11–20 of 32 posts
I can’t help but wonder if we were able to feed a lot of whale communications into LLMs with this new found layer of information if we would be able to translate someday.
Earlier quoted context omitted.
Well, lets get an LLM to translate one of the not understood human languages first. Could we build a chat GPT for whales to use, with this approach, sure. Does that get us any closer to translating it. NO, because without shared context to start building connections and relationships its highly unlikely that were going to find commonality.
>Well, lets get an LLM to translate one of not understood human languages first. You can do both. Models trained to receive and predict audio tokens alongside text are coming. You could just add such data as part of training. >Does that get us any closer to translating it. NO, because without shared context to start building connections and relationships its highly unlikely that were going to find commonality. If you…
But whales? What we are (probably) proposing is putting two languages side by side with NO context and saying "figure it out".
Here is a great example of people and language and perception: https://news.mit.edu/2023/how-blue-and-green-appeared-langua...
Im fairly confident that unless we give an LLM a LOT of context between data sets to work with that it won't make much progress at all.
I can’t help but wonder if we were able to feed a lot of whale communications into LLMs with this new found layer of information if we would be able to translate someday.
Well, lets get an LLM to translate one of the not understood human languages first. Could we build a chat GPT for whales to use, with this approach, sure. Does that get us any closer to translating it. NO, because without shared context to start building connections and relationships its highly unlikely that were going to find commonality.
Earlier quoted context omitted.
https://youtu.be/hph9OeKjg3w -- here's a video about this about a research effort to accomplish precisely this.
What do whales do if we "replay" their sounds?
I can’t help but wonder if we were able to feed a lot of whale communications into LLMs with this new found layer of information if we would be able to translate someday.
I can’t help but wonder if we were able to feed a lot of whale communications into LLMs with this new found layer of information if we would be able to translate someday.
Well, lets get an LLM to translate one of the not understood human languages first. Could we build a chat GPT for whales to use, with this approach, sure. Does that get us any closer to translating it. NO, because without shared context to start building connections and relationships its highly unlikely that were going to find commonality.
Earlier quoted context omitted.
>Well, lets get an LLM to translate one of not understood human languages first. You can do both. Models trained to receive and predict audio tokens alongside text are coming. You could just add such data as part of training. >Does that get us any closer to translating it. NO, because without shared context to start building connections and relationships its highly unlikely that were going to find commonality. If you…
the sounds for man, and the word man can be mapped. The concept of man can be mapped from English to Chinese. Given enough of these clues, and a large enough data set it's not shocking that models get decent at inference between languages. But whales? What we are (probably) proposing is putting two languages side by side with NO context and saying "figure it out". Here is a great example of people and language and pe…
while ww2 code breaking contained other human contexts, perhaps like-context observations could allow for certain categories that might reveal linguistic insights of whales. like whale sounds observed consistently near boats, divers, danger, eating, play, etc.
no clue about how LLM/AI systems process meta contextual training data inputs (is this even a valid phrase about AI?! haha) but i hope whale linguists have considered such an approach.
Earlier quoted context omitted.
Well, lets get an LLM to translate one of the not understood human languages first. Could we build a chat GPT for whales to use, with this approach, sure. Does that get us any closer to translating it. NO, because without shared context to start building connections and relationships its highly unlikely that were going to find commonality.
Not understood human languages are in general languages with a low amount of source material.
I can’t help but wonder if we were able to feed a lot of whale communications into LLMs with this new found layer of information if we would be able to translate someday.
That’s the kind of task I really want to see LLMs used for - not just to replicate things humans can already do, but to explore things that humans haven’t figured out yet. Maybe we don’t know enough to pick up on the rhyme and reason of whale communication yet , but brute-forcing it with an AI seems like a great way to get a fresh perspective.
Earlier quoted context omitted.
Not understood human languages are in general languages with a low amount of source material.
given unrestricted compute, could an AI attempt to decipher a completely unknown language through interpreting O(n) brute iterations and reporting versions that are coherent to human heuristics?
One plank of wood is not enough to determine solely if it was intended to be part of a house or part of a boat