Live data from Hacker News

All AI models might be the same

blog.jxmo.io

21–30 of 157 posts

Re: All AI models might be the same

#21

Is it closer to Mussolini or bread? Mussolini. Is it closer to Mussolini or David Beckham? Uhh, I guess Mussolini. (Ok, they’re definitely thinking of a person.) That reasoning doesn't follow. Many things besides people would have the same answers, for instance any animal that seems more like Mussolini than Beckham.

Oswald Mosley

Re: All AI models might be the same

#22

Is it closer to Mussolini or bread? Mussolini. Is it closer to Mussolini or David Beckham? Uhh, I guess Mussolini. (Ok, they’re definitely thinking of a person.) That reasoning doesn't follow. Many things besides people would have the same answers, for instance any animal that seems more like Mussolini than Beckham.

Whoops. I hope you can overlook this minor logical error.

Oh yeah it's absolutely an interesting article!

Re: All AI models might be the same

#23

I think “we might decode whale speech or ancient languages” is a huge stretch. Context is the most important part of what makes language useful. There is billions of human-written texts, grounded in shared experience that makes our AI good at language. We don't have that for a whale.

If a lion could speak, would we understand it?

Re: All AI models might be the same

#24
The devil is in the details.

I recently gave the "Veeam Intelligence" a spin.

Veeam is a backup system spanning quite a lot of IT systems with a lot of options - it is quite complicated but it is also a bounded domain - the app does as the app does. It is very mature and has extremely good technical documentation and a massive amount of technical information docs (TIDs) and a vibrant and very well informed set of web forums, staffed by ... staff and even the likes of Anton Gostev - https://www.veeam.com/company/management-team.html

Surely they have close to the perfect data set to train on?

I asked a question about moving existing VMware replicas from one datastore to another and how to keep my replication jobs working correctly. In this field, you may not be familiar with my particular requirements but this is not a niche issue.

The "VI" came up with a reasonable sounding answer involving a wizard. I hunted around the GUI looking for it (I had actually used that wizard a while back). So I asked where it was and was given directions. It wasn't there. The wizard was genuine but its usage here was a hallucination.

A human might have done the same thing with some half remembered knowledge but would soon fix that with the docs or the app itself.

I will stick to reading the docs. They are really well written and I am reasonably proficient in this field so actually - a decent index is all I need to get a job done. I might get some of my staff to play with this thing when given a few tasks that they are unfamiliar with and see what it comes up with.

I am sure that domain specific LLMs are where it is at but we need some sort of efficient "fact checker" system.

Re: All AI models might be the same

#25
LLMs are bruteforce reverse engineered human brains. Think about it. Any written text out there is written by human brains. The ”function” to output this is whatever happens inside the brain, insanely complex.

LLM ”training” is just brute forcing the same function into existence. ”Human brain output X, llm output Y, mutate it times billion until X and Y start matching”

Re: All AI models might be the same

#26
post #23

I think “we might decode whale speech or ancient languages” is a huge stretch. Context is the most important part of what makes language useful. There is billions of human-written texts, grounded in shared experience that makes our AI good at language. We don't have that for a whale.

If a lion could speak, would we understand it?

There is nothing really special about speech as a form of communication. All animals communicate with each other and with other animals. Informational density and, uhhhhh, cyclomatic complexity might be different between speech and a dance or a grunt or whatever.

Re: All AI models might be the same

#27
post #23

I think “we might decode whale speech or ancient languages” is a huge stretch. Context is the most important part of what makes language useful. There is billions of human-written texts, grounded in shared experience that makes our AI good at language. We don't have that for a whale.

If a lion could speak, would we understand it?

That was a philosophical position on the difficulty of understanding alien concepts and language, not a hard technological limit.

Re: All AI models might be the same

#29
post #23

Earlier quoted context omitted.

If a lion could speak, would we understand it?

There is nothing really special about speech as a form of communication. All animals communicate with each other and with other animals. Informational density and, uhhhhh, cyclomatic complexity might be different between speech and a dance or a grunt or whatever.

I was referencing Wittgenstein's "If a lion could speak, we would not understand it." Wittgenstein believed (and I am strongly inclined to agree with him) that our ability to convey meaning through communication was intrinsically tied to (or, rather, sprang forth from) our physical, lived experiences.

Thus, to your point, assuming communication, because "there's nothing really special about speech", does that mean we would be able to understand a lion, if the lion could speak? Wittgenstein would say probably not. At least not initially and not until we had built shared lived experiences.

Re: All AI models might be the same

#30
post #23

I think “we might decode whale speech or ancient languages” is a huge stretch. Context is the most important part of what makes language useful. There is billions of human-written texts, grounded in shared experience that makes our AI good at language. We don't have that for a whale.

If a lion could speak, would we understand it?

Knowing lions I bet all they’d talk about is being straight up dicks to anyone and everyone around them so yea I think we probably could ngl
Post reply on HN