Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Probabilistic Artificial Intelligence

arxiv.org

Post reply on HN
Print view View original

31–40 of 100 posts

Re: Probabilistic Artificial Intelligence

#31

Post by esafak »

whimsicalism wrote: post #30
keviniam wrote: post #27

Earlier quoted context omitted.

What would you (or other informed parties) recommend?

it’s been a while since I’ve been a beginner so I might not have the best resources, but I would recommend Harvard’s Stat 110 with Joe Blitzstein (lectures online) and then Machine Learning by Kevin Murphy. might be a scarier book to someone not confident in their math, but overall a better one imo for something more directly comparable to the niche ISLR filled, Bishop’s books are generally better - although I can’t…

https://www.bishopbook.com/ is the new one

Re: Probabilistic Artificial Intelligence

#32

Post by whimsicalism »

jgord wrote: post #28
fud101 wrote: post #20

Books suck (imho). We need a new format to teach and learn this deep technical stuff. Not youtube, something interactive with exercises and engagement.

yeah, I mean 3Blue1Brown has done a great job .. and maybe those would be even better if you could app-ify them into something you can interact with. Current gen of LLM programming AIs might make it less leg-work to make these

3b1b is great but if you want to do deep technical work, you’re eventually going to have to get comfortable with text as a medium

Re: Probabilistic Artificial Intelligence

#33

Post by antonkar »

jgord wrote: post #25
antonkar wrote: post #13

I think we’ll need a GUI for the models to democratize interpretability and let even gamers explore them. Basically to train another model, that will take the LLM and convert it into 3D shapes and put them in some 3D world that is understandable for humans. Simpler example: represent an LLM as a green field with objects, where humans are the only agents: You stand near a monkey, see chewing mouth nearby, go there (yo…

I dont think anyone has found a good way to map higher dimensional space onto 4D visualizations, yet. Maybe this is why tokens and language are so useful for humans ? they might be the closest analog we have.

Good point, I think at least some lossy “compression” into a GUI is possible. The guy who’ll make the GUI for LLMs is the next Jobs/Gates/Musk and Nobel Prize Winner (I think it’ll solve alignment by having millions of eyes on the internals of LLMs), because computers became popular only after the OS with a GUI appeared. I recently shared how one of its “apps” possibly can look: https://news.ycombinator.com/item?id=43319726

Re: Probabilistic Artificial Intelligence

#34

Post by antonkar »

soulofmischief wrote: post #19
antonkar wrote: post #13

I think we’ll need a GUI for the models to democratize interpretability and let even gamers explore them. Basically to train another model, that will take the LLM and convert it into 3D shapes and put them in some 3D world that is understandable for humans. Simpler example: represent an LLM as a green field with objects, where humans are the only agents: You stand near a monkey, see chewing mouth nearby, go there (yo…

I had a mind-bending Salvia trip at eighteen that went sort of like that. My mind turned into an infinitely large department store where each aisle was a concurrent branch of thought, and the common ingredient lists above each aisle were populated with words, feelings and concepts related to each branch. The PA system replaced my internal monologue, which I no longer had, but instead I was hearing my thoughts externa…

We have our first Neo candidate)

The guy who’ll make the GUI for LLMs is the next Jobs/Gates/Musk and Nobel Prize Winner (I think it’ll solve alignment by having millions of eyes on the internals of LLMs), because computers became popular only after the OS with a GUI appeared. I recently shared how one of its “apps” possibly can look: https://news.ycombinator.com/item?id=43319726

Re: Probabilistic Artificial Intelligence

#35

Post by thomasahle »

fud101 wrote: post #20

Books suck (imho). We need a new format to teach and learn this deep technical stuff. Not youtube, something interactive with exercises and engagement.

> something interactive with exercises and engagement

Books have exercises. It's your job to engage.

This book, in particular, has 3 pages of Problems per chapter. The only way to learn the math is to do all of them.

Re: Probabilistic Artificial Intelligence

#36

Post by wincy »

_rpxpx wrote: post #29
soulofmischief wrote: post #19

Earlier quoted context omitted.

I had a mind-bending Salvia trip at eighteen that went sort of like that. My mind turned into an infinitely large department store where each aisle was a concurrent branch of thought, and the common ingredient lists above each aisle were populated with words, feelings and concepts related to each branch. The PA system replaced my internal monologue, which I no longer had, but instead I was hearing my thoughts externa…

“When I began to navigate psychospace with LSD, I realized that before we were conscious, seemingly self-propelled human beings, many tapes and corridors had been created in our minds and reflexes which were not of our own making. These patterns and tapes laid down in our consciousness are walled off from each other. I see it as a vast labyrinth with high walls sealing off the many directives created by our personal…

I feel like if all the things people believe and espouse about hallucinogens were true and not just the effect of permanently damaging your mind, with the illusion of wisdom, we’d be able to point at all the revolutionary scientific breakthroughs and discoveries made under the influence of hallucinogenic substances.

However, everyone I’ve met who admits to having taken hallucinogens seems reduced in some way, rather than enhanced. Like the lights are on but someone else is home.

Re: Probabilistic Artificial Intelligence

#37

Post by meindnoch »

antonkar wrote: post #13

I think we’ll need a GUI for the models to democratize interpretability and let even gamers explore them. Basically to train another model, that will take the LLM and convert it into 3D shapes and put them in some 3D world that is understandable for humans. Simpler example: represent an LLM as a green field with objects, where humans are the only agents: You stand near a monkey, see chewing mouth nearby, go there (yo…

Sir, this is a Wendy's.

Re: Probabilistic Artificial Intelligence

#38

Post by cubefox »

cubefox wrote: post #12

Apparently they don't discuss language models at all.

Which is a major omission, as transformer-based language models are the most powerful available form of "probabilistic artificial intelligence". They predict a probability distribution over a token given a sequence of previous tokens.

My guess is that most of the content in the book is several years old (it's apparently based on an ETH Zurich class), despite the PDF being compiled this year, which would explain why it doesn't cover the state of the art.

Re: Probabilistic Artificial Intelligence

#39

Post by antonkar »

wincy wrote: post #36
_rpxpx wrote: post #29

Earlier quoted context omitted.

“When I began to navigate psychospace with LSD, I realized that before we were conscious, seemingly self-propelled human beings, many tapes and corridors had been created in our minds and reflexes which were not of our own making. These patterns and tapes laid down in our consciousness are walled off from each other. I see it as a vast labyrinth with high walls sealing off the many directives created by our personal…

I feel like if all the things people believe and espouse about hallucinogens were true and not just the effect of permanently damaging your mind, with the illusion of wisdom, we’d be able to point at all the revolutionary scientific breakthroughs and discoveries made under the influence of hallucinogenic substances. However, everyone I’ve met who admits to having taken hallucinogens seems reduced in some way, rather…

There is the Qualia Research Institute, one of the things they do is using dope and making simulations of the experience. They basically found 2 main types of drugs:

1. Most “create more separate personalities” in you

2. One (the “toad poison”) actually makes you feel like a giant place, the feeling is usually pleasant.

So there is either “agentification” of you into more “agents” or “space-ification” into one giant place without any agency in it. I think we can make this static place AI and it’ll be safe by definition because we’re the only agents in it.

P.S. I don’t promote drugs

Re: Probabilistic Artificial Intelligence

#40

Post by bongodongobob »

wincy wrote: post #36
_rpxpx wrote: post #29

Earlier quoted context omitted.

“When I began to navigate psychospace with LSD, I realized that before we were conscious, seemingly self-propelled human beings, many tapes and corridors had been created in our minds and reflexes which were not of our own making. These patterns and tapes laid down in our consciousness are walled off from each other. I see it as a vast labyrinth with high walls sealing off the many directives created by our personal…

I feel like if all the things people believe and espouse about hallucinogens were true and not just the effect of permanently damaging your mind, with the illusion of wisdom, we’d be able to point at all the revolutionary scientific breakthroughs and discoveries made under the influence of hallucinogenic substances. However, everyone I’ve met who admits to having taken hallucinogens seems reduced in some way, rather…

It happens all the time. DNA double helix is a good example. You really think people are going to mention their drug use in white papers? I think not. Nothing to gain and everything to lose.
Post reply on HN