Live data from Hacker News

Generative AI's Act Two

sequoiacap.com

111–120 of 125 posts

Re: Generative AI's Act Two

#111
post #69

Earlier quoted context omitted.

HFRL is literally just training the AI to be convincing. That's what these systems are optimized for.

Is it really that different from socialization (particularly primary socialization [0]), whereby we teach kids our social norms with the aim of them not being sociopaths? [0] https://en.wikipedia.org/wiki/Primary_socialization

Why does it feel so slimey and dehumanizing when you guys post bullshit like this?

Re: Generative AI's Act Two

#113
post #109
post #29

Earlier quoted context omitted.

The counterpoint to this is always "models work with numerical vectors and we translate those to/from words" These things feel sentient because they talk like us, but if I told you that I have a machine that takes 1 20k-dimensional vector and turns it into another meaningful 20k-dimensional vector, you definitely wouldn't call that sentience.

Yes, and you wouldn't believe you're made out of cells as well. The brain can't see, hear, smell, etc directly and neither can it talk or move hands or feet. "All" it does is receive incoming nerve signals from sensor neurons (which are connected to our sensory organs) and emit outgoing nerve signals through motor neurons (which are connected to our muscles). So the "data format" is really not that different.

Are you sure that is all the brain does?

Re: Generative AI's Act Two

#114

Can't wait for most of these companies to disappear once the hype dies down and the money dries up. Generative AI in its current form is a huge letdown.

Have you tried coding with it yet? Easy to see how you could get that impression from just playing with ChatGPT, but copilot/cursor/dropping stack traces into gpt4 is transformational.

In my experience talking architecture through with GPT4 has increased my productivity and enjoyment of development, and certain things like explain this typescript error to me or generate an elaborate mermaidjs chart for me that shows x,y,z have all been delightful.

That said, I've spent hours this week trying many different AI enhanced IDEs including cursor and I cannot for the life of me get anything to correctly set up jest in a TypeScript project - next.js or just vanilla TS... every single one does not correctly handle the Babel / tsconfig issues.

What I'm saying is I still think we'll see improvements over time but it's not quite there yet. I still prefer Codeium for completion and to take some boilerplate from gpt4 and modify it to my purposes.

Re: Generative AI's Act Two

#115
post #109

Earlier quoted context omitted.

Yes, and you wouldn't believe you're made out of cells as well. The brain can't see, hear, smell, etc directly and neither can it talk or move hands or feet. "All" it does is receive incoming nerve signals from sensor neurons (which are connected to our sensory organs) and emit outgoing nerve signals through motor neurons (which are connected to our muscles). So the "data format" is really not that different.

Are you sure that is all the brain does?

As far as "inputs and outputs" are concerned, yes. (Well, not quite, I think there is also communication with the body going on through chemical signals - but even this doesn't have to do a lot with how we experience our senses)

Not a neurologist, but that's about what you can read in basic biology textbooks.

Re: Generative AI's Act Two

#116
post #110
post #46

Earlier quoted context omitted.

Bro, I can't even do 5 dimensional vector math. EDIT: I couldn't help but make the joke, but I am certain my brain is doing zero dot products as a type this. What these models do is just different. We should consider what that means, and the 'sentience' jump is just lazy thinking to avoid that.

Sorry to tell you, but your brain is doing millions of dot products - it's what the biochemical reactions in the synapses between neurons amount to. We already know how the brain works on that level, we just don't know how it works on a higher level.

Sorry to tell you, but neurons do not follow a dot product structure in any way shape or form beyond basic metaphor.

I mean fine I’ll play along - is it whole numbers? Floating points? How many integers? Are we certain that neurons are even deterministic?

The point I’m making is this whole overuse of metaphor (I agree it’s an ok metaphor) belittles both what the brain and these models are doing. I get that we call them perceptrons and neurons, but friend, don’t tell me that a complex chemical system that we don’t understand is “matrix math” because dendrites exist. It’s kind of rude to your own endocrine system tbh.

Transformers and your brain are both extremely impressive and extremely different things. Doing things like adding biological-inspired noise and biological-inspired resilience might even make Transformers better! We don’t know! But we do know oversimplifying the model of the brain won’t help us get there!

Re: Generative AI's Act Two

#117

I see we are in peak bullshit again. AI will be a force amplifier. great, we get that. I suspect that this kind of vague marketing bollocks will be generated almost without any oversight soon. However there are also risks. Just like calico which used to be a really expensive luxury, and then with empire and colonialism, and later mechanisation became a cheap(er) commodity, LLMs will kneecap whole industries. I think…

> I think any site that relies on advertising on the web is going to die.

What? No. The only known useful application of generative LLMs is to write automatic ad copy. This means the cost of doing advertising will lower dramatically and we'll get more of it. (Mostly "native" ads in places where putting ad copy was previously not economically feasible - e.g., twitter posts, tiktoks, etc.)

Re: Generative AI's Act Two

#118
Hilariously for me (I’m a Microsoft FTE, fyi) there’s no mention of Bing, any of the multiple Copilot products in the Office/enterprise space, or, tellingly, the Azure OpenAI service (which provides you with private endpoints and models). I do see startups that use it, but it is a grossly lopsided view of the “market”.

(And regardless of my employer, there are a lot of consumer and enterprise-focused solutions in that space - including direct competition - that aren’t mentioned anywhere.)

Re: Generative AI's Act Two

#119

I see we are in peak bullshit again. AI will be a force amplifier. great, we get that. I suspect that this kind of vague marketing bollocks will be generated almost without any oversight soon. However there are also risks. Just like calico which used to be a really expensive luxury, and then with empire and colonialism, and later mechanisation became a cheap(er) commodity, LLMs will kneecap whole industries. I think…

> I think any site that relies on advertising on the web is going to die. What? No. The only known useful application of generative LLMs is to write automatic ad copy. This means the cost of doing advertising will lower dramatically and we'll get more of it. (Mostly "native" ads in places where putting ad copy was previously not economically feasible - e.g., twitter posts, tiktoks, etc.)

Where is the vast majority of advertising now? on websites.

If you are not going to websites anywhere near as much to get info, then the cost per click goes through the roof. Money drains from the system, those websites disappear.

Re: Generative AI's Act Two

#120

I love the AI space, but I wonder if the internet comparison is valid? Isn't it more like the cloud or mobile? Most apps will have AI of some sort. It's an infrastructure serving the problem. It isn't a completely new distribution medium, consumption mechanism.

Agreed that it is different to mobile or cloud that it is not a distribution mechanism
Post reply on HN