Live data from Hacker News

Generative AI's Act Two

sequoiacap.com

81–90 of 125 posts

Re: Generative AI's Act Two

#81
post #73
post #40

Earlier quoted context omitted.

What if I told you I have a machine that takes 1 20k-dimensional vector and turns it into another meaningful 20k-dimensional vector, but the machine is made of a bunch of proteins and fats and liquids and gels? Would you be willing to call it sentient now?

[flagged]

The people seeking to exclude numerical vectors as being possible to be involved in consciousness seem to me to be the ones that you should direct this ire at.

Re: Generative AI's Act Two

#82
post #3

Is there room for generative AI in science? I am experimenting with this a lot at https://atomictessellator.com , As a computational chemist I found it difficult just to stay on top of all of the papers that are released, I thought it would be cool to have generative AI attempt to reproduce the experiments using simulation tech. Here's a few cool insights I have uncovered while working on this: - Developer tools are…

Yes, but most of the current ideas on how this moment will change science are willfully short-sighted.

We are only a few years from next generation multimodal modeling. The future contains protein embeddings, genome embeddings, medical image embeddings, and chatbot decoders to discuss them with you.

Imagine prompting an image-conditioned decoder with questions like "Q: Why do you think this brain MRI indicates the person will get Parkinson's?" These are things that models can currently do, but we have basically no understanding of what they are looking at.

Re: Generative AI's Act Two

#83

Can't wait for most of these companies to disappear once the hype dies down and the money dries up. Generative AI in its current form is a huge letdown.

Typical HN pessimism, but I strongly disagree with anyone characterizing it as a huge letdown. Even if you personally don't get much use out of it (honestly hard for me to believe if you give it a fair try), there are tons of uses that will be impacting you significantly within the next year. Contrast that with crypto.

It's going to be one of those things like the internet where over the next decade it will have massively impacted every aspect of life but no one will fully appreciate how much everything has changed.

Re: Generative AI's Act Two

#84

Earlier quoted context omitted.

I think it absolutely has. Certainly in developer tools, but you can see it in other tools like Hubspot, Gong, etc. Not to mention the enterprise organizations who are building their own features that use LLMs. Yes, we'll see some "enterprises" adopt their first LLM in 10 years because some move as slow as molasses. That's fine; there's companies who are tasting Cloud for the first time right now, but nobody is sayin…

Are there any examples of companies turning a GAAP profit using generative models that aren’t selling the shovels, but actually using them to dig?

Uh... everywhere?

I forget how far from industry HN can be sometimes.

Re: Generative AI's Act Two

#85
post #3

Is there room for generative AI in science? I am experimenting with this a lot at https://atomictessellator.com , As a computational chemist I found it difficult just to stay on top of all of the papers that are released, I thought it would be cool to have generative AI attempt to reproduce the experiments using simulation tech. Here's a few cool insights I have uncovered while working on this: - Developer tools are…

> Is there room for generative AI in science? I would love a system like ChatGPT but targeted specifically at exploring existing literature. A system that can recommend papers to read, that you can chat with about your problem and can recommend approaches that have worked for others and tell you why. That you can prompt and refine and go into detail with while it helps you figure out what do next based on previous wo…

I agree, I think there is a wide open vista of opportunity in the hypothesis generation space when it comes to science. An instant literature-review-as-a-service would be incredibly valuable too, to say nothing of a, "write the code to implement the methods described in this paper."

Re: Generative AI's Act Two

#86
post #47

Earlier quoted context omitted.

Just remember that Sequoia deleted their Sam Bankman-Fried puff piece.

More evidence they are incapable of predicting where the future of technology lies

Their salaries depend on their ability to shill this stuff, not be objective.

Re: Generative AI's Act Two

#87

Earlier quoted context omitted.

Are there any examples of companies turning a GAAP profit using generative models that aren’t selling the shovels, but actually using them to dig?

Uh... everywhere? I forget how far from industry HN can be sometimes.

Wow, thanks, I learned a lot from your examples.

Re: Generative AI's Act Two

#88
post #69

Earlier quoted context omitted.

Isn't the takeaway : "holy shit, these things are advanced enough to make people like Blake Lemoine believe they are sentient?"

HFRL is literally just training the AI to be convincing. That's what these systems are optimized for.

Is it really that different from socialization (particularly primary socialization [0]), whereby we teach kids our social norms with the aim of them not being sociopaths?

[0] https://en.wikipedia.org/wiki/Primary_socialization

Re: Generative AI's Act Two

#89
post #74

Earlier quoted context omitted.

But that's not how it works at all? If I watch 100s of artists cell shade something and build a normal piece of software that mimics the results I owe them absolutely nothing. I've not seen an explanation as to why this is different.

People are fine with AI learning stuff from others. People are not fine with AI trained on everyone's recorded work and then replacing everyone to make massive profits for just that company. Private owned GAI is a dystopia, shared GAI is utopia like star trek. The difference might seem tiny today, but people really don't want to go down the dystopia route.

[deleted]

Re: Generative AI's Act Two

#90
post #37

“Four decades of the internet (accelerated by COVID) has given us trillions of tokens’ worth of training data.” What’s up with the “accelerated by COVID”? It feels completely out of place. Would we have not had enough training data if COVID didn’t happen? Blessings in disguise, I guess.

The only way I can interpret that is assuming it is referring to the massive uptick in video conferencing which COVID caused. Although I'm not sure what data programs like Zoom actually collected and if it was shared with generative AI creators.
Post reply on HN