941–950 of 1001 posts
This is a big deal for openai. Been working with homegrown toolkits and langchain, the open source version of this, for a number of months and the ability to call out to vectorstores, serpapis, etc, and chaining together generations and data-retrieval really unlocks the power of the LLMs. That being said, I'd never build anything dependent on these plugins. OpenAI and their models rule the day today, but who knows wh…
Short version: Is it spam? Yes. Scam? No. Ignore it at your own peril.
Long version: The cat is out of the bag now. The power of transformers is real. They are smarter and more intelligent than the least 20% smart humans (my approximation), and that’s already a breakthrough right there. I’ll paraphrase Steve Yegge:
> LLMs of today are like a Harvard graduate who did shrooms 4 hours ago, and is still a little high.
Putting the statistical/probability monkey aspect aside for a minute, empirically and anecdotally, they are incredibly powerful if you can learn how to harness them through intelligent prompts.
If they appear useless or dumb to you, your prompts are the reason why. Challenge them with a little guidance. They work better that way (read up on zero shot, one shot, two shot instructions).
What is most relevant this time is that they are real (an API, a search bot, a programming buddy) and democratized - available to anyone with an email address.
More on harnessing their power: squeezing your entire context into a 8k/32k token will be challenging for most complex applications. This is where prompt engineering (manual or automated) comes in.
To help with this, some very cool applications that use embeddings and vectors will push them even further - so the context can be shared as a compact vector instead of a large corpus of text.
While this is certainly better than a traditional search box, it’s still far from a fully-autonomous AI that can function with little to no supervision.
OpenAI plug-ins are a band-aid towards that vision, but they get us even closer.
Earlier quoted context omitted.
Honestly I suspect for anyone technical `langchain` will always be the way to go. You just have so much more control and the amount of "tools" available will always be greater. The only think that scares me a little bit is that we are letting these LLMs write and execute code on our machines. For now the worst that could happen is some bug doing something unexpected, but with GPT-9 or -10 maybe it will start hiding b…
Unpopular Opinion: Having used Langchain, I felt it was a big pile of spaghetti code / framework with poor dev experience. It tries to be too cute and it’s poorly documented so you have to read the source almost all the time. Extremely verbose to boot
Holy shit. Ignore the silly third party plugins, the first party plugins for web browsing and code interpretation are massive game changers. Up to date information and performing original research on it is huge. As someone else said, Google is dead unless they massively shift in the next 6 months. No longer do I need to sift through pages of "12 best recipes for Thanksgiving" blog spam - OpenAI will do this for me an…
I was considering doing the same (giving notice) and I'm doing similar things as you (product mgmt). What's your plan "to focus your career on what's happening in this field"?
This feels kinda like the blockchain rush ~5 years back, but with actual substantial potential rather than the obvious niche application of that tech.
Started watching the videos from Adrej - https://karpathy.ai/zero-to-hero.html quite impressed so far.
Earlier quoted context omitted.
As the past decade has shown us, moving fast and breaking things to secure unfathomable wealth has caused or enabled or perpetrated: * Genocide against the Rohingya [0] * A grotesquely unqualified reality TV character became President by a razor thin vote margin across three states because Facebook gave away the data of 87M US users to Cambridge Analytica [1], and that grotesquely unqualified President packed the Sup…
> I don't think GPT-4 will be a big deal in a month Why do you think that? Competition? Can you elaborate?
I've tried to find examples of ChatGPT doing impressive things that I could use in my own workflows, but everything I've found seems like it would cut an hour of googling down to 15 minutes of prompt generation and 40 minutes of validation.
And my biggest concern is copyright and license related. If I use code that comes out of AI-assistants, am I going to have to rip up codebases because we discover that GPT-4 or other LLMs are spitting out implementations from codebases with incompatible licenses? How will this shake out when a case inevitably gets to the Supreme Court?
Earlier quoted context omitted.
False equivalence. Sea level raise is unequivocally harmful. While everyone getting Einstein in a pocket is damn awesome and incredibly useful. How can this be bad?
We thought the same 25 years ago, when the whole internet-thing started for the broader audience. And now, here we are, with spam, hackers, scammers on every corner, social media driving people into depressions and suicides and breaking society slowly but hard. In the first hype-phase, everything is always rosy and shiny, the harsh reality comes later.
Earlier quoted context omitted.
> Omg you should see a therapist. How do you know I'm not already?
I wouldn't exactly call this suicidal ideation, but maybe a topic to broach at your next session.
Earlier quoted context omitted.
I guess I'm a bit vindicated from my prediction 40 days ago! "GPT needs a thalamus to repackage and send the math queries to Wolfram" https://news.ycombinator.com/item?id=34747990
Stephen Wolfram himself thought that Wolfram could be combined with GPT when ChatGPT was released like 4 months ago. Only due to that they worked together to build the plugin. He also authored the best article I've seen on how ChatGPT and more broadly LLMs work (that has now been turned into a book).
Earlier quoted context omitted.
OpenAi can't even fix the outage issue. Relax. This is the fire and motion strategy. https://www.joelonsoftware.com/2002/01/06/fire-and-motion/
If they were a company about infrastructure products, or they were using GPT-4 to manage their infrastructure, I'd weight that more heavily ;)
This is a big deal for openai. Been working with homegrown toolkits and langchain, the open source version of this, for a number of months and the ability to call out to vectorstores, serpapis, etc, and chaining together generations and data-retrieval really unlocks the power of the LLMs. That being said, I'd never build anything dependent on these plugins. OpenAI and their models rule the day today, but who knows wh…
> I'd never build anything dependent on these plugins You're thinking too long term. Based on my Twitter feed filled with AI gold rush tweets, the goal is to build something/anything while hype is at its peak, and you can secure a a few hundred k or million in profits before the ground shifts underneath you. The playbook is obvious now: just build the quickest path to someone giving you money, maybe it's not useful a…