Live data from Hacker News

What it feels like to work in AI right now

robotic.substack.com

271–280 of 768 posts

Re: What it feels like to work in AI right now

#271

Earlier quoted context omitted.

And you could even program the LLM to try to subtly manipulate people into using the advertised product.

A LLM trying to trick and manipulate? That's how your multi-million dollar model quickly becomes worthless in the eyes of the public.

People haven't been up in arms about the dishonesty around 'native' marketing.

Re: What it feels like to work in AI right now

#272
post #207
post #158

Earlier quoted context omitted.

Natural language is now a fully functional user interface out of the box. This is bigger than the mouse.

Fully functional in what way? As far as I can tell, ChatGPT is a box that I put sentences into, and I get grammatically correct sentences that contains topics or words loosely statistically correlated to what were in my sentences, that may or may not be correct and often are not. The box has little to no memory. I honestly don't see what's so useful about this box.

> and I get grammatically correct sentences that contains topics or words loosely statistically correlated to what were in my sentences, that may or may not be correct and often are not.

It's correct enough to pass the bar exam, medical exams, it scores 90-93 percentile on the SAT. This is way more complex and efficient than what you make it to be imo.

Re: What it feels like to work in AI right now

#273

This sub and blog post are all talking about ChatGPT which is no doubt amazing and far ahead of the curve. However I would also point to Metas new vision model: SAM (Segment Anything): it is so far beyond any other vision model, I actually believe vision will be solved in a few years now. People don’t realize that there was an industry of publishing paper with incremental improvements in small datasets in CVPR that h…

What does it mean to solve vision though?

Re: What it feels like to work in AI right now

#274
post #86

I won't try to predict the future as far as such ML models will take our jobs or not. However, I'd like to point out to most people that working on and studying fundamentals won't be a time wasted. Even if programming disappears as an employable job, people will still need to understand and learn things. You'll still need to know the math/physics/philosophy/history/literature/art/music etc. It might turn out that it'…

One sad, but possible, future is that it's not difficult to learn machine learning techniques, but to actually achieve anything with it you need hundreds of millions of dollars to spend on training and compute.

An existential double whammy; going back and forth between feeling you're smart enough to compete, if only you had the capital, and that the computers are smarter and better at everything.

Re: What it feels like to work in AI right now

#275

Earlier quoted context omitted.

You’re asking “what’s so big about GUIs? Literally nobody has asked to move a pointer around a screen”. It’s the use cases these thing enable that are important. Today, I wrote a draft product announcement. Only after I was done did I realize I had written it in a really impersonal third person (“users will be able to”). No big deal, but maybe 10-20 minutes of work to make it energetic and second person (“now you can…

I mean Google revolutionized search. Apple revolutionized personal computing. OpenAI revolutionized… rewriting things with slightly different wording? I’ve seen so many breathless people posting “this would have taken me so long to search” and then I type 3 keywords from their massive prompt they crafted and find it instantly on Google. We’re talking 1000x or more faster. I feel like the same is happening in your com…

It’s a hype bubble for hundreds of years and saying that doesn’t make chatgpt worth any less. I have definitely been surprised by this and gotta say I’m expecting AGI a lot faster now. Even if literally all it did was predict what the average internet user would write in a certain context, that’s huge, cuz when you integrate all the little advantages of all the weird things one person knows another doesn’t, the collective knowledge is worth more than the sum of the parts. A tool which can tap into the sum total of human knowledge 24/7 and more rapidly than I can propose more questions for it, mainly I’m just excited to play with larger context size models so I can include more code and get big picture ideas about groups of stuff that are too numerous for my feeble meat brain to reason about. 7-9 things in working memory has always been the thing that would make humans inferior to AI in the long run. Even if it’s not that insanely smart (but realize: intelligence is a probabilistic concept and computers are great at multiplying probabilities precisely) if the thing can fit more stuff in memory than us and type faster than us and it doesn’t get tired or overwhelmed and give up (imagine your capability in a world where you had no tiredness and unlimited self discipline) in time it’s inevitable the transformers put us all to shame, and the more complicated the topic, the bigger of a shaming it’ll be, since the more complicated topics have exponentially more relations to reason about. Who’s gonna trust a human doctor to diagnose their stuff if the human brain holds 9 things and the AI holds thousands?

Re: What it feels like to work in AI right now

#276

From my perspective it’s just _confusing_ to work in AI right now. We have some massive models that are doing some really neat stuff, and apparently hundreds of millions of people are using them—but I keep wondering: to do _what_, exactly? I’m not asking what the models can do, I’m asking what people want the models to do every day, all the time. I’ve been shown some neat pictures people made that they thought were c…

To be honest, I can't tell if you are genuinely wondering or just (virtue) signaling that you're not using it, but here's a sample of my own usage: https://news.ycombinator.com/item?id=35299121

Re: What it feels like to work in AI right now

#277

Earlier quoted context omitted.

I think this is a classic case of us overestimating the immediate impact and underestimating the long term impact. Right now, they are definitely useful time savers, but they need a lot of handholding. Eventually, someone will figure out how to get hundreds of LLMs supervising teams of millions of LLMs to do some really wild stuff that is currently completely impossible. You could spin up a giant staff the way we do…

>Eventually, someone will figure out how to get hundreds of LLMs supervising teams of millions of LLMs to do some really wild stuff that is currently completely impossible. This is an intuitive direction. In fact, it’s so intuitive that it’s a little bit odd that nobody seems to have made proper progress with LLM swarm computation.

In particular, it's odd that the greatest software developer in the world (ChatGPT) hasn't made progress with LLM swarm computation.

Re: What it feels like to work in AI right now

#278

Earlier quoted context omitted.

You’re asking “what’s so big about GUIs? Literally nobody has asked to move a pointer around a screen”. It’s the use cases these thing enable that are important. Today, I wrote a draft product announcement. Only after I was done did I realize I had written it in a really impersonal third person (“users will be able to”). No big deal, but maybe 10-20 minutes of work to make it energetic and second person (“now you can…

I mean Google revolutionized search. Apple revolutionized personal computing. OpenAI revolutionized… rewriting things with slightly different wording? I’ve seen so many breathless people posting “this would have taken me so long to search” and then I type 3 keywords from their massive prompt they crafted and find it instantly on Google. We’re talking 1000x or more faster. I feel like the same is happening in your com…

if we only focus on this part. this function represents that most of content creator don't need to convert or reproduce their content to fit another group of customers.

Re: What it feels like to work in AI right now

#279
post #221
post #163

Earlier quoted context omitted.

That interview is mind blowing stuff.

Yeah great interview style. It's non stop content.

I wonder if we saw the same video - or maybe it is just ChatGPT being "great" in the wild? I see one guy asking another guy simple questions and getting weaselwords for an answer.

Re: What it feels like to work in AI right now

#280
post #226
post #156

Earlier quoted context omitted.

ChatGPT is cool and novel, but FAANG's requirements for ML/AI go far beyond what ChatGPT provides as a product. ChatGPT is good at answering questions based on an older data set. FAANG typically requires up to date real time inference for huge rapidly changing data sets. Working on the practical side of ML/AI at FAANG, you will probably be working with some combination of feature stores, training platforms, inference…

ChatGPT is human level intelligence, it’s not just novel and cool, it’s the thing. Remember, GPT-4 training was finished 6 months ago. Listen to people at OpenAI, their concern is: disruption to the world, UBI, getting people used to superintelligence as part of our world. I think they have quite a few things in the pipeline. So yes ads optimisation/recommendations still need to be reliable for the time being, but fo…

GPT-4 is not human level intelligence, nor is is above or below. It’s quite a different kind of intelligence not entirely comparable to humans. That’s probably why we’re moving the AGI goalpost; we visualize AGI as a robot human, but these machines may simply be founded on too different principles to ever receive that honor.
Post reply on HN