Live data from Hacker News

What it feels like to work in AI right now

robotic.substack.com

251–260 of 768 posts

Re: What it feels like to work in AI right now

#251

From my perspective it’s just _confusing_ to work in AI right now. We have some massive models that are doing some really neat stuff, and apparently hundreds of millions of people are using them—but I keep wondering: to do _what_, exactly? I’m not asking what the models can do, I’m asking what people want the models to do every day, all the time. I’ve been shown some neat pictures people made that they thought were c…

- Amazing translations (this alone is a game changer) - Language learning... The ability to improvise realistic conversations is huge. I can ask to talk about cooking a specific dish or a sport! - As others have noted, refining documents similar to grammarly - Looking for a product with extremely specific features (though it isn't very good at comparing yet) - Searches that are too vague and complicated to articulate…

I don’t think people dismissing AI have access to GPT-4 yet. GPT-3.5 did feel like a gimmick.

GPT-4 feels like a team of really capable human interns.

The potential really goes wild once you connect it to the internet and use stuff like autoGPT

Re: What it feels like to work in AI right now

#252
post #238

Earlier quoted context omitted.

I believe that you are half right. AI is going to radically change the world, but not now, maybe in 10 years. The pace of research is slower than the expectations of investors. This will lead to the perception of a boom and bust and AI winter, but in reality there will be slow steady improvements. It’s just been commercialized too soon.

There is also the other (very high in my opinion) possibility that LLM will hit a wall in regards to performance and a new model is required. It's unfortunate that the current VC landscape encourages this single shot mentality instead of diversification. This will not help in the AI winter since most people will be invested in the same thing.

Wouldn't it stand to reason that LLMs should be obsolete in about a year due to the singularity event and the rapid speed which we're moving towards AGI and then onto exponential technology growth due to ASI?

At this point, as an AI researcher, I guess you'd just have to sit back and watch is all unfold, very soon everything you do is obsolete almost immediately.

Re: What it feels like to work in AI right now

#253

Earlier quoted context omitted.

And you could even program the LLM to try to subtly manipulate people into using the advertised product.

A LLM trying to trick and manipulate? That's how your multi-million dollar model quickly becomes worthless in the eyes of the public.

Not if it was REALLY good at everything else and really subtle.

Re: What it feels like to work in AI right now

#254

Earlier quoted context omitted.

> I have zero proof, but I suspect Google for instance has models that would literally obliterate what openai has shown capability wise. They're probably not necessarily language models though. Again, nothing to stand on here but I doubt their search and analytics for example are driven by hard coded algorithms these days. Then why is Bard so bad? Bard feels like GPT-2 or LLaMA 7B with no finetuning most of the time…

Googler here, opinions my own, etc. From my perspective, Bard went from "literally didn't exist" to "released" over the course of about a month. GP seems correct in that it very much felt like something picked up off the shelf, slightly dusted off, and released. Is it as good as chatGPT? From my testing, no. Is it the pinnacle of what Google can create, given motivation? I'm pretty sure also no. In comparison to the…

Google is in a weird spot. I suspect they are capable of doing so much more, but there is a serious risk to cannibalizing their 99% revenue model (search), which they probably don't yet know if they can monetize in the same way.

Unfortunately for them, OpenAI has forced the question down their throat, which I think is exactly what they intended or at least hoped for.

Re: What it feels like to work in AI right now

#255

From my perspective it’s just _confusing_ to work in AI right now. We have some massive models that are doing some really neat stuff, and apparently hundreds of millions of people are using them—but I keep wondering: to do _what_, exactly? I’m not asking what the models can do, I’m asking what people want the models to do every day, all the time. I’ve been shown some neat pictures people made that they thought were c…

> I’ve been shown some neat pictures people made that they thought were cool. I don’t know that I need this every day.

3d and motion and this becomes the holodeck, you describe a scene and it creates it direct to your vr goggles.

Generative AI that can take in a scene and alter it rather than fully create it becomes real augmented reality from sci-fi: not just a HUD or greenscreened in elements, major transformations.

Re: What it feels like to work in AI right now

#256

Earlier quoted context omitted.

> I have zero proof, but I suspect Google for instance has models that would literally obliterate what openai has shown capability wise. They're probably not necessarily language models though. Again, nothing to stand on here but I doubt their search and analytics for example are driven by hard coded algorithms these days. Then why is Bard so bad? Bard feels like GPT-2 or LLaMA 7B with no finetuning most of the time…

well my thought is that they 'whipped it up' real quick to attempt to downplay it a bit. Did that backfire? Yeah, I think so. But personally, I think people are missing where the real money is. OpenAI will do great for awhile until every damn product and service is using it, and then it's a race to the bottom. But that's just like my opinion...

I dunno, the stock price hasn't really tanked, so it didn't really backfire that much and it allowed them to get a bit of feedback as they try to figure out how to maintain revenue.

What if they put out this insanely great model and people just stopped using search? That would be a backfire most likely.

Re: What it feels like to work in AI right now

#258

Earlier quoted context omitted.

Surely this technology will be used for the benefit of humanity. By 2030 we will be working 15 hour weeks and all people will have homes!

The reward for increased productivity is more work! The problem for the capitalist is having to pay all those pesky people to do the work. Eats into profits. Now we can burn out 2 people and do the work that used to take 10!

But wait, that means there 8 unemployed people without money to spend on our business...

Oh I know! Get the government to give everyone money! Just not so much money that they can compete with us!

Re: What it feels like to work in AI right now

#259

From my perspective it’s just _confusing_ to work in AI right now. We have some massive models that are doing some really neat stuff, and apparently hundreds of millions of people are using them—but I keep wondering: to do _what_, exactly? I’m not asking what the models can do, I’m asking what people want the models to do every day, all the time. I’ve been shown some neat pictures people made that they thought were c…

> I’m asking what people want the models to do every day, all the time

I know three regular people using ChatGPT, here's how they're using it:

1. Franchise consultant: uses it to research opportunities, has it write business letters to franchisees he wishes to contact. Saves him time and is a better writer than he is.

2. Immigration lawyer: uses it to summarize info and write emails to clients. Saves her a ton of time.

3. School teacher: uses it to write report card and assignment feedback. It doesn't save any time at all, but the output is more elegant than if he wrote it manually.

Re: What it feels like to work in AI right now

#260

From my perspective it’s just _confusing_ to work in AI right now. We have some massive models that are doing some really neat stuff, and apparently hundreds of millions of people are using them—but I keep wondering: to do _what_, exactly? I’m not asking what the models can do, I’m asking what people want the models to do every day, all the time. I’ve been shown some neat pictures people made that they thought were c…

The thing has enabled me to upgrade a major code project into an exciting direction in a short amount of time. Paradoxically I find it does better with more difficult tasks because the prompts tend to have more detail. the thing can generate semantic cypher queries for combinations of combinations of combinations of elements if you want, it’s ridiculous at coding already and only gonna get more insanely good at it in the future. Yeah, sometimes it forgets context and you have to guide it a little, it still can rewrite a whole module in a new style with lots of specific changes under 2 minutes, good luck coming close to typing that fast even if you did know exactly what to write, coding feels pretty revolutionized overnight right now for me tbh
Post reply on HN