Live data from Hacker News

What it feels like to work in AI right now

robotic.substack.com

411–420 of 768 posts

Re: What it feels like to work in AI right now

#411

From my perspective it’s just _confusing_ to work in AI right now. We have some massive models that are doing some really neat stuff, and apparently hundreds of millions of people are using them—but I keep wondering: to do _what_, exactly? I’m not asking what the models can do, I’m asking what people want the models to do every day, all the time. I’ve been shown some neat pictures people made that they thought were c…

It's a hype bubble. There's a small group if die-hards in the tech-adjacent VC community that talk it up to no end and attack anyone who disagrees (I just saw a guy ask you if you were "virtue signaling" with your post - lol. And there's lots of people exploring how it could potentially be commercially useful - just like with blockchain. As everyone points out, it's got more going for it than blockchain did because i…

[flagged]

Re: What it feels like to work in AI right now

#412

Earlier quoted context omitted.

I feel that there’s significant insecurity among a lot of coders about GPT-4. A lot of them are ignoring the pace of improvement and highlighting the few off chances where it gets things wrong.

I've not used GPT-4, so it could be different, but regular old GPT-3.5 gets a _lot_ of things wrong.

GPT 4 is quite astounding. It might be wrong on occasion, but it will easily point you in the right direction most of the time. It still messes up, but like a twentieth of what 3.5 did. Honestly it is like an incredible rubber ducky for me. Not only can I just talk like I’m talking to a rubber duck but I can get fast, mostly informed, feedback that unblocks me. If I have a bunch of things competing for my attention I can ask gpt about one of them, a hard one, go do something else while it types out its answer, and then come back later and move on with that project.

Re: What it feels like to work in AI right now

#413

Earlier quoted context omitted.

What does it mean to solve vision though?

It's 2023 and tesla still can't reliably read traffic lights. Sounds like you know vision has a long way to go but I'd expect in the future it'll be harder to make that case. Maybe that's all that's meant.

It works for me. Do you have an article or something discussing the Tesla limitations?

Re: What it feels like to work in AI right now

#414

From my perspective it’s just _confusing_ to work in AI right now. We have some massive models that are doing some really neat stuff, and apparently hundreds of millions of people are using them—but I keep wondering: to do _what_, exactly? I’m not asking what the models can do, I’m asking what people want the models to do every day, all the time. I’ve been shown some neat pictures people made that they thought were c…

Text redaction - if any part of job is about writing, you can now just brain dump everything, structure it more or less, throw into chatgpt, and make it produce a clear and readable article. In my case, the output is better than anything I would ever write.

Ditto all the redacting work in newspapers, intranet etc. The whole field of proofreaders was virtually extinguished overnight.

Marketing agencies - and I spoke to a few - increased their workers' producitivity 2-4 times (sic!), virtually overnight. Anything from writing briefs to writing copy.

Programming - most of my programming work is deep algorithms, so not much help here, but for writing boiler plate code with new APIs, or writing in a language that I'm a bit rusty in, chatgpt is better than anything else.

Customer service helplines / chatbots (and the same for intranet) - we don't see it just yet, because it takes a bit more time to build a good system, but there are probably thousands projects right now worldwide building those for any niche concievable.

Business intelligence - we used, with success, ChatGPT in our deep tech seedfund, for helping out with initial project ddil.

And, essentially, rubber ducking, but for every single field out there. I just discussed with a psychiatrist how he can use even boilerplate GPT-4 as an additional consultant. You need to be aware of limitations of course, but it is already immensely useful in it's current form - and dedicated solutions for medicine are coming very soon.

That's the short-term perspective and low hanging fruits. On top of that, you have thousands projects now, that are figuring out how to apply LLMs to specific niches. It was difficult before, because you had to train your own models, and now you can just fine tune the existing ones, do embeddings, or just plain prompt engineering.

Oh, and also synergy with different AI modalities - we've had a massive growth in voice recognition and generation, visual recognition, and so on. And LLMs are a glue that adds a layer of understanding underneath.

Re: What it feels like to work in AI right now

#415
post #364

Earlier quoted context omitted.

Are you using GPT4 or 3?

GPT-3. I assumed that's what most people mean with ChatGPT. Usually, people specify for 3.5 or 4. Is GPT-4 significantly better with Japanese?

It's night and day in Japanese.

Re: What it feels like to work in AI right now

#416
post #413

Earlier quoted context omitted.

It's 2023 and tesla still can't reliably read traffic lights. Sounds like you know vision has a long way to go but I'd expect in the future it'll be harder to make that case. Maybe that's all that's meant.

It works for me. Do you have an article or something discussing the Tesla limitations?

https://www.ndtv.com/offbeat/watch-tesla-autopilot-feature-m...

This is 2021, but these systems are still not very smart today.

Re: What it feels like to work in AI right now

#417

Earlier quoted context omitted.

You’re asking “what’s so big about GUIs? Literally nobody has asked to move a pointer around a screen”. It’s the use cases these thing enable that are important. Today, I wrote a draft product announcement. Only after I was done did I realize I had written it in a really impersonal third person (“users will be able to”). No big deal, but maybe 10-20 minutes of work to make it energetic and second person (“now you can…

I mean Google revolutionized search. Apple revolutionized personal computing. OpenAI revolutionized… rewriting things with slightly different wording? I’ve seen so many breathless people posting “this would have taken me so long to search” and then I type 3 keywords from their massive prompt they crafted and find it instantly on Google. We’re talking 1000x or more faster. I feel like the same is happening in your com…

As for googling, here are some examples of queries you can try and see how it works:

- summary of all the carbon neutral concrete methods, especially ones that can be done in a small industrial workshop as a prototype

- I have allergies in Thailand, mid-february. What may it be related to?

- list all the companies from Japanese stock exchange that have high debt rate

Those are top of my head, but really anything that is either a super-specific niche, or requires merging a few niches together, Google won't help you with.

Re: What it feels like to work in AI right now

#418

Earlier quoted context omitted.

GPT-3. I assumed that's what most people mean with ChatGPT. Usually, people specify for 3.5 or 4. Is GPT-4 significantly better with Japanese?

It's night and day in Japanese.

I guess I should give it a spin then.

Re: What it feels like to work in AI right now

#419
post #205

From my perspective it’s just _confusing_ to work in AI right now. We have some massive models that are doing some really neat stuff, and apparently hundreds of millions of people are using them—but I keep wondering: to do _what_, exactly? I’m not asking what the models can do, I’m asking what people want the models to do every day, all the time. I’ve been shown some neat pictures people made that they thought were c…

You are not missing anything. It's a bubble. This is tech 101 and all over again. You gotta hype some new thing whether it's Web 2.0, Crypto or AI. LLM have proven to be great as a gimmick or making rather okay localized approximations. You can create a good enough image without any designing skills, or have auto-completion on steroids. However, there is no proof that this same tech can extrapolate to the next level.…

All current indications says otherwise.

Web3 or crypto didn't disrupt markets.

Chatgpt or let's say ml already did and there is no writing on the wall it will stop. Contrary it shows how much potential there is and how excited a lot of people are.

We have already ml now in office, in bing, in Google workspace. There is midjourney, SD etc.

You can find ml generated porn pictures.

We have constantly news about advantages in multiple ml fields.

This is so different to crypto and stuff.

Re: What it feels like to work in AI right now

#420
post #238

Earlier quoted context omitted.

There is also the other (very high in my opinion) possibility that LLM will hit a wall in regards to performance and a new model is required. It's unfortunate that the current VC landscape encourages this single shot mentality instead of diversification. This will not help in the AI winter since most people will be invested in the same thing.

Wouldn't it stand to reason that LLMs should be obsolete in about a year due to the singularity event and the rapid speed which we're moving towards AGI and then onto exponential technology growth due to ASI? At this point, as an AI researcher, I guess you'd just have to sit back and watch is all unfold, very soon everything you do is obsolete almost immediately.

I also believe we might see something unfold but we still don't know.

It would be wrong though not to keep an very close eye on it or also to embrace it because if it will not just happen in the next 20 years you still need to earn money and with expertise in ml you might be better of

Post reply on HN