Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

What it feels like to work in AI right now

robotic.substack.com

Post reply on HN
Print view View original

531–540 of 768 posts

Re: What it feels like to work in AI right now

#531

Post by greeny7373 »

csmpltn wrote: post #475
greeny7373 wrote: post #442

Earlier quoted context omitted.

[flagged]

Sure, you can keep throwing those hyped VC/MBA-style retorts all around, or you can acknowledge the simple reality that when it comes to the task of finding answers to questions on SO, traditional search technology outperforms LLMs on every parameter: 1. Cost: it's much easier to build and serve a traditional search index for questions/answers at scale 2. Speed 3. Quality: with search engines you don't just get one a…

I'm quite good in understanding the difference.

But LLM can already do things Google can't.

LLM is not just a search engine.

It's an explainer, rubber duck etc.

Instead of 'google define x' I just say ' explain x' in my dialog with the machine.

And it will only become better and better.

Re: What it feels like to work in AI right now

#532

Post by revelio »

Al-Khwarizmi wrote: post #450
MrVandemar wrote: post #409

Earlier quoted context omitted.

Amen. It outrages me that someone would waste my time making me listen to a regurgitated, averaged-out, speech written without any emotional fire or depth at an occasion that is profoundly meaningful. A speech as a best man should be personal, heartfelt, it should be funny and a little cringy maybe, and it should mean something. Same with eulogies; this is a moment to celebrate someone's life, to state what that pers…

Some people are just bad at this kind of thing, and sometimes saying nothing is not an option if there is a social expectation that you say something. Which can create a lot of anxiety.

Yep. The best man's speech at my brother's wedding was a disaster zone in every possible way, it was a sad blemish on an otherwise great day. It'd have been far better if he'd have some AI help along the way.

Re: What it feels like to work in AI right now

#533

Post by greeny7373 »

MrVandemar wrote: post #522
greeny7373 wrote: post #430

Earlier quoted context omitted.

That's quite arrogant. Not everyone has ever written something like it. Why is it unfair or unpersonal if chatgpt helps you, guides you and gives you a good starting point? Guess how many people would Google some example and starting with that, what's so wrong to let chatgpt generate a shitty first draft already tailored to your situation?

Hello greeny7373, nice to meet you. > Why is it unfair or unpersonal if chatgpt helps you, guides you and gives you a good starting point? As somewhat extreme examples: Rodin didn't swoop in and smooth off "The Kiss" after an apprentice chiselled the basic outline out of a lump of marble; pretty sure Salvador Dali started with blank canvas instead of getting a basic landscape from a $2 Art Shop and added a melting cl…

I started to see a huge issue with knowledge: people don't know what they don't know.

If you have a magic Maschine your solution is no longer 'no clue how to do this' but it becomes 'i will ask my trusty expert machine'.

This machine now gives you the next step, the guidance you need without being jugemental OR much simpler: just looks to busy to you that you are not confident to disturb the other.

Re: What it feels like to work in AI right now

#534

Post by revelio »

PeterStuer wrote: post #487
cgearhart wrote: post #152

From my perspective it’s just _confusing_ to work in AI right now. We have some massive models that are doing some really neat stuff, and apparently hundreds of millions of people are using them—but I keep wondering: to do _what_, exactly? I’m not asking what the models can do, I’m asking what people want the models to do every day, all the time. I’ve been shown some neat pictures people made that they thought were c…

"In fact, no one in my extended sphere of friends and family has asked me anything about chatGPT, midjourney, or any of these other models. The only people I hear about these models from are other tech people." I have the opposite experience. Everyone I meet outside tech has been exploring ChatGPT, or at least has heard of it and is extremely curious. And in non-tech student circles, a (non STEM) TA I know said stude…

I was sitting in a Starbucks yesterday sitting opposite two girls doing some language study and one of them was joking that the other should ask ChatGPT about some grammar point. This idea that only tech people know about it seems way off.

Re: What it feels like to work in AI right now

#535

Post by revelio »

AussieWog93 wrote: post #436
snowe2010 wrote: post #412

Earlier quoted context omitted.

GPT 4 is quite astounding. It might be wrong on occasion, but it will easily point you in the right direction most of the time. It still messes up, but like a twentieth of what 3.5 did. Honestly it is like an incredible rubber ducky for me. Not only can I just talk like I’m talking to a rubber duck but I can get fast, mostly informed, feedback that unblocks me. If I have a bunch of things competing for my attention I…

Is a 95% reduction in errors an exaggeration or is it really that much better? Might just need to drop the $20/mo if it's really improved that much.

I'm a recent convert, been experimenting with converting one PL to another.

GPT-3.5 will get the gist of what the code is doing, and then provide what looks like a direct translation but differs in numerous details whilst having a bunch of other problems.

GPT-4 does a correct translation, almost every time.

It kills me that there's a waiting list for the API. I have put together some tools to integrate 3.5 into my workflow and it helps for my current task a lot (for others it's useless). But to really shine it needs to have API access to 4.

Re: What it feels like to work in AI right now

#536

Post by revelio »

sanderjd wrote: post #377
letitgo12345 wrote: post #91

Earlier quoted context omitted.

From what I heard, they don't have scaling capabilities to deploy the bigger models right now which they're working on and that's the biggest issue.

I have no particular insight into this either way, but I find it pretty hard to believe that OpenAI has more scaling capability than Google.

It's not just about hardware, it's about the software infrastructure to go with it. Other than OpenAI most researchers weren't interested in "merely" scaling things up because that was/is seen as simple engineering, unworthy of the great minds who dream up new algorithms.

Re: What it feels like to work in AI right now

#537

Post by gavi »

The article discusses what it feels like to work in AI currently. The ChatGPT moment has shaken up the entire industry, causing career changes and projects to be abandoned. The pace is very high and everyone is extremely motivated but simultaneously close to burning out. Prioritization is hard, and leadership and vision are strained. The article offers solutions, such as taking solace in the scientific method and being process-oriented, managing up, and managing competition. The author reminds readers that it takes a lot of consistent work and luck to catch a wave in AI. - I used pagechat.com to summarize

Re: What it feels like to work in AI right now

#538

Post by YurgenJurgensen »

jiggawatts wrote: post #395
nwienert wrote: post #204

Earlier quoted context omitted.

I mean Google revolutionized search. Apple revolutionized personal computing. OpenAI revolutionized… rewriting things with slightly different wording? I’ve seen so many breathless people posting “this would have taken me so long to search” and then I type 3 keywords from their massive prompt they crafted and find it instantly on Google. We’re talking 1000x or more faster. I feel like the same is happening in your com…

You can program GPT in English. Let me repeat that: You can program GPT in English . ENGLISH! You're complaining about the first nuclear test bomb being impractical and uninteresting. How will this change the world? That huge monstrosity had to be affixed to the top of a test gantry and took years of effort by a veritable army of the best and brightest to make! No way it could change war, or geopolitics, or anything.…

The Ford Nucleon was a 1957 concept car that featured a compact nuclear reactor. Look at how well that prediction aged. It's apt that you mention the Trinity test, since 1950s inflated expectations of the applicability of nuclear everything are exactly where we are now.

Perhaps I could interest you in some Radium Water? It's new and trendy and good for your health.

Re: What it feels like to work in AI right now

#539

Post by aezart »

girvo wrote: post #500
Fr0styMatt88 wrote: post #407

Earlier quoted context omitted.

I’ll give you a concrete example from a few days ago in my job. I needed a quick utility window in the Unity editor to see what animations could fire animation events and what those were. I’m somewhat familiar with the editor API, enough to know what to Google and roughly where to go in the docs. I don’t do it enough though to really learn it beyond that point. So I’d estimate I could spend maybe one and a half hours…

One worry I have for the long term is: how will we learn or adopt new programming languages in the future, when LLM du-jour knows nothing about Language X? Will we be stuck with what we’ve got because LLMs make us too productive in them?

I'm very worried that machine learning will lead to stagnation in general, in programming and in art. People will accept the machine output and call it a day instead of making something new.

Re: What it feels like to work in AI right now

#540

Post by tome »

jakeinspace wrote: post #168
lexandstuff wrote: post #108

Earlier quoted context omitted.

In this interview [1] with Ilya Sutskever, he indicates that they aren't even close to tapping out of data. [1] https://www.youtube.com/watch?v=Yf1o0TQzry8&t=656s

To be fair, if the opposite were true, it might not be wise to admit. Saturating available high quality training data is one of the few ways anyone can see OpenAI slowing down.

Yes, it's a bit strange. I would have thought

1. They would already be using everything they can get 2. They would easily be able to explain what they're not using, without giving away sensitive secrets.

Post reply on HN