Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

What it feels like to work in AI right now

robotic.substack.com

Post reply on HN
Print view View original

291–300 of 768 posts

Re: What it feels like to work in AI right now

#291

Post by SanderNL »

esafak wrote: post #19
colinrand wrote: post #16

Probably not the right place to post this, but I really want someone to build a ChatGPT service that reviews consumer EULAs and highlights the important stuff, and can tell me what changes with them each time I have to reaccept or get notified. It's a subset of making legalese digestible, but bringing more visibility into the density of them would be wondrous.

Would you expect them to take legal liability? If not, would you still pay for it? If not, how would it make money?

You think lawyers take legal liability?

Re: What it feels like to work in AI right now

#292

Post by safety1st »

cgearhart wrote: post #201
brookst wrote: post #180

Earlier quoted context omitted.

You’re asking “what’s so big about GUIs? Literally nobody has asked to move a pointer around a screen”. It’s the use cases these thing enable that are important. Today, I wrote a draft product announcement. Only after I was done did I realize I had written it in a really impersonal third person (“users will be able to”). No big deal, but maybe 10-20 minutes of work to make it energetic and second person (“now you can…

Hmm…no, I’m not doubting the value of the interface. I’m asking what’s the “killer app”. Maybe I should just ask ChatGPT to explain it to me…

If we're characterizing LLMs as a kind of input interface I'd point out that the first GUI was released in 1973 by Xerox and the first commercially successful GUI was released in 1984 with the Mac 128K. It took 11 years for someone to answer this question. Sure things move faster these days, but we're still only a couple of months in.

With blockchains there was also a fundamental technological breakthrough (I'd argue less revolutionary than LLMs). The problem was that everyone jumped the gun and proclaimed the killer app had been discovered too soon: cryptocurrency's incarnations to date have yet to demonstrate much utility apart from being a vehicle for speculation. Nakomoto invented the first distributed blockchain in 2008...

Re: What it feels like to work in AI right now

#293

Post by glandium »

nazgul17 wrote: post #267
cgearhart wrote: post #152

From my perspective it’s just _confusing_ to work in AI right now. We have some massive models that are doing some really neat stuff, and apparently hundreds of millions of people are using them—but I keep wondering: to do _what_, exactly? I’m not asking what the models can do, I’m asking what people want the models to do every day, all the time. I’ve been shown some neat pictures people made that they thought were c…

I found ChatGPT helpful in a bunch of diverse situations. I'll go into detail below, but overall I think the most valuable thing it can do is understand questions that takes both knowledge (that I don't have and want to acquire) and understanding (that prior AI technologies did not have) and provide meaningful answers. I suppose I find it very useful for my own education - with the understanding that I should use 2 o…

Be wary with ChatGPT and Japanese. As someone fluent enough and using ChatGPT for inspiration in writing, as well as to find words that either I have "on the tip of my tongue" but fail to remember, or find idiomatic expressions that I may or may not have heard of, ChatGPT can come up with weird hallucinations (Edit: to the point of making up words, I guess mainly because its tokens are at best at the character level ; knowing that, it's amazing it performs as well as it does, honestly).

I always double check with Google searches, but at least ChatGPT gets me somewhere where I can actually search for something useful.

Relatedly, sometimes, even with an initial prompt I've used in the past to make it do what I need to a text in Japanese, and despite everything I type being in Japanese, sometimes it decides to respond entirely in English.

It can also be really bad with context. Because in Japanese, the subject is often omitted because it's known from context, ChatGPT often mixes things up when rewording or summarizing.

Re: What it feels like to work in AI right now

#294

Post by [deleted] »

logicchains wrote: post #286
cgearhart wrote: post #152

From my perspective it’s just _confusing_ to work in AI right now. We have some massive models that are doing some really neat stuff, and apparently hundreds of millions of people are using them—but I keep wondering: to do _what_, exactly? I’m not asking what the models can do, I’m asking what people want the models to do every day, all the time. I’ve been shown some neat pictures people made that they thought were c…

Have you heard of "editing"? Or "translating"? Those are entire industries that can now be almost entirely automated with no loss of quality.

[deleted]

Re: What it feels like to work in AI right now

#295

Post by spaceman_2020 »

JumpCrisscross wrote: post #54
UncleOxidant wrote: post #25

Earlier quoted context omitted.

Why do you think OpenAPI is so far out in front? It's not like there's a lot of secret sauce here - most of this stuff (transformers,etc.) is all out there in papers. And places like Google & Meta must have a lot more computing resources to train on that OpenAI does thus they should be able to train faster. Do you think OpenAI has discovered something they haven't been open about?

> Why do you think OpenAPI is so far out in front? There is a network effect forming around its models. The strengths of its kit speak for themselves. (It also cannot be understated how making ChatGPT public, something its competitors were too feeble, incompetent and behind the curve to do, dealt OpenAI a massive first-mover advantage.) But as others note, other models are in the ballpark. Where OpenAI is different i…

How much does reinforced learning from people using chatGPT help accelerate OpenAI’s advantage?

Re: What it feels like to work in AI right now

#296

Post by spaceman_2020 »

icelancer wrote: post #181
letitgo12345 wrote: post #146

Earlier quoted context omitted.

People really don't seem to understand just how far ahead OAI is in its reasoning abilities ( https://crfm.stanford.edu/helm/v0.2.2/?group=reasoning ) Maybe PaLM is near there (it's not evaluated on that page) but nothing else even comes close at all

The level of denial people are willing to sink into regarding how good GPT-4 is compared to everything else is truly crazy. Not a single other project is an order of magnitude close to the quantitative and qualitative (actual experiential results, not just benchmarks) results that GPT-4 brings.

I feel that there’s significant insecurity among a lot of coders about GPT-4. A lot of them are ignoring the pace of improvement and highlighting the few off chances where it gets things wrong.

Re: What it feels like to work in AI right now

#297

Post by Gigablah »

mach1ne wrote: post #265
spaceman_2020 wrote: post #241

Earlier quoted context omitted.

You couldn’t be further from the truth. This is the single greatest leap in productivity we’ve had in the last 100 years. Last week, I used GPT-4 to write my code. Later, I used it to analyze 100+ websites and come up with a personalized pitch for a relevant plugin/product idea - something that would have taken me 100+ hours.

Yes, but it hallucinates sometimes. /s

I mean, that’s exactly what it’s being used for — hallucination.

Re: What it feels like to work in AI right now

#298

Post by riffraff »

jack_pp wrote: post #243
cgearhart wrote: post #152

From my perspective it’s just _confusing_ to work in AI right now. We have some massive models that are doing some really neat stuff, and apparently hundreds of millions of people are using them—but I keep wondering: to do _what_, exactly? I’m not asking what the models can do, I’m asking what people want the models to do every day, all the time. I’ve been shown some neat pictures people made that they thought were c…

I thought about learning Go and Fiber to build the backend of a side project of mine and I did but as it goes for any new language / stack I wasn't feeling confident in it. Then ChatGPT came out and I thought what the hell, let's see what all the fuss is about. So I asked it to write me a struct for a table with the "id, name, longitude, latitude, news" columns. That worked well, I was surprised it automatically infe…

> Again, no bugs, perfect code

How do you know? Either you know enough Go to be able to tell, and thus you'd be able to write this yourself, or you don't and thus you can't really judge.

I mean, it probably is right, but this "I don't know something, but I trust what the chatbot told me" is what worries me about the rise of the LLMs.

Re: What it feels like to work in AI right now

#299

Post by [deleted] »

ChatGTP wrote: post #252
csomar wrote: post #238

Earlier quoted context omitted.

There is also the other (very high in my opinion) possibility that LLM will hit a wall in regards to performance and a new model is required. It's unfortunate that the current VC landscape encourages this single shot mentality instead of diversification. This will not help in the AI winter since most people will be invested in the same thing.

Wouldn't it stand to reason that LLMs should be obsolete in about a year due to the singularity event and the rapid speed which we're moving towards AGI and then onto exponential technology growth due to ASI? At this point, as an AI researcher, I guess you'd just have to sit back and watch is all unfold, very soon everything you do is obsolete almost immediately.

[deleted]

Re: What it feels like to work in AI right now

#300

Post by skybrian »

unit_circle wrote: post #233
cgearhart wrote: post #152

From my perspective it’s just _confusing_ to work in AI right now. We have some massive models that are doing some really neat stuff, and apparently hundreds of millions of people are using them—but I keep wondering: to do _what_, exactly? I’m not asking what the models can do, I’m asking what people want the models to do every day, all the time. I’ve been shown some neat pictures people made that they thought were c…

- Amazing translations (this alone is a game changer) - Language learning... The ability to improvise realistic conversations is huge. I can ask to talk about cooking a specific dish or a sport! - As others have noted, refining documents similar to grammarly - Looking for a product with extremely specific features (though it isn't very good at comparing yet) - Searches that are too vague and complicated to articulate…

For translations, I use Google translate. Should I switch?
Post reply on HN