Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPTs Are GPTs: An Early Look at the Labor Market Impact Potential of LLMs

arxiv.org

Post reply on HN
Print view View original

221–230 of 235 posts

Re: GPTs Are GPTs: An Early Look at the Labor Market Impact Potential of LLMs

#221

Post by ricardobeat »

shanebellone wrote: post #164
ricardobeat wrote: post #160

Earlier quoted context omitted.

Our brain excels at pattern matching. We attribute a lot of human abilities to “intelligence”, but the line between that and pattern-matching (or “autocomplete” ad it’s being referred as here) is being challenged by these latest LLMs. If it can look at a picture, explain what’s in it, and hypothesize about physics inside the picture’s environment, is it “just pattern matching”?

"If it can look at a picture, explain what’s in it, and hypothesize about physics inside the picture’s environment, is it “just pattern matching”?" That's extrapolation via approximation. Computers synthesize a specification. The difference is nuanced and entirely contextual.

Those are way too broad terms for this conversation to go anywhere. The point is, what's to say the LLM is not doing "extrapolation via approximation" or some process that is analog to how we think? We barely understand how the brain works to start with.

Re: GPTs Are GPTs: An Early Look at the Labor Market Impact Potential of LLMs

#222

Post by penjelly »

xmcqdpt2 wrote: post #134
sirsinsalot wrote: post #29

I asked Chat GPT which antacid medications are contraindicated for some medication I'm on. Easily found through NICE. It made up a severe risk of death taking a very common medicine combo. It was super convincing, even giving information on how long to avoid taking them together. It was pure bullshit. I think as much as hyping the benefits we need to hype the flaws and dangers. If the public at large learn to trust t…

I've been using Bing AI instead of Google for a few days to test it out. It gives responses with citations. A few times already it has hallucinated details that aren't on the cited website at all, but that do sound very plausible (for example something about the horns of a bull pointing up when I asked about the etymology of "bullish".) I think it comes down to the fact that most stuff is actually like 90% bullshit s…

i agree citations dont always support bings conclusion, thats been my exp as well

Re: GPTs Are GPTs: An Early Look at the Labor Market Impact Potential of LLMs

#223

Post by coldtea »

ChatGTP wrote: post #151
coldtea wrote: post #99

Earlier quoted context omitted.

> Almost all the output needs to be re-read, modified and integrated in the project. This often takes longer than just typing it out You'd be very suprised. Try measuring it.

People don't have to love using it you know? If the guy doesn't like it, why force it down his neck? I use plenty of code completion tools already, so I feel similar to them. Sometimes it saves me time, sometimes it doesn't. For me personally, language servers have been the best thing, you can explore libraries, auto-complete nicely, without as the other poster said, worrying about verifying the correctness.

>People don't have to love using it you know? If the guy doesn't like it, why force it down his neck?

It's not about feelings. It's about there being a thing, in objective reality, with some specific merit, and we're trying to evaluate what it is with some accuracy.

Whether someone enjoys it or not is beside the point.

Re: GPTs Are GPTs: An Early Look at the Labor Market Impact Potential of LLMs

#224

Post by malborodog »

visarga wrote: post #112
malborodog wrote: post #49

Earlier quoted context omitted.

This kind of problem is (trivially?) solvable through the ReAct framework, like LangChain etc. Basically you get good data, vector embed it, and make sure the LLM knows where to look for accurate information.

This approach has some issues - it chunks inputs, with some overlap, but this can destroy context - the retrieved passages, when they come from different documents, have no apparent relation or could be mistakenly considered related - the model struggles to correlate data between the document snippets, taking half an idea from one side and half from the other side and mixing them up in something that doesn't really m…

Implementation details. Check out what's going on with LangChain, augmented retrieval, etc. We'll be able to create knowledge bases on specific subjects with vetted data, and get the bot to retrieve and summarize appropriate results while providing a citation to the original source.

Re: GPTs Are GPTs: An Early Look at the Labor Market Impact Potential of LLMs

#225

Post by flangola7 »

yarg wrote: post #174
flangola7 wrote: post #109

Earlier quoted context omitted.

The outsourced call center is part of the local economy where they live. In some countries contact centers make up a large fraction of GDP

Sure, but it's unrealistic to think that the preservation of foreign economies is going to be any sort of priority over the next few years.

Foreign to who?

Re: GPTs Are GPTs: An Early Look at the Labor Market Impact Potential of LLMs

#226

Post by neuronic »

textninja wrote: post #183
neuronic wrote: post #155

Earlier quoted context omitted.

Single stories of LLM success are just as problematic as single stories of LLM failures. As always. The fact is that we have a dangerous tool at hand that absolutely REQUIRES skepticism if you are trying to get *facts* out of it. I agree that LLMs are extremely likely to impact many areas of work, particularly bullshit work. But as it stands you absolutely cannot use them as fact machines, the results can be catastro…

For the most part I agree, but will qualify that the caveats you listed apply to the out of the box version of ChatGPT. I expect these limitations will be overcome by using it as programming substrate and connecting it to other models and APIs. I am impressed by what we’ve seen from ChatGPT so far, but am especially excited to see what industry does with LLMs as new type of building block.

Fully agreed! I suspect that there will always be this subtle risk of catastrophic failure though, something observed in a lot of AI systems. The scrutiny filter may become less relevant but will likely not be less needed to prevent 1 in 10,000 bad responses.

If 100,000 people ask critical questions then 10 people might run into potentially catastrophic consequences. ChatGPT is a powerful tool and will only become more so but it will probably not be perfectly reliable by any means due to the nature of the system.

I am excited for the generative AI future and whatever the hell is still coming. Only those who adapt will survive.

Re: GPTs Are GPTs: An Early Look at the Labor Market Impact Potential of LLMs

#227

Post by stockboss »

aldarisbm wrote: post #166
stockboss wrote: post #71

Earlier quoted context omitted.

have you ever got on an airplane? are you aware that they are not 100% safe?

airplanes do not execute in a vacuum eg: computer. There are external factors that might cause an airplane to fail. A fully working airplane all things equal in terms of weather and a good pilot, will be safe.

you're missing the point. my point was: if everyone waited til something is 100% safe/complete/satisfaction guaranteed, there would be no progress in human civilization. we need to be willing to take a chance on a promising technology in order to allow for further progress. imagine if everyone said i'll wait for planes to be 100% safety guaranteed before i'll get on one - we wouldn't be flying today.

Re: GPTs Are GPTs: An Early Look at the Labor Market Impact Potential of LLMs

#228

Post by psl2z »

geraneum wrote: post #9

> Our findings indicate that the importance of science and critical thinking skills are strongly negatively associated with exposure, suggesting that occupations requiring these skills are less likely to be impacted by current language models. Conversely, programming and writing skills show a strong positive association with exposure, implying that occupations involving these skills are more susceptible to being infl…

They are measuring exposures based on O*Net skills. Here is a link to the skills of a mathematician:

https://www.onetonline.org/link/summary/15-2021.00

The following skills are listed:

- IBM SPSS Statistics - Tableau - Salesforce software ... - CSS - Microsoft Word

These skills are far from what one would expect from mathematicians.

Re: GPTs Are GPTs: An Early Look at the Labor Market Impact Potential of LLMs

#229

Post by kthejoker2 »

auggierose wrote: post #162
Jensson wrote: post #124

Earlier quoted context omitted.

AlphaGo is basically the same as image recognition, not sure why you thought AlphaGo was special compared to detecting faces. AlphaGo works the same way but maps game structures on a Go board instead of mapping facial structures and comparing those to known people.

That's exactly the kind of attitude I am talking about. You can rationalise pretty much everything and keep moving the goal post. I've seen AI do something nobody thought was possible. If that doesn't influence how you think about AI I cannot help you.

Nobody?

Re: GPTs Are GPTs: An Early Look at the Labor Market Impact Potential of LLMs

#230

Post by ebauch »

dathinab wrote: post #121

One major risk with this kind of AIs is that for the last few decades the mental image of what such AIs will be like (both by scientist and science fiction) has a _extreme serve_ mismatch with how they turned out. In the past humanity people thought of them as this non-emotional purely logic driven beings and in turn problems people imagined would be such as this logic not considering emotions and emotional well bein…

Noam Chomsky, is that you?
Post reply on HN