Live data from Hacker News

GPTs Are GPTs: An Early Look at the Labor Market Impact Potential of LLMs

arxiv.org

31–40 of 235 posts

Re: GPTs Are GPTs: An Early Look at the Labor Market Impact Potential of LLMs

#31
post #13
post #9

> Our findings indicate that the importance of science and critical thinking skills are strongly negatively associated with exposure, suggesting that occupations requiring these skills are less likely to be impacted by current language models. Conversely, programming and writing skills show a strong positive association with exposure, implying that occupations involving these skills are more susceptible to being infl…

Programming skills that do not need critical thinking are more susceptible of being influenced indeed. Don't forget that a lot of science requires computer programming these days. This is the root of it: The more "genericc" your work is. The more its "out there on the internet" the more GPT can learn about it.. So, a lot of engineers that are just doign teh same old trick: Writing HTTP endpoints, parsing json. Mappin…

> So, a lot of engineers that are just doign teh same old trick: Writing HTTP endpoints, parsing json. Mapping data types.. Yes that could be automated.

And to be fair, automation for all of that already pretty much exists.

Re: GPTs Are GPTs: An Early Look at the Labor Market Impact Potential of LLMs

#32

With little kids I am increasingly conscious about how to best equip them for the world when they are adults. I think previous playbook will need to be redrafted. 'Resilience' and 'Critical Thinking' are two things I am thinking are key any others?

Definitely.

They will also need to be exposed to ChatGPT to build intellectual antibodies.

Re: GPTs Are GPTs: An Early Look at the Labor Market Impact Potential of LLMs

#33

I asked Chat GPT which antacid medications are contraindicated for some medication I'm on. Easily found through NICE. It made up a severe risk of death taking a very common medicine combo. It was super convincing, even giving information on how long to avoid taking them together. It was pure bullshit. I think as much as hyping the benefits we need to hype the flaws and dangers. If the public at large learn to trust t…

Was it GPT4 or GPT3.5?

It spews less bullshit with each new iteration. Matter of time really.

Re: GPTs Are GPTs: An Early Look at the Labor Market Impact Potential of LLMs

#34

I asked Chat GPT which antacid medications are contraindicated for some medication I'm on. Easily found through NICE. It made up a severe risk of death taking a very common medicine combo. It was super convincing, even giving information on how long to avoid taking them together. It was pure bullshit. I think as much as hyping the benefits we need to hype the flaws and dangers. If the public at large learn to trust t…

This is an interesting comment, and highlights the accuracy problem with LLMs. But this is but one type of query that LLMs are used for, akin to an informational web search (E.g. How tall is the Eiffel tower).

Re: GPTs Are GPTs: An Early Look at the Labor Market Impact Potential of LLMs

#36

I asked Chat GPT which antacid medications are contraindicated for some medication I'm on. Easily found through NICE. It made up a severe risk of death taking a very common medicine combo. It was super convincing, even giving information on how long to avoid taking them together. It was pure bullshit. I think as much as hyping the benefits we need to hype the flaws and dangers. If the public at large learn to trust t…

Was it GPT4 or GPT3.5? It spews less bullshit with each new iteration. Matter of time really.

I don't want to have a calculator (or say bookkeeping software) that gives correct results most of the time but not always, and then hear from the developers that it will get better with each iteration. I need a calculator that is correct 100% of time, not even 99.999%, because otherwise I can't rely on it at all.

In other words, the utility of a calculator that is correct only 99% of time is zero, since you can't even tell when it's wrong.

Re: GPTs Are GPTs: An Early Look at the Labor Market Impact Potential of LLMs

#37

I think more parallels should be drawn with what we were doing before: Googling it. Perhaps it's because ChatGPT seemed to happen much more suddenly than Google became a programming resource, but we're using them in much the same way. Asking for pre-made solutions, explanations, troubleshooting tips etc. ChatGPT just does the job way better. But no-one was worried Google would put knowledge workers out of a job.

My (sales-y) colleagues are already writing marketing emails with ChatGPT. Saves a little bit of work, but it might result in the loss of being able to write such emails yourself. This can extend to other jobs, which will have some effects.

Use in education worries me more. If schools don't change their lazy group-projects and "write an essay on" strategies now, coming generations will have put less effort in than previous, leading to a further drop in levels.

Re: GPTs Are GPTs: An Early Look at the Labor Market Impact Potential of LLMs

#38
post #9

> Our findings indicate that the importance of science and critical thinking skills are strongly negatively associated with exposure, suggesting that occupations requiring these skills are less likely to be impacted by current language models. Conversely, programming and writing skills show a strong positive association with exposure, implying that occupations involving these skills are more susceptible to being infl…

My hunch here is that, because of the sometimes haphazard hallucinations of ChatGPT, you would need to always review the code that ChatGPT has crated. Also as in a group of people you sometimes agree on specific styles, but I think that ChatGPT won’t adhere to such things, making its code unfamiliar and really hard to follow. We as humans have a hard time agreeing on how code should be written, does ChatGPT have a better notion? And how maintainable is that? How does it make a change?

Re: GPTs Are GPTs: An Early Look at the Labor Market Impact Potential of LLMs

#40
post #36

Earlier quoted context omitted.

Was it GPT4 or GPT3.5? It spews less bullshit with each new iteration. Matter of time really.

I don't want to have a calculator (or say bookkeeping software) that gives correct results most of the time but not always, and then hear from the developers that it will get better with each iteration. I need a calculator that is correct 100% of time, not even 99.999%, because otherwise I can't rely on it at all. In other words, the utility of a calculator that is correct only 99% of time is zero, since you can't ev…

Don’t rely on floating point accuracy!
Post reply on HN