Live data from Hacker News

Generative AI and The Future of Work

maestroai.substack.com

41–50 of 106 posts

Re: Generative AI and The Future of Work

#41

ChatGPT help me solve a refactoring bug today. I had spent hours messing around trying to figure out what the issue was until I realized, via asking ChatGPT, that I had misunderstood a piece of the code and the docs. It was able to answer and provide examples (until it had error and crashed) in a way a senior engineer might have been able to. The funny thing is I had tried just pasting in code and saying "find the bu…

From Star Trek: First Contact: "When you build a machine to do a man's job, you take something away from the man." You surrendered the need to think to the machine. You are lesser for it. I don't think these AIs are just removing drudgery, like, say, a calculator. They actually do the work. Or more correctly, they produce something that will pass for the work. Wholesale embracing of this sort of technology is bad for…

That's how Socrates thought about books. Yet here we are 2400 years later and our minds are mostly fine.

Re: Generative AI and The Future of Work

#42
post #18
post #12

Earlier quoted context omitted.

I've been asking friends in non-programming engineering fields how ChatGPT does in their area of expertise, and I believe programming is the area that ChatGPT is the most accurate. Finding solution to general engineering problems seems blatantly wrong in almost all cases, whereas in programming, it seems to be able to generate mostly correct code for simple, boiler-plate like tasks.

yes, but why? Why is GPT so much better at programming than other tasks? can it be that programming itself can be so easily predicted in a generative way, while others require more ingenuity and real world model to be solved? In this case I would totally offload programming to a GPT /LLM AI, while my job is simply to specify largely the business case.

[dead]

Re: Generative AI and The Future of Work

#43
post #30

Earlier quoted context omitted.

Can you elaborate more on your process, and the venue/focus of the writing?

I write educational technical articles for a living. Dev tools, frameworks, security, APIs, infrastructure, web3, etc. I talk to the AI as if I would interview an expert on a subject matter. This usually gives a good starting point for an article, if the subject is general enough, and not too new. It's also good at structuring and rewriting texts. If you already have all the correct data, you can use it to write an o…

Do you have examples you can provide of these technical articles? Because those topics your offered are really broad and very few people are knowledgeable about all of them, so it sounds like you're filling in your knowledge by querying ChatGPT.

Using ChatGPT to fill in knowledge for a technical articles sounds bad. If I'm reading an article about security, I want it written by a security expert not a semi-layman plus a ChatGPT model.

Re: Generative AI and The Future of Work

#44
On the topic of Content is King, I have a different view than the author. I think in the case of these trained AIs, 'content' refers to the training datasets and not the generated outputs.

Trained AIs are in something like the early digital streaming days where there was only one provider in town, so that provider aggregated All The Content. Over the next decade we would see the content owners claw their content back from Netflix, and onto competitor platforms -- which takes us to where we are today. Netflix's third party content has dwindled and forced them to focus on creating their own first party content which can not be clawed away.

When these generative AIs start to produce income, it will be at the expense of the artists whose art was in the training dataset nonconsensually. This triggers the same content clawback we saw in digital streaming. Training datasets will be heavily scrutinized and monetized because the algorithms powering generative AIs aren't actually carrying much water. What is DALL-E without its dataset? Content is King.

Re: Generative AI and The Future of Work

#45

I don't have a problem with the main point of the article, but there is a huge terminology confusion that is rapidly gathering force to confuse people. The key breakthroughs of GPT3 et al are not primarily about generative AI. People had been building generative models long before GPT3, and it was generally found that discriminative models had better performance. They key to the power of GPT3 is that it has billions…

Good point on the terminology. What do you think the right terminology should be? LLMs is too much of a mouthful and is not as informative for the general public, imo. People are also using Foundation Models, which I rather like.

+1 to Foundation Models. I don't share your concerns about LLMs, though, and often refer to the future involving LXMs where X could be images, audio, bioinformatics data, etc

Re: Generative AI and The Future of Work

#46
GPT3 has shown how ML can be trained on multiple unstructured data sources to produce structured information on demand.

Iterate a few more versions from here, so that the models are stronger at producing the correct structured data, and the impact on every office job will be profound.

I.e. instead of training a generative model on text from the internet, train it on every single excel file, sql database, word document and email your company stores. Then query this model asking it to generate Report X showing Y and Z.

When you step back and consider it, 99% of office jobs are about producing structured data from unstructured data sources. The implications of this are being hugely underestimated.

Re: Generative AI and The Future of Work

#48
post #11

Earlier quoted context omitted.

Yup. What seems to be largely missed is that these models have zero understanding, and are actually destroyers of information, not creators. In classic Information Theory, information is basically surprise value — how much unexpected info is in the message? — yet these "AI" systems put out the most expected subset in each instance. This highly averaged output is very recognizable and so very striking, but it is not a…

> In classic Information Theory, information is basically surprise value — how much unexpected info is in the message? — yet these "AI" systems put out the most expected subset in each instance. Forgive me, but isn't this kind of moving-the-goalposts? Information is the surprise value from the recipient's point of view, which meas the recipient's bayesian prior probability is "expected". Saying "these "AI" systems pu…

Yes, the AI's output could be surprising to the point of view of many recipients.

This does not mean anything more than that the AI has a greater breadth of training background, which is likely.

We get the output most likely expected from any of (or the average of) the humans whose writing/drawing/whatever was included in the input set.

What we will not be getting from the AIs is any creative output based on unique understanding, as we would from an intelligent, creative human. Many of hte humans in the input set would see the same prompt and produce an actual novel and meaningful output, not simply a cut-and-paste from prior works. (& yes, seme novel output may come from some randomizing algo, but if it is correct, it is no more correct than the broken clock that is correct twice every day.)

Or, another example, I was involved in a legal deposition where an "AI" transcription system was used instead of a skilled court reporter. The output LOOKED fantastic, until I actually read it, and it was absolute garbage. The standard errata sheet has room for the deponent to put in about a dozen corrections, and most are less than a handful. My errata list was multiple pages. These errors often reversed the meaning of sentences, substitutin "I have ..." for "You have...", dropping or adding "not", or substituting in common names for unusual names (e.g., "Jack Kennedy" for "John Kemeny". note human transcribers always ask for correct spellings of names in the next break, this crap just inserted it like it had a clue).

So, even though the total "experience" or training set of the may go beyond the experience of the reader, so some of the output is surprising, this is no more so than a search engine produces surprise. In fact, I think this is the best use of the AIs, to have them trained on an enormous data set, and provide possibly better results, defined as more on-point, but likely less thorough.

Re: Generative AI and The Future of Work

#49
post #46

GPT3 has shown how ML can be trained on multiple unstructured data sources to produce structured information on demand. Iterate a few more versions from here, so that the models are stronger at producing the correct structured data, and the impact on every office job will be profound. I.e. instead of training a generative model on text from the internet, train it on every single excel file, sql database, word documen…

Nah. When AI is able to do all what you have said, requirements will just get harder and humans will still have to put hours to make something done. Just like 30 years ago it wasn't feasible to implement streaming music over the internet in a weekend, and now any teenager can do so by just 'npm install'ing... AI will only open the door to even more complex problems to solve.
Post reply on HN