Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

ChatGPT-4 significantly increased performance of business consultants

d3.harvard.edu

Post reply on HN
Print view View original

221–230 of 282 posts

Re: ChatGPT-4 significantly increased performance of business consultants

#221

Post by klabb3 »

Hippocrates wrote: post #178

This is hilarious. As impressive as GPT-3/4 has been at writing, what's more shocking is just how bullshity-y human writing is.. And a "business consultant" is the epitome of a role requiring bullshit writing. Chat GPT could certainly out business-consultant the very best business consultants. Sometimes to be taken seriously at work, you need to take some concise idea or data and fluff it up into a multiple pages or…

> As impressive as GPT-3/4 has been at writing, what's more shocking is just how bullshity-y human writing is..

Yeah. Most people have focused on what LLMs can do, but I think it’s equally if not more interesting what can they not do, and why?

When we say LLMs can generate text we’re painting brush strokes as broad as a 10-lane highway. Apparently we have quite limited vocabulary about what writing actually is, and specifically what categories and levels exist.

For instance, it’s fun (and in my view completely expected) to see that courteous emails, LinkedIn inspirational spam, corp-speech etc, GPT outperforms humans with flying colors, on the first attempt too! Whereas if you’re asking for the next book of Game of Thrones or any well-written literature it falls flat – incredibly boring, generic, full of platitudes and empty arcs and characters.

We have to start mapping the field of writing to a better conceptual space. Currently it seems like we can’t even differentiate between the equivalent of arithmetic and abstract algebra.

Re: ChatGPT-4 significantly increased performance of business consultants

#223

Post by flir »

fragmede wrote: post #175
flir wrote: post #81

Earlier quoted context omitted.

So you ask for 20 ideas and filter. Even if you throw away 19, it's still useful.

Even if you throw all of them away, the point is the human is simply more effective in their role. Just breaking the ice, the writer's block; anything to get out of the creative rut that we all fall in, is worth its weight in GPUs.

Thank you, you express it much better than I can. "Diabetic-Friendly Shoes" from the above list immediately had me thinking in half a dozen different directions at once.

Re: ChatGPT-4 significantly increased performance of business consultants

#224

Post by visarga »

ellyagg wrote: post #41
skepticATX wrote: post #32

Two things mentioned in the abstract that are worth pointing out. > For each one of a set of 18 realistic consulting tasks within the frontier of AI capabilities They specifically picked tasks that GPT-4 was capable of doing. GPT-4 could not do many tasks, so when we say that performance was significantly increased this is only for tasks GPT-4 is well suited to . There is still value here but let's put these results…

You're underestimating because it compounds. Small gains in efficency lead to huge advantages in long term growth. 17% would be absolutely monumental improvement.

yet insignificant compared to how full automation would look, not 1.17x but 1000x

but I can't find any automated AI tasks of critical importance, they all need human support

Re: ChatGPT-4 significantly increased performance of business consultants

#225

Post by qingcharles »

baq wrote: post #165
qingcharles wrote: post #143

Earlier quoted context omitted.

Try asking it for specifically NLP-ized text and it does it very well... (but then tells you not to use it as it is "unethical")

You aren't talking about the NLP the GP is talking about.

You're right. That'll teach me to reply to comments before I had my morning coffee.

For others arriving here: I suspect OP meant Natural Language Processing and I was talking about Neuro-linguistic Programming.

I've had my caffeine now.

Re: ChatGPT-4 significantly increased performance of business consultants

#226

Post by datadrivenangel »

shakow wrote: post #142
hubraumhugo wrote: post #15

Well, this sounds like perfect tasks for GPT: "Participants responded to a total of 18 tasks (or as many as they could within the given time frame). These tasks spanned various domains. Specifically, they can be categorized into four types: creativity (e.g., “Propose at least 10 ideas for a new shoe targeting an underserved market or sport.”), analytical thinking (e.g., “Segment the footwear industry market based on…

> Target: Dog Walkers > Features: Built-in waste bag dispenser I'm not yet sure whether I hate it or love it. > Target: Visually Impaired Individuals > Features: Haptic feedback Haptic shoes, how revolutionary!

I saw a built-in waste bag dispenser recently while helping walk a friend's dog, and honestly it was pretty convenient.

Re: ChatGPT-4 significantly increased performance of business consultants

#227

Post by johndhi »

highwaylights wrote: post #31
hubraumhugo wrote: post #15

Well, this sounds like perfect tasks for GPT: "Participants responded to a total of 18 tasks (or as many as they could within the given time frame). These tasks spanned various domains. Specifically, they can be categorized into four types: creativity (e.g., “Propose at least 10 ideas for a new shoe targeting an underserved market or sport.”), analytical thinking (e.g., “Segment the footwear industry market based on…

1) Your ideas are bad. 2) Spreadsheets exist. 3) No-one cares about your marketing copy. 4) No-one finds your c-suite babble inspirational. This is almost perfect input to an LLM exactly because of how low value it is in the first place.

Often the benefit of management consultants is they help the company feel better about firing or laying off people.

Actually a robot would be perfect at that. No one likes doing layoffs but chat gpt won't mind

Re: ChatGPT-4 significantly increased performance of business consultants

#228

Post by [deleted] »

benreesman wrote: post #46

LLMs are stunningly good at language tasks: almost all of what us old-timers called NLP is just crushed these days. Summarization, Q&A, sentiment, the list goes on and on. Truly remarkable stuff. And where there isn’t a bright line around “fact”, and where it doesn’t need to come together like a Pynchon novel, the generative stuff is smoking hot: short-form fiction, opinion pieces, product copy? Massive productivity…

[deleted]

Re: ChatGPT-4 significantly increased performance of business consultants

#229

Post by riskable »

datadrivenangel wrote: post #226
shakow wrote: post #142

Earlier quoted context omitted.

> Target: Dog Walkers > Features: Built-in waste bag dispenser I'm not yet sure whether I hate it or love it. > Target: Visually Impaired Individuals > Features: Haptic feedback Haptic shoes, how revolutionary!

I saw a built-in waste bag dispenser recently while helping walk a friend's dog, and honestly it was pretty convenient.

Yes but how much more convenient would it be with haptic feedback‽

Re: ChatGPT-4 significantly increased performance of business consultants

#230

Post by coffeefirst »

matheusmoreira wrote: post #210
Jeff_Brown wrote: post #72

Earlier quoted context omitted.

I wonder how long it takes AI to get good at law. Right now the verbal tasks it excels at are similar to the artistic ones: namely, solving problems with enormous solution spaces that are robust to small perturbations. That is, change a good picture of an angry tree man slightly and it's still probably a good picture of an angry tree man.

Isn't ChatGPT getting progressively better scores on medical and law exams? It will probably pass the USMLE and the bar one day. If it doesn't already. It's gonna be interesting.

Yes, but we should expect that, the answers are in its training data.

The problem is passing tests are an okay proxy for competence in humans, but if you think of LLMs as a giant library search engine, the thing it is competent at is identifying and regurgitating compiled phrases from its records.

Which is awesome. It can't be a doctor.

Post reply on HN