Live data from Hacker News

ChatGPT-4 significantly increased performance of business consultants

d3.harvard.edu

41–50 of 282 posts

Re: ChatGPT-4 significantly increased performance of business consultants

#41

Two things mentioned in the abstract that are worth pointing out. > For each one of a set of 18 realistic consulting tasks within the frontier of AI capabilities They specifically picked tasks that GPT-4 was capable of doing. GPT-4 could not do many tasks, so when we say that performance was significantly increased this is only for tasks GPT-4 is well suited to . There is still value here but let's put these results…

You're underestimating because it compounds. Small gains in efficency lead to huge advantages in long term growth. 17% would be absolutely monumental improvement.

Re: ChatGPT-4 significantly increased performance of business consultants

#42
post #2

Says more about how useless BCG consultants are.

I’m starting to think there’s an LLM equivalent to the old saying about how everything the media writes is accurate except on the topics you’re an expert in. All LLM output looks to be good quality except when it’s output you’re an expert in. People who have no background in writing or editing think LLMs will revolutionize those fields. Actual writers and editors take one look at LLM output and can see it’s basically…

[flagged]

Re: ChatGPT-4 significantly increased performance of business consultants

#43
post #2

Says more about how useless BCG consultants are.

I’m starting to think there’s an LLM equivalent to the old saying about how everything the media writes is accurate except on the topics you’re an expert in. All LLM output looks to be good quality except when it’s output you’re an expert in. People who have no background in writing or editing think LLMs will revolutionize those fields. Actual writers and editors take one look at LLM output and can see it’s basically…

Gell-Mann Amnesia!

Re: ChatGPT-4 significantly increased performance of business consultants

#44
post #11

This is a good thing, since increased perfomance means that the clients will have less billed hours, right? Right?

No, it increases the load one can successfully manage in a day. There isn't this tiny discrete amount of work that people need to handle. We gave that up when we left the campfires. We're trying to grow.

Re: ChatGPT-4 significantly increased performance of business consultants

#45

Earlier quoted context omitted.

I’m starting to think there’s an LLM equivalent to the old saying about how everything the media writes is accurate except on the topics you’re an expert in. All LLM output looks to be good quality except when it’s output you’re an expert in. People who have no background in writing or editing think LLMs will revolutionize those fields. Actual writers and editors take one look at LLM output and can see it’s basically…

[flagged]

https://news.ycombinator.com/newsguidelines.html

Be kind. Don't be snarky. Converse curiously; don't cross-examine. Edit out swipes.

When disagreeing, please reply to the argument instead of calling names. "That is idiotic; 1 + 1 is 2, not 3" can be shortened to "1 + 1 is 2, not 3."

Re: ChatGPT-4 significantly increased performance of business consultants

#46
LLMs are stunningly good at language tasks: almost all of what us old-timers called NLP is just crushed these days. Summarization, Q&A, sentiment, the list goes on and on. Truly remarkable stuff.

And where there isn’t a bright line around “fact”, and where it doesn’t need to come together like a Pynchon novel, the generative stuff is smoking hot: short-form fiction, opinion pieces, product copy? Massive productivity booster, you can prototype 20 ideas in one minute.

But that’s about where we are: lift natural language into a latent space with some clear notion of separability, do some affine (ish) transformations, lower back down.

Fucking impressive for a computer. But if it can really carry water for an expensive Penn grad?

You’re paying for something other than blindingly insightful product strategy.

Re: ChatGPT-4 significantly increased performance of business consultants

#47

Earlier quoted context omitted.

I’m starting to think there’s an LLM equivalent to the old saying about how everything the media writes is accurate except on the topics you’re an expert in. All LLM output looks to be good quality except when it’s output you’re an expert in. People who have no background in writing or editing think LLMs will revolutionize those fields. Actual writers and editors take one look at LLM output and can see it’s basically…

[flagged]

Why the anger?

Re: ChatGPT-4 significantly increased performance of business consultants

#48
post #24

The headline "GPT-4 increased BCG consultants’ performance by over 40%" is misleading since it implies that they became more productive in their actual work, when this is a carefully controlled study that separates tasks by an "AI frontier". Only inside the frontier did the "quality" of work increase by 40%, while they completed 12% more tasks on average.

Exactly, and right in the introduction they even say:

> while AI can actually decrease performance when used for work outside of the frontier

There is some value here but the authors can define "frontier" however they please to end up with whatever productivity increase they are looking for.

Re: ChatGPT-4 significantly increased performance of business consultants

#49

Earlier quoted context omitted.

Companies like BCG and McKinsey are mostly about liability, as a CEO you call them, pay them the big bucks, have them make up plans and strategies, if it works out you get the credit, if it doesn't then well "we worked tightly with experts from McKinsey, etc. so the blame isn't on me"

The frustrating one is when you've been telling management something for months (if not years), and the consultant comes in, and their report says what you been saying, and only then does the company finally do what you've been saying all along! Coulda saved the company 5-figures just listening to me. sigh politics.

Why is that frustrating? I find it validating

Re: ChatGPT-4 significantly increased performance of business consultants

#50
HN is so bad at predictions. Just a few months ago HN was awash with comments that confidently claimed LLMs were no more than stochastic parrots and unlikely to amount to anything.

> I can't help but think the next AI winter is around the corner. [0]

Yeah, right.

[0] https://news.ycombinator.com/item?id=23886325

Post reply on HN