Live data from Hacker News

ChatGPT-4 significantly increased performance of business consultants

d3.harvard.edu

211–220 of 282 posts

Re: ChatGPT-4 significantly increased performance of business consultants

#211

Earlier quoted context omitted.

I’m starting to think there’s an LLM equivalent to the old saying about how everything the media writes is accurate except on the topics you’re an expert in. All LLM output looks to be good quality except when it’s output you’re an expert in. People who have no background in writing or editing think LLMs will revolutionize those fields. Actual writers and editors take one look at LLM output and can see it’s basically…

LLMs are not worthless for programming. You just cannot expect it to ship a full programm for you, but for generating functions with limited scope, I found it very useful. How to make use of a new and common libary for example. But of course you have to check and test. And for text I know people who use it succesfully (professionally) to generate texts for them as a summary from some data. They still have to proof re…

I've been using it for code review. I just paste some of my code in and ask the AI to critique it, suggest ideas and improvements. Makes for a less lonely coding experience. Wish I could point it to my git repositories and have it review the entire projects.

I've had mixed experiences with getting it to generate new code. It produced good node.js command line application code. It didn't do so well at writing a program that creates 16 bit PCM audio file. I asked it to explain the WAV file format and things like lengths of structures got so confusing I had to research the stuff to figure out the truth.

Re: ChatGPT-4 significantly increased performance of business consultants

#212
post #165

Earlier quoted context omitted.

You aren't talking about the NLP the GP is talking about.

Ok now I’m /r/TooAfraidToAsk… NLP means something else relevant to probabilistic language models?

Natural language processing.

I actually don't know what you thought it meant.

Re: ChatGPT-4 significantly increased performance of business consultants

#213

Earlier quoted context omitted.

I don't buy it. LLMs cannot do anything reliably, no matter how constrained the domain. Their outputs are of acceptable quality when back to a person who will use their human brain to paper over the cracks. People can recognize when the output is garbage, figure out minor ambiguities, and subconsciously correct minor factual or logical errors. But I would never feed LLM results directly into another computer program…

I’m sympathetic to the instinct to push back on the absurd boosterism (these things are an existential threat to humanity this year ), it’s fucking annoying. But they can do plenty of useful stuff reliably. It’s not “be generally intelligent”, which they are just nothing even remotely close to, but know you don’t dig the LLM hype from that comment? Yeah, they get that every time.

I have tried to use LLMs, namely GPT4 and Llama-2, for sentiment analysis. They did quite poorly. I asked them to identify which sentiments from a list are found in a given text, with output formatted as a comma-separated list. In response I usually got just that. But sometimes I got a prose explanation of the sentiment, a list containing different keywords than requested, a list formatted differently than I wanted, or nothing useful at all.

Sentiment analysis is easy. It wasn't the end goal, just a "hello world" example to verify my tools were set up correctly. I ran into unsolvable problems in the tutorial.

I have no use for tools which do amazing things sometimes but which cannot be reasoned about and cannot be prevented from producing garbage. Maybe other people will find uses for them, though. I'll keep an open mind and check back in five years.

Re: ChatGPT-4 significantly increased performance of business consultants

#215

Earlier quoted context omitted.

>LLMs are not worthless for programming. They can be worse than worthless. They can sabotage your work if you let them making you spend even more time fixing it afterwards. For an example. I've used Gpt4 as a sort of Google on steroids with prompts like "do subnets in gcloud span azs" and ", "in gcloud secret manager can you access secrets across regions". I very quickly learned to ask "is it true" after every answer…

"They can be worse than worthless." But that is the same, when you blindly follow some stackoverflow answer. And yes, I always have to tweak and I use it only rarely. But when I did, it was faster than googling and parsing the results.

Nobody ever made a code editor plugin that reads random SO answers and automatically pastes them over your code.

The amount of fighting I needed against MS development tools mingling my code recently is absurd. (Also, who the fuck decided that autocomplete on space and enter was a reasonable thing? Was that person high?)

Re: ChatGPT-4 significantly increased performance of business consultants

#216

Earlier quoted context omitted.

It’s insane that people think producing pop music is easy. Competing on the pop music market is a cutthroat business with a lot of competition and the good ones get their price back in gold. When Scorpions wanted to be resurrected they hired Desmond Child to produce them and he absolutely crushed. These people are very good at what they do and there are very few of them.

The perception is that success in the field is driven largely by factors other than the quality of music. It'd be extremely interesting to see a Richard Bachman / Steven King [1] type experiment with a Desmond Child, Max Martin, or whoever else. Keep their existence completely out of the picture, and have them scout and produce talented no-name, but require the no-name to use only the sort of avenues that would be op…

Define quality

Re: ChatGPT-4 significantly increased performance of business consultants

#217
post #184

Earlier quoted context omitted.

>It's easy to be cynical about this It's probably easier to assume that their job is to provide objective expert advice since thats what they say they do. I'm being realistic here, not cynical.

the comment might be spot-on for some companies and industry, but really.. not all business culture is the same. By painting "all management" in this light you are showing the same one-dimensional thinking that is being criticized here..

Did you think I was making some comment about the millions of businesses and many governments that don't use the services of these consultants?

I can assure you I wasn't.

Re: ChatGPT-4 significantly increased performance of business consultants

#218
post #28
post #2

Says more about how useless BCG consultants are.

Most management consultants are useless. But there are some realities you must accept. Number 1. In a team of 20-30 engineers there is only one extremely god "why is he with us" engineers who is great at technical stuff and being a people person. However, no matter how nice he is his approach to his job, it is a job and I will only drop hints how the management should be done. He doesn't care about where the company…

The new tasks people get from talking to each other are usually well within their job description. They are just new tasks, and neither developers nor middle managers are allowed to drop useless tasks just before something valuable appeared.

Either way, in my experience management consultants just add new useless tasks for everybody on that set. I have never seen them actually decreasing the number of tasks.

Re: ChatGPT-4 significantly increased performance of business consultants

#219

Earlier quoted context omitted.

It’s also insane people think running a large business is easy, or that management consultants aren’t worth what they’re paid.

Worth here is the key word. I did an MBA which was specifically designed to get people into consulting, we did many consulting projects for real multinantionals and the key lesson was: "What does the hidden client want?" i.e. someone has been tasked with getting some consultants to come up with a suggestion, the key question however is what does THEIR boss want to hear. If you can work that out and give it to them th…

Wow I’m sure someone that paid some money for an MBA and then stopped at the gate of an entry level position has expertise in this matter.

Re: ChatGPT-4 significantly increased performance of business consultants

#220

Earlier quoted context omitted.

The perception is that success in the field is driven largely by factors other than the quality of music. It'd be extremely interesting to see a Richard Bachman / Steven King [1] type experiment with a Desmond Child, Max Martin, or whoever else. Keep their existence completely out of the picture, and have them scout and produce talented no-name, but require the no-name to use only the sort of avenues that would be op…

> other than the quality of the music The ‘quality’ of a pop song is how much popular appeal it has. That’s the basis of the genre, even reflected in the name.

But the qualities of the song are not what make it popular. With "pop" music there are far more important forces at play, namely the quantity and quality of the song's publicity. One of the big things you get with a big time producer is big time connections and a lot of "airplay" in mixes, commercials, TV shows, etc. You also open the door for more collaborations with other popular artists.

Occasionally you'll have a song that breaks through due to sheer catchy-ness, but this is the exception rather than the rule.

Post reply on HN