Live data from Hacker News

Ask HN: What are your thoughts on ChatGPT as a professional?

news.ycombinator.com

31–40 of 65 posts

Re: Ask HN: What are your thoughts on ChatGPT as a professional?

#31
post #22

I use ChatGPT everyday and I am sure it is a great, novel, and revolutionary tool. I said I am sure because I can measure how ChatGPT inproves my daily work. I don't use it for software development because I am in a management role now. The first insight is that an article that I need to publish could be proofread immediately while before I used an incredible professional content editor that could take hours for revi…

Are you using ChatGPT to proofread your articles? And you trust it despite the hallucinations? Isn't that very backwards? You should proofread and triple check the output, unless the articles you're writing are fiction and you use it for spell-checking, but then just use the spell-checking in your editor.

Re: Ask HN: What are your thoughts on ChatGPT as a professional?

#32
I think it depends where you end up, but where I currently work we almost mandated that devs at least get familiar with how to use it, if not necessarily use it in everyday work. It's just too useful and valuable to omit.

What I've also found is it's incredibly useful for domain knowledge too. I've been working on a project around electrical grids, and when I had to go deep into how AC grid electrical engineering stuff, it was very very helpful. It's useful for business related stuff too.

At the end of the day, I think it's a powerful tool that shouldn't become a crutch, and any company saying otherwise is sabotaging themselves. But that's not to say they wouldn't be a good place to work for, companies sabotage themselves in all sorts of ways :)

Re: Ask HN: What are your thoughts on ChatGPT as a professional?

#33
It appears to be good enough to make you believe its answers are trustworthy. It's bad enough that you should not trust it with anything it says and doublecheck everything that it produces.

It's great for getting started quick, but don't fall into the trap of believing it could be a viable replacement for a human expert or a reviewed reference.

To be honest, I tend to believe now we're a long way off from an AI capable of that (again).

Re: Ask HN: What are your thoughts on ChatGPT as a professional?

#34
I work in biotech and at my company, specifically our CEO, for over a decade has constantly asked all of us, "How are you leveraging AI in your job?". So much so that we used to joke about it. Well, when ChatGPT arrived, something happened. Everyone at the company (now about 5000 people) were already primed, looking for how they could finally answer "Yes" to our obsessive CEO. We have a deep roster of professional software engineers, and one dev in particular hacked out an internal site that leveraged the OpenAI API and deployed it company wide. Last count, a majority of the company uses it daily. What my team specifically has found is that building custom GPTs and working out detailed, two-way prompts, has allowed us (and specifically my part-time employee) to deliver detailed technical reports commensurate to an FTE. The key is to force the output to "show it's work" and to expect to review similar to how you would work with a first year graduate student. If you do the math, this puts the company above it's FTE cost in terms of per employee output. That's the real ticket right now. It's not inventing the next drug, but it sure as hell is making me more productive without causing burn-out. It works really well also at meeting minutes, a huge source of time-waste for project managers who should be doing high-thought work instead of menial tasks.

So to answer your question: become reliant on it. This is the future of white-collar work. Local instances are catching up to the big ones. It's only going to get better!

Re: Ask HN: What are your thoughts on ChatGPT as a professional?

#35
We (an engineering consultancy, so not software but physical infrastructure) have an internal ChatGPT so that people can use it for work.

I find that it is quite good at answering textbook type questions and giving background on things. Basically a kind of supercharged search engine.

So for example, if I knew nothing about water treatment technology, I could ask it "what are the typical stages of water treatment for groundwater from a borehole?" and it will give me a good answer. Sometimes when you ask more specific questions, it will give some weird answers. It was convinced that desalination was already the main source of drinking water in a particular country, probably because there have been a lot of new desal schemes proposed and so the input corpus has a lot of associations between that country and desalination.

I just asked it a question on whether you could use nitrogen to cool a nuclear reactor (correct answer is yes, if it's enriched heavy nitrogen) and it gave an ok answer but didn't mention that N14 absorbs neutrons. This is pretty obvious but there is very little written about this idea in the likely input corpus so ChatGPT doesn't know this.

It cannot (and in fact, standard LLMs cannot because of how they architected) answer questions that require constructing counterfactuals or hypotheticals outside their input base. To note, from the point of view of an LLM, something which is covered in its input corpus is neither a counterfactual nor a hypothetical even if they are relative to the real world. So if nobody has ever written anything on the use of a particular technology for a particular purpose, no pure LLM will be able to answer questions relating to it. Other emerging AI technologies look like they will be able to do that though.

Re: Ask HN: What are your thoughts on ChatGPT as a professional?

#36
I guess you mean code-generating LLMs in general, not specifically ChatGPT.

For programmers I think they're valuable tools and productivity enhancers. Knowing how to use one effectively to boost your productivity is important.

The "[thing] will kill software engineering" narrative is one we hear every time something new boosts productivity by hiding abstractions - high level programming languages, IDEs, garbage collection, etc. The end result is never less programmers, it's more code. More stuff gets made that otherwise would not be. Same will be true for LLMs.

Re: Ask HN: What are your thoughts on ChatGPT as a professional?

#37
post #26

It makes mistakes all the time even for simple tasks.

Whenever someone says this, I always wonder whether we're talking about the same tool. GPT-3.5 scores at the bottom 10% in a lot of tasks where GPT-4 scores in the top 10%.

Not the same task. Gpt-4 scored top 10% at simple tasks gpt 3 was already good at, and a little less worthless on some tasks that gpt-3 were really bad, it didn't completely revolutionize at any kind of task.

Re: Ask HN: What are your thoughts on ChatGPT as a professional?

#38
post #9

> is there any stigma with using ChatGPT in the workplace? I work in a big tech company. ChatGPT (and equivalent systems) is becoming pervasive in developers tooling. There's no stigma, it's used is actually encouraged. I don't think it's a life changer or that it'll save engineers the time to learn their craft.

Can you explain how you use it? Every time I try to use it for programming, the output is somewhat nonsensical. I also tried copilot but that was even worse (for terraform and python)

Typical use, I need to write a script or bit of code for a language I'm not super familiar with. Examples: write a bash script that tests this and that. Write a unit tests in python for this function. How can you do this idiomatically using the C++ stdlib.

Less common: code transformation. I have this json output and I want to turn it to a different format without bothering writing a script. I give chatgpt a few examples of the transformation, and have it done for the rest. I'll still have to fix it but it can save me a bit of the time.

And finally, when I stumble on an API I don't know anything about, I can get a better grasp by asking ChatGPT some questions about it.

Again, not life changing or even a huge productivity booster, but it helps. Also, it's good to know when ChatGPT isn't going to help and avoid losing time.

Re: Ask HN: What are your thoughts on ChatGPT as a professional?

#40
No stigma. If it helps, use it. Don't discard a useful tool but know its limits. You are not paid to carry around trivia to be used in a vacuum. You are paid to solve problems that sometimes involve programming.

It serves me well for micro-programming. So problems between a single line of code and a function. Here I can control for all its weirdness and hallucinations. As soon as I need to compose these elements I found it somewhere between neutral and a nuisance. High-level changes across a domain or further are impossible.

Understanding problems inside-out or from first principles has been vastly more helpful than blindly copying around libraries/SO answers/Copilot ideas.

That said, I have been in this industry for over a decade, am jaded and bitter and up to my armpits in Stockholm Syndrome, and have learned how to keep computers happy. Starting out I would have loved Copilot and it would have absolutely made a huge difference.

Post reply on HN