Live data from Hacker News

Tell HN: ChatGPT is fantastic for finding and solving issues in logs

news.ycombinator.com

51–60 of 184 posts

Re: Tell HN: ChatGPT is fantastic for finding and solving issues in logs

#53
post #17
post #3

I wish people would focus on these exceptional strengths of the model rather than blabbing about AGI or whatever. Similarly to you, I have been able to find issues with logs, formatting, asking it quick query questions in [whatever flavor of query language XYZ service likes to use], etc.. and it's really, really good. The alternative is to muscle through it, using a lot of energy, writing my own parser or something d…

That's actually the hidden secret. Millions of people are using it to solve their problems quietly - something Google and other companies whose lunch they're eating should be worried about rather than being worried about grand ideas like "AI Safety". Pretty much all of my non-tech family is using it in ways that I never expected: making meal plans, writing school essays, making assignments for students, writing email…

I'd pay for a service that let me take a few pictures of the contents of my fridge and pantry and then generate a list of recipes. Sounds like a good idea for a "ducktape AI" startup.

Re: Tell HN: ChatGPT is fantastic for finding and solving issues in logs

#54

Earlier quoted context omitted.

Never underestimate a hype bubble ;) The crypto one lasted for many years with far fewer use cases than LLMs, even accounting for hallucinations.

I never upgraded to pro and I spent like $2 on credits so far this month. I could easily see them hitting a $1b/yr which to me isn't niche market or a hype bubble.

A large profitable business can still be overpriced or inflated by a bubble. Like Cisco/Intel in the 90s

Re: Tell HN: ChatGPT is fantastic for finding and solving issues in logs

#55
post #12

I let GPT-4 walk me through troubleshooting steps with my extremely slow read times on my SSD-backed KVM virtual machine. It told me the things it needed, I pasted relevant logs and other output, and finally I solved my issue. I was highly impressed! It parsed atop, top, and various other content, explaining exactly what everything meant. Another benefit was that it was able to present a much more readable version of…

Used it recently to try and diagnose a weird networking issue on a server. It got me pretty far, but then the only next steps it could suggest involved installing some software that wasn't pre-installed. I don't like modifying prod servers by hand, especially because we do the whole infrastructure-as-code thing.

So I pinged a more senior engineer, they solved it. I asked what they did. They did exactly what GPT-4 had suggested for me to do. (Don't worry we ended up fixing it "properly" afterwards and re-launched the instance). I'm still not going to trust it when it tells me to do something I don't understand on a prod instance, but that was fun to see.

Re: Tell HN: ChatGPT is fantastic for finding and solving issues in logs

#56

Awesome! It is also fantastic for understanding chunks of Bash script, Perl, AWK etc where if you don't know something then it's next to impossible to search for it using a non-AI search engine. Bonus: you can also use it to understand what the various flags in a command do.

Yeah it's truly incredible w scripts

Re: Tell HN: ChatGPT is fantastic for finding and solving issues in logs

#58
post #14

Earlier quoted context omitted.

Yeah, it only takes a small hallucination to delete emails instead of copy them

lol, indeed. As long as the hallucination problem remains, I think we are going to see a significant hype bubble crash within a year or so. Yes, it is still useful under proper guidance, but building things on full automation that are reliable doesn't seem to be something that is actually within realms of reality at present. More innovations will be required for that.

My understanding is the base model is pretty good about knowing whether it knows stuff or not. it's human feedback training that causes it to lose that signal.

Re: Tell HN: ChatGPT is fantastic for finding and solving issues in logs

#59
post #33

I used it to transform cryptic credit card statement items into company names, which then allowed me to query my Gmail archives for receipts and invoices from these vendors, automating a manual process of accounting backup discovery that is the bane of my very existence. I even got GPT-4 to assess whether an email likely relates to an invoice or payment so that I could limit the amount of noise extracted from my emai…

Are you triggering on email received? I'd love to see how you went about this so I can solve some of my own headaches!

Re: Tell HN: ChatGPT is fantastic for finding and solving issues in logs

#60

Earlier quoted context omitted.

We don’t know how many books and academic papers were in the dataset.

I can say with absolute certainty they did not include all books with all human knowledge. For example I suspect chat GPT has zero knowledge of how to speak native American languages that have effectively died with no remaining speakers and no complete written history of their exact usage.

It also has massive gaps when it comes to problems when porting video games, concepts in game audio like procedural mixing, and even basic stuff like not generating a terribad NGINX config despite being fed the documentation. Anything niche, it's appalling. Anything you can otherwise Google? Sure.
Post reply on HN