Live data from Hacker News

Tell HN: ChatGPT is fantastic for finding and solving issues in logs

news.ycombinator.com

131–140 of 184 posts

Re: Tell HN: ChatGPT is fantastic for finding and solving issues in logs

#131

Earlier quoted context omitted.

No, humans don't work like your simplistic view of a neural network. I as a human can apply logic and deduction to figure out how something works despite never having experienced or learned about it directly for example. GPT cannot do this and can only guess or make up responses when faced with a problem that requires such reasoning.

GPT cannot do this? Not even a bit? Well... that's definitely an opinion. A reasonable person would grant it _some_ level of reasoning ability, however flawed. To dismiss it all as 'pattern matching' rather shows some confused ideas about how cognition works, as if pattern matching plays no role in human cognition or intelligence. I'll understand difference in opinion if we're talking about more nebulous aspects like…

> Well... that's definitely an opinion. A reasonable person would grant it _some_ level of reasoning ability, however flawed.

No this is not an opinion, this is an objective fact about how deep learning and neural network models work period. You are confabulating capabilities onto them which they do not have. There's not 'some level of reasoning' in a neural network, there's _no reasoning_.

You're being tricked by plausible sounding responses from something trained on an enormous corpus of internet BS (reddit posts, etc.). There is no intelligence or reasoning or logic inside GPT.

Your human emotions (which GPT does not have) are clouding your judgement and making you think there is intelligence there which does not actually exist--you want it to be there so badly you'll invent reasons to confirm your views. If you asked GPT directly if it were intelligent or sentient it would not agree with you either, because it was not trained to do so.

Re: Tell HN: ChatGPT is fantastic for finding and solving issues in logs

#132
post #103

Earlier quoted context omitted.

That log line ( with the four space at the front for HN formatting) is 40 tokens [1]. You can easily fit several hundred log lines with GPT4 8k context and with the incoming 32K context, you'll be able to fit close to a thousand log lines. That's a lot of context, especially if you can prefilter from relevant services, nodes, etc. or provide a multi-node trace [1] https://platform.openai.com/tokenizer

200 lines @ 40 tokens per line equates to 8,000 tokens. That costs $1.60. for one query.

Someone making $100 per hour would be able to analyze those 200 logs for about 7 minutes for that cost. That's a person you pay over 200k of salary.

I analyze logs at work all the time and I analyze way more than 200 lines and it takes way less than 7 minutes to analyze those 200 lines.

Somehow I don't think it would be more cost effective to have an intern paste those into ChatGPT over and over and blow through a ton of money doing it.

Re: Tell HN: ChatGPT is fantastic for finding and solving issues in logs

#134
post #115

Earlier quoted context omitted.

I keep seeing anecdotes like this, and I wonder: How do you feel about the privacy aspect of this? To do this, you had to feed your email into GPT-4, right?

Why do you think your email is private? Is your email provider more aligned with your interests or more secure than OpenAI? I doubt either Google or Microsoft care about your privacy (no difference).

Of course Google and Microsoft is more secure than OpenAI.

And Google and Microsoft don't care about your privacy but they do care about being the only ones to profit off your data. OpenAI don't make profit off of your data, but they are collecting it; how they choose to make profit off of it in the future could be completely orthogonal to your interests.

Hell, China or any other of the numerous wealthy baddys could buy OpenAI and have access to all the data they're storing.

Amazing that you're so blase about this

Re: Tell HN: ChatGPT is fantastic for finding and solving issues in logs

#136

Earlier quoted context omitted.

GPT cannot do this? Not even a bit? Well... that's definitely an opinion. A reasonable person would grant it _some_ level of reasoning ability, however flawed. To dismiss it all as 'pattern matching' rather shows some confused ideas about how cognition works, as if pattern matching plays no role in human cognition or intelligence. I'll understand difference in opinion if we're talking about more nebulous aspects like…

> Well... that's definitely an opinion. A reasonable person would grant it _some_ level of reasoning ability, however flawed. No this is not an opinion, this is an objective fact about how deep learning and neural network models work period. You are confabulating capabilities onto them which they do not have. There's not 'some level of reasoning' in a neural network, there's _no reasoning_. You're being tricked by pl…

The error in your thinking is that you assume the essence of human cognition cannot ever be reducible to a algorithmic process that our current transformer models are approximating. Which may be the case... but we don't know for certain yet, so your certainty of the negative is also not warranted.

I can say the same your fears of machine intelligence is clouding your ability to objectively assess evidence.

You can design a novel problem and see for yourself the reasoning and logical deductions an LLM will make to solve it, like many have already done.

> If you asked GPT directly if it were intelligent or sentient it would not agree with you either

If you think this class of questions is appropriate to gauge reasoning ability, I don't know what to tell you.

Re: Tell HN: ChatGPT is fantastic for finding and solving issues in logs

#137
post #37

Earlier quoted context omitted.

In addition, for recipes, it’s just a better Google. If I do “Give me a concise recipe for X” it gives me one. No fluff, no ads. Just ingredients and steps. For example. I asked for pasta carbonara, concise and then even more concise. Final result: Quick Carbonara (4 servings) Ingredients: 12 oz pasta 4 eggs 1 cup cheese 8 oz bacon 4 garlic Salt, pepper Parsley (opt) Cook pasta, save water. Mix eggs, cheese. Fry baco…

>> Combine, mix, season. That "Combine" is doing all the work in there.

The recipe is terrible, it neither has the detailed enough ingredients list nor the cooking technique for carbonara.

Someone who hasn't cooked a carbonara just isn't going to be able to cook it with that recipe.

Re: Tell HN: ChatGPT is fantastic for finding and solving issues in logs

#138
post #100
post #69

Yeah it's pretty awesome! I used GPT-4 last week to fix my corrupted SSD. Granted I already narrowed down the kernel logs to a few suspicious lines, but I just pasted those 10 lines in and asked for a fix. Pasting in GPT's arcane `fsck` incantations and boom -- fixed SSD. Saved me an hour or two of hassle reading man pages and stack overflow posts.

Holy crap, I've seen GPT models hallucinate api calls often enough, I would be shitting my pants when touching anything related to a drive.

Yeah while I use ChatGPT to help with pointers, I would never copy-paste a command directly from ChatGPT into my terminal without doing a bit more research into what exactly those commands were doing.

Re: Tell HN: ChatGPT is fantastic for finding and solving issues in logs

#140
post #3

I wish people would focus on these exceptional strengths of the model rather than blabbing about AGI or whatever. Similarly to you, I have been able to find issues with logs, formatting, asking it quick query questions in [whatever flavor of query language XYZ service likes to use], etc.. and it's really, really good. The alternative is to muscle through it, using a lot of energy, writing my own parser or something d…

I pasted in a code snippet and asked if it was threadsafe (I already knew it wasn't) and it confirmed what I knew, and gave a simpler solution that worked for my particular use case that what I would have done.

Anything to do with threads is hard™ and it did it.

Though I think the big thing less tech savvy users have yet to realize is: GIGO still applies. If your prompts are bad, the output is bad. And if you didn't know your prompt was bad, it's almost impossible to know the output is too.

Post reply on HN