Live data from Hacker News

Artificial intelligence is losing hype

economist.com

331–340 of 814 posts

Re: Artificial intelligence is losing hype

#331

Earlier quoted context omitted.

I think that Greptile is on the right track. I made a repo containing the c# source code for the godot game engine, and it's "how to do X", where X is some obscure technical feature (like how to create a collision query using the godot internal physics api) is much better than all the other ai solutions which use general training data. However there are some very frustrating limitations to greptle, so severe that I b…

I work at Greptile and agree on all three criticisms. 1) is a bug we haven't been able to fix, 2) has to do with the high cost of re-indexing, we will likely start auto-updating the index when LLM costs come down a little, and 3) has to do with LLM speed. We pushed some changes to cut time-to-first-token by about half but long way to go. Re: prompt engineering, we have a prompt guide if that helps, was that what you…

No idea about the product, but I would like to congratulate you guys on what is maybe the greatest name ever. Something about it seems to combine "fierce" with "cute", so I think you should consider changing your logo to something that looks like reptar

Re: Artificial intelligence is losing hype

#332
Yes, hype happens because something new that can potentially be applied to many problems triggers lots of experimentation and discussion. Once people figure out the problems to which it's well-suited and ill-suited, experimentation and discussion die down and there's just application. Nothing to see here, this is standard and expected.

Re: Artificial intelligence is losing hype

#333

Earlier quoted context omitted.

I work at Greptile and agree on all three criticisms. 1) is a bug we haven't been able to fix, 2) has to do with the high cost of re-indexing, we will likely start auto-updating the index when LLM costs come down a little, and 3) has to do with LLM speed. We pushed some changes to cut time-to-first-token by about half but long way to go. Re: prompt engineering, we have a prompt guide if that helps, was that what you…

No idea about the product, but I would like to congratulate you guys on what is maybe the greatest name ever. Something about it seems to combine "fierce" with "cute", so I think you should consider changing your logo to something that looks like reptar

So glad you like it - we were worried it was too silly.

The logo is supposed to be a reptile claw but we might modify it to make that more obvious.

Re: Artificial intelligence is losing hype

#334

Earlier quoted context omitted.

Software engineer for multiple decades here. None of the AI assistants have made any major change to my job. They are useful tools when it's time to write code like many useful tools before them. But the hard work of being a senior+ software engineer comes before you start typing.

I am not a software engineer and these tools allow me to make a giant mess of an app in a weekend that kind of does what I want but I only get that weekend. Once I come back to it after any length of time, since I have no idea what I am doing or what is going on it is impossible to update or add to the app without breaking it. Now I have all these new ideas but I am back to square one because it just seems easier to…

This.

It’s great at helping me automate things I normally do not have time to attempt.

Re: Artificial intelligence is losing hype

#335
post #124

Earlier quoted context omitted.

> I am yet to see any reasoned argument for why it is easy to build real AI and that it will come fast. We have "real ai" already. As for future progress, have you tried just simple interpolation of the progress so far? Human level intelligence is very near. (Though of course artificial intelligence will never exactly match human intelligence: it will be ahead/behind in certain aspects...)

- We don't have a "real AI" at all. Where's Skynet, where's HAL-9000? Where are the cute robotic butlers from the "I, Robot" movie? - Simple interpolation of the progress is exactly the problem here. Look at the historical graphs of AI funding and tell me with a straight face that we absolutely must use simple interpolation. - Nope, human-level intelligence is not even close. It remains as nebulous and out of reach a…

> We don't have a "real AI" at all. Where's Skynet, where's HAL-9000? Where are the cute robotic butlers from the "I, Robot" movie?

You shouldn’t use science fiction as your reference point. It’s like saying “where is my flying car?” (Helicopters exist)

Re: Artificial intelligence is losing hype

#336
Yes and no. Hype over ‘API wrapper’ projects and startups will crash a bit, I think.

On the other hand we are no where near approaching hard limits on LLMs. When LLMs start to be trained for smaller subject areas with massive hand curated examples for solving problems, then they will reach expert performance in those narrow tech areas. These specialized models will be combined in general purpose MoEs.

Then new approaches beyond LLMs, RL, etc. will be discovered, perfected, made more efficient.

Seriously, any hard limits are far into the future.

Re: Artificial intelligence is losing hype

#337
post #231

I just asked Google's Gemini the following question: Q: How many N's are there in Normation? A: There is one N in the word "Normation" Note that the answer is the same when asked n's instead of N's. And this is but one example of many simple cases demonstrating that these model are indeed not reasoning in a similar manner to humans. However, the outputs are useful enough that I myself use Claude and GPT-4o for some w…

Local instance of Llama 3.1 8B

Q: How many N's are there in Normation? A: There are 2 N's in the word "Normation". Q: Confidence level? A: A more precise question! After rechecking, I can confirm that there is indeed 2 N's in the word "Normation". Confidence level: 100%

Q: How many N's are there in the string "Normation"? A: There are 2 N's in the string "Normation".

On several regenerations, at some point it gives: A: There are 3 N's in the word "Normation". Q: Confidence level? A: A slight challenge! After re-checking, I see that there are actually 2 N's in the word "Normation".

Re: Artificial intelligence is losing hype

#338

Earlier quoted context omitted.

I think my general perception is that AI is a great assistant for some occupations like software engineering, but due to its large room for error it's very impractical for majority of business applications that require accuracy. I'm seeing this trend at my company, which operates in the medical field and recently mandated that all engineers use CoPilot. At the same time it's a struggle to see where we can improve our…

I've been using (GitHub) Copilot and ChatGPT since they've been widely available. I started using ChatGPT for coding after 4 came out. I was an early advocate for Copilot but, honestly, nowadays I really don't find it that useful, compared to GPT-4o via ChatGPT. ChatGPT not being directly integrated into my editor turns out to be an advantage. The problem with Copilot is it gets in the way. It's too easy to unintenti…

Have you tried using the shortcut for turning copilot on/off? I know what you mean and in those cases I just turn it off for a second and type freely, then turn it back on.

Re: Artificial intelligence is losing hype

#339

I tried to do some AI database clean up this weekend - simple stuff like zip lookup and standardizing spacing, and caps - and ChatGPT managed to screw it ip over and over. It’s the sort of thing there a little error means the answer is totally wrong so I spent an hour refining the query and then addressing edge cases etc. I could have just done it all in excel in less with less chance of random (hard to catch) errors…

The point is that these problems will follow the same growth trajectory as every other tech bug. In other words, they will go away eventually.

But the Rubicon is still crossed. There is a general purpose computer system that understands human language and can write real sounding human language. That's a sea change.

Re: Artificial intelligence is losing hype

#340

As usual, when we see a thread on this topic on HN, the reactions tend to be bimodal: either "Yes, AI has transformed my workflow" (which is where I mostly fall), or "No, it's over-hyped." The latter often comes with an anecdote about how an LLM failed at a relatively simple task. I speculate that this diversity in opinion might be related to whether or not the user is employing a pro-tier LLM. Personally, I've been…

I'm using the latest top paid models, gpt4o and claude 3.5. They work when there's a lot of examples on github or google, but once you get into something that doesn't have a lot of examples like closed source code or rarely used libraries, it will start hallucinating and even mixing up different API versions to create a mess that doesn't work at all. I don't believe LLMs will get any better than this without a new ma…

> don't believe LLMs will get any better than this without a new major breakthrough, but this is already better than using Google search

I mean .. every single org is invested in that research right now

Post reply on HN