Live data from Hacker News

ChatGPT turned generative AI into an “anything tool”

arstechnica.com

91–100 of 245 posts

Re: ChatGPT turned generative AI into an “anything tool”

#91

AI hypes every twenty years. Instead of moving goalposts, let's accept that each one succeeded at mechanizing intelligence. Including boolean algebra, writing and arithmetic.

When was the last time an AI product reached 100 million users in a few months?

I seem to have forgotten that locust cycle.

Re: ChatGPT turned generative AI into an “anything tool”

#92

Earlier quoted context omitted.

That's why I think open source LLMs are the ones that will actually persist throughout the commercial enshittification and reign supreme at the end.

I'm more interested in Open Source/Local LLM's ability to consume private data as an internal knowledgeable. For example, feed in your entire source repo(s) and then ask it questions about where something is or how it works.

I am constantly searching for this. To point a locally hosting LLM to a locally hosted code repo - and then start improving it from there would be awesome.

Re: ChatGPT turned generative AI into an “anything tool”

#93

Earlier quoted context omitted.

That's why I think open source LLMs are the ones that will actually persist throughout the commercial enshittification and reign supreme at the end.

I'm more interested in Open Source/Local LLM's ability to consume private data as an internal knowledgeable. For example, feed in your entire source repo(s) and then ask it questions about where something is or how it works.

You would still need a huge training and data set for model before it can do something useful from your private data.

Re: ChatGPT turned generative AI into an “anything tool”

#94

Although let's see if it is sustainable. I pay for ChatGPT Plus but most people aren't, and from what I've read they're losing money like crazy. We may wind up seeing this as the technical high point before the various competitors cut back on expensive hardware/energy usage for the free tier, and the quality of the responses takes a dive. This might sound a bit conspiratorial so apologies for that but back when the c…

That's why model hashes/transparency is necessary. There's absolutely no reason anyone should ever consider building a deployed app that uses an API whose underlying model could change any second to something far dumber. The only thing that could avoid this is competition and commodification of LLMs.

Re: ChatGPT turned generative AI into an “anything tool”

#95
post #70

Earlier quoted context omitted.

> I'd like to have LawGPT I tried ChatGPT 4 for a specific TX county's laws. This was after I had spent hours doing traditional search. ChatGPT got everything correct, and even gave me some more direction.

> ChatGPT got everything correct My anecdote with technical information is exactly the opposite, unfortunately. I routinely use it to help guide my research - generally about topics I know something about but want to know more. It often will provide some response that is entirely wrong but looks very good. When called out, it apologizes, then proceeds to produce more information that's also not entirely correct. Ther…

I have found the very similar issues.

But on programming language and other logical question areas it does not matter much, as you can verify with logic if something is correct, and then it is incredible useful

Re: ChatGPT turned generative AI into an “anything tool”

#96
post #67

Earlier quoted context omitted.

I'm actually worried of the inevitable enshitification of Open AI. Right now, GPT 4 is great and I use it every day. I rely less and less on Google and save a ton of time. Google has gone downhill hard for a few years, thanks to all these silly blog engines like medium, substack and the like. I'm really worried and would like to 'freeze' GPT 4 as is, at least with the data up to Sep 2021, and for them to not change o…

This is a good point and I'm surprised it hasn't had more attention. We've seen history repeat itself enough times that it's inevitable. Probably the best you can do is download a few of the full precision 70B or bigger models (LLaMA etc) to at least have some state of the art weights around you could use yourself if you wanted if/when openAI goes to shit. The nice thing about the language models is as least they're…

>... compared to google search which you'd never be able to host locally

That's something I haven't thought about for a long time. How big is the Google index, would you say? Petabytes or exabytes, or am I vastly overestimating?

Re: ChatGPT turned generative AI into an “anything tool”

#97

Earlier quoted context omitted.

Bing chat uses DALL-E for image generation. The results were complete gibberish. Characters that looked like an alien alphabet and the graphic was also so abstract to not represent anything.

Generative image systems are notoriously poor at producing legible text without significant rerolls. You'd be far better off generating a textless logo and then layering text afterwards using PS, Photopea, Krita, etc,

why are they so bad at text?

Re: ChatGPT turned generative AI into an “anything tool”

#98

Although let's see if it is sustainable. I pay for ChatGPT Plus but most people aren't, and from what I've read they're losing money like crazy. We may wind up seeing this as the technical high point before the various competitors cut back on expensive hardware/energy usage for the free tier, and the quality of the responses takes a dive. This might sound a bit conspiratorial so apologies for that but back when the c…

> from what I've read they're losing money like crazy.

Source? Random tweets don't count.

> They're legitimately bad today (Siri in particular, but even Google Assistant is much worse than itself from back then)

Your anecdote. My anecdote is Siri doesn't change, but our expectation becomes much, much higher. Siri blew everyone's mind by... making a phone call to nearby Starbucks. When it came out that phone call was a super big deal.

Re: ChatGPT turned generative AI into an “anything tool”

#99

Although let's see if it is sustainable. I pay for ChatGPT Plus but most people aren't, and from what I've read they're losing money like crazy. We may wind up seeing this as the technical high point before the various competitors cut back on expensive hardware/energy usage for the free tier, and the quality of the responses takes a dive. This might sound a bit conspiratorial so apologies for that but back when the c…

It’s sustainable. Llama.cpp is orders of magnitude more efficient than Llama because it’s in Rust. OpenAI hasn’t even touched low level languages yet.

Are you seriously not knowing what .cpp in llama.cpp stands for?

Re: ChatGPT turned generative AI into an “anything tool”

#100

Although let's see if it is sustainable. I pay for ChatGPT Plus but most people aren't, and from what I've read they're losing money like crazy. We may wind up seeing this as the technical high point before the various competitors cut back on expensive hardware/energy usage for the free tier, and the quality of the responses takes a dive. This might sound a bit conspiratorial so apologies for that but back when the c…

Assuming your hardware requirements are correct I would gladly buy this hardware for on premise support for always available ChatGPT4.
Post reply on HN