Live data from Hacker News

NanoChat – The best ChatGPT that $100 can buy

github.com

221–230 of 326 posts

Re: NanoChat – The best ChatGPT that $100 can buy

#221

Earlier quoted context omitted.

people say this like it's a criticism, but damn is it ever nice to start writing a simple crud form and just have copilot autocomplete the whole thing for me.

Back in the 90s you could drag and drop a vb6 applet in Microsoft word. Somehow we’ve regressed.. Edit: for the young, wysiwyg (what you see is what you get) was common for all sorts of languages from c++ to Delphi to html. You could draw up anything you wanted. Many had native bindings to data sources of all kinds. My favourite was actually HyperCard because I learned it in grade school.

4gl or RAD is still here, but now it’s called low- or no-code.

Re: NanoChat – The best ChatGPT that $100 can buy

#222
post #66
post #4

I've always thought about the best way to contribute to humanity: number of people you help x how much you help them. I think what Karpathy is doing is one of the highest leverage ways to achieve that. Our current world is build on top of open source projects. This is possible because there are a lot of free resources to learn to code so anyone from anywhere in the world can learn and make a great piece of software.…

I would adjust your formula to the: number of people you help x how much you help them x number of people you harm x how much you harm them For example - harming a little bit all content creators of the world, by stealing their work without compensation or permission. How much does that cost globally every year after year? How do we even quantify long term consequences of that? Stuff like that.

If you consider the cost of hiring a human professional to over using multimodal AI for something, its very realize literally thousands of dollars of value per chat.

Multiply that by many billions of chats per day.

Lawyers and other professionals charge a lot. So do artists, especially when you want to do a million revisions. LLMs hand it out for free, making many knowledge and art professions affordable and accessible to the masses.

Stable owners were upset when cars replaced horses, but you can't stop progress, especially when value proposition is undenyable.

Re: NanoChat – The best ChatGPT that $100 can buy

#224

Earlier quoted context omitted.

As noble as the goal sounds, I think it's wrong. Software is just a tool. Much like a hammer, a knife, or ammonium nitrate, it can be used for both good or bad. I say this as someone who has spent almost 15 years writing software in my free time and publishing it as open source: building software and allowing anyone to use it does not automatically make other people's lives better. A lot of my work has been used for…

> At least 2 billion people live in dictatorships. AI has the potential to become a tool of mass surveillance and total oppression from which those countries will never recover because just like the models can detect a woman is pregnant before she knows it, it will detect a dissenter long before dissent turns into resistance. It already works like this in your precious western democracies and they didn't need AI to b…

I don't know man. All this "tech" didn't see AOC, Sanders, and other 'radicals' coming. The parties actually had to expend effort after the fact to delegitimize them and have to continue to do so for additional candidates that come along(Jamal Bowman, Cori Bush, etc.)

Re: NanoChat – The best ChatGPT that $100 can buy

#225
post #41

Earlier quoted context omitted.

This free tradition in software is I think one of the things that I love so much, but I don't see how it can continue with LLMs due to the extremely high training costs and the powerful hardware required for inference. It just seems like writing software will necessarily require paying rent to the LLM hosts to keep up. I guess it's possible that we'll figure out a way to do local inference in a way that is accessible…

There's a Stephen Boyd quote that's something like "if your optimization problem is too computationally expensive, just go on vacation to Greece for a few weeks and by the time you get back, computers might be fast enough to solve it." With LLMs there's sort of an equivalent situation with cost: how mindblowing would it be able to train this kind of LLM at all even just 4 years ago? And today you can get a kindergart…

But in this case the reason is simple: the core algorithm is O(n^2), this not going to be improved over a few weeks.

Re: NanoChat – The best ChatGPT that $100 can buy

#226

Earlier quoted context omitted.

I think you got your proportions slightly wrong there. This will be contributing as much to an AI bubble as a kid tinkering around with combustion is contribution to global warming.

Not really. Anything that guy does sets the tone for an extended cacophony of fans and followers. It would be a sad day when nobody critically assesses the motivations, effects and framing of those moves. I question the claim this move helps humanity and stand by the assessment it's just more feeding an unfree ecosystem which equates to propping up the bubble.

That certainly sounds very ominous.

Re: NanoChat – The best ChatGPT that $100 can buy

#227
post #203

Earlier quoted context omitted.

okay but he literally does have a bridge that non-deterministically might take you to the wrong place to sell you

The original context of this sub-thread was Karpathy saying how AI coding tools were pretty useless for him when working on this particular project.

Indeed. And only Karpathy is entitled to say that AI tools produce wrong code for him. And he's only entitled to say it for this project only.

If anyone else says this, "the skepticism is exhausting", and their experience is completely irrelevant.

Re: NanoChat – The best ChatGPT that $100 can buy

#228
post #107

Interesting exchange on the use of AI coding tools: curious how much did you write the code by hand of it? Karpathy: Good question, it's basically entirely hand-written (with tab autocomplete). I tried to use claude/codex agents a few times but they just didn't work well enough at all and net unhelpful, possibly the repo is too far off the data distribution. https://x.com/karpathy/status/1977758204139331904

This makes sense, right? It's a relatively novel thing to be writing. I don't find it to be a damning remark like other comments here seem to be concluding. If anything, the fact that Karpathy reached towards Claude/Codex in an attempt to gain value is indicative that, in previous coding efforts, those tools were helpful to him.

> This makes sense, right? It's a relatively novel thing to be writing.

It's really not though? Honestly I'm surprised coding agents fail hard at this task apparently

Re: NanoChat – The best ChatGPT that $100 can buy

#229
post #121

Earlier quoted context omitted.

> the repo is too far off the data distribution ah, this explains why these models have been useless to me this whole time. everything i do is just too far off the data distribution!

Everything is unless your app is a React todolist or leatcode questions.

I don't know. I successfully use it for small changes on VHDL FPGA designs these days.

Re: NanoChat – The best ChatGPT that $100 can buy

#230

Earlier quoted context omitted.

It is amusing to note the dichotomy between the clearly compassionate, empathetic and altruistic perspective displayed here and the comically overstated framing of helping humanity.

(Shrug) Other sites beckon.

This is wholly unhelpful.
Post reply on HN