Earlier quoted context omitted.
people say this like it's a criticism, but damn is it ever nice to start writing a simple crud form and just have copilot autocomplete the whole thing for me.
Back in the 90s you could drag and drop a vb6 applet in Microsoft word. Somehow we’ve regressed.. Edit: for the young, wysiwyg (what you see is what you get) was common for all sorts of languages from c++ to Delphi to html. You could draw up anything you wanted. Many had native bindings to data sources of all kinds. My favourite was actually HyperCard because I learned it in grade school.
NanoChat – The best ChatGPT that $100 can buy
221–230 of 326 posts
Re: NanoChat – The best ChatGPT that $100 can buy
#222I've always thought about the best way to contribute to humanity: number of people you help x how much you help them. I think what Karpathy is doing is one of the highest leverage ways to achieve that. Our current world is build on top of open source projects. This is possible because there are a lot of free resources to learn to code so anyone from anywhere in the world can learn and make a great piece of software.…
I would adjust your formula to the: number of people you help x how much you help them x number of people you harm x how much you harm them For example - harming a little bit all content creators of the world, by stealing their work without compensation or permission. How much does that cost globally every year after year? How do we even quantify long term consequences of that? Stuff like that.
Multiply that by many billions of chats per day.
Lawyers and other professionals charge a lot. So do artists, especially when you want to do a million revisions. LLMs hand it out for free, making many knowledge and art professions affordable and accessible to the masses.
Stable owners were upset when cars replaced horses, but you can't stop progress, especially when value proposition is undenyable.
Re: NanoChat – The best ChatGPT that $100 can buy
#223Re: NanoChat – The best ChatGPT that $100 can buy
#224Earlier quoted context omitted.
As noble as the goal sounds, I think it's wrong. Software is just a tool. Much like a hammer, a knife, or ammonium nitrate, it can be used for both good or bad. I say this as someone who has spent almost 15 years writing software in my free time and publishing it as open source: building software and allowing anyone to use it does not automatically make other people's lives better. A lot of my work has been used for…
> At least 2 billion people live in dictatorships. AI has the potential to become a tool of mass surveillance and total oppression from which those countries will never recover because just like the models can detect a woman is pregnant before she knows it, it will detect a dissenter long before dissent turns into resistance. It already works like this in your precious western democracies and they didn't need AI to b…
Re: NanoChat – The best ChatGPT that $100 can buy
#225Earlier quoted context omitted.
This free tradition in software is I think one of the things that I love so much, but I don't see how it can continue with LLMs due to the extremely high training costs and the powerful hardware required for inference. It just seems like writing software will necessarily require paying rent to the LLM hosts to keep up. I guess it's possible that we'll figure out a way to do local inference in a way that is accessible…
There's a Stephen Boyd quote that's something like "if your optimization problem is too computationally expensive, just go on vacation to Greece for a few weeks and by the time you get back, computers might be fast enough to solve it." With LLMs there's sort of an equivalent situation with cost: how mindblowing would it be able to train this kind of LLM at all even just 4 years ago? And today you can get a kindergart…
Re: NanoChat – The best ChatGPT that $100 can buy
#226Earlier quoted context omitted.
I think you got your proportions slightly wrong there. This will be contributing as much to an AI bubble as a kid tinkering around with combustion is contribution to global warming.
Not really. Anything that guy does sets the tone for an extended cacophony of fans and followers. It would be a sad day when nobody critically assesses the motivations, effects and framing of those moves. I question the claim this move helps humanity and stand by the assessment it's just more feeding an unfree ecosystem which equates to propping up the bubble.
Re: NanoChat – The best ChatGPT that $100 can buy
#227Earlier quoted context omitted.
okay but he literally does have a bridge that non-deterministically might take you to the wrong place to sell you
The original context of this sub-thread was Karpathy saying how AI coding tools were pretty useless for him when working on this particular project.
If anyone else says this, "the skepticism is exhausting", and their experience is completely irrelevant.
Re: NanoChat – The best ChatGPT that $100 can buy
#228Interesting exchange on the use of AI coding tools: curious how much did you write the code by hand of it? Karpathy: Good question, it's basically entirely hand-written (with tab autocomplete). I tried to use claude/codex agents a few times but they just didn't work well enough at all and net unhelpful, possibly the repo is too far off the data distribution. https://x.com/karpathy/status/1977758204139331904
This makes sense, right? It's a relatively novel thing to be writing. I don't find it to be a damning remark like other comments here seem to be concluding. If anything, the fact that Karpathy reached towards Claude/Codex in an attempt to gain value is indicative that, in previous coding efforts, those tools were helpful to him.
It's really not though? Honestly I'm surprised coding agents fail hard at this task apparently
Re: NanoChat – The best ChatGPT that $100 can buy
#229Earlier quoted context omitted.
> the repo is too far off the data distribution ah, this explains why these models have been useless to me this whole time. everything i do is just too far off the data distribution!
Everything is unless your app is a React todolist or leatcode questions.