Live data from Hacker News

NanoChat – The best ChatGPT that $100 can buy

github.com

301–310 of 326 posts

Re: NanoChat – The best ChatGPT that $100 can buy

#301
post #300

Earlier quoted context omitted.

Everything is unless your app is a React todolist or leatcode questions.

Generative AI for coding isn't your new junior programmer, it's the next generation of app framework.

I wished such sentiments prevailed in upper management, as it is true. Much like owning a car that can drive itself - you still need to pass a driving test to be allowed to use it.

Re: NanoChat – The best ChatGPT that $100 can buy

#302
post #256

Earlier quoted context omitted.

> It will be littered with negative comments that either imply or outright say that the poster is either shilling, ignorant or working only on toy examples. And they would be often be right. Coupled with the fact that most of the glowing "omg I only code with AI" posts don't even try to show what code or products they are working on. And yes, the absolute vast majority of people who are skeptical are skeptical precis…

Just so we are clear, you are upset by people dismissing your experience gained skepticism but have no problem dismissing every positive comment as a shill, ignorant or simple? You don’t see any dissonance in that? It’s only the positive people that are exhausting?

I myself post positive comments about AI from time to time.

I never pretend that AI is the be all end all of programming, don't claim that it can do all the magical things, or that it's capable of running hours on end just creating software with not proof like most positive posts do.

See the difference?

I'm all for positive posts. I'm against childish belief in magic: https://dmitriid.com/everything-around-llms-is-still-magical...

Re: NanoChat – The best ChatGPT that $100 can buy

#303

Earlier quoted context omitted.

the current level of AI hype amongst a lot of people, but especially investors and bosses, is that you can already give an AI a simple prompt and get it to spit out a fully functional, user-ready application for you. and we're so incredibly far off that. the things that AI is able to do are incredible, but hype levels are just totally detached from reality.

> is that you can already give an AI a simple prompt and get it to spit out a fully functional, user-ready application for you. But it can already do that. Isn't that the whole "one-shotting" thing? The problem is, of course, that it won't be optimized , maintainable or have anyone responsible you can point to if something with it goes wrong. It almost certainly (unless you carefully prompted it to) won't have a test…

The thing is, we've already had "working mockup generators" — a.k.a. prototyping tools — for decades now.

If you come at the problem from the direction of "I draw a user interface; you guess what it's supposed to do and wire it up for me", then all you need to solve that problem (to a first-order approximation) is some plain-old 1970s "AI" heuristics.

The buzz around current AI coding prompting seems to be solely generated by the fact that while prototyping tools require you to at least have some training as a designer (i.e. understanding the problem you're solving on the level of inputs and outputs), these tools allow people with no experience in programming or design to get results. (Mainly by doing for UIs what genAI image/video tools do for art: interpolating the average of many ingested examples of how a designer would respond to a client request for X, with no regard for the designer's personal style†.)

† Unless prompted to have such regard... but if you know enough to tell the AI how to design everything, then you may as well just design everything. Just as, if you know art well enough to prompt an AI into developing a unique art style, then you likely know art well enough to just make that same art yourself with less effort than it takes to prompt and re-prompt and patch-erase-infill-prompt the AI into drawing what you want.

Re: NanoChat – The best ChatGPT that $100 can buy

#304
post #258
post #237

Earlier quoted context omitted.

Yep. I find the hype around AI to be wildly overblown, but that doesn’t mean that what it can do right now isn’t interesting & useful. If you told me a decade ago that I could have a fuzzy search engine on my desktop that I could use to vaguely describe some program that I needed & it would go out into the universe of publicly available source code & return something that looks as close to the thing I’ve asked for as…

Why do you think what you describe being excited about does not warrant the current level of AI hype? I agree with your assessment and sometimes I think there is too much cynicism and not enough excitement.

I think the cynicism is only on software dev circles, and it’s probably a response to the crazy hype.

Remember the hype isn’t just “wow it’s so cool and amazing and useful”, it’s also “I can’t wait to fire all my dumb meat-based employees”

Re: NanoChat – The best ChatGPT that $100 can buy

#305
post #107

Interesting exchange on the use of AI coding tools: curious how much did you write the code by hand of it? Karpathy: Good question, it's basically entirely hand-written (with tab autocomplete). I tried to use claude/codex agents a few times but they just didn't work well enough at all and net unhelpful, possibly the repo is too far off the data distribution. https://x.com/karpathy/status/1977758204139331904

Isn't the point that now Andrej's published this, it will be in-distribution soon?

Re: NanoChat – The best ChatGPT that $100 can buy

#306
post #296

Earlier quoted context omitted.

Part of that comes from Microsoft API deals. Part of that will most certainly come because the vast network of companies buy subscriptions to help "Open" "AI" [1]. Given the rest of circular deals, I'd also scrutinize if it applies to the revenue. The entanglement with the Microsoft investments and the fact that "Open" "AI" is a private company makes that difficult to research. [1] In a U.S. startup, I went through t…

When people take the time to virtue signal "Open" "AI" or the annoyingly common M$ on here I wonder often why they are wasting their precious time on earth doing that

It is in my style guide. I see that you optimized your time by omitting the full stop at the end of the sentence.

Re: NanoChat – The best ChatGPT that $100 can buy

#307
post #73

Nice! His Shakespeare generator was one of the first projects I tried after ollama. The goal was to understand what LLMs were about. I have been on an LLM binge this last week or so trying to build a from-scratch training and inference system with two back ends: - CPU (backed by JAX) - GPU (backed by wgpu-py). This is critical for me as I am unwilling to deal with the nonsense that is rocm/pytorch. Vulkan works for m…

If you’re not writing/modifying the model itself but only training, fine tuning, and inferencing, ONNX now supports these with basically any backend execution provider without needing to get into dependency version hell.

Re: NanoChat – The best ChatGPT that $100 can buy

#308

Would love to hear some metrics on training it on your personal computer rather than a "cloud GPU box". I don't care if it takes 3 months to train if I have something good, offline, and free(ish, but just pay electric bills)

Each H100 can do 60 TFLOPS of f32 operations, while a single RTX 3080 can do roughly half that (just under 30). So complete back-of-the-envelope answer would be 16x as long (since nanochat is targeting four hours with 8xH100)

64 hours isn’t too bad at all!

(An RTX 2080 can only do 10 TFLOPS for fp32, so that would be again 3x as long.)

Re: NanoChat – The best ChatGPT that $100 can buy

#310
post #121

Earlier quoted context omitted.

> the repo is too far off the data distribution ah, this explains why these models have been useless to me this whole time. everything i do is just too far off the data distribution!

Everything is unless your app is a React todolist or leatcode questions.

Really such an annoying genre of comment. Yes I’m sure your groundbreaking bespoke code cannot be written by LLMs, however for the rest of us that build and maintain 99% of the software people actually use, they are quite useful.
Post reply on HN