Earlier quoted context omitted.
Everything is unless your app is a React todolist or leatcode questions.
Generative AI for coding isn't your new junior programmer, it's the next generation of app framework.
NanoChat – The best ChatGPT that $100 can buy
301–310 of 326 posts
Re: NanoChat – The best ChatGPT that $100 can buy
#302Earlier quoted context omitted.
> It will be littered with negative comments that either imply or outright say that the poster is either shilling, ignorant or working only on toy examples. And they would be often be right. Coupled with the fact that most of the glowing "omg I only code with AI" posts don't even try to show what code or products they are working on. And yes, the absolute vast majority of people who are skeptical are skeptical precis…
Just so we are clear, you are upset by people dismissing your experience gained skepticism but have no problem dismissing every positive comment as a shill, ignorant or simple? You don’t see any dissonance in that? It’s only the positive people that are exhausting?
I never pretend that AI is the be all end all of programming, don't claim that it can do all the magical things, or that it's capable of running hours on end just creating software with not proof like most positive posts do.
See the difference?
I'm all for positive posts. I'm against childish belief in magic: https://dmitriid.com/everything-around-llms-is-still-magical...
Re: NanoChat – The best ChatGPT that $100 can buy
#303Earlier quoted context omitted.
the current level of AI hype amongst a lot of people, but especially investors and bosses, is that you can already give an AI a simple prompt and get it to spit out a fully functional, user-ready application for you. and we're so incredibly far off that. the things that AI is able to do are incredible, but hype levels are just totally detached from reality.
> is that you can already give an AI a simple prompt and get it to spit out a fully functional, user-ready application for you. But it can already do that. Isn't that the whole "one-shotting" thing? The problem is, of course, that it won't be optimized , maintainable or have anyone responsible you can point to if something with it goes wrong. It almost certainly (unless you carefully prompted it to) won't have a test…
If you come at the problem from the direction of "I draw a user interface; you guess what it's supposed to do and wire it up for me", then all you need to solve that problem (to a first-order approximation) is some plain-old 1970s "AI" heuristics.
The buzz around current AI coding prompting seems to be solely generated by the fact that while prototyping tools require you to at least have some training as a designer (i.e. understanding the problem you're solving on the level of inputs and outputs), these tools allow people with no experience in programming or design to get results. (Mainly by doing for UIs what genAI image/video tools do for art: interpolating the average of many ingested examples of how a designer would respond to a client request for X, with no regard for the designer's personal style†.)
† Unless prompted to have such regard... but if you know enough to tell the AI how to design everything, then you may as well just design everything. Just as, if you know art well enough to prompt an AI into developing a unique art style, then you likely know art well enough to just make that same art yourself with less effort than it takes to prompt and re-prompt and patch-erase-infill-prompt the AI into drawing what you want.
Re: NanoChat – The best ChatGPT that $100 can buy
#304Earlier quoted context omitted.
Yep. I find the hype around AI to be wildly overblown, but that doesn’t mean that what it can do right now isn’t interesting & useful. If you told me a decade ago that I could have a fuzzy search engine on my desktop that I could use to vaguely describe some program that I needed & it would go out into the universe of publicly available source code & return something that looks as close to the thing I’ve asked for as…
Why do you think what you describe being excited about does not warrant the current level of AI hype? I agree with your assessment and sometimes I think there is too much cynicism and not enough excitement.
Remember the hype isn’t just “wow it’s so cool and amazing and useful”, it’s also “I can’t wait to fire all my dumb meat-based employees”
Re: NanoChat – The best ChatGPT that $100 can buy
#305Interesting exchange on the use of AI coding tools: curious how much did you write the code by hand of it? Karpathy: Good question, it's basically entirely hand-written (with tab autocomplete). I tried to use claude/codex agents a few times but they just didn't work well enough at all and net unhelpful, possibly the repo is too far off the data distribution. https://x.com/karpathy/status/1977758204139331904
Re: NanoChat – The best ChatGPT that $100 can buy
#306Earlier quoted context omitted.
Part of that comes from Microsoft API deals. Part of that will most certainly come because the vast network of companies buy subscriptions to help "Open" "AI" [1]. Given the rest of circular deals, I'd also scrutinize if it applies to the revenue. The entanglement with the Microsoft investments and the fact that "Open" "AI" is a private company makes that difficult to research. [1] In a U.S. startup, I went through t…
When people take the time to virtue signal "Open" "AI" or the annoyingly common M$ on here I wonder often why they are wasting their precious time on earth doing that
Re: NanoChat – The best ChatGPT that $100 can buy
#307Nice! His Shakespeare generator was one of the first projects I tried after ollama. The goal was to understand what LLMs were about. I have been on an LLM binge this last week or so trying to build a from-scratch training and inference system with two back ends: - CPU (backed by JAX) - GPU (backed by wgpu-py). This is critical for me as I am unwilling to deal with the nonsense that is rocm/pytorch. Vulkan works for m…
Re: NanoChat – The best ChatGPT that $100 can buy
#308Would love to hear some metrics on training it on your personal computer rather than a "cloud GPU box". I don't care if it takes 3 months to train if I have something good, offline, and free(ish, but just pay electric bills)
64 hours isn’t too bad at all!
(An RTX 2080 can only do 10 TFLOPS for fp32, so that would be again 3x as long.)
Re: NanoChat – The best ChatGPT that $100 can buy
#309Re: NanoChat – The best ChatGPT that $100 can buy
#310Earlier quoted context omitted.
> the repo is too far off the data distribution ah, this explains why these models have been useless to me this whole time. everything i do is just too far off the data distribution!
Everything is unless your app is a React todolist or leatcode questions.