Has the word ChatGPT become generic? This has nothing to do with OpenAI's ChatGPT.
NanoChat – The best ChatGPT that $100 can buy
51–60 of 326 posts
Re: NanoChat – The best ChatGPT that $100 can buy
#52Has the word ChatGPT become generic? This has nothing to do with OpenAI's ChatGPT.
[dead]
Re: NanoChat – The best ChatGPT that $100 can buy
#53Earlier quoted context omitted.
not a particularly ethical guy and I wouldn't hold him up as a example of morality but the guy hasn't actually been found guilty YET. Multiple courts have tried. You'd think that for a guy under as much scrutiny as him that they would have SOMETHING to pin him on by now. Innocent until PROVEN guilty is a foundational legal precedent for a reason.
He is definitely guilty of being a waste of human life, a massive asshole and a general detriment to society worldwide. Don’t need a court to prove that. There are 6 criminal cases against him in several countries, let’s see how they pan out - but regardless he is not an innocent person.
[dead]
Re: NanoChat – The best ChatGPT that $100 can buy
#54I've always thought about the best way to contribute to humanity: number of people you help x how much you help them. I think what Karpathy is doing is one of the highest leverage ways to achieve that. Our current world is build on top of open source projects. This is possible because there are a lot of free resources to learn to code so anyone from anywhere in the world can learn and make a great piece of software.…
As noble as the goal sounds, I think it's wrong. Software is just a tool. Much like a hammer, a knife, or ammonium nitrate, it can be used for both good or bad. I say this as someone who has spent almost 15 years writing software in my free time and publishing it as open source: building software and allowing anyone to use it does not automatically make other people's lives better. A lot of my work has been used for…
> At least 2 billion people live in dictatorships. AI has the potential to become a tool of mass surveillance and total oppression from which those countries will never recover because just like the models can detect a woman is pregnant before she knows it, it will detect a dissenter long before dissent turns into resistance.
It already works like this in your precious western democracies and they didn't need AI to be authoritarian total surveillance states in spirit, with quite a lot of support from a propagandized populace that begged for or pretended to agree with the infringement of their civil rights because of terrorism, drugs, covid or protecting the poor poor children.
You can combat tech with legislation and culture but the legislation and culture were way beyond the tech in being extremely authoritian in the first place.
Re: NanoChat – The best ChatGPT that $100 can buy
#55I've always thought about the best way to contribute to humanity: number of people you help x how much you help them. I think what Karpathy is doing is one of the highest leverage ways to achieve that. Our current world is build on top of open source projects. This is possible because there are a lot of free resources to learn to code so anyone from anywhere in the world can learn and make a great piece of software.…
As noble as the goal sounds, I think it's wrong. Software is just a tool. Much like a hammer, a knife, or ammonium nitrate, it can be used for both good or bad. I say this as someone who has spent almost 15 years writing software in my free time and publishing it as open source: building software and allowing anyone to use it does not automatically make other people's lives better. A lot of my work has been used for…
I would genuinely love to think otherwise. But I've seen and grown up seeing good things being used in stupid ways (not necessarily for malice)
Re: NanoChat – The best ChatGPT that $100 can buy
#56I've always thought about the best way to contribute to humanity: number of people you help x how much you help them. I think what Karpathy is doing is one of the highest leverage ways to achieve that. Our current world is build on top of open source projects. This is possible because there are a lot of free resources to learn to code so anyone from anywhere in the world can learn and make a great piece of software.…
strong +1 - developers like him are heros
Re: NanoChat – The best ChatGPT that $100 can buy
#57from their promotional material:
>> Why is the sky blue? > The sky is blue due to an optical illusion called the Rayleigh Scattering
Rayleigh Scattering is not an illusion but an effect.
> […] particles are made up of tiny blue and violet particles that cause the light to bend in a particular way.
ugh. no, there are no "tiny blue" particles in the sky.
Re: NanoChat – The best ChatGPT that $100 can buy
#58I'm doing a training run right now (started 20min ago). You can follow it at https://api.wandb.ai/links/sjd333-none/dsv4zkij
Will share the resulting model once ready (4 hours from now) for anyone to test inference.
Re: NanoChat – The best ChatGPT that $100 can buy
#59Which data uses for training?
Re: NanoChat – The best ChatGPT that $100 can buy
#60Earlier quoted context omitted.
A GPU with 80GB VRAM costs around $1-3 USD an hour on commodity clouds (i.e. the non-Big 3 bare metal providers e.g. https://getdeploying.com/reference/cloud-gpu/nvidia-h100 ). I think it's accessible to most middle class users in first world countries.
Isn’t the whole point to run your model locally?
I'd guess that this will output faster than the average reader can read, even while using only CPU inferencing on a modern-ish CPU.
The param count is small enough that even cheap (<$500) GPUs would work too.