111–120 of 472 posts
Unpopular opinion… but IMO almost all of Karpathy’s fame an influence come from being an incredible educator and communicator. Relative to his level of fame, his actual level of contribution as far as pushing forward AI, I’m not so sure about. I deeply appreciate his educational content and I’m glad that it has led to a way for him to gain influence and sustain a career. Hopefully he’s rich enough from that that he c…
I would argue that's far more valuable.
Frankly, OpenAI seems to be losing its luster, and fast. Plugins were a failure. GPTs are a little better, but I still don't see the product market fit. GPT-4 is still king, but not by that much any more. It's not even clear that they're doing great research, because they don't publish. GPT-5 has to be incredibly good at this point, and I'm not sure that it will be.
Running Ollama with a 80gb mistral model works as well if not better than ChatGPT 3.5. This is a good thing for the world IMO as the magic is no longer held just OpenAI. The speed at which competitors have caught up in even the last 3 months is astounding.
Earlier quoted context omitted.
Examples? (I'm not that familiar with field.)
Andrej Karpathy is badmephisto, a name you might have heard of if you're into cubing. http://badmephisto.com/
Earlier quoted context omitted.
What makes you say it’s a losing direction?
A popular take in autonomous driving is the thing preventing Tesla from breaking beyond level two autonomous driving is its aversion to lidar, which is a direct result of its nn preference. (Eg Mercedes has achieved level 3 already).
I'm judging from his pinned tweet, "The hottest new programming language is English", that "those of you who know me know what I'm working on ;)" message at the end of this seems like a nod to developer tools of some kind. Which would track for a tech visionary, a hacker can't resist making himself better tools I guess. Anybody have better info than my idle guess?
He'll become a full time YouTuber.
Television content for children is often called 'Children's Programming'
Earlier quoted context omitted.
A hackernews comment section is one of the least legitimate forums imaginable for the public reading of somebody's resume. Congress, maybe.
Honestly I have more faith in hacker news users than congress.
IMO governments, like websites, should be boring but effective, focused on small day to day improvements, not all flash and empty marketing chasing cultural trends...
Earlier quoted context omitted.
Xerox's copier sales peak was in the early 70's, and then multiple international companies [primarily in Japan] began creating better, less expensive copiers. By the late 70's, Xerox was massively losing marketshare [to both competitors, and to blossoming word processing technologies]. >Laser printers, email, the Internet, didn't yet exist Actually, all three did; the latter was in the form of ARPANET [to be technica…
One of us needs sources, and I think it's you :) > Actually, all three did; the latter was in the form of ARPANET [to be technical, not "The Internet"]. True, but a technicality. Very few people knew they even existed, and they had zero impact on Xerox copier sales.
Does not mean they did not exist. See citations, below:
https://en.wikipedia.org/wiki/Laser_printing (see 2nd intro paragraph)
https://en.wikipedia.org/wiki/History_of_email (see 3rd intro paragraph)
Unpopular opinion… but IMO almost all of Karpathy’s fame an influence come from being an incredible educator and communicator. Relative to his level of fame, his actual level of contribution as far as pushing forward AI, I’m not so sure about. I deeply appreciate his educational content and I’m glad that it has led to a way for him to gain influence and sustain a career. Hopefully he’s rich enough from that that he c…
Take CS 231, for example, which stands as one of Stanford's most popular AI/ML courses. Think about the number of students who have taken this class from around 2015 to 2017 and have since advanced in AI. It's fair to say a good chunk of credit goes back to that course.
Instructors who break it down, showing you how straightforward it can be, guiding you through each step, are invaluable. They play a crucial role in lowering the entry barriers into the field. In the long haul, it's these newcomers, brought into AI by resources like those created by Karpathy, who will drive some of the most significant breakthroughs. For instance, his "Hacker's Guide to Neural Networks," now almost a decade old, provided me with one of the clearest 'aha' moments in understanding back-propagation.
Frankly, OpenAI seems to be losing its luster, and fast. Plugins were a failure. GPTs are a little better, but I still don't see the product market fit. GPT-4 is still king, but not by that much any more. It's not even clear that they're doing great research, because they don't publish. GPT-5 has to be incredibly good at this point, and I'm not sure that it will be.
Idk, I just tried Gemini Ultra and it's so much worse than GPT4 that I am actually quite shocked. Trying to ask it any kind of coding question ends up being this frustrating and honestly bizarre waste of time as it hallucinates a whole new language syntax every time and then asks if you want to continue with non-working, in fact non-existing, option A or the equally non-existent option B until you realise that you've spent an hour trying to make it at least output something that is even in the requested language and finally that it is completely useless.
I'm actually pretty astonished at how far Google is behind and that they released such a bunch of worthless junk at all. And have the chutzpah to ask people to pay for it!
Of course I'm looking forward to gpt-5 but even if it's only a minor step up, they're still way ahead.