In his free time, I hope he writes some more fiction, I really liked https://karpathy.github.io/2015/11/14/ai/
Hi everyone yes, I left OpenAI yesterday
151–160 of 472 posts
Re: Hi everyone yes, I left OpenAI yesterday
#152Unpopular opinion… but IMO almost all of Karpathy’s fame an influence come from being an incredible educator and communicator. Relative to his level of fame, his actual level of contribution as far as pushing forward AI, I’m not so sure about. I deeply appreciate his educational content and I’m glad that it has led to a way for him to gain influence and sustain a career. Hopefully he’s rich enough from that that he c…
It’s like saying Rick Rubin didn’t do much for music because he doesn’t play any instrument.
Re: Hi everyone yes, I left OpenAI yesterday
#153Top job quitting performance
Re: Hi everyone yes, I left OpenAI yesterday
#154Earlier quoted context omitted.
What Mistral has though is speed, and with speed comes scale.
Who cares about speed if you’re wrong? This isn’t a race to write the most lines of code or the most lines of text. It’s a race to write the most correct lines of code. I’ll wait half an hour for a response if I know I’m getting at least staff engineer level tier of code for every question
For the tasks my group is considering, even a 7B model is adequate.
Sufficiently accurate responses can be fed into other systems downstream and cleaned up. Even code responses can benefit from this by restricting output tokens using the grammar of the target language, or iterating until the code compiles successfully.
And for a decent number of LLM-enabled use cases the functionality unlocked by these models is novel. When you're going from 0 to 1 people will just be amazed that the product exists.
Re: Hi everyone yes, I left OpenAI yesterday
#155OMG, what do we do now!?
But seriously, right now with full attention to LLMs, and many brains, there is no single key person. The question 'who said it first' isn't that important for the progress. With experts leaving OpenAI will gradually loose it's leadership. Others will catch up. Which is good in general, no one should have monopoly on AI. I wish it was that easy with hardware too...
Re: Hi everyone yes, I left OpenAI yesterday
#156Frankly, OpenAI seems to be losing its luster, and fast. Plugins were a failure. GPTs are a little better, but I still don't see the product market fit. GPT-4 is still king, but not by that much any more. It's not even clear that they're doing great research, because they don't publish. GPT-5 has to be incredibly good at this point, and I'm not sure that it will be.
I know things keep moving faster and faster, especially in this space, but GPT-4 is less than a year old. Claiming they are losing their luster, because they aren’t shaking the earth with new models every quarter, seems a little ridiculous.
As the popularity has exploded, and ethical questions have become increasingly relevant, it is probably worth taking some time to nail certain aspects down before releasing everything to the public for the sake of being first.
Re: Hi everyone yes, I left OpenAI yesterday
#157Earlier quoted context omitted.
I wish more of us would run for Congress. I'd much rather have a government of technocrats of various stripes than ex lawyers and rich business types. IMO governments, like websites, should be boring but effective, focused on small day to day improvements, not all flash and empty marketing chasing cultural trends...
I don't know, while lawyers and MBA's are not who I would choose to run the country, I am not sure the I would pick people with the motto "run fast and break things" in charge either.
It would be an improvement over "just break things", no?
Re: Hi everyone yes, I left OpenAI yesterday
#158Earlier quoted context omitted.
But no one cares about 3.5. It’s an order of magnitude worse than 4. An order of magnitude is a lot harder to catch up with.
Yeah but for how long… at this rate I would expect some of the freely distributed models to hit gpt4 levels in as little as 3-6 months.
I've heard claims like that 6 months ago.
But so far nobody is even in the same ballpark. And not just freely distributed models, but proprietary ones backed by big money, as well.
It really makes one wonder what kind of secret sauce OpenAI has. Surely it can't just be all that compute that Microsoft bought them, since Google could easily match that, and yet...
Re: Hi everyone yes, I left OpenAI yesterday
#159Earlier quoted context omitted.
Absense of lidar is just a symptom. Tesla only recently started to work with 3d model (which they get from cameras like one can get it from lidar) It just that the people who use lidar usually work with 3d model from the beginning.
> which they get from cameras like one can get it from lidar LiDAR directly measures the distance to objects. What Tesla is doing is inferring it from two cameras. There has been plenty of research to date [1] that LiDAR + Vision is significantly better than Vision Only especially under edge case conditions e.g. night, inclement weather when determining object bounding boxes. [1] https://iopscience.iop.org/article/10…
"What Tesla is doing is inferring it from two cameras."
People keep repeating this. I seriously don't know why. Stereo vision gives pretty crappy depth, ask anyone who has been playing around with disparity mapping.
Modern machine vision requires just one camera for depth. Especially if that one camera is moving. We humans have no trouble inferring depth with just one eye.
Re: Hi everyone yes, I left OpenAI yesterday
#160Earlier quoted context omitted.
Honestly I have more faith in hacker news users than congress.
I wish more of us would run for Congress. I'd much rather have a government of technocrats of various stripes than ex lawyers and rich business types. IMO governments, like websites, should be boring but effective, focused on small day to day improvements, not all flash and empty marketing chasing cultural trends...
This is like saying more lawyers should be writing software. Lawyers have extensive education and experience in the law and so work with..the law.