Live data from Hacker News

Hi everyone yes, I left OpenAI yesterday

twitter.com

141–150 of 472 posts

Re: Hi everyone yes, I left OpenAI yesterday

#141

Earlier quoted context omitted.

I wish more of us would run for Congress. I'd much rather have a government of technocrats of various stripes than ex lawyers and rich business types. IMO governments, like websites, should be boring but effective, focused on small day to day improvements, not all flash and empty marketing chasing cultural trends...

I don't know, while lawyers and MBA's are not who I would choose to run the country, I am not sure the I would pick people with the motto "run fast and break things" in charge either.

But what if we implemented agile and scrum? :^)

Imagine the retros!

Re: Hi everyone yes, I left OpenAI yesterday

#142
post #85

Earlier quoted context omitted.

A popular take in autonomous driving is the thing preventing Tesla from breaking beyond level two autonomous driving is its aversion to lidar, which is a direct result of its nn preference. (Eg Mercedes has achieved level 3 already).

Absense of lidar is just a symptom. Tesla only recently started to work with 3d model (which they get from cameras like one can get it from lidar) It just that the people who use lidar usually work with 3d model from the beginning.

> which they get from cameras like one can get it from lidar

LiDAR directly measures the distance to objects. What Tesla is doing is inferring it from two cameras.

There has been plenty of research to date [1] that LiDAR + Vision is significantly better than Vision Only especially under edge case conditions e.g. night, inclement weather when determining object bounding boxes.

[1] https://iopscience.iop.org/article/10.1088/1742-6596/2093/1/...

Re: Hi everyone yes, I left OpenAI yesterday

#143

Earlier quoted context omitted.

I don't think that is an apt metaphor. Imo Openai is Apple and Google is Parc. Google experiencing a similar issue to parc where they invented transformers but have been unable to capture the value so far due to being focused on ads revenue.

Great nuanced distinction. ---- "Xerox's top executives were for the most part salesmen of copy machines. From these leased behemoths the revenue stream was as tangible as the `click` of the meters counting off copies, for which the customer paid Xerox so many cents per page (and from which Xerox paid its salespersons their commissions). Noticing their eyes narrow [at R&D's attempts at asking to market their computer…

It seems odd that Xerox bothered with the research lab at all then. Why not only research how to make copier's cheaper and more compelling if company culture is Mad Men, copier edition?

Re: Hi everyone yes, I left OpenAI yesterday

#144

Unpopular opinion… but IMO almost all of Karpathy’s fame an influence come from being an incredible educator and communicator. Relative to his level of fame, his actual level of contribution as far as pushing forward AI, I’m not so sure about. I deeply appreciate his educational content and I’m glad that it has led to a way for him to gain influence and sustain a career. Hopefully he’s rich enough from that that he c…

In 2015 he wrote this blog post about "The Unreasonable Effectiveness of Recurrent Neural Networks": https://karpathy.github.io/2015/05/21/rnn-effectiveness/ That blog post inspired Alec Radford at Open AI to do the research that produced the "Unsupervised sentiment neuron": https://openai.com/research/unsupervised-sentiment-neuron Open AI decided to see what happened if they scaled up that model by leveraging the ne…

Also in that article he says

"In fact, I’d go as far as to say that

    The concept of attention is the most interesting recent architectural innovation in neural networks."
when the initial attention paper was less than a year old, and two years before the transformer paper.

Re: Hi everyone yes, I left OpenAI yesterday

#145

Frankly, OpenAI seems to be losing its luster, and fast. Plugins were a failure. GPTs are a little better, but I still don't see the product market fit. GPT-4 is still king, but not by that much any more. It's not even clear that they're doing great research, because they don't publish. GPT-5 has to be incredibly good at this point, and I'm not sure that it will be.

Custom GPTs like Grimoire or Cursor loaded on your repo are miles ahead of the competition for coding tasks at least.

Re: Hi everyone yes, I left OpenAI yesterday

#146

Earlier quoted context omitted.

But no one cares about 3.5. It’s an order of magnitude worse than 4. An order of magnitude is a lot harder to catch up with.

What Mistral has though is speed, and with speed comes scale.

Who cares about speed if you’re wrong?

This isn’t a race to write the most lines of code or the most lines of text. It’s a race to write the most correct lines of code.

I’ll wait half an hour for a response if I know I’m getting at least staff engineer level tier of code for every question

Re: Hi everyone yes, I left OpenAI yesterday

#147

Unpopular opinion… but IMO almost all of Karpathy’s fame an influence come from being an incredible educator and communicator. Relative to his level of fame, his actual level of contribution as far as pushing forward AI, I’m not so sure about. I deeply appreciate his educational content and I’m glad that it has led to a way for him to gain influence and sustain a career. Hopefully he’s rich enough from that that he c…

Disagreeing here! I think we often overlook the value of excellent educational materials. Karpathy has truly revitalized the AI field, which is often cluttered with overly complex and dense mathematical descriptions. Take CS 231, for example, which stands as one of Stanford's most popular AI/ML courses. Think about the number of students who have taken this class from around 2015 to 2017 and have since advanced in AI…

People like the grandparent think innovation and advancement happens in isolation.

Re: Hi everyone yes, I left OpenAI yesterday

#148

Unpopular opinion… but IMO almost all of Karpathy’s fame an influence come from being an incredible educator and communicator. Relative to his level of fame, his actual level of contribution as far as pushing forward AI, I’m not so sure about. I deeply appreciate his educational content and I’m glad that it has led to a way for him to gain influence and sustain a career. Hopefully he’s rich enough from that that he c…

I think the ability to teach is a direct outcome of the ability to think and articulate ideas clearly. This is a meta skill that will make a person effective in any area of work.

I'd say that that his work on AI has been significant and his ability to teach has contributed to that greatly.

Re: Hi everyone yes, I left OpenAI yesterday

#149

Unpopular opinion… but IMO almost all of Karpathy’s fame an influence come from being an incredible educator and communicator. Relative to his level of fame, his actual level of contribution as far as pushing forward AI, I’m not so sure about. I deeply appreciate his educational content and I’m glad that it has led to a way for him to gain influence and sustain a career. Hopefully he’s rich enough from that that he c…

That's incredibly impolite and totally without foundation. You make him look like a peasant :-)

What do you know about his work?

He's been leading the vision team at Tesla, implementing in the field all the papers that were available in the subject of autonomous driving and vision (he explicitly wrote that). He has not published about it surely due to obligations with Tesla.

Post reply on HN