Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Hi everyone yes, I left OpenAI yesterday

twitter.com

Post reply on HN
Print view View original

171–180 of 472 posts

Re: Hi everyone yes, I left OpenAI yesterday

#171

Post by peddling-brink »

sho wrote: post #139
peddling-brink wrote: post #133

Earlier quoted context omitted.

That’s an awfully specific and esoteric question. Would you expect gpt4 to be significantly better at that level of depth? That’s not been my experience.

OK, i have to admit that one was a little odd, I was beginning to give up and trying new angles. I can't really share my other sessions. But I was trying to get a handle on the language and thought it would be an easily-understood situation (multiple-token auth). I would have at least expected the response to be slightly valid. The language in question was only open sourced after GPT4's training date, so i couldn't c…

My experience has been that gpt4 will happily hallucinate the details when I go too deep. Like you mentioned, it will invent new syntax and function calls.

It's magic, until it isn't.

Re: Hi everyone yes, I left OpenAI yesterday

#172

Post by sigmoid10 »

jatins wrote: post #169
magoghm wrote: post #132

Earlier quoted context omitted.

In 2015 he wrote this blog post about "The Unreasonable Effectiveness of Recurrent Neural Networks": https://karpathy.github.io/2015/05/21/rnn-effectiveness/ That blog post inspired Alec Radford at Open AI to do the research that produced the "Unsupervised sentiment neuron": https://openai.com/research/unsupervised-sentiment-neuron Open AI decided to see what happened if they scaled up that model by leveraging the ne…

I read that post recently and it felt prescient to someone who has not been deeply involved in ML Even the HN discussion around this had comments like "this feels my baby learning to speak.." which are the same comparisons people were saying when LLMs hit mainstream in 2022

I had forgotten it's existence by now, but I remember reading this post all those years back. Damn. I also remember thinking that this would be so cool if RNNs didn't suck at long contexts, even with an attention mechanism. In some sense, the only thing he needed was the transformer architecture and a "fuck, let's just do it" compute budget to end up at ChatGPT. He was always at the frontier of this field.

Re: Hi everyone yes, I left OpenAI yesterday

#174

Post by Biganon »

smegger001 wrote: post #124
solardev wrote: post #117

Earlier quoted context omitted.

I wish more of us would run for Congress. I'd much rather have a government of technocrats of various stripes than ex lawyers and rich business types. IMO governments, like websites, should be boring but effective, focused on small day to day improvements, not all flash and empty marketing chasing cultural trends...

I don't know, while lawyers and MBA's are not who I would choose to run the country, I am not sure the I would pick people with the motto "run fast and break things" in charge either.

That's Facebook / Meta. They do not represent us

Re: Hi everyone yes, I left OpenAI yesterday

#175

Post by Simon_ORourke »

dontreact wrote: post #19

Unpopular opinion… but IMO almost all of Karpathy’s fame an influence come from being an incredible educator and communicator. Relative to his level of fame, his actual level of contribution as far as pushing forward AI, I’m not so sure about. I deeply appreciate his educational content and I’m glad that it has led to a way for him to gain influence and sustain a career. Hopefully he’s rich enough from that that he c…

> Relative to his level of fame, his actual level of contribution as far as pushing forward AI, I’m not so sure about.

I'd agree with that, however I've always wondered how easy it is for folks at that level to get hands on keyboards and not wind up spending their days polishing slide decks for talks instead.

Re: Hi everyone yes, I left OpenAI yesterday

#176

Post by danielscrubs »

osigurdson wrote: post #143
ProllyInfamous wrote: post #59

Earlier quoted context omitted.

Great nuanced distinction. ---- "Xerox's top executives were for the most part salesmen of copy machines. From these leased behemoths the revenue stream was as tangible as the `click` of the meters counting off copies, for which the customer paid Xerox so many cents per page (and from which Xerox paid its salespersons their commissions). Noticing their eyes narrow [at R&D's attempts at asking to market their computer…

It seems odd that Xerox bothered with the research lab at all then. Why not only research how to make copier's cheaper and more compelling if company culture is Mad Men, copier edition?

Always the same story, some boss wants to get noticed ask underlings to make something cool. Underlings make something cool, bosses boss get scared his position will be taken, orders a shutdown of it and to focus on what matters.

Re: Hi everyone yes, I left OpenAI yesterday

#177

Post by doktrin »

rendall wrote: post #125
15457345234 wrote: post #90

Earlier quoted context omitted.

> Frankly, OpenAI seems to be losing its luster, and fast. Good. I have no idea what's really going on inside that company but the way the staff were acting on twitter when Altman got the push was genuinely scary, major red flags, bad vibes, you name it, it reeked of it.

What do you mean? How were they acting? I was surprised and touched by their loyalty, but maybe I missed something you noticed.

Like a cult reciting their vows of allegiance.

Re: Hi everyone yes, I left OpenAI yesterday

#178

Post by arugulum »

magoghm wrote: post #132
dontreact wrote: post #19

Unpopular opinion… but IMO almost all of Karpathy’s fame an influence come from being an incredible educator and communicator. Relative to his level of fame, his actual level of contribution as far as pushing forward AI, I’m not so sure about. I deeply appreciate his educational content and I’m glad that it has led to a way for him to gain influence and sustain a career. Hopefully he’s rich enough from that that he c…

In 2015 he wrote this blog post about "The Unreasonable Effectiveness of Recurrent Neural Networks": https://karpathy.github.io/2015/05/21/rnn-effectiveness/ That blog post inspired Alec Radford at Open AI to do the research that produced the "Unsupervised sentiment neuron": https://openai.com/research/unsupervised-sentiment-neuron Open AI decided to see what happened if they scaled up that model by leveraging the ne…

Is it stated somewhere that Radford was inspired by that blog post?

Re: Hi everyone yes, I left OpenAI yesterday

#179

Post by paganel »

_giorgio_ wrote: post #149
dontreact wrote: post #19

Unpopular opinion… but IMO almost all of Karpathy’s fame an influence come from being an incredible educator and communicator. Relative to his level of fame, his actual level of contribution as far as pushing forward AI, I’m not so sure about. I deeply appreciate his educational content and I’m glad that it has led to a way for him to gain influence and sustain a career. Hopefully he’s rich enough from that that he c…

That's incredibly impolite and totally without foundation. You make him look like a peasant :-) What do you know about his work? He's been leading the vision team at Tesla, implementing in the field all the papers that were available in the subject of autonomous driving and vision (he explicitly wrote that). He has not published about it surely due to obligations with Tesla.

[flagged]

Re: Hi everyone yes, I left OpenAI yesterday

#180

Post by paganel »

laborcontract wrote: post #42
iaseiadit wrote: post #34

Earlier quoted context omitted.

ImageNet was very influential, but this just shows he was eighth author on a twelve author paper from almost a decade ago. Is there better evidence of sustained contributions to the field?

Hm, well, I see on his resume that he was a founder of OpenAI, recruited to be Tesla's head of AI, went back to OpenAI, and also has the most viewed educational videos in this space. So, he has made theoretical contributions to the space, contributions to prominent private organizations in the space, and broadly educated others about the space. What more are you looking for?

Tesla fumbled big on AI, and as for his work at OpenAI, he just left, had he been good enough they would have made him a financial offer that would have made him continue. But, I'll give him that, he seems to be a really good teacher.
Post reply on HN