Live data from Hacker News

Hi everyone yes, I left OpenAI yesterday

twitter.com

131–140 of 472 posts

Re: Hi everyone yes, I left OpenAI yesterday

#131

Earlier quoted context omitted.

Examples? (I'm not that familiar with field.)

Andrej Karpathy is badmephisto, a name you might have heard of if you're into cubing. http://badmephisto.com/

This blew my mind as well!! I never thought one of my favorite programmers would share a similar hobby haha

Re: Hi everyone yes, I left OpenAI yesterday

#132

Unpopular opinion… but IMO almost all of Karpathy’s fame an influence come from being an incredible educator and communicator. Relative to his level of fame, his actual level of contribution as far as pushing forward AI, I’m not so sure about. I deeply appreciate his educational content and I’m glad that it has led to a way for him to gain influence and sustain a career. Hopefully he’s rich enough from that that he c…

In 2015 he wrote this blog post about "The Unreasonable Effectiveness of Recurrent Neural Networks": https://karpathy.github.io/2015/05/21/rnn-effectiveness/

That blog post inspired Alec Radford at Open AI to do the research that produced the "Unsupervised sentiment neuron": https://openai.com/research/unsupervised-sentiment-neuron

Open AI decided to see what happened if they scaled up that model by leveraging the new Transformer architecture invented at Google, and they created something called GPT: https://cdn.openai.com/research-covers/language-unsupervised...

Re: Hi everyone yes, I left OpenAI yesterday

#133
post #129
post #126

Earlier quoted context omitted.

Do you have example links?

here was one of them https://gemini.google.com/share/fde31202b221?hl=en edit: as pointed out, this was indeed a pretty esoteric example. But the rest of my attempts were hardly better, if they had a response at all.

That’s an awfully specific and esoteric question. Would you expect gpt4 to be significantly better at that level of depth? That’s not been my experience.

Re: Hi everyone yes, I left OpenAI yesterday

#135

Earlier quoted context omitted.

Honestly I have more faith in hacker news users than congress.

I wish more of us would run for Congress. I'd much rather have a government of technocrats of various stripes than ex lawyers and rich business types. IMO governments, like websites, should be boring but effective, focused on small day to day improvements, not all flash and empty marketing chasing cultural trends...

You’re always gonna have a ton of lawyers in congress and state legislatures because if you were interested in law enough to become a lawyer you are disproportionately likely to want to write laws.

Re: Hi everyone yes, I left OpenAI yesterday

#136

Earlier quoted context omitted.

> Relative to his level of fame, his actual level of contribution as far as pushing forward AI, I’m not so sure about. Are you sure about your perspective? https://scholar.google.com/citations?view_op=view_citation&h...

ImageNet was very influential, but this just shows he was eighth author on a twelve author paper from almost a decade ago. Is there better evidence of sustained contributions to the field?

He’s first author on a ton of those papers. That’s a tenure worthy CV almost anywhere. Gimme a break.

Re: Hi everyone yes, I left OpenAI yesterday

#137
post #96

Earlier quoted context omitted.

Running Ollama with a 80gb mistral model works as well if not better than ChatGPT 3.5. This is a good thing for the world IMO as the magic is no longer held just OpenAI. The speed at which competitors have caught up in even the last 3 months is astounding.

But no one cares about 3.5. It’s an order of magnitude worse than 4. An order of magnitude is a lot harder to catch up with.

What Mistral has though is speed, and with speed comes scale.

Re: Hi everyone yes, I left OpenAI yesterday

#138

Frankly, OpenAI seems to be losing its luster, and fast. Plugins were a failure. GPTs are a little better, but I still don't see the product market fit. GPT-4 is still king, but not by that much any more. It's not even clear that they're doing great research, because they don't publish. GPT-5 has to be incredibly good at this point, and I'm not sure that it will be.

> Frankly, OpenAI seems to be losing its luster, and fast. Good. I have no idea what's really going on inside that company but the way the staff were acting on twitter when Altman got the push was genuinely scary, major red flags, bad vibes, you name it, it reeked of it.

It lost a little of its cool factor. However, they provide a nearly essential service at this point. While it is easy to underestimate, I suspect this is already have a measurable impact on global GDP.

Re: Hi everyone yes, I left OpenAI yesterday

#139
post #129

Earlier quoted context omitted.

here was one of them https://gemini.google.com/share/fde31202b221?hl=en edit: as pointed out, this was indeed a pretty esoteric example. But the rest of my attempts were hardly better, if they had a response at all.

That’s an awfully specific and esoteric question. Would you expect gpt4 to be significantly better at that level of depth? That’s not been my experience.

OK, i have to admit that one was a little odd, I was beginning to give up and trying new angles. I can't really share my other sessions. But I was trying to get a handle on the language and thought it would be an easily-understood situation (multiple-token auth). I would have at least expected the response to be slightly valid.

The language in question was only open sourced after GPT4's training date, so i couldn't compare. That's actually why I tried it in the first place. And yes, I do expect it to be better - GPT4 isn't perfect but I don't really it ever hallucinating quite that hard. In fact, its answer was basically that it didn't know.

And when I asked it questions with other, much less esoteric code like "how would you refactor this to be more idiomatic?" I'd get either "I couldn't complete your request. Rephrase your prompt and try again." or "Sorry, I can't help with that because there's too much data. Try again with less data." GPT-4 was helpful in both cases.

Re: Hi everyone yes, I left OpenAI yesterday

#140
post #129

Earlier quoted context omitted.

here was one of them https://gemini.google.com/share/fde31202b221?hl=en edit: as pointed out, this was indeed a pretty esoteric example. But the rest of my attempts were hardly better, if they had a response at all.

That’s an awfully specific and esoteric question. Would you expect gpt4 to be significantly better at that level of depth? That’s not been my experience.

[deleted]
Post reply on HN