Earlier quoted context omitted.
Examples? (I'm not that familiar with field.)
Andrej Karpathy is badmephisto, a name you might have heard of if you're into cubing. http://badmephisto.com/
Hi everyone yes, I left OpenAI yesterday
131–140 of 472 posts
Re: Hi everyone yes, I left OpenAI yesterday
#132Unpopular opinion… but IMO almost all of Karpathy’s fame an influence come from being an incredible educator and communicator. Relative to his level of fame, his actual level of contribution as far as pushing forward AI, I’m not so sure about. I deeply appreciate his educational content and I’m glad that it has led to a way for him to gain influence and sustain a career. Hopefully he’s rich enough from that that he c…
That blog post inspired Alec Radford at Open AI to do the research that produced the "Unsupervised sentiment neuron": https://openai.com/research/unsupervised-sentiment-neuron
Open AI decided to see what happened if they scaled up that model by leveraging the new Transformer architecture invented at Google, and they created something called GPT: https://cdn.openai.com/research-covers/language-unsupervised...
Re: Hi everyone yes, I left OpenAI yesterday
#133Earlier quoted context omitted.
Do you have example links?
here was one of them https://gemini.google.com/share/fde31202b221?hl=en edit: as pointed out, this was indeed a pretty esoteric example. But the rest of my attempts were hardly better, if they had a response at all.
Re: Hi everyone yes, I left OpenAI yesterday
#134Re: Hi everyone yes, I left OpenAI yesterday
#135Earlier quoted context omitted.
Honestly I have more faith in hacker news users than congress.
I wish more of us would run for Congress. I'd much rather have a government of technocrats of various stripes than ex lawyers and rich business types. IMO governments, like websites, should be boring but effective, focused on small day to day improvements, not all flash and empty marketing chasing cultural trends...
Re: Hi everyone yes, I left OpenAI yesterday
#136Earlier quoted context omitted.
> Relative to his level of fame, his actual level of contribution as far as pushing forward AI, I’m not so sure about. Are you sure about your perspective? https://scholar.google.com/citations?view_op=view_citation&h...
ImageNet was very influential, but this just shows he was eighth author on a twelve author paper from almost a decade ago. Is there better evidence of sustained contributions to the field?
Re: Hi everyone yes, I left OpenAI yesterday
#137Earlier quoted context omitted.
Running Ollama with a 80gb mistral model works as well if not better than ChatGPT 3.5. This is a good thing for the world IMO as the magic is no longer held just OpenAI. The speed at which competitors have caught up in even the last 3 months is astounding.
But no one cares about 3.5. It’s an order of magnitude worse than 4. An order of magnitude is a lot harder to catch up with.
Re: Hi everyone yes, I left OpenAI yesterday
#138Frankly, OpenAI seems to be losing its luster, and fast. Plugins were a failure. GPTs are a little better, but I still don't see the product market fit. GPT-4 is still king, but not by that much any more. It's not even clear that they're doing great research, because they don't publish. GPT-5 has to be incredibly good at this point, and I'm not sure that it will be.
> Frankly, OpenAI seems to be losing its luster, and fast. Good. I have no idea what's really going on inside that company but the way the staff were acting on twitter when Altman got the push was genuinely scary, major red flags, bad vibes, you name it, it reeked of it.
Re: Hi everyone yes, I left OpenAI yesterday
#139Earlier quoted context omitted.
here was one of them https://gemini.google.com/share/fde31202b221?hl=en edit: as pointed out, this was indeed a pretty esoteric example. But the rest of my attempts were hardly better, if they had a response at all.
That’s an awfully specific and esoteric question. Would you expect gpt4 to be significantly better at that level of depth? That’s not been my experience.
The language in question was only open sourced after GPT4's training date, so i couldn't compare. That's actually why I tried it in the first place. And yes, I do expect it to be better - GPT4 isn't perfect but I don't really it ever hallucinating quite that hard. In fact, its answer was basically that it didn't know.
And when I asked it questions with other, much less esoteric code like "how would you refactor this to be more idiomatic?" I'd get either "I couldn't complete your request. Rephrase your prompt and try again." or "Sorry, I can't help with that because there's too much data. Try again with less data." GPT-4 was helpful in both cases.
Re: Hi everyone yes, I left OpenAI yesterday
#140Earlier quoted context omitted.
here was one of them https://gemini.google.com/share/fde31202b221?hl=en edit: as pointed out, this was indeed a pretty esoteric example. But the rest of my attempts were hardly better, if they had a response at all.
That’s an awfully specific and esoteric question. Would you expect gpt4 to be significantly better at that level of depth? That’s not been my experience.