Frankly, OpenAI seems to be losing its luster, and fast. Plugins were a failure. GPTs are a little better, but I still don't see the product market fit. GPT-4 is still king, but not by that much any more. It's not even clear that they're doing great research, because they don't publish. GPT-5 has to be incredibly good at this point, and I'm not sure that it will be.
> Frankly, OpenAI seems to be losing its luster, and fast. Good. I have no idea what's really going on inside that company but the way the staff were acting on twitter when Altman got the push was genuinely scary, major red flags, bad vibes, you name it, it reeked of it.
Hi everyone yes, I left OpenAI yesterday
231–240 of 472 posts
Re: Hi everyone yes, I left OpenAI yesterday
#232Earlier quoted context omitted.
I wish more of us would run for Congress. I'd much rather have a government of technocrats of various stripes than ex lawyers and rich business types. IMO governments, like websites, should be boring but effective, focused on small day to day improvements, not all flash and empty marketing chasing cultural trends...
I don't know about the US, but the simple answer in the UK IMO is that politics doesn't pay enough. So you get egos, old money, and people with concurrent business interests. But try convincing a democracy that politicians should be paid more.
I believe the basic pay is £86k. They're not brain surgeons or rocket scientists, so even that is not that bad.
But I believe the average gravy train bumps this up 3X with extras.
It's a literal gravy train of subsidies and expenses and allowances! Sure the basic pay is, well, it's arguably not that bad ... but the gravy on top is tremendous. Not to mention the network contacts which plug their gravy train into the more lucrative gravy superhighway later.
Re: Hi everyone yes, I left OpenAI yesterday
#233Does anyone here know?
Re: Hi everyone yes, I left OpenAI yesterday
#234Earlier quoted context omitted.
Running Ollama with a 80gb mistral model works as well if not better than ChatGPT 3.5. This is a good thing for the world IMO as the magic is no longer held just OpenAI. The speed at which competitors have caught up in even the last 3 months is astounding.
But no one cares about 3.5. It’s an order of magnitude worse than 4. An order of magnitude is a lot harder to catch up with.
For some advanced reasoning you're 100% right, but many times you're doing document conversion, summarizing, doing RAG, in all these cases GPT 3.5 performs as good if not better than GPT 4 (we can't ignore cost and speed) and it's very hard to distinguish between the two.
Re: Hi everyone yes, I left OpenAI yesterday
#235Let me say, he's a great teacher! I took a CV class with him. He should teach more, and take it seriously. Being a popular AI influencer is not necessarily correlated with being a good researcher though. And I would argue there is a strong indication that it is negatively correlated with being a good business leader / founder. Here's to hoping he chills out and goes back to the sorely needed lost art of explaining co…
Re: Hi everyone yes, I left OpenAI yesterday
#236Re: Hi everyone yes, I left OpenAI yesterday
#237Earlier quoted context omitted.
I think OpenAI will do fine, but I have doubts about ChatGPT as a product. It’s just a chat UI, and I’m not convinced the UI will be chat 3 years from now. Personally, the chat UI is the main limiting factor in my own adoption, because a) it’s not in the tool I’m trying to use, and b) it’s quicker for me to do the work than describe the work I need doing.
I interact with ChatGPT by voice pretty often, they have the best speech recognition I’ve ever seen. I can switch between languages (English, French, German) mid-sentence, think aloud, stop mid sentence, the correct what I just said, use highly technical terms (even describe code), I don’t even double check anymore because it’s almost always transcribed correctly. They can ~easily evolve the product to a more general…
Multi languages would be so useful for me.
Re: Hi everyone yes, I left OpenAI yesterday
#238Earlier quoted context omitted.
They seem to be steadily dumbing down GPT-4; eventually, improving performance of open source models and decreasing performance of GPT-4 will meet in the middle.
I'm almost certain this is because you're getting use to chat bots. How would they honestly be getting worse? Initially it felt like the singularity was at hand. You've played with it, got to know it, the computer was taking to you, it was your friend, it was exciting then you got bored with your new friend and it wasn't as great as you remember it. Dating is often like this. You meet someone, have some amazing intim…
2. More and more RLHF
Re: Hi everyone yes, I left OpenAI yesterday
#239Frankly, OpenAI seems to be losing its luster, and fast. Plugins were a failure. GPTs are a little better, but I still don't see the product market fit. GPT-4 is still king, but not by that much any more. It's not even clear that they're doing great research, because they don't publish. GPT-5 has to be incredibly good at this point, and I'm not sure that it will be.
> GPTs are a little better, but I still don't see the product market fit. If ChatGPT doesn't have product-market fit, what actually has?
Re: Hi everyone yes, I left OpenAI yesterday
#240Earlier quoted context omitted.
Who cares about speed if you’re wrong? This isn’t a race to write the most lines of code or the most lines of text. It’s a race to write the most correct lines of code. I’ll wait half an hour for a response if I know I’m getting at least staff engineer level tier of code for every question
That’s the correct answer. Years ago I worked on inference efficiency on edge hardware at a startup. Time after time I saw that users vastly prefer slower, but more accurate and robust systems. Put succinctly: nobody cares how quick a model is if it doesn’t do a good job. Another thing I discovered is it can be very difficult to convince software engineers of this obvious fact.
I see how most people would prefer a better but slower model when price is equal, but I'm sure many prefer a worse $2/mo model over a better $20/mo model.