Earlier quoted context omitted.
You don't lose your luster only by not innovating. Altman saga, allowing military use and other small things step by step tarnish your reputation and pushes you to the mediocrity or worse. Microsoft has many great development stories (read Raymond Chen's blog to be awed), but what they did at the end to other competitors and how they behave removed their luster, permanently for some people.
"allowing military use" That would actually increase their standing in my eyes. Not too far from where I live, Russian bombing is destroying homes of people whose language is similar to mine and whose "fault" is that they don't want to submit to rule from Moscow, direct or indirect. If OpenAI can somehow help stop that, I am all for it.
Hi everyone yes, I left OpenAI yesterday
321–330 of 472 posts
Re: Hi everyone yes, I left OpenAI yesterday
#322Frankly, OpenAI seems to be losing its luster, and fast. Plugins were a failure. GPTs are a little better, but I still don't see the product market fit. GPT-4 is still king, but not by that much any more. It's not even clear that they're doing great research, because they don't publish. GPT-5 has to be incredibly good at this point, and I'm not sure that it will be.
GPTs are also pretty good, and being able to invoke them in regular chat is also handy, but the lack of monetization and the ability to easily surface them outside of chatgpt is also kind of a problem. These problems are more fixable than the plugin issue IMO since I think the architecture of plugins is a limiting factor.
Re: Hi everyone yes, I left OpenAI yesterday
#323Earlier quoted context omitted.
Yeah but for how long… at this rate I would expect some of the freely distributed models to hit gpt4 levels in as little as 3-6 months.
I've heard claims like that 6 months ago. But so far nobody is even in the same ballpark. And not just freely distributed models, but proprietary ones backed by big money, as well. It really makes one wonder what kind of secret sauce OpenAI has. Surely it can't just be all that compute that Microsoft bought them, since Google could easily match that, and yet...
Miqu is pretty good. Sure, it's a leak...but there's nothing special there. It's just a 70b llama2 finetune.
Re: Hi everyone yes, I left OpenAI yesterday
#324Earlier quoted context omitted.
I know things keep moving faster and faster, especially in this space, but GPT-4 is less than a year old. Claiming they are losing their luster, because they aren’t shaking the earth with new models every quarter, seems a little ridiculous. As the popularity has exploded, and ethical questions have become increasingly relevant, it is probably worth taking some time to nail certain aspects down before releasing everyt…
> Claiming they are losing their luster, because they aren’t shaking the earth with new models every quarter, seems a little ridiculous. If that's the foundation your luster is built on - then it's not really ridiculous. GPT popularized LLMs to the world with GPT-3, not too long before GPT-4 came out. They made a lot of big, cool changes shortly after GPT-4 - and everyone in their mother announced LLM projects and in…
Re: Hi everyone yes, I left OpenAI yesterday
#325Earlier quoted context omitted.
Yep. AI is, and will be used militarily. These virtue signaling games are childish.
It is indeed tragic that virtue is a childish trait among adults.
Re: Hi everyone yes, I left OpenAI yesterday
#326Earlier quoted context omitted.
> I'm almost certain this is because you're getting use to chat bots. How would they honestly be getting worse? People say that, but I don't get this line of reasoning. There was something new, I learned to work with it. At one point I knew what question to ask to get the answer I want and have been using that form ever since. Nowadays I don't get the answer I want for the same input. How is that not a result of decl…
For the record, I agree with you about declining quality of answers, but… > Nowadays I don't get the answer I want for the same input. How is that not a result of declining quality? Is it really the same input? An argument could easily be made that as you’ve gotten accustomed to ChatGPT, you ask harder questions, use less descriptive of language, etc.
I don't have logs detailed enough to be able to look it up, so I can't prove it. But for me learning to work with AI tools like ChatGPT consists specifically developing an intuition of what kind of answer to expect.
Maybe my intuition skewed a little over the months. It did not do that for open source models though. As a software developer understanding and knowing what to expect from a complex system is basically my profession. Not just the systems I build, maintain and integrate, but also the systems I use to get information, like search engines. Prompt engineering is just a new iteration of google-fu.
Since this intuition has not failed me in all those other areas and since OpenAI has an incentive to change the workings under the hood (cutting costs, adding barriers to keep it politically correct) and it is a closed source system that no-one from the outside can inspect, my bet is that it is them and not me.
Re: Hi everyone yes, I left OpenAI yesterday
#327Earlier quoted context omitted.
This is literally the only thing that matters in this debate. Everything else is useless hand-wringing from people who don't want to be associated with the negative externalities of their work. The second that this tech was developed it became literally impossible to stop this from happening. It was a totally foreseeable consequence, but the researchers involved didn't care because they wanted to be successful and fi…
> the researchers involved didn't care because they wanted to be successful and figured they could just try to blame others for the consequences of their actions Such an absurdly reductive take. Or how about just like nuclear energy and knives, they are incredibly useful, society advancing tools that can also be used to cause harm. It's not as if AI can only be used for warfare. And like pretty much every technology,…
If we cared about preventing LLMs from being used for violence, we would have poured more than a tiny fraction our resources into safety/alignment research. We did not. Ergo, we don't care, we just want people to think we care.
I don't have any real issue with using LLMs for military purposes. It was always going to happen.
Re: Hi everyone yes, I left OpenAI yesterday
#328Frankly, OpenAI seems to be losing its luster, and fast. Plugins were a failure. GPTs are a little better, but I still don't see the product market fit. GPT-4 is still king, but not by that much any more. It's not even clear that they're doing great research, because they don't publish. GPT-5 has to be incredibly good at this point, and I'm not sure that it will be.
> GPT-5 has to be incredibly good at this point, and I'm not sure that it will be. My guess is it isnt, these systems are hard to trust, and the rhetoric "were aiming for AGI" suggests to me that they know this and AGI might be the only surefire way out. If you tried to replace all of a devs duties with current LLMs it would be a disaster, making sense of all that info requires focus and background thinking processes…
Overall a chatbot like GPT-4 may be useful, but not that useful as it stands.
If you can write well, it's not really going to improve your writing. Granted, you can automate a few tasks, but it does not give you 10X or even 2X improvement as sometimes advertised.
It might be useful here and there for coding, but it's not reliable.
Re: Hi everyone yes, I left OpenAI yesterday
#329Earlier quoted context omitted.
> GPT-4 is still king, but not by that much any more Idk, I just tried Gemini Ultra and it's so much worse than GPT4 that I am actually quite shocked. Trying to ask it any kind of coding question ends up being this frustrating and honestly bizarre waste of time as it hallucinates a whole new language syntax every time and then asks if you want to continue with non-working, in fact non-existing, option A or the equall…
I kind of gave up completely on coding questions. Whether it's GPT4, Anthropic, or Gemini - there's always this big issue of laziness I'm facing. Never do I get a full code, there are always stubs or TODOs (on important stuff) and when asked to correct for that.. I just get more of it (laziness). Has anyone else faced this and is there a solution? It's almost as annoying, if not more, as was incomplete output in the…
Re: Hi everyone yes, I left OpenAI yesterday
#330Earlier quoted context omitted.
One recent example in the news was the AI generated p*rn of Taylor Swift. From what I read, the people who made it used Bing, which is based on OpenAI’s tech.
This is more sensationalism than ethical issue. Whatever they did they could do, and probably do better, using publicly available tools like Stable Diffusion.