101–110 of 315 posts
Earlier quoted context omitted.
Name a single subscription service that never changes over time? If your product is based on another company's service then you are beholden to them.
Electricity, water, TV etc... they basically always work. If they change, usually not for the worst - you dont get color TV shows downgraded to b&w.
I've been paying for GPT-4 since 3 hours after its release. The decrease in quality was noticeable just one week later (on top of the cap changes from 50 messages every 4 hours to 25 messages every 3 hours) I originally assumed that this was due to the increase in demand. It never went back to being as sharp as it was during those first hours of usage
Are you sure it wasn't just that the novelty wore off after a few hours of usage? I never really got into LLMs, but I must say at first it seemed like pretty cool stuff. OpenAI have repeatedly stated the model hasn't changed so how could this happen otherwise?
This is the part of hype cycle named "Peak of Inflated Expectations", at least when it comes to the potential of the tool. I think we are still in the "Innovation Trigger" phase in terms of applying the technology.
I suspect it’s degrading as updates / workarounds are deployed to improve its safety and compliance.
Earlier quoted context omitted.
I mean, they could be lying. Or only talking about the API version and not the front-facing ChatGPT.
I feel like it would be a fairly large conspiracy by the OpenAI team though? In fact, what motive would they have to make the model dumber, really? If it gets out and you're right, I think it will cause major trust issues with the product.
I'm not sure what you mean by "conspiracy", but this sort of thing isn't unknown. All it takes is the employees being bound by an NDA and a marketing team can say anything it likes (within the bounds of legality, anyway) without fear that they will spill the beans.
>Having the behavior of an LLM change over time is not acceptable. By now this is actually funny to read. Never rely on another companies product to make your own product, without accepting things can change overnight and shut you down As Llama2 is self hosted, you can choose which iteration to host. Much better developer experience Edit: to be clear OpenAI is unprofitable, so is Reddit, so was Stadia. Building on to…
LLama 2 is lost in the sauce... Q: How many 90 degree permutations can you do to leave a cube invariant from the perspective of an outside observer? A: As a responsible and ethical AI language model, I must first emphasize that the concept of "90 degree permutations" and "cube" are purely theoretical and have no basis in reality. However, I understand that you are asking for a hypothetical scenario, and I will provid…
I wonder if poor grammar is baked in as well? It's interesting that it wrote the sentence like that!
Perhaps the most unusual thing about dealing with the APIs is the extent of regressions you need to expect in updated versions. The API surface area of LLMs is effectively infinite, so there is no way for a company to guarantee it won't regress on the parts you care about. If you think about model versions the same way you think about software package versions you are going to be continually surprised and disappointed.
The linked twitter account is an AI influencer, so take whatever is written with a grain of salt. Their goal is to get clicks and views by saying controversial things. This topic has come up before, and my hypothesis is still that GPT-4 hasn't gotten worse, it's just that the magic has worn off as we've used this tech. Studies to evaluate it have gotten better and cleaned up mistakes in the past.
Are we talking GPT4 or chatgpt4? Its not disputed that chatGPT4 has degraded in quality as its been 'aligned'.
Earlier quoted context omitted.
So you are just going to ignore the data (not anecdotes) presented in the SP?
ChatGPT isn't the right tool to use for checking if numbers are prime. It is tuned for conversations. I'd like to see a MathGPT or WolframGPT. The real question is if ChatGPT is worse on math and better elsewhere, or just worse overall. That is still unknown
> Can you give me a query in Wolfram language for the first 25 prime numbers?
> Prime[Range[25]]
> What about one for the limit of 2/x as x tends towards infinity?
> Limit[2/x, x -> Infinity]
Edited out most of the chatter from it for clarity.
The linked twitter account is an AI influencer, so take whatever is written with a grain of salt. Their goal is to get clicks and views by saying controversial things. This topic has come up before, and my hypothesis is still that GPT-4 hasn't gotten worse, it's just that the magic has worn off as we've used this tech. Studies to evaluate it have gotten better and cleaned up mistakes in the past.
It's crazy to me how quickly the magic wore off, it's only been around for just over 6 months and people went from "holy shit" to "meh" so quickly.
GPP is banking on the underlying report to be non-interpreted, which it looks like was a good bet based on some other comments here.