How is ChatGPT's behavior changing over time?
1–10 of 187 posts
Re: How is ChatGPT's behavior changing over time?
#2Never let OpenAI or Google employees (in regards to search) gaslight you into believing that things aren't being "enshittified". Glad to see scholarly evidence of this coming out.
Re: How is ChatGPT's behavior changing over time?
#3[deleted]
Re: How is ChatGPT's behavior changing over time?
#4Never let OpenAI or Google employees (in regards to search) gaslight you into believing that things aren't being "enshittified". Glad to see scholarly evidence of this coming out.
Profit motive corrupts
Absolute profit motive corrupts absolutely
Re: How is ChatGPT's behavior changing over time?
#5>June version added “‘python and “‘ before and after the code snippet. Second, it also generated a few more comments. While a small change, the extra triple quotes render the code not executable.
These are to represent markdown code blocks, which probably helped their front end developers, but hinders copy-pasta
Re: How is ChatGPT's behavior changing over time?
#6I think we should stop trying to quiz LLMs on mathematics, something for which they are explicitly not designed to do with their tokenized view of the world. Ask GPT-4 to use its Wolfram plugin and it returns the answers quickly and correctly.
Second, I think the code generation bit of this paper is blown out of proportion. The code can't be immediately injected into a codebase due to a formatting change (triple quotes). I'd be more interested in changes to the quality and performance of the code generated, not whether it can be easily copy/pasted from the page.
I could not replicate that result (but could replicate the other math issues). I've also never seen the triple quotes in results so it's unclear if there was a temporary presentation bug.
Re: How is ChatGPT's behavior changing over time?
#7OpenAI is going to be left in the dust by (actual) open models. Llama 2 is already reaching GPT-3 levels, and can run inference on consumer hardware. Crazy how fast that flipped.
Re: How is ChatGPT's behavior changing over time?
#8>June version added “‘python and “‘ before and after the code snippet. Second, it also generated a few more comments. While a small change, the extra triple quotes render the code not executable. These are to represent markdown code blocks, which probably helped their front end developers, but hinders copy-pasta
Outputting that on the API is kinda dumb, but yeah, hardly something worth publishing.
Re: How is ChatGPT's behavior changing over time?
#9Never let OpenAI or Google employees (in regards to search) gaslight you into believing that things aren't being "enshittified". Glad to see scholarly evidence of this coming out.
Honest enshittification is good but rare. Like a cloud telling you what specific CPU SKU is in the hardware (not just 1 vcore).
They should say what you are paying for in terms of technicals, either spill the beans on the architecture or have some SLAs on how good the thing is.
Re: How is ChatGPT's behavior changing over time?
#10OpenAI is going to be left in the dust by (actual) open models. Llama 2 is already reaching GPT-3 levels, and can run inference on consumer hardware. Crazy how fast that flipped.
What enables this?
There's a huge gap between GPT-3.5 and 4, put there by a massive amount of money, from my understanding.
To compete, with open source projects being less well funded, I would assume that orders of magnitude improvements in training cost would be required. What do you see driving this, and who do you see paying for it?
If Meta, or anyone else, gets something that beats GPT-4, I would naively assume they would monetize it. If someopen source effort manages to beat GPT-4, then I assume some well funded, profit seeking, entity will dump orders of magnitude more money into whatever enabled the open source offerings to compete.
I don't think GPT-4 is the pinnacle of OpenAI, or that their funding will run dry, so they shouldn't be viewed as a static entity.