631–640 of 868 posts
Earlier quoted context omitted.
It looks like this doesn't work for users without accounts? It works when I'm logged in, but not logged out. I went ahead and reported it to the team. Thanks for letting us know!
No integration test for guest (non-logged in) users? Hahaha who am I kidding. No integration tests for anybody!
No more need for pesky humans, no?
I find it quite funny how this blog post has a big "Ask ChatGPT" box at the bottom. So you might think you could ask a question about the contents of the blog post, so you type the text "summarise this blog post". And it opens a new chat window with the link to the blog post followed by "summarise this blog post". Only to be told "I can't access external URLs directly, but if you can paste the relevant text or descri…
Earlier quoted context omitted.
Like building on quicksand for dependencies. I guess though the argument is that the foundation gets stronger over time
What dependancy could possibly be tied to a non deterministic ai model? Just include the latest one at your price point.
Earlier quoted context omitted.
If you're trying to use LLMs in an enterprise context, you would understand. Switching models sometimes requires tweaking prompts. That can be a complete mess, when there are dozens or hundreds of prompts you have to test.
This sounds made up. Much like “prompt engineering” Let’s hear an actual example
There’s no way you can switch model versions without testing and tweaking prompts, even the outputs usually look different. You pin it on a very specific version like gpt-5.2-20250308 in prod.
Earlier quoted context omitted.
wat
maybe gp's use of the word "lots" is unwarranted https://artificialanalysis.ai indicates that sonnect 4.6 beats opus 4.6 on GDPval-AA, Terminal-Bench Hard, AA Long context Reasoning, IFBench. see: https://artificialanalysis.ai/?models=claude-sonnet-4-6%2Ccl...
https://www.anthropic.com/_next/image?url=https%3A%2F%2Fwww-...
basically 9/13 are very close
Earlier quoted context omitted.
We have an OCR job running with a lot of domain specific knowledge. After testing different models we have clear results that some prompts are more effective with some models, and also some general observations (eg, some prompts performed badly across all models). Sample size was 1000 jobs per prompt/model. We run them once per month to detect regression as well.
While I believe that performance varies with respect to prompt, I have a seriously hard time believing that using the same prompt that was effective with the previous model would perform worse with the next generation of the same model from that lab and the same prompt.
Labs are still really optimizing for maybe 10 of those domains. At most 25 if we're being incredibly generous.
And for many domains, "worse" can hardly be benched. Think about creative writing. Think about a Burmese cooking recipe generator.
Earlier quoted context omitted.
No integration test for guest (non-logged in) users? Hahaha who am I kidding. No integration tests for anybody!
SDET here. A year ago when AI came into play SDET/QA roles started disappearing. People were like oh ya anyone can write tests. Then with the recent fiascos about outages and what not, I am seeing the SDE roles are disappearing and SDET roles are going back up?! Apparently AI is good at writing applications but you still need someone to make sure it is doing the right things.
Earlier quoted context omitted.
No integration test for guest (non-logged in) users? Hahaha who am I kidding. No integration tests for anybody!
SDET here. A year ago when AI came into play SDET/QA roles started disappearing. People were like oh ya anyone can write tests. Then with the recent fiascos about outages and what not, I am seeing the SDE roles are disappearing and SDET roles are going back up?! Apparently AI is good at writing applications but you still need someone to make sure it is doing the right things.
I am very curious about this: > Theme park simulation game made with GPT‑5.4 from a single lightly specified prompt, using Playwright Interactive for browser playtesting and image generation for the isometric asset set. Is "Playwright Interactive" a skill that takes screenshots in a tight loop with code changes, or is there more to it?
$skill-installer playwright-interactive in Codex! the model writes normal JS playwright code in a Node REPL
