211–220 of 692 posts
The pelican is a lot : https://github.com/simonw/llm-gemini/issues/133#issuecomment... Not a great bicycle though, it forgot the bar between the pedals and the back wheel and weirdly tangled the other bars. Expensive too - that pelican cost 13 cents: https://www.llm-prices.com/#it=11&ot=14403&sel=gemini-3.5-fl...
That pelican looks like it's in Miami for a crypto conference.
Earlier quoted context omitted.
We need another "Deepseek moment" or else it will become impossible for the regular dude to use AI. It will become something that only big companies can afford.
gemini isn't even that good. just tested 3.5 on usual complex prompts to opus/chat 5.5. meh
> Create animated SVG of a frog on a boat rowing through jungle river. Single page self contained HTML page with SVG 3.5 Flash: Thinking Medium - 7516 tokens https://gistpreview.github.io/?5c9858fd2057e678b55d563d9bff0... 3.5 Flash: Thinking High - 7280 tokens https://gistpreview.github.io/?1cab3d70064349d08cf5952cdc165... 3.1 Pro - 28,258 tokens https://gistpreview.github.io/?6bf3da2f80487608b9525bce53018... Though…
Opus 4.7 https://claude.ai/public/artifacts/128ebe5a-add7-406a-9bce-6...
Earlier quoted context omitted.
funny that when I try the same prompt, gemini generates an image, not an SVG. something is not right.
That's likely because you're using the Gemini app which has a tool for image generation (nano banana) - I do my tests against the API to avoid any possibility of tool use.
Earlier quoted context omitted.
hesamation/Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-GGUF @ Q6_K 8112 tokens @ 52.97 TPS, 0.85s TTFT https://gistpreview.github.io/?7bdefff99aca89d1bc12405323bd4... Full session: https://gist.github.com/abtinf/7bdefff99aca89d1bc12405323bd4... Generated with LM Studio on a Macbook Pro M2 Max https://huggingface.co/hesamation/Qwen3.6-35B-A3B-Claude-4.6...
It isn’t animated at all for me?
benchmarks look REALLY good, the price hike is big but it also beats sonnet 4.6 in every discipline?
Earlier quoted context omitted.
I don't think input/output pricing matters, 90% of the cost is cache. $0.15 is pretty good, but still very expensive.
Gemini caching is confusing though: $0.15 / million tokens $1.00 / 1,000,000 tokens per hour (storage price) I much prefer the OpenAI/DeepSeek way of pricing caching where you don't have to think about storage price at all - you pay for cached tokens if you reuse the same prefix within a (loosely defined) time period.
I confirmed this by running a bunch of prompts through Gemini 3.5 Flash without doing anything special to configure caching and noting that it comes back with a "cachedContentTokenCount" on many of the responses.
The "storage price" quoted is for an optional Gemini feature that most people don't care about: https://ai.google.dev/gemini-api/docs/caching#explicit-cachi...
Earlier quoted context omitted.
I see hallucinations ALL the time. It's only obvious when you're prompting about a subject you know well. And when I say all the time, I mean it, and this is for Opus 4.7 Adaptive. I often have to say, please do searches and cite sources, as if it doesn't it will confidently give me wrong or outdated information. If you're often asking questions about a topic that's not in your specialist knowledge you won't notice t…
Hallucination is also much better controlled in the context of agentic coding because outputs can be validated by running the code (or linters/LSP). I almost never notice hallucinations when I’m coding with AI, but when using AI for legal work (my real job) it hallucinates constantly and perniciously because the hallucinations are subtle—e.g., making up a crucial fact about a real case.
If you aren't paying attention it can spend a long time (and a lot of tokens) spinning in that loop. Sometimes there might be more than two approaches in the loop, which makes it even harder to see that it's repeating itself in a loop. It's pretty frustrating to see it working away productively (so you think) for 20 minutes or so only to finally notice what's going on
Earlier quoted context omitted.
Deepseek V4 (not flash) trippled in price too by the way (from Deepseek). Get used to this pattern. This is what you get for relying on the generosity of billionaires. Keep offshoring your thinking ability to a machine and let me know how competitive you. Hint, you wont be. There's nothing special about being able to use an LLM.
Anyone can host Deepseek V4 on rented GPUs and sell inference on it. Price will very quickly converge to the marginal cost of inference. This is as close to a pure commodity as it gets in the AI space so competitive market economics will put in work. Same is true for any open-weights model.
Please go run some numbers.The hardware needed to Run Deepseek v4 flash at 20 tps for a single session is nowhere close to what is required to run it at 50tps for 5,000 concurrent sessions.
Imagine what it takes to be profitible when running at 150 tps for 30cents per 1mm. You make less than 1k per month and the hardware required to run that cost 10k a month to rent with hardly any concurrent session capability.