141–150 of 156 posts
Finally EU is waking up. Proud of it. I am switching asap my Openai contract finishes to Mistral. We got to support EU, Viva La France.
A company owned by US investors, running on US infra, in a "strategic partnership with Microsoft", is "the EU waking up"? What a joke.
What about their infra ? Nothing's running in France ?
I've been trying to use other LLM providers than OpenAI over the past few weeks: Claude, Deepseek, Mistral, local Ollama ... While Mistral might not have the best LLM performances, their UX is IMO the best, or at least a tie with OpenAI's: - I never had any UI bug, while these were common with Claude or OpenAI (e.g. a discussion disappearing, LLM crashing mid-answer, long context errors on Claude ...); - They support…
Enough! I just paid for a year of Gemini Pro, I use gemini-cli for free for small sessions, turn on using my API key for longer sessions to avoid timeout, and most importantly: for API use I mostly just use Gemini 2.5-flash, sometimes -pro, and Moonshot’s Kimi K2. I also use local models on Ollama when they are sufficient (which is surprisingly often.)
I simply decided that I no longer wanted the hobby of always trying everything. I did look again at Mistral a few weeks ago, a good option, but Google was a good option for me.
Earlier quoted context omitted.
If China stays open, then the rest of the world will build on open. I'm frankly shocked that a domestic player isn't doing this. Fine tuning will work for niche business use cases better than promises of AGI.
> If China stays open, then the rest of the world will build on open I was listening to a Taiwanese news channel earlier today and although I wasn't paying much attention, I remember hearing about how Chinese AIs are biased towards Chinese political ideas and that some programme to create a more Taiwanese-aligned AI was being put in place. I wouldn't be surprised if just for this reason, at least a few different open…
Earlier quoted context omitted.
A major reason I haven’t really tried any of these things (despite thinking they are vaguely neat). I think I will wait until… 2026, second half, most likely. At least I’ll check if we have local models and hardware that can run them nicely, by then. Hats off to the folks who have decided to deal with the nascent versions though.
Depending on the definition of "nicely", FWIW I currently run Ollama sever [1] + Qwen Coder models [2] with decent success compared to the big hosted models. Granted, I don't utilize most "agentic" features and still mostly use chat-based interactions. The server is basically just my Windows gaming PC, and the client is my editor on a macOS laptop. Most of this effort is so that I can prepare for the arrival of that…
Finally EU is waking up. Proud of it. I am switching asap my Openai contract finishes to Mistral. We got to support EU, Viva La France.
They are very good at making smaller models, not the smartest or the most knowledgeable, but you generally get pretty clean results quickly. Also, in my experience, they are less heavy handed than others when it comes to censorship.
Earlier quoted context omitted.
There is a lot of fraud on Craigslist. The fraudsters are very creative. There is this fallacy, the 'Sunk Cost' fallacy, where people accept a substandard result because they feel they have already invested in the result and don't want to 'throw away' that investment. So in a place where it can take 90 minutes to go across the Bay, if you drive clear across the Bay for what you believe to be a pristine item, you may…
> This happens on EBay too. Sellers list something and it isn't as described, and fraudulent sellers will say "but it is! This buyer is trying to scam me." and EBay usually sides with the seller. This is not my experience at all and I've used eBay since 2008. eBay is pro buyer to the point that I don't sell anything on eBay (and buy all everything on eBay if price is the same).
I think they've buried the lede with their image editing capabilities, which seem to be very good! OpenAI's model will change the whole image while editing messing up details in unrelated areas. This seems to perfectly preserve parts of the image unrelated to your query and selectively apply the edits, which is very impressive! The only downside is the output resolution (the resulting image is 1184px wide even though…
The input image is scaled down to the closest aspect ratio of approximately 1 megapixel.
I ran some experiments with Kontext and added a slider so you can see the before / after of the isolated changes it makes without affecting the entire image.
https://specularrealms.com/ai-transcripts/experiments-with-f...
Earlier quoted context omitted.
It is completely unreasonable to buy the hardware to run a local model and only use it 1% of the time. It will be unreasonable in 2026 and probably very long after that. Maybe s.th. like a collective that buys the gpu's together and then uses them without leaking data can work.
over time you would assume the models will get more efficient and the hardware will get better to the point that buying a massive new gpu with boatloads of vram is just not necessary maybe 128gb of vram becomes the new mid tier model and most llms can fit into this nicely and do everything one wants in an llm given how fast llms are progressing it wouldn’t surprise me if we reach this point by 2030
I hope I'm wrong though, and we see a large bump soon. Even just 32GB in the mid tier would be huge.
I'm really tempted to try out a Mac Studio with 256+ GB Unified Memory (192 GB VRAM), but it is sadly out of my budget at the moment. I know there is a bandwidth loss, but being able to run huge models and huge contexts locally would be quite nice.
Earlier quoted context omitted.
A major reason I haven’t really tried any of these things (despite thinking they are vaguely neat). I think I will wait until… 2026, second half, most likely. At least I’ll check if we have local models and hardware that can run them nicely, by then. Hats off to the folks who have decided to deal with the nascent versions though.
When ChatGPT, then Llama, then Alpaca came out in rapid succession, I decided to hold off a year before diving in. This was definitely the right choice at the time, it’s becoming less-the-right-choice all the time. In particular it’s important to get past the whole need-to-self-host thing. Like, I used to be holding out for when this stuff would plateau, but that keeps not happening, and the things we’re starting to…
If they have to enshiffify, I don’t want that baked into my workflow. If they have to raise prices, that changes the local vs remote trade off. If they manage to lower prices, then the cost of running locally will be reduced as well.
I’m also not sure what the LLMs that I’d want to use look like. No real deal-maker applications have shown up so far; if the good application ends up being something like “integrate it into neovim and suggest completions as you type” obviously I won’t want to hit the network for that.
Early days still.