Any free open source model that I can install on iPhone? OpenAI/Claude are censored in China without a VPN.
OpenAI/Claude's company policy does not allow China to use them.
Open models by OpenAI
591–600 of 909 posts
Re: Open models by OpenAI
#592Earlier quoted context omitted.
> I am actually able to use ChatGPT 4.5 as not just an employee, not even just as a coworker, but at times as a mentor or senior advisor: I can tell it what I am trying to do, and it helps me by applying advanced mathematical insights or suggesting things I could use. You can still do that sort of thing, but just have it perform searches whenever it has to deal with a matter of fact. Just because it's trained for too…
If you strip all the facts from a mathematician you get me ... I don't need another me: I already used Google, and I already failed to find what I need. What I actually need is someone who can realize that my problem is a restatement of an existing known problem, just using words and terms or a occluded structure that don't look anything like how it was originally formulated. You very often simply can't figure that o…
> What makes these AIs so amazing is thinking of them as entirely replacing Google with something closer to a god
I guess that way of thinking may foster amazement, but it doesn't seem very grounded in how these things work or their current capabilities. Seems a bit manic tbf.
And again, enabling web search in your chats doesn't prevent these models from doing anything "integrative reasoning", so-to-speak, that they can purportedly do. It just helps ensure that relevant facts are in context for the model.
Re: Open models by OpenAI
#593Re: Open models by OpenAI
#594Just posted my initial impressions, took a couple of hours to write them up because there's a lot in this release! https://simonwillison.net/2025/Aug/5/gpt-oss/ TLDR: I think OpenAI may have taken the medal for best available open weight model back from the Chinese AI labs. Will be interesting to see if independent benchmarks resolve in that direction as well. The 20B model runs on my Mac laptop using less than 15GB…
> The 20B model runs on my Mac laptop using less than 15GB of RAM. I was about to try the same. What TPS are you getting and on which processor? Thanks!
55 token/s here on m4 pro, turning on flash attention puts it to 60/s.
Re: Open models by OpenAI
#595Earlier quoted context omitted.
Yep, it's almost as bad as all the cars' cooling systems using up so much water.
Estimated 1.5 billion vehicles in use across the world. Generous assumptions: a) they're all IC engines requiring 16 liters of water each. b) they are changing that water out once a year That gives 24m cubic meters annual water usage. Estimated ai usage in 2024: 560m cubic meters. Projected water usage from AI in 2027: 4bn cubic meters at the low end.
Earth: ~1.4e18 m³ water
Atmosphere: ~1.3e13 m³ vapor
Estimated impact from closed loop systems: 0-ish.
Re: Open models by OpenAI
#596Just posted my initial impressions, took a couple of hours to write them up because there's a lot in this release! https://simonwillison.net/2025/Aug/5/gpt-oss/ TLDR: I think OpenAI may have taken the medal for best available open weight model back from the Chinese AI labs. Will be interesting to see if independent benchmarks resolve in that direction as well. The 20B model runs on my Mac laptop using less than 15GB…
Hasn't nailed the strawberry test yet
Re: Open models by OpenAI
#597Earlier quoted context omitted.
>Google started shipping 16GB as the _lowest_ amount of RAM you can get on your Pixel 9. The Pixel 9 has 12GB of RAM[0]. You probably meant the Pixel 9 Pro. [0]: https://www.gsmarena.com/google_pixel_9-13219.php
Still an absurd amount of RAM for a phone, imo
Seems about right, my new laptop has 8x that which is a about the same ratio that my last new laptop had to my phone at the time.
Re: Open models by OpenAI
#598gpt-oss:20b crushed it on one of local llm test prompts to guess a country i am thinking of just by responding whether each guess is colder/warmer. I've had much larger local models struggle with it and get lost but this one nailed it and with speedy inference. progress on this stuff is boggling.
Re: Open models by OpenAI
#599Earlier quoted context omitted.
Why does it need knowledge when it can just call tools to get it?
Right... knowledge is one of the things (the one thing?) that LLMs are really horrible at, and that goes double for models small enough to run on normal-ish consumer hardware. Shouldn't we prefer to have LLMs just search and summarize more reliable sources?
Reliable sources that are becoming polluted by output from knowledge-poor LLMs, or overwhelmed and taken offline by constant requests from LLMs doing web scraping …
Re: Open models by OpenAI
#600Earlier quoted context omitted.
> I try to be mindful of what I share with ChatGPT, but even then, asking it to describe my family produced a response that was unsettling in its accuracy and depth. > Worse, after attempting to delete all chats and disable memory, I noticed that some information still seemed to persist. Maybe I'm missing something, but why wouldn't that be expected? The chat history isn't their only source of information - these mod…
I think you are underestimating how notable a person needs to be for their information to be baked into a model.
LLMs can learn from a single example.