Earlier quoted context omitted.
MoE models can use system memory along with a GPU.
and get high token bandwidth?
Similar to a spark, which isn't blazing fast but usable.
Qwen3.8-Max: A New Bar for Coding and Cowork
521–530 of 652 posts
Re: Qwen3.8-Max: A New Bar for Coding and Cowork
#522As someone who is searching for a new programming contract right now, reading all of the incredible abilities here is pretty intimidating. Especially since I get almost all of my projects from Upwork which is an outsourcing site. I believe I am competing directly with these frontier models in some circumstances. Like there are a ton of programmers who previously would be outsourcing work to that site, but now they as…
As someone else who is an IT consultant.
You need to run away from any client who thinks your primary purpose is to write code. You must run away from the business if YOU think your primary purpose is to write code.
You should be able to write code and do it well, But the AIs, and I'm not even talking about the ones on the frontier, have been able to write code faster than I have for quite some time.
What you need to explain to your customers is all the things around writing code: software architecture, performance, and so on. Also make sure you have some understanding of the customers business, so you can suggest additional ways to make their lives better/make more money.
Software developers have a chance. Code monkeys? None.
Re: Qwen3.8-Max: A New Bar for Coding and Cowork
#523As someone who is searching for a new programming contract right now, reading all of the incredible abilities here is pretty intimidating. Especially since I get almost all of my projects from Upwork which is an outsourcing site. I believe I am competing directly with these frontier models in some circumstances. Like there are a ton of programmers who previously would be outsourcing work to that site, but now they as…
> Anyway the point is these models are just about capable of doing the entire job of analyzing a small business and building out all the agents and iterating on them with the business owner. If you search for LLM benchmarks focused on real-world tasks, you'll quickly learn this ain't the case. No point in telling business owners about that though, they need to see/learn by themselves.
What does the benchmark even mean when people are using AI to make real world things that solve real world problems?
I see people, and my self making amazing things with AI and fixing old projects and having real world impact at the fraction of the cost it would take me to hire people, or hours spent on my own coding.
I have built tools and systems with AI that have allowed me to build windows drivers, android apps, web apps, iOS apps, vm occultation, custom block drivers, custom file systems and more. To the point where entire products have been created.
Not trying to be a doomsday, but yes. It seems as though with the right infrastructure we are at the point where businesses owners can go from idea to product very fast and not need or hire much external talent.
Re: Qwen3.8-Max: A New Bar for Coding and Cowork
#524Earlier quoted context omitted.
You can do whatever you want with the model within your own organization. If you use it commercially—either as a model-as-a-service business or in a very large-scale product—you should check the additional license terms, which go beyond MIT. My interpretation is that Moonshot cares about the exact inference behavior and accurate representation of their model or derivatives, and perhaps also about capturing some addit…
Considering that very few orgs are going to be able to host a 3T parameter model internally, chances are most deployments would be subject to these restrictions and require a separate license from Moonshot.
probably will be few clicks in dashboard of your org's cloud provider.
Re: Qwen3.8-Max: A New Bar for Coding and Cowork
#525I used the qwen 3.6 models and convinced myself to go ahead and get a gpu. I got the 7900 xt with 20 gb vram.
Bad move. Should have used the money to buy NVIDIA stock
Re: Qwen3.8-Max: A New Bar for Coding and Cowork
#526I'm so glad exciting releases like this are still going to have components with open weights like Qwen 3.8 27B dense
Re: Qwen3.8-Max: A New Bar for Coding and Cowork
#527Earlier quoted context omitted.
What is stopping them from just building their data centers in the west where they have energy surplus? Not like you need to locate a data center inside a city.
Water. The west is really dry. We could throw in data lines as well but it’s really bottlenecked by water. Actually the only place in China with water in abundance is southeast China. Also they really don’t have the chips to supply those data centers, and the government isn’t so crazy to go that aggressive on AI, they have lots of other priorities as well.
Chinese data centers like to use air cooled chillers for cooling, not evaporative coolers. It's simple because power for the chillers is cheaper than water for the evaporative coolers. The opposite is true in the US
Re: Qwen3.8-Max: A New Bar for Coding and Cowork
#528I noticed they are careful not show Apple products, what operating system are they using in the demo videos?
Re: Qwen3.8-Max: A New Bar for Coding and Cowork
#529Earlier quoted context omitted.
What kind of machine do you have running that? My attempts at local have always resulted in a very hot lap
I host the models on my Mac Studio, an M1 Ultra with 64gb ram (I bought it when it came out, just happens to be good at LLMs). So when I work on my laptop, I have my oh-my-pi setup configured to use the models on my Mac over my local "bonjour" network or whatever Apple calls it. That way I have a nice cool lap, while using models that my M4 MacBook Air with its 16gb ram couldn't possibly run.
Cool yeah. I got a M3 with 32GB ram and it’s a little iffy. I’ve considered getting a MacMini to act as an in-house
Re: Qwen3.8-Max: A New Bar for Coding and Cowork
#530Earlier quoted context omitted.
Which is why big labs have been working hard on making their harness not be stateless any longer: https://earendil.com/posts/session-portability/ “Just take the session thread to another provider” might not be feasible anymore soon-ish.
Ding ding ding Which is why folks should be jumping to pi / oh my pi as soon as possible This is also why anthropic no finger lets you use the flat rate sub in non-claude-code harnesses (They do but you are charged at api rates)
As a heavy pi user - this doesn’t help, for codex. The thinking traces are encrypted and you cannot move that session over to eg your local ds4. It will lack those precious thinking traces that you absolutely need to continue a session productively.