As someone who is searching for a new programming contract right now, reading all of the incredible abilities here is pretty intimidating. Especially since I get almost all of my projects from Upwork which is an outsourcing site. I believe I am competing directly with these frontier models in some circumstances. Like there are a ton of programmers who previously would be outsourcing work to that site, but now they as…
> Anyway the point is these models are just about capable of doing the entire job of analyzing a small business and building out all the agents and iterating on them with the business owner. If you search for LLM benchmarks focused on real-world tasks, you'll quickly learn this ain't the case. No point in telling business owners about that though, they need to see/learn by themselves.
Qwen3.8-Max: A New Bar for Coding and Cowork
571–580 of 652 posts
Re: Qwen3.8-Max: A New Bar for Coding and Cowork
#572Earlier quoted context omitted.
It took me about three hours total to set up a local model. I already have a GPU and I have fiber for the download. llama.cpp is not difficult to compile and has many backends. It can run parts of the model on different backends, like in the common case that the GPU doesn't have enough VRAM for everything. There are many step-by-step guides available.
Takes even less depending on your system. LM Studio or Lemonade and you are set up in minutes and now they can even tell you what models will fit with the memory you have.
Re: Qwen3.8-Max: A New Bar for Coding and Cowork
#573Earlier quoted context omitted.
Is it? OpenRouter shows DeepInfra being cheaper than DeepSeek directly https://openrouter.ai/deepseek/deepseek-v4-flash-20260731#pr...
I agree with parent. OpenRouter might be cheaper list-price, but i have been using 10$ on DS platform since April/May, still have 2$ left. Using OpenRouter i depleted the same dollar-amount in a 1-2 weeks with same usage pattern. No idea why.
Re: Qwen3.8-Max: A New Bar for Coding and Cowork
#574Re: Qwen3.8-Max: A New Bar for Coding and Cowork
#575This makes me wonder if AI companies even have a MOAT in the first place. All requests to an LLM are idempotent, for every API call you need to send it the entire conversation history so that it can process it. LLMs do not learn or remember anything, which makes it super easy for users to switch LLMs on the fly. Most popular AI frameworks, make this a one-liner change these days. And that makes me wonder if the trill…
> All requests to an LLM are idempotent, for every API call you need to send it the entire conversation history A more appropriate term is “stateless”. LLM responses are certainly not idempotent, as they are not even deterministic.
Re: Qwen3.8-Max: A New Bar for Coding and Cowork
#576As someone who is searching for a new programming contract right now, reading all of the incredible abilities here is pretty intimidating. Especially since I get almost all of my projects from Upwork which is an outsourcing site. I believe I am competing directly with these frontier models in some circumstances. Like there are a ton of programmers who previously would be outsourcing work to that site, but now they as…
Assume the business logic and all edge cases work in the legacy app. The app is "done", just too old to work on or run on modern hosts. Hence the project.
Would/could you use AI to deliver the project at 10x the speed? Or at 1/10 the price? Or charge the same amount as ever?
I have a feeling the lowest-cost developers on freelance marketplaces are not very good at using the AI tools (and whatever related acumen) and need a lot of hand-holding, the same amount of effort almost as if I decided to guide AI to do it myself.
IMO, there's value you can sell in being someone that (even developers) can hand off a project to, to do end to end, if it's fully specified. Even though the buyer could do it themselves, the developer would be taking on managing it and having AI do it until it's correct, and all the little things, few as they may be.
AI should be giving contract developers superpowers. If it's not, then the limited set of contractors with the AI superpowers will be able to charge 10x as much for their time, and the actual cost of the project remains the same even if it's done 10x as fast/easily.
Curious if you see/feel this, or if there's a marketplace for "please vibe code this for me, make sure it works and is what I want".
Re: Qwen3.8-Max: A New Bar for Coding and Cowork
#577Earlier quoted context omitted.
Filelight / ncdu are my friends for finding random 30GB directories containing cached models.
Personally, I prefer QDirStat. I just tried to use FileLight to compare, but the package seems to be broken on Lubuntu.
Re: Qwen3.8-Max: A New Bar for Coding and Cowork
#578Earlier quoted context omitted.
This is the diametric opposite of the rent-vs-buy scenario that this entails. Local: You need to invest $thousands into GPU and/or very-high-end CPU+Memory hardware. Vendor: You can use any existing device, even a phone or tablet. A very low-end laptop is fine. > takes literal minutes to get started Local: Typical scenario is hours just to download the software, the model weights, and then faffing around with CUDA an…
It took me about three hours total to set up a local model. I already have a GPU and I have fiber for the download. llama.cpp is not difficult to compile and has many backends. It can run parts of the model on different backends, like in the common case that the GPU doesn't have enough VRAM for everything. There are many step-by-step guides available.
Re: Qwen3.8-Max: A New Bar for Coding and Cowork
#579Earlier quoted context omitted.
This is the diametric opposite of the rent-vs-buy scenario that this entails. Local: You need to invest $thousands into GPU and/or very-high-end CPU+Memory hardware. Vendor: You can use any existing device, even a phone or tablet. A very low-end laptop is fine. > takes literal minutes to get started Local: Typical scenario is hours just to download the software, the model weights, and then faffing around with CUDA an…
> Local: Typical scenario is hours just to download the software, the model weights, and then faffing around with CUDA and matching your GPU drivers. Download LM studio, search models, click download, wait minutes, prompt and have fun
Re: Qwen3.8-Max: A New Bar for Coding and Cowork
#580This makes me wonder if AI companies even have a MOAT in the first place. All requests to an LLM are idempotent, for every API call you need to send it the entire conversation history so that it can process it. LLMs do not learn or remember anything, which makes it super easy for users to switch LLMs on the fly. Most popular AI frameworks, make this a one-liner change these days. And that makes me wonder if the trill…
Why is Google a monopoly? Do they have so advanced software that no one can outperform? I doubt it. What they have is a giant user base that generate loads of real-time data, which make Google services more accurate.
So how AI company can build a moat? Exactly the same way: by making a giant user base produce loads of real time data. Just imagine a service that will generate answers not only based on data they were trained on, but on all data from all user conversations. Imagine being at a concert, looking for a certain type of beer and instantly receiving an answer from an AI assistant about that only because some other guy in a crowd looking for exactly the same thing said to his agent "ah, here they are!".
It is not happening just yet because of making it secure and private is not yet solved, but it's just a matter of time I think.