Viewing profile — chisleu

Many are investing in RTX6000pro hardware but hitting deployment walls. This guide covers everything from simple 4x builds to scaling up to 16 cards with PCIe switches.

An open-source, code-first Go toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and control.

Total tangent, but I got to ride in some of these on a recent trip to India and I was really impressed with the build quality and utilitarian usefulness of the design.

Here is the demo video on it. The video w/ sound input -> sound output while doing translation from the video to another language was the most impressive display I've seen yet. htt…

Because of the prompt processing speed, small models like Qwen 3 coder 30b a3b are the sweet spot for mac platform right now. Which means a 32 or 64GB mac is all you need to use Cl…

I've been using GLM 4.5 and GLM 4.5 Air for a while now. The Air model is light enough to run on a macbook pro and is useful for Cline. I can run the full GLM model on my Mac Studi…

This is going to improve the quality of LLM responses for users. I'm for this.

> but eventually they did it They can do this with manual partitioning indeed. I've done it before, but it's not ideal because the auto partitioner will scale beyond almost anythin…

and indeed the bucket is not separate from the object key. the API separates it logically "for humans" but it's all one big string

> You don’t have to randomize the first part of your object keys to ensure they get spread around and avoid hotspots. As of when? According to internal support, this is still requi…

/agree We are in the infancy of LLM technology.

How was he doing "complex agentic coding" when the APIs have such extreme context and throughput limitations?

holy shit it does. The scene with him inventing the new compression algorithm basically foreshadowed the gooning to follow local LLM availability.

I use opus or gemini 2.5 pro for plan mode and sonnet for act mode in Cline. https://cline.bot It's my experience that Opus is better at solving architectural challenges where sonn…

It looks like qwen3-coder is going to steal K2's thunder in terms of agentic coding use.

It's 480B params, not 480GB. The 4 bit version of this is 270GB. I believe it's trained at bf16, so you need over a TB of memory to operate the model at bf16. No one should be tryi…

A Mac Studio 512GB can run it in 4bit quantization. I'm excited to see unsloth dynamic quants for this today.

I tried using the "fp8" model through hyperbolic but I question if it was even that model. It was basically useless through hyperbolic. I downloaded the 4bit quant to my mac studio…

A mac studio can run it at 4bit. Maybe at 6 bit.

I love the interface. It makes it extremely easy to rewind time to undo code edits and rewinding the LLM context at the same time. It's prompting and toolset is great. It's got MCP…

Like working with an incredibly talented and knowledgable junior engineer, but still a junior engineer. If you want to try something better than claude code, try Cline.

It's infinitely useful for people who's workflows involve LLM agents.

It is indeed. I don't use Claude Code. I use Cline which is a VS Code extension (cline.bot). This is a pretty killer feature that I would expect to find in all the coding agents so…