Of course Bolt is the customer spotlight. These vibe coding tools chuck the entire codebase and charge for tokens used. By 10k lines of code or so, these apps were not able to fit.
Claude Sonnet 4 now supports 1M tokens of context
631–640 of 706 posts
Re: Claude Sonnet 4 now supports 1M tokens of context
#632Does anybody know which technology most of these companies that support 1M tokens use? Or is it all hidden?
Re: Claude Sonnet 4 now supports 1M tokens of context
#633This is definitely one of my CORE problem as I use these tools for "professional software engineering." I really desperately need LLMs to maintain extremely effective context and it's not actually that interesting to see a new model that's marginally better than the next one (for my day-to-day). However. Price is king. Allowing me to flood the context window with my code base is great, but given that the price has su…
> I really desperately need LLMs to maintain extremely effective context The context is in the repo. An LLM will never have the context you need to solve all problems. Large enough repos don't fit on a single machine. There's a tradeoff just like in humans where getting a specific task done requires removing distractions. A context window that contains everything makes focus harder. For a long time context windows we…
All the more reason for good software engineering. Folders of files managing one concept. Files tightly focussed on sub problems of that concept. Keep your code so that you can solve problems in self contained context windows at the right level of abstraction
Re: Claude Sonnet 4 now supports 1M tokens of context
#634Earlier quoted context omitted.
> I really desperately need LLMs to maintain extremely effective context The context is in the repo. An LLM will never have the context you need to solve all problems. Large enough repos don't fit on a single machine. There's a tradeoff just like in humans where getting a specific task done requires removing distractions. A context window that contains everything makes focus harder. For a long time context windows we…
All the more reason for good software engineering. Folders of files managing one concept. Files tightly focussed on sub problems of that concept. Keep your code so that you can solve problems in self contained context windows at the right level of abstraction
I fear that LLM-optimal code structure is different from human-optimal code structure, and people are starting to optimize for the former rather than the latter.
Re: Claude Sonnet 4 now supports 1M tokens of context
#635Earlier quoted context omitted.
I'm not sure how, and maybe some of the coding agents are doing this, but we need to teach the AI to use abstractions, rather than the whole code base for context. We as humans don't hold the whole codebase in our hear, and we shouldn't expect the AI to either.
They already do, or at least Claude Code does. It will search for a method name, then only load a chunk of that file to get the method signature, for example. It will use the general information you give it to make educated guesses of where things are. If it knows the code is Vue based and it has to do something with "users", it might seach for "src/*/ User .vue. This is also the reason why the quality of your code m…
Claude Code can get access to a language server like clangd through a MCP server, for example https://github.com/isaacphi/mcp-language-server
Re: Claude Sonnet 4 now supports 1M tokens of context
#636Earlier quoted context omitted.
That's my anecdotal experience as well! Junior devs struggle with a lot of things: - syntax - iteration over an idea - breaking down the task and verifying each step Working with a tool like Claude that gets them started quick and iterate the solution together with them helps them tremendously and educate them on best practices in the field. Contrast that with a seasoned developer with a domain experience, good comma…
> that experienced developers' performance suffered when using an LLM That experiment is really non significant. A bunch of OSS devs without much training in the tools used them for very little time and found it to be a net negative.
> That experiment is really non significant
That's been anecdotally my experience as well, I have found juniors benefitted the most so far in professional settings with lots of time spent on learning the tools. Senior devs either negatively suffered or didn't experience an improvement. The only study so far also corroborates that anecdotal experience.
We can wait for other studies that are more relevant and with larger sample sizes, but till the only folks actually trying to measure productivity experienced a negative effect so I am more inclined to believe it until other studies come along.
Re: Claude Sonnet 4 now supports 1M tokens of context
#637Earlier quoted context omitted.
Also another view is that developers below a certain level get a positive benefit and those above get a negative effect. This makes sense, as the models are an average of the code out there and some of us are above and below that average. Sorry btw I do not want to offend anyone who feels they do garner a benefit from LLMs, just wanted to drop in this idea!
i don't know if anybody else has experienced this, but one of my biggest time-sucks with cursor is that it doesn't have a way for me to steer it mid-process that i'm aware of. it'll build something that fails a test, but i know how to fix the problem. i can't jump in a manually fix it or tell it what to do. i just have to watch it churn through the problem and eventually give up and throw away a 90% good solution tha…
You can click stop, and prompt it from there
Re: Claude Sonnet 4 now supports 1M tokens of context
#638Earlier quoted context omitted.
> But they have to get better at understanding the repo by asking the right questions. How I am tackling this problem is making it dead simple for users to create analyzers that are designed to enriched text data. You can read more about how it would be used in a search at https://github.com/gitsense/chat/blob/main/packages/chat/wid... The basic idea is, users would construct analyzers with the help of LLMs to extrac…
How is that better than just writing a line in the md?
I am not sure I follow what you are saying. What would the line be and how would it become deterministically searchable?
Re: Claude Sonnet 4 now supports 1M tokens of context
#639Earlier quoted context omitted.
I'm not a programmer, but I need to write python and bash programs to do my work. I also have a few websites and other personal projects. Claude Code helps me implement those little projects I've been wanting to do for a very long time, but I couldn't due to the lack of coding experience and time. Now I'm doing them. Also now I can improve my emacs environment, because I can create lisp functions with ease. For me, t…
At the end of the day, all tools are made to make their users' lives easier. I use GitHub Copilot. I recently did a vibe code hobby project for a command line tool that can display my computer's IP, hard drive, hard drive space, CPU, etc. GPT 4.1 did coding and Claude did the bug fixing. The code it wrote worked, and I even asked it to create a PowerShell script to build the project for release
Try typing ctrl+shift+escape.
Re: Claude Sonnet 4 now supports 1M tokens of context
#640Just completed a new benchmark that sheds some light on whether Anthropic's premium is worth it. (Short answer: not unless your top priority is speed.) https://brokk.ai/power-rankings
Why no Grok 4?
the accompanying blog post explains: xAI did not respond to our requests for a grok 4 quota that would allow us to run the evaluation