Earlier quoted context omitted.
Exponential over which metric exactly? Training dataset size, compute required yeah these have grown exponentially. But has any measure capability? Because exponentially growing costs with linear or not measurable improvements is not a great trajectory.
Exponential in how useful LLM APIs and LLM based products like Google AI Lab, ChatGPT, etc. are to me personally. I am the data point I care about. I have a pet programming problem that every few months I try to solve with the current tools of the day. I admit this is anecdotal, just my personal experiences. Metrics like training data set size are less interesting now given the utility of smaller synthetic data sets.…
Gemini 2.5 Pro Preview
691–700 of 728 posts
Re: Gemini 2.5 Pro Preview
#692Earlier quoted context omitted.
The software tool takes a higher-level input to produce the executable. I'm waiting for LLMs to integrate directly into programming languages. The discussions sound a bit like the early days of when compilers started coming out, and people had been using direct assembler before. And then decades after, when people complained about compiler bugs and poor optimizers.
> I'm waiting for LLMs to integrate directly into programming languages. What do you mean? How would this look like in your view?
Re: Gemini 2.5 Pro Preview
#693Earlier quoted context omitted.
Oh, they are definitely capable, I am using them every day, and build my own MCP servers. But you cannot test a distributed system "fully". The only test I believe in is understanding every single line of code myself, or knowing that somebody else does. At this point, I don't trust the AI for anything, although it makes a very valuable assistant. Very soon our AI built software systems will break down in spectacular…
I have no idea why you think you can't test a distributed system. Hopefully you are not in the business of software development. You certainly wouldnt be working at my company. Secondly, people are not just blindly having AI write code with no idea how it works. The AI is acting as a senior consultant helping the developer to design and build the systems and generating parts of the code as they work together.
Re: Gemini 2.5 Pro Preview
#694Earlier quoted context omitted.
Yeah I think we largely agree. But I do know people, mostly experienced product managers, who are excited about "vibecoding" expressly as a prototyping / demo creation tool, which can be useful in conjunction with people who know how to turn the prototypes into real software. I'm sure lots of people aren't seeing it this way, but the point I was trying to make about this being a skill differentiator is that I think u…
If you're really prototyping a product, a simple mockup with a tool like Balsamiq can get you quite far for communication and ideation. But more often, when people want a live prototype, it's because they plan to spin some lies as "sales and marketing".
What I've seen people use it for to, in my opinion, great effect is to demonstrate capabilities that exist, but for which there are many different possibilities for how to combine and present them to users.
Sure, you can just put together a clickable mock up like people have been doing for years, but putting together functional UIs that call out to existing APIs but cobble them together in different ways, that's actually less smoke and mirrors sales spin.
Re: Gemini 2.5 Pro Preview
#695Earlier quoted context omitted.
OpenRouter lets you fund a wallet and spend no more than that. Google will let it go out of control and they purposely delay the billing console by up to 24 hours so if you don't track it all yourself you can get hit big, especially if it is a coding error that uses up to the rate limits.
Well OpenRouter is also facading the API calls, so you may not get the full details of the response back from the upstream LLM service. As far as I can tell the Gemini API returns the token counts in its response enabling you to estimate billing yourself if you want to. > they purposely delay the billing console by up to 24 hours This is about scalability and performance. Billing for as many requests per second as a…
> This is about scalability and performance. Billing for as many requests per second as a cloud provider gets can't be done live, without significant performance and reliability degradation.
I don't buy this, for LLMs specifically. For lots of things a cloud provider gives, things might be aggregated and batched before showing up, but there is no reason your LLM spend should take nearly as long as bank system clearing to show. Especially an estimate, which it already gets disclaimed as.
There are companies that will monitor your cloud spend much faster pretty cheaply, and they are essentially having to reimplement the whole thing from the outside and keep up with Google's pricing changes through a shadow recreation of the billing system.
And open router is able to reflect your spend to you immediately, or couldn't implement their cap. If they can do it why can't Google, at least for the broad number of customers without custom price agreements.
Re: Gemini 2.5 Pro Preview
#696Re: Gemini 2.5 Pro Preview
#697Earlier quoted context omitted.
I have no idea why you think you can't test a distributed system. Hopefully you are not in the business of software development. You certainly wouldnt be working at my company. Secondly, people are not just blindly having AI write code with no idea how it works. The AI is acting as a senior consultant helping the developer to design and build the systems and generating parts of the code as they work together.
I'm very confused by this. I have in no way seen AI that can act as a senior consultant to any professional software engineer. I work with AI all the time and am not doubting that it is very useful, but this seems like dreaming to me. It frequently gets confused and doesn't understand the bigger picture, particularly when large contexts are involved. Solving small problems it is often helpful but I can't imagine how…
Re: Gemini 2.5 Pro Preview
#698Earlier quoted context omitted.
> I really liked the Gemini 2.5 pro model when it was first released - the upload code folder was very nice (but they removed it). Removed from where? I use the attach code folder feature every day from the Gemini web app (with a script that clones a local repo that deletes .git and anything matching a gitignore pattern).
Maybe I got stuck with a bad experiment that removed it but it has been gone for me for a few weeks so I just stopped using it
Re: Gemini 2.5 Pro Preview
#699Earlier quoted context omitted.
[flagged]
weird ad hominem, but you do you. I'm trying to figure out this logical inconsistency: "AI has made my workers more productive, therefore my workers are worth less." My general theory is that there is more than enough engineering work to go around
Re: Gemini 2.5 Pro Preview
#700Earlier quoted context omitted.
[flagged]
LLMs cannot replace what we do. Only AGI could do that, at which point you could say the same about anything. 'Racist' in your culture, not in mine.