141–150 of 512 posts
Earlier quoted context omitted.
Need a general term for autonomous intelligent decision making.
Isn't that just "intelligent"?
Intelligence is a characteristic.
Earlier quoted context omitted.
I've been using Gemini Flash for free through the API using Cline for VS Code. I switch between Claude and Gemini Flash, using Claude for more complicated tasks. Hope that the 2.0 model comes closer to Claude for coding.
Or… just continue using Claude?
Considering so many of us would like more vRAM than NVIDIA is giving us for home compute, is there any future where these Trillium TPUs become commodity hardware?
Why do you want the hardware vs just using it in the cloud? If you're training huge models you probably don't also keep all your data on prem, but on GCS or S3 right? It'd be more efficient to use training resources close to your data. I guess inference on huge models? Still isn't just using a hosted API simpler / what everyone is doing now?
Anyone else annoyed how the ML/AI community just adopted the word "reasoning" when it seems like it is being used very out of context when looking at what the model actually does?
Earlier quoted context omitted.
You’re still focused about training :) training doesn’t matter if inference costs are high and people don’t pay for them
but inference costs arent high already and there are tons of hardware companies that can do relatively cheap LLM inference
Training is amortized over each inference, so the cost of inference also needs to include the cost of training to break even unless made up elsewhere
Side note on Gemini: I pay for Google Workspace simply to enable e-mail capability for a custom domain. I never used the web interface to access email until recently. To my surprise, all of the AI shit is enabled by default. So it’s very likely Gemini has been training on private data without my explicit consent. Of course G words it as “personalizing” the experience for me but it’s such a load of shit. I’m tired of…
Big companies can be slow to pivot, and Google has been famously bad at getting people aligned and driving in one direction. But, once they do get moving in the right direction the can achieve things that smaller companies can't. Google has an insane amount of talent in this space, and seems to be getting the right results from that now. Remains to be seen how well they will be able to productize and market, but hard…
Yet, google continues to show it'll deprecate it's APIs, Services, and Functionality at the detriment of your own business. I'm not sure enterprises will trust Google's LLM over the alternatives. Too many have been burned throughout the years, including GCP customers. The fact GCP needs to have this page, and these lists are not 100% comprehensive is telling enough. https://cloud.google.com/compute/docs/deprecations…
Earlier quoted context omitted.
Your first sentence has the fallacy that you’re attributing the cost of the device to a single feature against the cost of that single feature. Most people are unlikely to buy the device for the AI features alone. It’s a value add to the device they’d buy anyway. So you need the paid for option to be significantly better than the free one that comes with the device. Your second sentence assumes the local one is dumb.…
I think it's a more likely assumption that on device performance will trail off device models by a significant margin for at least the next few years - of course if magically you can make it work locally with the same level of performance it would be better. Plus a lot of the "agentic" stuff is interaction with the outside world, connectivity is a must regardless.
It's like Microsoft creating an AI tool and calling it Peertube. "Hurr durr they couldn't possibly be confused; one is a decentralised video platform and the other is an AI tool hurr durr. And ours is already more popular if you 'bing' it hurr durr."