Powering cost-efficient AI inference at scale with Cloud TPU v5e on GKE
1–10 of 28 posts
Re: Powering cost-efficient AI inference at scale with Cloud TPU v5e on GKE
#2AI is a big deal this year. Google is one of the biggest tech companies.
Yet a post about AI at Google gets... No comments at all.
Back in 2005, this would have been the most talked about news of the day. Now, nobody cares what Googles up to. They lost their way.
Re: Powering cost-efficient AI inference at scale with Cloud TPU v5e on GKE
#3AI is a big deal this year. Google is one of the biggest tech companies. Yet a post about AI at Google gets... No comments at all. Back in 2005, this would have been the most talked about news of the day. Now, nobody cares what Googles up to. They lost their way.
At this point I can’t see why anyone would build their business on any Google product aside from Google Docs.
Re: Powering cost-efficient AI inference at scale with Cloud TPU v5e on GKE
#4AI is a big deal this year. Google is one of the biggest tech companies. Yet a post about AI at Google gets... No comments at all. Back in 2005, this would have been the most talked about news of the day. Now, nobody cares what Googles up to. They lost their way.
Google, structurally, sucks at anything but sucking down Ad money.
A good LLM allows one to basically bypass the internet for many use cases and drastically reduces ad time. As cool as LLM capabilities are the thing that delights me most about them is I can get high quality (YMMV) answers from the internet without all the godforsaken ad bullshit and wonky websites made only as mazes to keep users in ad gardens.
Google is stuck in one hell of an innovators dilemma, one that I can't really see them getting unstuck from.
As far as this particular product, it's touting cost efficiency, but that's not really dominating many decisions yet. There is an all-in sprint to get models trained and take their piece of the pie before the moats get too deep and AI hardware everywhere is back-ordered 12+ months.
Re: Powering cost-efficient AI inference at scale with Cloud TPU v5e on GKE
#5AI is a big deal this year. Google is one of the biggest tech companies. Yet a post about AI at Google gets... No comments at all. Back in 2005, this would have been the most talked about news of the day. Now, nobody cares what Googles up to. They lost their way.
Google, structurally, sucks at anything but sucking down Ad money. A good LLM allows one to basically bypass the internet for many use cases and drastically reduces ad time. As cool as LLM capabilities are the thing that delights me most about them is I can get high quality (YMMV) answers from the internet without all the godforsaken ad bullshit and wonky websites made only as mazes to keep users in ad gardens. Googl…
> good LLM allows one to basically bypass the internet for many use cases and drastically reduces ad time
Until they advertise during your Chat with the LLM. The question is just when this happens not if.
Re: Powering cost-efficient AI inference at scale with Cloud TPU v5e on GKE
#6Earlier quoted context omitted.
Google, structurally, sucks at anything but sucking down Ad money. A good LLM allows one to basically bypass the internet for many use cases and drastically reduces ad time. As cool as LLM capabilities are the thing that delights me most about them is I can get high quality (YMMV) answers from the internet without all the godforsaken ad bullshit and wonky websites made only as mazes to keep users in ad gardens. Googl…
> good LLM allows one to basically bypass the internet for many use cases and drastically reduces ad time Until they advertise during your Chat with the LLM. The question is just when this happens not if.
Too true.
But in the beginning at least, there will be high competition which will hold down the ads a bit, with enshitifcation happening after the market entrenches around the winners.
Re: Powering cost-efficient AI inference at scale with Cloud TPU v5e on GKE
#7AI is a big deal this year. Google is one of the biggest tech companies. Yet a post about AI at Google gets... No comments at all. Back in 2005, this would have been the most talked about news of the day. Now, nobody cares what Googles up to. They lost their way.
Google is no longer a tech heavy company. The only “interesting” things coming out of there are high level executives assigning engineers on random projects against their will, return to office orders, sarcastic offers to relocate workers into company owned hotels so they can “sleep longer” in the morning, and many other mediocre “achievements” of mba type “leaders”.
Just by looking at their core hook, search, you notice a clear reduction in quality. Their core products, ads, are also rife with dubious practices - even more so than in the past. I doubt these are due to technical issues but rather a result of poor product management. Lesson is that no technical company should be led by non technical people. They all turn to shit when that happens.
Re: Powering cost-efficient AI inference at scale with Cloud TPU v5e on GKE
#8Earlier quoted context omitted.
Google, structurally, sucks at anything but sucking down Ad money. A good LLM allows one to basically bypass the internet for many use cases and drastically reduces ad time. As cool as LLM capabilities are the thing that delights me most about them is I can get high quality (YMMV) answers from the internet without all the godforsaken ad bullshit and wonky websites made only as mazes to keep users in ad gardens. Googl…
> good LLM allows one to basically bypass the internet for many use cases and drastically reduces ad time Until they advertise during your Chat with the LLM. The question is just when this happens not if.
If only. How about product placement seamlessly melded into any digital interaction? BRB, prompting ChatGPT for a YCombinator funding pitch.
Re: Powering cost-efficient AI inference at scale with Cloud TPU v5e on GKE
#9AI is a big deal this year. Google is one of the biggest tech companies. Yet a post about AI at Google gets... No comments at all. Back in 2005, this would have been the most talked about news of the day. Now, nobody cares what Googles up to. They lost their way.
They lost their way or HN readers are out of touch?
Re: Powering cost-efficient AI inference at scale with Cloud TPU v5e on GKE
#10AI is a big deal this year. Google is one of the biggest tech companies. Yet a post about AI at Google gets... No comments at all. Back in 2005, this would have been the most talked about news of the day. Now, nobody cares what Googles up to. They lost their way.
They lost their way or HN readers are out of touch?
Google Drive losing customer data is which one?
Context: https://www.theregister.com/2023/11/27/google_drive_files_di...