Earlier quoted context omitted.
True. Microsoft's all in, Apple's all in, Nvidia is selling shovels, insurance companies are all in, police & military are all in, education is all in, office management is all in. Who is left to pump line up?
no one is successfully using LLMs for anything other than customer service related things and text generation(coding, writing)
New LLM optimization technique slashes memory costs
31–40 of 227 posts
Re: New LLM optimization technique slashes memory costs
#32So it's like a garbage collector for prompts?
Re: New LLM optimization technique slashes memory costs
#33Re: New LLM optimization technique slashes memory costs
#34[flagged]
Re: New LLM optimization technique slashes memory costs
#35Re: New LLM optimization technique slashes memory costs
#36Re: New LLM optimization technique slashes memory costs
#37[flagged]
Re: New LLM optimization technique slashes memory costs
#38Re: New LLM optimization technique slashes memory costs
#39Earlier quoted context omitted.
Google Trends make it seem like we're out of the exponential growth phase for LLMs-- search interest is possibly plateauing. A decline in search interest outside of academia makes sense. The groups who can get by on APIs don't care so much how the sausage is made and just want to see prices come down. Interested parties have likely already found tools that work for them. There's definitely some academic interest outs…
Or maybe it’s Google Search usage that’s plateauing, as LLM interest is answered elsewhere? I am only half kidding.
Eg tap water is really, really useful and widely deployed. Approximately every household is a user, and that's unlikely to change. But I doubt you'll find much evidence of that in Google Search trends.
Re: New LLM optimization technique slashes memory costs
#40Is it possible that after 3-4 years of performance optimizations, both algorithmic and in hardware efficiency, it will turn out that we didn’t really need all of the nuclear plants we’re currently in the process of setting up to satisfy the power demands of AI data centers?