Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

New LLM optimization technique slashes memory costs

venturebeat.com

Post reply on HN
Print view View original

211–220 of 227 posts

Re: New LLM optimization technique slashes memory costs

#211

Post by ViewTrick1002 »

exe34 wrote: post #210
portaouflop wrote: post #207

Earlier quoted context omitted.

I genuinely don’t understand why you think nuclear is a viable alternative. You agree it costs more, is less flexible, takes longer to be operational than renewable energies. You didn’t present any good argument for nuclear except “something something you don’t like my politics” I agree with GP that nuclear is often used as a smokescreen to delay doing __anything__ practical and instead keep burning coal etc

in practice, 20 years of walking away from nuclear meant that Germany brought coal-fired stations back last year. I'm sure renewables will stop it happening again in 20 years _this time_.

Not sure why this misinformation keeps being repeated?

Since the nuclear phase out began both coal and nuclear is down replaced by renewables. Fossil gas is stable.

https://ourworldindata.org/grapher/share-elec-by-source?time...

Germany brought a few coal plants out mothball to prevent the collapse of the French grid when half the French nuclear fleet was off line at the height of the energy crisis.

Which then were promptly mothballed again when the French got their nuclear power under control.

https://www.nytimes.com/2022/11/15/business/nuclear-power-fr...

But lets blame the French nuclear power not delivering on Germany. That makes total sense.

Re: New LLM optimization technique slashes memory costs

#212

Post by Eisenstein »

portaouflop wrote: post #207
Eisenstein wrote: post #202

Earlier quoted context omitted.

I agreed that it costs more and read the study you linked. You are having a hard time accepting that some people might have a different opinion than you and are taking it like they are being obstinate. Sorry it costs more, but I don't think we need to be uniformly opposed to a viable option due to cost.

I genuinely don’t understand why you think nuclear is a viable alternative. You agree it costs more, is less flexible, takes longer to be operational than renewable energies. You didn’t present any good argument for nuclear except “something something you don’t like my politics” I agree with GP that nuclear is often used as a smokescreen to delay doing __anything__ practical and instead keep burning coal etc

I'm not making this political, I said that the politics are irrelevant. I am not advocating for more nuclear -- I am advocating keeping options on the table regardless of politics or cost, because the issue is important to the progress of our species and condensing things down by referencing single studies and talking points is short-sighted -- we have been down that road, it didn't work, let's not bind our hands needlessly.

Re: New LLM optimization technique slashes memory costs

#213

Post by pizza »

h0l0cube wrote: post #208
pizza wrote: post #79

Earlier quoted context omitted.

Would you like that with or without tokens?

Go ask ChatGPT how to make a room temperature superconductor

Ok, done. I can report to you that it helped me cut down my personal search space. Imagine what such a tool could do in the hands of a subject matter expert with rudimentary critical thinking ability and the faintest hint of a grasp of using the scientific method to verify claims, wow..

Re: New LLM optimization technique slashes memory costs

#214

Post by exe34 »

ViewTrick1002 wrote: post #211
exe34 wrote: post #210

Earlier quoted context omitted.

in practice, 20 years of walking away from nuclear meant that Germany brought coal-fired stations back last year. I'm sure renewables will stop it happening again in 20 years _this time_.

Not sure why this misinformation keeps being repeated? Since the nuclear phase out began both coal and nuclear is down replaced by renewables. Fossil gas is stable. https://ourworldindata.org/grapher/share-elec-by-source?time... Germany brought a few coal plants out mothball to prevent the collapse of the French grid when half the French nuclear fleet was off line at the height of the energy crisis. Which then were p…

do you expect renewables to be more consistent than nuclear?

it sounds like they turned off coal to go back to nuclear after all...

Re: New LLM optimization technique slashes memory costs

#215

Post by oblio »

eru wrote: post #203
oblio wrote: post #133

Earlier quoted context omitted.

Nobody wants to lose money (savings) or go bankrupt because of hallucinations.

That's one small part of finance. (And essentially solved mechanically with index funds.) There's a lot more to finance outside of that.

At the end of the day, the hard limit in finance is defaulting. Everything outside that is financial poetry (or engineering :-p).

I know every segment of finance loves to pretend that's not the case, because their jobs (and high salaries) frequently rely on that not being true (see the subprime mortgage crisis).

Re: New LLM optimization technique slashes memory costs

#216

Post by portaouflop »

exe34 wrote: post #214
ViewTrick1002 wrote: post #211

Earlier quoted context omitted.

Not sure why this misinformation keeps being repeated? Since the nuclear phase out began both coal and nuclear is down replaced by renewables. Fossil gas is stable. https://ourworldindata.org/grapher/share-elec-by-source?time... Germany brought a few coal plants out mothball to prevent the collapse of the French grid when half the French nuclear fleet was off line at the height of the energy crisis. Which then were p…

do you expect renewables to be more consistent than nuclear? it sounds like they turned off coal to go back to nuclear after all...

What answer do you expect here?

This is not something you can answer clearly, no one can.

I personally would say since renewables (there are many different types of renewable energy sources btw) are so much cheaper and easier to build they are more consistent.

France for example has really shitty nuclear plants that have been falling apart since the 90s - they are not reliable and fixing them is not feasible

Re: New LLM optimization technique slashes memory costs

#217

Post by sobani »

adelpozo wrote: post #173
cratermoon wrote: post #167

Earlier quoted context omitted.

Space-based solar power contains little intrinsic advantage that we can get “only from space.” It looks like a wash at best, and the astronomers would say “don’t bother.” https://dothemath.ucsd.edu/2012/03/space-based-solar-power/

Yeah, but what I found thought provoking is what if you send the solar panels and the datacenter as well for training. No need to transmission of power down to earth. I guess then it becomes a heat dissipation and hardware upgrade and maintenance. But again, thought provoking.

Heat dissipation becomes a _huge_ problem when you deploy a data center inside a perfect insulator, the vacuum of space.

Currently about a third of the energy consumption of a data center spent on cooling (heat dissipation)? And that's with the use of a huge heat sink, the earth.

Re: New LLM optimization technique slashes memory costs

#218

Post by guerrilla »

baq wrote: post #83
K0balt wrote: post #25

Earlier quoted context omitted.

Finance is basically all of the reasons not to use (generative, LLM based) AI , all in one vertical. The poster child of determinism.

Finance is all in on reading 10-Ks and generating summaries. If you have decisions in mind, I’ll be referring to IBM 1979 slide until an HR LLM fires me.

That's not finance, that's just a generic application, and I think it's a terrible idea that won't last anyway.

Re: New LLM optimization technique slashes memory costs

#219

Post by exe34 »

portaouflop wrote: post #216
exe34 wrote: post #214

Earlier quoted context omitted.

do you expect renewables to be more consistent than nuclear? it sounds like they turned off coal to go back to nuclear after all...

What answer do you expect here? This is not something you can answer clearly, no one can. I personally would say since renewables (there are many different types of renewable energy sources btw) are so much cheaper and easier to build they are more consistent. France for example has really shitty nuclear plants that have been falling apart since the 90s - they are not reliable and fixing them is not feasible

the correct answer is no. solar doesn't work very well at night. wind isn't always blowing.

Re: New LLM optimization technique slashes memory costs

#220

Post by h0l0cube »

pizza wrote: post #213
h0l0cube wrote: post #208

Earlier quoted context omitted.

Go ask ChatGPT how to make a room temperature superconductor

Ok, done. I can report to you that it helped me cut down my personal search space. Imagine what such a tool could do in the hands of a subject matter expert with rudimentary critical thinking ability and the faintest hint of a grasp of using the scientific method to verify claims, wow..

> Imagine what such a tool could do in the hands of a subject matter expert

Nothing. Because LLMs can’t spit out anything more than the corpus of information they’ve consumed. LLMs aren’t AGI.

Post reply on HN