Live data from Hacker News

Performance per dollar is getting faster and cheaper

wafer.ai

11–20 of 151 posts

Re: Performance per dollar is getting faster and cheaper

#11
post #4

Agentic coding drivers for different architectures is a massive unlock for the world So much compute is under utilized waiting for a savant or company to prioritize an architecture, and now all the other engineers can tackle this at any time if they get inspired on the right prompts

Personally, I can't wait till something like this starts getting to consumer level. https://www.anuragk.com/blog/posts/Taalas.html

Re: Performance per dollar is getting faster and cheaper

#13
post #2

Can you folks add performance per watt as a metric to these comparisons, I honestly want to understand where AMD fits in the stack in terms of actual performance to dollars. I have had talks with companies wanting to build data centers outside of US and find it hard to source anything Nvidia in sufficient capacity and scale. If AMD is competitive performance per watt and roughly reliable in terms of software support…

AMD MI355X uses 1,400W per GPU and NVIDIA B200 uses 1,200W. So AMD uses about 16% more power.

Re: Performance per dollar is getting faster and cheaper

#14
post #4

Agentic coding drivers for different architectures is a massive unlock for the world So much compute is under utilized waiting for a savant or company to prioritize an architecture, and now all the other engineers can tackle this at any time if they get inspired on the right prompts

this is exactly our thesis at wafer :) thank you for the support

Re: Performance per dollar is getting faster and cheaper

#15
post #11
post #4

Agentic coding drivers for different architectures is a massive unlock for the world So much compute is under utilized waiting for a savant or company to prioritize an architecture, and now all the other engineers can tackle this at any time if they get inspired on the right prompts

Personally, I can't wait till something like this starts getting to consumer level. https://www.anuragk.com/blog/posts/Taalas.html

That’s pretty fascinating, Apple has some innocuous LLMs and transformers baked into its devices and leveraging their neural chipset

So I could see something like this where the neural chipset has an LLM that cant be so easily updated baked into it, until you get a new device

Re: Performance per dollar is getting faster and cheaper

#16
post #2

Can you folks add performance per watt as a metric to these comparisons, I honestly want to understand where AMD fits in the stack in terms of actual performance to dollars. I have had talks with companies wanting to build data centers outside of US and find it hard to source anything Nvidia in sufficient capacity and scale. If AMD is competitive performance per watt and roughly reliable in terms of software support…

AMD MI355X uses 1,400W per GPU and NVIDIA B200 uses 1,200W. So AMD uses about 16% more power.

Not how you measure performance per watt but generally it’s 20-60% worse at tok/s/watt not 16. It does have ~50% more memory (~100gb) which complicates the comparison.

Re: Performance per dollar is getting faster and cheaper

#17
post #2

Can you folks add performance per watt as a metric to these comparisons, I honestly want to understand where AMD fits in the stack in terms of actual performance to dollars. I have had talks with companies wanting to build data centers outside of US and find it hard to source anything Nvidia in sufficient capacity and scale. If AMD is competitive performance per watt and roughly reliable in terms of software support…

> I have never seen a company use AMD Meta is using AMD: https://www.amd.com/en/newsroom/press-releases/2026-2-24-amd... And OpenAI: https://www.amd.com/en/newsroom/press-releases/2025-10-6-amd...

It's not clear when this will be - AMD has slipped these dates likely to 2027.
Post reply on HN