201–210 of 362 posts
> He tells me that, by the end of this year, Meta will own more than 340,000 of Nvidia’s H100 GPUs That's approx $15b worth of H100 GPUs.
How much does one need to go after crypto currencies vulnerable to a 51% attack?
Can someone provide insight into why there's so much insistence from business that magic happens at scale with LLMs? We're a long way from AGI. The lack of meaningful details in these announcements makes me pessimistic.
LLM scaling laws are pretty well established at this point. They probably won’t hold forever but we aren’t at the breaking point yet. Some more pressing questions are: * What new capabilities emerge as the models get better and better at predicting (i.e. loss goes down)? * How much will it cost to train increasingly large models? And to run inference on them? * How difficult will it be to find or generate more and mo…
what are they then? I thought everyone was firmly in the "let's train with more data and see what happens" camp
Is it even possible to build an AGI with our current computing paradigms? So far our most advanced neural networks are purpose-built for a task (i.e. ChatGPT for text communication, Dall-E for images).
Whatever happened to replacing the US dollar, or creating a metaverse, or curing disease in his children's lifetime? The guy has all the focus of a disco ball.
Earlier quoted context omitted.
At some point Google Cloud, AWS, Alibaba Cloud, Apple, etc are going to make their own specialized chips (Google tried a bit with their tensors chip). There is no value into the NVIDIA-part by itself, only the raw power is interesting. If tomorrow this is AMD, or China-Town chip, it's perfectly fine. I wouldn't miss the CUDA toolkit mess.
If raw power per dollar would be all that's interesting we'd all run 7900 XTX clusters like geohot in his tinybox. We are not, because there's clearly value in the CUDA ecosystem.
Sane business people will look to decentralize their compute over time and not be reliant on a single provider. AMD will be able to take advantage of that and they've already stated that is their focus going forward.
ROCm/HIP are getting incrementally better, MI300x have 192GB and benchmarks are looking good, the only problem is that nobody has access to the higher end hardware from AMD today. That's why I'll have MI300x, for rent, soon.
> He tells me that, by the end of this year, Meta will own more than 340,000 of Nvidia’s H100 GPUs That's approx $15b worth of H100 GPUs.
How much does one need to go after crypto currencies vulnerable to a 51% attack?
Earlier quoted context omitted.
I am a general intelligence, with the knowledge of the internet at my fingertips, and I am not particularly dangerous.
Perhaps the primary barrier between a person’s desire and their ability to do harm to the world is their need to bring other people in on the scheme. These other people have their own moral systems, incentives, preferences, and priorities. But through most of history, to do massive scale harm you had to convince a large number of people to your evil purpose. Technology in general reduces the number of people an indiv…
I'm sure we'll come up with solutions like we did before. Worst case, "present birth certificate and touch heartbeat detector to log in"
Whatever happened to replacing the US dollar, or creating a metaverse, or curing disease in his children's lifetime? The guy has all the focus of a disco ball.
Whatever happened to replacing the US dollar, or creating a metaverse, or curing disease in his children's lifetime? The guy has all the focus of a disco ball.
AGI could potentially do all of these things
The actual quote: > "Our long term vision is to build general intelligence, open source it responsibly, and make it widely available so everyone can benefit." "responsibly" is a pretty important word there that the hn title leaves out. I'm not really sure how that would be possible with a true general intelligence give the alignment problem - it's not really clear to me there's any responsible way to build a true gen…
I am a general intelligence, with the knowledge of the internet at my fingertips, and I am not particularly dangerous.