Live data from Hacker News

Grok3 Launch [video]

x.com

211–220 of 1001 posts

Re: Grok3 Launch [video]

#211

I don't understand how and why Grok would be related to "understanding the nature of the universe", as Musk puts it. Please correct me if I'm wrong, but they basically just burned more cash than any human should have to buy Nvidia GPUs and make them predict natural language, right? So, they are somewhat on-par with all the other companies that did the same. This is not innovation, this is baseless hype over a mediocr…

Musk promises revolution and sells evolution.

Promises FSD, sells EVs.

Promises Mars colony, sells self landing rockets and sattelite internet.

Promises faster tunnel boring, sells smaller tunnel boring machine that drills smaller tunnels.

Promises less corruption and bureaucracy, just fires people.

Re: Grok3 Launch [video]

#212
post #180

I don't understand how and why Grok would be related to "understanding the nature of the universe", as Musk puts it. Please correct me if I'm wrong, but they basically just burned more cash than any human should have to buy Nvidia GPUs and make them predict natural language, right? So, they are somewhat on-par with all the other companies that did the same. This is not innovation, this is baseless hype over a mediocr…

You don’t understand the Musk business model. It has been the same for years. His wealth doesn’t come from his products, but from his fanbase buying his stock. The purpose of everything he does is to influence the public opinion to make him the tech genius of today in the collective psyche. Of course, he needs to do impressive things, stuff that a normal person wouldn’t have the resources to achieve. It’s similar to…

I'm interested in what you're saying about classical business terms. Can you elaborate on that a little? I've always found these kinds of people hard to understand.

The man has almost unlimited wealth and his motivations seem consistently petty and strange or just downright ludicrous. He's like an alien to me.

I've noted the same feeling when seeing VCs/business people speak when I've encountered them.

Re: Grok3 Launch [video]

#213
post #94
post #81

Earlier quoted context omitted.

It was mentioned during the launch that current datacenter requires up to 0.25 gigawatts of power. The datacenter they're currently building will require 1.25 (5x) (for reference, a nuclear powerplant might output about 1 gigawatt). Will be interesting to see if the relationship between power/compute/parameters and performance is exponential, logarithmic or something more linear.

It's logarithmic. Meaning you scale compute exponentially to get linearly better models. However there is a big premium in having the best model because of low switching costs of workloads, creating all sorts of interesting threshold effects.

Linear in what metric?

Re: Grok3 Launch [video]

#214

Off topic, but just in case: is there a good reference on how people actually use LLMs on a daily basis ? All my attempts so far have been pretty underwhelming: * when I use chatbots as search engines, I'm very quickly disappointed by obvious hallucinations * I ended up disabling github copilot because it was just "auto-complete on steroids" at best, and "auto-complete on mushrooms" at worst * I rarely have use cases…

These probably aren't tasks you need done but;

LLMs are pretty good at translation between human languages which makes sense since they are language models after all. They are better at this any any other technology.

The state of the art image ones can also probably do OCR and handwriting recognition better than any other software though may be expensive to run in large volume. But if you need to take picture of a notebook page with your camera phone an LLM can quickly OCR it.

Re: Grok3 Launch [video]

#216

Off topic, but just in case: is there a good reference on how people actually use LLMs on a daily basis ? All my attempts so far have been pretty underwhelming: * when I use chatbots as search engines, I'm very quickly disappointed by obvious hallucinations * I ended up disabling github copilot because it was just "auto-complete on steroids" at best, and "auto-complete on mushrooms" at worst * I rarely have use cases…

Here's some things I have in my chatgpt history:

- Discussing the various stages of candymaking and their relation to the fundamental properties of sugar syrups, and which candies are crystalline vs amorphous. It turns out junior mints are fudge. Fondant is really just fudge. Everything is fudge, my god.

- Summarizing various SEC filings and related paperwork to understand the implications of an activist investor intervening in a company

- Discussing the relative film merits of the movie Labyrinth and other similar 80s kitsch movies. ChatGPT mentioned the phenomenon of "twin films" which was an interesting digression.

- Learning about various languages Tolkien invented and their ties to actual linguistics of natural languages and other conlangs

- Some dimensional analysis of volumes, specifically relating to things like "how many beans are in the jar" estimation and what the min and max of a particular weight of coins might be valued, in terms of both a par value based on a standard coin mix and outliers of, for example, old dimes that are pure silver.

- Discussion of quines in prolog and other languages, which resulted in a very interesting ChatGPT bug where it started recursing and broke when trying to write a prolog quine.

- Back of the envelope economic calculations around the magnitude of the housing deficit and the relative GDP cost for providing enough housing quickly enough to make an impact. Spoiler: it's probably unreasonably expensive to build enough houses to bring down housing prices by any significant degree, and even if we wanted to, there's not enough skilled workers.

- A number of podcasts transcribed. (I hate audio and meandering, so transcribed and summarized is perfect) I could use whisper and a python script to do this, but I'd rather let ChatGPT do the legwork, and it actually used a more modern model and method of processing than I would have naively used.

I find Github Copilot to be a really great autocomplete. I frequently write the comment at the top of a function and hit tab and it writes the whole function. This is dependent on typescript and having a relatively standard codebase but I think those things are useful on their own. You really have to limit it in terms of scope and specifics, but it lets me think high level instead of worrying about syntax.

Re: Grok3 Launch [video]

#217

Companies have hijacked the open source concept to mean downloadable blob and we follow them as I see in the comments. It’s a real shame.

I remember the NVIDIA Linux kernel binary blob driver discussions from the early-mid 2000s. Who knew we had an open source driver all along...

Something isn’t open-source because you get everything that went into making it. Something is open-source if you can change it (relatively) easily. The GPL and open-source definition both refer to “the preferred form for making modifications”. The preferred form for modification in the Nvidia driver’s case is the source code. The preferred form for modification in this case is the weights.

Open-source as a concept doesn’t really correspond well with LLMs but to the extent that it does, access to the training data is not required because that training data is not the preferred form for making modifications.

Re: Grok3 Launch [video]

#218

I don't understand how and why Grok would be related to "understanding the nature of the universe", as Musk puts it. Please correct me if I'm wrong, but they basically just burned more cash than any human should have to buy Nvidia GPUs and make them predict natural language, right? So, they are somewhat on-par with all the other companies that did the same. This is not innovation, this is baseless hype over a mediocr…

I absolutely hate the Elon hypetrain, but I also don't understand the social media hate I see for AI, like comparing every ChatGPT answer to one wasted bottle of water.

Can we stop for a second and just marvel at a new piece of human ingenuity? Let's not give Elon too much credit, but I think that AI as a whole helps us all understand the nature of intelligence, and therefore humans' place in the universe.

One of the fundamental questions of human existence is: what does it mean to exist and think? Every time we build a new human-like thing it helps us understand the context of our own existence. (Not just computers or AI, but also airplanes, factories, etc.)

True AGI would force us to rethink what it means to be a thinking human being, and I think current LLMs already should and do.

Re: Grok3 Launch [video]

#219

Off topic, but just in case: is there a good reference on how people actually use LLMs on a daily basis ? All my attempts so far have been pretty underwhelming: * when I use chatbots as search engines, I'm very quickly disappointed by obvious hallucinations * I ended up disabling github copilot because it was just "auto-complete on steroids" at best, and "auto-complete on mushrooms" at worst * I rarely have use cases…

My wife has found ChatGPT extremely useful when dealing with her mother - who has bipolar and is obsessed with other people's health. I've got a terminal cancer diagnosis and handling my mother-in-law has been extremely difficult - nearly to the point of no longer having any communication with her. ChatGPT has a single conversation with all the back story and has put some useful points across when discussing how difficult her behaviour has been (she watched a operation that failed for me for entertainment, for instance).

I have found similar when giving backstory and needing help to start structuring difficult conversations where I want to say the right thing but also need to be sensitive.

Re: Grok3 Launch [video]

#220
post #194
post #180

Earlier quoted context omitted.

You don’t understand the Musk business model. It has been the same for years. His wealth doesn’t come from his products, but from his fanbase buying his stock. The purpose of everything he does is to influence the public opinion to make him the tech genius of today in the collective psyche. Of course, he needs to do impressive things, stuff that a normal person wouldn’t have the resources to achieve. It’s similar to…

> His profits don’t come from his products, but from his fanbase buying his stock. SpaceX is private, Starlink makes real money from real users. > Everything he does is done to influence the public opinion to make him the tech genius of today in the collective psyche. Well that's clearly not right. He's doing a lot of things to make himself seem like a total tool that we should all boycott no matter how good the prod…

The bulk of his wealth is the Tesla stock. I know that SpaceX produces value. Some of his ventures do. But the image of a genius entrepreneur is way more valuable than any government contract he might get.

Remember he was way less crazy before his market cap skyrocketed. Now he can afford being polarizing as a PR strategy once his fanbase has reached a certain critical mass. He’s been constantly testing what works.

Post reply on HN