Earlier quoted context omitted.
I have a close friend working in core research teams there. Based on our chats, the secret seems to be (1) massive compute power (2) ridiculous pay to attract top talents from established teams (3) extremelly hard work without big corp bureaucracy.
Anecdotal, but I've gotten three recruiting emails from them now for joining their iOS team. I got on a call and confirmed they were offering FAANG++ comp but with the expectation of in-office 50h+ (realistically more). I don't have that dog in me anymore, but there are plenty of engineers who do and will happily work those hours for 500k USD.
Grok3 Launch [video]
661–670 of 1001 posts
Re: Grok3 Launch [video]
#662Launched where? https://x.com/i/grok just loads Grok 2. I assume it's only accessible from iOS right now?
Re: Grok3 Launch [video]
#663Karpathy gave his initial impression: https://x.com/karpathy/status/1891720635363254772 The pull quote is: The impression overall I got here is that this is somewhere around (OpenAI) o1-pro capability
Naive question from a bystander , but since DeepSeek is open source and is on par with o1-pro (is it?), shouldn't we expect that anybody with the computer power is capable to compete with o1-pro?
Re: Grok3 Launch [video]
#664Re: Grok3 Launch [video]
#665Earlier quoted context omitted.
I'm not sure how LLMs/AI couldn't consolidate power. By design, it will move power from the individual to those running the AI systems.
Because the difference between a model that costs 10 million to train and a model that costs 10 billion to train is 6 months. Deepseek R1 is something that you can run in a garage on hardware that the average software engineer can buy with a months salary and when it came out last month it was better than _every_ other model.
Depending on the curve we’re on, LLMs may grow more resource hungry while becoming closer to human performance in software engineering tasks. It’s not unimaginable this would concentrate productivity in the upper class of software engineers that can afford the hardware and/or licenses.
Re: Grok3 Launch [video]
#666The story about how they made this happen in such a short period is impressive to say the least. Elon’s strength seems to be making things happen. Getting the largest computer cluster in the world up and running in a matter of months? Unbelievable.
Re: Grok3 Launch [video]
#667It blows my mind that Musk hasn't integrated Grok as an app inside their vehicles. A literal AI copilot is a completely novel and killer app that cannot be pulled off by any other vehicle manufacturer.
Getting them to actually do something useful other than generating text is still a work in progress. What do you envision them actually doing in this integration?
Re: Grok3 Launch [video]
#668Re: Grok3 Launch [video]
#669Maybe the best outcome of a competitive Grok is breaking the mindshare stranglehold that ChatGPT has on the public at large and with HN. There are many good frontier models that are all very close in capabilities.
Re: Grok3 Launch [video]
#670It blows my mind that Musk hasn't integrated Grok as an app inside their vehicles. A literal AI copilot is a completely novel and killer app that cannot be pulled off by any other vehicle manufacturer.