Earlier quoted context omitted.
I believe Grok is powered by backup generators.
Tesla makes backup generators.
Microsoft is plotting a future without OpenAI
391–400 of 460 posts
Re: Microsoft is plotting a future without OpenAI
#392Earlier quoted context omitted.
Strictly speaking I'm not sure if it does require learning if information representing the updated context is presented. Though it depends what you define as learning. ("You have tried this twice, and it's not working.") is often enough to get even current LLM's to try something else. That said, your second paragraph is one of the best and most succinct ways of pointing out why current LLM's aren't yet close to AGI i…
In context learning, learning via training. Both are things we barely understand the mechanism of. RAG is a basically a perfect example to understand the limits of in context learning and AI in general. It's faults are easier to understand but the same as any AI vs AGI problem. I could go on but CL is a massive gap of our knowledge and likely the only thing missing to AGI.
How? RAG is not even in the field of AI.
Re: Microsoft is plotting a future without OpenAI
#393Earlier quoted context omitted.
ROCM is close to being perfected and I think in few years and some investment you can use it directly to run 99% software written in CUDA with similar performance.
Since 2007 Nvidia has built with CUDA and compatible hardware - a large and growing ecosystem - a massive installed base of backwards compatible hardware - the ability to massively scale delivery of new systems - and lots lots more They now have scale that enables them to continue to invest at a level that no competition can do. None of these are easily reproduced. As per SemiAnalysis AMD in late 2024 can’t get essen…
There are open source projects volunteer run projects[1] that are better than official AMD implementation in many ways.
Re: Microsoft is plotting a future without OpenAI
#394Earlier quoted context omitted.
The go and rust crowds both love writing things in their own language for its own sake. Not because it's a good choice. For a large web backend, go is great. For many other things it's terrible.
Rust is pretty antithetical to resume-driven development because a lot of the stuff that's written in Rust is too well-written and free of the usual kinds of software defects. It immediately becomes "done" and enters low-effort maintenance mode, there's just very little reason to get involved with it anymore since "it just works". Believe it or not, this whole dynamic is behind a lot of the complaints about Rust in t…
Re: Microsoft is plotting a future without OpenAI
#395Earlier quoted context omitted.
> The go and rust crowds both love writing things in their own language for its own sake Hard to take you seriously when you do such weird generalized takes. While it's a sad fact that fanboys and zealots absolutely do exist, most devs can't afford to be such and have to be pragmatic. They pick languages based on merit and analysis.
Most of the people who use Go and Rust do it for pragmatic reasons. That doesn't influence the culture of the zealots in each community. You should search for headlines on HN that say "written in Go" or "written in Rust" and then compare that to the number of headlines that say "written in JavaScript" or "written in Kotlin."
Re: Microsoft is plotting a future without OpenAI
#396Earlier quoted context omitted.
Life is too short to program on languages one doesn't love. Those people, if they really exist, are right.
To be honest, I agree with you, and I think this is the right approach to life if you have a strong preference for languages. I think this only gets a bad name when people aren't upfront about their preferences and skills, with a lot of people having bad experiences with a go zealot at some point.
Rewriting something in Go or Rust and announcing it is not being a Zealot.
Being enthusiastic about something shouldn't be a cause for us to judge them like this. We should be happy about them.
Re: Microsoft is plotting a future without OpenAI
#397Earlier quoted context omitted.
As an outsider looking at Microsoft, I've always been impressed by the attention to maintaining legacy APIs and backward compatibility in the Windows ecosystem. In my mind, Microsoft is at the opposite end of the killedbygoogle.com spectrum. However, none of this is grounded in real evidence (just perception). Red Hat is another company I'd put forth as an example of a long-term support culture, although I don't know…
I don't understand where this idea that Microsoft doesn't kill projects. Zune, Games for Windows Live, Skype, Encarta, CodePlex, Windows Phone, Internet Explorer. https://killedbymicrosoft.info/
Re: Microsoft is plotting a future without OpenAI
#398Earlier quoted context omitted.
good god, lemon
Anyway, why does Microsoft bottleneck itself when it could have 10 different AI teams. That's why 10 new AI startups can achieve what these behemoths can't.
Re: Microsoft is plotting a future without OpenAI
#399Earlier quoted context omitted.
The more senior I get the less opinionated I am. Someone wants to do something in some different or some different way.. why not. In the end the language matters little the tech stack doesn't matter unless you are going down a specific path and even then it probably doesn't matter that much if you have a choice on what to use.
I honestly couldn't disagree more. Having built very similar systems in Golang, Python, and Java in different companies, and having used MongoDB and other NoSQLs as well as Postgres to similar ends, I have very strong preferences about which I'd rather use in the future. Even simple requirements can rule out languages for me. Like, if you need async or concurrency, Python is awful. If you need SQL in your code, Golan…
I might personally love to kick off a greenfield project with Elixir, and it might tick all the technical boxes and meet the requirements. But then I have to pay a premium for senior engineers that know elixir or have to price in the time needed to upskill.
Or I could just do it in Rails where I can dip into a much larger talent pool and still meet the requirements. Much more boring but can get the job done just as well.
Re: Microsoft is plotting a future without OpenAI
#400Earlier quoted context omitted.
Since 2007 Nvidia has built with CUDA and compatible hardware - a large and growing ecosystem - a massive installed base of backwards compatible hardware - the ability to massively scale delivery of new systems - and lots lots more They now have scale that enables them to continue to invest at a level that no competition can do. None of these are easily reproduced. As per SemiAnalysis AMD in late 2024 can’t get essen…
It's hard but not $3T hard. AMD has consistently underinvested in their software. If they invest double digit million to make installation and usage of drivers and ROCM smoother I highly doubt they can't acheive it. There are open source projects volunteer run projects[1] that are better than official AMD implementation in many ways. [1]: https://github.com/CHIP-SPV/chipStar/
ChatGPT was announced Nov 22. The opportunity has been clear for two years and still essential software breaks.