I think something that doesn't get said enough is Meta did, albeit intentionally kick off the origin of the open source race back in 2023 with the release of llama. I'm not a big fan of meta in general, but they've done enough good, and it's possible that it was intentional as well. I don't know, I wasn't in the rooms, and I think it's worth giving them some reasonable doubt. No one is purely good, and no one is pure…
Mark Zuckerberg attacks 'closed' AI rivals as Meta returns to open models
481–490 of 623 posts
Re: Mark Zuckerberg attacks 'closed' AI rivals as Meta returns to open models
#482My favorite paragraph from Zuckerberg's writeup: """ [...] it is surprising that the discourse from many developing AI is so filled with doom. I do not understand why anyone who believes that AI will eliminate most jobs and much of humanity's relevance would rush to build that future. The notion that AI is so dangerous that the only safe path is an extreme concentration of power seems inherently problematic. Historic…
Am I the only one getting the impression this dude was merely lucky back in the day, in fact at the right time, rather than having been super intelligent nor forward thinking… ? I mean - given all his throw outs in media and his apparent burn of nearly 80bn for a failed 3D world?
Re: Mark Zuckerberg attacks 'closed' AI rivals as Meta returns to open models
#483U-turn when meta finds an inconvenience due to open weights in 3… 2… … …
--------
[1] reduced advertising revenues due to not being able to target based on message traffic, and reduced data scraped for training purposes
[2] and possibly in part due to behind-the-scenes pushback from government/police/other interests?
Re: Mark Zuckerberg attacks 'closed' AI rivals as Meta returns to open models
#484I think something that doesn't get said enough is Meta did, albeit intentionally kick off the origin of the open source race back in 2023 with the release of llama. I'm not a big fan of meta in general, but they've done enough good, and it's possible that it was intentional as well. I don't know, I wasn't in the rooms, and I think it's worth giving them some reasonable doubt. No one is purely good, and no one is pure…
Disclaimer, I work on Gemma and open models at Deepmind and the opinions here are my own There were open models from EleutherAI (GPT-Neo), Google Brain (T5X, Bert), and HuggingFace was promoting open models (and others doing open work I haven't listed here) all prior to 2023 and the big Chatgpt moment. https://github.com/EleutherAI/gpt-neo/releases https://github.com/google-research/bert https://github.com/google-res…
Re: Mark Zuckerberg attacks 'closed' AI rivals as Meta returns to open models
#485Earlier quoted context omitted.
Words mean what people use them to mean. Ship has sailed whether you approve or not.
Yup. An extremist wing of the FOSS movement ceded the debate early on by trying to insist open source required full access to the training data. Philosophically, not wrong. But practically fucked, so the word evolved. Within tech circles, open weight != open source. Outside them, they’re synonyms.
Re: Mark Zuckerberg attacks 'closed' AI rivals as Meta returns to open models
#486Earlier quoted context omitted.
Disclaimer, I work on Gemma and open models at Deepmind and the opinions here are my own There were open models from EleutherAI (GPT-Neo), Google Brain (T5X, Bert), and HuggingFace was promoting open models (and others doing open work I haven't listed here) all prior to 2023 and the big Chatgpt moment. https://github.com/EleutherAI/gpt-neo/releases https://github.com/google-research/bert https://github.com/google-res…
Hey, with the changes at Deepmind, is the Gemma project still ongoing?
Re: Mark Zuckerberg attacks 'closed' AI rivals as Meta returns to open models
#487Earlier quoted context omitted.
I don’t understand how you can look at what’s happening right now and call people simply calling for caution “hysterical”
Did you know that if trains or cars go over 30 mph, it's disastrous for public health? Not from accidents. Just trauma from (ahem) acceleration: https://illuminatingfacts.com/the-train-speed-panic-why-peop... Reason that hysteria remains apropos now is that then, and now, we're figuring out how to deal with something beyond merely incremental change. Irony is roads and sidewalks should have changed much more. We neve…
On the other hand some kinds of hysteria occurs due to a divide between the public and subject matter experts on topics. Kind of like Dunning Kruger. Take for example the people saying 5G causes cancer. Then there are people who blanket dismiss their worries, because "it's non ionizing you dummy". Given sufficient power you can still fry someone with non ionizing radiation, for example in radio broadcasts. Of course a regular 5g antenna can't put out that kind of power but my point is that people too quickly raise or dismiss concerns without actually critically examining the entire topic. This will likely worsen from specialization and progress in all fields and regular Joes get left further and further behind.
Re: Mark Zuckerberg attacks 'closed' AI rivals as Meta returns to open models
#488Earlier quoted context omitted.
Still say Matrix 3 would have been better if the cliffhanger at the end of 2 had been that "the real world" was just another nested layer of the Matrix for those who rejected the primary fiction. I mean, why bother sending an army like that when one tiny robot could carry in a plague? Or, as demonstrated by Smith, when an Agent can virally infect and take over someone's mind while they're connected? Even in 1, Smith…
I think Matrix 3 would have been better if it was more about humans taking control of the Matrix and trying to figure out what a virtual utopia looks like.
But in The Animatrix, you could get away with that, plus we can see the early attempts at utopia that Smith described. Perhaps something about how utopia for some people didn't work for others could be illustrated with an auto-antonym on some load-bearing part of the dystopic-utopia?:
Some believed we lacked the programming language to describe your perfect world.
We can see this even in current discussions of fiction, where people look at e.g. The Culture and see a dystopia, while famously many of the powerful in tech are parodied for taking the wrong lessons from fiction with "At long last, we have created the Torment Nexus from classic sci-fi novel Don't Create The Torment Nexus".Re: Mark Zuckerberg attacks 'closed' AI rivals as Meta returns to open models
#489Earlier quoted context omitted.
Disclaimer, I work on Gemma and open models at Deepmind and the opinions here are my own There were open models from EleutherAI (GPT-Neo), Google Brain (T5X, Bert), and HuggingFace was promoting open models (and others doing open work I haven't listed here) all prior to 2023 and the big Chatgpt moment. https://github.com/EleutherAI/gpt-neo/releases https://github.com/google-research/bert https://github.com/google-res…
Hey, with the changes at Deepmind, is the Gemma project still ongoing?
I'm just beginning to enjoy the release of Gemma E4B why are you giving me a cold shower here telling me there may be no Gemma 5?
Here's hoping the supreme leader of the US does a speech like Chairman Xi.
Re: Mark Zuckerberg attacks 'closed' AI rivals as Meta returns to open models
#490Earlier quoted context omitted.
Am I the only one getting the impression this dude was merely lucky back in the day, in fact at the right time, rather than having been super intelligent nor forward thinking… ? I mean - given all his throw outs in media and his apparent burn of nearly 80bn for a failed 3D world?
I mean, of course it was a matter of being at the right place and right time, and being able to execute. He definitely was lucky but that alone isn't enough