Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Open source AI is the path forward

about.fb.com

Post reply on HN
Print view View original

1–10 of 936 posts

Re: Open source AI is the path forward

#2

Post by amusingimpala75 »

Sure but under what license? Because slapping “open source” on the model doesn’t make it open source if it’s not actually license that way. The 3.1 license still contains their non-commercial clause (over 700m users) and requires derivatives, whether fine tunings or trained on generated data, to use the llama name.

Re: Open source AI is the path forward

#5

Post by kart23 »

> This is how we’ve managed security on our social networks – our more robust AI systems identify and stop threats from less sophisticated actors who often use smaller scale AI systems.

Ok, first of all, has this really worked? AI moderators still can't capture the mass of obvious spam/bots on all their platforms, threads included. Second, AI detection doesn't work, and with how much better the systems are getting, it's probably never going to, unless you keep the best models for yourself, and it's is clear from the rest of the note that its not zuck's intention to do so.

> As long as everyone has access to similar generations of models – which open source promotes – then governments and institutions with more compute resources will be able to check bad actors with less compute.

This just doesn't make sense. How are you going to prevent AI spam, AI deepfakes from causing harm with more compute? What are you gonna do with more compute about nonconsensual deepfakes? People are already using AI to bypass identity verification on your social media networks, and pump out loads of spam.

Re: Open source AI is the path forward

#6

Post by blackeyeblitzar »

Only if it is truly open source (open data sets, transparent curation/moderation/censorship of data sets, open training source code, open evaluation suites, and an OSI approved open source license).

Open weights (and open inference code) is NOT open source, but just some weak open washing marketing.

The model that comes closest to being TRULY open is AI2’s OLMo. See their blog post on their approach:

https://blog.allenai.org/hello-olmo-a-truly-open-llm-43f7e73...

I think the only thing they’re not open about is how they’ve curated/censored their “Dolma” training data set, as I don’t think they explicitly share each decision made or the original uncensored dataset:

https://blog.allenai.org/dolma-3-trillion-tokens-open-llm-co...

By the way, OSI is working on defining open source for AI. They post weekly updates to their blog. Example:

https://opensource.org/blog/open-source-ai-definition-weekly...

Re: Open source AI is the path forward

#7

Post by JumpCrisscross »

“The Heavy Press Program was a Cold War-era program of the United States Air Force to build the largest forging presses and extrusion presses in the world.” This ”program began in 1944 and concluded in 1957 after construction of four forging presses and six extruders, at an overall cost of $279 million. Six of them are still in operation today, manufacturing structural parts for military and commercial aircraft” [1].

$279mm in 1957 dollars is about $3.2bn today [2]. A public cluster of GPUs provided for free to American universities, companies and non-profits might not be a bad idea.

[1] https://en.m.wikipedia.org/wiki/Heavy_Press_Program

[2] https://data.bls.gov/cgi-bin/cpicalc.pl?cost1=279&year1=1957...

Re: Open source AI is the path forward

#9

Post by ldjkfkdsjnv »

On every post like this on hacker news, I post my pro meta speech. My opinion has always been the same:

1. Meta pushed engineering wages higher across the industry.

2. They promote high performing engineers very quickly. There are engineers making 7 figures there with just a few years experience.

3. They have open sourced the most important frameworks: React and Pytorch

This company is a guiding light forcing the hand of other large corporations. Mark Zuckerberg is a hero, and has done a fantastic job

Post reply on HN