I don’t like most thing FB/Meta does. But, I must admit they are the only big tech sharing so much openly. Other big tech should take Meta as an example here.
I thought I’d never say this : good job Zuck on AI!
Meta Llama 3
411–420 of 965 posts
Re: Meta Llama 3
#412I just want to express how grateful I am that Zuck and Yann and the rest of the Meta team have adopted an open approach and are sharing the model weights, the tokenizer, information about the training data, etc. They, more than anyone else, are responsible for the explosion of open research and improvement that has happened with things like llama.cpp that now allow you to run quite decent models locally on consumer h…
Call me cynical, but it was the only way not to be outplayed by OpenAI and to compete with Google, etc.
100%. It was the only real play they had.
Re: Meta Llama 3
#413Earlier quoted context omitted.
Why is Meta doing it though? This is an astronomical investment. What do they gain from it?
It’s a shame it can’t just be giving back to the community and not questioned. Why is selfishness from companies who’ve benefited from social resources not a surprising event vs the norm.
If it was Wikipedia doing this, sure, assume the best.
Re: Meta Llama 3
#414There’s a trillion dollars waiting for whoever can figure out how to put a terabyte of VRAM on a GPU.
Re: Meta Llama 3
#415Earlier quoted context omitted.
His engineering mindset made him blind to the fact the metaverse was a product that nobody wanted or needed. In one of the Fridman interviews, he goes on and on about all the cool technical challenges involved in making the metaverse work. But when Fridman asked him what he likes to do in his spare time, it was all things that you could precisely not do in the metaverse. It was baffling to me that he failed to connec…
I don't think that was the issue. VRChat was basically the same idea but done in a more appealing way and it was (still is) wildly popular.
All the work Meta has put in is still being felt in the VR space. Besides Valve they are the only ones pushing an open ecosystem.
Re: Meta Llama 3
#416Just added Llama 3 70B to Chat at https://double.bot if anyone wants to try it for coding. Free for your first 50 messages and will push Llama 3 8B for autocomplete later this afternoon.
From my early tests this seems like the first API alternative to GPT4 / Opus. Huge!
Re: Meta Llama 3
#417Earlier quoted context omitted.
Depends on your size threshhold. For anything beyond 100 bn in market cap certainly. There is some relatively large companies with a similar flair though, like Cohere and obviously Mistral.
Well, they're not AI companies, necessarily, or at least not only AI companies, but the big hardware firms tend to have engineers at the helm. That includes Nvidia, AMD, and Intel. (Counterpoint: Apple)
Counter counter point: apples hardware division has been doing great work in the last 5 years, it’s their software that seems to have gone off the rails (in my opinion).
Re: Meta Llama 3
#418Earlier quoted context omitted.
EU actually has the opposite of draconian privacy laws. It's more that meta doesn't have a business model if they don't intrude on your privacy
Well, exactly, and that's why IMO they'll end up pulling out the EU. There's barely any money in non-targeted ads.
If by "barely any money", you mean "all the businesses in the EU will still give you all their money as long as you've got eyeballs", then yes.
Re: Meta Llama 3
#419Earlier quoted context omitted.
I recall there was a website tracking the ideological bias of LLMs, but I can’t find it now. But it was showing where all the LLMs rank on a political graph with four quadrants. I think we need something like that, ranking these LLMs on aspects like censorship. Example: https://www.technologyreview.com/2023/08/07/1077324/ai-langu... But I think some other site was doing this ‘live’ and adding more models as they appe…
Do you mean this? https://trackingai.org/
Yes, that is exactly what I was thinking of. Thank you.