Is there a getting started with 8Gb VRAM for dummies doc somewhere?
Llama 2
741–750 of 860 posts
Re: Llama 2
#742What is the best way in terms of price/convenience ratio to run the 70B model on the cloud? Are there any providers offering out-of-the box setups?
Re: Llama 2
#743Key detail from release: > If, on the Llama 2 version release date, the monthly active users of the products or services made available by or for Licensee, or Licensee’s affiliates, is greater than 700 million monthly active users in the preceding calendar month, you must request a license from Meta, which Meta may grant to you in its sole discretion, and you are not authorized to exercise any of the rights under thi…
https://blogs.microsoft.com/blog/2023/07/18/microsoft-and-me... I think this is effectively an Apple + Amazon + Google ban? (MS employee, just noticing interesting intersection of announcements and licensing).
Firefox can't ship a AI-browser extension without permission..
Re: Llama 2
#744Earlier quoted context omitted.
Presented with no comment :) https://twitter.com/chhillee/status/1635790330854526981?s=46...
Having worked on ML products, there is sometimes debate on whether you should train on the test partition prior to prod deployment - after all, why would you ship a worse model to prod? Obviously you can't tell whether the model is better at generalization compared to an alternate technique, and you also incur some overfit risk. But many industrial problems are solvable through memorization.
> after all, why would you ship a worse model to prod?
...because you need a control to evaluate how well your product is doing? I know it's a young field, but boy, do some folk love removing the "science" from "data science"
Re: Llama 2
#745Quick script to run it on your MacBook:
https://gist.github.com/adrienbrault/b76631c56c736def9bc1bc2...
Re: Llama 2
#746Earlier quoted context omitted.
I genuinely have no idea what N-Point definition of open source you’re using. The term “open source” doesn’t have a singular definition. I liked the comment somewhere in this thread that if you stuck 5 HN users in a room you’d get 12 definitions for open source. Sounds like people need to come with more precise terms like “GNU Open Source” or similar. Because at this point we’ve gone too far and there will never be a…
This was a huge thing in the 1990s - yes there is a singular definition, by the Open Source Initiative https://opensource.org/ That's a good thing, because otherwise corporations constantly try to stretch the definition and make it meaningless. Same then, same now!
OSI has done a poor job in their mission because they’ve failed to define the spectrum of projects between “personal definition or open source” and “fully closed source”. And now everyone is using the term open source in a manner they did not sanction. Because their definition is not particularly relevant.
Re: Llama 2
#747Earlier quoted context omitted.
> say the tracklist for lou reed album 'new york' >Sure! The tracklist for Lou Reed's album "New York" is as follows: >"Heroin" >"New York City" >"Kicks" >"Betrayed" >"I'm Waiting for the Man" >"The Kids" >"Oh! Sweet Honey Pie" >"Sunday Morning" >"Romeo Had Juliette" >"The Bed" >I hope that helps! Let me know if you have any other questions.
If LLama 2 were a Lou Reed album, it would probably be Metal Machine Music.
turning up the temperature, you get multiple entries of 'the power of positive drinking' in the tracklist.. it's hilarious.
Re: Llama 2
#748Earlier quoted context omitted.
https://blogs.microsoft.com/blog/2023/07/18/microsoft-and-me... I think this is effectively an Apple + Amazon + Google ban? (MS employee, just noticing interesting intersection of announcements and licensing).
Firefox can't ship a AI-browser extension without permission..
Firefox's market share is below 8.75%, so it cannot have 700 million monthly active users as of the Llama 2 release date, so it does not need permission.
(Human population / 700 million ≈ 8.75%. Firefox global market share, I've seen measurements reported from 2.81% to 7.69%).
Re: Llama 2
#749I filled the form about an hour ago and got the download link 15 mins ago. Download is ongoing. Direct link to request access form: https://ai.meta.com/resources/models-and-libraries/llama-dow... Direct link to request access on Hugging Face (use the same email): https://huggingface.co/meta-llama/Llama-2-70b-chat-hf Direct link to repo: https://github.com/facebookresearch/llama Once you get a link to download on emai…
How big is it?
~650 GB everything
Re: Llama 2
#750Earlier quoted context omitted.
I asked it about cannibals. It said > I do not support or condone the practice of cannibalism, as it is harmful and exploitative towards the individuals who are consumed. Then it said that cannibals have inherent worth and dignity and that we should strive to appreciate what they do. Then it crashed and is now responding to all following inputs with just the letter "I"
I let it write some machine learning quote and tried to make it guess good hyperparameters, then it crashed and just kept repeating the word "Based".
"based" indeed.