The magic "Just barely runs on 24GB VRAM" model being absent is fishy.
Let's hope they do fix it and release it and this isn't a ploy to keep people in the cloud by only releasing lesser models for local systems.
Llama 2
351–360 of 860 posts
Re: Llama 2
#352I work at a company using LLMs, and so far Falcon has been the only commercially licensed LLM that was remotely close to ChatGPT in terms of performing well on our use case (MPT did not work well when we tried it). And a ton of the open source software for eg instruction-tuning llama will presumably now be viable for commercial use if transferred to this license. Sure, it's not 'true' open source, but IMHO this is still a HUGE deal.
Re: Llama 2
#353Hey HN, we've released tools that make it easy to test LLaMa 2 and add it to your own app! Model playground here: https://llama2.ai Hosted chat API here: https://replicate.com/a16z-infra/llama13b-v2-chat If you want to just play with the model, llama2.ai is a very easy way to do it. So far, we’ve found the performance is similar to GPT-3.5 with far fewer parameters, especially for creative tasks and interactions. Dev…
> Model playground here: llama2.ai is there any way to rename the model from "Assistant" to tune out those "I am a large language model" excuses?
In the menu there's an option to modify the prompt.
Re: Llama 2
#354Key detail from release: > If, on the Llama 2 version release date, the monthly active users of the products or services made available by or for Licensee, or Licensee’s affiliates, is greater than 700 million monthly active users in the preceding calendar month, you must request a license from Meta, which Meta may grant to you in its sole discretion, and you are not authorized to exercise any of the rights under thi…
Maybe anti-Twitter? Aren't Elon and Zuck having a spat?
Re: Llama 2
#355Making advanced LLMs and releasing them for free like this is wonderful for the world. It saves a huge number of folks (companies, universities & individuals) vast amount of money and engineering time. It will enable many teams to do research and make products that they otherwise wouldn't be able to. It is interesting to ponder to what extent this is just a strategic move by Meta to make more money in the end, but wh…
Feed the open market, people add to the market, feed from the open market, profit
Re: Llama 2
#356Hey HN, we've released tools that make it easy to test LLaMa 2 and add it to your own app! Model playground here: https://llama2.ai Hosted chat API here: https://replicate.com/a16z-infra/llama13b-v2-chat If you want to just play with the model, llama2.ai is a very easy way to do it. So far, we’ve found the performance is similar to GPT-3.5 with far fewer parameters, especially for creative tasks and interactions. Dev…
Here is my first attempt:
Me: Hey there! Can you help me with my NeoVim configuration?
Assistant: Hello! Sure, I'd be happy to help! What do you need help with specifically? Do you have a question about installing NeoVim, or are you looking for help with a specific feature or configuration?
Me: How do I configure neovim's lsp to work with golang lsp server?
Assistant: Great question! To configure NeoVim to work with the GoLang LSP server, you'll need to do a few things. First, you'll need to install the GoLang LSP server by running the following command in your terminal:
Go to the NeoVim configuration file by running the command :e $HOME/.config/nvim/init.vim
Assistant: Once you're in the NeoVim configuration file, you'll need to add the following lines at the end of the file:
Then, save and close the configuration file. After that, restart NeoVim and you should be good to go!
Re: Llama 2
#357Earlier quoted context omitted.
In a free market economy everything is a strategic move to make the company more money. It's the nature of our incentive structure.
Most, but not all things are strategic moves. Some moves are purely altruistic. Some moves are semi-altruistic - they don't harm the company, but help it increase its reputation or even just allows them to offer people ways to help in order to retain talent. (Which is also kind of strategic, but in a different way.) Also, some things are just mistakes and miscalculations.
This, in my view it's a (very smart) move in response to OpenAI/Microsoft and Google having their cold war-esque standoff.
Following the analogy : Meta is arming the Open source community with okish (but in comparison to the soviets and Americans shoddy) weapons and push the third position politically.
Amazon meanwhile is basically a neutral arms manufacturer with AWS, and Nvidia owns the patent on "the projectile"
I'm not trying to biting the hand that arms me - so thank you very much Meta and Mister Zuckerberg.
Now someone, somewhere can create this eras version of Linux, hopefully under this eras version of the GPL.
Re: Llama 2
#358I checked the playground at https://www.llama2.ai/
Me. How do I swap keys with values in a Ruby hash?
Llama. To swap keys with values in a Ruby hash, you can use the each method to iterate over the hash, and then use the swap method to swap the key and value for each key-value pair. Here's an example:
hash = {a: 1, b: 2, c: 3}
hash.each do |key, value| hash[value] = key; end
This will swap the keys and values in the hash, so that the resulting hash is:
{1: "a", 2: "b", 3: "c"}
Me. Where did you use the swap method in that code?
Llama2. I apologize, I made a mistake. There is no swap method in Ruby. Instead, we used the each method to iterate over the hash and assign the value to the key.
Re: Llama 2
#359Earlier quoted context omitted.
There's a few prompts that I use with every model to compare them. One of the simplest ones is: > When does the bowl of the winds get used in the wheel of time books? LLaMA2 fails pretty hard: > The Bowl of the Winds is a significant artifact in the Wheel of Time series by Robert Jordan. It is first introduced in the third book, "The Dragon Reborn," and plays a crucial role in the series throughout the rest of the bo…
> get this question correct I am willing to bet a million dollars that it is unlikely any single model will ever be able to answer any question correctly. The implications then are that one cannot use a single question evaluate whether a model is useful or not.
Of course that has to be the case otherwise you have a halting oracle. It's fitting this was proven by the namesake of the Turing Test.
Re: Llama 2
#360Earlier quoted context omitted.
You're just being overly pedantic. They hold their breath, fully submerge, control their buoyancy, and propel themselves through water. Also known as swimming.
Nah, this is often not considered swimming in major publications and by zoos. National Geographic https://www.nationalgeographic.com/animals/mammals/facts/hip... > Hippos cannot swim or breathe underwater, and unlike most mammals they are so dense that they cannot float. Instead, they walk or run along the bottom of the riverbed. Because their eyes and nostrils are located on the top of their heads, they can still se…
>> Because their eyes and nostrils are located on the top of their heads, they can still see and breathe while underwater.
That is an inaccurate use of the word underwater. Underwater means beneath the surface. Breathing moves gases in and out of the lungs. These gases are not available in sufficient quantities beneath a liquid's surface to perform typical breathing behavior.
A better description is "while its body is submerged":
The hippo's nose, ears, and eyes are on the top of its head, and they protrude from the water while the rest of its head and its body lie beneath the surface. That way a hippo can breathe, see, and hear even while its body is submerged.
https://kids.nationalgeographic.com/animals/mammals/facts/hi...
You could be kind to Nat Geo Adults and Buckeyes and say "ok, that's mostly underwater" but its still wrong because of the way it talks about eyes. Light penetrates the surface of water and the Hippo's optical organs are not deleteriously effected by most liquid water unlike the alveoli of lungs. Thus eyes can see underwater even though a Hippo will not be able to breathe effectively.