Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Llama 2

ai.meta.com

Post reply on HN
Print view View original

491–500 of 860 posts

Re: Llama 2

#491

Post by simonw »

rajko_rad wrote: post #18

Hey HN, we've released tools that make it easy to test LLaMa 2 and add it to your own app! Model playground here: https://llama2.ai Hosted chat API here: https://replicate.com/a16z-infra/llama13b-v2-chat If you want to just play with the model, llama2.ai is a very easy way to do it. So far, we’ve found the performance is similar to GPT-3.5 with far fewer parameters, especially for creative tasks and interactions. Dev…

My LLM command-line tool can now access Llama 2 via the Replicate API using a new llm-replicate plugin - I wrote about that here: https://simonwillison.net/2023/Jul/18/accessing-llama-2/

The tool logs all prompts and responses to a SQLite database, so it's great for comparing results from different models.

Re: Llama 2

#492

Post by jmorgan »

rajko_rad wrote: post #18

Hey HN, we've released tools that make it easy to test LLaMa 2 and add it to your own app! Model playground here: https://llama2.ai Hosted chat API here: https://replicate.com/a16z-infra/llama13b-v2-chat If you want to just play with the model, llama2.ai is a very easy way to do it. So far, we’ve found the performance is similar to GPT-3.5 with far fewer parameters, especially for creative tasks and interactions. Dev…

If you want to try running Llama 2 locally, you can use https://github.com/jmorganca/ollama

To run Llama 2 with it:

  ollama run llama2

Re: Llama 2

#493

Post by xxprogamerxy »

shostack wrote: post #220
nicolashahn wrote: post #161

I asked llama2 why I should use it over chatgpt: " llama2 and chatgpt are both powerful language models, but they have some key differences that may make one more suitable for your needs than the other. llama2 is a more recent model, and it has been specifically designed for conversational AI tasks, such as answering questions and engaging in dialogue. It has been trained on a large dataset of text from the internet…

Any insights into recency of data? One of the big ChatGPT limitations is how old its dataset is which means it can't reference things that happened recently.

It knows that GPT-4 was released on March 14th 2023 so the knowledge cutoff has to be after that.

Re: Llama 2

#494

Post by [deleted] »

whimsicalism wrote: post #4

Key detail from release: > If, on the Llama 2 version release date, the monthly active users of the products or services made available by or for Licensee, or Licensee’s affiliates, is greater than 700 million monthly active users in the preceding calendar month, you must request a license from Meta, which Meta may grant to you in its sole discretion, and you are not authorized to exercise any of the rights under thi…

[deleted]

Re: Llama 2

#495

Post by zevyoura »

BoorishBears wrote: post #370
pmontra wrote: post #358

I checked the playground at https://www.llama2.ai/ Me. How do I swap keys with values in a Ruby hash? Llama. To swap keys with values in a Ruby hash, you can use the each method to iterate over the hash, and then use the swap method to swap the key and value for each key-value pair. Here's an example: hash = {a: 1, b: 2, c: 3} hash.each do |key, value| hash[value] = key; end This will swap the keys and values in the…

Consideration -> Implementation -> Verification is a super low friction way to improve how LLMs do at coding tasks (or most tasks really). - Me: We want to swap keys with values in a Ruby hash, what are some considerations? LLM: When swapping keys with values in a Ruby hash, there are a few considerations to keep in mind. First, it's important to note that swapping keys and values can change the order of the hash, wh…

But this is wrong in at least two ways:

> Additionally, if the hash contains duplicate keys, swapping the keys and values may not have the desired effect.

You can't have duplicate keys in a hash.

More importantly, their implementation adds the swapped pairs but does not remove the original k/v pairs, which is both incorrect and does not match the output it prints.

Re: Llama 2

#496

Post by ipv6ipv4 »

simonw wrote: post #414

I just added Llama 2 support to my LLM CLI tool: https://simonwillison.net/2023/Jul/18/accessing-llama-2/ So you can now access the Replicate hosted version from the terminal like this: pip install llm # or brew install simonw/llm/llm llm install llm-replicate llm keys set replicate # Paste in your Replicate API key llm replicate add a16z-infra/llama13b-v2-chat \ --chat --alias llama2 # And run a prompt llm -m llama2…

It doesn't work for me.

  brew install simonw/llm/llm 
  ...

  ==> Installing llm from simonw/llm
  Error: Your Command Line Tools are too outdated.
  Update them from Software Update in System Settings.

  If that doesn't show you any updates, run:
    sudo rm -rf /Library/Developer/CommandLineTools
    sudo xcode-select --install

  Alternatively, manually download them from:
    https://developer.apple.com/download/all/.
  You should download the Command Line Tools for Xcode 14.3.
I have 14.3.1 installed

Re: Llama 2

#497

Post by mark_l_watson »

jmorgan wrote: post #492
rajko_rad wrote: post #18

Hey HN, we've released tools that make it easy to test LLaMa 2 and add it to your own app! Model playground here: https://llama2.ai Hosted chat API here: https://replicate.com/a16z-infra/llama13b-v2-chat If you want to just play with the model, llama2.ai is a very easy way to do it. So far, we’ve found the performance is similar to GPT-3.5 with far fewer parameters, especially for creative tasks and interactions. Dev…

If you want to try running Llama 2 locally, you can use https://github.com/jmorganca/ollama To run Llama 2 with it: ollama run llama2

Thank you, that looks useful! I don’t have much RAM on either of my Macs (I usually use Colab or Lambda Labs GPS VPSs to run LLMs). It would be great to add a column on your model display for RAM size to run the models.

Re: Llama 2

#498

Post by rajko_rad »

simonw wrote: post #491
rajko_rad wrote: post #18

Hey HN, we've released tools that make it easy to test LLaMa 2 and add it to your own app! Model playground here: https://llama2.ai Hosted chat API here: https://replicate.com/a16z-infra/llama13b-v2-chat If you want to just play with the model, llama2.ai is a very easy way to do it. So far, we’ve found the performance is similar to GPT-3.5 with far fewer parameters, especially for creative tasks and interactions. Dev…

My LLM command-line tool can now access Llama 2 via the Replicate API using a new llm-replicate plugin - I wrote about that here: https://simonwillison.net/2023/Jul/18/accessing-llama-2/ The tool logs all prompts and responses to a SQLite database, so it's great for comparing results from different models.

amazing @simonw !!

Re: Llama 2

#499

Post by simonw »

jmorgan wrote: post #492
rajko_rad wrote: post #18

Hey HN, we've released tools that make it easy to test LLaMa 2 and add it to your own app! Model playground here: https://llama2.ai Hosted chat API here: https://replicate.com/a16z-infra/llama13b-v2-chat If you want to just play with the model, llama2.ai is a very easy way to do it. So far, we’ve found the performance is similar to GPT-3.5 with far fewer parameters, especially for creative tasks and interactions. Dev…

If you want to try running Llama 2 locally, you can use https://github.com/jmorganca/ollama To run Llama 2 with it: ollama run llama2

When you run that command, where does it download the model weights from?
Post reply on HN