Live data from Hacker News

Llama 3 implemented in pure NumPy

docs.likejazz.com

1–10 of 54 posts

Re: Llama 3 implemented in pure NumPy

#7

The rotary embeddings bit is neat. I wonder if a complex representation would simplify vs complexify things (readability, performance, expressive power).

Some implementations use a complex rotary encoding, but it makes it a bit harder to port to platforms or frameworks which do not support complex numbers natively.

Re: Llama 3 implemented in pure NumPy

#10

What is the difference to the llama.np repository credited in the README? https://github.com/hscspring/llama.np

Well, it supports Llama3.

But the other question I have is about the license. The tokenizer.py file is identical, and the rest is very similar - just making minor adjustments here and there.

Can they just take this Apache 2 licensed code, change it a bit and offer it as MIT? They are clearly not the original author.

Post reply on HN