Llama 3 implemented in pure NumPy
docs.likejazz.com
Llama 3 implemented in pure NumPy
1–10 of 54 posts
Re: Llama 3 implemented in pure NumPy
#2[dead]
Re: Llama 3 implemented in pure NumPy
#3I'll consider superintelligence achieved if AI can do such work faithfully.
Re: Llama 3 implemented in pure NumPy
#4[deleted]
Re: Llama 3 implemented in pure NumPy
#5The rotary embeddings bit is neat. I wonder if a complex representation would simplify vs complexify things (readability, performance, expressive power).
Re: Llama 3 implemented in pure NumPy
#6What is the difference to the llama.np repository credited in the README? https://github.com/hscspring/llama.np
Re: Llama 3 implemented in pure NumPy
#7The rotary embeddings bit is neat. I wonder if a complex representation would simplify vs complexify things (readability, performance, expressive power).
Some implementations use a complex rotary encoding, but it makes it a bit harder to port to platforms or frameworks which do not support complex numbers natively.
Re: Llama 3 implemented in pure NumPy
#8Obligatory Recmo’s Llama1 implementation in numpy :)
Re: Llama 3 implemented in pure NumPy
#9I'll consider superintelligence achieved if AI can do such work faithfully.
What? Lots of people could produce this repo, it hardly counts as superintelligence.
Re: Llama 3 implemented in pure NumPy
#10What is the difference to the llama.np repository credited in the README? https://github.com/hscspring/llama.np
Well, it supports Llama3.
But the other question I have is about the license. The tokenizer.py file is identical, and the rest is very similar - just making minor adjustments here and there.
Can they just take this Apache 2 licensed code, change it a bit and offer it as MIT? They are clearly not the original author.