Alfred-40B, an OSS RLHF version of Falcon40B
1–10 of 26 posts
Re: Alfred-40B, an OSS RLHF version of Falcon40B
#2so its open source? Where is the link to the weights?
The article was mildly annoying because of many underlines sentences and words that looked like links.
Re: Alfred-40B, an OSS RLHF version of Falcon40B
#3so its open source? Where is the link to the weights? The article was mildly annoying because of many underlines sentences and words that looked like links.
The weights are literally linked in the article. The license is Apache 2.0
Re: Alfred-40B, an OSS RLHF version of Falcon40B
#4Any performance benchmarks compared to other LLMs? Also, any performance increases on the orig Falcon model in inference speed?
We ditched most of our focus on Falcon 40B after Llama 2 70B came out, both the tokens per sec and quality of results are not even close.
Re: Alfred-40B, an OSS RLHF version of Falcon40B
#5Anyone keeping track of all these LLM releases?
Re: Alfred-40B, an OSS RLHF version of Falcon40B
#6Anyone keeping track of all these LLM releases?
This is the closest thing I'm aware of: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderb...
Re: Alfred-40B, an OSS RLHF version of Falcon40B
#7Anyone keeping track of all these LLM releases?
Kind of. There's https://github.com/Hannibal046/Awesome-LLM and you can follow the subreddit too. They're not amazing though, so I'm in the process of making my own catalogue.
Re: Alfred-40B, an OSS RLHF version of Falcon40B
#8Igor, is LightOn still working on optical computing? Or have you fully pivoted to genai without optics?
Re: Alfred-40B, an OSS RLHF version of Falcon40B
#9so its open source? Where is the link to the weights? The article was mildly annoying because of many underlines sentences and words that looked like links.
The weights are literally linked in the article. The license is Apache 2.0 https://huggingface.co/lightonai/alfred-40b-0723/tree/main
thanks!
Re: Alfred-40B, an OSS RLHF version of Falcon40B
#10What kind of hardware do I need to run this sufficiently well? I.e. say I want 10 tokens/s, what specs am I looking at?