Really cool!
Honestly I wish these releases would come with a demo (like on replicate or hugging face)
Persimmon-8B
21–30 of 61 posts
Re: Persimmon-8B
#22Earlier quoted context omitted.
This is the least detailed foundational model release I have seen. Llama paper offers lot more details like ablations, loss curves etc. Falcon has data preparation details etc. Google's model release papers like T5 are some of the best and includes many ablations.
I mean "I am become death, destroyer of worlds" bullshit about AI safety/ethics/etc that is included in every press release from Google/Meta/OpenAI and even much smaller players.
Yes, but in many cases paper is written by many people including ethicists who believes that and add that to the paper. It doesn't deplete the value of people who actually made it work.
Re: Persimmon-8B
#23Appreciate the release! Since you're hosting the downloads directly, I'd recommend throwing an integrity hash for each of the files alongside the download links so users can verify there wasn't any corruption in transfer.
Re: Persimmon-8B
#24Appreciate the release! Since you're hosting the downloads directly, I'd recommend throwing an integrity hash for each of the files alongside the download links so users can verify there wasn't any corruption in transfer.
Good shout. Will be fixed soon.
Re: Persimmon-8B
#25Earlier quoted context omitted.
I would have to guess it has something to do with that task not actually being suitable for language models at their current stage. Even if they could be trusted to perform the task, its actually not that much work to just... write code to handle keeping this kind of thing in sync. It's really really not that much more work. You really don't even need to do it, both training and inference can be done within PyTorch o…
I'm confused. If these tools aren't good enough for AI research then why would they be good enough for consumer applications? If language models can not help with the AI development loop then the technology is not going to be useful for consumer use cases. Code can be very easily verified by linters and type systems so the problem of verification is much simpler than in consumer use cases without linters and type sys…
>Code can be very easily verified by linters and type systems so the problem of verification is much simpler than in consumer use cases without linters and type systems.
you are confusing (syntactic) validation from verification. verifying code is an incredibly hard problem.
You can get a lot of value out of a models even if they are not capable of AI development because most people aren't doing things that are as complicated as AI development.
Re: Persimmon-8B
#26Awesome! I applaud everyone training new models and attempting different techniques! I'm concerned about the current download's availability - its two URLs to some object storage. I find that these go dark rather quickly for many different reasons (accidentally moving it, bandwidth limits, deleting it later, etc). I'm curious if there's a reason it's not also hosted on huggingface? I'm not saying they're the best pla…
We're working on it!
Re: Persimmon-8B
#27Appreciate the release! Since you're hosting the downloads directly, I'd recommend throwing an integrity hash for each of the files alongside the download links so users can verify there wasn't any corruption in transfer.
Looks like someone there is reading HN as they just did it!
Re: Persimmon-8B
#28Two important takeaways on the base model: * scored 18.9 on HumanEval (coding) where Llama2 7B scored 12.2 * was trained from the beginning with a 16k context using a modified RoPe where many models are simply fine-tuned using RoPe to gain longer context windows after the base model has been trained at 4k. Can anyone share ideas on how important the 2nd one is? Do LLMs benefit from large context windows using RoPe du…
phi-1 supposedly does 50.6 on HumanEval with 1.3B parameters. (Python only) https://arxiv.org/abs/2306.11644
Weights haven't been released, though.
Re: Persimmon-8B
#29Do you have any explanations on why this performed better than Llama 2?
Re: Persimmon-8B
#30Earlier quoted context omitted.
I'm confused. If these tools aren't good enough for AI research then why would they be good enough for consumer applications? If language models can not help with the AI development loop then the technology is not going to be useful for consumer use cases. Code can be very easily verified by linters and type systems so the problem of verification is much simpler than in consumer use cases without linters and type sys…
>Code can be very easily verified by linters and type systems so the problem of verification is much simpler than in consumer use cases without linters and type systems. you are confusing (syntactic) validation from verification. verifying code is an incredibly hard problem. You can get a lot of value out of a models even if they are not capable of AI development because most people aren't doing things that are as co…
I don't think AI development is complicated. It's just a bunch of functions with parameters which are optimized with gradient descent. The AI development loop is extremely simple and most AI "research" is basically stacking standard tensor operations and seeing what works. It's surprising there is no company that is applying AI to AI development since it is essentially a game with symbols and very well defined measurable outcomes.