Live data from Hacker News

Llamafile lets you distribute and run LLMs with a single file

github.com

301–302 of 302 posts

Re: Llamafile lets you distribute and run LLMs with a single file

#301
post #98

Earlier quoted context omitted.

Fish is another cool shell I got to help improve two years ago by upstreaming a patch for this. So long as you're using a recent version, you should be golden (provided binfmt_misc doesn't cause any issues). Let us know what you think of llamafile!

Thank you, I really like it! It's a very clever way to get LLMs deployed, and with Cosmopolitan, I don't need to point people to different downloads for the same LLM. Excellent job.

Thanks!

Re: Llamafile lets you distribute and run LLMs with a single file

#302
post #289

Is the context only 1024 tokens? it seem it will cut off more and more (which is weird) after I have longer conversation.

it looks like the Llamafile team is taking questions in their live Q&A tomorrow (thursday) at 1700 UTC - https://www.youtube.com/live/dwhBvUN-MD8?feature=shared
Post reply on HN