[dead]
I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros
11–20 of 208 posts
Re: I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros
#12Re: I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros
#13Re: I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros
#14Is it weird if I carry a phone with this and a solar charger around at all times, in case I suddenly get hurled back in time?
Re: I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros
#15[flagged]
[deleted]
Re: I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros
#16Why do none of these apps allow you to set the system prompt? I find these LLM apps kind of useless without being able to refine the way in which the model will respond to later questions.
Mistral instruct doesn't have system prompt AFAIK. Also llama chat system prompt is very useless in my testing.
It does; and if it's LLaMa 2 7B Chat stock from Facebook, that was a little rushed imho, doesn't seem as baked in.
(GPTs matters but it's _very_ bizarre who it thinks it's coming from)
Re: I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros
#17Are these LLMs you can run locally giving answers deterministically just as with, say, StableDiffusion? In StableDiffusion if you reuse the exact same version of SD / model and same query and seed, you always get the same result (at least I think so).
Re: I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros
#18Why do none of these apps allow you to set the system prompt? I find these LLM apps kind of useless without being able to refine the way in which the model will respond to later questions.
would love for you to give cnvrs a shot!
- save characters (system prompt + temperature, and a name & cosmetic color) - download & experiment with models from 1b, 3b, & 7b, and quant options q2k, q4km, q6k - save, search, continue, & export past chats
along with smaller touches: - custom theme colors - haptics
and more coming soon!
Re: I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros
#19Some other local LLM iOS apps: - MLC Chat: https://llm.mlc.ai - LLM Farm: https://llmfarm.site - Enchanted (not local, just a frontend): https://github.com/AugustDev/enchanted But I don't think any of these support Mistral 0.2 which is a pretty big deal.
MLC Chat supports Mistral 0.2 (7B, q3f16_1, it seems)
Re: I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros
#20Is it weird if I carry a phone with this and a solar charger around at all times, in case I suddenly get hurled back in time?
A machine that tells you that the Golden State Warriors won the 2012 Stanley Cup by bowling a perfect 300 would be invaluable in 1602