I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros
1–10 of 208 posts
Re: I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros
#2Does it save all conversations and let me revisit them later?
I use MLC Chat to run Mistral 7B on my iPhone at the moment, but the lack of conversation history is a real nuisance: https://apps.apple.com/us/app/mlc-chat/id6448482937
Re: I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros
#3Why do none of these apps allow you to set the system prompt? I find these LLM apps kind of useless without being able to refine the way in which the model will respond to later questions.
Re: I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros
#4Why do none of these apps allow you to set the system prompt? I find these LLM apps kind of useless without being able to refine the way in which the model will respond to later questions.
I made a free / mostly open source one for iOS that lets you edit the system prompt
Re: I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros
#5[flagged]
Re: I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros
#6[flagged]
Not everyone chases money
Re: I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros
#7Some other local LLM iOS apps:
- MLC Chat: https://llm.mlc.ai
- LLM Farm: https://llmfarm.site
- Enchanted (not local, just a frontend): https://github.com/AugustDev/enchanted
But I don't think any of these support Mistral 0.2 which is a pretty big deal.
Re: I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros
#8[flagged]
[dead]
Re: I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros
#9Why do none of these apps allow you to set the system prompt? I find these LLM apps kind of useless without being able to refine the way in which the model will respond to later questions.
Mistral instruct doesn't have system prompt AFAIK. Also llama chat system prompt is very useless in my testing.
Re: I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros
#10Why do none of these apps allow you to set the system prompt? I find these LLM apps kind of useless without being able to refine the way in which the model will respond to later questions.
Mistral instruct doesn't have system prompt AFAIK. Also llama chat system prompt is very useless in my testing.
It seems to work well on GPT4All (macOS) with system prompts?
Can you link to any doc why it shouldn't work?