I love the idea, that's the future. However you should be aware that the explanation of second law of thermodynamics generated by the LLM you used in your app store screenshot is wrong: the LLM has it backwards. Energy transfers to less stable states from more stable states, and not the reverse. (I use LLMs for science education apps like https://apps.apple.com/fr/app/explayn-learn-chemistry/id6448..., so I am quite used to spot that kind of errors in LLM outputs...)
I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros
141–150 of 208 posts
Re: I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros
#142I love the idea, that's the future. However you should be aware that the explanation of second law of thermodynamics generated by the LLM you used in your app store screenshot is wrong: the LLM has it backwards. Energy transfers to less stable states from more stable states, and not the reverse. (I use LLMs for science education apps like https://apps.apple.com/fr/app/explayn-learn-chemistry/id6448... , so I am quite…
How do you define stability in that context?
Re: I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros
#143Earlier quoted context omitted.
What the hell are you on about? Apple has rules and guidelines on (user) generated content, GP was asking whether it applied here.
Understood but at some point it becomes the responsibility of the user of the hammer if they use it in an attack or hurt someone else or themselves with it. LLMs are LLMs anyone who is using it who doesn’t understand it is language model and is a machine and how at the high level it works, probably shouldn’t use it, and it shouldn’t be Apple’s responsibility to keep hammers out of the hands of everyone due to the few…
Apple forcefully takes on that responsibility, and their customers love it (as clearly evidenced by their domination of the market). If you don't want a hammer that gets reviewed and screened by Apple before you can use it, then you're on the wrong platform.
Re: I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros
#144I love the idea, that's the future. However you should be aware that the explanation of second law of thermodynamics generated by the LLM you used in your app store screenshot is wrong: the LLM has it backwards. Energy transfers to less stable states from more stable states, and not the reverse. (I use LLMs for science education apps like https://apps.apple.com/fr/app/explayn-learn-chemistry/id6448... , so I am quite…
Oh, that's an interesting app and in French too... is that something you plan to have on Android as well?
Re: I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros
#145are you using a quantized version of the model and if so which one?
Re: I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros
#146Is it weird if I carry a phone with this and a solar charger around at all times, in case I suddenly get hurled back in time?
I think it would be far better to just store a bunch of epubs on your phone in case you get hurled back. Textbooks on physics, chem, etc.
I think a great caution should be used with modern physics and chemistry - it may be a way to get yourself killed for sorcery.
But if you want to say alive then I'll recommend including few books about creating modern medicine from scratch - like creating aspirin from willow bark and penicillin from molded bread.
Re: I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros
#147I love the idea, that's the future. However you should be aware that the explanation of second law of thermodynamics generated by the LLM you used in your app store screenshot is wrong: the LLM has it backwards. Energy transfers to less stable states from more stable states, and not the reverse. (I use LLMs for science education apps like https://apps.apple.com/fr/app/explayn-learn-chemistry/id6448... , so I am quite…
Is that explanation better? https://github.com/Const-me/Cgml/blob/master/Mistral/Mistral...
Same Mistral Instruct 0.2 model, different implementation.
Re: I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros
#148Re: I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros
#149Re: I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros
#150I love the idea, that's the future. However you should be aware that the explanation of second law of thermodynamics generated by the LLM you used in your app store screenshot is wrong: the LLM has it backwards. Energy transfers to less stable states from more stable states, and not the reverse. (I use LLMs for science education apps like https://apps.apple.com/fr/app/explayn-learn-chemistry/id6448... , so I am quite…
Strongly agree.
Local, app embedded, and purpose-built targeted experts is clearly the future in my mind for a variety of reasons. Looking at TPUs in Android devices and neural engine in Apple hardware it's pretty clear.
Xcode already has an ML studio, for example, that can not only embed and integrate models in apps but also finetune, etc. It's obvious to me that at some point most apps will have embedded models in the app (or device) for specific purposes.
No AI can compare to humans and even we specialize. You wouldn't hire a plumber to perform brain surgery and you wouldn't hire a neurosurgeon to fix your toilet. Mixture of experts with AI models is a thing of course but when we look at how we primarily interact with technology and the functionality it provides it's generally pretty well siloed to specific purposes.
A purposed domain and context trained/tuned small model doing stuff on your on-device data would likely do nearly as well if not better for some applications than even ChatGPT. Think of the next version of device keyboards doing RAG+LLM through your text messages to generate replies. Stack it up with speech to text, vision, multimodal models, and who knows what and yeah, interesting.
Throw in the automatic scaling, latency, and privacy and the wins really stack up.
Some random app developer can integrate a model in their application and scale higher with better performance than ChatGPT without setting money on fire.