This is a great use-case for WebGPU: https://chat.webllm.ai
Forget ChatGPT: why researchers now run small AIs on their laptops
381–385 of 385 posts
Re: Forget ChatGPT: why researchers now run small AIs on their laptops
#382Earlier quoted context omitted.
I bought an iZYREC (?) and leave the phone at home. MacWhisper and some regex (I use verbal tags) and done
Some dubious marketing choices on their landing page: > Finding the Truth – Surprisingly, my iZYREC revealed more than I anticipated. I had placed it in my husband's car, aiming to capture some fun moments, but it instead recorded intimate encounters between my husband and my close friend. Heartbreaking yet crucial, it unveiled a hidden truth, helping me confront reality. > A Voice for the Voiceless – We suspected th…
Hahaha yes, a Chinese idea of marketing. However has good battery, good mic, and you can use if offline as mass storage so nothing lost
Re: Forget ChatGPT: why researchers now run small AIs on their laptops
#383Re: Forget ChatGPT: why researchers now run small AIs on their laptops
#384For anyone who hasn't tried local models because they think it's too complicated or their computer can't handle it, download a single llamafile and try it out in just moments. https://future.mozilla.org/builders/news_insights/introducin... https://github.com/Mozilla-Ocho/llamafile They even have whisperfiles now, which is the same thing but for whisper.cpp, aka real-time voice transcription. You can also take this a…
I built Fluid app exactly with that in mind. You can run local AI on mac without really knowing what an LLM/ollama is. Plug&Play. Sorry for the blatant ad, though I do hope it's useful for some ppl reading this thread: https://getfluid.app
Probably not the best choice of names: https://fluidapp.com. I don't know that it's been updated in a while, but it still works nicely.
Re: Forget ChatGPT: why researchers now run small AIs on their laptops
#385Earlier quoted context omitted.
>the telemetry of VSCode is non-personal metrics But I don't want it. I want my software to work for me, not against me. >and some of the most popular extensions are only available with VSCode, not with Codium. I'll manage without them. What's especially annoying is that this restriction is completely artificial. Having said that, MS did a great job with VsCode and I applaud them for that. I guess nothing is perfect,…
> But I don't want it. I want my software to work for me, not against me. How is said software working "against" you by collecint non-personal telemetry while purpose of that telemetry usually is making the software better for most users?
You just need to swap out some nouns and the offense will become more obvious.
"How is that chair working 'against' you by collecting 'non-personal' sitting patterns tagged with timestamps and information about the chair and house that it's in while the purpose of that data collection 'usually' is making the chair better for other people?"
When I use a product, I'm not implicitly inviting the makers of that product to perpetually monitor my usage of the product so that they can make more money based on my data. In any other part of life other than software, this would be an obscene assumption for a product maker to make. But in software, people give it a pass.
No.
This type of data collection is obscene when informed consent is not clearly and authoritatively acquired in advance.