I made a shell alias to translate things from French to English, does that count? function trans llm "Translate \"$argv\" from French to English please" end Llama 3.2:3b is a fine French-English dictionary IMHO.
Ask HN: Is anyone doing anything cool with tiny language models?
161–170 of 356 posts
Re: Ask HN: Is anyone doing anything cool with tiny language models?
#162Re: Ask HN: Is anyone doing anything cool with tiny language models?
#163Earlier quoted context omitted.
Maybe it could also send automated petitions to the EU to undo cookie consent legislation, and reverse some of the enshitification.
To me this take is like smokers complaining that the evil government is forcing the good tobacco companies to degrade the experience by adding pictures of cancer patients on cigarette packs.
Re: Ask HN: Is anyone doing anything cool with tiny language models?
#164Micro Wake Word is a library and set of on device models for ESPs to wake on a spoken wake word. https://github.com/kahrendt/microWakeWord Recently deployed in Home Assistants fully local capable Alexa replacement. https://www.home-assistant.io/voice_control/about_wake_word/
Nice idea.
Re: Ask HN: Is anyone doing anything cool with tiny language models?
#165I built an Excel Add-In that allows my girlfriend to quickly filter 7000 paper titles and abstracts for a review paper that she is writing [1]. It uses Gemma 2 2b which is a wonderful little model that can run on her laptop CPU. It works surprisingly well for this kind of binary classification task. The nice thing is that she can copy/paste the titles and abstracts in to two columns and write e.g. "=PROMPT(A1:B1, "If…
Re: Ask HN: Is anyone doing anything cool with tiny language models?
#166I have a mini PC with an n100 CPU connected to a small 7" monitor sitting on my desk, under the regular PC. I have llama 3b (q4) generating endless stories in different genres and styles. It's fun to glance over at it and read whatever it's in the middle of making. I gave llama.cpp one CPU core and it generates slow enough to just read at a normal pace, and the CPU fans don't go nuts. Totally not productive or really…
That's neat. I just tried something similar: FORTUNE=$(fortune) && echo $FORTUNE && echo "Convert the following output of the Unix `fortune` command into a small screenplay in the style of Shakespeare: \n\n $FORTUNE" | ollama run phi4
Re: Ask HN: Is anyone doing anything cool with tiny language models?
#167Earlier quoted context omitted.
Have you backtested this in times when markets were not constantly green? Nearly any strategy is good in the good times.
yep. the 55% is over a few years.
Re: Ask HN: Is anyone doing anything cool with tiny language models?
#168Re: Ask HN: Is anyone doing anything cool with tiny language models?
#169We fine-tuned a Gemma 2B to identify urgent messages sent by new and expecting mothers on a government-run maternal health helpline. https://idinsight.github.io/tech-blog/blog/enhancing_materna...
Re: Ask HN: Is anyone doing anything cool with tiny language models?
#170I had an LLM create a playlist for me. I’m tired of the bad playlists I get from algorithms, so I made a specific playlist with an Llama2 based on several songs I like. I started with 50, removed any I didn’t like, and added more to fill in the spaces. The small models were pretty good at this. Now I have a decent fixed playlist. It does get “tired” after a few weeks and I need to add more to it. I’ve never been able…