Live data from Hacker News

Ask HN: Is anyone doing anything cool with tiny language models?

news.ycombinator.com

161–170 of 356 posts

Re: Ask HN: Is anyone doing anything cool with tiny language models?

#161
post #133

I made a shell alias to translate things from French to English, does that count? function trans llm "Translate \"$argv\" from French to English please" end Llama 3.2:3b is a fine French-English dictionary IMHO.

Is it better than translatelocally? https://translatelocally.com/downloads/ (the same as used in firefox)

Re: Ask HN: Is anyone doing anything cool with tiny language models?

#163

Earlier quoted context omitted.

Maybe it could also send automated petitions to the EU to undo cookie consent legislation, and reverse some of the enshitification.

To me this take is like smokers complaining that the evil government is forcing the good tobacco companies to degrade the experience by adding pictures of cancer patients on cigarette packs.

Those don’t really work: https://jamanetwork.com/journals/jamanetworkopen/fullarticle...

Re: Ask HN: Is anyone doing anything cool with tiny language models?

#164

Micro Wake Word is a library and set of on device models for ESPs to wake on a spoken wake word. https://github.com/kahrendt/microWakeWord Recently deployed in Home Assistants fully local capable Alexa replacement. https://www.home-assistant.io/voice_control/about_wake_word/

Nice idea.

Make sure your meeting participants know you’re transcribing them. Has similar notification requirements as recording state to state.

Re: Ask HN: Is anyone doing anything cool with tiny language models?

#165

I built an Excel Add-In that allows my girlfriend to quickly filter 7000 paper titles and abstracts for a review paper that she is writing [1]. It uses Gemma 2 2b which is a wonderful little model that can run on her laptop CPU. It works surprisingly well for this kind of binary classification task. The nice thing is that she can copy/paste the titles and abstracts in to two columns and write e.g. "=PROMPT(A1:B1, "If…

Very cool idea. I’ve used gemma2 2b for a few small things. Very good model for being so small.

Re: Ask HN: Is anyone doing anything cool with tiny language models?

#166
post #50

I have a mini PC with an n100 CPU connected to a small 7" monitor sitting on my desk, under the regular PC. I have llama 3b (q4) generating endless stories in different genres and styles. It's fun to glance over at it and read whatever it's in the middle of making. I gave llama.cpp one CPU core and it generates slow enough to just read at a normal pace, and the CPU fans don't go nuts. Totally not productive or really…

That's neat. I just tried something similar: FORTUNE=$(fortune) && echo $FORTUNE && echo "Convert the following output of the Unix `fortune` command into a small screenplay in the style of Shakespeare: \n\n $FORTUNE" | ollama run phi4

Doesn't `fortune` inside double quotes execute the command in bash? You should use single quotes instead of backticks.

Re: Ask HN: Is anyone doing anything cool with tiny language models?

#167

Earlier quoted context omitted.

Have you backtested this in times when markets were not constantly green? Nearly any strategy is good in the good times.

yep. the 55% is over a few years.

Right, but if 55% is avg over the last few years, “buy stock” is going to be correct more than not.

https://www.crestmontresearch.com/docs/Stock-Yo-Yo.pdf

Re: Ask HN: Is anyone doing anything cool with tiny language models?

#168

Earlier quoted context omitted.

I'm curious what sort of unethical suggestions it's coming up with haha

so far, mostly buying companies owned/ran by horrible people.

So if you filter out the Republican owned ones or whatever your bugbear is, does the 55% persist?

Re: Ask HN: Is anyone doing anything cool with tiny language models?

#169

We fine-tuned a Gemma 2B to identify urgent messages sent by new and expecting mothers on a government-run maternal health helpline. https://idinsight.github.io/tech-blog/blog/enhancing_materna...

Oh that is a nice writeup. We have something similar in mind at work. Will forward it.

Re: Ask HN: Is anyone doing anything cool with tiny language models?

#170

I had an LLM create a playlist for me. I’m tired of the bad playlists I get from algorithms, so I made a specific playlist with an Llama2 based on several songs I like. I started with 50, removed any I didn’t like, and added more to fill in the spaces. The small models were pretty good at this. Now I have a decent fixed playlist. It does get “tired” after a few weeks and I need to add more to it. I’ve never been able…

Huh, interesting. For me that often dreamed up artist and songs.
Post reply on HN