Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: Is anyone doing anything cool with tiny language models?

news.ycombinator.com

Post reply on HN
Print view View original

201–210 of 356 posts

Re: Ask HN: Is anyone doing anything cool with tiny language models?

#201

Post by tinco »

computers3333 wrote: post #176

https://gophersignal.com – I built GopherSignal! It's a lightweight tool that summarizes Hacker News articles. For example, here’s what it outputs for this very post, "Ask HN: Is anyone doing anything cool with tiny language models?": "A user inquires about the use of tiny language models for interesting applications, such as spam filtering and cookie notice detection. A developer shares their experience with using O…

That's cool, I really like it. One piece of feedback: I am usually more interested in the HN comments than in the original article. If you'd include a link to the comments then I might switch to GopherSignal as a replacement for the HN frontpage.

My flow is generally: Look at the title and the amount of upvotes to decide if I'm interested in the article. Then view the comments to see if there's interesting discussion going on or if there's already someone adding essential context. Only then I'll decide if I want to read the article or not.

Of course no big deal if you're not interested in my patronage, just wanted to let you know your page already looks good enough for me to consider switching my most visited page to it if it weren't for this small detail. And maybe the upvote count.

Re: Ask HN: Is anyone doing anything cool with tiny language models?

#202

Post by krystofee »

Has anyone ever tried to do some automatic email workflow autoresponder agents?

Lets say, I want some outcome and it will autonomousl handle the process prompt me and the other side for additional requirements if necessary and then based on that handle the process and reach the outcome?

Re: Ask HN: Is anyone doing anything cool with tiny language models?

#204

Post by krystofee »

HexDecOctBin wrote: post #114

Is there any experiments in a small models that does paraphrasing? I tried hsing some off-the-shelf models, but it didn't go well. I was thinking of hooking them in RPGs with text-based dialogue, so that a character will say something slightly different every time you speak to them.

Intuitively this sounds like something that should be possible using almost any llm. This should be just a matter of prompting.

Re: Ask HN: Is anyone doing anything cool with tiny language models?

#205

Post by lnenad »

relistan wrote: post #174
nozzlegear wrote: post #61

I have a small fish script I use to prompt a model to generate three commit messages based off of my current git diff. I'm still playing around with which model comes up with the best messages, but usually I only use it to give me some ideas when my brain isn't working. All the models accomplish that task pretty well. Here's the script: https://github.com/nozzlegear/dotfiles/blob/master/fish-func... And for this chan…

Interesting idea. But those say what’s in the commit. The commit diff already tells you that. The best commit messages IMO tell you why you did it and what value was delivered. I think it’s gonna be hard for an LLM to do that since that context lives outside the code. But maybe it would, if you hook it to e.g. a ticketing system and include relevant tickets so it can grab context. For instance, in your first example,…

I disagree. When you look at the git history in x months you're gonna have a hard time understanding what was done following your example.

Re: Ask HN: Is anyone doing anything cool with tiny language models?

#206

Post by indolering »

kaspermarstal wrote: post #183
afro88 wrote: post #178

Earlier quoted context omitted.

How accurate are the classifications?

I don't know. This paper [1] reports accuracies in the 97-98% range on a similar task with more powerful models. With Gemma 2 2b the accuracy will certainly be lower. [1] https://www.medrxiv.org/content/10.1101/2024.10.01.24314702v...

Y'all definitely need to cross validate a small number of samples by hand. When I did this kind of research, I would hand validate to at least P < .01.

Re: Ask HN: Is anyone doing anything cool with tiny language models?

#207

Post by potamic »

Evidlo wrote: post #81
RVuRnvbM2e wrote: post #73

Earlier quoted context omitted.

This is fantastic. How have your hooked up a mobile number to the llm?

Android app that forwards to a Python service on remote workstation over MQTT. I can make a Show HN if people are interested.

Why MQTT over HTTP for a low volume, small scale integration?

Re: Ask HN: Is anyone doing anything cool with tiny language models?

#208

Post by 7734128 »

kaspermarstal wrote: post #158

I built an Excel Add-In that allows my girlfriend to quickly filter 7000 paper titles and abstracts for a review paper that she is writing [1]. It uses Gemma 2 2b which is a wonderful little model that can run on her laptop CPU. It works surprisingly well for this kind of binary classification task. The nice thing is that she can copy/paste the titles and abstracts in to two columns and write e.g. "=PROMPT(A1:B1, "If…

You could have called it CellMate b

Re: Ask HN: Is anyone doing anything cool with tiny language models?

#209

Post by 7734128 »

kaspermarstal wrote: post #158

I built an Excel Add-In that allows my girlfriend to quickly filter 7000 paper titles and abstracts for a review paper that she is writing [1]. It uses Gemma 2 2b which is a wonderful little model that can run on her laptop CPU. It works surprisingly well for this kind of binary classification task. The nice thing is that she can copy/paste the titles and abstracts in to two columns and write e.g. "=PROMPT(A1:B1, "If…

You could have called it CellMate

Re: Ask HN: Is anyone doing anything cool with tiny language models?

#210

Post by computers3333 »

tinco wrote: post #201
computers3333 wrote: post #176

https://gophersignal.com – I built GopherSignal! It's a lightweight tool that summarizes Hacker News articles. For example, here’s what it outputs for this very post, "Ask HN: Is anyone doing anything cool with tiny language models?": "A user inquires about the use of tiny language models for interesting applications, such as spam filtering and cookie notice detection. A developer shares their experience with using O…

That's cool, I really like it. One piece of feedback: I am usually more interested in the HN comments than in the original article. If you'd include a link to the comments then I might switch to GopherSignal as a replacement for the HN frontpage. My flow is generally: Look at the title and the amount of upvotes to decide if I'm interested in the article. Then view the comments to see if there's interesting discussion…

Hey, thanks a ton for the feedback! That was super helpful to hear about your flow—makes a lot of sense and it's pretty similar to how I browse HN too. I usually only dive into the article after checking out the upvotes and seeing what context the comments add.

I'll definitely add a link to the comments and the upvote count—gotta keep my tiny but mighty userbase (my mom, me, and hopefully you soon) happy, right? lol

And if there's even a chance you'd use GopherSignal as your daily driver, that's a no-brainer for me. Really appreciate you taking the time to share your ideas and help me improve.

Post reply on HN