I have a tiny device that listens to conversations between two people or more and constantly tries to declare a "winner"
Tell me it also does sports style commentary on the ongoing debate. My mental image requires it.
Ask HN: Is anyone doing anything cool with tiny language models?
331–340 of 356 posts
Re: Ask HN: Is anyone doing anything cool with tiny language models?
#332I am building GitHub-Copilot style AI autocomplete in any text field on your Mac. The point is to have the AI fill in all the redundant words required by human language, while you provide the entropy (i.e. the words that are unique to what you are trying to express). It is kind of a "dance" between accepting the AI's suggested words and typing yourself to keep it going in the right direction.
Using it, I find myself often writing only the first half of most words, because the second part can usually already be guessed by the AI. In fact, it has a dedicated shortcut for accepting only the first word of the suggestion — that way, it can save you some typing even when later words deviate from your original intent.
Completions are generated in real-time locally on your Mac using a variety of models (primarily Qwen 2.5 1.5B).
It is currently in open beta: https://cotypist.app
Re: Ask HN: Is anyone doing anything cool with tiny language models?
#333https://gophersignal.com – I built GopherSignal! It's a lightweight tool that summarizes Hacker News articles. For example, here’s what it outputs for this very post, "Ask HN: Is anyone doing anything cool with tiny language models?": "A user inquires about the use of tiny language models for interesting applications, such as spam filtering and cookie notice detection. A developer shares their experience with using O…
can you install this into a discord? i volunteer to help. I've been wanting a text-based hackernews chat with alternative moderation.
Re: Ask HN: Is anyone doing anything cool with tiny language models?
#334Earlier quoted context omitted.
> I don't know. HN in a nutshell: I've built some cool tech but have no idea if it is helpful or even counter productive...
I am not going to claim or report any kind of accuracy, especially with such a small model and such a specific, context dependent use case. It is the user’s responsibility to cross validate if it’s accurate enough for their use case and upgrade model or use another approach if not.
Offer a 100% money back guarantee if the user finds that the software is not fit for purpose :)
Re: Ask HN: Is anyone doing anything cool with tiny language models?
#335I have tired but chinese to english but it isn't good(none of them are), because for Chinese words meaning different depending on context so i am just stuck with large model but sometimes even they leave chinese text in translation(like google gemina 2),
I really hope there would be some amazing models this year for translation.
Re: Ask HN: Is anyone doing anything cool with tiny language models?
#336I built an Excel Add-In that allows my girlfriend to quickly filter 7000 paper titles and abstracts for a review paper that she is writing [1]. It uses Gemma 2 2b which is a wonderful little model that can run on her laptop CPU. It works surprisingly well for this kind of binary classification task. The nice thing is that she can copy/paste the titles and abstracts in to two columns and write e.g. "=PROMPT(A1:B1, "If…
Could it be adapted for Google Sheets ?
Re: Ask HN: Is anyone doing anything cool with tiny language models?
#337I built an Excel Add-In that allows my girlfriend to quickly filter 7000 paper titles and abstracts for a review paper that she is writing [1]. It uses Gemma 2 2b which is a wonderful little model that can run on her laptop CPU. It works surprisingly well for this kind of binary classification task. The nice thing is that she can copy/paste the titles and abstracts in to two columns and write e.g. "=PROMPT(A1:B1, "If…
Could it be adapted for Google Sheets ?
Yes, and it will be
Re: Ask HN: Is anyone doing anything cool with tiny language models?
#338I built an Excel Add-In that allows my girlfriend to quickly filter 7000 paper titles and abstracts for a review paper that she is writing [1]. It uses Gemma 2 2b which is a wonderful little model that can run on her laptop CPU. It works surprisingly well for this kind of binary classification task. The nice thing is that she can copy/paste the titles and abstracts in to two columns and write e.g. "=PROMPT(A1:B1, "If…
Tried it out, very cool! Fun to see it chugging on a bunch of rows. Had a weird issue where it would recompute values endlessly when I used it in a table, but I had another table it worked with so not sure what that was about
Glad you tried it out! Excel triggers recalculation when a referenced cell updates, just like with any other formula. This is also why responses are not streamed, as every update would trigger recalculation. But if the async behavior of responses messes with the recalculation logic I am very interested in looking into it and you are most welcome to open an issue in the repo with steps to reproduce.
Re: Ask HN: Is anyone doing anything cool with tiny language models?
#339I am doing nothing, but I was wondering if it would make sense to combine a small LLM and SQLITE to parse date time human expressions. For example, given a human input like "last day of this month", the LLM will generate the following query `SELECT date('now','start of month','+1 month','-1 day');` It is probably super overengineering, considering that pretty good libraries are already doing that on different languag…
>>It is probably super overengineering, considering that pretty good libraries are already doing that on different languages, but it would be funny. I did some tests with chatGPT, and it worked sometimes. It would probably work with some fine-tuning, but I don't have the experience or the time right now
yeah, could you share those libraries please?
Anyone around have actually succeeding in solving this in a way it works? Would appreciate any hints.
Re: Ask HN: Is anyone doing anything cool with tiny language models?
#340I built an Excel Add-In that allows my girlfriend to quickly filter 7000 paper titles and abstracts for a review paper that she is writing [1]. It uses Gemma 2 2b which is a wonderful little model that can run on her laptop CPU. It works surprisingly well for this kind of binary classification task. The nice thing is that she can copy/paste the titles and abstracts in to two columns and write e.g. "=PROMPT(A1:B1, "If…
Seems very nice and useful.
I'd like to have something similar integrated with Zotero to get an easy interaction and get answers about papers I added as references.