Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: Is anyone doing anything cool with tiny language models?

news.ycombinator.com

Post reply on HN
Print view View original

101–110 of 356 posts

Re: Ask HN: Is anyone doing anything cool with tiny language models?

#101

Post by dr_kiszonka »

zeroCalories wrote: post #66
colechristensen wrote: post #36

Earlier quoted context omitted.

But that's the thing, I don't need my ML model to be able to write me a sonnet about the history of beets, especially if I want to run it at home for specific tasks like as a programming assistant. I'm fine with and prefer specialist models in most cases.

I would love a model that knows SQL really well so I don't need to remember all the small details of the language. Beyond that, I don't see why the transformer architecture can't be applied to any problem that needs to predict sequences.

The trick is to find such problems with enough training data and some market potential. I am terrible at it.

Re: Ask HN: Is anyone doing anything cool with tiny language models?

#102

Post by dkga »

spiritplumber wrote: post #78

My husband and me made a stock market analysis thing that gets it right about 55% of the time, so better than a coin toss. The problem is that it keeps making unethical suggestions, so we're not using it to trade stock. Does anyone have any idea what we can do with that?

Suggestion: calculate the out-of-sample Sharpe ratio[0] of the suggestions over a reasonable period to gauge how good the model would actually perform in terms of return compared to risks. It is better than vanilla accuracy or related metrics. Source: I'm a financial economist.

[0]: https://en.wikipedia.org/wiki/Sharpe_ratio

Re: Ask HN: Is anyone doing anything cool with tiny language models?

#103

Post by codazoda »

I had an LLM create a playlist for me.

I’m tired of the bad playlists I get from algorithms, so I made a specific playlist with an Llama2 based on several songs I like. I started with 50, removed any I didn’t like, and added more to fill in the spaces. The small models were pretty good at this. Now I have a decent fixed playlist. It does get “tired” after a few weeks and I need to add more to it. I’ve never been able to do this myself with more than a dozen songs.

Re: Ask HN: Is anyone doing anything cool with tiny language models?

#104

Post by stogot »

celestialcheese wrote: post #90
Evidlo wrote: post #69

I have ollama responding to SMS spam texts. I told it to feign interest in whatever the spammer is selling/buying. Each number gets its own persona, like a millennial gymbro or 19th century British gentleman. http://files.widloski.com/image10%20(1).png http://files.widloski.com/image11.png

Given the source, I'm skeptical it's not just a troll, but found this explanation [0] plausible as to why those vague spam text exists. If true, this trolling helps the spammers warm those phone numbers up. 0 - https://x.com/nikitabier/status/1867029883387580571

Why does STOP work here?

Re: Ask HN: Is anyone doing anything cool with tiny language models?

#105

Post by celestialcheese »

stogot wrote: post #104
celestialcheese wrote: post #90

Earlier quoted context omitted.

Given the source, I'm skeptical it's not just a troll, but found this explanation [0] plausible as to why those vague spam text exists. If true, this trolling helps the spammers warm those phone numbers up. 0 - https://x.com/nikitabier/status/1867029883387580571

Why does STOP work here?

https://x.com/nikitabier/status/1867069169256308766

Again, no clue if this is true, but it seems plausible.

Re: Ask HN: Is anyone doing anything cool with tiny language models?

#107

Post by inerte »

stogot wrote: post #104
celestialcheese wrote: post #90

Earlier quoted context omitted.

Given the source, I'm skeptical it's not just a troll, but found this explanation [0] plausible as to why those vague spam text exists. If true, this trolling helps the spammers warm those phone numbers up. 0 - https://x.com/nikitabier/status/1867029883387580571

Why does STOP work here?

Carriers and SMS service providers (like Twillio) obey that, no matter what service is behind.

There are stories of people replying STOP to spam, then never getting a legit SMS because the number was re-used by another service. That's because it's being blocked between the spammer and the phone.

Re: Ask HN: Is anyone doing anything cool with tiny language models?

#108

Post by genewitch »

cwmoore wrote: post #63

I'm playing with the idea of identifying logical fallacies stated by live broadcasters.

I have several rhetoric and logic books of the sort you might use for training or whatever, and one of my best friends got a doctorate in a tangential field, and may have materials and insights.

We actually just threw a relationship curative app online in 17 hours around Thanksgiving., so they "owe" me, as it were.

I'm one of those people that can do anything practical with tech and the like, but I have no imagination for it - so when someone mentions something that I think would be beneficial for my fellow humans I get this immense desire to at least cheer on if not ask to help.

Re: Ask HN: Is anyone doing anything cool with tiny language models?

#109

Post by bongodongobob »

spiritplumber wrote: post #78

My husband and me made a stock market analysis thing that gets it right about 55% of the time, so better than a coin toss. The problem is that it keeps making unethical suggestions, so we're not using it to trade stock. Does anyone have any idea what we can do with that?

You can literally flip coins and get better than 50% success in a bull market. Just buy index funds and spend your time on something that isn't trying to beat entropy. You won't be able to.

Re: Ask HN: Is anyone doing anything cool with tiny language models?

#110

Post by great_psy »

deadbabe wrote: post #91
Evidlo wrote: post #81

Earlier quoted context omitted.

Android app that forwards to a Python service on remote workstation over MQTT. I can make a Show HN if people are interested.

I’d love to see that. Could you simulate iMessage?

Yes it’s possible, but it’s not something you can easily scale.

I had a similar project a few years back that used OSX automations and Shortcuts and Python to send a message everyday to a friend. It required you to be signed in to iMessage on your MacBook.

Than was a send operation, the reading of replies is not something I implemented, but I know there is a file somewhere that holds a history of your recent iMessages. So you would have to parse it on file update and that should give you the read operation so you can have a conversation.

Very doable in a few hours unless something dramatic changed with how the messages apps works within the last few years.

Post reply on HN