301–310 of 356 posts
when i feel like casually listening to something, instead of netflix/hulu/whatever, i'll run a ~3b model (qwen 2.5 or llama 3.2) and generate and audio stream of water cooler office gossip. (when it is up, it runs here: https://water-cooler.jothflee.com ). some of the situations get pretty wild, for the office :)
I built an Excel Add-In that allows my girlfriend to quickly filter 7000 paper titles and abstracts for a review paper that she is writing [1]. It uses Gemma 2 2b which is a wonderful little model that can run on her laptop CPU. It works surprisingly well for this kind of binary classification task. The nice thing is that she can copy/paste the titles and abstracts in to two columns and write e.g. "=PROMPT(A1:B1, "If…
Like either as table in the background or as regular script?
On most computers you can't compile or add add-ons without administrative rights and LLM Chat sites are blocked to prevent usage of company data.
It should run on native Excel or GSheets.
I mean, pure without compilation, just like the do the matrix calculations here straight in Excel without admin rights:
Lesson 1: Demystifying how LLMs work, from architecture to Excel
As far as i know in GSheet the scripts also run on the Google Servers and are not limited by the local computer power. So there larger models could be deployed.
Someone can hack this into Excel/GSheet?
Earlier quoted context omitted.
Android app that forwards to a Python service on remote workstation over MQTT. I can make a Show HN if people are interested.
I am so SO interested, please make a Show HN
Many interesting projects, cool. I'm waiting to LLMs in games. That would make them much more fun. Any time now...
I have a mini PC with an n100 CPU connected to a small 7" monitor sitting on my desk, under the regular PC. I have llama 3b (q4) generating endless stories in different genres and styles. It's fun to glance over at it and read whatever it's in the middle of making. I gave llama.cpp one CPU core and it generates slow enough to just read at a normal pace, and the CPU fans don't go nuts. Totally not productive or really…
Do you find that it actually generates varied and diverse stories? Or does it just fall into the same 3 grooves? Last week I tried to get an LLM (one of the recent Llama models running through Groq, it was 70B I believe) to produce randomly generated prompts in a variety of styles and it kept producing cyberpunk scifi stuff. When I told it to stop doing cyberpunk scifi stuff it went completely to wild west.
Earlier quoted context omitted.
Tracking, tracking cookies, banners etc. are a choice done by the website. There are browser addons for making it simpler, though. The transparency requirements and consent for collecting all kinds of PII (this is the regulation) actually is a great innovation.
I think I'd rather see cookie notices handled by a browser API with a common UI, where the default is always "No." Provide that common UI in a popover accessed in the address bar, or a side pane in the browser itself. If a user logs in or does something requiring cookies that would otherwise prevent normal functionality, prompt them with a Permissions box if they haven't already accepted it in the usual (optional) UI…
I had an LLM create a playlist for me. I’m tired of the bad playlists I get from algorithms, so I made a specific playlist with an Llama2 based on several songs I like. I started with 50, removed any I didn’t like, and added more to fill in the spaces. The small models were pretty good at this. Now I have a decent fixed playlist. It does get “tired” after a few weeks and I need to add more to it. I’ve never been able…
Interesting! I wrote a prompt for something similar[1], but I use Claude Sonnet for it. I wonder how a small model would handle it. Time to test, I guess. [1]: https://git.sr.ht/~jamesponddotco/llm-prompts/tree/trunk/dat...
Earlier quoted context omitted.
I think I'd rather see cookie notices handled by a browser API with a common UI, where the default is always "No." Provide that common UI in a popover accessed in the address bar, or a side pane in the browser itself. If a user logs in or does something requiring cookies that would otherwise prevent normal functionality, prompt them with a Permissions box if they haven't already accepted it in the usual (optional) UI…
There isn't any way EU didn't knew this was possible and is a better choice. There already was DNT header that they can regulate. It also knew the harm to ad industry.
Google could've implemented a consent API in Chrome, but they didn't. Guess why.
I'm playing with the idea of identifying logical fallacies stated by live broadcasters.
Keep good work, good fellow. ;)