Viewing profile — tynmann

Thank you, this is very good advice.

I wrote a small amount of JS and CSS to give this page: https://thelibrarian.cc an old UI look and animate it in the same style as typical 90s UIs I have seen during my childhood i…

However if one wants to run something like this in production, it would make more sense to use a server with at least an A10, which has better performance per power consumption.

I'm running everything on my own PC. With a 3060 12 GB at under $300, it's very cheap to build a system capable of running inference with smaller models. But even bigger models (13…

Just my small weekend project, experimenting with LLMs. I made a Discord bot that uses the Zephyr 7B model to reply, and whisper.cpp to transcribe voice messages into text. So you …

Thank you! I pushed a fix for the Firefox issue. And here is the link to the demo for convenience: https://writingcharm.com/write

I'm working on an LLM-based tool to assist with fiction writing. The goal is to help writers get unstuck in case of writer's block, not to do autonomous writing. One has to enter s…