Ask HN: How do you use LLMs for private discussions?
11–20 of 32 posts
The hardest part isn’t payment; the prompt itself may identify you. For truly sensitive topics, I’d abstract the details first, then use a local model—or avoid an LLM entirely.
Re: Ask HN: How do you use LLMs for private discussions?
#12[flagged]
Re: Ask HN: How do you use LLMs for private discussions?
#13Best is to use local LLMs obviously. I haven't used it but nano-gpt accepts crypto payments.
Re: Ask HN: How do you use LLMs for private discussions?
#14[flagged]
Re: Ask HN: How do you use LLMs for private discussions?
#15Running Local LLM isn't really a lot effort anymore, since its one command away to get the familar interface of chat AI. This setup requires 24GB ish VRAM and 32GB ram, so if you have capable gaming PC which can do AAA games, you can run it.
- llama-server -hf ggml-org/gemma-4-26b-a4b-it-GGUF:Q4_K_M
After that simply open browser and enter: http://localhost:8080
What this does: This will download Gemma4 AI with 26B param & start a http server for chat
Its shockingly capable for its size. Does it beat the top end models? No, but as long your don't fall into the hallucations. Its just fine.
Edit: the software is llama.cpp you can download it from "releases" which u can find at github right side. No need to know how to build it
Edit2: Pro tip is, only use chat per context you want to use. Lots users want "dynamically" change the context, but that doesnt really work from my experience.
Re: Ask HN: How do you use LLMs for private discussions?
#16[flagged]
Re: Ask HN: How do you use LLMs for private discussions?
#17Not sure what kind of model you're interested in, but you may give Duck.ai[0] a try. It doesn't require any signup and let you use gpt-5.4 nano/mini, Haiku 4.5, Mistral Small 4 and Gemma 4 31B.
[0] https://duck.ai/
Re: Ask HN: How do you use LLMs for private discussions?
#18[deleted]
Re: Ask HN: How do you use LLMs for private discussions?
#19hi, you should try https://ollama.com/ which is imo the most convenient way to run local LLMs
Re: Ask HN: How do you use LLMs for private discussions?
#20[flagged]