Beyond the obvious chatbots and coding copilots, curious what people are actually shipping with LLMs. Internal tools? Customer-facing features? Any economically useful agents out there in the wild?
Ask HN: What are you actually using LLMs for in production?
1–10 of 70 posts
Re: Ask HN: What are you actually using LLMs for in production?
#2So many things. I have built several customer facing products, a web research platform that works better than the RAG you get from Google, and lots of small tools.
For example, I wrote a recent blog post on how I use LLMs to generate excel files with a prompt (less about the actual product and more about how to improve outcomes): https://maxirwin.com/articles/persona-enriched-prompting/
Re: Ask HN: What are you actually using LLMs for in production?
#3We have a prompt that takes a job description and categorizes it based on whether it's an individual contributor role, manager, leadership, or executive, and also tags it based on whether it's software, mechanical, etc.
We scrape job sites and use that prompt to create tags which are then searchable by users in our interface.
It was a bit surprising to see how Karpathy described software 3.0 in his recent presentation because that's exactly what we're doing with that prompt.
Re: Ask HN: What are you actually using LLMs for in production?
#4Not really, no. Still just using ChatGPT or Gemini for the occasional search for things that are buried in documentation somewhere. Anything more than that and LLMs make a hash of it fairly quick.
Re: Ask HN: What are you actually using LLMs for in production?
#5Nvidia nemo ASR + an 8B LLM to generate transcripts and summaries of phone calls that my support team conducts. It works better than the notes they leave about the calls.
Re: Ask HN: What are you actually using LLMs for in production?
#6We've been encouraged to use LLMs for brainstorming blog posts. The actual posts it generates are usually not good but gives us something to talk about so we can write something better.
And doing SEO to posts. It seems to do that pretty well.
Re: Ask HN: What are you actually using LLMs for in production?
#7Not really, no. Still just using ChatGPT or Gemini for the occasional search for things that are buried in documentation somewhere. Anything more than that and LLMs make a hash of it fairly quick.
I have enjoyed how these LLMs make a nice wrapper around projects tha are terrible at writing documentation.
Re: Ask HN: What are you actually using LLMs for in production?
#8Mostly for understanding existing code base and making changes to it. There are tons of unnecessary abstractions and indirections in it so it takes a long time for me to follow that chain. Writing Splunk queries is another use.
People use it to generate meeting notes. I don't like it and don't use it.
Re: Ask HN: What are you actually using LLMs for in production?
#9Writing test boilerplate.
Re: Ask HN: What are you actually using LLMs for in production?
#10Built vaporlens.app in my free time using LLMs (specifically gemini, first 2.0-flash, recently moved to 2.5-flash).
It processes Steam game reviews and provides one page summary of what people thing about the game. Have been gradually improving it and adding some features from community feedback. Has been good fun.