Live data from Hacker News

Ask HN: What are you actually using LLMs for in production?

news.ycombinator.com

21–30 of 70 posts

Re: Ask HN: What are you actually using LLMs for in production?

#21
Not production I was just playing around but seems useful. On so many platforms bios are mostly blank. The best way to get good ones is to have AIs search for pictures and info about yourself and write a draft that's close but definitely not how you want it. That motivates fixing it up on the spot.

Re: Ask HN: What are you actually using LLMs for in production?

#22

Built vaporlens.app in my free time using LLMs (specifically gemini, first 2.0-flash, recently moved to 2.5-flash). It processes Steam game reviews and provides one page summary of what people thing about the game. Have been gradually improving it and adding some features from community feedback. Has been good fun.

I usually find that if a game is rated overwhelmingly positive, I'm gonna like it. The moment it's just mostly positive, it doesn't stay as a favorite for me.

Re: Ask HN: What are you actually using LLMs for in production?

#24
post #18

When a customer onboards, we scrap their website to pre-fill some answers and pre-create certain settings (categories, tags, etc.). Ideally the customer spends most of the time just confirming things.

This is something we've been doing as well, and it's pretty magical when the user has a fully customized experience.

That said, it required the user to sign in with their real work email or the results are way off.

Re: Ask HN: What are you actually using LLMs for in production?

#25

Analyzing firehoses of data. RSS feeds, releases, stuff like that. My job involves curating information and while I still do that process by hand, LLMs make my net larger and help me find more signals. This means hallucinations or mistakes aren't a big deal, since it all ends up with me anyway. I'm quite bullish on using LLMs as extra eyes, rather than as extra hands where they can run into trouble.

Is cost a major consideration for you here? Like if you're dealing with firehose data which I'm assuming is fairly high throughput, do you see an incentive for potentially switching to a more specific NLP classifier model rather than sticking with generative LLMs? Or is it that this is good enough/the ROI of switching isn't attractive? Or is the generative aspect adding something else here?

Re: Ask HN: What are you actually using LLMs for in production?

#26
Pretty much all of my productivity apps has LLM integration now. My language learning app uses them to break down phrases and get detailed definitions. My RSS app generates summaries. And recently I released an email app that's like Google Inbox in that it uses bundles. It also summarizes emails and extracts expiry and due dates.

Re: Ask HN: What are you actually using LLMs for in production?

#27
I created an agent to scan niche independent cinemas and create a repository of everything playing in my city. I have an LLM heavy workflow to scrape, clean, classify and validate the data. It can handle any page I throw at it with ease. Very accurate as well, less than 5% errors right now.

Re: Ask HN: What are you actually using LLMs for in production?

#29

We have a prompt that takes a job description and categorizes it based on whether it's an individual contributor role, manager, leadership, or executive, and also tags it based on whether it's software, mechanical, etc. We scrape job sites and use that prompt to create tags which are then searchable by users in our interface. It was a bit surprising to see how Karpathy described software 3.0 in his recent presentatio…

Can you elaborate on what makes this “software 3.0”? I didn’t really understand what the distinction was in Karpathy’s talk, and felt like I needed a more concrete example. What you describe sounds cool, but I still feel like I’m not understanding what makes it “3.0”. I’m not trying to criticize, I really am trying to understand this concept.

Re: Ask HN: What are you actually using LLMs for in production?

#30
Several things! But my favourite use-case works surprisingly well.

I have a js-to-video service (open source sdk, WIP) [1] with the classic "editor to the left - preview on the right" scenario.

To help write the template code I have a simple prompt input + api that takes the llms-full.txt [2] + code + instructions and gives me back updated code.

It's more "write this stuff for me" than vibe-coding, as it isn't conversational for now.

I've not been bullish on ai coding so far, but this "hybrid" solution is perfect for this particular use-case IMHO.

[1] https://js2video.com/play [2] https://js2video.com/llms-full.txt

Post reply on HN