Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: Are you making money from LLMs? How?

news.ycombinator.com

Post reply on HN
Print view View original

1–10 of 28 posts

Ask HN: Are you making money from LLMs? How?

#1

Post by kordlessagain »

I'm curious about the practical applications of large language models (LLMs) that are actually generating revenue. If you've successfully monetized an LLM-based product or service:

  What does your product/service do?
  How did you develop and launch it?
  Which LLM(s) are you using (e.g. GPT-4, Claude, open source models)?
  What's your revenue model?
  How much are you making (if you want to share, ballpark figures are fine)?
  What challenges have you faced?
  Any advice for others looking to enter this space?
I'm particularly interested in hearing about niche or unexpected applications, not just the obvious chatbots and writing assistants. Also curious about solo founders or small teams, not just well-funded startups.

Thanks for sharing your experiences!

Re: Ask HN: Are you making money from LLMs? How?

#3

Post by meyerluanna »

I’ve been using an AI chatbot powered by GPT-4 to manage customer service tasks for my small business. The chatbot handles basic queries, FAQ responses, and routing, and it’s been a great time-saver. The service operates on a freemium model, where the base features are free, and you can pay for more advanced capabilities like analytics and integrations.

One challenge I've noticed is ensuring it works seamlessly across different business needs while staying easy to use. For those exploring LLMs, starting with a targeted niche and iterating based on real user feedback has been essential in maximizing the tool’s efficiency.

Re: Ask HN: Are you making money from LLMs? How?

#5

Post by lbhdc »

What does your product/service do?

Ad tech

How did you develop and launch it?

New features for an existing product. Most of them were switched on globally when we launched them.

Which LLM(s) are you using (e.g. GPT-4, Claude, open source models)?

We started using language models before ChatGPT and friends came out. We built our models from scratch, and still use and update them.

What's your revenue model?

Saas

How much are you making (if you want to share, ballpark figures are fine)?

We don't charge extra for features that use ML, it's an implementation detail that our users don't care about. So, I am not sure what % of the whole they contribute to. Its not the majority.

What challenges have you faced?

"mlops" was a real challenge in the early days, and we built so many bespoke distributed systems to figure it out. Eventually we did, but finding the right balance between building a performant system and a system that doesn't explode in cost was tough. There is off the shelf things that do this these days, but they can be expensive.

Any advice for others looking to enter this space?

Solve problems customers are willing to pay for. Some of the features we have dreamed up have been total flops. Many of the features we have developed (ml or otherwise), while the add value for the customer and add to the moat, they aren't valuable enough that our users are willing to pay extra for it as a standalone product.

Re: Ask HN: Are you making money from LLMs? How?

#6

Post by readyplayernull »

meyerluanna wrote: post #3

I’ve been using an AI chatbot powered by GPT-4 to manage customer service tasks for my small business. The chatbot handles basic queries, FAQ responses, and routing, and it’s been a great time-saver. The service operates on a freemium model, where the base features are free, and you can pay for more advanced capabilities like analytics and integrations. One challenge I've noticed is ensuring it works seamlessly acros…

Thank you AI.

Re: Ask HN: Are you making money from LLMs? How?

#7

Post by lWaterboardCats »

lbhdc wrote: post #5

What does your product/service do? Ad tech How did you develop and launch it? New features for an existing product. Most of them were switched on globally when we launched them. Which LLM(s) are you using (e.g. GPT-4, Claude, open source models)? We started using language models before ChatGPT and friends came out. We built our models from scratch, and still use and update them. What's your revenue model? Saas How mu…

Would love to read an MLOps lessons learned or approach you had or if you recommend any particular books that really hit the nail on the head

Re: Ask HN: Are you making money from LLMs? How?

#9

Post by gtirloni »

lbhdc wrote: post #5

What does your product/service do? Ad tech How did you develop and launch it? New features for an existing product. Most of them were switched on globally when we launched them. Which LLM(s) are you using (e.g. GPT-4, Claude, open source models)? We started using language models before ChatGPT and friends came out. We built our models from scratch, and still use and update them. What's your revenue model? Saas How mu…

> There is off the shelf things that do this these days, but they can be expensive.

Could you share some names for someone inexperienced in MLOps to do some research?

Re: Ask HN: Are you making money from LLMs? How?

#10

Post by lbhdc »

gtirloni wrote: post #9
lbhdc wrote: post #5

What does your product/service do? Ad tech How did you develop and launch it? New features for an existing product. Most of them were switched on globally when we launched them. Which LLM(s) are you using (e.g. GPT-4, Claude, open source models)? We started using language models before ChatGPT and friends came out. We built our models from scratch, and still use and update them. What's your revenue model? Saas How mu…

> There is off the shelf things that do this these days, but they can be expensive. Could you share some names for someone inexperienced in MLOps to do some research?

https://www.kubeflow.org/

Kubeflow is the one I see used the most (self hosted). The public clouds also have products targeting these workloads.

Post reply on HN