Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Don't build AI products the way everyone else is doing it

builder.io

Post reply on HN
Print view View original

121–130 of 261 posts

Re: Don't build AI products the way everyone else is doing it

#121

Post by tryauuum »

threeseed wrote: post #69
toyg wrote: post #53

Earlier quoted context omitted.

To be fair, LLMs as a tech are actually useful, even just to take human input. Blockchain an K8s though... Eh. Geekery for geekery's sake.

I've worked for a number of enterprise companies. All have moved to Kubernetes. And it's not just geekery by developers who aren't as smart as you. It's because it allows you to treat all of your infrastructure in one way. Whether you are on GCP, AWS or On-Premise, whether you use Java, Spark, Web Serving or ML Training, whether you are deploying direct to Production or go through multiple staging environments etc. I…

Do you run VMs inside kubernetes as well? I know this is possible but wonder how's the actual experience

Re: Don't build AI products the way everyone else is doing it

#122

Post by YetAnotherNick »

While the differentiation aspect is real, for pricing I did some calculation for self hosting and even with small models, you are likely to loose money unless you have very high rps with users could tolerate some random delay. It's very hard to even get 7B model to be cheaper than ChatGPT API. And that was pre price reduction.

Re: Don't build AI products the way everyone else is doing it

#123

Post by [deleted] »

bob1029 wrote: post #3

> The solution: create your own toolchain No thanks. I have an actual job & customer needs to tend to. I am about 80% of the way through integrating with the OAI assistant API. The real secret is to already have a viable business that AI can subsequently improve . Making AI the business is a joke of a model to me. You'd have an easier time pitching javascript frameworks in our shop. Our current application of AI is a…

[deleted]

Re: Don't build AI products the way everyone else is doing it

#125

Post by lhnz »

bob1029 wrote: post #111
wokwokwok wrote: post #62

Earlier quoted context omitted.

Did you read the article or are you responding to what you imagine it says? > a whole toolchain of specialized models, … all of these specialized models are combined with tons of just normal code and logic that creates the end result They are not referring to a toolchain as “write a compiler”. They are referring to it as “fine tune models with specific purposes and glue them together with normal code”. It’s a no-brai…

> They are referring to it as “fine tune models with specific purposes and glue them together with normal code”. > will be technically out competed by their competitors because fine tuned models are better . I disagree that fine tuning is the way to go. We spent a large amount of effort on that path and found it to be untenable for our business cases - not from an academic standpoint, but from a practical data manage…

I think this is exactly the kind of issue that the startup Klu [0] is trying to solve. Not everybody should be building their own custom toolchains for finetuning/prompting AI models and there is really quite a lot of work involved in data management/evaluation.

There's definitely a lot of value in adding some AI features into your applications, but if it's not your core business you shouldn't be spending a lot of your time building a toolchain to do so.

[0] https://klu.ai

Re: Don't build AI products the way everyone else is doing it

#126

Post by lagrange77 »

bob1029 wrote: post #3

> The solution: create your own toolchain No thanks. I have an actual job & customer needs to tend to. I am about 80% of the way through integrating with the OAI assistant API. The real secret is to already have a viable business that AI can subsequently improve . Making AI the business is a joke of a model to me. You'd have an easier time pitching javascript frameworks in our shop. Our current application of AI is a…

> Making AI the business is a joke of a model to me.

By AI you just mean LLMs, like most people recently, right?

Re: Don't build AI products the way everyone else is doing it

#127

Post by ericskiff »

threeseed wrote: post #73
BillFranklin wrote: post #7

This is a nice post, and I think it will resonate with most new AI startups. My advice would be don't build an AI product at all. To my mind an "x product" is rarely the framing that will lead to value being added for customers. E.g. a web3 product, an observability product, a machine vision product, an AI product. Like all decent startup ideas the obviously crucial thing is to start with a real user need rather than…

> I think most people I know offline hate interacting with chat bots as products It's hilarious to me when people are bringing back chat bots as a concept. We had chat bots a few years ago and it was something that almost all larger companies had built strategies around. The idea being that they could significantly reduce call centre staff and improve customer experience. And it wasn't just that the quality of the co…

A few months ago, I would’ve agreed with this in theory, but having interacted with an Apple chat bot recently that was fast, seemed empathetic, and immediately solved my problem, I do have to wonder if LLM powered support agents may finally swing this the other direction

Re: Don't build AI products the way everyone else is doing it

#128

Post by ryandrake »

fillskills wrote: post #37
BillFranklin wrote: post #7

This is a nice post, and I think it will resonate with most new AI startups. My advice would be don't build an AI product at all. To my mind an "x product" is rarely the framing that will lead to value being added for customers. E.g. a web3 product, an observability product, a machine vision product, an AI product. Like all decent startup ideas the obviously crucial thing is to start with a real user need rather than…

This. Avoid the “If have hammer, everything looks like a nail” strategy. Find a customer pain point and use the right blend of tools. You can also make a new tool where tools dont exist

Being a "AI startup" makes about as much sense as being a "Python startup."

What does your company do? We do Python!

OK, but what problem are you solving? Lots of them, but what's important is we solve it using Python code!

Re: Don't build AI products the way everyone else is doing it

#129

Post by mmoustafa »

ShamelessC wrote: post #24
mmoustafa wrote: post #4

Great tips. I tried to do this with SVG icons in https://unstock.ai before a lot of people started creating text-to-vector solutions. You also have to keep evolving!

Would it not make sense to use a text to image generator, then convert the image to svg using normal methods?

that’s what I do! it’s a fine tuned model and an svg converter

Re: Don't build AI products the way everyone else is doing it

#130

Post by worldsayshi »

ericskiff wrote: post #127
threeseed wrote: post #73

Earlier quoted context omitted.

> I think most people I know offline hate interacting with chat bots as products It's hilarious to me when people are bringing back chat bots as a concept. We had chat bots a few years ago and it was something that almost all larger companies had built strategies around. The idea being that they could significantly reduce call centre staff and improve customer experience. And it wasn't just that the quality of the co…

A few months ago, I would’ve agreed with this in theory, but having interacted with an Apple chat bot recently that was fast, seemed empathetic, and immediately solved my problem, I do have to wonder if LLM powered support agents may finally swing this the other direction

Until this point in time I've been extremely sceptical about chat bots. But LLM is changing the playing field. Chat bots often don't make sense but I do think there are a lot of cases they can do things other interfaces would struggle with.
Post reply on HN