Live data from Hacker News

Which kinds of GPT startups will thrive?

assistedeverything.substack.com

71–80 of 87 posts

Re: Which kinds of GPT startups will thrive?

#71
post #31

Earlier quoted context omitted.

Google/MS make generic software for businesses and developers. They don't really get involved in specific verticals (aside from obvious ones like cloud, gaming, marketing). Successful start-ups will be the ones taking models from big tech cos and bringing them to the boring verticals those companies have no interest in.

Then one day Google tweaks their model in an unfortunate way and you fall all the way down that vertical.

Just build a product that is even slightly reliant upon customer service. They won't know how to compete.

Re: Which kinds of GPT startups will thrive?

#72
Make things more simpler, more convenient, and faster for the end user, even if it makes things a bit worse, stupider, and more annoying for everyone else.

Prompt assistance

Prompt/Result sharing

Easily fine tune your own dataset

Type barely anything and get something reasonably valuable

Click to build prompts without having to type

Automatic results based on other activity (location, browsing, messages)

Re: Which kinds of GPT startups will thrive?

#73

Let's call the other guys "Gatekeepers" (Open.AI, Google with Bard, etc). Option 1: none. Most of the value will be captured by Gatekeepers Option 2: Gatekeepers will partially commoditize their service, and on top of them, several startups will thrive by creating something not easily replicable by Gatekeepers (via patents, via speed of execution, via viral growth, etc). Example: biggest GPT-powered media startup wil…

Could you expand on option 3?

Re: Which kinds of GPT startups will thrive?

#74
post #68

What kind of deep learning startups survived or thrived? The underlying technology (of gpt et al) is racing towards being a commodity. There are very few "pure play" "AI" companies left from the deep learning wave, and what few there are pivoted to become SaaS with some ML features. Something similar will happen here. Companies that solve a business pain point, irrespective of whatever "AI" will get somewhere.

I wonder if the issues around owning of training data may allow larger, well funded companies to acquire ownership (for example, buying stack overflow content). This might allow larger players to starve smaller players.

If we're not already, I'd expect to see lots of previously public content get locked down so it can be monetized. It will be interesting to see what the long run equilibrium looks like, as in will large players play ball?

I'd guess that the future high value application will still have lots of fine tuning on more specialized datasets, which will continue to be a bottleneck and be considered valuable, while the large scale training data will be less important (with respect to transformer llms, who knows if there is some newer breakthrough). Same way that e.g. everybody uses CNNs pertained on imagenet, and fine tunes on application specific stuff, and there was not much of a commercial push (imo) to rush out and build a better general purpose large scale image set like imagenet.

Re: Which kinds of GPT startups will thrive?

#76

Not many of them. Google or Microsoft can see what works for these startups and then put it in their own products. If you don't own the model, you don't have a safe business.

I think it's only a matter of time until open source models catch up.

Closed source models are also improving. Not clear to me why would open source models will catch up.

Re: Which kinds of GPT startups will thrive?

#77
Disgusting content marketing. The shtick works like this:

1. Think of a topic that is remotely related to the product you are trying to sell (GPT can even help with that).

2. Write a low-value (what new thing really did you learn from reading this?) article that looks like it's providing useful insight.

3. End with a shameless plug about a service you are trying to sell.

I thought this scam was debunked a few days ago right here on Hackernews? Why is it still getting upvoted?

Re: Which kinds of GPT startups will thrive?

#78

Earlier quoted context omitted.

I want to agree, but I think that’s what I thought at the dawn of Web 2.0 — no way slapping a basic CRUD UI on top of an open-source database will ever power anything but the most trivial use cases. Turns out knowing Excel and programming and NOT knowing business and design (at that point in my career) might have cost me a couple bucks.

There's millions of small businesses that don't know what CRUD or open source means. Hell just last year I helped a neighbor get a basic informational website up for a non profit he was part of. They tried it themselves but bungled it a bit. They want something a bit nicer now and he said they're paying someone $16k to redo it.

A nonprofit that I was (voluntarily) running a mostly static wordpress website for paid a consultant thousands to rewrite the whole website because they wanted an entire conference registration and scheduling system. The new website is still in wordpress, they're paying hundreds per month in 'maintenance fees' but can't get the consultants to do anything for them, I don't have admin access, it doesn't have any new conference or scheduling functionality, and they don't understand why I don't want to help them any more.

Re: Which kinds of GPT startups will thrive?

#80

Earlier quoted context omitted.

There's millions of small businesses that don't know what CRUD or open source means. Hell just last year I helped a neighbor get a basic informational website up for a non profit he was part of. They tried it themselves but bungled it a bit. They want something a bit nicer now and he said they're paying someone $16k to redo it.

A nonprofit that I was (voluntarily) running a mostly static wordpress website for paid a consultant thousands to rewrite the whole website because they wanted an entire conference registration and scheduling system. The new website is still in wordpress, they're paying hundreds per month in 'maintenance fees' but can't get the consultants to do anything for them, I don't have admin access, it doesn't have any new co…

If you or they have access to the database, just assign you/them an admin role and/or change the password and/or create a new user.

Consider any contracts currently in place before you do something like this, and figure out who is the name on the hosting, or whose server it is.

Post reply on HN