Earlier quoted context omitted.
Google/MS make generic software for businesses and developers. They don't really get involved in specific verticals (aside from obvious ones like cloud, gaming, marketing). Successful start-ups will be the ones taking models from big tech cos and bringing them to the boring verticals those companies have no interest in.
Then one day Google tweaks their model in an unfortunate way and you fall all the way down that vertical.
Which kinds of GPT startups will thrive?
71–80 of 87 posts
Re: Which kinds of GPT startups will thrive?
#72Prompt assistance
Prompt/Result sharing
Easily fine tune your own dataset
Type barely anything and get something reasonably valuable
Click to build prompts without having to type
Automatic results based on other activity (location, browsing, messages)
Re: Which kinds of GPT startups will thrive?
#73Let's call the other guys "Gatekeepers" (Open.AI, Google with Bard, etc). Option 1: none. Most of the value will be captured by Gatekeepers Option 2: Gatekeepers will partially commoditize their service, and on top of them, several startups will thrive by creating something not easily replicable by Gatekeepers (via patents, via speed of execution, via viral growth, etc). Example: biggest GPT-powered media startup wil…
Re: Which kinds of GPT startups will thrive?
#74What kind of deep learning startups survived or thrived? The underlying technology (of gpt et al) is racing towards being a commodity. There are very few "pure play" "AI" companies left from the deep learning wave, and what few there are pivoted to become SaaS with some ML features. Something similar will happen here. Companies that solve a business pain point, irrespective of whatever "AI" will get somewhere.
I wonder if the issues around owning of training data may allow larger, well funded companies to acquire ownership (for example, buying stack overflow content). This might allow larger players to starve smaller players.
I'd guess that the future high value application will still have lots of fine tuning on more specialized datasets, which will continue to be a bottleneck and be considered valuable, while the large scale training data will be less important (with respect to transformer llms, who knows if there is some newer breakthrough). Same way that e.g. everybody uses CNNs pertained on imagenet, and fine tunes on application specific stuff, and there was not much of a commercial push (imo) to rush out and build a better general purpose large scale image set like imagenet.
Re: Which kinds of GPT startups will thrive?
#75Re: Which kinds of GPT startups will thrive?
#76Not many of them. Google or Microsoft can see what works for these startups and then put it in their own products. If you don't own the model, you don't have a safe business.
I think it's only a matter of time until open source models catch up.
Re: Which kinds of GPT startups will thrive?
#771. Think of a topic that is remotely related to the product you are trying to sell (GPT can even help with that).
2. Write a low-value (what new thing really did you learn from reading this?) article that looks like it's providing useful insight.
3. End with a shameless plug about a service you are trying to sell.
I thought this scam was debunked a few days ago right here on Hackernews? Why is it still getting upvoted?
Re: Which kinds of GPT startups will thrive?
#78Earlier quoted context omitted.
I want to agree, but I think that’s what I thought at the dawn of Web 2.0 — no way slapping a basic CRUD UI on top of an open-source database will ever power anything but the most trivial use cases. Turns out knowing Excel and programming and NOT knowing business and design (at that point in my career) might have cost me a couple bucks.
There's millions of small businesses that don't know what CRUD or open source means. Hell just last year I helped a neighbor get a basic informational website up for a non profit he was part of. They tried it themselves but bungled it a bit. They want something a bit nicer now and he said they're paying someone $16k to redo it.
Re: Which kinds of GPT startups will thrive?
#79Re: Which kinds of GPT startups will thrive?
#80Earlier quoted context omitted.
There's millions of small businesses that don't know what CRUD or open source means. Hell just last year I helped a neighbor get a basic informational website up for a non profit he was part of. They tried it themselves but bungled it a bit. They want something a bit nicer now and he said they're paying someone $16k to redo it.
A nonprofit that I was (voluntarily) running a mostly static wordpress website for paid a consultant thousands to rewrite the whole website because they wanted an entire conference registration and scheduling system. The new website is still in wordpress, they're paying hundreds per month in 'maintenance fees' but can't get the consultants to do anything for them, I don't have admin access, it doesn't have any new co…
Consider any contracts currently in place before you do something like this, and figure out who is the name on the hosting, or whose server it is.