There are surely some startups for which this is bullshit. But the good version of it is:
- take some valuable task that's never been successfully automated before
- do it manually (and expensively) for a while to acquire data
- build an automated system with some combination of regular software and ML models trained on the data
- now you can do a valuable task for free
- scale up and profit
The risk is that it's hard to guess how much data you'll need to train an accurate, automated model. Maybe it's very large, and you can't keep doing it manually long enough to get there. Maybe it's very small and lots of companies will automate the same task and you won't have any advantage.
I think there'll be some big successes with this model, and many failures. So be skeptical -- ML isn't a magic bullet. But if a team has a good handle on how they're going to automate something valuable, it can be a good bet.
As an investor, you may well face the situation down the line "We've burned through $10M doing it manually, and we're sure that with another $10M we can finish the automation." Then you have to make a hard decision. With some applications like self-driving cars, it might be $10B.