There are plenty of companies trying to grow slowly, via organic growth. Or even not grow at all (think about a restaurant - usually no growth is intended). There are even plenty of tech companies in that bucket.
However, VCs generally don't invest in these companies, for a variety of reasons. The bottom-line is that it doesn't make sense financially for the VC model, and it's not what the people who give the VCs money want.
VCs will often get money from pension funds, etc. These are companies managing billions of dollars, of which they allocate let's say 1% to VCs, with the idea of making a huge interest on their investments. E.g. typical real-estate or stock investments will give you a %5-%20 interest, and VCs are supposed to give you much higher numbers.
Again, this doesn't mean that there aren't plenty of tech companies out there who aren't looking for VC money or to grow rapidly, although there are structural reasons why lots of tech companies should look for that kind of growth (mostly, tech companies have way more ability to scale than e.g. restaurants). But most of these "smaller" companies are simply less visible - for obvious reasons, bigger companies are more visible, therefore more talked about.
BTW, let me just correct one misstatement - VCs are aiming for huge exits, but they are investing for often long time horizons - I think the typical time to an "exit" is 11 years these days, so it's not like they're trying to do a quick exit - quite the opposite, if a company exits after 3 years, it's almost certain they haven't become a unicorn.
Edit: Still one of the best pieces of writing on the idea of "2 kinds of companies", from Joel Spolsky: https://www.joelonsoftware.com/2000/05/12/strategy-letter-i-...