Part of it is also the creators optimizing for what the suggestion algorithm rewards. If you don't like the front page, you're looking for a needle in a haystack, because creators are rewarded very heavily for making the kind of content that lands on the front page and gets mass amounts of views.
Youtube doesn't have much of an incentive to show things that are not either popular in general, or that already worked on you in the past. There are some people that care strongly about that (me included), but it's a very small minority.
If the A/B test says distilled garbage is what hijacks the dopamine center the best, then you will be fed the A/B juice. And on average, people in your cohort will like it.