The entire point is to make it a game of skill, yes. In spec racing, you can't just buy yourself a win by having more money to spend on a faster car. Thousands of amateur-level racers deliberately seek this type of competition out specifically because it's more fun to them to have a competition where it's all about skill rather than how good your equipment is. The idea that this is "taking the fun out" seems precisely backwards to me.