Wider tires are not slower. They are heavier. Heavier tires are slower than light tires because they take significantly more energy to get them up to speed.
In particular their inertia is higher, and the tire is the worst place to put heavy things physically speaking.
But for most people, whether or not you went to the toilet before starting your ride, or had that bit of cake at the cafe stop, has a bigger impact than the additional grams on the tyres.