Take it from someone on the other side - I frequently envy my 40 year old colleagues without kids. They travel, focus on their hobbies, and generally do what they want and seem happier and less stressed out. They have more money and drive nicer cars and have nicer, neater houses.
Kids are a major self sacrifice - you give up vast quantities of personal time and opportunities. It is a large trade off.