That's right -- the atmosphere stays attached to the Earth mostly thanks to gravity, and the Earth's gravity in GR is almost entirely the gradient in clock rate near the Earth.
Near Earth’s surface, clocks lower down tick very slightly slower than clocks higher up. The change in tick rate is on the order of 10^(-16) per meter. While extremely small, that's enough to generate the familiar 9.8 m/s^2 spatial acceleration we experience. Such a small gradient in clock rates generates macrosopically noticeable spatial accelerations because the "translation" factor is c^2, a tremendously large number.
Now, if I wanted to cover all my bases here, I'd need to point out that gravity does also bend space -- that is just not a relevant factor for "ordinary" gravity acting on relatively slow moving matter (like the Earth itself, or the Earth's atmosphere). For instance, for light itself, spatial bending is just as important (in fact, the gravitational deflection of light by a weak static gravitational field is controlled by a near 50/50 split between spatial and temporal effects). Near a massive black hole, it's not that simple and can't meaningfully be understood in terms of "time" and "space" effects being independently separated.