This seems different than the concept of infinite time, where prior to the big band there was something the collapsed into a ball of energy and maybe someday our universe will collapse back again (which has lost merit since we've seen matter in the universe isn't slowing down in spreading apart, but accelerating .. meaning in a few trillion years, atoms may be so far apart that light can't reach anything .. the event…
The answer is similar to the time. Remember, in cosmology there's no really separate space and time, there's only space-time.
So when you're looking at the edge of the observable universe, you really looking back in time. So the answer to the question "what is outside" is the same as "what was before".
Or, in simpler words, the question is meaningless, as there's no space to talk about "outside". Not sure the last phrase is correct, as I've just talked about separate space from time.