If they don't have FTL (including no time effects) they will never come. Space is too large to go anywhere useful. The nearest start is ~4 light years away, at 1/10th the speed of light (vastly faster than we know how to go) it is 40 years to get here! We have done a lot of searching for life and haven't found it, the closer the planet is, the more likely we are to find it, thus I think it is safe to concluded there is no life within 20 light years or so. At 20 light years communication via radio is hard to establish just because turn around time for questions won't be answered in a lifetime. (It will be interesting learning about their Roman Empire history, but if they explain science and there is even one thing we don't get the person who sends the what do you mean question is retired/dead before the answer arrives - unless a few years latter we figure it out anyway.
Take the civilization 20 light years away, either they left before they even know we existed (we didn't have any emissions that indicated intelligence, though they might be able to detect life), and so they are not equipped to deal with us. If they want to take over - they didn't break enough weapons because they didn't expect to need them.
Even if life is common in the universe, it isn't common in any area where an intelligent civilization can expect to actually reach without FTL.