A few thoughts on this:
1. I have done transactional work and litigation in and about these areas for nearly 30 years in Silicon Valley. Based on that experience, in practical terms, the risk you deal with in doing side work boils down to this: it is rare that an employer will make a claim to IP you develop on your own time and using your own resources but, when it does happen, its effect is pretty horrific.
2. California gives you more scope only because it has a law on the books that generally prohibits employers, on public policy grounds, from making claims to IP generated by employees working on their own time and using their own resources.
3. Even in California, however, an employee owes duties to his employer and one of those is that you don't misappropriate your employer's IP for your own use. This is why the California law says that you don't keep your side-project IP for yourself if it is in your employer's line of business or anticipated line of business. You can imagine the chaos that would result if any employee could state that, "no, that valuable IP that I came up with might have directly concerned what my employer was paying me to develop, but, in fact, I developed that particular key piece on my own time, etc."
4. In this sense, there is a common sense element to this area of law as applied in California. You typically will sense, without being told, whether the work you are doing on the side is capitalizing on the things your employer is doing or if it is truly unrelated.
5. That said, don't mess around with this sort of thing. It is both contract-specific and local-law-specific. That means general statements you hear from time to time (including those I just made) may or may not apply to you. If what you are planning to do has commercial value, then make sure to get it checked by a good local lawyer who can guide you through the pitfalls and explain alternatives. This is particularly so if you are not in California.