I have a MsC in CS. While I spent half of my career writing device drivers, the other half was doing computer architecture. You could say I had a foot on the low level software side, and the other foot on the high-level hardware side. I found them to be two sides of the same coin. Understanding how hardware folks see the world took a few years, but it was very doable.
My biggest gripe with the semiconductor industry as a career, compared to software, is twofold.
First, it is very concentrated. If you want to make good money there are only a handful of potential employers, and this only a handful of cities/neighborhoods where you will have to live; remote work is theoretically possible but not all employers make it effective. I found this the most frustrating. The upside is that people know this and this tend to stay at the same employer for a long time, so you get to learn from people with a deep understanding of the product, and people are mindful to keep a pleasant work environment.
Second, the pay isn't as good at the top end. If you have FAANG-level skills, you will typically do much better financially there than in the semiconductor industry —with the notable exception of NVidia for the past decade or so.