So, what can you do with a (de-Facebooked) one of these then?
They're everywhere and its a problem. Google taught humanity that its OK to have tracking everywhere, if that's used only to enhance user experience. However, now other identity ecosystems are using that power for purposes which people may not be ok with. It should be easy to opt out of it [0].
EDIT: Apologies, I re-read your question and it appears to be a genuine one which I did not answer i.e. if doing this hampers the usage of the oculus device. I'll leave my answer up though, if anyone else is interested in this aspect of the discussion.
[0]: Facebook does appear to have an opt out page. Try going there and opting out. Just go there, please, before responding: https://www.facebook.com/ads/settings