Without a SIM card it would be a lot harder to do my taxes, access my online bank, check my insurance, etc., because the SIM card is used to veriy my identity using a solution called BankID. ( https://www.bankid.no/en/company/ ) It's a lot easier then the alternative with OTP codes, especially since BankID is now supported by a lot of different sites and services. From government, banking, phone companies, etc.
How has Norway solved the "slamming" problem, where attackers ring the phone company and get a duplicate SIM?
That plus the other things like storing the encrypted keys in the SIM card activated by logging in to a bank by some other means make it pretty secure.