Also be aware that there are a couple different kinds of "works without internet access".
One kind works without ever needing internet access (on the IOT device itself or on the app if it uses an app) except possibly when you want to install a firmware update and perhaps when first setting up the device.
The other kind requires you to log in to an account from the IOT vendor, but doesn't actually need internet access to then use the device. The thing to watch out for with these is that sometimes the login has a time limit so you occasionally have to re-login. Or sometimes you have to re-login if the vendor's app updates.
An example of the latter is some TP-Link smart plugs I have. I only use them from Apple Shortcuts, but it is still TP-Link's app controlling them underneath and occasionally the shortcut stops working until I open the TP-Link. When I do that I invariably find that I'm no longer logged in, and logging back in makes them work again.
For lights in particular another thing to consider when choosing them is what they do on power up. Some let you set the behavior and remember that on the IOT device, typically offering some subset of these options: light off; light full on; light however it was when power was last lost; light on to a specific brightness and color.
Some have one of those behaviors and you can't change it. Typically "light full on", because that means you can use it both as an ordinary bulb that you turn on and off from a regular light switch and as a fancy IOT light.
For lights that you only occasionally need to dim or change color on that can be great. But for lights that you often want to turn on and off remotely so you need to leave the switch on all the time it gets really annoying because every time you get a power outage or often even a significant power flicker they turn off and come back full on.