>>my goodness, it'd be slow and potentially flaky all via the web UI for those sites Generally, I've had better luck using undocumented APIs for this kind of stuff. I was a heavy user of Selenium to automate many a task (I work in wholesale construction goods, tons of automations needed everywhere). But then discovered that using internal APIs (which surprisingly don't change much) is far easier than trying to except…
(Facepalm) I read your post. Paused. Opened up debugger on the site I'm currently selenium-ising. reloaded. boom. there it is. The request, and beautiful json response. So...so..so much simpler. Thank you, my evening is sorted ;)
I had the same experience a couple years ago after spending months selenium-ing our ERP software.