I have not read too deeply into this but, do any of these serverless environments offer GPUs? I'm sure there are ... reasons but the lack of GPU support in Lambda and Fargate remains a major paint point for AWS users. It's been keeping me wrangling EC2 instances for ML teams but I do wonder how much longer that will last.
The only big one I know of is Cloud Run on GCP. https://cloud.google.com/run/docs/configuring/services/gpu
This sounds very compelling. Thanks!