Earlier quoted context omitted.
You can work around that by saving your model and reloading.
Can you elaborate on this?
Colab Pro
101–108 of 108 posts
Re: Colab Pro
#102Earlier quoted context omitted.
Can you elaborate on this?
Have model training make checkpoints every five minutes. When the training gets interrupted, just restart it on a new instance from the last checkpoint. Repeat as necessary until hundreds of hours of training is completed.
Re: Colab Pro
#103Earlier quoted context omitted.
Probably because it's easier to buy something that costs $10/month instead of "maybe it will be $0, maybe it will be $300,000, we'll see at the end of the month!" When you're using your own money to pay for cloud resources, that unbounded worst case is pretty scary.
Google Cloud offers tools to limit your worst case expenses upfront.
Re: Colab Pro
#104Earlier quoted context omitted.
Google Cloud offers tools to limit your worst case expenses upfront.
But you have to admit that if you're just some scientist who wants to GPU-accelerate their Python notebook, "click here to pay $9.99" is a lot better UX than "just log into the Google Cloud Console and change 83 settings!"
Re: Colab Pro
#105Earlier quoted context omitted.
Have model training make checkpoints every five minutes. When the training gets interrupted, just restart it on a new instance from the last checkpoint. Repeat as necessary until hundreds of hours of training is completed.
Yes, exactly. To add one more detail: mount your Google Drive and save the checkpoint there.
Re: Colab Pro
#106Earlier quoted context omitted.
Yes, exactly. To add one more detail: mount your Google Drive and save the checkpoint there.
Cloud storage bucket works better than Google Drive for both training data and checkpoints; and if you're doing training on TPUs, then I believe that you must do the data exchange via cloud storage.
Re: Colab Pro
#107Just wanted to share a Colab alternative I work on called Gradient[0] (also includes a free GPU). Some of the key differences: - Faster storage. Colab uses Google Drive which is convenient to use but very slow. For example, training datasets often contain a large amount of small files (eg 50k images in the sample TensorFlow and PyTorch datasets). Colab will start to crawl when it tries to ingest these files which is…
Some more feedback: When I open the linked page, the page title instantly starts flashing between the actual title and "(2) New Messages!". At that point I knew without a doubt that this was not a product I would ever use. The "Contact Sales" button on the landing page makes things even more confusing. On the one hand you're using abusive practices like the one above to grab attention, something I usually associate w…
Re: Colab Pro
#108Earlier quoted context omitted.
Thanks for the feedback. Instance pricing is currently listed here ( https://gradient.paperspace.com/instances ) but we're working to make it simpler.
Really interesting product, but please disable the notification sound of your chatbot!