Advanced usage of Python requests: timeouts, retries, hooks

Post by dhxt » Fri, Feb 28, 2020, 1:55 PM UTC

Post by dhxt » Fri, Feb 28, 2020, 4:20 PM UTC

hmhrex wrote: post #2

Thank you for this brief reference. I'm always going back to my old projects to remind myself how I did things with requests. I didn't realize some of things existed.

Post by dhxt » Fri, Feb 28, 2020, 4:28 PM UTC

sciurus wrote: post #4

I wish that requests had a default timeout instead of defaulting to waiting forever. It's very easy for devs to forget to think about timeouts, but inevitably that ends in a cascading production outage.

Post by dhxt » Fri, Feb 28, 2020, 4:35 PM UTC

sciurus wrote: post #6

dhxt wrote: post #5

Earlier quoted context omitted.

I'm not sure if you noticed, but the post contains a section on how to set default timeouts. https://findwork.dev/blog/advanced-usage-python-requests-tim...

Right. I'm saying the library should set a default timeout by default , which you could then change if needed. Of course, whatever it chose would inevitably be wrong for many scenarios, it would be less wrong than defaulting to waiting forever.

Post by hmhrex » Fri, Feb 28, 2020, 4:47 PM UTC

dhxt wrote: post #3

hmhrex wrote: post #2

Thank you for this brief reference. I'm always going back to my old projects to remind myself how I did things with requests. I didn't realize some of things existed.

You're welcome. I thought I'd aggregate all the useful tricks I'd found while working on my last project. It's a collection of snippets I had found in the docs and in Github issues. The post contains the most important snippets, but you might find the advanced section of the requests docs [1] useful and the requests_toolbelt [2]. [1] https://requests.readthedocs.io/en/master/user/advanced/ [2] https://toolbelt.readth…