Optimized Python Docker Image

#1

Post by webology » Sat, Dec 02, 2017, 7:43 PM UTC

Optimized Python Docker Image
revsys.com

Re: Optimized Python Docker Image

#2

Post by StavrosK » Sat, Dec 02, 2017, 8:49 PM UTC

Why aren't these just upstreamed onto the official Python binaries?

Re: Optimized Python Docker Image

#3

Post by Daviey » Sat, Dec 02, 2017, 9:01 PM UTC

Binary docker image, with no (public) reproducible build system? No thanks.

Re: Optimized Python Docker Image

#4

Post by mastax » Sat, Dec 02, 2017, 9:24 PM UTC

StavrosK wrote: post #2

Why aren't these just upstreamed onto the official Python binaries?

I think these optimizations are upstream, but they're not in the canonical 'python' docker image: https://github.com/docker-library/python/issues/160

Re: Optimized Python Docker Image

#5

Post by StavrosK » Sat, Dec 02, 2017, 9:30 PM UTC

mastax wrote: post #4

StavrosK wrote: post #2

Why aren't these just upstreamed onto the official Python binaries?

I think these optimizations are upstream, but they're not in the canonical 'python' docker image: https://github.com/docker-library/python/issues/160

Ah I see, that makes sense, thank you.

Re: Optimized Python Docker Image

#6

Post by greglindahl » Sat, Dec 02, 2017, 9:42 PM UTC

Daviey wrote: post #3

Binary docker image, with no (public) reproducible build system? No thanks.

Also, I wonder how many obscure bugs were introduced by using more aggressive compiler flags? The image has "lto" in the name, and at https://github.com/docker-library/python/issues/160 I see this comment:

> In the future the Python developers may decide to turn on further optimizations based on this argument, for example link-time optimizations (LTO), though they haven't worked out all the bugs for that one yet.

(Thanks mastax for finding the issue!)

Re: Optimized Python Docker Image

#7

Post by rcarmo » Sat, Dec 02, 2017, 10:59 PM UTC

I've been using --enable-optimizations for a while, and built my own 3.6 images a couple of weeks back.

Here's the Dockerfiles and readme:

https://github.com/rcarmo/ubuntu-python

Re: Optimized Python Docker Image

#8

Post by muxator » Sat, Dec 02, 2017, 11:19 PM UTC

Am I totally misunderstanding something or there is no Dockerfile referenced? If so, is this just a binary blob I pull from a public registry?

I have some trust concerns about basing my infrastructure on something opaque.

Re: Optimized Python Docker Image

#9

Post by frankwiles » Sat, Dec 02, 2017, 11:26 PM UTC

Daviey wrote: post #3

Binary docker image, with no (public) reproducible build system? No thanks.

Doh sorry that was an oversight on our part. Just pushed up the information and our benchmark runs here https://github.com/revsys/optimized-python-docker

Re: Optimized Python Docker Image

#10

Post by frankwiles » Sat, Dec 02, 2017, 11:26 PM UTC

muxator wrote: post #8

Am I totally misunderstanding something or there is no Dockerfile referenced? If so, is this just a binary blob I pull from a public registry? I have some trust concerns about basing my infrastructure on something opaque.

Absolutely! Was just an oversight on our part, here is the Dockerfile and build info https://github.com/revsys/optimized-python-docker