I think it would be really beneficial if there would be easy to set up docker image with Nginx reverse proxy. It would help greatly with reducing the load on OSM tile servers.
Are you simply trying to reduce the load on the OSM servers? We have a CDN, very nicely sponsored by Fastly, which does this very well and is probably closer to your eyeballs.