zuul-jobs/roles/upload-logs-swift
Clark Boylan 7755ef1b8d Use gzip to compress files uploaded to swift
We've discovered that rackspace swift seems to always want to gzip
encode files when clients request their contents. When our files are
deflate encoded this results in files that are first deflate encoded
then gzip encoded. Not all browers or layer 7 firewalls can handle this
(despite being perfectly valid according to the HTTP RFCs). We'll use
gzip to see if that causes rackspace to not double encode the files.

To do this with memory efficienty we vendor a tool from pypi called
gzip-stream which allows us to read chunks of the compressed data at a
time without loading the entire file into memory or writing multiple
gzip headers in a single file.

Change-Id: I9483cfdbd8e7d0683eeb24d28dd6d8b0c0e772fa
2019-10-11 11:32:17 -07:00
..
defaults upload-logs-swift: option for disabling the indexer 2019-06-05 17:08:59 +02:00
library Use gzip to compress files uploaded to swift 2019-10-11 11:32:17 -07:00
tasks Be consistent about spaces before and after vars 2019-08-07 20:17:41 +01:00
__init__.py Enable Python 2.7 unit tests 2018-08-17 10:23:20 +10:00
README.rst Add build shard log path docs to upload-logs(-swift) 2019-09-05 15:27:18 +00:00

Upload logs to a swift container

This uploads logs to an OpenStack Object Store (Swift) container.

Role Variables

Complex argument which contains the cloud configuration in os-cloud-config (clouds.yaml) format. It is expected that this argument comes from a Secret.