Transferring large objects
As discussed in Chapter 2, OpenStack Swift Architecture, Swift limits a single object upload to 5 GB. Larger objects can be split into 5 GB or smaller segments by specifying the segment size option in the Swift CLI tool command-line argument, and uploaded to a special container (created within the container where the object is being uploaded).
Once the upload has been completed, a manifest object that contains information about the segments has to be created. The manifest file is of zero size, with headers such as X-Object-Manifest identifying the special container in which the segments are stored and the name with which all the segments will start. For example, if we have to upload France.txt (which is of size 8 GB) ...
Get OpenStack Object Storage (Swift) Essentials now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
