chunklevel. For example, when creating a tensor for storing images, you can choose the compression technique for the image samples using the
.append(...)calls is compressed using the specified
video,...), choose the
sample_compressiontechnique that is native to the application such as
lz4is a generic compressor that works well in most applications.
lz4can be used as a
chunk_compression. In most cases,
sample_compressionis sufficient, but in theory,
chunk_compressionproduces slightly smaller data.
jpegcompression may result in a 10X difference in the size of a Hub dataset.
sample_compressioninput matches the compression of the source data, such as:
.jpg, and the hub
sample_compressionin Hub results in significantly slower upload speeds, because Hub must decompress the source data and recompress it using the specified