Skip to content

[ostree-rs-ext] Parallelize Writing OCI image #1683

@antheas

Description

@antheas

Currently, ostree-rs-ext is single threaded. When outputting a compressed gz images, this makes it so it requires around ~6min on a 2c/4t system for a large image such as Bazzite.

This could be more than halved by outputting the layers in parallel, as there is no implicit requirement for them to be linked. However, the current code makes it difficult to achieve due to the shared ostree object.

This consumes a large part of the build process, so let's try to improve on that over the next few months.

The compressed images it outputs compare favorably to compression by podman size-wise. In addition, when uploading multiple tags, podman recompresses the image per tag, so it cumulatively takes longer as opposed to uploading the raw oci with skopeo. Therefore, this fix should go to ostree-rs-ext.

Another 2 minutes could be spared by parallelizing ostree, however that would be much harder to do.

Metadata

Metadata

Assignees

No one assigned

    Labels

    triagedThis looks like a valid issue

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions