feat(container): Run dataset and model initializers in parallel

[HKanoje]

What you would like to be added?

Support for running dataset and model initializer containers in parallel instead of sequentially in the container backend.

Why is this needed?

Currently, when both dataset and model initializers are configured, they run one after another. Since Docker and Podman support multiple containers mounting the same volume simultaneously, running them in parallel would reduce the total initialization time - especially beneficial when downloading large datasets and models.

Reference: #188

Love this feature?

Give it a 👍 We prioritize the features with most 👍

[github-actions]

🎉 Welcome to the Kubeflow SDK! 🎉

Thanks for opening your first issue! We're happy to have you as part of our community 🚀

Here's what happens next:

• Our team will review your issue soon! cc @kubeflow/kubeflow-sdk-team
• If you'd like to contribute to this issue, check out our Contributing Guide for repo-specific guidelines and the Kubeflow Contributor Guide for general community standards

Join the community:

• Slack: Join our #kubeflow-ml-experience and #kubeflow-trainer Slack channels
• Meetings: Attend the Kubeflow SDK and ML Experience bi-weekly meetings

Feel free to ask questions in the comments if you need any help or clarification!
Thanks again for contributing to Kubeflow! 🙏

[andreyvelich]

/remove-label lifecycle/needs-triage
/area local
/good-first-issue

[google-oss-prow]

@andreyvelich:
This request has been marked as suitable for new contributors.

Please ensure the request meets the requirements listed here.

If this request no longer meets these requirements, the label can be removed
by commenting with the /remove-good-first-issue command.

Details

In response to this:

/remove-label lifecycle/needs-triage
/area local
/good-first-issue

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.