Skip to content

Conversation

@ekcasey
Copy link
Contributor

@ekcasey ekcasey commented Jul 18, 2025

Add POST /models/load endpoint to the model manager which allows TAR formatted models to by streamed from the client and stored in the archive. See docker/model-distribution#113 for formatting details.

Endpoint should be analagous to POST images/load in the docker engine API.

@ekcasey ekcasey force-pushed the model-load branch 2 times, most recently from fafd9e8 to 14de02e Compare July 24, 2025 02:59
@ekcasey ekcasey requested a review from xenoscopic July 24, 2025 02:59
@ekcasey ekcasey force-pushed the model-load branch 2 times, most recently from 0dfa50a to f667a10 Compare July 24, 2025 03:37
@ekcasey ekcasey marked this pull request as ready for review July 24, 2025 03:39
Signed-off-by: Emily Casey <[email protected]>
@doringeman doringeman merged commit 7777c22 into main Jul 24, 2025
4 checks passed
@doringeman doringeman deleted the model-load branch July 24, 2025 11:52
doringeman added a commit to doringeman/model-runner that referenced this pull request Sep 23, 2025
* Adds support for packaging/loading models to/from TAR archive

Signed-off-by: Emily Casey <[email protected]>

* Check for blobs when writing manifest

Signed-off-by: Emily Casey <[email protected]>

* LoadModel: don't crash on cancellation

Signed-off-by: Dorin Geman <[email protected]>

---------

Signed-off-by: Emily Casey <[email protected]>
Signed-off-by: Dorin Geman <[email protected]>
Co-authored-by: Dorin Geman <[email protected]>
doringeman added a commit to doringeman/model-runner that referenced this pull request Sep 23, 2025
* Adds support for packaging/loading models to/from TAR archive

Signed-off-by: Emily Casey <[email protected]>

* Check for blobs when writing manifest

Signed-off-by: Emily Casey <[email protected]>

* LoadModel: don't crash on cancellation

Signed-off-by: Dorin Geman <[email protected]>

---------

Signed-off-by: Emily Casey <[email protected]>
Signed-off-by: Dorin Geman <[email protected]>
Co-authored-by: Dorin Geman <[email protected]>
doringeman added a commit to doringeman/model-runner that referenced this pull request Sep 24, 2025
* Adds support for packaging/loading models to/from TAR archive

Signed-off-by: Emily Casey <[email protected]>

* Check for blobs when writing manifest

Signed-off-by: Emily Casey <[email protected]>

* LoadModel: don't crash on cancellation

Signed-off-by: Dorin Geman <[email protected]>

---------

Signed-off-by: Emily Casey <[email protected]>
Signed-off-by: Dorin Geman <[email protected]>
Co-authored-by: Dorin Geman <[email protected]>
doringeman added a commit to doringeman/model-runner that referenced this pull request Sep 24, 2025
* Adds support for packaging/loading models to/from TAR archive

Signed-off-by: Emily Casey <[email protected]>

* Check for blobs when writing manifest

Signed-off-by: Emily Casey <[email protected]>

* LoadModel: don't crash on cancellation

Signed-off-by: Dorin Geman <[email protected]>

---------

Signed-off-by: Emily Casey <[email protected]>
Signed-off-by: Dorin Geman <[email protected]>
Co-authored-by: Dorin Geman <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants