Skip to content

Conversation

@yeahdongcn
Copy link
Collaborator

@yeahdongcn yeahdongcn commented Sep 29, 2024

This PR introduces Dockerfiles for musa, allowing the build of 3 Docker images: local/llama.cpp:full-musa, local/llama.cpp:light-musa, and local/llama.cpp:server-musa.

Testing done

  • Successfully built musa images.
  • Verified each Docker image runs with mt-container-toolkit and Llama 3.2 1B Instruct.

Logs

server-musa.log
light-musa.log
full-musa.log

@github-actions github-actions bot added documentation Improvements or additions to documentation devops improvements to build systems and github actions labels Sep 29, 2024
@yeahdongcn yeahdongcn changed the title mtgpu: support docker musa: add docker image support Sep 30, 2024
@yeahdongcn yeahdongcn marked this pull request as ready for review September 30, 2024 01:02
@yeahdongcn yeahdongcn marked this pull request as draft September 30, 2024 03:25
@yeahdongcn yeahdongcn force-pushed the docker branch 3 times, most recently from e1d085f to c4f906c Compare October 8, 2024 01:44
@yeahdongcn yeahdongcn marked this pull request as ready for review October 8, 2024 01:47
@yeahdongcn
Copy link
Collaborator Author

Everything is set now. @slaren, could you please take a look? Thanks!

@yeahdongcn yeahdongcn requested a review from slaren October 10, 2024 07:30
@slaren slaren merged commit cf8e0a3 into ggml-org:master Oct 10, 2024
53 checks passed
dsx1986 pushed a commit to dsx1986/llama.cpp that referenced this pull request Oct 29, 2024
* mtgpu: add docker image support

Signed-off-by: Xiaodong Ye <[email protected]>

* mtgpu: enable docker workflow

Signed-off-by: Xiaodong Ye <[email protected]>

---------

Signed-off-by: Xiaodong Ye <[email protected]>
arthw pushed a commit to arthw/llama.cpp that referenced this pull request Nov 15, 2024
* mtgpu: add docker image support

Signed-off-by: Xiaodong Ye <[email protected]>

* mtgpu: enable docker workflow

Signed-off-by: Xiaodong Ye <[email protected]>

---------

Signed-off-by: Xiaodong Ye <[email protected]>
arthw pushed a commit to arthw/llama.cpp that referenced this pull request Nov 18, 2024
* mtgpu: add docker image support

Signed-off-by: Xiaodong Ye <[email protected]>

* mtgpu: enable docker workflow

Signed-off-by: Xiaodong Ye <[email protected]>

---------

Signed-off-by: Xiaodong Ye <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

devops improvements to build systems and github actions documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants