11## Unified and cross-platform CM interface for DevOps, MLOps and MLPerf
22
33[ ![ License] ( https://img.shields.io/badge/License-Apache%202.0-green )] ( LICENSE.md )
4- [ ![ Python Version] ( https://img.shields.io/badge/python-3+-blue.svg )] ( https://github.com/mlcommons/ck/tree/master/cm/cmind )
54[ ![ Powered by CM] ( https://img.shields.io/badge/Powered_by-MLCommons%20CM-blue )] ( https://pypi.org/project/cmind ) .
6- [ ![ Downloads] ( https://static.pepy.tech/badge/cm4mlops )] ( https://pepy.tech/project/cm4mlops )
75
86[ ![ CM script automation features test] ( https://github.com/mlcommons/cm4mlops/actions/workflows/test-cm-script-features.yml/badge.svg )] ( https://github.com/mlcommons/cm4mlops/actions/workflows/test-cm-script-features.yml )
97[ ![ MLPerf inference bert (deepsparse, tf, onnxruntime, pytorch)] ( https://github.com/mlcommons/cm4mlops/actions/workflows/test-mlperf-inference-bert-deepsparse-tf-onnxruntime-pytorch.yml/badge.svg )] ( https://github.com/mlcommons/cm4mlops/actions/workflows/test-mlperf-inference-bert-deepsparse-tf-onnxruntime-pytorch.yml )
108[ ![ MLPerf inference MLCommons C++ ResNet50] ( https://github.com/mlcommons/cm4mlops/actions/workflows/test-mlperf-inference-mlcommons-cpp-resnet50.yml/badge.svg )] ( https://github.com/mlcommons/cm4mlops/actions/workflows/test-mlperf-inference-mlcommons-cpp-resnet50.yml )
119[ ![ MLPerf inference ABTF POC Test] ( https://github.com/mlcommons/cm4mlops/actions/workflows/test-mlperf-inference-abtf-poc.yml/badge.svg )] ( https://github.com/mlcommons/cm4mlops/actions/workflows/test-mlperf-inference-abtf-poc.yml )
12- [ ![ Test Compilation of QAIC Compute SDK (build LLVM from src)] ( https://github.com/mlcommons/cm4mlops/actions/workflows/test-qaic-compute-sdk-build.yml/badge.svg )] ( https://github.com/mlcommons/cm4mlops/actions/workflows/test-qaic-compute-sdk-build.yml )
13- [ ![ Test QAIC Software kit Compilation] ( https://github.com/mlcommons/cm4mlops/actions/workflows/test-qaic-software-kit.yml/badge.svg )] ( https://github.com/mlcommons/cm4mlops/actions/workflows/test-qaic-software-kit.yml )
14-
1510
1611# CM4MLOps repository
1712
18- ** CM4MLOps** repository is powered by the [ Collective Mind automation framework] ( https://github.com/mlcommons/ck/tree/master/cm ) ,
19- a [ Python package] ( https://pypi.org/project/cmind/ ) with a CLI and API designed for creating and managing automations.
13+ This repository is powered by the [ Collective Mind workflow automation framework] ( https://github.com/mlcommons/ck/tree/master/cm ) .
2014
2115Two key automations developed using CM are ** Script** and ** Cache** , which streamline machine learning (ML) workflows,
22- including managing Docker runs. Both Script and Cache automations are part of the ** cm4mlops ** repository.
16+ including managing Docker runs. Both Script and Cache automations are part of the ** cmx4mlops ** repository.
2317
24- The CM scripts, also housed in this repository, consist of hundreds of modular Python-wrapped scripts accompanied
18+ The [ CM scripts] ( https://access.cknowledge.org/playground/?action=scripts ) ,
19+ also housed in this repository, consist of hundreds of modular Python-wrapped scripts accompanied
2520by ` yaml ` metadata, enabling the creation of robust and flexible ML workflows.
2621
2722- ** CM Scripts Documentation** : [ https://docs.mlcommons.org/cm4mlops/ ] ( https://docs.mlcommons.org/cm4mlops/ )
2823- ** CM CLI Documentation** : [ https://docs.mlcommons.org/ck/specs/cm-cli/ ] ( https://docs.mlcommons.org/ck/specs/cm-cli/ )
2924
30- The ` mlperf-branch ` of the ** cm4mlops** repository is dedicated to developments specific to MLPerf Inference.
31- Please submit any pull requests (PRs) to this branch. For more information about using CM for MLPerf Inference,
32- refer to the [ MLPerf Inference Documentation] ( https://docs.mlcommons.org/inference/ ) .
33-
3425## License
3526
3627[ Apache 2.0] ( LICENSE.md )
@@ -45,17 +36,35 @@ Grigori Fursin, the cTuning foundation and OctoML donated the CK and CM projects
4536
4637* MLCommons
4738
48- ## CM author
39+ ## Author
4940
5041[ Grigori Fursin] ( https://cKnowledge.org/gfursin )
5142
52- ## CM concepts
43+ We sincerely appreciate all [ contributors] ( https://github.com/mlcommons/ck/blob/master/CONTRIBUTORS.md )
44+ for their invaluable feedback and support!
45+
46+ ## Concepts
5347
5448Check our [ ACM REP'23 keynote] ( https://doi.org/10.5281/zenodo.8105339 ) and the [ white paper] ( https://arxiv.org/abs/2406.16791 ) .
5549
56- ## CM script developers
50+ ## Test image classification and MLPerf R-GAT inference benchmark via CMX PYPI package
51+
52+ ``` bash
53+ pip install cmind
54+ pip install cmx4mlops
55+ cmx run script " python app image-classification onnx" --quiet
56+ cmx run script --tags=run,mlperf,inference,generate-run-cmds,_submission,_short --submitter=" MLCommons" --adr.inference-src.tags=_branch.dev --pull_changes=yes --pull_inference_changes=yes --submitter=" MLCommons" --hw_name=ubuntu-latest_x86 --model=rgat --implementation=python --backend=pytorch --device=cpu --scenario=Offline --test_query_count=500 --adr.compiler.tags=gcc --category=datacenter --quiet --v --target_qps=1
57+ ```
58+
59+ ## Test image classification and MLPerf R-GAT inference benchmark via CMX GitHub repo
5760
58- Arjun Suresh, Anandhu Sooraj, Grigori Fursin
61+ ``` bash
62+ pip uninstall cmx4mlops
63+ pip install cmind
64+ cmx pull repo mlcommons@ck --dir=cmx4mlops/cmx4mlops
65+ cmx run script " python app image-classification onnx" --quiet
66+ cmx pull repo mlcommons@ck --dir=cmx4mlops/cmx4mlops
67+ ```
5968
6069## Parent project
6170
0 commit comments