Repositories list

• mlcommons-ck

  Public
  Collective Knowledge (CK) and Common Metadata eXchange (CMX): community-driven projects to learn how to run AI, ML and other emerging workloads in a more effici…

  Python

  •

  Apache License 2.0

  •123•2•0•0•Updated Sep 13, 2025Sep 13, 2025

• cm4mlperf-results

  Public
  CM interface and automation recipes to analyze MLPerf Inference, Tiny and Training results. The goal is to make it easier for the community to visualize, compar…

  Python

  •

  Apache License 2.0

  •3•0•0•0•Updated Apr 9, 2025Apr 9, 2025

• artifact-evaluation

  Public
  Collective Knowledge repository to support artifact evaluation and reproducibility initiatives:

  reproducible-researchconferencesjournals+ 7collaborative-researchartifact-evaluationartifact-sharingpublic-reviewingartifact-evaluation-committeeartifact-appendixreproducibility-checklist

  JavaScript

  •

  Other

  •20•61•0•0•Updated Mar 21, 2025Mar 21, 2025

• cm4mlops

  Public
  A collection of portable, reusable and cross-platform automation recipes (CM scripts) to make it easier to build and benchmark AI systems across diverse models,…

  Python

  •

  Apache License 2.0

  •21•1•0•0•Updated Mar 13, 2025Mar 13, 2025

• mlcflow

  Public
  MLCFlow: Simplifying MLPerf Automations

  Python

  •

  Apache License 2.0

  •14•0•0•0•Updated Feb 11, 2025Feb 11, 2025

• test_mlperf_inference_submissions

  Public
  Mermaid

  •

  Apache License 2.0

  •0•0•0•0•Updated Feb 5, 2025Feb 5, 2025

• cm4research

  Public
  CM interface and automation recipes to access, manage, prepare, run and reproduce research projects from AI, ML and Systems conferences

  automationcollaborationreproducibility+ 4portabilityreusabilityartifact-evaluationcollective-mind

  HTML

  •

  MIT License

  •6•6•0•0•Updated Feb 4, 2025Feb 4, 2025

• mlperf-loadgen

  Public
  Minimal copy of the MLPerf loadgen

  C++

  •

  Apache License 2.0

  •0•0•0•0•Updated Feb 4, 2025Feb 4, 2025

• mlperf-automations

  Public
  Python

  •

  Apache License 2.0

  •23•0•0•0•Updated Jan 15, 2025Jan 15, 2025

• q2a-mlperf-visualizer

  Public
  MLPerf explorer beta

  visualizationmlperfmlperf-inference+ 1mlperf-inference-results

  PHP

  •

  Other

  •0•0•0•0•Updated Jan 14, 2025Jan 14, 2025

• MLPerf-Power-HPCA-2025

  Public
  Python

  •1•0•0•0•Updated Dec 13, 2024Dec 13, 2024

• mlcommons-inference-20241204

  Public
  Reference implementations of MLPerf™ inference benchmarks

  Python

  •

  Apache License 2.0

  •610•0•0•0•Updated Dec 4, 2024Dec 4, 2024

• mlperf-automations-20241204

  Public
  This repository contains the automations and scripts used to automate MLPerf benchmarks (mainly MLPerf inference for now)

  Python

  •

  Apache License 2.0

  •21•0•0•0•Updated Dec 4, 2024Dec 4, 2024

• go-mlperf-automations-20241204

  Public
  This repository contains the automations and scripts used to automate MLPerf benchmarks (mainly MLPerf inference for now)

  Python

  •

  Apache License 2.0

  •21•0•0•0•Updated Dec 4, 2024Dec 4, 2024

• cm4mlops-20241204

  Public
  A collection of portable, reusable and cross-platform automation recipes (CM scripts) to make it easier to build and benchmark AI systems across diverse models,…

  Python

  •

  Apache License 2.0

  •21•0•0•0•Updated Dec 4, 2024Dec 4, 2024

• go-cm4mlops-20241204

  Public
  A collection of reusable and cross-platform automation recipes (CM scripts) with a human-friendly interface and minimal dependencies to make it easier to build,…

  Python

  •

  Apache License 2.0

  •21•0•0•0•Updated Dec 4, 2024Dec 4, 2024

• mlperf_inference_test_submissions_v5.0_20241204

  Public
  Mermaid

  •5•0•0•0•Updated Dec 4, 2024Dec 4, 2024

• go-mlperf_inference_unofficial_submissions_v5.0-20241204

  Public
  These are automated test submissions for validating the MLPerf inference workflows

  Mermaid

  •2•0•0•0•Updated Dec 4, 2024Dec 4, 2024

• mlcommons-ck-20241204

  Public
  Collective Knowledge (CK) and Collective Mind (CM): educational community projects to learn how to run AI, ML and other emerging workloads in a more efficient a…

  Python

  •

  Apache License 2.0

  •123•0•0•0•Updated Dec 3, 2024Dec 3, 2024

• mlcommons-cm4abtf-20241205

  Public
  CM interface and automation recipes for ABTF

  Python

  •

  Apache License 2.0

  •4•0•0•0•Updated Nov 29, 2024Nov 29, 2024

• cm4abtf-20241204

  Public
  CM interface and automation recipes for ABTF

  Python

  •

  Apache License 2.0

  •4•0•0•0•Updated Nov 29, 2024Nov 29, 2024

• go-cm4mlperf-inference-20241204

  Public
  Mermaid

  •

  Apache License 2.0

  •35•0•0•0•Updated Nov 29, 2024Nov 29, 2024

• go-inference_results_visualization_template-20241204

  Public template
  JavaScript

  •

  Apache License 2.0

  •8•0•0•0•Updated Nov 27, 2024Nov 27, 2024

• go-cm-20241204

  Public
  Collective Mind

  Python

  •

  Apache License 2.0

  •123•0•0•0•Updated Nov 25, 2024Nov 25, 2024

• cm4mlperf-inference-20241204

  Public
  Apache License 2.0

  •35•0•0•0•Updated Nov 21, 2024Nov 21, 2024

• inference_results_visualization_template-20241206

  Public template
  JavaScript

  •

  Apache License 2.0

  •8•0•0•0•Updated Oct 1, 2024Oct 1, 2024

• inference_results_v4.0

  Public
  This repository contains the results and code for the MLPerf™ Inference v4.0 benchmark.

  C++

  •

  Apache License 2.0

  •17•0•0•0•Updated Jul 15, 2024Jul 15, 2024

• ck-quantum

  Public
  Miscellaneous resources for Quantum Collective Knowledge

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •5•32•3•0•Updated Jun 6, 2024Jun 6, 2024

• ck_mlperf_results

  Public
  Outdated

  Python

  •

  Apache License 2.0

  •3•1•0•0•Updated Mar 30, 2024Mar 30, 2024

• inference_results_v3.1

  Public
  This repository contains the results and code for the MLPerf™ Inference v3.1 benchmark.

  Apache License 2.0

  •13•0•0•0•Updated Mar 14, 2024Mar 14, 2024