22
33List of GGML operations and backend support status.
44
5+ ## How to add a backend to this table:
6+
7+ 1 . Run ` test-backend-ops support --output csv ` with your backend name and redirect output to a csv file in ` docs/ops/ ` (e.g., ` docs/ops/CUDA.csv ` )
8+ 2 . Regenerate ` /docs/ops.md ` via ` ./scripts/create_ops_docs.py `
9+
510Legend:
611- ✅ Fully supported by this backend
712- 🟡 Partially supported by this backend
@@ -18,7 +23,8 @@ Legend:
1823| ARGSORT | ❌ | ✅ | ✅ | ✅ |
1924| CLAMP | ❌ | ✅ | ✅ | 🟡 |
2025| CONCAT | ❌ | ✅ | 🟡 | ✅ |
21- | CONT | ❌ | ✅ | 🟡 | ✅ |
26+ | CONT | ❌ | ✅ | ✅ | ✅ |
27+ | CONV_2D | ❌ | ✅ | ❌ | ❌ |
2228| CONV_2D_DW | ❌ | ✅ | ✅ | ❌ |
2329| CONV_TRANSPOSE_1D | ❌ | ✅ | ✅ | ✅ |
2430| CONV_TRANSPOSE_2D | ❌ | ✅ | ✅ | ❌ |
@@ -30,7 +36,7 @@ Legend:
3036| DIAG_MASK_INF | ❌ | ✅ | ✅ | 🟡 |
3137| DIV | ❌ | ✅ | ✅ | 🟡 |
3238| DUP | ❌ | ✅ | 🟡 | 🟡 |
33- | ELU | ❌ | ✅ | ❌ | 🟡 |
39+ | ELU | ❌ | ✅ | 🟡 | 🟡 |
3440| EXP | ❌ | ✅ | 🟡 | ❌ |
3541| FLASH_ATTN_EXT | ❌ | ✅ | 🟡 | 🟡 |
3642| GATED_LINEAR_ATTN | ❌ | ✅ | ✅ | ❌ |
@@ -66,14 +72,16 @@ Legend:
6672| REPEAT_BACK | ❌ | ✅ | ✅ | ❌ |
6773| RMS_NORM | ❌ | ✅ | ✅ | 🟡 |
6874| RMS_NORM_BACK | ❌ | ✅ | ✅ | ❌ |
69- | RMS_NORM_MUL | ❌ | ✅ | ✅ | ✅ |
75+ | RMS_NORM_MUL | ❌ | ❌ | ❌ | ✅ |
76+ | RMS_NORM_MUL_ADD | ❌ | ✅ | ✅ | ❌ |
77+ | ROLL | ❌ | ✅ | ❌ | ❌ |
7078| ROPE | ❌ | ✅ | ✅ | ✅ |
7179| ROPE_BACK | ❌ | ✅ | ✅ | ❌ |
7280| RWKV_WKV6 | ❌ | ✅ | ✅ | ✅ |
7381| RWKV_WKV7 | ❌ | ✅ | ✅ | ✅ |
7482| SCALE | ❌ | ✅ | ✅ | ✅ |
7583| SET | ❌ | ✅ | ❌ | ✅ |
76- | SET_ROWS | ❌ | 🟡 | ❌ | 🟡 |
84+ | SET_ROWS | ❌ | 🟡 | 🟡 | 🟡 |
7785| SGN | ❌ | ✅ | 🟡 | ❌ |
7886| SIGMOID | ❌ | ✅ | 🟡 | 🟡 |
7987| SILU | ❌ | ✅ | 🟡 | 🟡 |
0 commit comments