Skip to content

Commit d9fbdf6

Browse files
Adjust claude cron to real-world inference challenges (#211)
* Adjust claude cron to real-world inference challenges * PR feedback
1 parent 59e0e1b commit d9fbdf6

File tree

1 file changed

+9
-0
lines changed

1 file changed

+9
-0
lines changed

.github/workflows/create-challenge.yml

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -73,6 +73,15 @@ jobs:
7373
7474
Pick the next available challenge number that is NOT already taken by a merged challenge or an open PR. Also avoid creating a challenge on the same topic as any pending PR, even if the number differs.
7575
76+
THEME — REAL-WORLD INFERENCE KERNELS:
77+
Focus on challenges inspired by real-world ML inference workloads. Think about the building blocks of modern neural networks (transformers, diffusion models, LLMs, vision models) and the GPU kernels that make them fast. Good examples:
78+
- Fused inference kernels: fused SwiGLU/GeGLU MLP blocks, flash attention, paged attention, speculative decoding verification, quantized matmul (INT8/INT4), fused QKV projection, KV-cache updates
79+
- Sequence/token operations: top-k/top-p sampling, beam search step, KV-cache rotation, causal masking
80+
- Model architecture blocks: full transformer decoder block (like the existing GPT-2 challenge), mixture-of-experts routing, LoRA forward pass
81+
- Online/streaming algorithms: online softmax, streaming attention (process new queries without storing entire rows), continuous batching, prefix caching
82+
83+
Look at `challenges/medium/74_gpt2_block/` as the gold standard for this style of challenge. The solver should implement a meaningful, self-contained inference building block — not a toy operation.
84+
7685
HARD RULES:
7786
- Do NOT create trivial element-wise challenges. We have way too many (sigmoid, relu, silu, clipping, etc). If your idea is just "apply f(x) to every element", pick something else.
7887
- Do NOT duplicate existing challenges — check both the merged challenges in the repo AND the open PRs listed above.

0 commit comments

Comments
 (0)