Explain pitch (#28)

Author: msaroufim

README.md

@@ -1,3 +1,15 @@
+## BackendBench
+
+A lot of people are now interested in optimizing existing kernels in PyTorch. This audience includes both systems researchers experimenting with new DSLs and LLM researchers looking to automate kernel authoring completely. But many existing efforts have been plagued by how to ensure correctness.
+
+Our take is that if a kernel can replace an existing PyTorch operator and be merged into PyTorch's official codebase then it's far more likely to be correct but hacking on PyTorch's kernels has historically been challenging.
+
+BackendBench is an evaluation suite that tests how good LLMs and humans are at writing a full fledged PyTorch backend. We make it possible for developers to add their custom kernels in well organized directory structure and dynamically override the core PyTorch aten operators at runtime. The outcome is a fully functional readable PyTorch backend you can pip install and run real models on with no model changes!
+
+We provide both
+1. Comprehensive operator level correctness checks using the PyTorch OpInfo test suite
+2. Performance checks using the ops that show up in the most popular Hugging Face models with realistic tensor shapes
+
 # Usage:
 
 Run a simple smoke test (relu) with the default ATen backend:
@@ -33,4 +45,4 @@ Run LLM evaluation on smoke test (relu operation):
 ```bash
 export ANTHROPIC_API_KEY=your_api_key_here
 python scripts/main.py --suite smoke --backend llm
-```
+```