If any tool you're trying to use (pip, python, spin, etc) is missing, always stop and ask the user if an environment is needed. Do NOT try to find alternatives or install these tools.
Always ask for build configuration environment variables before running build.
All build (both codegen, C++ and python) is done via pip install -e . -v --no-build-isolation.
You should NEVER run any other command to build PyTorch.
Use our test class and test runner:
from torch.testing._internal.common_utils import run_tests, TestCase
class TestFeature(TestCase):
...
if __name__ == "__main__":
run_tests()
To test Tensor equality, use assertEqual.
For tests over multiple inputs, use the @parametrize decorator.
For any test that checks numerics of the on-device implementation, use instantiate_device_type_tests to write device-generic tests.
Only use commands provided via spin for linting.
Use spin help to list available commands.
Generally, use spin lint as to run the lint and spin fixlint to apply automatic fixes.
Don't commit unless the user explicitly asks you to.
When writing a commit message, don't make a bullet list of the individual changes. Instead, if the PR is large, explain the order to review changes (e.g., the logical progression), or if it's short just omit the bullet list entirely.
Disclose that the PR was authored with Claude.
Follow these rules for all code changes in this repository:
- Minimize comments; be concise; code should be self-explanatory and self-documenting.
- Comments should be useful, for example, comments that remind the reader about some global context that is non-obvious and can't be inferred locally.
- Don't make trivial (1-2 LOC) helper functions that are only used once unless it significantly improves code readability.
- Prefer clear abstractions. State management should be explicit.
For example, if managing state in a Python class: there should be a clear
class definition that has all of the members: don't dynamically
setattra field on an object and then dynamicallygetattrthe field on the object. - Match existing code style and architectural patterns.
- Assume the reader has familiarity with PyTorch. They may not be the expert on the code that is being read, but they should have some experience in the area.
If uncertain, choose the simpler, more concise implementation.
Use torch._dynamo.config.patch for temporarily changing config. It can be used as a decorator on test methods or as a context manager:
# Good - use patch as decorator on test method
@torch._dynamo.config.patch(force_compile_during_fx_trace=True)
def test_my_feature(self):
# test code here
pass
# Good - use patch as context manager
with torch._dynamo.config.patch(force_compile_during_fx_trace=True):
# test code here
pass
# Bad - manual save/restore
orig = torch._dynamo.config.force_compile_during_fx_trace
try:
torch._dynamo.config.force_compile_during_fx_trace = True
# test code here
finally:
torch._dynamo.config.force_compile_during_fx_trace = origIf B950 line too long triggers on a multi-line string block, you cannot fix it by putting # noqa: B950 on that line directly, as that would change the meaning of the string, nor can you fix it by line breaking the string (since you need the string to stay the same). Instead, put # noqa: B950 on the same line as the terminating triple quote.
Example:
self.assertExpectedInline(
foo(),
"""
this line is too long...
""", # noqa: B950
)
When adding debug logging for errors or diagnostic info, consider two user personas:
- Local development: Users run locally and can access files on disk
- Production jobs: Users can only access logs via
tlparsefrom structured traces
For production debugging, use trace_structured to log artifacts:
from torch._logging import trace_structured
# Log an artifact (graph, edge list, etc.)
trace_structured(
"artifact",
metadata_fn=lambda: {
"name": "my_debug_artifact",
"encoding": "string",
},
payload_fn=lambda: my_content_string,
)To check if structured tracing is enabled (for conditional messaging):
from torch._logging._internal import trace_log
if trace_log.handlers:
# Structured tracing is enabled, suggest tlparse in error messages
msg += "[Use tlparse to extract debug artifacts]"Best practices for error diagnostics:
- Always log to
trace_structuredfor production (no runtime cost if disabled) - If you're dumping debug info in the event of a true internal compiler exception, you can also consider writing to local files for local debugging convenience
- In error messages, tell users about both options:
- Local files: "FX graph dump: min_cut_failed_graph.txt"
- Production: "Use tlparse to extract artifacts" (only if tracing enabled)
- Use
_get_unique_path()pattern to avoid overwriting existing debug files