Refine JIT Runtime/Compilation/Build Capabilities

[hunhoffe]

Description

This issue is used to track progress/plans for changes/extensions to the functionality for JIT Runtime/Compilation/Build Capabilities that are planned

Goals

• Reduce pain points and extend functionality for users with different purposes (users seeking an easy/simple path for education, etc., users seeking to use a piece of the toolstack but not the whole, researchers looking to extend/modify components within the toolstack).
• Sync implementation in this repo and implementation in amd/iron, which includes reducing the amount of duplicated functionality

Specific Tasks and their Related Issues/PRs

Completed

• Loosen XRT ties between the iron.Tensor class and PyXRT (Decouple IRON Tensor from XRT Host Runtime #2692)
• Update documentation on configuration options for the IRON python environment (Add Documentation for IRON Python Configuration Options/Methods #2717)
• Fix amd/IRON so I don't keep breaking it with these changes
  • Streamline versioning of mlir-aie release wheels: Make wheels for tagged releases with the appropriate version #2722 Fix github action syntax error. #2725
  • Use pinned release wheels in amd/IRON: Pin milr-aie version to a release and create action to keep it updated. amd/IRON#27
• Runtime refactor IRON host runtime abstraction #2737

General Code Cleanup

• Integrate python test lit config with helper classes #2684
• Support for numpy integer type conversion in scf for wrapper #2711 (bug from Jack that never become an issue)
• Refine default Python runtime sequence behavior; remove experimental code. #2687
• Python Device class extension and cleanup #2691
• Disambiguate python buffers #2724
• Tests to compare iron.Tensor and torch.Tensor #2731
• IRON Environment Var Documentation; minor code restructure. #2736

In Progress

• Integrate iron.Tensor into amd/IRON
  • First Step: Use runtime library Update mlir-aie with simplified installation of python extras amd/IRON#68
  • Second Step: Full integration

General Code Cleanup

• Device slicing [WIP] Stateful Destructive Device Slicing #2726
• SequentialPlacer cleanup [WIP] SequentialPlacer #2659 (prep PR: Device and ObjectFifo tests #2733)
• Dependency/Update management for maintainability (3 part task, issue here: Dependencies, Versioning, and Wheels #2805)

Future Work

• Integration of the parallel/algorithms capability: Parallel/algorithms #2730

Existing Issues that are Related

• Add trace with JIT example #2541
• Combining multiple object files in JIT #2530
• Add a code object cache for external functions #2509

[andrej]

Is the Compilable/Runnable abstraction you presented previously a part of this or a future stage?

[hunhoffe]

That is part of it, but the first steps are just to capture all the other in-flight efforts. And I've got breaking changes in the pipeline, so I really need to get the wheels pinning in amd/IRON finished before I can make too much progress.