Skip to content

Commit d161b56

Browse files
authored
refactor: cleanup codebase after tvm-ffi refactor (flashinfer-ai#1795)
<!-- .github/pull_request_template.md --> ## πŸ“Œ Description The codegen logic for pytorch and tvm should unify after flashinfer-ai#1641 , and this PR cleans up the related codegen functions in tvm_bindings. Other changes: 1. update tvm-ffi to 0.1.0b11 to incorporate apache/tvm-ffi#67 and apache/tvm-ffi#68 2. rename of source files: `_ops.cu` and `_pybind.cu` renamed to `_binding.cu` 3. remove torch related header include/library linking in ninja files (flashinfer-ai#1642 (comment)) 4. remove the use of `use_torch_stream` in unittests, they are no longer required after apache/tvm-ffi#68 ## πŸ” Related Issues flashinfer-ai#1641 ## πŸš€ Pull Request Checklist Thank you for contributing to FlashInfer! Before we review your pull request, please make sure the following items are complete. ### βœ… Pre-commit Checks - [ ] I have installed `pre-commit` by running `pip install pre-commit` (or used your preferred method). - [ ] I have installed the hooks with `pre-commit install`. - [ ] I have run the hooks manually with `pre-commit run --all-files` and fixed any reported issues. > If you are unsure about how to set up `pre-commit`, see [the pre-commit documentation](https://pre-commit.com/). ## πŸ§ͺ Tests - [ ] Tests have been added or updated as needed. - [ ] All tests are passing (`unittest`, etc.). ## Reviewer Notes cc @MasterJH5574 please let us know what changes do we need to make to help you bump to the latest version of flashinfer in MLC.
1 parent 63aff25 commit d161b56

File tree

88 files changed

+360
-2749
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

88 files changed

+360
-2749
lines changed

β€Žcsrc/cudnn_sdpa_kernel_launcher.cuβ€Ž

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -23,6 +23,8 @@
2323
#include <cstdint>
2424
#include <iostream>
2525
#include <map>
26+
#include <mutex>
27+
#include <numeric>
2628

2729
#include "cudnn_sdpa_utils.h"
2830
#include "tvm_ffi_utils.h"

0 commit comments

Comments
Β (0)