Removing all S4TF dependency will enable immediate revival of SwiftFusion since most codepath only use a fraction of the Tensor interface.
Issues I have on file (TODO: file them as issues)
- math functions like
sin needs replacement into their Swift-numerics counterpart
swift-numerics does not have @differentiable, need custom VJPs
matmul need hand implementation
pinv uses SVD in S4TF, need to be replaced
Possible solution directions:
- Handcraft usable but not great stuff for now to keep it together
- Move to SwiftRT?
supersedes #274