2x Faster Inferencing #14
Description
This is something that I suspect will be of interest to people who land on this repo:
https://github.com/octoml/Apple-M1-BERT
People were able to get 2x speed improvement over TF-metal using TVM to accelerate models. Downside is that TVM doesn't (yet) support model training.