Skip to content
This repository was archived by the owner on Sep 10, 2025. It is now read-only.
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 5 additions & 5 deletions docs/quantization.md
Original file line number Diff line number Diff line change
Expand Up @@ -142,22 +142,22 @@ To use linear:a8wxdq and embedding:wx, you must set up the torchao experimental

From the torchchat root directory, run
```
sh torchchat/utils/scripts/build_torchao_ops.sh
bash torchchat/utils/scripts/build_torchao_ops.sh
```

This should take about 10 seconds to complete.

Note: if you want to use the new kernels in the AOTI and C++ runners, you must pass the flag link_torchao_ops when running the scripts the build the runners.

```
sh torchchat/utils/scripts/build_native.sh aoti link_torchao_ops
bash torchchat/utils/scripts/build_native.sh aoti link_torchao_ops
```

```
sh torchchat/utils/scripts/build_native.sh et link_torchao_ops
bash torchchat/utils/scripts/build_native.sh et link_torchao_ops
```

Note before running `sh torchchat/utils/scripts/build_native.sh et link_torchao_ops`, you must first install executorch with `sh torchchat/utils/scripts/install_et.sh` if you have not done so already.
Note before running `bash torchchat/utils/scripts/build_native.sh et link_torchao_ops`, you must first install executorch with `bash torchchat/utils/scripts/install_et.sh` if you have not done so already.

### Examples

Expand Down Expand Up @@ -212,7 +212,7 @@ Currently, torchchat can only run them on Eager mode.

From the torchchat root directory, run
```
sh torchchat/utils/scripts/build_torchao_ops.sh mps
bash torchchat/utils/scripts/build_torchao_ops.sh mps
```

### Examples
Expand Down
Loading