Add buffered inference support for SALM models #18775
| Job | Run time |
|---|---|
| 30s | |
| 24s | |
| 16s | |
| 2s | |
| 2s | |
| 8s | |
| 7m 40s | |
| 1m 0s | |
| 4m 59s | |
| 5m 52s | |
| 3m 44s | |
| 3m 44s | |
| 3m 37s | |
| 5m 20s | |
| 3m 38s | |
| 5m 13s | |
| 9m 19s | |
| 3m 58s | |
| 5m 55s | |
| 5m 17s | |
| 1m 24s | |
| 5m 52s | |
| 5m 12s | |
| 4m 34s | |
| 2m 30s | |
| 6s | |
| 6m 43s | |
| 5m 35s | |
| 9m 5s | |
| 26m 19s | |
| 21m 19s | |
| 7m 5s | |
| 11m 14s | |
| 4m 52s | |
| 33m 35s | |
| -1s | |
| 1m 7s | |
| 0s | |
| 3h 37m 9s |