Quantize: specify each major tensor quant in CLI for common LLMs #14357
| Job | Run time |
|---|---|
| 1m 13s | |
| 1m 13s | |
| 1m 11s | |
| 1m 13s | |
| 1m 13s | |
| 1m 11s | |
| 1m 3s | |
| 1m 11s | |
| 1m 12s | |
| 35s | |
| 27s | |
| 1s | |
| 1m 14s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 13m 26s |