Quantize: specify each major tensor quant in CLI for common LLMs #14358
| Job | Run time |
|---|---|
| 2m 47s | |
| 2m 35s | |
| 10m 13s | |
| 17m 0s | |
| 2m 42s | |
| 3m 32s | |
| 2m 19s | |
| 3m 9s | |
| 1m 46s | |
| 3m 25s | |
| 6m 36s | |
| 1m 26s | |
| 1m 34s | |
| 5m 6s | |
| 1m 58s | |
| 2m 32s | |
| 10m 0s | |
| 8m 18s | |
| 2m 39s | |
| 10m 6s | |
| 5m 25s | |
| 2m 42s | |
| 8m 1s | |
| 20m 33s | |
| 7m 2s | |
| 20m 40s | |
| 12m 56s | |
| 7m 4s | |
| 9m 19s | |
| 7m 58s | |
| 17m 3s | |
| 6m 56s | |
| 1m 57s | |
| 7m 52s | |
| 11m 15s | |
| 10m 38s | |
| 6m 18s | |
| 6m 50s | |
| 7m 14s | |
| 3m 25s | |
| 2m 16s | |
| 1s | |
| 4h 43m 8s |