Relax dtype requirements for int4 and float8 quants in autoquant (#1571) #1228
Job | Run time |
---|---|
8s | |
2m 55s | |
10m 7s | |
8m 49s | |
8m 28s | |
15m 16s | |
17m 49s | |
5m 15s | |
2m 51s | |
10m 11s | |
9m 10s | |
8m 27s | |
9m 59s | |
17m 59s | |
3m 10s | |
2m 51s | |
10m 20s | |
9m 18s | |
8m 5s | |
15m 25s | |
17m 44s | |
5m 24s | |
3m 3s | |
10m 17s | |
8m 50s | |
8m 5s | |
15m 35s | |
20m 59s | |
5m 24s | |
3m 0s | |
10m 5s | |
9m 0s | |
8m 19s | |
15m 22s | |
18m 10s | |
5m 19s | |
22s | |
19s | |
15s | |
20s | |
15s | |
14s | |
15s | |
19s | |
16s | |
20s | |
19s | |
14s | |
12s | |
13s | |
15s | |
14s | |
20s | |
19s | |
13s | |
21s | |
14s | |
15s | |
20s | |
18s | |
13s | |
21s | |
15s | |
16s | |
20s | |
20s | |
19s | |
14s | |
13s | |
18s | |
15s | |
5h 50m 55s |