llama : use F32 precision in GLM4 attention and no FA (#9130) #14390
Job | Run time |
---|---|
14m 20s | |
18m 3s | |
33m 44s | |
1h 56m 46s | |
57m 19s | |
2h 35m 22s | |
34m 23s | |
34m 42s | |
13m 27s | |
14m 54s | |
8h 13m 0s |
Job | Run time |
---|---|
14m 20s | |
18m 3s | |
33m 44s | |
1h 56m 46s | |
57m 19s | |
2h 35m 22s | |
34m 23s | |
34m 42s | |
13m 27s | |
14m 54s | |
8h 13m 0s |