llamafile : improve moe prompt eval speed on cpu #11302
Job | Run time |
---|---|
5m 31s | |
5m 38s | |
3m 33s | |
5m 21s | |
5m 46s | |
1m 47s | |
2m 9s | |
5m 31s | |
55s | |
3m 59s | |
1m 27s | |
41m 37s |
Job | Run time |
---|---|
5m 31s | |
5m 38s | |
3m 33s | |
5m 21s | |
5m 46s | |
1m 47s | |
2m 9s | |
5m 31s | |
55s | |
3m 59s | |
1m 27s | |
41m 37s |