Feat (nn/sdpa): quantization of scaled dot-product attention #1106
Job | Run time |
---|---|
2m 3s | |
1m 31s | |
2m 5s | |
1m 33s | |
1m 53s | |
1m 26s | |
2m 11s | |
1m 43s | |
2m 14s | |
2m 2s | |
2m 15s | |
1m 45s | |
2m 24s | |
1m 38s | |
2m 4s | |
1m 24s | |
1m 57s | |
1m 44s | |
2m 14s | |
1m 36s | |
2m 10s | |
1m 44s | |
2m 11s | |
1m 34s | |
2m 15s | |
1m 33s | |
2m 13s | |
1m 42s | |
53m 4s |