Skip to content
Back to pull request #1090

Feat (nn/sdpa): quantization of scaled dot-product attention #1927

Sign in to view logs

Feat (nn/sdpa): quantization of scaled dot-product attention

Feat (nn/sdpa): quantization of scaled dot-product attention #1927

Run time

Learn about OS pricing on GitHub Actions
Job Run time
build (3.9, 1.11.0, windows-latest, jit_disabled)
18m 3s
build (3.9, 1.11.0, windows-latest, jit_disabled)
18m 3s
build (3.9, 1.11.0, windows-latest, jit_disabled)
18m 3s
build (3.9, 1.11.0, windows-latest, jit_enabled)
1h 35m 22s
build (3.9, 1.11.0, windows-latest, jit_enabled)
1h 35m 22s
build (3.9, 1.11.0, windows-latest, jit_enabled)
1h 35m 22s
build (3.9, 1.11.0, ubuntu-latest, jit_disabled)
31m 10s
build (3.9, 1.11.0, ubuntu-latest, jit_disabled)
31m 10s
build (3.9, 1.11.0, ubuntu-latest, jit_disabled)
31m 10s
build (3.9, 1.11.0, ubuntu-latest, jit_enabled)
1h 38m 33s
build (3.9, 1.11.0, ubuntu-latest, jit_enabled)
1h 38m 33s
build (3.9, 1.11.0, ubuntu-latest, jit_enabled)
1h 38m 33s
build (3.9, 1.11.0, macos-latest, jit_disabled)
11m 23s
build (3.9, 1.11.0, macos-latest, jit_disabled)
11m 23s
build (3.9, 1.11.0, macos-latest, jit_disabled)
11m 23s
build (3.9, 1.11.0, macos-latest, jit_enabled)
56m 44s
build (3.9, 1.11.0, macos-latest, jit_enabled)
56m 44s
build (3.9, 1.11.0, macos-latest, jit_enabled)
56m 44s
build (3.9, 1.12.1, windows-latest, jit_disabled)
21m 40s
build (3.9, 1.12.1, windows-latest, jit_disabled)
21m 40s
build (3.9, 1.12.1, windows-latest, jit_disabled)
21m 40s
build (3.9, 1.12.1, windows-latest, jit_enabled)
1h 40m 21s
build (3.9, 1.12.1, windows-latest, jit_enabled)
1h 40m 21s
build (3.9, 1.12.1, windows-latest, jit_enabled)
1h 40m 21s
build (3.9, 1.12.1, ubuntu-latest, jit_disabled)
33m 58s
build (3.9, 1.12.1, ubuntu-latest, jit_disabled)
33m 58s
build (3.9, 1.12.1, ubuntu-latest, jit_disabled)
33m 58s
build (3.9, 1.12.1, ubuntu-latest, jit_enabled)
1h 43m 25s
build (3.9, 1.12.1, ubuntu-latest, jit_enabled)
1h 43m 25s
build (3.9, 1.12.1, ubuntu-latest, jit_enabled)
1h 43m 25s
build (3.9, 1.12.1, macos-latest, jit_disabled)
12m 13s
build (3.9, 1.12.1, macos-latest, jit_disabled)
12m 13s
build (3.9, 1.12.1, macos-latest, jit_disabled)
12m 13s
build (3.9, 1.12.1, macos-latest, jit_enabled)
1h 25m 22s
build (3.9, 1.12.1, macos-latest, jit_enabled)
1h 25m 22s
build (3.9, 1.12.1, macos-latest, jit_enabled)
1h 25m 22s
build (3.9, 1.13.0, windows-latest, jit_disabled)
21m 24s
build (3.9, 1.13.0, windows-latest, jit_disabled)
21m 37s
build (3.9, 1.13.0, windows-latest, jit_disabled)
21m 27s
build (3.9, 1.13.0, windows-latest, jit_enabled)
1h 32m 34s
build (3.9, 1.13.0, windows-latest, jit_enabled)
1h 32m 34s
build (3.9, 1.13.0, windows-latest, jit_enabled)
1h 32m 34s
build (3.9, 1.13.0, ubuntu-latest, jit_disabled)
31m 14s
build (3.9, 1.13.0, ubuntu-latest, jit_disabled)
31m 14s
build (3.9, 1.13.0, ubuntu-latest, jit_disabled)
31m 14s
build (3.9, 1.13.0, ubuntu-latest, jit_enabled)
1h 34m 46s
build (3.9, 1.13.0, ubuntu-latest, jit_enabled)
1h 34m 46s
build (3.9, 1.13.0, ubuntu-latest, jit_enabled)
1h 34m 46s
build (3.9, 1.13.0, macos-latest, jit_disabled)
14m 45s
build (3.9, 1.13.0, macos-latest, jit_disabled)
14m 45s
build (3.9, 1.13.0, macos-latest, jit_disabled)
14m 45s
build (3.9, 1.13.0, macos-latest, jit_enabled)
52m 37s
build (3.9, 1.13.0, macos-latest, jit_enabled)
52m 37s
build (3.9, 1.13.0, macos-latest, jit_enabled)
52m 37s
build (3.9, 2.0.1, windows-latest, jit_disabled)
23m 42s
build (3.9, 2.0.1, windows-latest, jit_disabled)
23m 42s
build (3.9, 2.0.1, windows-latest, jit_disabled)
23m 42s
build (3.9, 2.0.1, windows-latest, jit_enabled)
1h 32m 16s
build (3.9, 2.0.1, windows-latest, jit_enabled)
1h 32m 39s
build (3.9, 2.0.1, windows-latest, jit_enabled)
1h 32m 16s
build (3.9, 2.0.1, ubuntu-latest, jit_disabled)
32m 22s
build (3.9, 2.0.1, ubuntu-latest, jit_disabled)
32m 22s
build (3.9, 2.0.1, ubuntu-latest, jit_disabled)
32m 22s
build (3.9, 2.0.1, ubuntu-latest, jit_enabled)
1h 32m 2s
build (3.9, 2.0.1, ubuntu-latest, jit_enabled)
1h 32m 2s
build (3.9, 2.0.1, ubuntu-latest, jit_enabled)
1h 32m 2s
build (3.9, 2.0.1, macos-latest, jit_disabled)
13m 34s
build (3.9, 2.0.1, macos-latest, jit_disabled)
13m 34s
build (3.9, 2.0.1, macos-latest, jit_disabled)
13m 34s
build (3.9, 2.0.1, macos-latest, jit_enabled)
1h 14m 53s
build (3.9, 2.0.1, macos-latest, jit_enabled)
1h 14m 53s
build (3.9, 2.0.1, macos-latest, jit_enabled)
1h 14m 53s
build (3.9, 2.1.0, windows-latest, jit_disabled)
22m 47s
build (3.9, 2.1.0, windows-latest, jit_disabled)
22m 47s
build (3.9, 2.1.0, windows-latest, jit_disabled)
22m 47s
build (3.9, 2.1.0, windows-latest, jit_enabled)
1h 33m 41s
build (3.9, 2.1.0, windows-latest, jit_enabled)
1h 32m 58s
build (3.9, 2.1.0, windows-latest, jit_enabled)
1h 32m 58s
build (3.9, 2.1.0, ubuntu-latest, jit_disabled)
33m 6s
build (3.9, 2.1.0, ubuntu-latest, jit_disabled)
33m 6s
build (3.9, 2.1.0, ubuntu-latest, jit_disabled)
33m 6s
build (3.9, 2.1.0, ubuntu-latest, jit_enabled)
1h 28m 18s
build (3.9, 2.1.0, ubuntu-latest, jit_enabled)
1h 28m 18s
build (3.9, 2.1.0, ubuntu-latest, jit_enabled)
1h 28m 18s
build (3.9, 2.1.0, macos-latest, jit_disabled)
17m 16s
build (3.9, 2.1.0, macos-latest, jit_disabled)
17m 16s
build (3.9, 2.1.0, macos-latest, jit_disabled)
17m 16s
build (3.9, 2.1.0, macos-latest, jit_enabled)
1h 16m 31s
build (3.9, 2.1.0, macos-latest, jit_enabled)
1h 16m 31s
build (3.9, 2.1.0, macos-latest, jit_enabled)
1h 16m 31s
build (3.9, 2.2.2, windows-latest, jit_disabled)
21m 41s
build (3.9, 2.2.2, windows-latest, jit_disabled)
21m 24s
build (3.9, 2.2.2, windows-latest, jit_disabled)
21m 27s
build (3.9, 2.2.2, windows-latest, jit_enabled)
1h 32m 5s
build (3.9, 2.2.2, windows-latest, jit_enabled)
1h 32m 5s
build (3.9, 2.2.2, windows-latest, jit_enabled)
1h 32m 5s
build (3.9, 2.2.2, ubuntu-latest, jit_disabled)
32m 11s
build (3.9, 2.2.2, ubuntu-latest, jit_disabled)
32m 11s
build (3.9, 2.2.2, ubuntu-latest, jit_disabled)
32m 11s
build (3.9, 2.2.2, ubuntu-latest, jit_enabled)
1h 32m 9s
build (3.9, 2.2.2, ubuntu-latest, jit_enabled)
1h 32m 9s
build (3.9, 2.2.2, ubuntu-latest, jit_enabled)
1h 32m 9s
build (3.9, 2.2.2, macos-latest, jit_disabled)
22m 41s
build (3.9, 2.2.2, macos-latest, jit_disabled)
22m 41s
build (3.9, 2.2.2, macos-latest, jit_disabled)
22m 41s
build (3.9, 2.2.2, macos-latest, jit_enabled)
1h 9m 50s
build (3.9, 2.2.2, macos-latest, jit_enabled)
1h 9m 50s
build (3.9, 2.2.2, macos-latest, jit_enabled)
1h 9m 50s
build (3.9, 2.3.1, windows-latest, jit_disabled)
23m 2s
build (3.9, 2.3.1, windows-latest, jit_disabled)
22m 20s
build (3.9, 2.3.1, windows-latest, jit_disabled)
22m 0s
build (3.9, 2.3.1, windows-latest, jit_enabled)
1h 32m 14s
build (3.9, 2.3.1, windows-latest, jit_enabled)
1h 32m 14s
build (3.9, 2.3.1, windows-latest, jit_enabled)
1h 32m 14s
build (3.9, 2.3.1, ubuntu-latest, jit_disabled)
34m 15s
build (3.9, 2.3.1, ubuntu-latest, jit_disabled)
34m 15s
build (3.9, 2.3.1, ubuntu-latest, jit_disabled)
34m 15s
build (3.9, 2.3.1, ubuntu-latest, jit_enabled)
1h 29m 34s
build (3.9, 2.3.1, ubuntu-latest, jit_enabled)
1h 29m 34s
build (3.9, 2.3.1, ubuntu-latest, jit_enabled)
1h 29m 34s
build (3.9, 2.3.1, macos-latest, jit_disabled)
12m 0s
build (3.9, 2.3.1, macos-latest, jit_disabled)
12m 0s
build (3.9, 2.3.1, macos-latest, jit_disabled)
12m 0s
build (3.9, 2.3.1, macos-latest, jit_enabled)
58m 56s
build (3.9, 2.3.1, macos-latest, jit_enabled)
58m 56s
build (3.9, 2.3.1, macos-latest, jit_enabled)
58m 56s
build (3.10, 1.11.0, windows-latest, jit_disabled)
18m 19s
build (3.10, 1.11.0, windows-latest, jit_disabled)
18m 19s
build (3.10, 1.11.0, windows-latest, jit_disabled)
18m 19s
build (3.10, 1.11.0, windows-latest, jit_enabled)
1h 36m 32s
build (3.10, 1.11.0, windows-latest, jit_enabled)
1h 36m 32s
build (3.10, 1.11.0, windows-latest, jit_enabled)
1h 36m 32s
build (3.10, 1.11.0, ubuntu-latest, jit_disabled)
30m 40s
build (3.10, 1.11.0, ubuntu-latest, jit_disabled)
30m 40s
build (3.10, 1.11.0, ubuntu-latest, jit_disabled)
30m 40s
build (3.10, 1.11.0, ubuntu-latest, jit_enabled)
1h 31m 50s
build (3.10, 1.11.0, ubuntu-latest, jit_enabled)
1h 31m 50s
build (3.10, 1.11.0, ubuntu-latest, jit_enabled)
1h 31m 50s
build (3.10, 1.11.0, macos-latest, jit_disabled)
12m 4s
build (3.10, 1.11.0, macos-latest, jit_disabled)
12m 4s
build (3.10, 1.11.0, macos-latest, jit_disabled)
12m 4s
build (3.10, 1.11.0, macos-latest, jit_enabled)
48m 5s
build (3.10, 1.11.0, macos-latest, jit_enabled)
48m 5s
build (3.10, 1.11.0, macos-latest, jit_enabled)
48m 5s
build (3.10, 1.12.1, windows-latest, jit_disabled)
22m 34s
build (3.10, 1.12.1, windows-latest, jit_disabled)
22m 41s
build (3.10, 1.12.1, windows-latest, jit_disabled)
22m 41s
build (3.10, 1.12.1, windows-latest, jit_enabled)
1h 40m 17s
build (3.10, 1.12.1, windows-latest, jit_enabled)
1h 40m 17s
build (3.10, 1.12.1, windows-latest, jit_enabled)
1h 40m 17s
build (3.10, 1.12.1, ubuntu-latest, jit_disabled)
32m 49s
build (3.10, 1.12.1, ubuntu-latest, jit_disabled)
32m 49s
build (3.10, 1.12.1, ubuntu-latest, jit_disabled)
32m 49s
build (3.10, 1.12.1, ubuntu-latest, jit_enabled)
1h 37m 19s
build (3.10, 1.12.1, ubuntu-latest, jit_enabled)
1h 37m 19s
build (3.10, 1.12.1, ubuntu-latest, jit_enabled)
1h 37m 19s
build (3.10, 1.12.1, macos-latest, jit_disabled)
15m 12s
build (3.10, 1.12.1, macos-latest, jit_disabled)
15m 12s
build (3.10, 1.12.1, macos-latest, jit_disabled)
15m 12s
build (3.10, 1.12.1, macos-latest, jit_enabled)
46m 15s
build (3.10, 1.12.1, macos-latest, jit_enabled)
46m 15s
build (3.10, 1.12.1, macos-latest, jit_enabled)
46m 15s
build (3.10, 1.13.0, windows-latest, jit_disabled)
23m 14s
build (3.10, 1.13.0, windows-latest, jit_disabled)
23m 14s
build (3.10, 1.13.0, windows-latest, jit_disabled)
23m 14s
build (3.10, 1.13.0, windows-latest, jit_enabled)
1h 30m 34s
build (3.10, 1.13.0, windows-latest, jit_enabled)
1h 30m 34s
build (3.10, 1.13.0, windows-latest, jit_enabled)
1h 30m 34s
build (3.10, 1.13.0, ubuntu-latest, jit_disabled)
32m 57s
build (3.10, 1.13.0, ubuntu-latest, jit_disabled)
32m 57s
build (3.10, 1.13.0, ubuntu-latest, jit_disabled)
32m 57s
build (3.10, 1.13.0, ubuntu-latest, jit_enabled)
1h 28m 58s
build (3.10, 1.13.0, ubuntu-latest, jit_enabled)
1h 28m 58s
build (3.10, 1.13.0, ubuntu-latest, jit_enabled)
1h 28m 58s
build (3.10, 1.13.0, macos-latest, jit_disabled)
14m 29s
build (3.10, 1.13.0, macos-latest, jit_disabled)
14m 29s
build (3.10, 1.13.0, macos-latest, jit_disabled)
14m 29s
build (3.10, 1.13.0, macos-latest, jit_enabled)
43m 58s
build (3.10, 1.13.0, macos-latest, jit_enabled)
43m 58s
build (3.10, 1.13.0, macos-latest, jit_enabled)
43m 58s
build (3.10, 2.0.1, windows-latest, jit_disabled)
22m 31s
build (3.10, 2.0.1, windows-latest, jit_disabled)
22m 31s
build (3.10, 2.0.1, windows-latest, jit_disabled)
22m 31s
build (3.10, 2.0.1, windows-latest, jit_enabled)
1h 35m 30s
build (3.10, 2.0.1, windows-latest, jit_enabled)
1h 35m 3s
build (3.10, 2.0.1, windows-latest, jit_enabled)
1h 36m 18s
build (3.10, 2.0.1, ubuntu-latest, jit_disabled)
33m 0s
build (3.10, 2.0.1, ubuntu-latest, jit_disabled)
33m 0s
build (3.10, 2.0.1, ubuntu-latest, jit_disabled)
33m 0s
build (3.10, 2.0.1, ubuntu-latest, jit_enabled)
1h 29m 55s
build (3.10, 2.0.1, ubuntu-latest, jit_enabled)
1h 29m 55s
build (3.10, 2.0.1, ubuntu-latest, jit_enabled)
1h 29m 55s
build (3.10, 2.0.1, macos-latest, jit_disabled)
15m 26s
build (3.10, 2.0.1, macos-latest, jit_disabled)
15m 26s
build (3.10, 2.0.1, macos-latest, jit_disabled)
15m 26s
build (3.10, 2.0.1, macos-latest, jit_enabled)
48m 23s
build (3.10, 2.0.1, macos-latest, jit_enabled)
48m 23s
build (3.10, 2.0.1, macos-latest, jit_enabled)
48m 23s
build (3.10, 2.1.0, windows-latest, jit_disabled)
21m 54s
build (3.10, 2.1.0, windows-latest, jit_disabled)
22m 23s
build (3.10, 2.1.0, windows-latest, jit_disabled)
22m 23s
build (3.10, 2.1.0, windows-latest, jit_enabled)
1h 36m 29s
build (3.10, 2.1.0, windows-latest, jit_enabled)
1h 36m 29s
build (3.10, 2.1.0, windows-latest, jit_enabled)
1h 36m 29s
build (3.10, 2.1.0, ubuntu-latest, jit_disabled)
33m 54s
build (3.10, 2.1.0, ubuntu-latest, jit_disabled)
33m 54s
build (3.10, 2.1.0, ubuntu-latest, jit_disabled)
33m 54s
build (3.10, 2.1.0, ubuntu-latest, jit_enabled)
1h 28m 44s
build (3.10, 2.1.0, ubuntu-latest, jit_enabled)
1h 28m 44s
build (3.10, 2.1.0, ubuntu-latest, jit_enabled)
1h 28m 44s
build (3.10, 2.1.0, macos-latest, jit_disabled)
17m 36s
build (3.10, 2.1.0, macos-latest, jit_disabled)
17m 36s
build (3.10, 2.1.0, macos-latest, jit_disabled)
17m 36s
build (3.10, 2.1.0, macos-latest, jit_enabled)
1h 14m 57s
build (3.10, 2.1.0, macos-latest, jit_enabled)
1h 14m 57s
build (3.10, 2.1.0, macos-latest, jit_enabled)
1h 14m 57s
build (3.10, 2.2.2, windows-latest, jit_disabled)
21m 54s
build (3.10, 2.2.2, windows-latest, jit_disabled)
23m 8s
build (3.10, 2.2.2, windows-latest, jit_disabled)
21m 52s
build (3.10, 2.2.2, windows-latest, jit_enabled)
1h 37m 52s
build (3.10, 2.2.2, windows-latest, jit_enabled)
1h 37m 1s
build (3.10, 2.2.2, windows-latest, jit_enabled)
1h 35m 51s
build (3.10, 2.2.2, ubuntu-latest, jit_disabled)
31m 54s
build (3.10, 2.2.2, ubuntu-latest, jit_disabled)
31m 54s
build (3.10, 2.2.2, ubuntu-latest, jit_disabled)
31m 54s
build (3.10, 2.2.2, ubuntu-latest, jit_enabled)
1h 28m 6s
build (3.10, 2.2.2, ubuntu-latest, jit_enabled)
1h 28m 6s
build (3.10, 2.2.2, ubuntu-latest, jit_enabled)
1h 28m 6s
build (3.10, 2.2.2, macos-latest, jit_disabled)
19m 32s
build (3.10, 2.2.2, macos-latest, jit_disabled)
19m 32s
build (3.10, 2.2.2, macos-latest, jit_disabled)
19m 32s
build (3.10, 2.2.2, macos-latest, jit_enabled)
48m 52s
build (3.10, 2.2.2, macos-latest, jit_enabled)
48m 52s
build (3.10, 2.2.2, macos-latest, jit_enabled)
48m 52s
build (3.10, 2.3.1, windows-latest, jit_disabled)
22m 44s
build (3.10, 2.3.1, windows-latest, jit_disabled)
22m 5s
build (3.10, 2.3.1, windows-latest, jit_disabled)
22m 5s
build (3.10, 2.3.1, windows-latest, jit_enabled)
1h 34m 41s
build (3.10, 2.3.1, windows-latest, jit_enabled)
1h 34m 41s
build (3.10, 2.3.1, windows-latest, jit_enabled)
1h 34m 41s
build (3.10, 2.3.1, ubuntu-latest, jit_disabled)
33m 35s
build (3.10, 2.3.1, ubuntu-latest, jit_disabled)
33m 35s
build (3.10, 2.3.1, ubuntu-latest, jit_disabled)
33m 35s
build (3.10, 2.3.1, ubuntu-latest, jit_enabled)
1h 28m 51s
build (3.10, 2.3.1, ubuntu-latest, jit_enabled)
1h 28m 51s
build (3.10, 2.3.1, ubuntu-latest, jit_enabled)
1h 28m 51s
build (3.10, 2.3.1, macos-latest, jit_disabled)
20m 12s
build (3.10, 2.3.1, macos-latest, jit_disabled)
20m 12s
build (3.10, 2.3.1, macos-latest, jit_disabled)
20m 12s
build (3.10, 2.3.1, macos-latest, jit_enabled)
56m 25s
build (3.10, 2.3.1, macos-latest, jit_enabled)
56m 25s
build (3.10, 2.3.1, macos-latest, jit_enabled)
56m 25s
9d 6h 12m 42s