Feat (optim): add Cailey SGD optimizer (#1153) #1590
| Job | Run time |
|---|---|
| 29m 19s | |
| 24m 52s | |
| 18m 29s | |
| 39m 14s | |
| 32m 50s | |
| 22m 9s | |
| 35m 16s | |
| 28m 50s | |
| 22m 30s | |
| 35m 57s | |
| 29m 12s | |
| 19m 53s | |
| 35m 4s | |
| 29m 24s | |
| 25m 58s | |
| 34m 51s | |
| 28m 54s | |
| 18m 45s | |
| 36m 4s | |
| 29m 0s | |
| 19m 22s | |
| 29m 44s | |
| 25m 5s | |
| 20m 2s | |
| 40m 53s | |
| 34m 21s | |
| 27m 9s | |
| 36m 46s | |
| 28m 25s | |
| 19m 15s | |
| 36m 42s | |
| 30m 20s | |
| 18m 25s | |
| 37m 52s | |
| 29m 10s | |
| 14m 42s | |
| 36m 3s | |
| 30m 59s | |
| 18m 51s | |
| 37m 33s | |
| 29m 33s | |
| 16m 59s | |
| 19h 54m 42s |