| Accelerator | FP32 | RT32 | FP16 | BF16 | FP8 | INT8 | TDP |
|---|---|---|---|---|---|---|---|
| NVIDIA A100 SXM 40GB | 19.5 | 156 | 312 | 312 | 624 | 400W | |
| NVIDIA H100 | 67 | 989 | 1,979 | 1,979 | 3,958 | 700W | |
| AMD MI250 | 90.5 | 362.1 | 362.1 | 362.1 | 560W | ||
| AMD MI300X | 163.4 | 653.7 | 1,300 | 2610 | 2,600 | 750W | |
| Groq | 188 | 755 | |||||
| SambaNova SN30 | 660 | ||||||
| Graphcore Bow Pod64 | 250 | ||||||
| Habana Gaudi-1 | 150 | ||||||
| AMD Versal VCK5000 | 12 | 145 | 150W | ||||
| AMD Alveo V70 | 202 | 404 | 75W |