Unit Test

Removes batch size from prefill attention calculation. #15374

Sign in to view logs

Run time

Learn about OS pricing on GitHub Actions

Job	Run time
TPU test (v4-8)	22m 59s
GPU test (a100-40gb-4, pinned)	17m 29s
	40m 28s