use_flash_attention

[fourier20laplace]

Thanks 4 your work!
I wonder if I can load the ESM-2 without the flash-attention, when I pass the use_flash_attention=False to the FAEsmForMaskedLM , it gives an error.

[pengzhangzhi]

u dont have to pass the param, just run the code and it will by default disable flash attention