You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
WMT post-ln variant broken in JAX: flax.errors.ScopeParamNotFoundError: Could not find parameter named "scale" in scope "/encoder/encoder_layernorm"
#652
Closed
priyakasimbeg opened this issue
Feb 26, 2024
· 0 comments
· Fixed by #658
WMT post-ln variant broken in JAX: flax.errors.ScopeParamNotFoundError: Could not find parameter named "scale" in scope "/encoder/encoder_layernorm"
Description
Logs: gist.
Steps to Reproduce
Source or Possible Fix
Looks like an issue with the layer definition.
The text was updated successfully, but these errors were encountered: