Skip to content

Commit

Permalink
Typo in FSDP definition for ogbg
Browse files Browse the repository at this point in the history
  • Loading branch information
davidtweedle committed Dec 5, 2024
1 parent dbfd233 commit 40a932f
Showing 1 changed file with 1 addition and 2 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -167,12 +167,11 @@ def init_model_fn(
size_based_auto_wrap_policy, min_num_params=2 ** 10
)
model = FSDP(
self._model,
model,
use_orig_params=True,
auto_wrap_policy=auto_wrap_policy,
device_id=RANK
)

else:
model = torch.nn.DataParallel(model)
return model, None
Expand Down

0 comments on commit 40a932f

Please sign in to comment.