Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Installing Apex - any successful instructions? #28

Open
christegho opened this issue Sep 7, 2024 · 4 comments
Open

Installing Apex - any successful instructions? #28

christegho opened this issue Sep 7, 2024 · 4 comments

Comments

@christegho
Copy link

christegho commented Sep 7, 2024

In order to run the Pangu model, I need to install Apex.

The documentation on https://github.com/NVIDIA/apex?tab=readme-ov-file#linux is not leading to a successful install.

I get this error:

TypeError: unsupported operand type(s) for +: 'NoneType' and 'str'

Wondering how you managed to get the library?

@christegho
Copy link
Author

Same issue as reported here:
NVIDIA/apex#990

@efesurekli
Copy link
Collaborator

Apparently Apex is only used for the fused layer norm layer in FCN networks. Patched it with the megatron_core so we can safely install without Apex.

@efesurekli
Copy link
Collaborator

Will test the installation and report back

@efesurekli
Copy link
Collaborator

Yep all good, closing this.

@efesurekli efesurekli reopened this Sep 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants