Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issues about MLP selection. #5

Closed
KAIWEILIUCC opened this issue Oct 11, 2022 · 2 comments
Closed

Issues about MLP selection. #5

KAIWEILIUCC opened this issue Oct 11, 2022 · 2 comments

Comments

@KAIWEILIUCC
Copy link

Hello, I would like to ask a question about the MLP selection.
When I finishing running the commond 'python examples/t5-sst2-inf.py' and tries to run the commond 'python moefication/mlp_select_example.py', I get an error telling me that the file ‘results/t5-base//param_split/encoder.block.0.layer.1.DenseReluDense.wi.weight’ doesn't exist.
This error is from the line 203 in utils.py.
So, do I need to execute other scripts before executing mlp_select_example.py? Thanks. :)

@zzy14
Copy link
Member

zzy14 commented Oct 11, 2022

Hi, you need to first construct experts by python moefication/param_cluster_example.py.

@KAIWEILIUCC
Copy link
Author

Thank you. :)

@zzy14 zzy14 closed this as completed Oct 13, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants