Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
Delaunay authored Jan 13, 2025
1 parent 4dc0ba9 commit 1331235
Showing 1 changed file with 31 additions and 1 deletion.
32 changes: 31 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -33,12 +33,42 @@ evaluating current and future hardware in a research environment.
export MILABENCH_GPU_ARCH=cuda

milabench install --base workspace --config milabench/config/standard.yaml --select fp32


export MILABENCH_HF_TOKEN={your_token}
milabench prepare --base workspace --config milabench/config/standard.yaml --select fp32

milabench run --base workspace --config milabench/config/standard.yaml --select fp32


## Gated Models

Some benchmark use gated models or datasets, which requires the user to request permission to huggingface

1. Request permission

llama
url: https://huggingface.co/meta-llama/Llama-2-7b/tree/main
llm-lora-single
llm-lora-ddp-gpus
llm-lora-ddp-nodes
url: https://huggingface.co/meta-llama/Llama-3.1-8B
llm-lora-mp-gpus
llm-full-mp-gpus
llm-full-mp-nodes
url: https://huggingface.co/meta-llama/Llama-3.1-70B

3. Create a new token

https://huggingface.co/settings/tokens/new?tokenType=read

4. Add your token to your environment

export MILABENCH_HF_TOKEN={your_token}

Now you are ready to execute `milabench prepare`

## Details

The benchmark suite has been validated on the following configurations:
Expand Down

0 comments on commit 1331235

Please sign in to comment.