Skip to content

Commit

Permalink
Update script path in Mixtral instructions
Browse files Browse the repository at this point in the history
  • Loading branch information
zpcore committed Nov 1, 2024
1 parent 74ca67c commit ac6b380
Show file tree
Hide file tree
Showing 3 changed files with 7 additions and 7 deletions.
10 changes: 5 additions & 5 deletions training/trillium/Mixtral-8x7B-Pytorch/XPK/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@ popd
```
---
### 3. Update and export environment variables
Modify environment variables in `env.sh` targetting your gcloud resource and the experiment model config. Source the script for future use.
Modify environment variables in `env.sh` targetting your gcloud resource and the experiment model config. Source the script.
```bash
source env.sh
```
Expand Down Expand Up @@ -84,12 +84,12 @@ XPK End: Thu Oct 31 02:03:01 UTC 2024
### 6. [Optional] Metric processing
You can use the profile
```
# this is the place we place the profile processing script
export PROFILE_SCRIPT_PATH=../../../../utils/
# download the profile from gcp bucket to local
gsutil cp -r $PROFILE_LOG_DIR ./
# feed in the xplane.pd file, e.g.,
python utils/profile_convert.py ${PROFILE_LOG_DIR}/plugins/profile/2024_10_31_02_00_47/127.0.0.1_9012.xplane.pb
# locate the xplane.pb file and process
PYTHONPATH==$PROFILE_SCRIPT_PATH:$PYTHONPATH python $PROFILE_SCRIPT_PATH/profile_convert.py xplane.pb
```

You will see output like that tells the average step time in second:
Expand Down
2 changes: 1 addition & 1 deletion training/trillium/Mixtral-8x7B-Pytorch/XPK/benchmark.sh
Original file line number Diff line number Diff line change
Expand Up @@ -12,4 +12,4 @@ python3 xpk.py workload create \
--zone=$ZONE \
--project=$PROJECT \
--enable-debug-logs \
--command="bash train.sh"
--command="bash /app/train.sh"
2 changes: 1 addition & 1 deletion training/trillium/Mixtral-8x7B-Pytorch/XPK/train.sh
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
#!/bin/bash

source env.sh
source /app/env.sh

# Extract the number after '-' in TPU_TYPE
TPU_NUM=$(echo "$TPU_TYPE" | grep -oP '(?<=-)\d+')
Expand Down

0 comments on commit ac6b380

Please sign in to comment.