Skip to content

Commit

Permalink
More chagnes to mlperf setup to support llama2 70b and mixtral 8x7b (#…
Browse files Browse the repository at this point in the history
  • Loading branch information
vipannalla authored Feb 13, 2025
1 parent 8f91427 commit 101545e
Show file tree
Hide file tree
Showing 4 changed files with 3 additions and 4 deletions.
1 change: 0 additions & 1 deletion benchmarks/mlperf/main.py
Original file line number Diff line number Diff line change
Expand Up @@ -161,7 +161,6 @@ def main():
else:
user_conf = args.user_conf

settings.FromConfig(args.mlperf_conf, args.mlperf_conf_id, args.scenario)
settings.FromConfig(user_conf, args.mlperf_conf_id, args.scenario)
log.info("Mlperf config: %s", args.mlperf_conf)
log.info("User config: %s", user_conf)
Expand Down
2 changes: 1 addition & 1 deletion benchmarks/mlperf/scripts/generate_server_accuracy_run.sh
Original file line number Diff line number Diff line change
Expand Up @@ -48,7 +48,7 @@ cd ../ && python3 main.py \
--input-mode tokenized \
--output-mode tokenized \
--max-output-len 1024 \
--mlperf-conf ../mlperf.conf \
--mlperf-conf mlperf.conf \
--user-conf ${USER_CONFIG} \
--audit-conf no-audit \
--total-sample-count ${TOTAL_SAMPLE_COUNT} \
Expand Down
2 changes: 1 addition & 1 deletion benchmarks/mlperf/scripts/generate_server_audit_run.sh
Original file line number Diff line number Diff line change
Expand Up @@ -43,7 +43,7 @@ cd ../ && python3 main.py \
--input-mode tokenized \
--output-mode tokenized \
--max-output-len 1024 \
--mlperf-conf ../mlperf.conf \
--mlperf-conf mlperf.conf \
--user-conf ${USER_CONFIG} \
--audit-conf ../../../compliance/nvidia/TEST06/audit.config \
--total-sample-count ${TOTAL_SAMPLE_COUNT} \
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -45,7 +45,7 @@ cd ../ && python3 main.py \
--input-mode tokenized \
--output-mode tokenized \
--max-output-len 1024 \
--mlperf-conf ../mlperf.conf \
--mlperf-conf mlperf.conf \
--user-conf ${USER_CONFIG} \
--audit-conf no-audit \
--total-sample-count ${TOTAL_SAMPLE_COUNT} \
Expand Down

0 comments on commit 101545e

Please sign in to comment.