add reference algorithms

mlcommons · Nov 21, 2023 · 0338f8f · 0338f8f
1 parent cc0c6ff
commit 0338f8f
Show file tree

Hide file tree

Showing 11 changed files with 81 additions and 81 deletions.
diff --git a/reference_algorithms/threshold_baselines/README.md b/reference_algorithms/threshold_baselines/README.md
@@ -0,0 +1,81 @@
+# Threshold Baselines
+TODO: link back to section in rules. 
+
+## Externally Tuned Ruleset
+
+### JAX
+
+The threshold submissions for jax are: 
+- `reference_algorithms/threshold_baselines/external_tuning/jax_nadamw_target_setting.py`
+- `feference_algorithms/threshold_baselines/external_tuning/jax_nadamw_full_budget.py`
+
+Example command:
+
+```bash
+python3 submission_runner.py \
+    --framework=jax \
+    --data_dir=<data_dir> \
+    --experiment_dir=<experiment_dir> \
+    --experiment_name=<experiment_name> \
+    --workload=<workload> \
+    --submission_path=reference_algorithms/threshold_baselines/external_tuning/jax_nadamw_target_setting.py \
+    --tuning_search_space=reference_algorithms/threshold_baselines/external_tuning/tuning_search_space.json
+```
+
+### PyTorch
+
+The threshold submissions for PyTorch are 
+- `reference_algorithms/threshold_baselines/external_tuning/pytorch_nadamw_target_setting.py` 
+- `feference_algorithms/threshold_baselines/external_tuning/pytorch_nadamw_full_budget.py`
+
+
+Example command:
+
+```bash
+torchrun --redirects 1:0,2:0,3:0,4:0,5:0,6:0,7:0 --standalone --nnodes=1 --nproc_per_node=8 submission_runner.py \
+    --framework=pytorch \
+    --data_dir=<data_dir> \
+    --experiment_dir=<experiment_dir> \
+    --experiment_name=t<experiment_name> \
+    --workload=<workload>\
+    --submission_path=reference_algorithms/threshold_baselines/external_tuning/pytorch_nadamw_target_setting.py \
+    --tuning_search_space=reference_algorithms/threshold_baselines/external_tuning/tuning_search_space.json
+```
+
+## Self-tuning Ruleset
+
+### JAX
+
+The threshold submissions for jax are 
+- `reference_algorithms/threshold_baselines/external_tuning/jax_nadamw_target_setting.py`
+- `feference_algorithms/threshold_baselines/external_tuning/jax_nadamw_full_budget.py`
+
+Example command:
+```bash
+python3 submission_runner.py \
+    --framework=jax \
+    --data_dir=<data_dir> \
+    --experiment_dir=<experiment_dir> \
+    --experiment_name=<experiment_name> \
+    --workload=<workload> \
+    --submission_path=reference_algorithms/threshold_baselines/external_tuning/jax_nadamw_target_setting.py \
+    --tuning_ruleset=self
+```
+
+### PyTorch
+
+The threshold submissions for PyTorch are 
+- `reference_algorithms/threshold_baselines/external_tuning/pytorch_nadamw_target_setting.py` 
+- `feference_algorithms/threshold_baselines/external_tuning/pytorch_nadamw_full_budget.py`
+
+Example command:
+```bash
+torchrun --redirects 1:0,2:0,3:0,4:0,5:0,6:0,7:0 --standalone --nnodes=1 --nproc_per_node=8 submission_runner.py \
+    --framework=pytorch \
+    --data_dir=<data_dir> \
+    --experiment_dir=<experiment_dir> \
+    --experiment_name=t<experiment_name> \
+    --workload=<workload>\
+    --submission_path=reference_algorithms/threshold_baselines/external_tuning/pytorch_nadamw_target_setting.py \
+    --tuning_ruleset=self
+```
diff --git a/...external_tuning/jax_nadamw_full_budget.py → ...external_tuning/jax_nadamw_full_budget.py b/...external_tuning/jax_nadamw_full_budget.py → ...external_tuning/jax_nadamw_full_budget.py
diff --git a/...ernal_tuning/jax_nadamw_target_setting.py → ...ernal_tuning/jax_nadamw_target_setting.py b/...ernal_tuning/jax_nadamw_target_setting.py → ...ernal_tuning/jax_nadamw_target_setting.py
diff --git a/...rnal_tuning/pytorch_nadamw_full_budget.py → ...rnal_tuning/pytorch_nadamw_full_budget.py b/...rnal_tuning/pytorch_nadamw_full_budget.py → ...rnal_tuning/pytorch_nadamw_full_budget.py
diff --git a/...l_tuning/pytorch_nadamw_target_setting.py → ...l_tuning/pytorch_nadamw_target_setting.py b/...l_tuning/pytorch_nadamw_target_setting.py → ...l_tuning/pytorch_nadamw_target_setting.py
diff --git a/.../external_tuning/tuning_search_space.json → .../external_tuning/tuning_search_space.json b/.../external_tuning/tuning_search_space.json → .../external_tuning/tuning_search_space.json
diff --git a/...ons/self_tuning/jax_nadamw_full_budget.py → ...nes/self_tuning/jax_nadamw_full_budget.py b/...ons/self_tuning/jax_nadamw_full_budget.py → ...nes/self_tuning/jax_nadamw_full_budget.py
diff --git a/.../self_tuning/jax_nadamw_target_setting.py → .../self_tuning/jax_nadamw_target_setting.py b/.../self_tuning/jax_nadamw_target_setting.py → .../self_tuning/jax_nadamw_target_setting.py
diff --git a/...self_tuning/pytorch_nadamw_full_budget.py → ...self_tuning/pytorch_nadamw_full_budget.py b/...self_tuning/pytorch_nadamw_full_budget.py → ...self_tuning/pytorch_nadamw_full_budget.py
diff --git a/...f_tuning/pytorch_nadamw_target_setting.py → ...f_tuning/pytorch_nadamw_target_setting.py b/...f_tuning/pytorch_nadamw_target_setting.py → ...f_tuning/pytorch_nadamw_target_setting.py
diff --git a/reference_algorithms/threshold_submissions/README.md b/reference_algorithms/threshold_submissions/README.md