Code

[DRAFT] prompt migration engine#808

Code

Draft

heyjustinai wants to merge 15 commits intomainmeta-llama/llama-cookbook:mainfrom prompt-migrationmeta-llama/llama-cookbook:prompt-migrationCopy head branch name to clipboard

+5,914

Commits

Commits on Jan 15, 2025

• added evaluator and formatter and main

  heyjustinai

  committed
  2570d16

  Copy full SHA for 2570d16

• add usage guide and init

  heyjustinai

  committed
  08e41d0

  Copy full SHA for 08e41d0

• add engine and eval dataset

  heyjustinai

  committed
  a3e96e4

  Copy full SHA for a3e96e4

• add .env settings and configure yml

  heyjustinai

  committed
  096249b

  Copy full SHA for 096249b

• placeholder readme

  heyjustinai

  committed
  263b8b5

  Copy full SHA for 263b8b5

• adding eval dataset

  heyjustinai

  committed
  43a2cbc

  Copy full SHA for 43a2cbc

• change eval dataset, include more robust judging, improved main

  heyjustinai

  committed
  b85811d

  Copy full SHA for b85811d

• minor changes in eval, deleted formatter

  heyjustinai

  committed
  90d16cd

  Copy full SHA for 90d16cd

• update dir

  heyjustinai

  committed
  4d75fe9

  Copy full SHA for 4d75fe9

Commits on Jan 16, 2025

• updated prompt migration to use benchmark and also mipro, added meta implementation

  heyjustinai

  committed
  e52e1d1

  Copy full SHA for e52e1d1

• update harness notebook

  heyjustinai

  committed
  1e4c6d2

  Copy full SHA for 1e4c6d2

• update harness notebook

  heyjustinai

  committed
  62b5367

  Copy full SHA for 62b5367

• beef up readme

  heyjustinai

  committed
  5730a84

  Copy full SHA for 5730a84

Commits on Jan 17, 2025

• added updated llama-mmlu-pro and added human-eva

  heyjustinai

  committed
  314b6a8

  Copy full SHA for 314b6a8

• harness runcode

  heyjustinai

  committed
  2776a35

  Copy full SHA for 2776a35