Skip to content

Commit

Permalink
docs: interesting
Browse files Browse the repository at this point in the history
  • Loading branch information
adrienbrault committed Apr 25, 2024
1 parent 21be010 commit 2969ed1
Showing 1 changed file with 12 additions and 0 deletions.
12 changes: 12 additions & 0 deletions src/Console/GetCommand.php
Original file line number Diff line number Diff line change
Expand Up @@ -295,6 +295,18 @@ private function getType(InputInterface $input): mixed
} elseif (str_ends_with($type, '.json')) {
$type = decode(file_get_contents($type));
}

// handle/remove/transform custom instructrice properties like:
// prompt: 'The prompt to use'
// few shot examples: [ input -> output ]
// evals: [ input -> output ]
// logs: [ input -> output ]

// So when you run instructrice, it adds each input/output to logs
// Then as a user, you can cut that, put it within evals, and define exactly the output you expect for that input
// You can then run instructrice evals something
// If you end up collecting a set of good quality input/output pairs, consider moving some to the few shot examples
// this should improve the accuracy at the cost of more prompt tokens
}
$type = replace($type, '#/#i', '\\');

Expand Down

0 comments on commit 2969ed1

Please sign in to comment.