Skip to content

Commit

Permalink
[ez] non-promptfoo eval nits (#383)
Browse files Browse the repository at this point in the history
[ez] non-promptfoo eval nits

- dedup with promptfoo script
- make substring checker (wrapper fn)


https://colab.research.google.com/drive/1oxyegh5wOx9jLODRPA8zTWmDl7OOZpMT

---
Stack created with [Sapling](https://sapling-scm.com). Best reviewed
with
[ReviewStack](https://reviewstack.dev/lastmile-ai/aiconfig/pull/383).
* #405
* __->__ #383
  • Loading branch information
jonathanlastmileai authored Dec 5, 2023
2 parents f0de738 + d7c1f70 commit 7285f19
Show file tree
Hide file tree
Showing 4 changed files with 57 additions and 54 deletions.
2 changes: 1 addition & 1 deletion python/requirements.txt
Original file line number Diff line number Diff line change
Expand Up @@ -14,4 +14,4 @@ nest_asyncio
prompt_toolkit
mock
pytest-asyncio
lastmile_utils>=0.0.5
lastmile_utils>=0.0.6
Loading

0 comments on commit 7285f19

Please sign in to comment.