TruLens-Eval v0.32.0
sfc-gh-jreini
released this
24 Jun 18:03
·
1 commit
to releases/rc-trulens-eval/0.32.0
since this release
What's Changed
- Context filtering guardrails by @sfc-gh-jreini in #1192
- Query optimizations for TruLens dashboard resulting in 4-32x benchmarked speedups by @sfc-gh-chu in #1216
- Logging in Snowflake database by @sfc-gh-chu in #1216
- Snowflake Cortex feedback provider by @sfc-gh-dhuang in #1202
- improve langchain prompting using native messages by @nicoloboschi in #1194
- fix groundedness with no supporting evidence by @nicoloboschi in #1193
- Improve Microsecond support by @sfc-gh-gtokernliang in #1195
- SkipEval exception by @sfc-gh-pmardziel in #1200
- Update pull_request_template.md by @sfc-gh-jreini in #1234
- Use rounding instead of flooring in feedback score extraction by @sfc-gh-dhuang in #1244
Documentation
- Benchmarking Snowflake arctic-instruct feedback function of groundedness by @sfc-gh-dhuang in #1185
- Evaluation Benchmarks Page by @sfc-gh-jreini in #1190
- Documentation for snowflake sqlalchemy implementation by @sfc-gh-chu in #1216*
- Documentation for logging in snowflake database by @sfc-gh-chu in #1216
- Documentation for cortex provider by @sfc-gh-dhuang in #1202
Examples
- Context filtering guardrails added to quickstarts by @sfc-gh-jreini in #1192
- Update Arctic model notebook to use new Cortex provider by @sfc-gh-dhuang in #1202
- New example showing cortex finetuning by @sfc-gh-dhuang in #1202
- show how to add cost/latency/usage details in virtual records by @sfc-gh-jreini in #1197
Bug Fixes
- Enable formatting during PR build. Also format code that wasn't formatted. by @sfc-gh-dkurokawa in #1212
- Fix test cases generation - normalization step for SummEval score by @sfc-gh-dhuang in #1217
- Enable regex to extract floats in score generation by @sfc-gh-dhuang in #1223
- Fix cost tracking in OpenAI and LiteLLM endpoints by @sfc-gh-dhuang in #1228
- remove deprecated legacy caching by @sfc-gh-jreini in #1233
- Remove remaining streamlit legacy caching by @JushBJJ in #1246