Skip to content

Commit

Permalink
Automated File Generation from Docs Notebook Changes (#542)
Browse files Browse the repository at this point in the history 
Co-authored-by: joshreini1 <[email protected]>
  • Loading branch information
@github-actions @joshreini1
github-actions[bot] and joshreini1 authored Nov 2, 2023
1 parent 5d4a3b1 commit 3ff8878
Show file tree
Hide file tree
Showing 9 changed files with 259 additions and 328 deletions.
12 changes: 6 additions & 6 deletions README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -43,18 +43,18 @@ TruLens supports the evaluation of tracking for any LLM app framework. Choose a

**Langchain**

[langchain_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0a/trulens_eval/examples/quickstart/langchain_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0a/trulens_eval/examples/quickstart/colab/langchain_quickstart_colab.ipynb)
[langchain_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/langchain_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/colab/langchain_quickstart_colab.ipynb)

**Llama-Index**

[llama_index_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0a/trulens_eval/examples/quickstart/llama_index_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0a/trulens_eval/examples/quickstart/colab/llama_index_quickstart_colab.ipynb)
[llama_index_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/llama_index_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/colab/llama_index_quickstart_colab.ipynb)

**Custom Text to Text Apps**

[text2text_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0a/trulens_eval/examples/quickstart/text2text_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0a/trulens_eval/examples/quickstart/colab/text2text_quickstart_colab.ipynb)
[text2text_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/text2text_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/colab/text2text_quickstart_colab.ipynb)

## TruLens-Explain

Expand Down
12 changes: 6 additions & 6 deletions trulens_eval/README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -46,18 +46,18 @@ TruLens supports the evaluation of tracking for any LLM app framework. Choose a

**Langchain**

[langchain_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0a/trulens_eval/examples/quickstart/langchain_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0a/trulens_eval/examples/quickstart/colab/langchain_quickstart_colab.ipynb)
[langchain_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/langchain_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/colab/langchain_quickstart_colab.ipynb)

**Llama-Index**

[llama_index_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0a/trulens_eval/examples/quickstart/llama_index_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0a/trulens_eval/examples/quickstart/colab/llama_index_quickstart_colab.ipynb)
[llama_index_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/llama_index_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/colab/llama_index_quickstart_colab.ipynb)

**Custom Text to Text Apps**

[text2text_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0a/trulens_eval/examples/quickstart/text2text_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0a/trulens_eval/examples/quickstart/colab/text2text_quickstart_colab.ipynb)
[text2text_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/text2text_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/colab/text2text_quickstart_colab.ipynb)

### 💡 Contributing

Expand Down
53 changes: 27 additions & 26 deletions trulens_eval/examples/quickstart/colab/langchain_quickstart_colab.ipynb
View file
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "002ffae2",
"id": "631abb12",
"metadata": {},
"source": [
"# Langchain Quickstart\n",
Expand All @@ -30,7 +30,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "f028b402",
"id": "ed112ffc",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -40,7 +40,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "9c313e70",
"id": "9de40d54",
"metadata": {},
"source": [
"## Setup\n",
Expand All @@ -51,7 +51,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "e8dc32cc",
"id": "ac1dc02a",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -63,7 +63,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "ecd0e34e",
"id": "314dd325",
"metadata": {},
"source": [
"### Import from LangChain and TruLens"
Expand All @@ -72,7 +72,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "2159b8c3",
"id": "12354219",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -95,7 +95,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "7faab30e",
"id": "43a0c2a2",
"metadata": {},
"source": [
"### Create Simple LLM Application\n",
Expand All @@ -106,7 +106,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "e00c3ff8",
"id": "36e94b09",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -128,7 +128,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "b1ac78fe",
"id": "5fd05b6b",
"metadata": {},
"source": [
"### Send your first request"
Expand All @@ -137,7 +137,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "8c6c3032",
"id": "4207dd6f",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -147,7 +147,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "d0ceda72",
"id": "20dc1ac7",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -159,15 +159,16 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "5790ac98",
"id": "75b91bcf",
"metadata": {},
"source": [
"## Initialize Feedback Function(s)"
]
},
{
"cell_type": "code",
"id": "fcfce0cc",
"execution_count": null,
"id": "1722d1b7",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -183,7 +184,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "0c23d029",
"id": "0086d018",
"metadata": {},
"source": [
"## Instrument chain for logging with TruLens"
Expand All @@ -192,7 +193,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "a07c1fb1",
"id": "9959db6e",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -204,7 +205,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "7a632846",
"id": "1957bccb",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -216,7 +217,7 @@
},
{
"cell_type": "markdown",
"id": "6bacc4fc",
"id": "b23067d8",
"metadata": {},
"source": [
"## Retrieve records and feedback"
Expand All @@ -225,7 +226,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "8856f6a0",
"id": "d8a5374a",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -240,7 +241,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "09d4ec4f",
"id": "07bb2d75",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -262,7 +263,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "d79a1fd0",
"id": "e13ec812",
"metadata": {},
"source": [
"## Explore in a Dashboard"
Expand All @@ -271,7 +272,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "502832e1",
"id": "728c7e47",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -283,7 +284,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "43ba08ab",
"id": "2ddac721",
"metadata": {},
"source": [
"Alternatively, you can run `trulens-eval` from a command line in the same folder to start the dashboard."
Expand All @@ -292,7 +293,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "2a22d99d",
"id": "73f2420a",
"metadata": {},
"source": [
"### Chain Leaderboard\n",
Expand Down Expand Up @@ -325,7 +326,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "a8dff588",
"id": "d30fc56a",
"metadata": {},
"source": [
"Note: Feedback functions evaluated in the deferred manner can be seen in the \"Progress\" page of the TruLens dashboard."
Expand All @@ -334,7 +335,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "2790a01c",
"id": "ba44412c",
"metadata": {},
"source": [
"## Or view results directly in your notebook"
Expand All @@ -343,7 +344,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "b2292133",
"id": "f99aa8f3",
"metadata": {},
"outputs": [],
"source": [
Expand Down
Loading

0 comments on commit 3ff8878

Please sign in to comment.