Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add TogetherNotebookLM recipe #766

Merged
merged 8 commits into from
Nov 20, 2024
Merged

add TogetherNotebookLM recipe #766

Show file tree
Hide file tree
Changes from 7 commits
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
cd661d7
Add Together NotebookLM recipe
zainhas Oct 31, 2024
be988c4
small recipe modification
zainhas Oct 31, 2024
c0057d5
move repos
zainhas Oct 31, 2024
50d3d68
update notebook
jeffxtang Nov 1, 2024
a4438d4
renamed notebook
jeffxtang Nov 1, 2024
884faab
added README
jeffxtang Nov 1, 2024
16124b5
deleted old notebook
jeffxtang Nov 1, 2024
d437411
added pydantic to wordlist.txt
jeffxtang Nov 20, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 13 additions & 0 deletions recipes/3p_integrations/togetherai/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
# Building LLM apps using Llama on Together.ai

This folder contains demos on how to use Llama on [Together.ai](https://www.together.ai/) to quickly build LLM apps.

The first demo is a notebook that converts PDF to podcast using Llama 3.1 70B or 8B hosted by Together.ai. It differs and complements the [Meta's implementation](https://github.com/meta-llama/llama-recipes/tree/main/recipes/quickstart/NotebookLlama) in several ways:

1. You don't need to download the Llama models from HuggingFace and have a GPU to run the notebooks - you can quickly get a free Together API key and run the whole Colab notebook on a browser, in about 10 minutes;
2. A single system prompt is used to generate the naturally sounding podcast from PDF, with the support of pydantic, scratchpad and JSON response format to make the whole flow simple yet powerful;
3. A different TTS service, also with an easy-to-get free API key, is used.

The whole Colab notebook can run with a single "Runtime - Run all" click, generating the podcast audio from the Transformer paper that started the GenAI revolution.


Loading
Loading