Skip to content

Commit

Permalink
readme
Browse files Browse the repository at this point in the history
  • Loading branch information
yanxi0830 committed Oct 15, 2024
1 parent d1f8515 commit 7c450f8
Showing 1 changed file with 6 additions and 1 deletion.
7 changes: 6 additions & 1 deletion llama_stack/distribution/docker/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@
This folder contains scripts to enable starting a distribution using `docker compose`.


#### TGI Inference Adapter
#### Example: TGI Inference Adapter
```
$ cd llama_stack/distribution/docker/tgi
$ ls
Expand All @@ -21,3 +21,8 @@ INFO: Waiting for application startup.
INFO: Application startup complete.
INFO: Uvicorn running on http://[::]:5000 (Press CTRL+C to quit)
```

To kill the server
```
docker compose down
```

0 comments on commit 7c450f8

Please sign in to comment.