Skip to content

Commit

Permalink
refine readme
Browse files Browse the repository at this point in the history
Signed-off-by: Xinyao Wang <[email protected]>
  • Loading branch information
XinyaoWa committed Nov 15, 2024
1 parent 4782f2b commit 514a5b6
Show file tree
Hide file tree
Showing 2 changed files with 0 additions and 12 deletions.
6 changes: 0 additions & 6 deletions comps/llms/text-generation/vllm/langchain/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -56,12 +56,6 @@ bash ./build_docker_vllm.sh hpu

Set `hw_mode` to `hpu`.

Note: If you want to enable tensor parallel, please set `setuptools==69.5.1` in Dockerfile.hpu before build docker with following command.

```
sed -i "s/RUN pip install setuptools/RUN pip install setuptools==69.5.1/g" docker/Dockerfile.hpu
```

#### Launch vLLM service on single node

For small model, we can just use single node.
Expand Down
6 changes: 0 additions & 6 deletions comps/llms/text-generation/vllm/llama_index/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -56,12 +56,6 @@ bash ./build_docker_vllm.sh hpu

Set `hw_mode` to `hpu`.

Note: If you want to enable tensor parallel, please set `setuptools==69.5.1` in Dockerfile.hpu before build docker with following command.

```
sed -i "s/RUN pip install setuptools/RUN pip install setuptools==69.5.1/g" docker/Dockerfile.hpu
```

#### Launch vLLM service on single node

For small model, we can just use single node.
Expand Down

0 comments on commit 514a5b6

Please sign in to comment.