Skip to content

Commit

Permalink
#13180: added continuous batching paged attention demo for llama 3.1 8b
Browse files Browse the repository at this point in the history
  • Loading branch information
@caixunshiren
caixunshiren committed Sep 27, 2024
1 parent 49384c1 commit bda62f9
Show file tree
Hide file tree
Showing 5 changed files with 600 additions and 41 deletions.
Loading

0 comments on commit bda62f9

Please sign in to comment.