Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Implement SHM serialization for Tensors #17

Open
VivekPanyam opened this issue Jan 19, 2023 · 0 comments
Open

Implement SHM serialization for Tensors #17

VivekPanyam opened this issue Jan 19, 2023 · 0 comments

Comments

@VivekPanyam
Copy link
Owner

Maybe also make Handle serialize differently based on the size of the tensor? For large tensors, it uses shared memory. For small ones it serializes them inline? Make Handle a variant so we can choose dynamically.
@VivekPanyam VivekPanyam mentioned this issue Feb 1, 2023
Merged
VivekPanyam added a commit that referenced this issue Feb 1, 2023
@VivekPanyam
Implement shared memory storage + benchmark (#45)
6372c2c 
This PR implements shared memory storage for tensors and updates the
allocation benchmark to measure performance.

See the included performance analysis in
`source/carton-runner-interface/benches` for more details.

cc #17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@VivekPanyam