Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is there precision data for FP32 and FP16 under TensorRT for GroundingDINO #20

Open
simplew2011 opened this issue Aug 2, 2024 · 1 comment

Comments

@simplew2011
Copy link

simplew2011 commented Aug 2, 2024

Reference link 11342 implemented TensorRT deployment, found that the accuracy of fp32/fp16 cannot be aligned with the accuracy under onnx

@simplew2011 simplew2011 changed the title Is there precision data for FP32 and FP16 under Tensor for GroundingDINO Is there precision data for FP32 and FP16 under TensorRT for GroundingDINO Aug 2, 2024
@rhysdg
Copy link
Owner

rhysdg commented Aug 2, 2024

Hey there! If it's helpful this prediction is with FP16, and the onnxruntime TensorRT execution provider. There's no by eye change in inference quality but I'm yet to do a programmatic assessment of accuracy

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants