How to interact with the compressed model?

[hsb1995]

Dear Professor, in your paper, we have studied it in detail. I can understand most of the formula derivation, but there is a question I would like to ask you:
At the end of your article, how do we interact with the compressed model?
I tried to redeploy the Llama7B model, and after deployment, they were able to run and interact with each other. However, the compressed model I replicated cannot run on it with many errors.
You provided a visualization table in your paper, but the program did not provide it. Can I ask for advice on this part?