The problem about the final performance

[yexiguafuqihao]

Thanks for your valuable work. And I wonder if you have achieved the performance as reported in the original paper.

[shuuchen]

Thank you. I did not use datasets as those in the paper, so it is hard to compare. I used my own datasets for unsupervised pre-training and it improved fine-tuning.