Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Qwen2-7B-instruct 句子字面对比，结果不正确 #899

Open
zhaoxjmail opened this issue Sep 10, 2024 · 2 comments
Open

Qwen2-7B-instruct 句子字面对比，结果不正确 #899

zhaoxjmail opened this issue Sep 10, 2024 · 2 comments
Assignees
@yangapku
Labels
enhancement New feature or request

Comments

@zhaoxjmail
Copy link

zhaoxjmail commented Sep 10, 2024 •
edited
Loading

image
@zhaoxjmail zhaoxjmail changed the title Qwen2-7B-instruct 在本地与 https://huggingface.co/spaces/Qwen/Qwen2-7b-instruct-demo生成结果不同 Qwen2-7B-instruct 结果异常 Sep 11, 2024
@jklj077 jklj077 added the enhancement New feature or request label Sep 11, 2024
@jklj077
Copy link
Collaborator

jklj077 commented Sep 11, 2024

Hi,

I can indeed reproduce this with Qwen2-7B-Instruct.
However, Qwen2-72B-Instruct can answer correctly.

image

@jklj077 jklj077 changed the title Qwen2-7B-instruct 结果异常 Qwen2-7B-instruct 句子字面对比，结果不正确 Dec 4, 2024
@jklj077
Copy link
Collaborator

jklj077 commented Dec 4, 2024

this specific badcase still exists for Qwen2.5-7B-Instruct and smaller models. but the larger model can get it right.

image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@yangapku yangapku

Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@zhaoxjmail @yangapku @jklj077