Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Does FV hold for mutli-token transformation tasks? #15

Open
MarSaKi opened this issue Dec 23, 2024 · 0 comments
Open

Does FV hold for mutli-token transformation tasks? #15

MarSaKi opened this issue Dec 23, 2024 · 0 comments

Comments

@MarSaKi
Copy link

MarSaKi commented Dec 23, 2024

Dear author,
Thanks for your great work and generous open-sourcing efforts!
Function vectors are indeed a remarkable discovery. After reading your paper, I noticed that the tasks where function vectors hold true often involve relatively simple mappings from multi-token inputs to single-token outputs, such as antonyms or word-level translations.
This naturally leads me to a question: Do function vectors also hold for multi-token to multi-token mapping tasks, such as sentence-level translation? Could you please share some of your insights on this? Additionally, are there any in-context sentence translation datasets that could be used to explore this question? Or perhaps related literature that has already investigated this topic?

I deeply appreciate your time and thoughts on this matter!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant