Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

about some questions #10

Open
vickyqi7 opened this issue Oct 20, 2019 · 2 comments
Open

about some questions #10

vickyqi7 opened this issue Oct 20, 2019 · 2 comments

Comments

@vickyqi7
Copy link

Hello, Dr.song. I read your paper《Membership Inference Attacks Against Machine Learning Models》 the other day. I am very interested in it, but I have two questions about it. First, your attack requires the confidence values of the target model output. What if the output is not the confidence values? Second, the example you use, that is, a certain patient's clinical record was used to train a model associated with a disease determine the appropriate medicine dosage. If I input this person's information and the model outputs his medicine dosage, then this person must suffer from this disease and there is no need for member inference attacks, so what is the meaning of this article?I would appreciate your reply.

@csong27
Copy link
Owner

csong27 commented Oct 20, 2019

If the output is not confidence value then the attack reduces to using one-hot encoding of the predicted label for determine membership inference and the attack performance will likely drop in this case.
As for our motivating example, you are thinking in a scenario where there is a one-to-one mapping between medical dosage and diseases. However in reality medical dosage and diseases might not be exactly correlated: certain diseases might be prescribed with similar medicines, and prescription is also conditioned on patient's medical history and other examination etc. Just given a pair of (clinical record, medical dosage), I don't see how one can accurately guess whether a patient has a certain disease. With the help of membership inference, the chance of revealing the disease can be higher. Does this make sense to you?

@vickyqi7
Copy link
Author

Thank you for your reply.I think I see what your mean.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants