Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Include encrypted data key in Kafka buffer message. #3655

Closed
Tracked by #3979
dlvenable opened this issue Nov 14, 2023 · 1 comment
Closed
Tracked by #3979

Include encrypted data key in Kafka buffer message. #3655

dlvenable opened this issue Nov 14, 2023 · 1 comment
Assignees
Labels
enhancement New feature or request Priority-High
Milestone

Comments

@dlvenable
Copy link
Member

Coming from #3620, include metadata about encryption in the Kafka buffer message

message BufferedData {
   /* The format of the message as it was written.
    */
   MessageFormat message_format = 1;
  
  /* The actual data. This is encrypted if key_id is present. Otherwise, it
   * is unencrypted data.
   */
  bytes data = 2;

  /* Indicates if data is encrypted or not.
   */
  optional boolean encrypted = 3;
   
   /* The data key which encrypted the data field. This will be encrypted.
    * The consuming Data Prepper node must have the ability to decrypt this key.
    */
  optional bytes encrypted_data_key = 4;
}

@dlvenable dlvenable added enhancement New feature or request and removed untriaged labels Nov 14, 2023
@dlvenable dlvenable added this to the v2.7 milestone Nov 14, 2023
@dlvenable dlvenable self-assigned this Nov 14, 2023
@dlvenable dlvenable moved this from Unplanned to To do in Data Prepper Tracking Board Dec 13, 2023
@dlvenable dlvenable moved this from To do to In progress in Data Prepper Tracking Board Jan 17, 2024
dlvenable added a commit to dlvenable/data-prepper that referenced this issue Jan 18, 2024
…he encryption in the protobuf record. Contributes toward opensearch-project#3655.

Signed-off-by: David Venable <[email protected]>
dlvenable added a commit that referenced this issue Feb 8, 2024
…he encryption in the protobuf record. Contributes toward #3655. (#3976)

Signed-off-by: David Venable <[email protected]>
@dlvenable
Copy link
Member Author

This was resolved by #3976

@github-project-automation github-project-automation bot moved this from In progress to Done in Data Prepper Tracking Board Feb 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request Priority-High
Projects
Development

No branches or pull requests

1 participant