Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add possibility of configuration for Coordinator and Worker prefix #12342

Open
9 tasks
TiagoSilva67 opened this issue Feb 19, 2025 · 1 comment
Open
9 tasks
Labels
proposal Iceberg Improvement Proposal (spec/major changes/etc)

Comments

@TiagoSilva67
Copy link

Proposed Change

Feature Request / Improvement

Summary:
Apache Iceberg Kafka Connect should be able to allow configuration of the naming of structures that need to be compliant with ACL policies in the environment where it is being installed.

Motivation
Currently, Apache Iceberg does not allow to have custom names for Coordinator and Worker in the kafka-connect since the names are hard coded, which causes problem in the using of the connector because it is blocked by ACL policies that are expecting a specific prefix in the structures names.

Image

Image

This is a problem specially for cases where the ACL policies can not be changed to accommodate the kafka-connect names.

Proposed Implementation:

  • Introduce a new sink property that define the prefix
  • Add method to IcebergSinkConfig to retrieve the value of the property from the sink configuration
  • Use the prefix as the name when constructing instances of classes that extend Channel (e.g., Coordinator or Worker)

Query engine

  • None

Willingness to contribute

  • I can contribute this improvement/feature independently
  • I would be willing to contribute this improvement/feature with guidance from the Iceberg community
  • I cannot contribute this improvement/feature at this time

Proposal document

No response

Specifications

  • Table
  • View
  • REST
  • Puffin
  • Encryption
  • Other
@TiagoSilva67 TiagoSilva67 added the proposal Iceberg Improvement Proposal (spec/major changes/etc) label Feb 19, 2025
@leandrosilv
Copy link

I guess that this issue is related to #12352

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
proposal Iceberg Improvement Proposal (spec/major changes/etc)
Projects
None yet
Development

No branches or pull requests

2 participants