Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Streamlined Data Import #18

Open
sheridancbio opened this issue Jan 8, 2025 · 0 comments
Open

Streamlined Data Import #18

sheridancbio opened this issue Jan 8, 2025 · 0 comments

Comments

@sheridancbio
Copy link

Feature Summary : During import of cancer studies data should flow directly into a running ClickHouse database.

The current approach of importing into a mysql database which is then replicated into ClickHouse and then further processed through table derivation introduces data integrity concerns, processing delays, and the overhead of unneeded data artifacts. A direct import approach would be more efficient and elegant.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant