New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[INLONG-11624][Agent] Add SQL data source #11625

Merged

justinwwhuang merged 11 commits into apache:master from justinwwhuang:b11624

Dec 30, 2024

Contributor

justinwwhuang commented Dec 30, 2024 •

edited

Loading

Fixes #11624

Motivation

Add SQL data source

Modifications

Add SQL type task configuration
Add SQL type Task class
Add SQL type Instance class

Verifying this change

(Please pick either of the following options)

This change is a trivial rework/code cleanup without any test coverage.
This change is already covered by existing tests, such as:
(please describe tests)
This change added tests and can be verified as follows:

(example:)
- Added integration tests for end-to-end deployment with large payloads (10MB)
- Extended integration test for recovery after broker failure

Documentation

No doc needed


          [INLONG-11624][Agent] Add SQL data source

7a0cb7b

justinwwhuang added this to the 2.1.0 milestone

justinwwhuang self-assigned this

github-actions bot added the component/agent label

justinwwhuang requested review from doleyzi, aloyszhang and fuweng11

December 30, 2024 08:05

fuweng11 reviewed

View reviewed changes

inlong-agent/agent-common/src/main/java/org/apache/inlong/agent/pojo/SQLTask.java Show resolved Hide resolved

inlong-agent/agent-common/src/main/java/org/apache/inlong/agent/pojo/SQLTask.java Show resolved Hide resolved


          [INLONG-11624][Agent] Add code comments

e566386

aloyszhang reviewed

View reviewed changes

inlong-agent/agent-common/src/main/java/org/apache/inlong/agent/constant/TaskConstants.java Show resolved Hide resolved

aloyszhang reviewed

View reviewed changes

...g-agent/agent-plugins/src/main/java/org/apache/inlong/agent/plugin/instance/SQLInstance.java Outdated Show resolved Hide resolved

aloyszhang reviewed

View reviewed changes

inlong-agent/agent-plugins/src/main/java/org/apache/inlong/agent/plugin/sources/SQLSource.java Outdated Show resolved Hide resolved

aloyszhang reviewed

View reviewed changes

inlong-agent/agent-plugins/src/main/java/org/apache/inlong/agent/plugin/sources/SQLSource.java Outdated Show resolved Hide resolved

justinwwhuang and others added 2 commits

December 30, 2024 17:17


          Update inlong-agent/agent-plugins/src/main/java/org/apache/inlong/age…

c9384c4

…nt/plugin/instance/SQLInstance.java

Co-authored-by: AloysZhang <[email protected]>


          Update inlong-agent/agent-plugins/src/main/java/org/apache/inlong/age…

d85d7fe

…nt/plugin/sources/SQLSource.java

Co-authored-by: AloysZhang <[email protected]>

aloyszhang reviewed

View reviewed changes

inlong-agent/agent-plugins/src/main/java/org/apache/inlong/agent/plugin/sources/SQLSource.java Outdated Show resolved Hide resolved

aloyszhang reviewed

View reviewed changes

inlong-agent/agent-plugins/src/main/java/org/apache/inlong/agent/plugin/sources/SQLSource.java Outdated Show resolved Hide resolved

fuweng11 reviewed

View reviewed changes

inlong-agent/agent-plugins/src/main/java/org/apache/inlong/agent/plugin/sources/SQLSource.java Show resolved Hide resolved


          Update inlong-agent/agent-plugins/src/main/java/org/apache/inlong/age…

b2171aa

…nt/plugin/sources/SQLSource.java

Co-authored-by: AloysZhang <[email protected]>

aloyszhang reviewed

View reviewed changes

...g-agent/agent-plugins/src/main/java/org/apache/inlong/agent/plugin/utils/regex/FileTask.java Outdated Show resolved Hide resolved

aloyszhang reviewed

View reviewed changes

...g-agent/agent-plugins/src/main/java/org/apache/inlong/agent/plugin/utils/regex/FileTask.java Outdated Show resolved Hide resolved

justinwwhuang and others added 3 commits

December 30, 2024 17:27


          Update inlong-agent/agent-plugins/src/main/java/org/apache/inlong/age…

9ed81a0

…nt/plugin/utils/regex/FileTask.java

Co-authored-by: AloysZhang <[email protected]>


          Update inlong-agent/agent-plugins/src/main/java/org/apache/inlong/age…

d3f8c0a

…nt/plugin/utils/regex/FileTask.java

Co-authored-by: AloysZhang <[email protected]>


          [INLONG-11624][Agent] Modify code based on comments

8294bf7

fuweng11 reviewed

View reviewed changes

inlong-agent/agent-plugins/src/main/java/org/apache/inlong/agent/plugin/sources/SQLSource.java Outdated Show resolved Hide resolved


          Update inlong-agent/agent-plugins/src/main/java/org/apache/inlong/age…

5d67de8

…nt/plugin/sources/SQLSource.java

Co-authored-by: fuweng11 <[email protected]>

fuweng11 previously approved these changes

View reviewed changes


          [INLONG-11624][Agent] Modify thread name

898b45e

justinwwhuang dismissed fuweng11’s stale review via

898b45e

December 30, 2024 11:14


          [INLONG-11624][Agent] Rename variables to prevent misunderstandings

67745f1

aloyszhang approved these changes

View reviewed changes

fuweng11 approved these changes

View reviewed changes

justinwwhuang merged commit b91a380 into apache:master

8 checks passed

justinwwhuang deleted the b11624 branch

January 3, 2025 10:22

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

component/agent