Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Documentation Update #27

Open
wants to merge 380 commits into
base: main
Choose a base branch
from
Open

Conversation

manjudr
Copy link
Collaborator

@manjudr manjudr commented Nov 19, 2024

No description provided.

yashashkumar and others added 30 commits September 3, 2024 18:08
* #OBS-I115: Dataset list API refactoring

* #0000: adding command api

* #OBS-I116: Dataset CRUD APIs test and fixes

* #OBS-I115: cmd api remove addn modules

* #OBS-I116: Dataset status trasition to retire check for denorm fields

* #OBS-I116: Dataset CRUD APIs test cases and fixes

* #OBS-I115: Dataset Transition API refactoring

* #OBS-I115: Dataset Transition API refactoring

* #OBS-I116: Dataset update API Dedupe and denorm test cases fixes

* #OBS-I115: Dataset Transition API refactoring and error handling refactoring

* #OBS-I115: Dataset Transition API refactoring

* #OBS-I115: Dataset Transition API refactoring

* #OBS-I115: Remove unnecessary field fields_set

* #OBS-I115: Dataset publish API - update the index of hudi spec properly for publish to handle schema evolution

* #OBS-I116: Dataset create and status transition api code fix

* #OBS-I116: Dataset Create api test case fixes

* #OBS-I116: Dataset update extraction config api test case fixes

* #OBS-I116: Dataset druid ingestion spec generation fix

* #OBS-I116: express version upgraded

* #OBS-I116: Dataset create api fixes

* #OBS-I116: Dataset ingestion spec generation fix

* #OBS-I126: updated swagger documentation

* #OBS-I126: updated postman collection

* #OBS-I126: updated postman collection

* #OBS-I116: fix: entry topic column in datasets model

* #OBS-I58 feat: Minio cloud store support

- Added endpoint. as optional config to support the minio

* #OBS-I126: added dataset read, list, update api's documentation and updated collection

* #OBS-I116: feat: Dataschema api implementation v2

* #OBS-I116: feat: Schema validation fix

* #OBS-I126: swagger doc updated

* #OBS-I116: Dataset update api test cases

* #OBS-I116: fix: linting fixes

* #OBS-I116: lint fixes

* #OBS-I116: Dataset status transition test cases

* #OBS-I126 : added multiple requests example

* #OBS-I126 : updated order

* #OBS-I126 : updated server url

* #OBS-I21: feat: dataset publish changes for connectors

* #OBS-I1 updated Dataset Health API code

* #OBS-I116: Dataset CRUD api fixes

* #OBS-I116: fix: error codes fix

* #OBS-I1 Refactored as per new changes

* #OBS-I101: Update the publish API for the v2 APIs

* #OBS-I101: fix db models

* #OBS-I115: Remove the v1 unused API code and restructure the folders

* #OBS-I1 Added DatasethealthService

* #OBS-I1 Updated the imports and folders

* #OBS-I2 updated dataset reset

* #OBS-I116: fix: Command api and schema fixes

* #OBS-I116: fix: Command api fix in db query

* #OBS-I1 Added Notifications and alerts APIs

* #OBS-I138: added decrypted response for the read api for connectors_config field and added defaults updated date and created date to list api

* #OBS-I116: fix: feat: Dataset copy and export api implementation

* #OBS-I2 Refactoring as per v2 APIs

* #OBS-I2 typo fix

* #OBS-I116: fix: fix: Dataset copy check for dataset fix

* #OBS-I21: dataset publish changes fixes

* #OBS-I116: fix: feat: Feedback fixes of removing set redis db

* #OBS-I138: added cors to app

* #OBS-I116: fix: feat: Dataset import api implementation

* #OBS-I116: fix: fix: Dataset service fix

* #OBS-I116: fix: repeated Validation method removal

* #OBS-I116: fix: unused code

* connector list

* #OBS-I142: connector list api

* #OBS-I116: fix: schema validation check for v1 exported dataset.

* #OBS-I116: fix: Dataset overwrite after creation failure

* #OBS-I116: fix: error handling

* #OBS-I116: fix: error messages fix

* #OBS-I116: fix: code fixes

* #OBS-I142: formatted connector list api files

* #OBS-I142: formatted connector list api files

* #OBS-I142: formatted connector list file

* #OBS-I138: required changes for dataset for master dataset migration from v1 to v2

* #OBS-I138: removed cors package

* #OBS-I138: updated package json file

* #OBS-I138: indentation fix

* #OBS-I138: indentation fix

* #OBS-I138: fixed indentations

* #OBS-I142: updated postman collection

* #OBS-I142: added connector list swagger documentation

* #OBS-I142: updated postman collection

* #OBS-I116: feat: Dataset Import and export api integration fixes

* #OBS-I138: removed comment

* #OBS-I138: throwing error if dataset is undefined

* #OBS-I142: added test cases for connector list

* #OBS-I138: merging dataset defaults to dataset draft record before saving

* #OBS-I138: adding merged event to dataset while migrating live or draft dataset

* #OBS-I142: added live_date field to defaultFields

* #OBS-I145: Connector Read API

* #OBS-I145: updated postman collection with connector read api

* #OBS-I145: updated swagger documentation

* #OBS-I145: updated the connector read api

* merge changes

* merge changes

* Resolved merge changes

* Resolved merge changes

* #OBS-I145: updated the connector read api

* #OBS-I138: removed datakey before merging defaults to dataset

* #OBS-I145: updated postman collection and swagger documentation

* #OBS-I145: added the test cases for connector read api

* #OBS-I145: added a test case for connector read api

* #OBS-I116: feat: Dataset import api fixes

* #OBS-I116: feat: Test cases and linting fixes

* #OBS-I116: feat: Dataset status transition test cases fix

* #OBS-I1 updated the routes

* #OBS-I116: feat: Dataset migratio method fix

* #OBS-I108: feat: helm modifications for flink connectors

* #OBS-I108: helm chart fixes

* #OBS-I108: feat: Modify volume mounts

* #OBS-I108: feat: Add PVC for JobManager

* #OBS-I108: feat: change args for jobmanager command

* #OBS-I141: added a new metric to sum the response time

* #OBS-I141: modified the url variable and access dataset_id from params

* #OBS-I141: added helper function to get dataset_id for error cases

* #OBS-I108: feat: Use sidecar container to submit connector flink job

* #OBS-I141: added telemetry for v2 api's

* #OBS-I141: added a new metric to sum the response time

* #OBS-I141: modified the url variable and access dataset_id from params

* #OBS-I141: added helper function to get dataset_id for error cases

* #OBS-I141: added telemetry for v2 api's

* #OBS-I141: added telemetry for v2 api's

* #OBS-I143: feat: dataset publish changes to deploy flink connectors

* #OBS-I141: removed metric for sum of response time

* #OBS-I141: removed usage of builtin kafka methods from telemetry file

* #OBS-I146: feat: Retire fix

* Issue #SBCOSS-12 fix: convert all SQL raw queries to prepared statements

* Issue #SBCOSS-12 fix: tags is an array, so requires empty json for null case; dataset draft deletion requires deletion of transformation and source config drafts

* #SBCOSS-23: feat:  dataset publish changes for redeployment

* #OBS-I167 : read api changes while reading connectors according to v2 structure

* #OBS-I173: fix: Ready to publish schema fix to expect connector configs as object and string

* #OBS-I174: fix: Dataset read api fix to expect both v1 and v2 connectors

* #OBS-I146: fix: Test case fix for read api

* #OBS-I146: fix: Test case fix for read api changes

* #OBS-I146: fix: status transition test cases

* #OBS-I146: fix: Test case script fix

* #OBS-I146: fix: Type error fix

* #OBS-I141: removed metric for sum of response time

* #OBS-I146: fix: Dataset read api test cases fixes

* #OBS-I146: fix: Hudi spec generation test cases

* #OBS-I146: fix: Test case and linting fix

* merge commit

* #OBS-I173: fix: Dataset web console required fixes

* #OBS-I173: fix: Dataset update changes to accept type changes

* #OBS-I167 : dataset read api changes to read live dataset source configs

* #OBS-I146: fix: linting fix

* #OBS-I146: fix: linting fix

* #OBS-I167 : Added string or dict as type to connector_config

* #OBS-I143: dataset publish changes fixes

* #OBS-I167 : if dataset is empty return with error

* #OBS-I143: inswert query fix

* Issue #OBS-I144 fix: icon data as string; check default version

* #OBS-143: fix: dataset publish fixes

* #OBS-I167 : fix: removed duplicate code.

* #OBS-I181 - Updated the event structure

* #OBS-I164: added jwt token vwerification and access control to api's

* #OBS-I164: added jwt token vwerification and access control to api's

* #OBS-I164: modified the access roles and permissions

* #OBS-I164: reading public key from env file

* #OBS-I186 : fix: dataset metrics api

* #OBS-I185 : fix: removed duplicate code.

* #OBS-I164: modified public key variable in config

* flink connector helm chart updates

* flink connector helm chart updates

* fix: dataset publish fixes

* #OBS-I164: modified public key variable in config

* #OBS-I186 : added dataset mertric api controller and route and minor change in dataset transition api

* install pip requirments if applicable

* #OBS-I186 : removed export statement

* #OBS-I164: added config for option rbac verification

* #OBS-I164: changed the middleware to rbac_middleware

* #OBS-I186 : Logic moved to separate function

* #OBS-I164: changed import name

* #OBS-I186 : Logic moved to separate function

* #OBS-I185 : fix: test case fixes

* #OBS-I185 : fix: linting fix

* #OBS-I164: modified config and rbac middleware

* #OBS-I164: added jsonwebtoken package

* master url fix

---------

Co-authored-by: Santhosh Vasabhaktula <[email protected]>
Co-authored-by: JeraldJF <[email protected]>
Co-authored-by: yashashk <[email protected]>
Co-authored-by: harishkumar gangula <[email protected]>
Co-authored-by: SurabhiAngadi <[email protected]>
Co-authored-by: Rakshitha-D <[email protected]>
Co-authored-by: Anand Parthasarathy <[email protected]>
Co-authored-by: Aniket Sakinala <[email protected]>
ravismula and others added 30 commits December 26, 2024 12:16
#OBS-I442 Removed env for topics
… from the table of datasources of postgres db instead of druid
#OBS-I408: data schema fix for proper mappings and data type suggestions
…t-fixes

fix: #OBS-I441 added labels for cronjob
fix: #OBS-I406 storage type support read from envs
fix: #OBS-I406 storage type support envs as json
fix #OBS-I479 ingestion batch structure fix
fix: #OBS-I354 dataset level alert metric caching issue fix
fix: #OBS-I494: updated permissions for admin user
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

9 participants