Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Backport 2.6] Release notes for Data Prepper 2.6.0 #3712

Merged
merged 1 commit into from
Nov 28, 2023
Merged

[Backport 2.6] Release notes for Data Prepper 2.6.0 #3712

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
60 changes: 60 additions & 0 deletions release/release-notes/data-prepper.release-notes-2.6.0.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,60 @@
## 2023-11-28 Version 2.6.0

---

### Features
* Support DynamoDB as a source. ([#2932](https://github.com/opensearch-project/data-prepper/issues/2932))
* Use Kafka as a buffer ([#3322](https://github.com/opensearch-project/data-prepper/issues/3322))
* Support dynamically changing the visibility timeout for S3 Source with SQS queue ([#2485](https://github.com/opensearch-project/data-prepper/issues/2485))
* Create or update Amazon OpenSearch Serverless network policy ([#3577](https://github.com/opensearch-project/data-prepper/issues/3577))
* Sink level metric for end to end latency ([#3494](https://github.com/opensearch-project/data-prepper/issues/3494))


### Enhancements
* Use Amazon Linux as base Docker image ([#3505](https://github.com/opensearch-project/data-prepper/issues/3505))
* Allow the Kafka buffer (and others that do not require the heap) to bypass the heap circuit breaker ([#3616](https://github.com/opensearch-project/data-prepper/issues/3616))
* Improve gRPC request exception logging ([#3621](https://github.com/opensearch-project/data-prepper/issues/3621))
* Configure the delay in the random string source ([#3601](https://github.com/opensearch-project/data-prepper/issues/3601))
* Add `distribution_version` flag to `opensearch` source ([#3636](https://github.com/opensearch-project/data-prepper/pull/3636))


### Bug Fixes
* Data Prepper is writing empty DLQ objects ([#3644](https://github.com/opensearch-project/data-prepper/issues/3644))
* Bulk Operation Retry Strategy should print cause of error ([#3504](https://github.com/opensearch-project/data-prepper/issues/3504))
* ISM index rollover actions fail because of missing setting for otel-v1-apm-span-* indices ([#3506](https://github.com/opensearch-project/data-prepper/issues/3506))
* AWS `opensearch` source error: `ElasticsearchVersionInfo.buildFlavor` ([#3640](https://github.com/opensearch-project/data-prepper/issues/3640))
* No permissions for writing to Amazon OpenSearch Serverless collection only shows errors after `max_retries` limit is reached ([#3508](https://github.com/opensearch-project/data-prepper/issues/3508))
* Bulk Operation Retry Strategy should print cause of error ([#3504](https://github.com/opensearch-project/data-prepper/issues/3504))
* NullPointer exception in `DefaultKafkaClusterConfigSupplier` get API ([#3528](https://github.com/opensearch-project/data-prepper/issues/3528))
* Fix bug so global read-only items do not expire from TTL in DynamoDB source coordination store ([#3703](https://github.com/opensearch-project/data-prepper/issues/3703))
* Check if failedDeleteCount is positive before logging an SQS error ([#3686](https://github.com/opensearch-project/data-prepper/issues/3686))
* Docker image jre-jammy contains Berkeley DB ([#3543](https://github.com/opensearch-project/data-prepper/issues/3543))
* Race condition in DefaultEventHandle ([#3617](https://github.com/opensearch-project/data-prepper/issues/3617))


### Security
* CVE-2023-44981 (Critical) detected in multiple libraries ([#3491](https://github.com/opensearch-project/data-prepper/issues/3491))
* CVE-2023-36478 (High) detected in http2-hpack-11.0.12.jar, jetty-http-11.0.12.jar ([#3490](https://github.com/opensearch-project/data-prepper/issues/3490))
* CVE-2023-4586 (High) detected in netty-handler-4.1.100.Final.jar ([#3443](https://github.com/opensearch-project/data-prepper/issues/3443))
* CVE-2023-5072 (High) detected in json-20230618.jar ([#3522](https://github.com/opensearch-project/data-prepper/issues/3522))
* CVE-2023-39410 (High) detected in avro-1.11.0.jar ([#3430](https://github.com/opensearch-project/data-prepper/issues/3430))
* CVE-2023-4043 (High) detected in parsson-1.1.2.jar ([#3588](https://github.com/opensearch-project/data-prepper/issues/3588))
* CVE-2023-46122 (High) detected in io_2.13-1.9.1.jar ([#3547](https://github.com/opensearch-project/data-prepper/issues/3547))
* CVE-2023-46136 (High) detected in Werkzeug-2.2.3-py3-none-any.whl ([#3552](https://github.com/opensearch-project/data-prepper/issues/3552))
* CVE-2023-26048 (Medium) detected in jetty-server-11.0.12.jar ([#2533](https://github.com/opensearch-project/data-prepper/issues/2533))
* CVE-2023-26049 (Medium) detected in jetty-http-11.0.12.jar, jetty-server-11.0.12.jar ([#2532](https://github.com/opensearch-project/data-prepper/issues/2532))
* CVE-2023-40167 (Medium) detected in jetty-http-11.0.12.jar ([#3359](https://github.com/opensearch-project/data-prepper/issues/3359))
* CVE-2023-36479 (Medium) detected in jetty-servlets-11.0.12.jar ([#3367](https://github.com/opensearch-project/data-prepper/issues/3367))
* WS-2023-0236 (Low) detected in jetty-xml-11.0.12.jar ([#3072](https://github.com/opensearch-project/data-prepper/issues/3072))


### Maintenance
* Update to the Gradle 8.x version which supports Java 21. Gradle 8.3 is supporting up to Java 20. ([#3330](https://github.com/opensearch-project/data-prepper/issues/3330))
* Start building Data Prepper on Java 21 ([#3329](https://github.com/opensearch-project/data-prepper/issues/3329))
* Integration tests to validate data going to OpenSearch ([#3678](https://github.com/opensearch-project/data-prepper/issues/3678))
* Unit tests fail on Windows machine ([#3459](https://github.com/opensearch-project/data-prepper/issues/3459))
* Fix disabled E2E ack integration tests in PipelinesWithAcksIT.java ([#3472](https://github.com/opensearch-project/data-prepper/issues/3472))
* Remove the `@Deprecated` from `Record` ([#3536](https://github.com/opensearch-project/data-prepper/issues/3536))
* Remove all unnecessary projects in the 2.6 branch ([#3605](https://github.com/opensearch-project/data-prepper/issues/3605))
* Update end-to-end tests to run from the released Docker image ([#3566](https://github.com/opensearch-project/data-prepper/issues/3566))

Loading