diff --git a/CHANGES.md b/CHANGES.md index 031e17e5edac..3d691bb681a4 100644 --- a/CHANGES.md +++ b/CHANGES.md @@ -50,6 +50,7 @@ ## Known Issues +[comment]: # ( When updating known issues after release, make sure also update website blog in website/www/site/content/blog.) * ([#X](https://github.com/apache/beam/issues/X)). --> @@ -88,6 +89,7 @@ ## Known Issues +[comment]: # ( When updating known issues after release, make sure also update website blog in website/www/site/content/blog.) * ([#X](https://github.com/apache/beam/issues/X)). # [2.63.0] - Unreleased @@ -158,6 +160,7 @@ ## Known Issues +[comment]: # ( When updating known issues after release, make sure also update website blog in website/www/site/content/blog.) * ([#X](https://github.com/apache/beam/issues/X)). # [2.62.0] - 2025-01-21 @@ -194,6 +197,7 @@ ## Known Issues +[comment]: # ( When updating known issues after release, make sure also update website blog in website/www/site/content/blog.) * [Python] If you are using the official Apache Beam Python containers for version 2.62.0, be aware that they include NumPy version 1.26.4. It is strongly recommended that you explicitly specify numpy==1.26.4 in your project's dependency list. ([#33639](https://github.com/apache/beam/issues/33639)). * [Dataflow Streaming Appliance] Commits fail with KeyCommitTooLargeException when a key outputs >180MB of results. Bug affects versions 2.60.0 to 2.62.0, * fix will be released with 2.63.0. [#33588](https://github.com/apache/beam/issues/33588). @@ -238,6 +242,7 @@ ## Known Issues +[comment]: # ( When updating known issues after release, make sure also update website blog in website/www/site/content/blog.) * [Managed Iceberg] DataFile metadata is assigned incorrect partition values ([#33497](https://github.com/apache/beam/issues/33497)). * Fixed in 2.62.0 * [Python] If you are using the official Apache Beam Python containers for version 2.61.0, be aware that they include NumPy version 1.26.4. It is strongly recommended that you explicitly specify numpy==1.26.4 in your project's dependency list. ([#33639](https://github.com/apache/beam/issues/33639)). @@ -295,6 +300,7 @@ when running on 3.8. ([#31192](https://github.com/apache/beam/issues/31192)) ## Known Issues +[comment]: # ( When updating known issues after release, make sure also update website blog in website/www/site/content/blog.) * BigQuery Enrichment (Python): The following issues are present when using the BigQuery enrichment transform ([#32780](https://github.com/apache/beam/pull/32780)): * Duplicate Rows: Multiple conditions may be applied incorrectly, leading to the duplication of rows in the output. * Incorrect Results with Batched Requests: Conditions may not be correctly scoped to individual rows within the batch, potentially causing inaccurate results. @@ -342,6 +348,7 @@ when running on 3.8. ([#31192](https://github.com/apache/beam/issues/31192)) ## Known Issues +[comment]: # ( When updating known issues after release, make sure also update website blog in website/www/site/content/blog.) * Prism is under active development and does not yet support all pipelines. See [#29650](https://github.com/apache/beam/issues/29650) for progress. * In the 2.59.0 release, Prism passes most runner validations tests with the exceptions of pipelines using the following features: OrderedListState, OnWindowExpiry (eg. GroupIntoBatches), CustomWindows, MergingWindowFns, Trigger and WindowingStrategy associated features, Bundle Finalization, Looping Timers, and some Coder related issues such as with Python combiner packing, and Java Schema transforms, and heterogenous flatten coders. Processing Time timers do not yet have real time support. @@ -354,6 +361,8 @@ when running on 3.8. ([#31192](https://github.com/apache/beam/issues/31192)) * Fixed in 2.61.0. * [Managed Iceberg] DataFile metadata is assigned incorrect partition values ([#33497](https://github.com/apache/beam/issues/33497)). * Fixed in 2.62.0 +* [FileBasedIO] StringSet metrics can grow unlimitedly large when pipeline involves read/write large number of files, and degrading functionalities such us metrics monitoring and Dataflow job upgrade. + * Mitigated in 2.60.0 ([#32649](https://github.com/apache/beam/issues/32649)). # [2.58.1] - 2024-08-15 diff --git a/website/www/site/content/en/blog/beam-2.59.0.md b/website/www/site/content/en/blog/beam-2.59.0.md index 846e45916d66..4334e5d67b1e 100644 --- a/website/www/site/content/en/blog/beam-2.59.0.md +++ b/website/www/site/content/en/blog/beam-2.59.0.md @@ -71,6 +71,10 @@ For more information on changes in 2.59.0, check out the [detailed release notes * Duplicate Rows: Multiple conditions may be applied incorrectly, leading to the duplication of rows in the output. * Incorrect Results with Batched Requests: Conditions may not be correctly scoped to individual rows within the batch, potentially causing inaccurate results. * Fixed in 2.61.0. +* [Managed Iceberg] DataFile metadata is assigned incorrect partition values ([#33497](https://github.com/apache/beam/issues/33497)). + * Fixed in 2.62.0 +* [FileBasedIO] StringSet metrics can grow unlimitedly large when pipeline involves read/write large number of files, and degrading functionalities such us metrics monitoring and Dataflow job upgrade. + * Mitigated in 2.60.0 ([#32649](https://github.com/apache/beam/issues/32649)). For the most up to date list of known issues, see https://github.com/apache/beam/blob/master/CHANGES.md diff --git a/website/www/site/content/en/blog/beam-2.60.0.md b/website/www/site/content/en/blog/beam-2.60.0.md index e5767cff5114..3c19ea4392fb 100644 --- a/website/www/site/content/en/blog/beam-2.60.0.md +++ b/website/www/site/content/en/blog/beam-2.60.0.md @@ -75,6 +75,11 @@ when running on 3.8. ([#31192](https://github.com/apache/beam/issues/31192)) * Duplicate Rows: Multiple conditions may be applied incorrectly, leading to the duplication of rows in the output. * Incorrect Results with Batched Requests: Conditions may not be correctly scoped to individual rows within the batch, potentially causing inaccurate results. * Fixed in 2.61.0. +* [Managed Iceberg] DataFile metadata is assigned incorrect partition values ([#33497](https://github.com/apache/beam/issues/33497)). + * Fixed in 2.62.0 +* [Dataflow Streaming Appliance] Commits fail with KeyCommitTooLargeException when a key outputs >180MB of results. Bug affects versions 2.60.0 to 2.62.0, + * fix will be released with 2.63.0. [#33588](https://github.com/apache/beam/issues/33588). + * To resolve this issue, downgrade to 2.59.0 or upgrade to 2.63.0 or enable [Streaming Engine](https://cloud.google.com/dataflow/docs/streaming-engine#use). For the most up to date list of known issues, see https://github.com/apache/beam/blob/master/CHANGES.md diff --git a/website/www/site/content/en/blog/beam-2.61.0.md b/website/www/site/content/en/blog/beam-2.61.0.md index dafa94cbddc9..fd5aae33fbb6 100644 --- a/website/www/site/content/en/blog/beam-2.61.0.md +++ b/website/www/site/content/en/blog/beam-2.61.0.md @@ -66,6 +66,9 @@ For more information on changes in 2.61.0, check out the [detailed release notes * [Managed Iceberg] DataFile metadata is assigned incorrect partition values ([#33497](https://github.com/apache/beam/issues/33497)). * Fixed in 2.62.0 * [Python] If you are using the official Apache Beam Python containers for version 2.61.0, be aware that they include NumPy version 1.26.4. It is strongly recommended that you explicitly specify numpy==1.26.4 in your project's dependency list. ([#33639](https://github.com/apache/beam/issues/33639)). +* [Dataflow Streaming Appliance] Commits fail with KeyCommitTooLargeException when a key outputs >180MB of results. Bug affects versions 2.60.0 to 2.62.0, + * fix will be released with 2.63.0. [#33588](https://github.com/apache/beam/issues/33588). + * To resolve this issue, downgrade to 2.59.0 or upgrade to 2.63.0 or enable [Streaming Engine](https://cloud.google.com/dataflow/docs/streaming-engine#use). For the most up to date list of known issues, see https://github.com/apache/beam/blob/master/CHANGES.md diff --git a/website/www/site/content/en/blog/beam-2.62.0.md b/website/www/site/content/en/blog/beam-2.62.0.md index 2bb4ff92a9c2..fd65c116ca6c 100644 --- a/website/www/site/content/en/blog/beam-2.62.0.md +++ b/website/www/site/content/en/blog/beam-2.62.0.md @@ -61,6 +61,9 @@ For the most up to date list of known issues, see https://github.com/apache/beam ## Known Issues * [Python] If you are using the official Apache Beam Python containers for version 2.62.0, be aware that they include NumPy version 1.26.4. It is strongly recommended that you explicitly specify numpy==1.26.4 in your project's dependency list. ([#33639](https://github.com/apache/beam/issues/33639)). +* [Dataflow Streaming Appliance] Commits fail with KeyCommitTooLargeException when a key outputs >180MB of results. Bug affects versions 2.60.0 to 2.62.0, + * fix will be released with 2.63.0. [#33588](https://github.com/apache/beam/issues/33588). + * To resolve this issue, downgrade to 2.59.0 or upgrade to 2.63.0 or enable [Streaming Engine](https://cloud.google.com/dataflow/docs/streaming-engine#use). ## List of Contributors