Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The PostCommit Java Nexmark Dataflow job is flaky #30606

Open
github-actions bot opened this issue Mar 12, 2024 · 10 comments
Open

The PostCommit Java Nexmark Dataflow job is flaky #30606

github-actions bot opened this issue Mar 12, 2024 · 10 comments

Comments

@github-actions
Copy link
Contributor

The PostCommit Java Nexmark Dataflow is failing over 50% of the time
Please visit https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_Nexmark_Dataflow.yml?query=is%3Afailure+branch%3Amaster to see the logs.

Copy link
Contributor Author

Reopening since the workflow is still flaky

Copy link
Contributor Author

Reopening since the workflow is still flaky

@damccorm damccorm removed this from the 2.59.0 Release milestone Aug 22, 2024
@shahine44
Copy link

shahine44 commented Aug 22, 2024 via email

@shahine44
Copy link

shahine44 commented Aug 22, 2024 via email

@kennknowles
Copy link
Member

Permanently red for about a week.

@kennknowles
Copy link
Member

Could this also be due to the BOM update and ZetaSQL?

@Abacn
Copy link
Contributor

Abacn commented Nov 26, 2024

It's due to ZetaSQL. Taking an example job id 2024-11-26_02_24_36-1437416076296126678, the test is supposed to run on Java11

image

However, the error

Caused by: java.lang.NoSuchMethodError: java.util.Map.entry(Ljava/lang/Object;Ljava/lang/Object;)Ljava/util/Map$Entry;
	at com.google.zetasql.Type.<clinit>(Type.java:55)
	at com.google.zetasql.TypeFactory$1.apply(TypeFactory.java:123)

indicates the worker container is actually on Java8

@Abacn
Copy link
Contributor

Abacn commented Nov 26, 2024

I see, this is due to setting "--workerHarnessContainerImage=" leads to an internal worker container: "us-central1-artifactregistry.gcr.io/google.com/dataflow-containers/worker/v1beta3/beam-java-streaming:20241122-02-rc00" which is built on Java8

nexmarkArgsList.add('--workerHarnessContainerImage=')

@Amar3tto
Copy link
Collaborator

Job has been stable for 3 days. Closing as resolved.

@github-actions github-actions bot added this to the 2.63.0 Release milestone Jan 31, 2025
@github-actions github-actions bot reopened this Feb 2, 2025
Copy link
Contributor Author

github-actions bot commented Feb 2, 2025

Reopening since the workflow is still flaky

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

6 participants