Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[NU-1962] Flink scenario testing mechanism: mini cluster created once and reused each time #7458

Open
wants to merge 24 commits into
base: staging
Choose a base branch
from

Test for multiple tests run + refactor

cd419c6
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Open

[NU-1962] Flink scenario testing mechanism: mini cluster created once and reused each time #7458

Test for multiple tests run + refactor
cd419c6
Select commit
Loading
Failed to load commit list.
GitHub Actions / REPORT-IntegrationTests-2.13 succeeded Jan 21, 2025 in 0s

42 passed, 0 failed and 1 skipped

Tests passed successfully

Report Passed Failed Skipped Time
components/openapi/target/it-reports/TEST-pl.touk.nussknacker.openapi.functional.OpenApiScenarioIntegrationTest.xml 4✅ 32s
components/openapi/target/it-reports/TEST-pl.touk.nussknacker.openapi.functional.OpenAPIServiceSpec.xml 1✅ 6s
designer/processReports/target/it-reports/TEST-pl.touk.nussknacker.processCounts.influxdb.InfluxCountsReporterSpec.xml 3✅ 3s
engine/flink/management/target/it-reports/TEST-pl.touk.nussknacker.engine.management.streaming.FlinkStreamingDeploymentManagerSlotsCountSpec.xml 1✅ 317ms
engine/flink/management/target/it-reports/TEST-pl.touk.nussknacker.engine.management.streaming.FlinkStreamingDeploymentManagerSpec.xml 9✅ 1⚪ 136s
engine/flink/management/target/it-reports/TEST-pl.touk.nussknacker.engine.management.streaming.FlinkStreamingProcessTestRunnerSpec.xml 2✅ 5s
engine/flink/management/target/it-reports/TEST-pl.touk.nussknacker.engine.management.streaming.JavaConfigDeploymentManagerSpec.xml 1✅ 13s
engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeBinTest.xml 1✅ 9s
engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerAvroTest.xml 1✅ 31s
engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerJsonTest.xml 1✅ 31s
engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerProbesTest.xml 2✅ 61s
engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.requestresponse.NuReqRespRuntimeBinTest.xml 1✅ 7s
engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.requestresponse.NuReqRespRuntimeDockerTest.xml 2✅ 330ms
security/target/it-reports/TEST-pl.touk.nussknacker.ui.security.oauth2.GenericOidcServiceSpec.xml 1✅ 6s
utils/kafka-components-utils/target/it-reports/TEST-pl.touk.nussknacker.engine.kafka.validator.CachedTopicsExistenceValidatorWhenAutoCreateDisabledTest.xml 6✅ 2s
utils/kafka-components-utils/target/it-reports/TEST-pl.touk.nussknacker.engine.kafka.validator.CachedTopicsExistenceValidatorWhenAutoCreateEnabledTest.xml 6✅ 4s

✅ components/openapi/target/it-reports/TEST-pl.touk.nussknacker.openapi.functional.OpenApiScenarioIntegrationTest.xml

4 tests were completed in 32s with 4 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.openapi.functional.OpenApiScenarioIntegrationTest 4✅ 32s

✅ pl.touk.nussknacker.openapi.functional.OpenApiScenarioIntegrationTest

✅ should should enrich scenario with data
✅ should call enricher with primitive request body
✅ should call enricher with request body
✅ should call enricher returning string

✅ components/openapi/target/it-reports/TEST-pl.touk.nussknacker.openapi.functional.OpenAPIServiceSpec.xml

1 tests were completed in 6s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.openapi.functional.OpenAPIServiceSpec 1✅ 6s

✅ pl.touk.nussknacker.openapi.functional.OpenAPIServiceSpec

✅ service returns customers

✅ designer/processReports/target/it-reports/TEST-pl.touk.nussknacker.processCounts.influxdb.InfluxCountsReporterSpec.xml

3 tests were completed in 3s with 3 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.processCounts.influxdb.InfluxCountsReporterSpec 3✅ 3s

✅ pl.touk.nussknacker.processCounts.influxdb.InfluxCountsReporterSpec

✅ invokes counts for point in time data
✅ invokes query for date range
✅ should detect restarts one SingleDifference mode

✅ engine/flink/management/target/it-reports/TEST-pl.touk.nussknacker.engine.management.streaming.FlinkStreamingDeploymentManagerSlotsCountSpec.xml

1 tests were completed in 317ms with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.management.streaming.FlinkStreamingDeploymentManagerSlotsCountSpec 1✅ 317ms

✅ pl.touk.nussknacker.engine.management.streaming.FlinkStreamingDeploymentManagerSlotsCountSpec

✅ deploy scenario with too low task manager slots counts

✅ engine/flink/management/target/it-reports/TEST-pl.touk.nussknacker.engine.management.streaming.FlinkStreamingDeploymentManagerSpec.xml

10 tests were completed in 136s with 9 passed, 0 failed and 1 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.management.streaming.FlinkStreamingDeploymentManagerSpec 9✅ 1⚪ 136s

✅ pl.touk.nussknacker.engine.management.streaming.FlinkStreamingDeploymentManagerSpec

✅ deploy scenario in running flink
⚪ continue on timeout exception during scenario deploy
✅ cancel of not existing job should not fail
✅ be able verify&redeploy kafka scenario
✅ save state when redeploying
✅ snapshot state and be able to deploy using it
✅ should stop scenario and deploy it using savepoint
✅ fail to redeploy if old is incompatible
✅ fail to redeploy if result produced by aggregation is incompatible
✅ extract scenario definition

✅ engine/flink/management/target/it-reports/TEST-pl.touk.nussknacker.engine.management.streaming.FlinkStreamingProcessTestRunnerSpec.xml

2 tests were completed in 5s with 2 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.management.streaming.FlinkStreamingProcessTestRunnerSpec 2✅ 5s

✅ pl.touk.nussknacker.engine.management.streaming.FlinkStreamingProcessTestRunnerSpec

✅ should run scenario in test mode
✅ should return correct error messages

✅ engine/flink/management/target/it-reports/TEST-pl.touk.nussknacker.engine.management.streaming.JavaConfigDeploymentManagerSpec.xml

1 tests were completed in 13s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.management.streaming.JavaConfigDeploymentManagerSpec 1✅ 13s

✅ pl.touk.nussknacker.engine.management.streaming.JavaConfigDeploymentManagerSpec

✅ deploy java scenario in running flink

✅ engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeBinTest.xml

1 tests were completed in 9s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeBinTest 1✅ 9s

✅ pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeBinTest

✅ should run scenario and pass data to output

✅ engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerAvroTest.xml

1 tests were completed in 31s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerAvroTest 1✅ 31s

✅ pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerAvroTest

✅ avro ping-pong should work

✅ engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerJsonTest.xml

1 tests were completed in 31s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerJsonTest 1✅ 31s

✅ pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerJsonTest

✅ json ping-pong should work

✅ engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerProbesTest.xml

2 tests were completed in 61s with 2 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerProbesTest 2✅ 61s

✅ pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerProbesTest

✅ readiness probe
✅ liveness probe

✅ engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.requestresponse.NuReqRespRuntimeBinTest.xml

1 tests were completed in 7s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.lite.requestresponse.NuReqRespRuntimeBinTest 1✅ 7s

✅ pl.touk.nussknacker.engine.lite.requestresponse.NuReqRespRuntimeBinTest

✅ binary version should handle ping pong via http

✅ engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.requestresponse.NuReqRespRuntimeDockerTest.xml

2 tests were completed in 330ms with 2 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.lite.requestresponse.NuReqRespRuntimeDockerTest 2✅ 330ms

✅ pl.touk.nussknacker.engine.lite.requestresponse.NuReqRespRuntimeDockerTest

✅ docker image should handle ping pong via http
✅ should get scenario definition via http

✅ security/target/it-reports/TEST-pl.touk.nussknacker.ui.security.oauth2.GenericOidcServiceSpec.xml

1 tests were completed in 6s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.ui.security.oauth2.GenericOidcServiceSpec 1✅ 6s

✅ pl.touk.nussknacker.ui.security.oauth2.GenericOidcServiceSpec

✅ Basic OpenIDConnect flow

✅ utils/kafka-components-utils/target/it-reports/TEST-pl.touk.nussknacker.engine.kafka.validator.CachedTopicsExistenceValidatorWhenAutoCreateDisabledTest.xml

6 tests were completed in 2s with 6 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.kafka.validator.CachedTopicsExistenceValidatorWhenAutoCreateDisabledTest 6✅ 2s

✅ pl.touk.nussknacker.engine.kafka.validator.CachedTopicsExistenceValidatorWhenAutoCreateDisabledTest

✅ should validate existing source topic
✅ should validate not existing source topic
✅ should validate existing sink topic
✅ should validate not existing sink topic
✅ should not validate not existing topic when validation disabled
✅ should fetch topics every time when not valid using cache

✅ utils/kafka-components-utils/target/it-reports/TEST-pl.touk.nussknacker.engine.kafka.validator.CachedTopicsExistenceValidatorWhenAutoCreateEnabledTest.xml

6 tests were completed in 4s with 6 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.kafka.validator.CachedTopicsExistenceValidatorWhenAutoCreateEnabledTest 6✅ 4s

✅ pl.touk.nussknacker.engine.kafka.validator.CachedTopicsExistenceValidatorWhenAutoCreateEnabledTest

✅ should validate existing source topic
✅ should not validate not existing source topic
✅ should validate existing sink topic
✅ should validate not existing sink topic
✅ should not validate not existing topic when validation disabled
✅ should use cache when validating