Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Change default sensor interval #27405

Open
wants to merge 1 commit into
base: dpeng817/configure_list_dags_limit
Choose a base branch
from

Conversation

dpeng817
Copy link
Contributor

@dpeng817 dpeng817 commented Jan 27, 2025

Summary & Motivation

Make the default sensor interval way slower. 1 second is incredibly aggressive for real life use cases.

How I Tested These Changes

Existing tests

Changelog

  • [dagster-airlift] The default sensor interval on the airflow polling sensor has been brought down to 30 seconds.

Copy link
Contributor Author

dpeng817 commented Jan 27, 2025

Warning

This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

This stack of pull requests is managed by Graphite. Learn more about stacking.

@dpeng817 dpeng817 requested a review from benpankow January 31, 2025 01:49
@dpeng817 dpeng817 marked this pull request as ready for review January 31, 2025 01:49
@dpeng817 dpeng817 force-pushed the dpeng817/configure_list_dags_limit branch from 7b893da to 1827578 Compare January 31, 2025 23:02
@dpeng817 dpeng817 force-pushed the dpeng817/change_default_sensor_interval branch from 5fc0913 to 07a4a2e Compare January 31, 2025 23:02
@dpeng817 dpeng817 force-pushed the dpeng817/configure_list_dags_limit branch from 1827578 to 1f0955c Compare January 31, 2025 23:08
@dpeng817 dpeng817 force-pushed the dpeng817/change_default_sensor_interval branch from 07a4a2e to 1a053da Compare January 31, 2025 23:08
Copy link
Member

@benpankow benpankow left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@dpeng817 dpeng817 force-pushed the dpeng817/configure_list_dags_limit branch from 1f0955c to 4502cad Compare February 12, 2025 22:39
@dpeng817 dpeng817 force-pushed the dpeng817/change_default_sensor_interval branch from 1a053da to 5c0863d Compare February 12, 2025 22:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants