Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(client): Walkback Channel Timeout in Sad Path #427

Closed
wants to merge 1 commit into from

Conversation

refcell
Copy link
Collaborator

@refcell refcell commented Aug 13, 2024

Description

An alternative to #424 that walks back the channel_timeout in the sad path when the pipeline fails to decode a batch from ready channel data.

Metadata

Fixes #417

@refcell refcell changed the title feat: walkback channel timeout in sad path feat(client): Walkback Channel Timeout in Sad Path Aug 13, 2024
Copy link
Collaborator Author

refcell commented Aug 13, 2024

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @refcell and the rest of your teammates on Graphite Graphite

@refcell refcell requested a review from clabby August 13, 2024 16:25
@refcell refcell added K-feature Kind: feature M-bin Meta: Touches application binaries A-client Area: client binary labels Aug 13, 2024 — with Graphite App
@refcell refcell marked this pull request as ready for review August 13, 2024 16:25
@refcell refcell self-assigned this Aug 13, 2024
@codecov-commenter
Copy link

codecov-commenter commented Aug 13, 2024

Codecov Report

Attention: Patch coverage is 47.05882% with 18 lines in your changes missing coverage. Please review.

Project coverage is 78.2%. Comparing base (19b00f3) to head (31775c0).

Files Patch % Lines
crates/derive/src/pipeline/core.rs 0.0% 9 Missing ⚠️
crates/derive/src/stages/channel_reader.rs 65.0% 7 Missing ⚠️
crates/derive/src/errors.rs 0.0% 1 Missing ⚠️
crates/derive/src/stages/batch_queue.rs 66.6% 1 Missing ⚠️
Additional details and impacted files

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Collaborator

@clabby clabby left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks good overall. Curious about that TODO.

bin/client/src/l1/driver.rs Outdated Show resolved Hide resolved
crates/derive/src/stages/channel_reader.rs Outdated Show resolved Hide resolved
@refcell refcell added the M-do-not-merge Meta: Do not merge label Aug 21, 2024
@refcell
Copy link
Collaborator Author

refcell commented Aug 21, 2024

This does not prevent a malicious batcher from posting multiple valid frames within the channel window where the first frame is missed because it is posted prior to the l1 origin....

@refcell refcell marked this pull request as draft August 23, 2024 20:30
@refcell refcell marked this pull request as ready for review August 23, 2024 20:30
@refcell refcell marked this pull request as draft August 23, 2024 20:30
@refcell refcell force-pushed the rf/fix/sad-path-walkback branch from 1ee0ae2 to 780898a Compare August 23, 2024 20:39
@refcell
Copy link
Collaborator Author

refcell commented Sep 23, 2024

Closing for now. Holocene should fix and if we absolutely need, can always re-open.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A-client Area: client binary K-feature Kind: feature M-bin Meta: Touches application binaries M-do-not-merge Meta: Do not merge
Projects
None yet
Development

Successfully merging this pull request may close these issues.

fix(client): Respect channel timeout
3 participants