Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

SAMZA-2801: fix the case when waterrmark is not aggregated when quorum is not met #1707

Merged
merged 9 commits into from
Aug 21, 2024
Merged

SAMZA-2801: fix the case when waterrmark is not aggregated when quorum is not met #1707

merged 9 commits into from
Aug 21, 2024

Commits on Aug 13, 2024

  1. Initial impl to add task watermark idle time

    Xinyu Liu committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    41cc049 View commit details
    Browse the repository at this point in the history

  2. Make default task.watermark.idle.ms to be -1

    Xinyu Liu committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    a5fd2e9 View commit details
    Browse the repository at this point in the history

Commits on Aug 14, 2024

  1. Add handling for skipping tasks not emitting watermarks from the begi… 

    …nning
    Xinyu Liu committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    97fab20 View commit details
    Browse the repository at this point in the history

  2. Address feedback

    Xinyu Liu committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    f36e86d View commit details
    Browse the repository at this point in the history

Commits on Aug 15, 2024

  1. Add logic to establish quorum in case of idle tasks

    Xinyu Liu committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    58f27d5 View commit details
    Browse the repository at this point in the history

Commits on Aug 16, 2024

  1. Add logging for quorum count update

    Xinyu Liu committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    b050979 View commit details
    Browse the repository at this point in the history

Commits on Aug 21, 2024

  1. Fix the watermark advance when quarum is not reached

    Xinyu Liu committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    b5df592 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into watermark-update2

    Xinyu Liu committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    567edcd View commit details
    Browse the repository at this point in the history

  3. Fix typo

    Xinyu Liu committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    dd10f9b View commit details
    Browse the repository at this point in the history