-
Notifications
You must be signed in to change notification settings - Fork 517
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[RunAllTests] Fix #3752: Introduce Bazel test batching in CI #3757
Merged
Commits on Sep 1, 2021
-
This is needed to open a PR on GitHub. This commit is being made so that the PR can start off in a broken Actions state. This also initially disables most non-Bazel workflows to make workflow iteration faster and less impacting on other team members.
Configuration menu - View commit details
-
Copy full SHA for 366ab4d - Browse repository at this point
Copy the full SHA 366ab4dView commit details -
Configuration menu - View commit details
-
Copy full SHA for c38b95c - Browse repository at this point
Copy the full SHA c38b95cView commit details
Commits on Sep 2, 2021
-
Introduce infrastructure for batching.
This introduces a new mechanism for passing lists of tests to sharded test targets in CI, and hooks it up. No actual sharding is occurring yet. This led to some simplifications in the CI workflow since the script can be more dynamic in computing the full list of targets (which also works around a previous bug with instrumentation tests being run). Java proto lite also needed to be upgraded for the scripts to be able to use it. More testing/documentation needed as this functionality continues to expand.
Configuration menu - View commit details
-
Copy full SHA for ac73dd6 - Browse repository at this point
Copy the full SHA ac73dd6View commit details -
This simply partitions bucketed groups of targets into chunks of 10 for each run. Only 3 buckets are currently retained to test sharding in CI before introducing full support.
Configuration menu - View commit details
-
Copy full SHA for 3aec233 - Browse repository at this point
Copy the full SHA 3aec233View commit details -
Fix caching & stabilize builds.
Fixes some caching bucket and output bugs. Also, introduces while loop & keep_going to introduce resilience against app test build failures (or just test failures in general).
Configuration menu - View commit details
-
Copy full SHA for 650570b - Browse repository at this point
Copy the full SHA 650570bView commit details -
Increase sharding & add randomization.
Also, enable other workflows. Note that CI shouldn't fully pass yet since some documentation and testing needs to be added yet, but this is meant to be a more realistic test of the CI environment before the PR is finished.
Configuration menu - View commit details
-
Copy full SHA for d66bb2c - Browse repository at this point
Copy the full SHA d66bb2cView commit details -
Improving partitionin & readability.
Adds a human-readable prefix to make the shards look a bit nicer. Also, adds more fine-tuned partitioning to bucket & reduce shard counts to improve overall timing. Will need to be tested in CI.
Configuration menu - View commit details
-
Copy full SHA for 3969a6d - Browse repository at this point
Copy the full SHA 3969a6dView commit details -
Configuration menu - View commit details
-
Copy full SHA for e7b2a0d - Browse repository at this point
Copy the full SHA e7b2a0dView commit details -
A newly computed variable wasn't updated to be used in an earlier change.
Configuration menu - View commit details
-
Copy full SHA for d1da067 - Browse repository at this point
Copy the full SHA d1da067View commit details -
Configuration menu - View commit details
-
Copy full SHA for fbb3838 - Browse repository at this point
Copy the full SHA fbb3838View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6c91da9 - Browse repository at this point
Copy the full SHA 6c91da9View commit details -
Try 10 max parallel actions instead.
See #3757 (comment) for context.
Configuration menu - View commit details
-
Copy full SHA for e3eb6f2 - Browse repository at this point
Copy the full SHA e3eb6f2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 62576a1 - Browse repository at this point
Copy the full SHA 62576a1View commit details
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.