How to delay Codecov reports on GitHub actions until all runners have their tests pass

Before submitting a topic, please confirm the following

I have searched for similar issues before creating this topic.
I have verified that my repository is using the Codecov GitHub app, if using GitHub
I have validated my codecov.yaml configuration file.
I have filled out the below sections to the best of my ability.
I understand that the community boards are a free, best-effort tool. While we hope to have someone on the Codecov team resolve your problem quickly, this is not always possible.


I have Codecov set up to work on GitHub PRs, both via the runner and a report in the PR itself. I have several GitHub actions runners that each submit individual codecov reports that get collated in the end to give the full coverage statistics. However, Codecov provides a report after every runner passes which can provide misleading results before the test suite completes. Additionally, if someone opens a PR and one of the runners is failing, the coverage will appear to be greatly reduced compared to main even though it’s simply because the test failed.

Is there a way to have Codecov only show the report when all coverage reports have been uploaded from the test suite?


You can see an example of it in action here: [WIP] QuAcc Q-Chem by samblau · Pull Request #393 · Quantum-Accelerators/quacc · GitHub

Codecov Output

Expected Results

It’s behaving as expected, but I would like to alter the settings so contributors aren’t confused as much.

Actual Results

See above.

@arosen93 you can check out after_n_builds which will defer notifications until Codecov has received n uploads.