Github status check reported too early


I’ve finally got a 4-job GitHub Actions CI workflow reporting all CodeCov reports correctly, as reported here: Codecov (it seems a little lower than the 80% I knew before but… closer than earlier attempts).

The PR is: add wait_for_ajax for barnstar system test by jywarren · Pull Request #9909 · publiclab/plots2 · GitHub

However the reported coverage in GitHub’s check is 59.59% (-22.56%).

If you look at the commits, that’s one behind the most recent assessment, so it skips the final merge commit listed at Codecov which would bring it up to 74%.

Commit SHAs


CI/CD or Build URL


It’s uploading via the codecov gem. The results were the same using the CodeCov GitHub Action, which I tested earlier.

Codecov Output

In mine it’s done in 4 different jobs; but here is the final job:

  _____          _
 / ____|        | |
| |     ___   __| | ___  ___ _____   __
| |    / _ \ / _\`|/ _ \/ __/ _ \ \ / /
| |___| (_) | (_| |  __/ (_| (_) \ V /
 \_____\___/ \__,_|\___|\___\___/ \_/
==> GitHub Actions detected
==> Gzipping contents
==> Uploading reports
    query: token=secret&flags&package=ruby-0.5.2&service=github-actions&branch=barnstar-wait&pr=9909&slug=publiclab%2Fplots2&build=1038545312&commit=8b6a73e9d7d7c44a8f5b4ea627f70192c64ecd15
->  Pinging Codecov
->  Uploading to
    View reports at

Expected Results

I would expect it to either wait until the final job is complete before reporting a status check, OR to update once it got the last report.

Actual Results

It seems to have reported a failure due to lower than expected coverage because it didn’t wait until the final job report uploaded, or it didn’t re-report after that.

Additional Information

For commenting, i set after_n_builds to 4, which is a really nice feature:

However i don’t see a way to tell CodeCov to wait on the status check until 4 builds. That would solve this problem.

Thank you, i love CodeCov!!!

1 Like

Hi @jywarren I think you’re looking for notify#after_n_builds

1 Like

That looks just right, thank you so much!!!

1 Like