Codecov bot only posting to PRs after multiple commits

Description

Starting a couple weeks ago, Codecov’s automated comments on pull requests to one of our GitHub repositories largely stopped being posted, unless the PR author pushed more commits to the PR branch after initial creation.

In some of these late comments (example), Codecov reported coverage for the old commit, with a warning that the PR head & covered commit differed, and it never updated for the later commit.

For some of the PRs that didn’t get comments (example), the Codecov page for the commit (corresponding example) states “Waiting for CI to complete” even though the CI did complete. (I see now that our Travis builds stopped a couple days ago, though that doesn’t explain all of the observed behavior.)

Commit SHAs

A commit that didn’t get comments: 46a2598ad25f2579d0bb5659d2805adeda7454db

Repository

CI/CD or Build URL

One of the runs for the above commit: Retry downloads interrupted by connnection resets · con/tinuous@46a2598 · GitHub

Uploader

GitHub Actions

Codecov Output

2021-06-10T18:31:13.0270668Z  / ____|        | |
2021-06-10T18:31:13.0271360Z | |     ___   __| | ___  ___ _____   __
2021-06-10T18:31:13.0272292Z | |    / _ \ / _` |/ _ \/ __/ _ \ \ / /
2021-06-10T18:31:13.0272868Z | |___| (_) | (_| |  __/ (_| (_) \ V /
2021-06-10T18:31:13.0273439Z  \_____\___/ \__,_|\___|\___\___/ \_/
2021-06-10T18:31:13.0274430Z                               Bash-1.0.3
2021-06-10T18:31:13.0275431Z 
2021-06-10T18:31:13.0275937Z 
2021-06-10T18:31:13.0298556Z e[0;36m==>e[0m git version 2.31.1 found
2021-06-10T18:31:13.0425148Z e[0;36m==>e[0m curl 7.68.0 (x86_64-pc-linux-gnu) libcurl/7.68.0 OpenSSL/1.1.1f zlib/1.2.11 brotli/1.0.7 libidn2/2.2.0 libpsl/0.21.0 (+libidn2/2.2.0) libssh/0.9.3/openssl/zlib nghttp2/1.40.0 librtmp/2.3
2021-06-10T18:31:13.0427959Z Release-Date: 2020-01-08
2021-06-10T18:31:13.0428854Z Protocols: dict file ftp ftps gopher http https imap imaps ldap ldaps pop3 pop3s rtmp rtsp scp sftp smb smbs smtp smtps telnet tftp 
2021-06-10T18:31:13.0430445Z Features: AsynchDNS brotli GSS-API HTTP2 HTTPS-proxy IDN IPv6 Kerberos Largefile libz NTLM NTLM_WB PSL SPNEGO SSL TLS-SRP UnixSockets
2021-06-10T18:31:13.0431567Z e[0;90m==>e[0m GitHub Actions detected.
2021-06-10T18:31:13.0432028Z     Env vars used:
2021-06-10T18:31:13.0432624Z       -> GITHUB_ACTIONS:    true
2021-06-10T18:31:13.0433243Z       -> GITHUB_HEAD_REF:   gh-84
2021-06-10T18:31:13.0434269Z       -> GITHUB_REF:        refs/pull/91/merge
2021-06-10T18:31:13.0435137Z       -> GITHUB_REPOSITORY: con/tinuous
2021-06-10T18:31:13.0435814Z       -> GITHUB_RUN_ID:     926101787
2021-06-10T18:31:13.0436686Z       -> GITHUB_SHA:        e8058ca546da935493df62458cdfbc126ca4720d
2021-06-10T18:31:13.0437520Z       -> GITHUB_WORKFLOW:   Test
2021-06-10T18:31:13.0652370Z     e[0;90mproject root:e[0m .
2021-06-10T18:31:13.0725041Z     e[0;90mYaml found at:e[0m codecov.yml
2021-06-10T18:31:13.1209995Z e[0;90m==>e[0m Running gcov in . e[0;90m(disable via -X gcov)e[0m
2021-06-10T18:31:13.1366957Z e[0;90m==>e[0m Searching for coverage reports in:
2021-06-10T18:31:13.1368609Z     e[0;32m+e[0m .
2021-06-10T18:31:13.1444737Z     e[0;90m->e[0m Found 1 reports
2021-06-10T18:31:13.1447679Z e[0;90m==>e[0m Detecting git/mercurial file structure
2021-06-10T18:31:13.1529521Z e[0;90m==>e[0m Reading reports
2021-06-10T18:31:13.1595826Z     e[0;32m+e[0m ./coverage.xml e[0;90mbytes=39095e[0m
2021-06-10T18:31:13.1631753Z e[0;90m==>e[0m Appending adjustments
2021-06-10T18:31:13.1633123Z     e[0;36mhttps://docs.codecov.io/docs/fixing-reportse[0m
2021-06-10T18:31:13.1743176Z     e[0;90m->e[0m No adjustments found
2021-06-10T18:31:13.1744300Z e[0;90m==>e[0m Gzipping contents
2021-06-10T18:31:13.2057046Z         4.0K	/tmp/codecov.Dk78p0.gz
2021-06-10T18:31:13.2088197Z e[0;90m==>e[0m Uploading reports
2021-06-10T18:31:13.2089077Z     e[0;90murl:e[0m https://codecov.io
2021-06-10T18:31:13.2090936Z     e[0;90mquery:e[0m branch=gh-84&commit=46a2598ad25f2579d0bb5659d2805adeda7454db&build=926101787&build_url=http%3A%2F%2Fgithub.com%2Fcon%2Ftinuous%2Factions%2Fruns%2F926101787&name=&tag=&slug=con%2Ftinuous&service=github-actions&flags=&pr=91&job=Test&cmd_args=n,F,Q,C
2021-06-10T18:31:13.2136613Z e[0;90m->e[0m  Pinging Codecov
2021-06-10T18:31:13.2139220Z https://codecov.io/upload/v4?package=github-action-v1.5.2-1.0.3&token=secret&branch=gh-84&commit=46a2598ad25f2579d0bb5659d2805adeda7454db&build=926101787&build_url=http%3A%2F%2Fgithub.com%2Fcon%2Ftinuous%2Factions%2Fruns%2F926101787&name=&tag=&slug=con%2Ftinuous&service=github-actions&flags=&pr=91&job=Test&cmd_args=n,F,Q,C
2021-06-10T18:31:13.8172314Z e[0;90m->e[0m  Uploading to
2021-06-10T18:31:13.8177080Z https://storage.googleapis.com/codecov/v4/raw/2021-06-10/0010CBA6D851417C00BB0BC3FC5895F9/46a2598ad25f2579d0bb5659d2805adeda7454db/936cd0d0-f063-416e-94eb-1fa88077dbf3.txt?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GOOG1EKKHVKCKHW7KBCGM7IHR55T63V2PAVJWLVFNITJHDU5G6R5IRN3LMWJA%2F20210610%2FUS%2Fs3%2Faws4_request&X-Amz-Date=20210610T183113Z&X-Amz-Expires=10&X-Amz-SignedHeaders=host&X-Amz-Signature=bb48afc5e1f2d675864dfdf04f5e7d9fc81fab9793c07fd47deb515ed21a1421
2021-06-10T18:31:13.8279180Z   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
2021-06-10T18:31:13.8286127Z                                  Dload  Upload   Total   Spent    Left  Speed
2021-06-10T18:31:13.8287008Z 
2021-06-10T18:31:14.0207732Z   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
2021-06-10T18:31:14.0208610Z 100  3328    0     0  100  3328      0  17243 --:--:-- --:--:-- --:--:-- 17243
2021-06-10T18:31:14.0267222Z     e[0;32m->e[0m Reports have been successfully queued for processing at e[0;36mhttps://codecov.io/github/con/tinuous/commit/46a2598ad25f2579d0bb5659d2805adeda7454dbe[0m

Expected Results

Codecov should have commented as soon as the first CI run on the first commit finished.

Actual Results

Codecov did not comment unless further commits were pushed.