Description
Starting a couple weeks ago, Codecov’s automated comments on pull requests to one of our GitHub repositories largely stopped being posted, unless the PR author pushed more commits to the PR branch after initial creation.
In some of these late comments (example), Codecov reported coverage for the old commit, with a warning that the PR head & covered commit differed, and it never updated for the later commit.
For some of the PRs that didn’t get comments (example), the Codecov page for the commit (corresponding example) states “Waiting for CI to complete” even though the CI did complete. (I see now that our Travis builds stopped a couple days ago, though that doesn’t explain all of the observed behavior.)
Commit SHAs
A commit that didn’t get comments: 46a2598ad25f2579d0bb5659d2805adeda7454db
Repository
CI/CD or Build URL
One of the runs for the above commit: Retry downloads interrupted by connnection resets · con/tinuous@46a2598 · GitHub
Uploader
GitHub Actions
Codecov Output
2021-06-10T18:31:13.0270668Z / ____| | |
2021-06-10T18:31:13.0271360Z | | ___ __| | ___ ___ _____ __
2021-06-10T18:31:13.0272292Z | | / _ \ / _` |/ _ \/ __/ _ \ \ / /
2021-06-10T18:31:13.0272868Z | |___| (_) | (_| | __/ (_| (_) \ V /
2021-06-10T18:31:13.0273439Z \_____\___/ \__,_|\___|\___\___/ \_/
2021-06-10T18:31:13.0274430Z Bash-1.0.3
2021-06-10T18:31:13.0275431Z
2021-06-10T18:31:13.0275937Z
2021-06-10T18:31:13.0298556Z e[0;36m==>e[0m git version 2.31.1 found
2021-06-10T18:31:13.0425148Z e[0;36m==>e[0m curl 7.68.0 (x86_64-pc-linux-gnu) libcurl/7.68.0 OpenSSL/1.1.1f zlib/1.2.11 brotli/1.0.7 libidn2/2.2.0 libpsl/0.21.0 (+libidn2/2.2.0) libssh/0.9.3/openssl/zlib nghttp2/1.40.0 librtmp/2.3
2021-06-10T18:31:13.0427959Z Release-Date: 2020-01-08
2021-06-10T18:31:13.0428854Z Protocols: dict file ftp ftps gopher http https imap imaps ldap ldaps pop3 pop3s rtmp rtsp scp sftp smb smbs smtp smtps telnet tftp
2021-06-10T18:31:13.0430445Z Features: AsynchDNS brotli GSS-API HTTP2 HTTPS-proxy IDN IPv6 Kerberos Largefile libz NTLM NTLM_WB PSL SPNEGO SSL TLS-SRP UnixSockets
2021-06-10T18:31:13.0431567Z e[0;90m==>e[0m GitHub Actions detected.
2021-06-10T18:31:13.0432028Z Env vars used:
2021-06-10T18:31:13.0432624Z -> GITHUB_ACTIONS: true
2021-06-10T18:31:13.0433243Z -> GITHUB_HEAD_REF: gh-84
2021-06-10T18:31:13.0434269Z -> GITHUB_REF: refs/pull/91/merge
2021-06-10T18:31:13.0435137Z -> GITHUB_REPOSITORY: con/tinuous
2021-06-10T18:31:13.0435814Z -> GITHUB_RUN_ID: 926101787
2021-06-10T18:31:13.0436686Z -> GITHUB_SHA: e8058ca546da935493df62458cdfbc126ca4720d
2021-06-10T18:31:13.0437520Z -> GITHUB_WORKFLOW: Test
2021-06-10T18:31:13.0652370Z e[0;90mproject root:e[0m .
2021-06-10T18:31:13.0725041Z e[0;90mYaml found at:e[0m codecov.yml
2021-06-10T18:31:13.1209995Z e[0;90m==>e[0m Running gcov in . e[0;90m(disable via -X gcov)e[0m
2021-06-10T18:31:13.1366957Z e[0;90m==>e[0m Searching for coverage reports in:
2021-06-10T18:31:13.1368609Z e[0;32m+e[0m .
2021-06-10T18:31:13.1444737Z e[0;90m->e[0m Found 1 reports
2021-06-10T18:31:13.1447679Z e[0;90m==>e[0m Detecting git/mercurial file structure
2021-06-10T18:31:13.1529521Z e[0;90m==>e[0m Reading reports
2021-06-10T18:31:13.1595826Z e[0;32m+e[0m ./coverage.xml e[0;90mbytes=39095e[0m
2021-06-10T18:31:13.1631753Z e[0;90m==>e[0m Appending adjustments
2021-06-10T18:31:13.1633123Z e[0;36mhttps://docs.codecov.io/docs/fixing-reportse[0m
2021-06-10T18:31:13.1743176Z e[0;90m->e[0m No adjustments found
2021-06-10T18:31:13.1744300Z e[0;90m==>e[0m Gzipping contents
2021-06-10T18:31:13.2057046Z 4.0K /tmp/codecov.Dk78p0.gz
2021-06-10T18:31:13.2088197Z e[0;90m==>e[0m Uploading reports
2021-06-10T18:31:13.2089077Z e[0;90murl:e[0m https://codecov.io
2021-06-10T18:31:13.2090936Z e[0;90mquery:e[0m branch=gh-84&commit=46a2598ad25f2579d0bb5659d2805adeda7454db&build=926101787&build_url=http%3A%2F%2Fgithub.com%2Fcon%2Ftinuous%2Factions%2Fruns%2F926101787&name=&tag=&slug=con%2Ftinuous&service=github-actions&flags=&pr=91&job=Test&cmd_args=n,F,Q,C
2021-06-10T18:31:13.2136613Z e[0;90m->e[0m Pinging Codecov
2021-06-10T18:31:13.2139220Z https://codecov.io/upload/v4?package=github-action-v1.5.2-1.0.3&token=secret&branch=gh-84&commit=46a2598ad25f2579d0bb5659d2805adeda7454db&build=926101787&build_url=http%3A%2F%2Fgithub.com%2Fcon%2Ftinuous%2Factions%2Fruns%2F926101787&name=&tag=&slug=con%2Ftinuous&service=github-actions&flags=&pr=91&job=Test&cmd_args=n,F,Q,C
2021-06-10T18:31:13.8172314Z e[0;90m->e[0m Uploading to
2021-06-10T18:31:13.8177080Z https://storage.googleapis.com/codecov/v4/raw/2021-06-10/0010CBA6D851417C00BB0BC3FC5895F9/46a2598ad25f2579d0bb5659d2805adeda7454db/936cd0d0-f063-416e-94eb-1fa88077dbf3.txt?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GOOG1EKKHVKCKHW7KBCGM7IHR55T63V2PAVJWLVFNITJHDU5G6R5IRN3LMWJA%2F20210610%2FUS%2Fs3%2Faws4_request&X-Amz-Date=20210610T183113Z&X-Amz-Expires=10&X-Amz-SignedHeaders=host&X-Amz-Signature=bb48afc5e1f2d675864dfdf04f5e7d9fc81fab9793c07fd47deb515ed21a1421
2021-06-10T18:31:13.8279180Z % Total % Received % Xferd Average Speed Time Time Time Current
2021-06-10T18:31:13.8286127Z Dload Upload Total Spent Left Speed
2021-06-10T18:31:13.8287008Z
2021-06-10T18:31:14.0207732Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
2021-06-10T18:31:14.0208610Z 100 3328 0 0 100 3328 0 17243 --:--:-- --:--:-- --:--:-- 17243
2021-06-10T18:31:14.0267222Z e[0;32m->e[0m Reports have been successfully queued for processing at e[0;36mhttps://codecov.io/github/con/tinuous/commit/46a2598ad25f2579d0bb5659d2805adeda7454dbe[0m
Expected Results
Codecov should have commented as soon as the first CI run on the first commit finished.
Actual Results
Codecov did not comment unless further commits were pushed.