CodeCov comment still says "consider uploading reports for the commit to get more accurate results" after reports have been uploaded

Before submitting a topic, please confirm the following

I have searched for similar issues before creating this topic.
I have verified that my repository is using the Codecov GitHub app, if using GitHub
I have validated my codecov.yaml configuration file. (I have no codecov.yaml configuration file)
I have filled out the below sections to the best of my ability.


On this PR, CodeCov added the following comment:

Merging #443 (c04c077) into master (c04c077) will not change coverage.
The diff coverage is n/a.

Note that, in this comment, CodeCov compares the commit of the master branch to itself, so of course this cannot change coverage.

Note that it knows that the commit it is using is not the latest one:

Current head c04c077 differs from pull request most recent head 832ec14. Consider uploading reports for the commit 832ec14 to get more accurate results

But it does not use the latest reports that have been uploaded.

Note that the checks added by CodeCov on the PR seem correct.


Codecov Output

Please provide the full output of running the uploader on your CI/CD. This will typically have the Codecov logo as ASCII.

Note that our build sends 4 reports to CodeCov:

2022-07-18T09:09:05.0304391Z ##[group]Run codecov/codecov-action@e3c560433a6cc60aec8812599b7844a7b4fa0d71
2022-07-18T09:09:05.0304745Z with:
2022-07-18T09:09:05.0304957Z   file: ./coverage/
2022-07-18T09:09:05.0305191Z   flags: ut
2022-07-18T09:09:05.0305414Z ##[endgroup]
2022-07-18T09:09:05.2159901Z ==> linux OS detected
2022-07-18T09:09:05.9053383Z ==> SHASUM file signed by key id 806bb28aed779869
2022-07-18T09:09:06.1358709Z ==> Uploader SHASUM verified (432553f03714a83ab5cac78be2e7fe6a6050767f78f77e9c7a84bdb1c34a0bd3  codecov)
2022-07-18T09:09:06.1360257Z ==> Running version latest
2022-07-18T09:09:06.2179655Z ==> Running version v0.2.4
2022-07-18T09:09:06.2212215Z [command]/home/runner/work/_actions/codecov/codecov-action/e3c560433a6cc60aec8812599b7844a7b4fa0d71/dist/codecov -n  -Q github-action-3.0.0 -f ./coverage/ -F ut -C 832ec14e4f6d390474700175597656b8b9afcad6
2022-07-18T09:09:06.5003611Z [2022-07-18T09:09:06.498Z] ['info'] 
2022-07-18T09:09:06.5004277Z      _____          _
2022-07-18T09:09:06.5005438Z     / ____|        | |
2022-07-18T09:09:06.5005832Z    | |     ___   __| | ___  ___ _____   __
2022-07-18T09:09:06.5006331Z    | |    / _ \ / _` |/ _ \/ __/ _ \ \ / /
2022-07-18T09:09:06.5006942Z    | |___| (_) | (_| |  __/ (_| (_) \ V /
2022-07-18T09:09:06.5007230Z     \_____\___/ \__,_|\___|\___\___/ \_/
2022-07-18T09:09:06.5007641Z   Codecov report uploader 0.2.4
2022-07-18T09:09:06.5083330Z [2022-07-18T09:09:06.507Z] ['info'] => Project root located at: /home/runner/work/kassette/kassette
2022-07-18T09:09:06.5098790Z [2022-07-18T09:09:06.509Z] ['info'] -> No token specified or token is empty
2022-07-18T09:09:06.5184274Z [2022-07-18T09:09:06.517Z] ['info'] Searching for coverage files...
2022-07-18T09:09:06.6197987Z [2022-07-18T09:09:06.619Z] ['info'] => Found 1 possible coverage files:
2022-07-18T09:09:06.6198385Z   ./coverage/
2022-07-18T09:09:06.6204766Z [2022-07-18T09:09:06.620Z] ['info'] Processing ./coverage/
2022-07-18T09:09:06.6277043Z [2022-07-18T09:09:06.627Z] ['info'] Detected GitHub Actions as the CI provider.
2022-07-18T09:09:06.6304961Z [2022-07-18T09:09:06.630Z] ['info'] Pinging Codecov:*******&branch=har&build=2689370132&
2022-07-18T09:09:07.3887416Z [2022-07-18T09:09:07.388Z] ['info']
2022-07-18T09:09:07.3893939Z [2022-07-18T09:09:07.388Z] ['info'] Uploading...
2022-07-18T09:09:07.5837022Z [2022-07-18T09:09:07.583Z] ['info'] {"status":"success","resultURL":""}
2022-07-18T09:09:07.6176977Z ##[group]Run codecov/codecov-action@e3c560433a6cc60aec8812599b7844a7b4fa0d71
2022-07-18T09:09:07.6177311Z with:
2022-07-18T09:09:07.6177531Z   file: ./coverage-e2e/
2022-07-18T09:09:07.6177742Z   flags: e2e
2022-07-18T09:09:07.6177952Z ##[endgroup]
2022-07-18T09:09:07.7986989Z ==> linux OS detected
2022-07-18T09:09:08.4414809Z ==> SHASUM file signed by key id 806bb28aed779869
2022-07-18T09:09:08.6711347Z ==> Uploader SHASUM verified (432553f03714a83ab5cac78be2e7fe6a6050767f78f77e9c7a84bdb1c34a0bd3  codecov)
2022-07-18T09:09:08.6716451Z ==> Running version latest
2022-07-18T09:09:08.7619328Z ==> Running version v0.2.4
2022-07-18T09:09:08.7648351Z [command]/home/runner/work/_actions/codecov/codecov-action/e3c560433a6cc60aec8812599b7844a7b4fa0d71/dist/codecov -n  -Q github-action-3.0.0 -f ./coverage-e2e/ -F e2e -C 832ec14e4f6d390474700175597656b8b9afcad6
2022-07-18T09:09:09.0406385Z [2022-07-18T09:09:09.038Z] ['info'] 
2022-07-18T09:09:09.0406831Z      _____          _
2022-07-18T09:09:09.0407165Z     / ____|        | |
2022-07-18T09:09:09.0407520Z    | |     ___   __| | ___  ___ _____   __
2022-07-18T09:09:09.0407889Z    | |    / _ \ / _` |/ _ \/ __/ _ \ \ / /
2022-07-18T09:09:09.0408235Z    | |___| (_) | (_| |  __/ (_| (_) \ V /
2022-07-18T09:09:09.0408602Z     \_____\___/ \__,_|\___|\___\___/ \_/
2022-07-18T09:09:09.0409081Z   Codecov report uploader 0.2.4
2022-07-18T09:09:09.0471217Z [2022-07-18T09:09:09.046Z] ['info'] => Project root located at: /home/runner/work/kassette/kassette
2022-07-18T09:09:09.0487508Z [2022-07-18T09:09:09.048Z] ['info'] -> No token specified or token is empty
2022-07-18T09:09:09.0570729Z [2022-07-18T09:09:09.056Z] ['info'] Searching for coverage files...
2022-07-18T09:09:09.1458610Z [2022-07-18T09:09:09.145Z] ['info'] => Found 1 possible coverage files:
2022-07-18T09:09:09.1459791Z   ./coverage-e2e/
2022-07-18T09:09:09.1465713Z [2022-07-18T09:09:09.146Z] ['info'] Processing ./coverage-e2e/
2022-07-18T09:09:09.1544731Z [2022-07-18T09:09:09.153Z] ['info'] Detected GitHub Actions as the CI provider.
2022-07-18T09:09:09.1567223Z [2022-07-18T09:09:09.156Z] ['info'] Pinging Codecov:*******&branch=har&build=2689370132&
2022-07-18T09:09:09.8243683Z [2022-07-18T09:09:09.823Z] ['info']
2022-07-18T09:09:09.8253688Z [2022-07-18T09:09:09.825Z] ['info'] Uploading...
2022-07-18T09:09:10.0154143Z [2022-07-18T09:09:10.014Z] ['info'] {"status":"success","resultURL":""}
2022-07-18T09:11:50.2105271Z ==> SHASUM file signed by key id 806bb28aed779869
2022-07-18T09:11:50.4543782Z ==> Uploader SHASUM verified (a45de206d32ad7c34ede07edcf44ca901aa8b24740f508437d1b15c738589f0b  codecov.exe)
2022-07-18T09:11:50.4546375Z ==> Running version latest
2022-07-18T09:11:50.7239276Z ==> Running version v0.2.4
2022-07-18T09:11:50.7287483Z [command]D:\a\_actions\codecov\codecov-action\e3c560433a6cc60aec8812599b7844a7b4fa0d71\dist\codecov.exe -n "" -Q github-action-3.0.0 -f ./coverage/ -F ut -C 832ec14e4f6d390474700175597656b8b9afcad6
2022-07-18T09:11:51.1454993Z [2022-07-18T09:11:51.142Z] ['info'] 
2022-07-18T09:11:51.1455708Z      _____          _
2022-07-18T09:11:51.1456393Z     / ____|        | |
2022-07-18T09:11:51.1456905Z    | |     ___   __| | ___  ___ _____   __
2022-07-18T09:11:51.1457363Z    | |    / _ \ / _` |/ _ \/ __/ _ \ \ / /
2022-07-18T09:11:51.1457756Z    | |___| (_) | (_| |  __/ (_| (_) \ V /
2022-07-18T09:11:51.1458201Z     \_____\___/ \__,_|\___|\___\___/ \_/
2022-07-18T09:11:51.1458793Z   Codecov report uploader 0.2.4
2022-07-18T09:11:51.1815771Z [2022-07-18T09:11:51.180Z] ['info'] => Project root located at: D:/a/kassette/kassette
2022-07-18T09:11:51.1837443Z [2022-07-18T09:11:51.182Z] ['info'] -> No token specified or token is empty
2022-07-18T09:11:51.2395361Z [2022-07-18T09:11:51.238Z] ['info'] Searching for coverage files...
2022-07-18T09:11:51.3560725Z [2022-07-18T09:11:51.324Z] ['info'] => Found 1 possible coverage files:
2022-07-18T09:11:51.3621140Z   ./coverage/
2022-07-18T09:11:51.3622651Z [2022-07-18T09:11:51.325Z] ['info'] Processing ./coverage/
2022-07-18T09:11:51.3634906Z [2022-07-18T09:11:51.338Z] ['info'] Detected GitHub Actions as the CI provider.
2022-07-18T09:11:51.3667903Z [2022-07-18T09:11:51.340Z] ['info'] Pinging Codecov:*******&branch=har&build=2689370132&
2022-07-18T09:11:51.8422746Z [2022-07-18T09:11:51.840Z] ['info']
2022-07-18T09:11:51.8428664Z [2022-07-18T09:11:51.841Z] ['info'] Uploading...
2022-07-18T09:11:52.0347936Z [2022-07-18T09:11:52.033Z] ['info'] {"status":"success","resultURL":""}
2022-07-18T09:11:52.0968591Z ##[group]Run codecov/codecov-action@e3c560433a6cc60aec8812599b7844a7b4fa0d71
2022-07-18T09:11:52.0969011Z with:
2022-07-18T09:11:52.0969493Z   file: ./coverage-e2e/
2022-07-18T09:11:52.0969811Z   flags: e2e
2022-07-18T09:11:52.0970006Z ##[endgroup]
2022-07-18T09:11:52.3549691Z ==> windows OS detected
2022-07-18T09:11:52.9185817Z ==> SHASUM file signed by key id 806bb28aed779869
2022-07-18T09:11:53.1496426Z ==> Uploader SHASUM verified (a45de206d32ad7c34ede07edcf44ca901aa8b24740f508437d1b15c738589f0b  codecov.exe)
2022-07-18T09:11:53.1498969Z ==> Running version latest
2022-07-18T09:11:53.1883745Z ==> Running version v0.2.4
2022-07-18T09:11:53.1928679Z [command]D:\a\_actions\codecov\codecov-action\e3c560433a6cc60aec8812599b7844a7b4fa0d71\dist\codecov.exe -n "" -Q github-action-3.0.0 -f ./coverage-e2e/ -F e2e -C 832ec14e4f6d390474700175597656b8b9afcad6
2022-07-18T09:11:53.5886393Z [2022-07-18T09:11:53.586Z] ['info'] 
2022-07-18T09:11:53.5887106Z      _____          _
2022-07-18T09:11:53.5887698Z     / ____|        | |
2022-07-18T09:11:53.5888349Z    | |     ___   __| | ___  ___ _____   __
2022-07-18T09:11:53.5889028Z    | |    / _ \ / _` |/ _ \/ __/ _ \ \ / /
2022-07-18T09:11:53.5889675Z    | |___| (_) | (_| |  __/ (_| (_) \ V /
2022-07-18T09:11:53.5890315Z     \_____\___/ \__,_|\___|\___\___/ \_/
2022-07-18T09:11:53.5890941Z   Codecov report uploader 0.2.4
2022-07-18T09:11:53.6236172Z [2022-07-18T09:11:53.622Z] ['info'] => Project root located at: D:/a/kassette/kassette
2022-07-18T09:11:53.6256296Z [2022-07-18T09:11:53.624Z] ['info'] -> No token specified or token is empty
2022-07-18T09:11:53.6619160Z [2022-07-18T09:11:53.660Z] ['info'] Searching for coverage files...
2022-07-18T09:11:53.7753607Z [2022-07-18T09:11:53.752Z] ['info'] => Found 1 possible coverage files:
2022-07-18T09:11:53.7825098Z   ./coverage-e2e/
2022-07-18T09:11:53.7831875Z [2022-07-18T09:11:53.752Z] ['info'] Processing ./coverage-e2e/
2022-07-18T09:11:53.7854042Z [2022-07-18T09:11:53.759Z] ['info'] Detected GitHub Actions as the CI provider.
2022-07-18T09:11:53.7868697Z [2022-07-18T09:11:53.761Z] ['info'] Pinging Codecov:*******&branch=har&build=2689370132&
2022-07-18T09:11:54.2608959Z [2022-07-18T09:11:54.259Z] ['info']
2022-07-18T09:11:54.2613467Z [2022-07-18T09:11:54.260Z] ['info'] Uploading...
2022-07-18T09:11:54.4625919Z [2022-07-18T09:11:54.461Z] ['info'] {"status":"success","resultURL":""}

Expected Results

The comment from CodeCov on the PR should provide the real coverage.

Actual Results

The comment on the PR is not updated.

Additional Information

Note that there were many “force” (non fast-forward) pushes to the PR.

Note that the same problem happens with this PR:

The comment on the PR is not updated even though the coverage was successfully uploaded.

@divdavem I’m sorry this is going to be an unsatisfying answer. The PRs are a little too old for me to pull up logs for, so I would have to make some guesses.

  1. The PR is merged before the PR comment from Codecov gets updated properly
  2. Something weird is happening with the number of rebases
  3. Something weird is happening due to the PR coming from a fork

Is this still happening for you, and do you have a more recent example?

The same problem happens with this PR:

@wenqiq thanks, my suspicion is that we might not be handling repeated rebases properly. Let me forward this along to the product team.

Thanks so much. I have made a new PR with the same code changes and found the same problem.[not4review]Remove the limit on the number of Endpoints in AntreaProxy by wenqiq · Pull Request #4226 · antrea-io/antrea · GitHub
I think maybe it’s not related to rebase. After I changed the ignore files in codecov.yml. The hints disappeared.

@wenqiq oh that’s ineresting. So let me understand properly

  1. Removing ignore files in the codecov.yml removes the error message (did you remove all of them or just some?)
  2. Adding back in ignore into the codecov.yml shows the error message again?