CodeCov comment still says "consider uploading reports for the commit to get more accurate results" after reports have been uploaded

divdavem · July 18, 2022, 9:37am

Before submitting a topic, please confirm the following

I have searched for similar issues before creating this topic.
I have verified that my repository is using the Codecov GitHub app, if using GitHub
I have validated my codecov.yaml configuration file. (I have no codecov.yaml configuration file)
I have filled out the below sections to the best of my ability.

Description

On this PR, CodeCov added the following comment:

Merging #443 (c04c077) into master (c04c077) will not change coverage.
The diff coverage is n/a.

Note that, in this comment, CodeCov compares the commit of the master branch to itself, so of course this cannot change coverage.

Note that it knows that the commit it is using is not the latest one:

Current head c04c077 differs from pull request most recent head 832ec14. Consider uploading reports for the commit 832ec14 to get more accurate results

But it does not use the latest reports that have been uploaded.

Note that the checks added by CodeCov on the PR seem correct.

CI/CD URL

https://github.com/AmadeusITGroup/kassette/runs/7386203433?check_suite_focus=true
https://github.com/AmadeusITGroup/kassette/runs/7386203624?check_suite_focus=true

Codecov Output

Please provide the full output of running the uploader on your CI/CD. This will typically have the Codecov logo as ASCII.

Note that our build sends 4 reports to CodeCov:

2022-07-18T09:09:05.0304391Z ##[group]Run codecov/codecov-action@e3c560433a6cc60aec8812599b7844a7b4fa0d71
2022-07-18T09:09:05.0304745Z with:
2022-07-18T09:09:05.0304957Z   file: ./coverage/lcov.info
2022-07-18T09:09:05.0305191Z   flags: ut
2022-07-18T09:09:05.0305414Z ##[endgroup]
2022-07-18T09:09:05.2159901Z ==> linux OS detected
2022-07-18T09:09:05.7618017Z https://uploader.codecov.io/latest/linux/codecov.SHA256SUM
2022-07-18T09:09:05.9053383Z ==> SHASUM file signed by key id 806bb28aed779869
2022-07-18T09:09:06.1358709Z ==> Uploader SHASUM verified (432553f03714a83ab5cac78be2e7fe6a6050767f78f77e9c7a84bdb1c34a0bd3  codecov)
2022-07-18T09:09:06.1360257Z ==> Running version latest
2022-07-18T09:09:06.2179655Z ==> Running version v0.2.4
2022-07-18T09:09:06.2212215Z [command]/home/runner/work/_actions/codecov/codecov-action/e3c560433a6cc60aec8812599b7844a7b4fa0d71/dist/codecov -n  -Q github-action-3.0.0 -f ./coverage/lcov.info -F ut -C 832ec14e4f6d390474700175597656b8b9afcad6
2022-07-18T09:09:06.5003611Z [2022-07-18T09:09:06.498Z] ['info'] 
2022-07-18T09:09:06.5004277Z      _____          _
2022-07-18T09:09:06.5005438Z     / ____|        | |
2022-07-18T09:09:06.5005832Z    | |     ___   __| | ___  ___ _____   __
2022-07-18T09:09:06.5006331Z    | |    / _ \ / _` |/ _ \/ __/ _ \ \ / /
2022-07-18T09:09:06.5006942Z    | |___| (_) | (_| |  __/ (_| (_) \ V /
2022-07-18T09:09:06.5007230Z     \_____\___/ \__,_|\___|\___\___/ \_/
2022-07-18T09:09:06.5007373Z 
2022-07-18T09:09:06.5007641Z   Codecov report uploader 0.2.4
2022-07-18T09:09:06.5083330Z [2022-07-18T09:09:06.507Z] ['info'] => Project root located at: /home/runner/work/kassette/kassette
2022-07-18T09:09:06.5098790Z [2022-07-18T09:09:06.509Z] ['info'] -> No token specified or token is empty
2022-07-18T09:09:06.5184274Z [2022-07-18T09:09:06.517Z] ['info'] Searching for coverage files...
2022-07-18T09:09:06.6197987Z [2022-07-18T09:09:06.619Z] ['info'] => Found 1 possible coverage files:
2022-07-18T09:09:06.6198385Z   ./coverage/lcov.info
2022-07-18T09:09:06.6204766Z [2022-07-18T09:09:06.620Z] ['info'] Processing ./coverage/lcov.info...
2022-07-18T09:09:06.6277043Z [2022-07-18T09:09:06.627Z] ['info'] Detected GitHub Actions as the CI provider.
2022-07-18T09:09:06.6304961Z [2022-07-18T09:09:06.630Z] ['info'] Pinging Codecov: https://codecov.io/upload/v4?package=github-action-3.0.0-uploader-0.2.4&token=*******&branch=har&build=2689370132&build_url=https%3A%2F%2Fgithub.com%2FAmadeusITGroup%2Fkassette%2Factions%2Fruns%2F2689370132&commit=832ec14e4f6d390474700175597656b8b9afcad6&job=Continuous+Integration&pr=443&service=github-actions&slug=AmadeusITGroup%2Fkassette&name=&tag=&flags=ut&parent=
2022-07-18T09:09:07.3887416Z [2022-07-18T09:09:07.388Z] ['info'] https://codecov.io/github/AmadeusITGroup/kassette/commit/832ec14e4f6d390474700175597656b8b9afcad6
2022-07-18T09:09:07.3890605Z https://storage.googleapis.com/codecov/v4/raw/2022-07-18/79F65D6A37B289E8383E0956E605D09A/832ec14e4f6d390474700175597656b8b9afcad6/5d1b632f-9d13-499f-8d35-e85ac27d0897.txt?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GOOG1E5YTIQF4NUDJHIPRXCW6SWPNHIWXR6YCTGFLBKZTWXKPGHK3U3FMCQWA%2F20220718%2FUS%2Fs3%2Faws4_request&X-Amz-Date=20220718T090907Z&X-Amz-Expires=10&X-Amz-SignedHeaders=host&X-Amz-Signature=e45bfceacac7e050c10cfe61f5e8f82269e2dba28c03030daa1b80a82052b463
2022-07-18T09:09:07.3893939Z [2022-07-18T09:09:07.388Z] ['info'] Uploading...
2022-07-18T09:09:07.5837022Z [2022-07-18T09:09:07.583Z] ['info'] {"status":"success","resultURL":"https://codecov.io/github/AmadeusITGroup/kassette/commit/832ec14e4f6d390474700175597656b8b9afcad6"}
2022-07-18T09:09:07.6176977Z ##[group]Run codecov/codecov-action@e3c560433a6cc60aec8812599b7844a7b4fa0d71
2022-07-18T09:09:07.6177311Z with:
2022-07-18T09:09:07.6177531Z   file: ./coverage-e2e/lcov.info
2022-07-18T09:09:07.6177742Z   flags: e2e
2022-07-18T09:09:07.6177952Z ##[endgroup]
2022-07-18T09:09:07.7986989Z ==> linux OS detected
2022-07-18T09:09:08.3162208Z https://uploader.codecov.io/latest/linux/codecov.SHA256SUM
2022-07-18T09:09:08.4414809Z ==> SHASUM file signed by key id 806bb28aed779869
2022-07-18T09:09:08.6711347Z ==> Uploader SHASUM verified (432553f03714a83ab5cac78be2e7fe6a6050767f78f77e9c7a84bdb1c34a0bd3  codecov)
2022-07-18T09:09:08.6716451Z ==> Running version latest
2022-07-18T09:09:08.7619328Z ==> Running version v0.2.4
2022-07-18T09:09:08.7648351Z [command]/home/runner/work/_actions/codecov/codecov-action/e3c560433a6cc60aec8812599b7844a7b4fa0d71/dist/codecov -n  -Q github-action-3.0.0 -f ./coverage-e2e/lcov.info -F e2e -C 832ec14e4f6d390474700175597656b8b9afcad6
2022-07-18T09:09:09.0406385Z [2022-07-18T09:09:09.038Z] ['info'] 
2022-07-18T09:09:09.0406831Z      _____          _
2022-07-18T09:09:09.0407165Z     / ____|        | |
2022-07-18T09:09:09.0407520Z    | |     ___   __| | ___  ___ _____   __
2022-07-18T09:09:09.0407889Z    | |    / _ \ / _` |/ _ \/ __/ _ \ \ / /
2022-07-18T09:09:09.0408235Z    | |___| (_) | (_| |  __/ (_| (_) \ V /
2022-07-18T09:09:09.0408602Z     \_____\___/ \__,_|\___|\___\___/ \_/
2022-07-18T09:09:09.0408855Z 
2022-07-18T09:09:09.0409081Z   Codecov report uploader 0.2.4
2022-07-18T09:09:09.0471217Z [2022-07-18T09:09:09.046Z] ['info'] => Project root located at: /home/runner/work/kassette/kassette
2022-07-18T09:09:09.0487508Z [2022-07-18T09:09:09.048Z] ['info'] -> No token specified or token is empty
2022-07-18T09:09:09.0570729Z [2022-07-18T09:09:09.056Z] ['info'] Searching for coverage files...
2022-07-18T09:09:09.1458610Z [2022-07-18T09:09:09.145Z] ['info'] => Found 1 possible coverage files:
2022-07-18T09:09:09.1459791Z   ./coverage-e2e/lcov.info
2022-07-18T09:09:09.1465713Z [2022-07-18T09:09:09.146Z] ['info'] Processing ./coverage-e2e/lcov.info...
2022-07-18T09:09:09.1544731Z [2022-07-18T09:09:09.153Z] ['info'] Detected GitHub Actions as the CI provider.
2022-07-18T09:09:09.1567223Z [2022-07-18T09:09:09.156Z] ['info'] Pinging Codecov: https://codecov.io/upload/v4?package=github-action-3.0.0-uploader-0.2.4&token=*******&branch=har&build=2689370132&build_url=https%3A%2F%2Fgithub.com%2FAmadeusITGroup%2Fkassette%2Factions%2Fruns%2F2689370132&commit=832ec14e4f6d390474700175597656b8b9afcad6&job=Continuous+Integration&pr=443&service=github-actions&slug=AmadeusITGroup%2Fkassette&name=&tag=&flags=e2e&parent=
2022-07-18T09:09:09.8243683Z [2022-07-18T09:09:09.823Z] ['info'] https://codecov.io/github/AmadeusITGroup/kassette/commit/832ec14e4f6d390474700175597656b8b9afcad6
2022-07-18T09:09:09.8246302Z https://storage.googleapis.com/codecov/v4/raw/2022-07-18/79F65D6A37B289E8383E0956E605D09A/832ec14e4f6d390474700175597656b8b9afcad6/1000a0a5-25b3-43ea-8f0a-6417376b4511.txt?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GOOG1E5YTIQF4NUDJHIPRXCW6SWPNHIWXR6YCTGFLBKZTWXKPGHK3U3FMCQWA%2F20220718%2FUS%2Fs3%2Faws4_request&X-Amz-Date=20220718T090909Z&X-Amz-Expires=10&X-Amz-SignedHeaders=host&X-Amz-Signature=c0ee7784a35d92eafe22708883a29aa8c63b840d1a0d5bb43396e2ee668ced9b
2022-07-18T09:09:09.8253688Z [2022-07-18T09:09:09.825Z] ['info'] Uploading...
2022-07-18T09:09:10.0154143Z [2022-07-18T09:09:10.014Z] ['info'] {"status":"success","resultURL":"https://codecov.io/github/AmadeusITGroup/kassette/commit/832ec14e4f6d390474700175597656b8b9afcad6"}

2022-07-18T09:11:49.9950078Z https://uploader.codecov.io/latest/windows/codecov.exe.SHA256SUM
2022-07-18T09:11:50.2105271Z ==> SHASUM file signed by key id 806bb28aed779869
2022-07-18T09:11:50.4543782Z ==> Uploader SHASUM verified (a45de206d32ad7c34ede07edcf44ca901aa8b24740f508437d1b15c738589f0b  codecov.exe)
2022-07-18T09:11:50.4546375Z ==> Running version latest
2022-07-18T09:11:50.7239276Z ==> Running version v0.2.4
2022-07-18T09:11:50.7287483Z [command]D:\a\_actions\codecov\codecov-action\e3c560433a6cc60aec8812599b7844a7b4fa0d71\dist\codecov.exe -n "" -Q github-action-3.0.0 -f ./coverage/lcov.info -F ut -C 832ec14e4f6d390474700175597656b8b9afcad6
2022-07-18T09:11:51.1454993Z [2022-07-18T09:11:51.142Z] ['info'] 
2022-07-18T09:11:51.1455708Z      _____          _
2022-07-18T09:11:51.1456393Z     / ____|        | |
2022-07-18T09:11:51.1456905Z    | |     ___   __| | ___  ___ _____   __
2022-07-18T09:11:51.1457363Z    | |    / _ \ / _` |/ _ \/ __/ _ \ \ / /
2022-07-18T09:11:51.1457756Z    | |___| (_) | (_| |  __/ (_| (_) \ V /
2022-07-18T09:11:51.1458201Z     \_____\___/ \__,_|\___|\___\___/ \_/
2022-07-18T09:11:51.1458496Z 
2022-07-18T09:11:51.1458793Z   Codecov report uploader 0.2.4
2022-07-18T09:11:51.1815771Z [2022-07-18T09:11:51.180Z] ['info'] => Project root located at: D:/a/kassette/kassette
2022-07-18T09:11:51.1837443Z [2022-07-18T09:11:51.182Z] ['info'] -> No token specified or token is empty
2022-07-18T09:11:51.2395361Z [2022-07-18T09:11:51.238Z] ['info'] Searching for coverage files...
2022-07-18T09:11:51.3560725Z [2022-07-18T09:11:51.324Z] ['info'] => Found 1 possible coverage files:
2022-07-18T09:11:51.3621140Z   ./coverage/lcov.info
2022-07-18T09:11:51.3622651Z [2022-07-18T09:11:51.325Z] ['info'] Processing ./coverage/lcov.info...
2022-07-18T09:11:51.3634906Z [2022-07-18T09:11:51.338Z] ['info'] Detected GitHub Actions as the CI provider.
2022-07-18T09:11:51.3667903Z [2022-07-18T09:11:51.340Z] ['info'] Pinging Codecov: https://codecov.io/upload/v4?package=github-action-3.0.0-uploader-0.2.4&token=*******&branch=har&build=2689370132&build_url=https%3A%2F%2Fgithub.com%2FAmadeusITGroup%2Fkassette%2Factions%2Fruns%2F2689370132&commit=832ec14e4f6d390474700175597656b8b9afcad6&job=Continuous+Integration&pr=443&service=github-actions&slug=AmadeusITGroup%2Fkassette&name=&tag=&flags=ut&parent=
2022-07-18T09:11:51.8422746Z [2022-07-18T09:11:51.840Z] ['info'] https://codecov.io/github/AmadeusITGroup/kassette/commit/832ec14e4f6d390474700175597656b8b9afcad6
2022-07-18T09:11:51.8427100Z https://storage.googleapis.com/codecov/v4/raw/2022-07-18/79F65D6A37B289E8383E0956E605D09A/832ec14e4f6d390474700175597656b8b9afcad6/9ab9b7ad-ee77-4292-953c-c959e8def46a.txt?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GOOG1E5YTIQF4NUDJHIPRXCW6SWPNHIWXR6YCTGFLBKZTWXKPGHK3U3FMCQWA%2F20220718%2FUS%2Fs3%2Faws4_request&X-Amz-Date=20220718T091151Z&X-Amz-Expires=10&X-Amz-SignedHeaders=host&X-Amz-Signature=3485e7d84b224dd3bf8c8220f578c957dcc4a7ef06d070e086ad32fad803cd84
2022-07-18T09:11:51.8428664Z [2022-07-18T09:11:51.841Z] ['info'] Uploading...
2022-07-18T09:11:52.0347936Z [2022-07-18T09:11:52.033Z] ['info'] {"status":"success","resultURL":"https://codecov.io/github/AmadeusITGroup/kassette/commit/832ec14e4f6d390474700175597656b8b9afcad6"}
2022-07-18T09:11:52.0968591Z ##[group]Run codecov/codecov-action@e3c560433a6cc60aec8812599b7844a7b4fa0d71
2022-07-18T09:11:52.0969011Z with:
2022-07-18T09:11:52.0969493Z   file: ./coverage-e2e/lcov.info
2022-07-18T09:11:52.0969811Z   flags: e2e
2022-07-18T09:11:52.0970006Z ##[endgroup]
2022-07-18T09:11:52.3549691Z ==> windows OS detected
2022-07-18T09:11:52.8128522Z https://uploader.codecov.io/latest/windows/codecov.exe.SHA256SUM
2022-07-18T09:11:52.9185817Z ==> SHASUM file signed by key id 806bb28aed779869
2022-07-18T09:11:53.1496426Z ==> Uploader SHASUM verified (a45de206d32ad7c34ede07edcf44ca901aa8b24740f508437d1b15c738589f0b  codecov.exe)
2022-07-18T09:11:53.1498969Z ==> Running version latest
2022-07-18T09:11:53.1883745Z ==> Running version v0.2.4
2022-07-18T09:11:53.1928679Z [command]D:\a\_actions\codecov\codecov-action\e3c560433a6cc60aec8812599b7844a7b4fa0d71\dist\codecov.exe -n "" -Q github-action-3.0.0 -f ./coverage-e2e/lcov.info -F e2e -C 832ec14e4f6d390474700175597656b8b9afcad6
2022-07-18T09:11:53.5886393Z [2022-07-18T09:11:53.586Z] ['info'] 
2022-07-18T09:11:53.5887106Z      _____          _
2022-07-18T09:11:53.5887698Z     / ____|        | |
2022-07-18T09:11:53.5888349Z    | |     ___   __| | ___  ___ _____   __
2022-07-18T09:11:53.5889028Z    | |    / _ \ / _` |/ _ \/ __/ _ \ \ / /
2022-07-18T09:11:53.5889675Z    | |___| (_) | (_| |  __/ (_| (_) \ V /
2022-07-18T09:11:53.5890315Z     \_____\___/ \__,_|\___|\___\___/ \_/
2022-07-18T09:11:53.5890635Z 
2022-07-18T09:11:53.5890941Z   Codecov report uploader 0.2.4
2022-07-18T09:11:53.6236172Z [2022-07-18T09:11:53.622Z] ['info'] => Project root located at: D:/a/kassette/kassette
2022-07-18T09:11:53.6256296Z [2022-07-18T09:11:53.624Z] ['info'] -> No token specified or token is empty
2022-07-18T09:11:53.6619160Z [2022-07-18T09:11:53.660Z] ['info'] Searching for coverage files...
2022-07-18T09:11:53.7753607Z [2022-07-18T09:11:53.752Z] ['info'] => Found 1 possible coverage files:
2022-07-18T09:11:53.7825098Z   ./coverage-e2e/lcov.info
2022-07-18T09:11:53.7831875Z [2022-07-18T09:11:53.752Z] ['info'] Processing ./coverage-e2e/lcov.info...
2022-07-18T09:11:53.7854042Z [2022-07-18T09:11:53.759Z] ['info'] Detected GitHub Actions as the CI provider.
2022-07-18T09:11:53.7868697Z [2022-07-18T09:11:53.761Z] ['info'] Pinging Codecov: https://codecov.io/upload/v4?package=github-action-3.0.0-uploader-0.2.4&token=*******&branch=har&build=2689370132&build_url=https%3A%2F%2Fgithub.com%2FAmadeusITGroup%2Fkassette%2Factions%2Fruns%2F2689370132&commit=832ec14e4f6d390474700175597656b8b9afcad6&job=Continuous+Integration&pr=443&service=github-actions&slug=AmadeusITGroup%2Fkassette&name=&tag=&flags=e2e&parent=
2022-07-18T09:11:54.2608959Z [2022-07-18T09:11:54.259Z] ['info'] https://codecov.io/github/AmadeusITGroup/kassette/commit/832ec14e4f6d390474700175597656b8b9afcad6
2022-07-18T09:11:54.2611787Z https://storage.googleapis.com/codecov/v4/raw/2022-07-18/79F65D6A37B289E8383E0956E605D09A/832ec14e4f6d390474700175597656b8b9afcad6/bc726dcc-ab50-4a7b-ba60-ad459b0fa5a3.txt?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GOOG1E5YTIQF4NUDJHIPRXCW6SWPNHIWXR6YCTGFLBKZTWXKPGHK3U3FMCQWA%2F20220718%2FUS%2Fs3%2Faws4_request&X-Amz-Date=20220718T091154Z&X-Amz-Expires=10&X-Amz-SignedHeaders=host&X-Amz-Signature=e0d3e5676bb1ea7fdcddac14e6759472b9c31996baeac429f57f862ad215fb02
2022-07-18T09:11:54.2613467Z [2022-07-18T09:11:54.260Z] ['info'] Uploading...
2022-07-18T09:11:54.4625919Z [2022-07-18T09:11:54.461Z] ['info'] {"status":"success","resultURL":"https://codecov.io/github/AmadeusITGroup/kassette/commit/832ec14e4f6d390474700175597656b8b9afcad6"}

Expected Results

The comment from CodeCov on the PR should provide the real coverage.

Actual Results

The comment on the PR is not updated.

Additional Information

Note that there were many “force” (non fast-forward) pushes to the PR.

divdavem · July 27, 2022, 9:14am

Note that the same problem happens with this PR:

The comment on the PR is not updated even though the coverage was successfully uploaded.

tom · August 17, 2022, 4:44am

@divdavem I’m sorry this is going to be an unsatisfying answer. The PRs are a little too old for me to pull up logs for, so I would have to make some guesses.

The PR is merged before the PR comment from Codecov gets updated properly
Something weird is happening with the number of rebases
Something weird is happening due to the PR coming from a fork

Is this still happening for you, and do you have a more recent example?

wenqiq · September 21, 2022, 6:44am

The same problem happens with this PR:

github.com/antrea-io/antrea

Remove the limit on the number of Endpoints in AntreaProxy

antrea-io:main ← hongliangl:20220826-openflow1.5

opened 03:44PM - 29 Aug 22 UTC

hongliangl

+221 -150

Fixes: #2092 Due to the message size of Openflow, the maximum number of Endpo…ints for a Service in AntreaProxy is 800. Since Openflow 1.5 is used in Antrea, the operation `insert_buckets` introduced in Openflow 1.5 can be used to create a Service with more than 800 Endpoints. To sync Service with more than 800 Endpoints to OVS, multiple Openflow messages will be sent to OVS in a bundle (the first message uses `add` to sync the OVS group and its corresponding buckets to OVS, other messages use `insert_buckets` to sync other buckets to OVS). Signed-off-by: Hongliang Liu <lhongliang@vmware.com>

tom · September 21, 2022, 11:13pm

@wenqiq thanks, my suspicion is that we might not be handling repeated rebases properly. Let me forward this along to the product team.

wenqiq · September 23, 2022, 6:09am

Thanks so much. I have made a new PR with the same code changes and found the same problem.[not4review]Remove the limit on the number of Endpoints in AntreaProxy by wenqiq · Pull Request #4226 · antrea-io/antrea · GitHub
I think maybe it’s not related to rebase. After I changed the ignore files in codecov.yml. The hints disappeared.

tom · September 26, 2022, 4:36pm

@wenqiq oh that’s ineresting. So let me understand properly

Removing ignore files in the codecov.yml removes the error message (did you remove all of them or just some?)
Adding back in ignore into the codecov.yml shows the error message again?

Topic		Replies	Views
Incorrect code coverage due to wrong base commit and recent commits to main missing from Codecov dashboard Support github	1	361	January 16, 2023
Codecov report is not correctly Bug Fixes github	1	274	October 18, 2021
Codecov GitHub action doesn't work well compared to bash uploader Bug Fixes github	15	432	October 6, 2023
PR Merge "Not Updating" Base Coverage - Misunderstanding Support	2	397	August 30, 2021
Why stuck in "Waiting for CI to complete"? Bug Fixes	5	541	July 12, 2022