Note: With a new account here, I can frustratingly only post one link. See https://github.com/python-pillow/Pillow/issues/3934#issuecomment-511332550 for this same report with the TODOs filled in.
Coverage reports are being created for PRs on Codecov, but most of the time they’re not showing as checks the PRs on GitHub. They used to. This makes it hard to see if the PR has tested the changed code.
Here’s 5 recent PRs, none have Codecov checks on GitHub:
These mostly show up on the Codecov website itself with coverage:
#3953: “No report uploaded yet.”
The most recent to have a Codecov check on GitHub was 8 days ago, but there are older ones without checks:
codecov 2.0.15 for Python
We fixed a bug last night with stuck statuses. Can you please push a fresh commit and let me know if you are still seeing this issue?
Hi @drazisil, thanks for the quick reply!
I restarted the Travis CI build for 5 PRs. This now had Codecov checks on the PR:
I can see them at https://codecov.io/gh/python-pillow/Pillow/pulls, but not as checks.
Should it only work for fresh commits, or should restarting it also help?
Hi @drazisil, I sent the notifications and that PR now has the checks: https://github.com/python-pillow/Pillow/pull/3964.
Should I do the same for the other PRs?
Yes, please. Let me know if that doesn’t fix them.
For the old PR https://github.com/python-pillow/Pillow/pull/3969 I pushed notifications at https://codecov.io/gh/python-pillow/Pillow/commit/c76369ce874c7a4b0928495bb7e17f9759aa4a40/build and the checks show up
But I created a new PR today, https://github.com/python-pillow/Pillow/pull/3976, and it doesn’t have the checks.
Its corresponding https://codecov.io/gh/python-pillow/Pillow/commit/4ceaa14f91ad9e9fdbb3ee2f4f3c564029bf9ce4/build says:
Notifications are pending CI completion. Waiting for GitHub’s status webhook to queue notifications. Push notifications now.
Any idea why that is?
Not sure. I manually pushed them, I wonder if one of the CI runs took long enough for the checks to timeout. How long do the runs generally take?
The slowest is AppVeyor, which usually takes 45-60 minutes for all the jobs to complete in series.
Looking at PR https://github.com/python-pillow/Pillow/pull/3981, there are 20 Travis CI jobs and 10 AppVeyor jobs which send coverage.
However, 4 Travis jobs are missing from https://codecov.io/gh/python-pillow/Pillow/commit/9b26ea2164f14ad9e6b4b133d9e56eeef6671345/build
They’re all green at https://travis-ci.org/python-pillow/Pillow/builds/561296502
However, 3 timed out uploading to S3 when running
Uploading to S3...
Error: HTTPSConnectionPool(host='codecov.io', port=443): Max retries exceeded with url: /codecov/v4/raw/2019-07-20/A516DB1BB8B4FFBA3C8D154F4B502F22/9b26ea2164f14ad9e6b4b133d9e56eeef6671345/8db867f0-7252-43d2-93cd-28a325d23400.txt?AWSAccessKeyId=AKIAIHLZSCQCS4WIHD4A&Expires=1563593005&Signature=Oho8rN93UdDP7%2FG7eIy3mvrmX%2B4%3D (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7fa4495c6e48>: Failed to establish a new connection: [Errno 110] Connection timed out'))
The 4th has a problem installing a dependency before running
Here’s a PR which fixes the dependency install problem:
The check is still missing, and one AppVeyor job timed out uploading to S3: