GitHub checks not being reported for public repo

Support
,
1

Before submitting a topic, please confirm the following

I have searched for similar issues before creating this topic.
I have verified that my repository is using the Codecov GitHub app, if using GitHub
I have validated my codecov.yaml configuration file.
I have filled out the below sections to the best of my ability.

Description

I have a personal public repository hosted on GitHub. Around 6 months ago I had Codecov configured and running properly on the repo, with both project and patch checks being properly reported. A couple of days ago I noticed I had a dependabot PR open, so I started doing some housekeeping, and I noticed the Codecov checks were in the “Expected” status, as they had been set as required by me months ago.

I tried to re-run the workflow but because the config was too old, I decided to review the integration and upgrade all of my actions. By the way, I also checked logs and the reports were being properly generated and sent to Codecov. The only issue was the missing checks.

Here is a summary of what I tried to do to get them properly reported: (not necessarily in order)

  • Went to Codecov’s website, which asked me for extra scopes/permissions for GitHub.
  • Removed the integration from GitHub and installed it again.
  • Removed and added permissions for this specific repo.
  • Installed the application in GitHub’s marketplace.
  • Upgraded all of my GitHub actions to v3 (many were in v1).
  • Noticed that a previously configured webhook had been failing with a 403 and deleted it, hoping it would be readded but apparently it is not used anymore.
  • Removed the codecov token I had been using because it was not required for public repos.

CI/CD URL

Codecov Output

2023-01-07T01:46:04.9620903Z ##[group]Run codecov/codecov-action@v3
2023-01-07T01:46:04.9621191Z with:
2023-01-07T01:46:04.9621412Z   files: ./coverage.out
2023-01-07T01:46:04.9621672Z   fail_ci_if_error: true
2023-01-07T01:46:04.9621921Z   verbose: true
2023-01-07T01:46:04.9622154Z ##[endgroup]
2023-01-07T01:46:05.1242501Z {
2023-01-07T01:46:05.1243328Z   execArgs: [
2023-01-07T01:46:05.1244648Z     '-n',
2023-01-07T01:46:05.1245082Z     '',
2023-01-07T01:46:05.1245582Z     '-Q',
2023-01-07T01:46:05.1246195Z     'github-action-3.1.1',
2023-01-07T01:46:05.1246694Z     '-Z',
2023-01-07T01:46:05.1247129Z     '-f',
2023-01-07T01:46:05.1247646Z     './coverage.out',
2023-01-07T01:46:05.1248120Z     '-C',
2023-01-07T01:46:05.1248843Z     '8e7dd96b9dd62ca42d75650d6b21662fb059a971',
2023-01-07T01:46:05.1249393Z     '-v'
2023-01-07T01:46:05.1249748Z   ]
2023-01-07T01:46:05.1250063Z }
2023-01-07T01:46:05.1251486Z ==> linux OS detected
2023-01-07T01:46:05.6017447Z https://uploader.codecov.io/latest/linux/codecov.SHA256SUM
2023-01-07T01:46:05.6641059Z Received SHA256SUM 20f9c9d78483fce977b6cc39e231a734a23bcd36f4d536bb7355222fb88d02bc  codecov
2023-01-07T01:46:05.7073701Z Received SHA256SUM signature -----BEGIN PGP SIGNATURE-----
2023-01-07T01:46:05.7074264Z 
2023-01-07T01:46:05.7077007Z iQIzBAABCgAdFiEEJwNOf9uFDgu8LGL/gGuyiu13mGkFAmMsvyQACgkQgGuyiu13
2023-01-07T01:46:05.7077665Z mGmStA/+N4roe/N6hA78uO55SL8/8tfS75QYe+PbRF3nN+mpXsyik+gMZWfu9SLT
2023-01-07T01:46:05.7169001Z lQJK2T9PfU6dFx5VnceoENXgnH+SUvDLorKUOwTolXMIEos9bLCPRcgfe3AkTeZR
2023-01-07T01:46:05.7169580Z 2sHZcDj75nmcfEpO9Tf/Jpq2PPrP24J3S822/v3ZT8lca9jJe8CJlBL15yXC1kgD
2023-01-07T01:46:05.7170099Z Vk72+r9KzAoAu6bCEvBOOIFHHNfVBf0635vamRFCHFgjN1rRJW5cuyieZr9rYa22
2023-01-07T01:46:05.7170686Z 1KDpN6vijJwUlrwB7V8wTvaeOEinR5Fzo55TtjTtE4brfaOF2KCzM33Czzep3SfH
2023-01-07T01:46:05.7171233Z OPJENE1+A+/bleRcVok5qmRfvMThSITE98INNk4qCVsB1YqTOvtJs5rFtyuH/Xqf
2023-01-07T01:46:05.7171743Z 674HAqeNjzXvFME5oX4Hm31X1Y4rfzH0738H25J//3GqZWahivq7e8ElyYP+CI0H
2023-01-07T01:46:05.7172292Z pXbeN6E9Zup/QR6YjYWBV35AvRscC7v4e6HnlN9ctTuAd0VZJXI8JLM1XTgiQnIQ
2023-01-07T01:46:05.7172838Z rql/7lIYrvzLerPmzVoAmYZuV2iAE7pxfo3Iy9zEtgV8cF42peE3TDyrqj5Ylbtc
2023-01-07T01:46:05.7173387Z 1pKlfIIAhoB/ff2hIvGonXG4OgTCCQrUvbtI8KsNi6UFPX5jhCaltKMsLG/JPM+Q
2023-01-07T01:46:05.7173901Z vXPa43eZ+aWPHOi9dFdlg98GCFesSVKLECkU4DjoZxJsI493PrQ=
2023-01-07T01:46:05.7174238Z =IHR5
2023-01-07T01:46:05.7174655Z -----END PGP SIGNATURE-----
2023-01-07T01:46:05.7174838Z 
2023-01-07T01:46:05.7393156Z ==> SHASUM file signed by key id 806bb28aed779869
2023-01-07T01:46:05.9230646Z ==> Uploader SHASUM verified (20f9c9d78483fce977b6cc39e231a734a23bcd36f4d536bb7355222fb88d02bc  codecov)
2023-01-07T01:46:05.9231145Z ==> Running version latest
2023-01-07T01:46:06.0144425Z ==> Running version v0.3.2
2023-01-07T01:46:06.0168120Z [command]/home/runner/work/_actions/codecov/codecov-action/v3/dist/codecov -n  -Q github-action-3.1.1 -Z -f ./coverage.out -C 8e7dd96b9dd62ca42d75650d6b21662fb059a971 -v
2023-01-07T01:46:06.2298664Z [2023-01-07T01:46:06.228Z] ['verbose'] Start of uploader: 1673055966228...
2023-01-07T01:46:06.2304538Z [2023-01-07T01:46:06.230Z] ['info'] 
2023-01-07T01:46:06.2305037Z      _____          _
2023-01-07T01:46:06.2306582Z     / ____|        | |
2023-01-07T01:46:06.2306924Z    | |     ___   __| | ___  ___ _____   __
2023-01-07T01:46:06.2307269Z    | |    / _ \ / _` |/ _ \/ __/ _ \ \ / /
2023-01-07T01:46:06.2307653Z    | |___| (_) | (_| |  __/ (_| (_) \ V /
2023-01-07T01:46:06.2308077Z     \_____\___/ \__,_|\___|\___\___/ \_/
2023-01-07T01:46:06.2308327Z 
2023-01-07T01:46:06.2308569Z   Codecov report uploader 0.3.2
2023-01-07T01:46:06.2357843Z [2023-01-07T01:46:06.235Z] ['info'] => Project root located at: /home/runner/work/go-tlv/go-tlv
2023-01-07T01:46:06.2396521Z [2023-01-07T01:46:06.239Z] ['info'] -> No token specified or token is empty
2023-01-07T01:46:06.2397407Z [2023-01-07T01:46:06.239Z] ['verbose'] Start of network processing...
2023-01-07T01:46:06.2400508Z [2023-01-07T01:46:06.239Z] ['verbose'] Searching for files in /home/runner/work/go-tlv/go-tlv
2023-01-07T01:46:06.2469398Z [2023-01-07T01:46:06.246Z] ['verbose'] coveragepy is not installed
2023-01-07T01:46:06.2470557Z [2023-01-07T01:46:06.246Z] ['info'] Searching for coverage files...
2023-01-07T01:46:06.3008954Z [2023-01-07T01:46:06.300Z] ['verbose'] Preparing to clean the following coverage paths: ./coverage.out
2023-01-07T01:46:06.3015659Z [2023-01-07T01:46:06.301Z] ['info'] => Found 1 possible coverage files:
2023-01-07T01:46:06.3016302Z   ./coverage.out
2023-01-07T01:46:06.3016996Z [2023-01-07T01:46:06.301Z] ['verbose'] End of network processing
2023-01-07T01:46:06.3028543Z [2023-01-07T01:46:06.302Z] ['info'] Processing ./coverage.out...
2023-01-07T01:46:06.3074177Z [2023-01-07T01:46:06.307Z] ['info'] Detected GitHub Actions as the CI provider.
2023-01-07T01:46:06.3074912Z [2023-01-07T01:46:06.307Z] ['verbose'] -> Using the following env variables:
2023-01-07T01:46:06.3081396Z [2023-01-07T01:46:06.307Z] ['verbose']      GITHUB_ACTION: __codecov_codecov-action
2023-01-07T01:46:06.3082359Z [2023-01-07T01:46:06.308Z] ['verbose']      GITHUB_HEAD_REF: debug/codecov-checks
2023-01-07T01:46:06.3087660Z [2023-01-07T01:46:06.308Z] ['verbose']      GITHUB_REF: refs/pull/24/merge
2023-01-07T01:46:06.3092978Z [2023-01-07T01:46:06.309Z] ['verbose']      GITHUB_REPOSITORY: pauloavelar/go-tlv
2023-01-07T01:46:06.3093721Z [2023-01-07T01:46:06.309Z] ['verbose']      GITHUB_RUN_ID: 3859861896
2023-01-07T01:46:06.3094518Z [2023-01-07T01:46:06.309Z] ['verbose']      GITHUB_SERVER_URL: https://github.com
2023-01-07T01:46:06.3101851Z [2023-01-07T01:46:06.309Z] ['verbose']      GITHUB_SHA: 9d6c9fc2baf97644f9da9f094f877ffeb1eab369
2023-01-07T01:46:06.3105690Z [2023-01-07T01:46:06.310Z] ['verbose']      GITHUB_WORKFLOW: CI
2023-01-07T01:46:06.3110860Z [2023-01-07T01:46:06.310Z] ['verbose'] Using the following upload parameters:
2023-01-07T01:46:06.3111428Z [2023-01-07T01:46:06.310Z] ['verbose'] branch
2023-01-07T01:46:06.3111865Z [2023-01-07T01:46:06.310Z] ['verbose'] build
2023-01-07T01:46:06.3112336Z [2023-01-07T01:46:06.311Z] ['verbose'] buildURL
2023-01-07T01:46:06.3117777Z [2023-01-07T01:46:06.311Z] ['verbose'] commit
2023-01-07T01:46:06.3118218Z [2023-01-07T01:46:06.311Z] ['verbose'] job
2023-01-07T01:46:06.3118593Z [2023-01-07T01:46:06.311Z] ['verbose'] pr
2023-01-07T01:46:06.3119041Z [2023-01-07T01:46:06.311Z] ['verbose'] service
2023-01-07T01:46:06.3125492Z [2023-01-07T01:46:06.311Z] ['verbose'] slug
2023-01-07T01:46:06.3126025Z [2023-01-07T01:46:06.312Z] ['verbose'] name
2023-01-07T01:46:06.3130748Z [2023-01-07T01:46:06.312Z] ['verbose'] tag
2023-01-07T01:46:06.3131302Z [2023-01-07T01:46:06.312Z] ['verbose'] flags
2023-01-07T01:46:06.3131730Z [2023-01-07T01:46:06.312Z] ['verbose'] parent
2023-01-07T01:46:06.3146558Z [2023-01-07T01:46:06.314Z] ['info'] Pinging Codecov: https://codecov.io/upload/v4?package=github-action-3.1.1-uploader-0.3.2&token=*******&branch=debug%2Fcodecov-checks&build=3859861896&build_url=https%3A%2F%2Fgithub.com%2Fpauloavelar%2Fgo-tlv%2Factions%2Fruns%2F3859861896&commit=8e7dd96b9dd62ca42d75650d6b21662fb059a971&job=CI&pr=24&service=github-actions&slug=pauloavelar%2Fgo-tlv&name=&tag=&flags=&parent=
2023-01-07T01:46:06.3147928Z [2023-01-07T01:46:06.314Z] ['verbose'] Passed token was 0 characters long
2023-01-07T01:46:06.3149543Z [2023-01-07T01:46:06.314Z] ['verbose'] https://codecov.io/upload/v4?package=github-action-3.1.1-uploader-0.3.2&branch=debug%2Fcodecov-checks&build=3859861896&build_url=https%3A%2F%2Fgithub.com%2Fpauloavelar%2Fgo-tlv%2Factions%2Fruns%2F3859861896&commit=8e7dd96b9dd62ca42d75650d6b21662fb059a971&job=CI&pr=24&service=github-actions&slug=pauloavelar%2Fgo-tlv&name=&tag=&flags=&parent=
2023-01-07T01:46:06.3151104Z         Content-Type: 'text/plain'
2023-01-07T01:46:06.3151777Z         Content-Encoding: 'gzip'
2023-01-07T01:46:06.3152485Z         X-Reduced-Redundancy: 'false'
2023-01-07T01:46:07.0427791Z [2023-01-07T01:46:07.041Z] ['info'] https://app.codecov.io/github/pauloavelar/go-tlv/commit/8e7dd96b9dd62ca42d75650d6b21662fb059a971
2023-01-07T01:46:07.0432278Z https://storage.googleapis.com/codecov/v4/raw/2023-01-07/7897F9B7822F0DD6F231665E2F00BF99/8e7dd96b9dd62ca42d75650d6b21662fb059a971/c9c2eb5d-1173-448d-9222-637ff3c6d961.txt?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GOOG1EJOGFN2JQ4OCTGA2MU5AEIT7OT5Z7HTFOAN2SPG4NWSN2UJYOY5U6LZQ%2F20230107%2FUS%2Fs3%2Faws4_request&X-Amz-Date=20230107T014607Z&X-Amz-Expires=10&X-Amz-SignedHeaders=host&X-Amz-Signature=a5590373a7933b180d64f26c086cd0af7e1b284be6b55b76988ac45707779a59
2023-01-07T01:46:07.0437545Z [2023-01-07T01:46:07.042Z] ['verbose'] Returned upload url: https://storage.googleapis.com/codecov/v4/raw/2023-01-07/7897F9B7822F0DD6F231665E2F00BF99/8e7dd96b9dd62ca42d75650d6b21662fb059a971/c9c2eb5d-1173-448d-9222-637ff3c6d961.txt?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GOOG1EJOGFN2JQ4OCTGA2MU5AEIT7OT5Z7HTFOAN2SPG4NWSN2UJYOY5U6LZQ%2F20230107%2FUS%2Fs3%2Faws4_request&X-Amz-Date=20230107T014607Z&X-Amz-Expires=10&X-Amz-SignedHeaders=host&X-Amz-Signature=a5590373a7933b180d64f26c086cd0af7e1b284be6b55b76988ac45707779a59
2023-01-07T01:46:07.0442104Z [2023-01-07T01:46:07.042Z] ['info'] Uploading...
2023-01-07T01:46:07.2158050Z [2023-01-07T01:46:07.214Z] ['info'] {"status":"success","resultURL":"https://app.codecov.io/github/pauloavelar/go-tlv/commit/8e7dd96b9dd62ca42d75650d6b21662fb059a971"}
2023-01-07T01:46:07.2160215Z [2023-01-07T01:46:07.215Z] ['verbose'] End of uploader: 987 milliseconds

Expected Results

The GitHub checks should have been reported in my PR.

Actual Results

No GitHub checks ever got reported, despite all the changes to make it work. Codecov is still commenting in the PR with the report overview, but the checks are missing.

2

@pauloavelar I’m not positive the branches field in the codecov.yml supports regex. Could you try replacing it with

- "main"

instead?

1 Like
3

Hi Tom. Thanks for the quick reply.

The [ main ] was supposed to be just a shorthand for an array declaration in YAML, not regex. I ran the yml file in the validator and apparently it was valid.

That said, you made me reconsider my config file, and I was not really looking at it and focused mostly on the actions. I removed all of the advanced config from it, as most of it was redundant, and it worked! So it was indeed most likely the branches config.

I am wondering how this could have been clearer, and definitely something broke along the way, because the file was not changed for nearly 2 years and at some point the checks worked.

Anyway, thank you very much for the tip.

1 Like