Description
Code coverage reports are being uploaded correctly to codecove, the website shows what seems to be correct data/reports, BUT the github status check state “No coverage information found on head” and the PR comment isn’t being added.
What is most bizarre is that doing identical changes to a fork of the project performs as-expected, with PR comments being added promptly etc.
As suggested elsewhere, I have removed the codecov app and then re-added it but this has been without success.
Commit SHAs
e9372bef21515cf89a3b710c39b3b6eca720f0d1
Repository
CI/CD or Build URL
Github Actions – Fix surefire configuration to allow jacoco to run correctly on JSS tests by MysterAitch · Pull Request #3208 · javaparser/javaparser · GitHub
Uploader
Github Action
Codecov Output
Note that this is one of many uploads within the build matrix (27 in total:: JDK8-16 on ubuntu/mac/windows).
Run codecov/codecov-action@v1
with:
file: javaparser-symbol-solver-testing/target/site/jacoco/jacoco.xml
fail_ci_if_error: false
verbose: false
flags: javaparser-symbol-solver,AlsoSlowTests,ubuntu-latest,jdk-8
env_vars: OS,JDK
env:
OS: ubuntu-latest
JDK: 8
JAVA_HOME_8.0.282_x64: /opt/hostedtoolcache/jdk/8.0.282/x64
JAVA_HOME: /opt/hostedtoolcache/jdk/8.0.282/x64
JAVA_HOME_8_0_282_X64: /opt/hostedtoolcache/jdk/8.0.282/x64
/usr/bin/bash codecov.sh -n -F javaparser-symbol-solver,AlsoSlowTests,ubuntu-latest,jdk-8 -Q github-action -e OS,JDK -f javaparser-symbol-solver-testing/target/site/jacoco/jacoco.xml -C e9372bef21515cf89a3b710c39b3b6eca720f0d1
_____ _
/ ____| | |
| | ___ __| | ___ ___ _____ __
| | / _ \ / _` |/ _ \/ __/ _ \ \ / /
| |___| (_) | (_| | __/ (_| (_) \ V /
\_____\___/ \__,_|\___|\___\___/ \_/
Bash-20210309-2b87ace
==> git version 2.31.0 found
==> curl 7.68.0 (x86_64-pc-linux-gnu) libcurl/7.68.0 OpenSSL/1.1.1f zlib/1.2.11 brotli/1.0.7 libidn2/2.2.0 libpsl/0.21.0 (+libidn2/2.2.0) libssh/0.9.3/openssl/zlib nghttp2/1.40.0 librtmp/2.3
Release-Date: 2020-01-08
Protocols: dict file ftp ftps gopher http https imap imaps ldap ldaps pop3 pop3s rtmp rtsp scp sftp smb smbs smtp smtps telnet tftp
Features: AsynchDNS brotli GSS-API HTTP2 HTTPS-proxy IDN IPv6 Kerberos Largefile libz NTLM NTLM_WB PSL SPNEGO SSL TLS-SRP UnixSockets
==> GitHub Actions detected.
Env vars used:
-> GITHUB_ACTIONS: true
-> GITHUB_HEAD_REF: re_enable_jacoco_on_jss
-> GITHUB_REF: refs/pull/3208/merge
-> GITHUB_REPOSITORY: javaparser/javaparser
-> GITHUB_RUN_ID: 692910328
-> GITHUB_SHA: f2864337d7f496c8a6d4460d8e35f9086dbfe196
-> GITHUB_WORKFLOW: Build and test (using maven)
project root: .
Yaml found at: codecov.yml
-> Found 1 reports
==> Detecting git/mercurial file structure
==> Appending build variables
+ OS
+ JDK
==> Reading reports
+ javaparser-symbol-solver-testing/target/site/jacoco/jacoco.xml bytes=5518572
==> Appending adjustments
https://docs.codecov.io/docs/fixing-reports
-> No adjustments found
==> Gzipping contents
340K /tmp/codecov.H5FrLF.gz
==> Uploading reports
url: https://codecov.io
query: branch=re_enable_jacoco_on_jss&commit=e9372bef21515cf89a3b710c39b3b6eca720f0d1&build=692910328&build_url=http%3A%2F%2Fgithub.com%2Fjavaparser%2Fjavaparser%2Factions%2Fruns%2F692910328&name=&tag=&slug=javaparser%2Fjavaparser&service=github-actions&flags=javaparser-symbol-solver,AlsoSlowTests,ubuntu-latest,jdk-8&pr=3208&job=Build%20and%20test%20%28using%20maven%29&cmd_args=n,F,Q,e,f,C
-> Pinging Codecov
https://codecov.io/upload/v4?package=github-action-20210309-2b87ace&token=secret&branch=re_enable_jacoco_on_jss&commit=e9372bef21515cf89a3b710c39b3b6eca720f0d1&build=692910328&build_url=http%3A%2F%2Fgithub.com%2Fjavaparser%2Fjavaparser%2Factions%2Fruns%2F692910328&name=&tag=&slug=javaparser%2Fjavaparser&service=github-actions&flags=javaparser-symbol-solver,AlsoSlowTests,ubuntu-latest,jdk-8&pr=3208&job=Build%20and%20test%20%28using%20maven%29&cmd_args=n,F,Q,e,f,C
-> Uploading to
https://storage.googleapis.com/codecov/v4/raw/2021-03-27/1FEC948195A8431A51B39B2D25154F8B/e9372bef21515cf89a3b710c39b3b6eca720f0d1/9607eb02-3061-4aba-a8c8-53f36b3244a3.txt?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GOOG1EQX6OZVJGHKK3633AAFGLBUCOOATRACRQRQF6HMSMLYUP6EAD6XSWAAY%2F20210327%2FUS%2Fs3%2Faws4_request&X-Amz-Date=20210327T134226Z&X-Amz-Expires=10&X-Amz-SignedHeaders=host&X-Amz-Signature=4e6339fa1704dadef879d5742aa1e26b8953dc6982fbf61a693f5624cb7d0f97
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 338k 0 0 100 338k 0 1685k --:--:-- --:--:-- --:--:-- 1685k
-> Reports have been successfully queued for processing at https://codecov.io/github/javaparser/javaparser/commit/e9372bef21515cf89a3b710c39b3b6eca720f0d1
Expected Results
Github status checks to report coverage, and a PR comment to be posted.
Here is a working example from an arbitrarily “old” PR (about two weeks ago):
Actual Results
No PR comment being added. At the time of writing this, PR 3208 (linked to below) status checks completed over five hours ago and I can see all uploads in the “build” tab – screenshots included within the PR.
“No coverage information on head” on the status check
Additional Information
Context: The JavaParser project has two parts – “core” and “symbol solver”.
It was noted recently that code coverage for the symbol solver section isn’t being reported – investigating this, it seems that it is a surefire error on our part (argline being overwritten).
Fixing this introduces a new problem of the PR comments not being shown, and the status checks reporting “No coverage information found on head”.
I am now (reasonably) confident that coverage reports are being produced correctly but the
