Github status check "No coverage information found on head", and PR comment missing

Please check the troubleshooting guide before creating a ticket.
All fields below are required.

Description

Code coverage reports are being uploaded correctly to codecove, the website shows what seems to be correct data/reports, BUT the github status check state “No coverage information found on head” and the PR comment isn’t being added.

What is most bizarre is that doing identical changes to a fork of the project performs as-expected, with PR comments being added promptly etc.

As suggested elsewhere, I have removed the codecov app and then re-added it but this has been without success.

Commit SHAs

e9372bef21515cf89a3b710c39b3b6eca720f0d1

Repository

CI/CD or Build URL

Github Actions – Fix surefire configuration to allow jacoco to run correctly on JSS tests by MysterAitch · Pull Request #3208 · javaparser/javaparser · GitHub

Uploader

Github Action

Codecov Output

Note that this is one of many uploads within the build matrix (27 in total:: JDK8-16 on ubuntu/mac/windows).

Run codecov/codecov-action@v1
  with:
    file: javaparser-symbol-solver-testing/target/site/jacoco/jacoco.xml
    fail_ci_if_error: false
    verbose: false
    flags: javaparser-symbol-solver,AlsoSlowTests,ubuntu-latest,jdk-8
    env_vars: OS,JDK
  env:
    OS: ubuntu-latest
    JDK: 8
    JAVA_HOME_8.0.282_x64: /opt/hostedtoolcache/jdk/8.0.282/x64
    JAVA_HOME: /opt/hostedtoolcache/jdk/8.0.282/x64
    JAVA_HOME_8_0_282_X64: /opt/hostedtoolcache/jdk/8.0.282/x64
/usr/bin/bash codecov.sh -n  -F javaparser-symbol-solver,AlsoSlowTests,ubuntu-latest,jdk-8 -Q github-action -e OS,JDK -f javaparser-symbol-solver-testing/target/site/jacoco/jacoco.xml -C e9372bef21515cf89a3b710c39b3b6eca720f0d1

  _____          _
 / ____|        | |
| |     ___   __| | ___  ___ _____   __
| |    / _ \ / _` |/ _ \/ __/ _ \ \ / /
| |___| (_) | (_| |  __/ (_| (_) \ V /
 \_____\___/ \__,_|\___|\___\___/ \_/
                              Bash-20210309-2b87ace


==> git version 2.31.0 found
==> curl 7.68.0 (x86_64-pc-linux-gnu) libcurl/7.68.0 OpenSSL/1.1.1f zlib/1.2.11 brotli/1.0.7 libidn2/2.2.0 libpsl/0.21.0 (+libidn2/2.2.0) libssh/0.9.3/openssl/zlib nghttp2/1.40.0 librtmp/2.3
Release-Date: 2020-01-08
Protocols: dict file ftp ftps gopher http https imap imaps ldap ldaps pop3 pop3s rtmp rtsp scp sftp smb smbs smtp smtps telnet tftp 
Features: AsynchDNS brotli GSS-API HTTP2 HTTPS-proxy IDN IPv6 Kerberos Largefile libz NTLM NTLM_WB PSL SPNEGO SSL TLS-SRP UnixSockets
==> GitHub Actions detected.
    Env vars used:
      -> GITHUB_ACTIONS:    true
      -> GITHUB_HEAD_REF:   re_enable_jacoco_on_jss
      -> GITHUB_REF:        refs/pull/3208/merge
      -> GITHUB_REPOSITORY: javaparser/javaparser
      -> GITHUB_RUN_ID:     692910328
      -> GITHUB_SHA:        f2864337d7f496c8a6d4460d8e35f9086dbfe196
      -> GITHUB_WORKFLOW:   Build and test (using maven)
    project root: .
    Yaml found at: codecov.yml
    -> Found 1 reports
==> Detecting git/mercurial file structure
==> Appending build variables
    + OS
    + JDK
==> Reading reports
    + javaparser-symbol-solver-testing/target/site/jacoco/jacoco.xml bytes=5518572
==> Appending adjustments
    https://docs.codecov.io/docs/fixing-reports
    -> No adjustments found
==> Gzipping contents
        340K	/tmp/codecov.H5FrLF.gz
==> Uploading reports
    url: https://codecov.io
    query: branch=re_enable_jacoco_on_jss&commit=e9372bef21515cf89a3b710c39b3b6eca720f0d1&build=692910328&build_url=http%3A%2F%2Fgithub.com%2Fjavaparser%2Fjavaparser%2Factions%2Fruns%2F692910328&name=&tag=&slug=javaparser%2Fjavaparser&service=github-actions&flags=javaparser-symbol-solver,AlsoSlowTests,ubuntu-latest,jdk-8&pr=3208&job=Build%20and%20test%20%28using%20maven%29&cmd_args=n,F,Q,e,f,C
->  Pinging Codecov
https://codecov.io/upload/v4?package=github-action-20210309-2b87ace&token=secret&branch=re_enable_jacoco_on_jss&commit=e9372bef21515cf89a3b710c39b3b6eca720f0d1&build=692910328&build_url=http%3A%2F%2Fgithub.com%2Fjavaparser%2Fjavaparser%2Factions%2Fruns%2F692910328&name=&tag=&slug=javaparser%2Fjavaparser&service=github-actions&flags=javaparser-symbol-solver,AlsoSlowTests,ubuntu-latest,jdk-8&pr=3208&job=Build%20and%20test%20%28using%20maven%29&cmd_args=n,F,Q,e,f,C
->  Uploading to
https://storage.googleapis.com/codecov/v4/raw/2021-03-27/1FEC948195A8431A51B39B2D25154F8B/e9372bef21515cf89a3b710c39b3b6eca720f0d1/9607eb02-3061-4aba-a8c8-53f36b3244a3.txt?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GOOG1EQX6OZVJGHKK3633AAFGLBUCOOATRACRQRQF6HMSMLYUP6EAD6XSWAAY%2F20210327%2FUS%2Fs3%2Faws4_request&X-Amz-Date=20210327T134226Z&X-Amz-Expires=10&X-Amz-SignedHeaders=host&X-Amz-Signature=4e6339fa1704dadef879d5742aa1e26b8953dc6982fbf61a693f5624cb7d0f97
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100  338k    0     0  100  338k      0  1685k --:--:-- --:--:-- --:--:-- 1685k
    -> Reports have been successfully queued for processing at https://codecov.io/github/javaparser/javaparser/commit/e9372bef21515cf89a3b710c39b3b6eca720f0d1

Expected Results

Github status checks to report coverage, and a PR comment to be posted.

Here are screenshots of a working example from an arbitrarily “old” PR (about two weeks ago):

Edit: New users aren’t able to include multiple screenshots. Here is a link: Fixed name resolution in casted lambda expressions by maartenc · Pull Request #3165 · javaparser/javaparser · GitHub

Actual Results

No PR comment being added. At the time of writing this, PR 3208 (linked to below) status checks completed over half an hour ago and I can see all uploads in the “build” tab – screenshots included within the PR.

“No coverage information on head” on the status check

image

Additional Information

Context: The JavaParser project has two parts – “core” and “symbol solver”.

It was noted recently that code coverage for the symbol solver section isn’t being reported – investigating this, it seems that it is a surefire error on our part (argline being overwritten).

Fixing this introduces a new problem of the PR comments not being shown, and the status checks reporting “No coverage information found on head”.

I am now (reasonably) confident that coverage reports are being produced correctly but the

Hi @MysterAitch sorry for the delay here. So the error message you are receiving is due to the fact that we are not getting coverage metrics for those flags (so instead of showing 0 lines hit/0 lines total, we show that message).

However, I see that you are sending coverage with flags here and have flags defined here. You are, however, missing a flags section in your yaml. Adding that should fix your issue.