Sudden codecov drop when using github actions

Support Bug Fixes
,
1

I have searched for similar issues and found this - Sudden significant coverage drop but I could not use the solution they found in my code.

Description

The code coverage of a project has dropped by 93% but there are not corresponding changes to the tests or R code. This went unnoticed for some time but in checking the commits there isn’t and obvious reason why the coverage would plummet as it has.

Commit SHAs

At this commit 6b5f93a everything was fine.

at this commit it dropped by 93% 38e5de2 - here is the change on github - try out github actions CI by goldingn · Pull Request #332 · greta-dev/greta · GitHub

Repository

CI/CD or Build URL

I am using github actions,
the link where coverage is being uploaded is Actions · greta-dev/greta · GitHub

Uploader

Github actions

Codecov Output

From the github actions link (apologies if this is not what is meant - I couldn’t find the codecov ascii mentioned

Run covr::codecov()
  covr::codecov()
  shell: /usr/local/bin/Rscript {0}
  env:
    RSPM: https://packagemanager.rstudio.com/cran/__linux__/bionic/latest
    GITHUB_PAT: ***
    R_LIBS_USER: /home/runner/work/_temp/Library
    TZ: UTC
    _R_CHECK_SYSTEM_CLOCK_: FALSE
    NOT_CRAN: true

files differ in number of lines:
12,14c12
< Warning message:
< In spelling::spell_check_test(vignettes = TRUE, error = FALSE, skip_on_cran = TRUE) :
<   Failed to find package source directory
---
> All Done!
$message
[1] "Coverage reports upload successfully"

$uploaded
[1] TRUE

$queued
[1] TRUE

$id
[1] "c72fe260-ac7d-4534-9a51-b2e142b894aa"

$url
[1] "https://codecov.io/github/greta-dev/greta/commit/d6aac0eb36966bdb5ca8a8c71f822a80ca087f6b"

Expected Results

Coverage to stay at a similar number - 93-5%

Actual Results

Coverage dropped to 1%

Additional Information

Here is the codecov YAML

comment: false

coverage:
  status:
    project:
      default:
        target: auto
        threshold: 1%
        informational: true
    patch:
      default:
        target: auto
        threshold: 1%
        informational: true
2

@njtierney sorry for the delay here. I took a look at the coverage report uploaded in one of the 1% reports, and it mostly is showing null or 0 which implies that those lines aren’t hit. My guess is that this is something with your CI that changed or a race condition. I’m sorry I can’t be more helpful here, but Codecov is displaying the coverage as uploaded.