Default: false not being respected for project coverage settings in Codecov.yml

Description

In our .codecov.yml, we are trying to split up the project to look at the app, the unit tests, and the UI tests separately. As you can see, we tried including default: false under the project, but we are still getting failures in the PR related to that.

Repository

Private, but latest commit is here.

Versions

macOS 10.15, Safari 13.0, Codecov 1.1.6

Additional Information

Entire .codecov.yml file contents:

coverage:
  status:
    project:
      default: false  # disable the default status that measures entire project
      unitTests:
        target: 90
        paths: 
          - "culture-cloud-iosTests"
      uiTests:
        target: 90
        paths:
         - "culture-cloud-iosUITests"
      app:
        target: auto
        threshold: 2
        paths: 
          - "culture-cloud-ios"

ignore:
  - "culture-cloud-iosTests/Matchers.swift"
  - "culture-cloud-ios/**/**/*_Previews.swift"

Hmm, maybe it just takes time. It seems to be showing up properly now.

@benjaminsnorris glad this is working correctly. Out of curiosity, roughly how long did it take? I’d like to investigate a little more.

It seems as it was at least half an hour or more from when it originally posted. The first time I looked, the checks in the PR showed codecov/project and had the coverage amount, which was causing a failure. When I looked later, codecov/project was gone, and codecov/project/app was there and passing.

Hey @benjaminsnorris – are you using the Flags feature?

That may help further define these split tests.

Also, are you running your full coverage suite everytime? If not, you should consider using Carryforward Flags as well for partial test runs. https://docs.codecov.io/docs/carryforward-flagshttps://docs.codecov.io/docs/carryforward-flags

Thanks @jerrod. We are not using Flags right now, so we will look into that.

And we are running the full coverage suite every time as of now.