Remove old carryforward flag

Description

We have an automatic carryforward flag setup in a monorepo.
When we have remove a project the flag is carried forward indefinitely and we are unsure how to disable it.

For example the application-templates-party-letter flag https://codecov.io/gh/island-is/island.is/commit/41d3d9d577b13d49e44cd358806d5ed926c25234/build is over a month old.

It messes up with the absolute change percentage of the code coverage.

CI/CD URL

Please provide a link to the CI/CD run.

Codecov Output

Please provide the full output of running the uploader on your CI/CD. This will typically have the Codecov logo as ASCII.

The lines are not in order for some reason.

Uploading coverage report /runner/_work/island.is/island.is/coverage/apps/web/coverage-final.json
[2022-01-11T13:31:49.521Z] ['info'] 
     _____          _
    / ____|        | |
   | |     ___   __| | ___  ___ _____   __
   | |    / _ \ / _` |/ _ \/ __/ _ \ \ / /
   | |___| (_) | (_| |  __/ (_| (_) \ V /
    \_____\___/ \__,_|\___|\___\___/ \_/

  Codecov report uploader 0.1.13
[2022-01-11T13:31:49.530Z] ['info'] => Project root located at: /runner/_work/island.is/island.is
[2022-01-11T13:31:49.535Z] ['info'] ->  Token found by arguments
[2022-01-11T13:31:49.553Z] ['info'] Searching for coverage files...
[2022-01-11T13:31:49.840Z] ['info'] => Found 1 possible coverage files:
  /runner/_work/island.is/island.is/coverage/apps/web/coverage-final.json
[2022-01-11T13:31:49.840Z] ['info'] Processing /runner/_work/island.is/island.is/coverage/apps/web/coverage-final.json...
[2022-01-11T13:31:49.893Z] ['info'] Detected GitHub Actions as the CI provider.
[2022-01-11T13:31:49.903Z] ['info'] Pinging Codecov: https://codecov.io/upload/v4?package=uploader-0.1.13&token=*******&branch=fixing-typo-for-dd-rum&build=1682656639&build_url=https%3A%2F%2Fgithub.com%2Fisland-is%2Fisland.is%2Factions%2Fruns%2F1682656639&commit=7cc2297c3a02515205cabb0a7710d848254d9738&job=Monorepo+pipeline+-+pull+request&pr=6208&service=github-actions&slug=island-is%2Fisland.is&name=&tag=&flags=web&parent=
[2022-01-11T13:31:50.341Z] ['info'] Uploading...
[2022-01-11T13:31:50.843Z] ['info'] {"status":"success","resultURL":"https://codecov.io/github/island-is/island.is/commit/41d3d9d577b13d49e44cd358806d5ed926c25234"}
Uploading coverage report /runner/_work/island.is/island.is/coverage/apps/auth-admin-web/coverage-final.json
[2022-01-11T13:31:51.321Z] ['info'] 
     _____          _
    / ____|        | |
   | |     ___   __| | ___  ___ _____   __
   | |    / _ \ / _` |/ _ \/ __/ _ \ \ / /
   | |___| (_) | (_| |  __/ (_| (_) \ V /
    \_____\___/ \__,_|\___|\___\___/ \_/

  Codecov report uploader 0.1.13
[2022-01-11T13:31:51.332Z] ['info'] => Project root located at: /runner/_work/island.is/island.is
[2022-01-11T13:31:51.334Z] ['info'] ->  Token found by arguments
[2022-01-11T13:31:51.349Z] ['info'] Searching for coverage files...
[2022-01-11T13:31:51.592Z] ['info'] => Found 1 possible coverage files:
  /runner/_work/island.is/island.is/coverage/apps/auth-admin-web/coverage-final.json
[2022-01-11T13:31:51.592Z] ['info'] Processing /runner/_work/island.is/island.is/coverage/apps/auth-admin-web/coverage-final.json...
[2022-01-11T13:31:51.639Z] ['info'] Detected GitHub Actions as the CI provider.
[2022-01-11T13:31:51.648Z] ['info'] Pinging Codecov: https://codecov.io/upload/v4?package=uploader-0.1.13&token=*******&branch=fixing-typo-for-dd-rum&build=1682656639&build_url=https%3A%2F%2Fgithub.com%2Fisland-is%2Fisland.is%2Factions%2Fruns%2F1682656639&commit=7cc2297c3a02515205cabb0a7710d848254d9738&job=Monorepo+pipeline+-+pull+request&pr=6208&service=github-actions&slug=island-is%2Fisland.is&name=&tag=&flags=auth-admin-web&parent=
[2022-01-11T13:31:52.001Z] ['info'] Uploading...
[2022-01-11T13:31:52.478Z] ['info'] {"status":"success","resultURL":"https://codecov.io/github/island-is/island.is/commit/41d3d9d577b13d49e44cd358806d5ed926c25234"}

Expected Results

I expect to get correct overall coverage.

Actual Results

Deleted projects that have flags are carried forward and give us a wrong overall coverage.

@dabbeg unfortunately there’s not an easy way to do this, but there is a way

  1. Remove the carryforward: true from the codecov.yml here.
  2. Commit the above to main.
  3. On a separate branch (or main) run your entire test suite with all flags necessary going forward
  4. Commit the above to main.
  5. Add back in carryforward: true to the codecov.yml
  6. Rebase any outstanding PRs to the new HEAD of main

Let me know if that works for you.