Coverage Reports are off/incorrect

Support
1

Please check the troubleshooting guide before creating a ticket.
All fields below are required.

Description

When running CodeCov the coverage report is missing files and/or changing inconsistently. The latest example was that I added several new unit tests (changed nothing else). However Coverage remained exactly the same. There have been other times that I have needed new code without tests and coverage has increased. I use CodeCov with CircleCI so I’m not sure if that is related to the issue.

Commit SHAs

Please include the commit SHA(s)
0844c394a473e95cb0e59d220d21110c276dae54

Repository

CI/CD or Build URL

https://app.circleci.com/pipelines/github/AIStream-Peelout
Codecov.

Uploader

bash

Codecov Output

I’m not sure what this is.

Expected Results

Expected coverage to increase and the new files to appear in CodeCov.

Actual Results

Coverage remained the same and newly added files did not appear.

Additional Information

It probably has something to due with the CircleCI setup flow-forecast/config.yml at master · AIStream-Peelout/flow-forecast · GitHub I’m not sure how to fix it though. We have multiple tests each loading a coverage report.

2

@isaacmg, I see you are using an older version of the orb, could you try updating and seeing if the issue persists?

3

@isaacmg, just kidding, it looks like you are just calling the bash uploader directly. One quick note, you only need to call it once here at the end

coverage run -m unittest -v tests/test_meta_pr.py
            bash <(curl -s https://codecov.io/bash) -cF python
            coverage run -m unittest -v tests/time_model_test.py
            bash <(curl -s https://codecov.io/bash) -cF python
            coverage run -m unittest -v tests/model_config_tests.py
            bash <(curl -s https://codecov.io/bash) -cF python
            coverage run -m unittest -v tests/data_loader_tests.py
            bash <(curl -s https://codecov.io/bash) -cF python
            coverage run -m unittest -v tests/test_da_rnn.py
            bash <(curl -s https://codecov.io/bash) -cF python
            coverage run -m unittest -v tests/test_loss.py
            bash <(curl -s https://codecov.io/bash) -cF python
            coverage run -m unittest -v tests/test_merging_models.py
            bash <(curl -s https://codecov.io/bash) -cF python
            coverage run -m unittest -v tests/pytorc_train_tests.py

I would still like to see the Codecov output. You are looking for the output of running that bash command in your CI.