Coverage seems to be off

Support
,
1

Description

When I run my tests, both locally and on Travis CI, I get a coverage report, but when the data is sent to codecov (via the codecov package), the report codecov presents is suddenly different. Coverage drops by 10% or so, and the report I see on codecov doesn’t match the HTML report I get running the tests.

Repository

https://github.com/sendahug/send-hug-frontend/tree/webpack-replace

(Webpack replace branch specifically, although the reports on the Dev branch never matched either, but the difference was significantly smaller.)

CI/CD

Travis CI.

Uploader

I’ve tried both the codecov NPM package and the bash uploader. Same results.

Commit SHAs

For example: 5650269188dd66ea59d82a606ec06d9c7fb79ff7, 4e41c95bfa46bcfd655edc2b428f375feb7984bc, b872248dd9f4eaf0d0e6ecca3b8d94b6f04c7af2

Codecov YAML

None.

Codecov Output

Seems to be too long to post here, but you can see it here: Travis CI - Test and Deploy with Confidence

Additional Information

Nothing I can think of.

2

Hi @shirblc, could you provide the html summary?

3

Hi @tom, I wasn’t sure how to post it here so I uploaded it to my Drive; I hope it’s okay.

Here’s the link.

4

Hi @shirblc, thanks for this! I think I figured out why it looks off. The most important thing is that Codecov takes into account branch coverage and does NOT consider a partially covered as hit.

For example, we can take a look at src/app/components/aboutApp/aboutApp.component.ts. This is what we see in the HTML

image
image1279×92 18.7 KB

Take particular note of the line coverage of 13/13.

image
image2346×204 17.4 KB

In Codecov, we see 13 total lines here too, but 5 are partially covered. Where did they come from?

Digging into the raw lcov.info file, we see

image
image486×802 74.5 KB

BRDA specific branch coverage. There are 29 statements here (as matches the HTML branches). If you see lines marked with a 0 at the end, it means that branch was not taken as described in the docs (BRDA:<line number>,<block number>,<branch number>,<taken>)

So what does this mean? Codecov interprets your branch coverage and thus you see coverage seem to be off.