Before submitting a topic, please confirm the following
I have searched for similar issues before creating this topic.
I have verified that my repository is using the Codecov GitHub app, if using GitHub
I have validated my codecov.yaml configuration file.
I have filled out the below sections to the best of my ability.
Description
Any codecov runs on the repository authelia/authelia seem to only show two files being uploaded whereas CI runs clearly are uploading many more files.
However, it should be called out that this isn’t limited to the above PR/branch, all commits seem to be experiencing this same problem.
You can click through any commit on the repo, including HEAD @ master:
CI/CD URL
Codecov Output
There are several of these runs, you can find them in the Unit Test Step:
And every single step that is labelled with the suffix Suite:
I’ve only pasted the first two above.
Expected Results
Codecov should allow downloading and analysis of all coverage files that have been uploaded for the specific suites and frontend/backend definitions.
Actual Results
There seems to be a limit of only 2 files appearing in codecov when inspecting a specific commit, these also seem to be completely random when inspecting the results of some of the historical commits:
Includes the frontend coverage for the Docker suite and backend coverage for the NetworkACL suite.
Includes the backend coverage for the MySQL suite and frontend coverage for the HighAvailability suite.
@tom apologies I should have been more clear, I mean I can only see two files/uploads that are uploaded/processed for coverage according to the Codecov interface.
This makes troubleshooting any indirect changes quite difficult and I’m not sure if it’s actually picked up and processed all the uploaded files.
@nighttah, that’s because you are only uploading twice to Codecov, as far as I can tell here. Each of those uploads has either 1 or 3 files. If you want to split that up, you will need to upload each file separately.
Almost all of those suites upload two sets of coverage (one for the backend and one for the frontend).
If you look at the image in my previous post you can see that the two files that have been uploaded are HAProxy and Envoy, and it’s picked up the backend coverage from one and the frontend coverage from the other.
The specific job on the build you referenced is for the Unit Test and that also results in a set of coverage for the frontend/backend which isn’t even represented.
All the files are being uploaded but codecov is only representing a maximum of 2 uploads instead of 2x Unit Test step (backend/frontend) and 2x for every suite (there are a few exceptions in some suites there will only be 1x).
@nightah, ok, I need some clarification as I’m not really familiar with your setup.
Can you provide a single commit SHA, the number of uploads you expect, the name of each upload (e.g. HAProxy), and a link to the CI for each of those uploads? Sorry for making you do some work here, but I’m just not groking everything here.
@nightah, I’m sorry, I guess I’m not following. I appreciate all these links, but I’m seeing 48 uploads for each of the past 7 days worth of commits on the master branch. Am i still missing something?
@tom now I look like an idiot but I can only surmise that something has changed.
All of the older commits that I was looking at were limited to only 2 successful uploads.
Even the screenshot I provided in my earlier post:
This was in relation to the commit that you had referenced in your previous screenshot: Codecov
Now is showing 48 files, however back when I screenshotted it (and that was 15 hours after the uploads) it was only showing 2 uploads.
I guess we should be able to close this off now, seeing as the number of uploads is representative of what I would expect, but nothing has changed on our side and these files magically appeared some time later.
