Coverage dropped a lot with a commit which only contains untracked files


We’re using Codecov on a Rails application. Recently, we saw the code coverage dropped a lot since a commit, which only contains file marked as untracked. And we also see the coverage reported by simplecov stays the same.



Chrome 73 on macOS 14.4.3

Additional Information

We first saw the decrease in this commit

Here’s the code we used in our test_helper.rb to invoke the codecov

require 'simplecov'
SimpleCov.start 'rails' do
  add_filter '/app/admin/'
require 'codecov'
SimpleCov.formatter = SimpleCov::Formatter::Codecov

Can anyone help us out with this problem? Please

Hey! Thanks for your patience.

Is the coverage report generated for the commit running your full test suite? If not / only running partial testing, Codecov doesn’t know how to assume coverage on the rest of the report.

I think it has tested over the whole test suits, but not sure about that, is there something I can confirm this?