Coverage dropped a lot with a commit which only contains untracked files

Support
1

Description

We’re using Codecov on a Rails application. Recently, we saw the code coverage dropped a lot since a commit, which only contains file marked as untracked. And we also see the coverage reported by simplecov stays the same.

Repository

Versions

Chrome 73 on macOS 14.4.3

Additional Information

We first saw the decrease in this commit Codecov.

Here’s the code we used in our test_helper.rb to invoke the codecov

require 'simplecov'
SimpleCov.start 'rails' do
  add_filter '/app/admin/'
end
require 'codecov'
SimpleCov.formatter = SimpleCov::Formatter::Codecov
2

Can anyone help us out with this problem? Please

3

Hey! Thanks for your patience.

Is the coverage report generated for the commit running your full test suite? If not / only running partial testing, Codecov doesn’t know how to assume coverage on the rest of the report.

4

I think it has tested over the whole test suits, but not sure about that, is there something I can confirm this?