Coverage dropped a lot with a commit which only contains untracked files

Support
#1

Description

We’re using Codecov on a Rails application. Recently, we saw the code coverage dropped a lot since a commit, which only contains file marked as untracked. And we also see the coverage reported by simplecov stays the same.

Repository

https://codecov.io/gh/mockingbot/imock

Versions

Chrome 73 on macOS 14.4.3

Additional Information

We first saw the decrease in this commit https://codecov.io/gh/mockingbot/imock/commit/b42def71835ed8d0bda1f9715250efacd3b0883d.

Here’s the code we used in our test_helper.rb to invoke the codecov

require 'simplecov'
SimpleCov.start 'rails' do
  add_filter '/app/admin/'
end
require 'codecov'
SimpleCov.formatter = SimpleCov::Formatter::Codecov
#2

Can anyone help us out with this problem? Please

#3

Hey! Thanks for your patience.

Is the coverage report generated for the commit running your full test suite? If not / only running partial testing, Codecov doesn’t know how to assume coverage on the rest of the report.

#4

I think it has tested over the whole test suits, but not sure about that, is there something I can confirm this?