I have recently set up our Codecov GitHub app integration (as discussed here), however now I realize that this comes with automated comments posted by the Codecov bot:
This is even if the the base branch (main) and the head branch (prb/deps-and-tests) both have comment: false in the codecov.yml file. Not sure if relevant but head branch has been recently rebased from the base.
@PaulRBerg I think something strange is happening, I don’t see that PR in the Codecov UI or that commit (dca6226) on the main or prb/deps-and-tests branch. Am I missing something here? Maybe a full commit SHA would be helpful
At any rate, this bug also happens in other repo of mine, which is open-source. See this PR - the Codecov bot already left a couple comments, which I deleted using my admin rights. This in spite of the Codecov config having comment: false (in both the base and the head branch).
For pull 322, there were 2 commits d3d0e4 and d01cc. Neither of those commits was sent notifications (the comment). However, you initially had dca6226 which did NOT yet have the comment: false in the YAML. This is why you have the PR comment on that pull request. You should not have it for future PRs.
The 2nd PR is difficult to debug due to all the rebases and the delete comment. I would need to get the commit SHA that actually posted a comment.
Oh, shoot, I think you’re right. Thanks for investigating this, @tom! I’m sorry for my clumsiness here, I should have realized that the comments were associated with an older commit.
Regarding the 2nd PR, it’s all clear now. The contributor who opened the PR pushed a few commits a few hours ago, and they did not trigger a new comment by the bot!