Nearly all PRs now showing "Changes found in between (pseudo...base) which prevent comparing this pull request."

Description

For the Spack project, nearly all the pull requests recently started getting errors like this:

The PRs show Codecov coverage numbers, but when I click on details I get the error above and can’t look at the diff.

Commit SHAs

There are a lot of commit SHAs for this – you can click the Codecov link on most PRs to get to them. But for this one I believe they’re: 0007ed7…e568564

Repository

CI/CD or Build URL

Uploader

GitHub Actions. See, e.g.:

There are several uses of the action for different types of tests.

Codecov Output

/usr/bin/bash codecov.sh -n  -F unittests,linux,clingo -Q github-action-v1.5.2 -C 9a6d15b6f7720af8bc56df2545a9ea85a7f9225f
8

9
  _____          _
10
 / ____|        | |
11
| |     ___   __| | ___  ___ _____   __
12
| |    / _ \ / _` |/ _ \/ __/ _ \ \ / /
13
| |___| (_) | (_| |  __/ (_| (_) \ V /
14
 \_____\___/ \__,_|\___|\___\___/ \_/
15
                              Bash-1.0.3
16

17

18
==> git version 2.32.0 found
19
==> curl 7.68.0 (x86_64-pc-linux-gnu) libcurl/7.68.0 OpenSSL/1.1.1f zlib/1.2.11 brotli/1.0.7 libidn2/2.2.0 libpsl/0.21.0 (+libidn2/2.2.0) libssh/0.9.3/openssl/zlib nghttp2/1.40.0 librtmp/2.3
20
Release-Date: 2020-01-08
21
Protocols: dict file ftp ftps gopher http https imap imaps ldap ldaps pop3 pop3s rtmp rtsp scp sftp smb smbs smtp smtps telnet tftp 
22
Features: AsynchDNS brotli GSS-API HTTP2 HTTPS-proxy IDN IPv6 Kerberos Largefile libz NTLM NTLM_WB PSL SPNEGO SSL TLS-SRP UnixSockets
23
==> GitHub Actions detected.
24
    Env vars used:
25
      -> GITHUB_ACTIONS:    true
26
      -> GITHUB_HEAD_REF:   fixes/spack-fetch
27
      -> GITHUB_REF:        refs/pull/24686/merge
28
      -> GITHUB_REPOSITORY: spack/spack
29
      -> GITHUB_RUN_ID:     995252835
30
      -> GITHUB_SHA:        0991678c00dc3fb2cb02f7e05e357a529e5e01d8
31
      -> GITHUB_WORKFLOW:   linux tests
32
    project root: .
33
    Yaml found at: .codecov.yml
34
==> Running gcov in . (disable via -X gcov)
35
==> Searching for coverage reports in:
36
    + .
37
    -> Found 13 reports
38
==> Detecting git/mercurial file structure
39
==> Reading reports
40
    + ./coverage/ld/cobertura.xml bytes=9312
41
    + ./coverage/ld/coverage.json bytes=329
42
    + ./coverage/c++/cobertura.xml bytes=9186
43
    + ./coverage/c++/coverage.json bytes=330
44
    + ./coverage/kcov-merged/cobertura.xml bytes=9158
45
    + ./coverage/kcov-merged/coverage.json bytes=329
46
    + ./coverage/cpp/cobertura.xml bytes=9179
47
    + ./coverage/cpp/coverage.json bytes=330
48
    + ./coverage/cc/cobertura.xml bytes=9334
49
    + ./coverage/cc/coverage.json bytes=329
50
    + ./coverage/fc/cobertura.xml bytes=9210
51
    + ./coverage/fc/coverage.json bytes=329
52
    + ./coverage.xml bytes=1738513
53
==> Appending adjustments
54
    https://docs.codecov.io/docs/fixing-reports
55
    + Found adjustments
56
==> Gzipping contents
57
        164K	/tmp/codecov.4nCAN4.gz
58
==> Uploading reports
59
    url: https://codecov.io
60
    query: branch=fixes%2Fspack-fetch&commit=9a6d15b6f7720af8bc56df2545a9ea85a7f9225f&build=995252835&build_url=http%3A%2F%2Fgithub.com%2Fspack%2Fspack%2Factions%2Fruns%2F995252835&name=&tag=&slug=spack%2Fspack&service=github-actions&flags=unittests,linux,clingo&pr=24686&job=linux%20tests&cmd_args=n,F,Q,C
61
->  Pinging Codecov
62
https://codecov.io/upload/v4?package=github-action-v1.5.2-1.0.3&token=secret&branch=fixes%2Fspack-fetch&commit=9a6d15b6f7720af8bc56df2545a9ea85a7f9225f&build=995252835&build_url=http%3A%2F%2Fgithub.com%2Fspack%2Fspack%2Factions%2Fruns%2F995252835&name=&tag=&slug=spack%2Fspack&service=github-actions&flags=unittests,linux,clingo&pr=24686&job=linux%20tests&cmd_args=n,F,Q,C
63
->  Uploading to
64
https://storage.googleapis.com/codecov/v4/raw/2021-07-03/72315F302C1BF0F15218ABDE2177D8C7/9a6d15b6f7720af8bc56df2545a9ea85a7f9225f/59cc3159-541f-4bed-b377-ec0eb9bd1f3c.txt?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GOOG1EKKHVKCKHW7KBCGM7IHR55T63V2PAVJWLVFNITJHDU5G6R5IRN3LMWJA%2F20210703%2FUS%2Fs3%2Faws4_request&X-Amz-Date=20210703T014537Z&X-Amz-Expires=10&X-Amz-SignedHeaders=host&X-Amz-Signature=7bceb6397d2590bd49127665c210cdc09e9c35f17bb763c2bd7a8f929d78f301
65
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
66
                                 Dload  Upload   Total   Spent    Left  Speed
67

68
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
69
100  162k    0     0  100  162k      0   666k --:--:-- --:--:-- --:--:--  666k
70
    -> Reports have been successfully queued for processing at https://codecov.io/github/spack/spack/commit/9a6d15b6f7720af8bc56df2545a9ea85a7f9225f

Expected Results

I expect the results of most PRs to be viewable on the Codecov site. It looks like most are broken somehow here: Codecov

Actual Results

Most PRs are broken and can’t display coverage results.

Additional Information

I recently disabled GitHub annotations on PRs, but I’m not sure if/how this could’ve caused this issue:

@tgamblin we made a change here to fix this issue. Have you been encountering it since?

So it looks like they now all say “Missing base report”. I guess that means the error was on our side but the message on the Codecov side was bad? I can see about fixing that, but just want to make sure we’re doing something wrong first.