Nearly all PRs now showing "Changes found in between (pseudo...base) which prevent comparing this pull request."

Support
1

Description

For the Spack project, nearly all the pull requests recently started getting errors like this:

Screen Shot 2021-07-02 at 10.06.19 PM
Screen Shot 2021-07-02 at 10.06.19 PM952×794 44.2 KB

The PRs show Codecov coverage numbers, but when I click on details I get the error above and can’t look at the diff.

Commit SHAs

There are a lot of commit SHAs for this – you can click the Codecov link on most PRs to get to them. But for this one I believe they’re: 0007ed7…e568564

Repository

CI/CD or Build URL

Uploader

GitHub Actions. See, e.g.:

There are several uses of the action for different types of tests.

Codecov Output

/usr/bin/bash codecov.sh -n  -F unittests,linux,clingo -Q github-action-v1.5.2 -C 9a6d15b6f7720af8bc56df2545a9ea85a7f9225f
8

9
  _____          _
10
 / ____|        | |
11
| |     ___   __| | ___  ___ _____   __
12
| |    / _ \ / _` |/ _ \/ __/ _ \ \ / /
13
| |___| (_) | (_| |  __/ (_| (_) \ V /
14
 \_____\___/ \__,_|\___|\___\___/ \_/
15
                              Bash-1.0.3
16

17

18
==> git version 2.32.0 found
19
==> curl 7.68.0 (x86_64-pc-linux-gnu) libcurl/7.68.0 OpenSSL/1.1.1f zlib/1.2.11 brotli/1.0.7 libidn2/2.2.0 libpsl/0.21.0 (+libidn2/2.2.0) libssh/0.9.3/openssl/zlib nghttp2/1.40.0 librtmp/2.3
20
Release-Date: 2020-01-08
21
Protocols: dict file ftp ftps gopher http https imap imaps ldap ldaps pop3 pop3s rtmp rtsp scp sftp smb smbs smtp smtps telnet tftp 
22
Features: AsynchDNS brotli GSS-API HTTP2 HTTPS-proxy IDN IPv6 Kerberos Largefile libz NTLM NTLM_WB PSL SPNEGO SSL TLS-SRP UnixSockets
23
==> GitHub Actions detected.
24
    Env vars used:
25
      -> GITHUB_ACTIONS:    true
26
      -> GITHUB_HEAD_REF:   fixes/spack-fetch
27
      -> GITHUB_REF:        refs/pull/24686/merge
28
      -> GITHUB_REPOSITORY: spack/spack
29
      -> GITHUB_RUN_ID:     995252835
30
      -> GITHUB_SHA:        0991678c00dc3fb2cb02f7e05e357a529e5e01d8
31
      -> GITHUB_WORKFLOW:   linux tests
32
    project root: .
33
    Yaml found at: .codecov.yml
34
==> Running gcov in . (disable via -X gcov)
35
==> Searching for coverage reports in:
36
    + .
37
    -> Found 13 reports
38
==> Detecting git/mercurial file structure
39
==> Reading reports
40
    + ./coverage/ld/cobertura.xml bytes=9312
41
    + ./coverage/ld/coverage.json bytes=329
42
    + ./coverage/c++/cobertura.xml bytes=9186
43
    + ./coverage/c++/coverage.json bytes=330
44
    + ./coverage/kcov-merged/cobertura.xml bytes=9158
45
    + ./coverage/kcov-merged/coverage.json bytes=329
46
    + ./coverage/cpp/cobertura.xml bytes=9179
47
    + ./coverage/cpp/coverage.json bytes=330
48
    + ./coverage/cc/cobertura.xml bytes=9334
49
    + ./coverage/cc/coverage.json bytes=329
50
    + ./coverage/fc/cobertura.xml bytes=9210
51
    + ./coverage/fc/coverage.json bytes=329
52
    + ./coverage.xml bytes=1738513
53
==> Appending adjustments
54
    https://docs.codecov.io/docs/fixing-reports
55
    + Found adjustments
56
==> Gzipping contents
57
        164K	/tmp/codecov.4nCAN4.gz
58
==> Uploading reports
59
    url: https://codecov.io
60
    query: branch=fixes%2Fspack-fetch&commit=9a6d15b6f7720af8bc56df2545a9ea85a7f9225f&build=995252835&build_url=http%3A%2F%2Fgithub.com%2Fspack%2Fspack%2Factions%2Fruns%2F995252835&name=&tag=&slug=spack%2Fspack&service=github-actions&flags=unittests,linux,clingo&pr=24686&job=linux%20tests&cmd_args=n,F,Q,C
61
->  Pinging Codecov
62
https://codecov.io/upload/v4?package=github-action-v1.5.2-1.0.3&token=secret&branch=fixes%2Fspack-fetch&commit=9a6d15b6f7720af8bc56df2545a9ea85a7f9225f&build=995252835&build_url=http%3A%2F%2Fgithub.com%2Fspack%2Fspack%2Factions%2Fruns%2F995252835&name=&tag=&slug=spack%2Fspack&service=github-actions&flags=unittests,linux,clingo&pr=24686&job=linux%20tests&cmd_args=n,F,Q,C
63
->  Uploading to
64
https://storage.googleapis.com/codecov/v4/raw/2021-07-03/72315F302C1BF0F15218ABDE2177D8C7/9a6d15b6f7720af8bc56df2545a9ea85a7f9225f/59cc3159-541f-4bed-b377-ec0eb9bd1f3c.txt?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GOOG1EKKHVKCKHW7KBCGM7IHR55T63V2PAVJWLVFNITJHDU5G6R5IRN3LMWJA%2F20210703%2FUS%2Fs3%2Faws4_request&X-Amz-Date=20210703T014537Z&X-Amz-Expires=10&X-Amz-SignedHeaders=host&X-Amz-Signature=7bceb6397d2590bd49127665c210cdc09e9c35f17bb763c2bd7a8f929d78f301
65
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
66
                                 Dload  Upload   Total   Spent    Left  Speed
67

68
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
69
100  162k    0     0  100  162k      0   666k --:--:-- --:--:-- --:--:--  666k
70
    -> Reports have been successfully queued for processing at https://codecov.io/github/spack/spack/commit/9a6d15b6f7720af8bc56df2545a9ea85a7f9225f

Expected Results

I expect the results of most PRs to be viewable on the Codecov site. It looks like most are broken somehow here: Codecov

Actual Results

Most PRs are broken and can’t display coverage results.

Additional Information

I recently disabled GitHub annotations on PRs, but I’m not sure if/how this could’ve caused this issue:

2

@tgamblin we made a change here to fix this issue. Have you been encountering it since?

3

So it looks like they now all say “Missing base report”. I guess that means the error was on our side but the message on the Codecov side was bad? I can see about fixing that, but just want to make sure we’re doing something wrong first.

4

Hi @tgamblin we’ve pushed a fix for this that should have resolved the Missing base report issue. Let me know if it looks good for you!