Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

0.931: pytest is failing mostly by compiler [-Werror=cpp] errors #11942

Closed
kloczek opened this issue Jan 9, 2022 · 2 comments
Closed

0.931: pytest is failing mostly by compiler [-Werror=cpp] errors #11942

kloczek opened this issue Jan 9, 2022 · 2 comments
Labels
bug mypy got something wrong topic-stubtest topic-tests

Comments

@kloczek
Copy link

kloczek commented Jan 9, 2022

I'm trying to package your module as an rpm package. So I'm using the typical PEP517 based build, install and test cycle used on building packages from non-root account.

  • python3 -sBm build -w --no-isolation
  • because I'm calling build with --no-isolation I'm using during all processes only locally installed modules
  • install .whl file in </install/prefix>
  • run pytest with PYTHONPATH pointing to sitearch and sitelib inside </install/prefix>

Bug Report
Looks like pytest is failing in some units which ar etrying to compile something by [-Werror=cpp] compiler errors.

To Reproduce
I'm almost sure that it may be connected somehow to /usr/include/features.h files from devel glibc used in Fedora or compiler version (gcc 11.2.1)

Expected Behavior
pytest should not fail.

Actual Behavior
Just only parts from from pytest output

+ cd mypy-0.931
+ CFLAGS='-O2 -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -fstack-protector-strong -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1 -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -fdata-sections -ffunction-sections -flto=auto -flto-partition=none'
+ CXXFLAGS='-O2 -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -fstack-protector-strong -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1 -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -fdata-sections -ffunction-sections -flto=auto -flto-partition=none'
+ FFLAGS='-O2 -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -fstack-protector-strong -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1 -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -fdata-sections -ffunction-sections -flto=auto -flto-partition=none -I/usr/lib64/gfortran/modules'
+ FCFLAGS='-O2 -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -fstack-protector-strong -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1 -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -fdata-sections -ffunction-sections -flto=auto -flto-partition=none -I/usr/lib64/gfortran/modules'
+ LDFLAGS='-Wl,-z,relro -Wl,--as-needed -Wl,--gc-sections -Wl,-z,now -specs=/usr/lib/rpm/redhat/redhat-hardened-ld -flto=auto -flto-partition=none -fuse-linker-plugin -Wl,--build-id=sha1'
+ CC=/usr/bin/gcc
+ CXX=/usr/bin/g++
+ FC=/usr/bin/gfortran
+ AR=/usr/bin/gcc-ar
+ NM=/usr/bin/gcc-nm
+ RANLIB=/usr/bin/gcc-ranlib
+ export CFLAGS CXXFLAGS FFLAGS FCFLAGS LDFLAGS CC CXX FC AR NM RANLIB
+ PATH=/home/tkloczko/rpmbuild/BUILDROOT/python-mypy-0.931-2.fc35.x86_64/usr/bin:/home/tkloczko/.local/bin:/home/tkloczko/bin:/usr/bin:/usr/sbin:/usr/local/sbin
+ PYTHONDONTWRITEBYTECODE=1
+ SETUPTOOLS_SCM_PRETEND_VERSION=0.931
+ PYTHONPATH=/home/tkloczko/rpmbuild/BUILDROOT/python-mypy-0.931-2.fc35.x86_64/usr/lib64/python3.8/site-packages:/home/tkloczko/rpmbuild/BUILDROOT/python-mypy-0.931-2.fc35.x86_64/usr/lib/python3.8/site-packages
+ /usr/bin/pytest -ra
============================= test session starts ==============================
platform linux -- Python 3.8.12, pytest-6.2.5, py-1.11.0, pluggy-1.0.0
rootdir: /home/tkloczko/rpmbuild/BUILD/mypy-0.931, configfile: pytest.ini, testpaths: mypy/test, mypyc/test
plugins: forked-1.4.0, cov-3.0.0, xdist-2.5.0
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [10056] / gw1 [10056] / gw2 [10056] / gw3 [10056] / gw4 [10056] / gw5 [10056]

..............................................s......................... [  0%]
........................................................................ [  1%]
........................................................................ [  2%]
........................................................................ [  2%]
........................................................................ [  3%]
......................................................................... [  4%]
........................................................................ [  5%]
........................................................................ [  5%]
........................................................................ [  6%]
........................................................................ [  7%]
........................................................................ [  7%]
........................................................s...s........... [  8%]
........................................................................ [  9%]
...................................................s.................... [ 10%]
....................................................................s... [ 10%]
........................................................................ [ 11%]
........................................................................ [ 12%]
........................................................................ [ 12%]
........................................................................ [ 13%]
........................................................................ [ 14%]
........................................................................ [ 15%]
................s....................................................... [ 15%]
........................................................................ [ 16%]
........................................................................ [ 17%]
........................................................................ [ 17%]
........................................................................ [ 18%]
........................................................................ [ 19%]
........................................................................ [ 20%]
........................................................................ [ 20%]
........................................................................ [ 21%]
.....................................s.................................. [ 22%]
........................................................................ [ 22%]
........................................................................ [ 23%]
........................................................................ [ 24%]
........................................................................ [ 25%]
........................................................................ [ 25%]
........................................................................ [ 26%]
........................................................................ [ 27%]
........................................................................ [ 27%]
........................................................................ [ 28%]
........................................................................ [ 29%]
........................................................................ [ 30%]
........................................................................ [ 30%]
........................................................................ [ 31%]
........................................................................ [ 32%]
......................................................................... [ 32%]
........................................................................ [ 33%]
..............................s......................................... [ 34%]
........................................................................ [ 35%]
........................................................................ [ 35%]
........................................................................ [ 36%]
........................................................................ [ 37%]
........................................................................ [ 37%]
........................................................................ [ 38%]
........................................................................ [ 39%]
........................................................................ [ 40%]
........................................................................ [ 40%]
..............................s......................................... [ 41%]
........................................................................ [ 42%]
........................................................................ [ 42%]
........................................................................ [ 43%]
..................s..................................................... [ 44%]
........................................................................ [ 45%]
.................................ss..................................... [ 45%]
........................................................................ [ 46%]
........................................................................ [ 47%]
.............x......x.............................................s..... [ 47%]
........................................................................ [ 48%]
s....s...........................s...................................... [ 49%]
...........................s............................................ [ 50%]
........................................................................ [ 50%]
........................................................................ [ 51%]
........................................................................ [ 52%]
........................................................................ [ 53%]
........................................................................ [ 53%]
........................................................................ [ 54%]
.......s................................................................ [ 55%]
........................................................s.....s......... [ 55%]
.....s...........................s.......x...................s.......... [ 56%]
.................................x...................................sss [ 57%]
sssss......s..............s........x...................s................ [ 58%]
..............................s.......s................................. [ 58%]
.s........s..................s..................................sss..... [ 59%]
.s................................sss...........ssssss.s.ss............. [ 60%]
...........................s...............sss.ssssss....s.....ss....... [ 60%]
......s.............s..s............ss..........s.....s................. [ 61%]
.s.....ss............................................................... [ 62%]
.................................s..................ssssss.s....s.ssssss [ 63%]
sss.....................s.......s..........s......................ss.... [ 63%]
.......s......sss....s.s............s...s...............ssss.....ss.s... [ 64%]
ss.............s..........ss..............s..........s...........s..ssss [ 65%]
........sss..........sssss.ss.s......ss..s..s........................ss. [ 65%]
......s.................................................sssss........... [ 66%]
s..ssss...................s.................................s.....s..... [ 67%]
..............s.....s................s...............s........s...s....s [ 68%]
ss..s................................................................... [ 68%]
..........................s............................................. [ 69%]
........................s...............s.........sssssssssssss........s [ 70%]
sssssssssss.sssss.................ssssssssssssssss.........sssssssssssss [ 70%]
sss.................ssssssssssss...ss...ssssss.sss.sssss..s..s...sssssss [ 71%]
sssssss....ss...sssss.sssss.sssssssssssssssssss......................... [ 72%]
...s........................sss.....s...s................................ [ 73%]
........................................................................ [ 73%]
........................................................................ [ 74%]
......s................................................................. [ 75%]
......................................................s................. [ 75%]
........................................................................ [ 76%]
........................................................................ [ 77%]
........................................................................ [ 78%]
........................................................................ [ 78%]
........................................................................ [ 79%]
..................................................................s..... [ 80%]
........................................................................ [ 80%]
........................................................................ [ 81%]
......................................................FFFFFFFFFFFFFFFFFF [ 82%]
FFFFFF.F..F...s......................................................... [ 83%]
........................................................................ [ 83%]
........................................................................ [ 84%]
........................................................................ [ 85%]
........................................s............................... [ 85%]
........................................................................ [ 86%]
.s.......sss...........................s................................ [ 87%]
........s............................................................... [ 88%]
........................................................................ [ 88%]
........................................................................ [ 89%]
.......................................s..s............................. [ 90%]
........................................................................ [ 90%]
........................................................................ [ 91%]
........................................................................ [ 92%]
........................................................................ [ 93%]
...........................................................F..F...F..... [ 93%]
.F...F..FF..FFF.F.FFF.FF..FF.F.F.FF.F.FF.FFFF.FFF.FF.FF.FF..FFF.F.FF.FF. [ 94%]
F.FF.FF.FFFFFF.FFFFFF.F.F.F.FF.FFFFFFF.FFFFFFFFFFFFFFFFFFFFFFFFF.FFFFFFF [ 95%]
FFFFF.FF..FF.FFF.FFF.F.FFF.FF.FF.FFFF.FF.FF.FF..FF.FF.FFF.F.FFFFFFF.FFFF [ 95%]
FFFFFFF.FFFFFFFF..FFFFFFFFFFFFFFFFFFF.FFFFFFFFFFFFFFFFFFFFFF.FFFFFFFF.FF [ 96%]
FFFFFFFFFF.FFFFFFFFFFF.FxF.FFxFF.F.F.FFFFFFFFF.FFFFF.FF.sssFFsssFsFsssFF [ 97%]
ssssFFsssFFsFsFssFFsFFsssFFsFsFssFFsF.sFsFsFssFFsssFsFssFF.FsFsFFFF.FFFF [ 98%]
FFF.FFFFF.F...F.....F..F................................................ [ 98%]
........................................................................ [ 99%]
.............................................                            [100%]
=================================== FAILURES ===================================
________________________ StubtestUnit.test_arg_mismatch ________________________
[gw3] linux -- Python 3.8.12 /usr/bin/python3

args = (<mypy.test.teststubtest.StubtestUnit testMethod=test_arg_mismatch>,)
kwargs = {}
cases = [<mypy.test.teststubtest.Case object at 0x7f50e9ac3c40>, <mypy.test.teststubtest.Case object at 0x7f50e9ac35e0>, <mypy...c3610>, <mypy.test.teststubtest.Case object at 0x7f50e9ac3280>, <mypy.test.teststubtest.Case object at 0x7f50e9ac3f40>]
expected_errors = {'test_module.f2', 'test_module.f3', 'test_module.f4', 'test_module.f5'}
c = <mypy.test.teststubtest.Case object at 0x7f50e9ac3f40>
expected_error = 'test_module.f5', @py_assert1 = False
@py_format3 = "{'test_module'} == {'test_module...st_module.f5'}\n~Extra items in the left set:\n~'test_module'\n~Extra items in the..._module.f5'\n~'test_module.f2'\n~'test_module.f3'...\n~\n~...Full output truncated (2 lines hidden), use '-vv' to show"
@py_format5 = "test_module\n~\n>assert {'test_module'} == {'test_module...st_module.f5'}\n~Extra items in the left set:\n~'test_modu..._module.f5'\n~'test_module.f2'\n~'test_module.f3'...\n~\n~...Full output truncated (2 lines hidden), use '-vv' to show"
output = 'test_module\n', actual_errors = {'test_module'}

    def test(*args: Any, **kwargs: Any) -> None:
        cases = list(fn(*args, **kwargs))
        expected_errors = set()
        for c in cases:
            if c.error is None:
                continue
            expected_error = "{}.{}".format(TEST_MODULE_NAME, c.error)
            assert expected_error not in expected_errors, (
                "collect_cases merges cases into a single stubtest invocation; we already "
                "expect an error for {}".format(expected_error)
            )
            expected_errors.add(expected_error)
        output = run_stubtest(
            stub="\n\n".join(textwrap.dedent(c.stub.lstrip("\n")) for c in cases),
            runtime="\n\n".join(textwrap.dedent(c.runtime.lstrip("\n")) for c in cases),
            options=["--generate-allowlist"],
        )

        actual_errors = set(output.splitlines())
>       assert actual_errors == expected_errors, output
E       AssertionError: test_module
E
E       assert {'test_module'} == {'test_module...st_module.f5'}
E         Extra items in the left set:
E         'test_module'
E         Extra items in the right set:
E         'test_module.f4'
E         'test_module.f5'
E         'test_module.f2'
E         'test_module.f3'...
E
E         ...Full output truncated (2 lines hidden), use '-vv' to show

mypy/test/teststubtest.py:128: AssertionError
__________________________ StubtestUnit.test_arg_name __________________________
[gw3] linux -- Python 3.8.12 /usr/bin/python3

args = (<mypy.test.teststubtest.StubtestUnit testMethod=test_arg_name>,)
kwargs = {}
cases = [<mypy.test.teststubtest.Case object at 0x7f50e91454c0>, <mypy.test.teststubtest.Case object at 0x7f50e9145f40>, <mypy...b5220>, <mypy.test.teststubtest.Case object at 0x7f50e89b5e80>, <mypy.test.teststubtest.Case object at 0x7f50e89b5820>]
expected_errors = {'test_module.BadMethod.f', 'test_module.bad', 'test_module.bad_posonly'}
c = <mypy.test.teststubtest.Case object at 0x7f50e89b5820>
expected_error = 'test_module.BadMethod.f', @py_assert1 = False
@py_format3 = "{'test_module'} == {'test_module....bad_posonly'}\n~Extra items in the left set:\n~'test_module'\n~Extra items in the right set:\n~'test_module.bad_posonly'\n~'test_module.bad'\n~'test_module.BadMethod.f'\n~Use -v to get the full diff"
@py_format5 = "test_module\n~\n>assert {'test_module'} == {'test_module....bad_posonly'}\n~Extra items in the left set:\n~'test_modu...e right set:\n~'test_module.bad_posonly'\n~'test_module.bad'\n~'test_module.BadMethod.f'\n~Use -v to get the full diff"
output = 'test_module\n', actual_errors = {'test_module'}

    def test(*args: Any, **kwargs: Any) -> None:
        cases = list(fn(*args, **kwargs))
        expected_errors = set()
        for c in cases:
            if c.error is None:
                continue
            expected_error = "{}.{}".format(TEST_MODULE_NAME, c.error)
            assert expected_error not in expected_errors, (
                "collect_cases merges cases into a single stubtest invocation; we already "
                "expect an error for {}".format(expected_error)
            )
            expected_errors.add(expected_error)
        output = run_stubtest(
            stub="\n\n".join(textwrap.dedent(c.stub.lstrip("\n")) for c in cases),
            runtime="\n\n".join(textwrap.dedent(c.runtime.lstrip("\n")) for c in cases),
            options=["--generate-allowlist"],
        )

        actual_errors = set(output.splitlines())
>       assert actual_errors == expected_errors, output
E       AssertionError: test_module
E
E       assert {'test_module'} == {'test_module....bad_posonly'}
E         Extra items in the left set:
E         'test_module'
E         Extra items in the right set:
E         'test_module.bad_posonly'
E         'test_module.bad'
E         'test_module.BadMethod.f'
E         Use -v to get the full diff

mypy/test/teststubtest.py:128: AssertionError

[gw3] linux -- Python 3.8.12 /usr/bin/python3

args = (<mypy.test.teststubtest.StubtestUnit testMethod=test_arg_mismatch>,)
kwargs = {}
cases = [<mypy.test.teststubtest.Case object at 0x7f50e9ac3c40>, <mypy.test.teststubtest.Case object at 0x7f50e9ac35e0>, <mypy...c3610>, <mypy.test.teststubtest.Case object at 0x7f50e9ac3280>, <mypy.test.teststubtest.Case object at 0x7f50e9ac3f40>]
expected_errors = {'test_module.f2', 'test_module.f3', 'test_module.f4', 'test_module.f5'}
c = <mypy.test.teststubtest.Case object at 0x7f50e9ac3f40>
expected_error = 'test_module.f5', @py_assert1 = False
@py_format3 = "{'test_module'} == {'test_module...st_module.f5'}\nExtra items in the left set:\n'test_module'\nExtra items in the..._module.f5'\n'test_module.f2'\n~'test_module.f3'...\n~\n~...Full output truncated (2 lines hidden), use '-vv' to show"
@py_format5 = "test_module\n~\n>assert {'test_module'} == {'test_module...st_module.f5'}\nExtra items in the left set:\n'test_modu..._module.f5'\n~'test_module.f2'\n~'test_module.f3'...\n~\n~...Full output truncated (2 lines hidden), use '-vv' to show"
output = 'test_module\n', actual_errors = {'test_module'}

def test(*args: Any, **kwargs: Any) -> None:
    cases = list(fn(*args, **kwargs))
    expected_errors = set()
    for c in cases:
        if c.error is None:
            continue
        expected_error = "{}.{}".format(TEST_MODULE_NAME, c.error)
        assert expected_error not in expected_errors, (
            "collect_cases merges cases into a single stubtest invocation; we already "
            "expect an error for {}".format(expected_error)
        )
        expected_errors.add(expected_error)
    output = run_stubtest(
        stub="\n\n".join(textwrap.dedent(c.stub.lstrip("\n")) for c in cases),
        runtime="\n\n".join(textwrap.dedent(c.runtime.lstrip("\n")) for c in cases),
        options=["--generate-allowlist"],
    )

    actual_errors = set(output.splitlines())

  assert actual_errors == expected_errors, output

E AssertionError: test_module
E
E assert {'test_module'} == {'test_module...st_module.f5'}
E Extra items in the left set:
E 'test_module'
E Extra items in the right set:
E 'test_module.f4'
E 'test_module.f5'
E 'test_module.f2'
E 'test_module.f3'...
E
E ...Full output truncated (2 lines hidden), use '-vv' to show

mypy/test/teststubtest.py:128: AssertionError
__________________________ StubtestUnit.test_arg_name __________________________
[gw3] linux -- Python 3.8.12 /usr/bin/python3

args = (<mypy.test.teststubtest.StubtestUnit testMethod=test_arg_name>,)
kwargs = {}
cases = [<mypy.test.teststubtest.Case object at 0x7f50e91454c0>, <mypy.test.teststubtest.Case object at 0x7f50e9145f40>, <mypy...b5220>, <mypy.test.teststubtest.Case object at 0x7f50e89b5e80>, <mypy.test.teststubtest.Case object at 0x7f50e89b5820>]
expected_errors = {'test_module.BadMethod.f', 'test_module.bad', 'test_module.bad_posonly'}
c = <mypy.test.teststubtest.Case object at 0x7f50e89b5820>
expected_error = 'test_module.BadMethod.f', @py_assert1 = False
@py_format3 = "{'test_module'} == {'test_module....bad_posonly'}\nExtra items in the left set:\n'test_module'\nExtra items in the right set:\n'test_module.bad_posonly'\n~'test_module.bad'\n~'test_module.BadMethod.f'\nUse -v to get the full diff"
@py_format5 = "test_module\n\n>assert {'test_module'} == {'test_module....bad_posonly'}\nExtra items in the left set:\n'test_modu...e right set:\n~'test_module.bad_posonly'\n~'test_module.bad'\n~'test_module.BadMethod.f'\n~Use -v to get the full diff"
output = 'test_module\n', actual_errors = {'test_module'}

def test(*args: Any, **kwargs: Any) -> None:
    cases = list(fn(*args, **kwargs))
    expected_errors = set()
    for c in cases:
        if c.error is None:
            continue
        expected_error = "{}.{}".format(TEST_MODULE_NAME, c.error)
        assert expected_error not in expected_errors, (
            "collect_cases merges cases into a single stubtest invocation; we already "
            "expect an error for {}".format(expected_error)
        )
        expected_errors.add(expected_error)
    output = run_stubtest(
        stub="\n\n".join(textwrap.dedent(c.stub.lstrip("\n")) for c in cases),
        runtime="\n\n".join(textwrap.dedent(c.runtime.lstrip("\n")) for c in cases),
        options=["--generate-allowlist"],
    )

    actual_errors = set(output.splitlines())

  assert actual_errors == expected_errors, output

E AssertionError: test_module
E
E assert {'test_module'} == {'test_module....bad_posonly'}
E Extra items in the left set:
E 'test_module'
E Extra items in the right set:
E 'test_module.bad_posonly'
E 'test_module.bad'
E 'test_module.BadMethod.f'
E Use -v to get the full diff

mypy/test/teststubtest.py:128: AssertionError
________________________ StubtestUnit.test_bad_literal _________________________
[gw3] linux -- Python 3.8.12 /usr/bin/python3

args = (<mypy.test.teststubtest.StubtestUnit testMethod=test_bad_literal>,)
kwargs = {}
cases = [<mypy.test.teststubtest.Case object at 0x7f50e958cd00>, <mypy.test.teststubtest.Case object at 0x7f50e958c370>, <mypy...>, <mypy.test.teststubtest.Case object at 0x7f50e958c6a0>, <mypy.test.teststubtest.Case object at 0x7f50e958c880>, ...]
expected_errors = {'test_module.BYTES_STR_MISMATCH', 'test_module.INT_FLOAT_MISMATCH', 'test_module.STR_BYTES_MISMATCH', 'test_module.WRONG_BOOL_1', 'test_module.WRONG_BOOL_2', 'test_module.WRONG_BYTES', ...}
c = <mypy.test.teststubtest.Case object at 0x7f50e958c2b0>
expected_error = 'test_module.WRONG_BOOL_2', @py_assert1 = False
@py_format3 = "{'test_module'} == {'test_module...G_BYTES', ...}\nExtra items in the left set:\n'test_module'\nExtra items in the...est_module.WRONG_INT'\n'test_module.WRONG_BYTES'...\n~\n~...Full output truncated (6 lines hidden), use '-vv' to show"
@py_format5 = "test_module\n~\n>assert {'test_module'} == {'test_module...G_BYTES', ...}\nExtra items in the left set:\n'test_modu...est_module.WRONG_INT'\n~'test_module.WRONG_BYTES'...\n~\n~...Full output truncated (6 lines hidden), use '-vv' to show"
output = 'test_module\n', actual_errors = {'test_module'}

def test(*args: Any, **kwargs: Any) -> None:
    cases = list(fn(*args, **kwargs))
    expected_errors = set()
    for c in cases:
        if c.error is None:
            continue
        expected_error = "{}.{}".format(TEST_MODULE_NAME, c.error)
        assert expected_error not in expected_errors, (
            "collect_cases merges cases into a single stubtest invocation; we already "
            "expect an error for {}".format(expected_error)
        )
        expected_errors.add(expected_error)
    output = run_stubtest(
        stub="\n\n".join(textwrap.dedent(c.stub.lstrip("\n")) for c in cases),
        runtime="\n\n".join(textwrap.dedent(c.runtime.lstrip("\n")) for c in cases),
        options=["--generate-allowlist"],
    )

    actual_errors = set(output.splitlines())

  assert actual_errors == expected_errors, output

E AssertionError: test_module
E
E assert {'test_module'} == {'test_module...G_BYTES', ...}
E Extra items in the left set:
E 'test_module'
E Extra items in the right set:
E 'test_module.WRONG_BOOL_1'
E 'test_module.WRONG_STR'
E 'test_module.WRONG_INT'
E 'test_module.WRONG_BYTES'...
E
E ...Full output truncated (6 lines hidden), use '-vv' to show

mypy/test/teststubtest.py:128: AssertionError
_________________________ StubtestUnit.test_basic_good _________________________
[gw3] linux -- Python 3.8.12 /usr/bin/python3

args = (<mypy.test.teststubtest.StubtestUnit testMethod=test_basic_good>,)
kwargs = {}
cases = [<mypy.test.teststubtest.Case object at 0x7f50e98db130>, <mypy.test.teststubtest.Case object at 0x7f50e98dbe20>]
expected_errors = set()
c = <mypy.test.teststubtest.Case object at 0x7f50e98dbe20>, @py_assert1 = False
@py_format3 = "{'test_module'} == set()\nExtra items in the left set:\n'test_module'\nUse -v to get the full diff"
@py_format5 = "test_module\n\n>assert {'test_module'} == set()\nExtra items in the left set:\n'test_module'\n~Use -v to get the full diff"
output = 'test_module\n', actual_errors = {'test_module'}

def test(*args: Any, **kwargs: Any) -> None:
    cases = list(fn(*args, **kwargs))
    expected_errors = set()
    for c in cases:
        if c.error is None:
            continue
        expected_error = "{}.{}".format(TEST_MODULE_NAME, c.error)
        assert expected_error not in expected_errors, (
            "collect_cases merges cases into a single stubtest invocation; we already "
            "expect an error for {}".format(expected_error)
        )
        expected_errors.add(expected_error)
    output = run_stubtest(
        stub="\n\n".join(textwrap.dedent(c.stub.lstrip("\n")) for c in cases),
        runtime="\n\n".join(textwrap.dedent(c.runtime.lstrip("\n")) for c in cases),
        options=["--generate-allowlist"],
    )

    actual_errors = set(output.splitlines())

  assert actual_errors == expected_errors, output

E AssertionError: test_module
E
E assert {'test_module'} == set()
E Extra items in the left set:
E 'test_module'
E Use -v to get the full diff

mypy/test/teststubtest.py:128: AssertionError
_________________________ StubtestUnit.test_decorator __________________________
[gw3] linux -- Python 3.8.12 /usr/bin/python3

args = (<mypy.test.teststubtest.StubtestUnit testMethod=test_decorator>,)
kwargs = {}, cases = [<mypy.test.teststubtest.Case object at 0x7f50e85abe20>]
expected_errors = set()
c = <mypy.test.teststubtest.Case object at 0x7f50e85abe20>, @py_assert1 = False
@py_format3 = "{'test_module'} == set()\nExtra items in the left set:\n'test_module'\nUse -v to get the full diff"
@py_format5 = "test_module\n\n>assert {'test_module'} == set()\nExtra items in the left set:\n'test_module'\n~Use -v to get the full diff"
output = 'test_module\n', actual_errors = {'test_module'}

def test(*args: Any, **kwargs: Any) -> None:
    cases = list(fn(*args, **kwargs))
    expected_errors = set()
    for c in cases:
        if c.error is None:
            continue
        expected_error = "{}.{}".format(TEST_MODULE_NAME, c.error)
        assert expected_error not in expected_errors, (
            "collect_cases merges cases into a single stubtest invocation; we already "
            "expect an error for {}".format(expected_error)
        )
        expected_errors.add(expected_error)
    output = run_stubtest(
        stub="\n\n".join(textwrap.dedent(c.stub.lstrip("\n")) for c in cases),
        runtime="\n\n".join(textwrap.dedent(c.runtime.lstrip("\n")) for c in cases),
        options=["--generate-allowlist"],
    )

    actual_errors = set(output.splitlines())

  assert actual_errors == expected_errors, output

E AssertionError: test_module
E
E assert {'test_module'} == set()
E Extra items in the left set:
E 'test_module'
E Use -v to get the full diff

mypy/test/teststubtest.py:128: AssertionError
_______________________ StubtestUnit.test_default_value ________________________
[gw3] linux -- Python 3.8.12 /usr/bin/python3

args = (<mypy.test.teststubtest.StubtestUnit testMethod=test_default_value>,)
kwargs = {}
cases = [<mypy.test.teststubtest.Case object at 0x7f50e8c8ac10>, <mypy.test.teststubtest.Case object at 0x7f50e8c8aaf0>, <mypy...8a1c0>, <mypy.test.teststubtest.Case object at 0x7f50e8c8a670>, <mypy.test.teststubtest.Case object at 0x7f50e8c8a520>]
expected_errors = {'test_module.f2', 'test_module.f3', 'test_module.f4', 'test_module.f5', 'test_module.f6'}
c = <mypy.test.teststubtest.Case object at 0x7f50e8c8a520>
expected_error = 'test_module.f6', @py_assert1 = False
@py_format3 = "{'test_module'} == {'test_module...st_module.f6'}\nExtra items in the left set:\n'test_module'\nExtra items in the..._module.f4'\n'test_module.f2'\n~'test_module.f5'...\n~\n~...Full output truncated (3 lines hidden), use '-vv' to show"
@py_format5 = "test_module\n~\n>assert {'test_module'} == {'test_module...st_module.f6'}\nExtra items in the left set:\n'test_modu..._module.f4'\n~'test_module.f2'\n~'test_module.f5'...\n~\n~...Full output truncated (3 lines hidden), use '-vv' to show"
output = 'test_module\n', actual_errors = {'test_module'}

def test(*args: Any, **kwargs: Any) -> None:
    cases = list(fn(*args, **kwargs))
    expected_errors = set()
    for c in cases:
        if c.error is None:
            continue
        expected_error = "{}.{}".format(TEST_MODULE_NAME, c.error)
        assert expected_error not in expected_errors, (
            "collect_cases merges cases into a single stubtest invocation; we already "
            "expect an error for {}".format(expected_error)
        )
        expected_errors.add(expected_error)
    output = run_stubtest(
        stub="\n\n".join(textwrap.dedent(c.stub.lstrip("\n")) for c in cases),
        runtime="\n\n".join(textwrap.dedent(c.runtime.lstrip("\n")) for c in cases),
        options=["--generate-allowlist"],
    )

    actual_errors = set(output.splitlines())

  assert actual_errors == expected_errors, output

E AssertionError: test_module
E
E assert {'test_module'} == {'test_module...st_module.f6'}
E Extra items in the left set:
E 'test_module'
E Extra items in the right set:
E 'test_module.f3'
E 'test_module.f4'
E 'test_module.f2'
E 'test_module.f5'...
E
E ...Full output truncated (3 lines hidden), use '-vv' to show

mypy/test/teststubtest.py:128: AssertionError
____________________________ StubtestUnit.test_enum ____________________________
[gw3] linux -- Python 3.8.12 /usr/bin/python3

args = (<mypy.test.teststubtest.StubtestUnit testMethod=test_enum>,)
kwargs = {}, cases = [<mypy.test.teststubtest.Case object at 0x7f50e97ff490>]
expected_errors = {'test_module.X.c'}
c = <mypy.test.teststubtest.Case object at 0x7f50e97ff490>
expected_error = 'test_module.X.c', @py_assert1 = False
@py_format3 = "{'test_module'} == {'test_module.X.c'}\nExtra items in the left set:\n'test_module'\nExtra items in the right set:\n'test_module.X.c'\nUse -v to get the full diff"
@py_format5 = "test_module\n\n>assert {'test_module'} == {'test_module.X.c'}\nExtra items in the left set:\n'test_module'\nExtra items in the right set:\n'test_module.X.c'\n~Use -v to get the full diff"
output = 'test_module\n', actual_errors = {'test_module'}

def test(*args: Any, **kwargs: Any) -> None:
    cases = list(fn(*args, **kwargs))
    expected_errors = set()
    for c in cases:
        if c.error is None:
            continue
        expected_error = "{}.{}".format(TEST_MODULE_NAME, c.error)
        assert expected_error not in expected_errors, (
            "collect_cases merges cases into a single stubtest invocation; we already "
            "expect an error for {}".format(expected_error)
        )
        expected_errors.add(expected_error)
    output = run_stubtest(
        stub="\n\n".join(textwrap.dedent(c.stub.lstrip("\n")) for c in cases),
        runtime="\n\n".join(textwrap.dedent(c.runtime.lstrip("\n")) for c in cases),
        options=["--generate-allowlist"],
    )

    actual_errors = set(output.splitlines())

  assert actual_errors == expected_errors, output

E AssertionError: test_module
E
E assert {'test_module'} == {'test_module.X.c'}
E Extra items in the left set:
E 'test_module'
E Extra items in the right set:
E 'test_module.X.c'
E Use -v to get the full diff

mypy/test/teststubtest.py:128: AssertionError
________________________ StubtestUnit.test_good_literal ________________________
[gw3] linux -- Python 3.8.12 /usr/bin/python3

args = (<mypy.test.teststubtest.StubtestUnit testMethod=test_good_literal>,)
kwargs = {}, cases = [<mypy.test.teststubtest.Case object at 0x7f50e8f402b0>]
expected_errors = set()
c = <mypy.test.teststubtest.Case object at 0x7f50e8f402b0>, @py_assert1 = False
@py_format3 = "{'test_module'} == set()\nExtra items in the left set:\n'test_module'\nUse -v to get the full diff"
@py_format5 = "test_module\n\n>assert {'test_module'} == set()\nExtra items in the left set:\n'test_module'\n~Use -v to get the full diff"
output = 'test_module\n', actual_errors = {'test_module'}

def test(*args: Any, **kwargs: Any) -> None:
    cases = list(fn(*args, **kwargs))
    expected_errors = set()
    for c in cases:
        if c.error is None:
            continue
        expected_error = "{}.{}".format(TEST_MODULE_NAME, c.error)
        assert expected_error not in expected_errors, (
            "collect_cases merges cases into a single stubtest invocation; we already "
            "expect an error for {}".format(expected_error)
        )
        expected_errors.add(expected_error)
    output = run_stubtest(
        stub="\n\n".join(textwrap.dedent(c.stub.lstrip("\n")) for c in cases),
        runtime="\n\n".join(textwrap.dedent(c.runtime.lstrip("\n")) for c in cases),
        options=["--generate-allowlist"],
    )

    actual_errors = set(output.splitlines())

  assert actual_errors == expected_errors, output

E AssertionError: test_module
E
E assert {'test_module'} == set()
E Extra items in the left set:
E 'test_module'
E Use -v to get the full diff

mypy/test/teststubtest.py:128: AssertionError
__________________________ StubtestUnit.test_missing ___________________________
[gw3] linux -- Python 3.8.12 /usr/bin/python3

args = (<mypy.test.teststubtest.StubtestUnit testMethod=test_missing>,)
kwargs = {}
cases = [<mypy.test.teststubtest.Case object at 0x7f50e8604f10>, <mypy.test.teststubtest.Case object at 0x7f50e86042b0>, <mypy...>, <mypy.test.teststubtest.Case object at 0x7f50e8604df0>, <mypy.test.teststubtest.Case object at 0x7f50e8604a90>, ...]
expected_errors = {'test_module.B', 'test_module.X', 'test_module.f', 'test_module.g', 'test_module.h', 'test_module.x', ...}
c = <mypy.test.teststubtest.Case object at 0x7f50e86047c0>
expected_error = 'test_module.B', @py_assert1 = False
@py_format3 = "{'test_module'} == {'test_module...odule.x', ...}\nExtra items in the left set:\n'test_module'\nExtra items in the...est_module.y'\n'test_module.B'\n~'test_module.X'...\n~\n~...Full output truncated (5 lines hidden), use '-vv' to show"
@py_format5 = "test_module\n~\n>assert {'test_module'} == {'test_module...odule.x', ...}\nExtra items in the left set:\n'test_modu...est_module.y'\n~'test_module.B'\n~'test_module.X'...\n~\n~...Full output truncated (5 lines hidden), use '-vv' to show"
output = 'test_module\n', actual_errors = {'test_module'}

def test(*args: Any, **kwargs: Any) -> None:
    cases = list(fn(*args, **kwargs))
    expected_errors = set()
    for c in cases:
        if c.error is None:
            continue
        expected_error = "{}.{}".format(TEST_MODULE_NAME, c.error)
        assert expected_error not in expected_errors, (
            "collect_cases merges cases into a single stubtest invocation; we already "
            "expect an error for {}".format(expected_error)
        )
        expected_errors.add(expected_error)
    output = run_stubtest(
        stub="\n\n".join(textwrap.dedent(c.stub.lstrip("\n")) for c in cases),
        runtime="\n\n".join(textwrap.dedent(c.runtime.lstrip("\n")) for c in cases),
        options=["--generate-allowlist"],
    )

    actual_errors = set(output.splitlines())

  assert actual_errors == expected_errors, output

E AssertionError: test_module
E
E assert {'test_module'} == {'test_module...odule.x', ...}
E Extra items in the left set:
E 'test_module'
E Extra items in the right set:
E 'test_module.f'
E 'test_module.y'
E 'test_module.B'
E 'test_module.X'...
E
E ...Full output truncated (5 lines hidden), use '-vv' to show

mypy/test/teststubtest.py:128: AssertionError
___________________ StubtestUnit.test_missing_no_runtime_all ___________________
[gw3] linux -- Python 3.8.12 /usr/bin/python3

args = (<mypy.test.teststubtest.StubtestUnit testMethod=test_missing_no_runtime_all>,)
kwargs = {}
cases = [<mypy.test.teststubtest.Case object at 0x7f50e903c550>, <mypy.test.teststubtest.Case object at 0x7f50e8e615b0>, <mypy.test.teststubtest.Case object at 0x7f50e8e61940>]
expected_errors = {'test_module.CONSTANT', 'test_module.g'}
c = <mypy.test.teststubtest.Case object at 0x7f50e8e61940>
expected_error = 'test_module.CONSTANT', @py_assert1 = False
@py_format3 = "{'test_module'} == {'test_module...est_module.g'}\nExtra items in the left set:\n'test_module'\nExtra items in the right set:\n'test_module.CONSTANT'\n~'test_module.g'\nUse -v to get the full diff"
@py_format5 = "test_module\n\n>assert {'test_module'} == {'test_module...est_module.g'}\nExtra items in the left set:\n'test_module'\nExtra items in the right set:\n'test_module.CONSTANT'\n~'test_module.g'\n~Use -v to get the full diff"
output = 'test_module\n', actual_errors = {'test_module'}

def test(*args: Any, **kwargs: Any) -> None:
    cases = list(fn(*args, **kwargs))
    expected_errors = set()
    for c in cases:
        if c.error is None:
            continue
        expected_error = "{}.{}".format(TEST_MODULE_NAME, c.error)
        assert expected_error not in expected_errors, (
            "collect_cases merges cases into a single stubtest invocation; we already "
            "expect an error for {}".format(expected_error)
        )
        expected_errors.add(expected_error)
    output = run_stubtest(
        stub="\n\n".join(textwrap.dedent(c.stub.lstrip("\n")) for c in cases),
        runtime="\n\n".join(textwrap.dedent(c.runtime.lstrip("\n")) for c in cases),
        options=["--generate-allowlist"],
    )

    actual_errors = set(output.splitlines())

  assert actual_errors == expected_errors, output

E AssertionError: test_module
E
E assert {'test_module'} == {'test_module...est_module.g'}
E Extra items in the left set:
E 'test_module'
E Extra items in the right set:
E 'test_module.CONSTANT'
E 'test_module.g'
E Use -v to get the full diff

mypy/test/teststubtest.py:128: AssertionError
____________________________ StubtestUnit.test_mro _____________________________
[gw3] linux -- Python 3.8.12 /usr/bin/python3

args = (<mypy.test.teststubtest.StubtestUnit testMethod=test_mro>,), kwargs = {}
cases = [<mypy.test.teststubtest.Case object at 0x7f50e9366c40>, <mypy.test.teststubtest.Case object at 0x7f50e9366f10>]
expected_errors = {'test_module.C.foo', 'test_module.X.init'}
c = <mypy.test.teststubtest.Case object at 0x7f50e9366f10>
expected_error = 'test_module.X.init', @py_assert1 = False
@py_format3 = "{'test_module'} == {'test_module...e.X.init'}\nExtra items in the left set:\n'test_module'\nExtra items in the right set:\n'test_module.C.foo'\n~'test_module.X.init'\nUse -v to get the full diff"
@py_format5 = "test_module\n\n>assert {'test_module'} == {'test_module...e.X.init'}\nExtra items in the left set:\n'test_module'\nExtra items in the right set:\n'test_module.C.foo'\n~'test_module.X.init'\n~Use -v to get the full diff"
output = 'test_module\n', actual_errors = {'test_module'}

def test(*args: Any, **kwargs: Any) -> None:
    cases = list(fn(*args, **kwargs))
    expected_errors = set()
    for c in cases:
        if c.error is None:
            continue
        expected_error = "{}.{}".format(TEST_MODULE_NAME, c.error)
        assert expected_error not in expected_errors, (
            "collect_cases merges cases into a single stubtest invocation; we already "
            "expect an error for {}".format(expected_error)
        )
        expected_errors.add(expected_error)
    output = run_stubtest(
        stub="\n\n".join(textwrap.dedent(c.stub.lstrip("\n")) for c in cases),
        runtime="\n\n".join(textwrap.dedent(c.runtime.lstrip("\n")) for c in cases),
        options=["--generate-allowlist"],
    )

    actual_errors = set(output.splitlines())

  assert actual_errors == expected_errors, output

E AssertionError: test_module
E
E assert {'test_module'} == {'test_module...e.X.init'}
E Extra items in the left set:
E 'test_module'
E Extra items in the right set:
E 'test_module.C.foo'
E 'test_module.X.init'
E Use -v to get the full diff

mypy/test/teststubtest.py:128: AssertionError
_______________________ StubtestUnit.test_name_mangling ________________________
[gw3] linux -- Python 3.8.12 /usr/bin/python3

args = (<mypy.test.teststubtest.StubtestUnit testMethod=test_name_mangling>,)
kwargs = {}, cases = [<mypy.test.teststubtest.Case object at 0x7f50e722ff10>]
expected_errors = {'test_module.X.__mangle_bad'}
c = <mypy.test.teststubtest.Case object at 0x7f50e722ff10>
expected_error = 'test_module.X.__mangle_bad', @py_assert1 = False
@py_format3 = "{'test_module'} == {'test_module.X.__mangle_bad'}\nExtra items in the left set:\n'test_module'\nExtra items in the right set:\n'test_module.X.__mangle_bad'\nUse -v to get the full diff"
@py_format5 = "test_module\n\n>assert {'test_module'} == {'test_module.X.__mangle_bad'}\nExtra items in the left set:\n'test_module'\nExtra items in the right set:\n'test_module.X.__mangle_bad'\n~Use -v to get the full diff"
output = 'test_module\n', actual_errors = {'test_module'}

def test(*args: Any, **kwargs: Any) -> None:
    cases = list(fn(*args, **kwargs))
    expected_errors = set()
    for c in cases:
        if c.error is None:
            continue
        expected_error = "{}.{}".format(TEST_MODULE_NAME, c.error)
        assert expected_error not in expected_errors, (
            "collect_cases merges cases into a single stubtest invocation; we already "
            "expect an error for {}".format(expected_error)
        )
        expected_errors.add(expected_error)
    output = run_stubtest(
        stub="\n\n".join(textwrap.dedent(c.stub.lstrip("\n")) for c in cases),
        runtime="\n\n".join(textwrap.dedent(c.runtime.lstrip("\n")) for c in cases),
        options=["--generate-allowlist"],
    )

    actual_errors = set(output.splitlines())

  assert actual_errors == expected_errors, output

E AssertionError: test_module
E
E assert {'test_module'} == {'test_module.X.__mangle_bad'}
E Extra items in the left set:
E 'test_module'
E Extra items in the right set:
E 'test_module.X.__mangle_bad'
E Use -v to get the full diff

mypy/test/teststubtest.py:128: AssertionError
________________________ StubtestUnit.test_non_public_1 ________________________
[gw3] linux -- Python 3.8.12 /usr/bin/python3

args = (<mypy.test.teststubtest.StubtestUnit testMethod=test_non_public_1>,)
kwargs = {}
cases = [<mypy.test.teststubtest.Case object at 0x7f50e7c4c610>, <mypy.test.teststubtest.Case object at 0x7f50e7c4c9d0>]
expected_errors = {'test_module._f'}
c = <mypy.test.teststubtest.Case object at 0x7f50e7c4c9d0>
expected_error = 'test_module._f', @py_assert1 = False
@py_format3 = "{'test_module'} == {'test_module._f'}\nExtra items in the left set:\n'test_module'\nExtra items in the right set:\n'test_module._f'\nUse -v to get the full diff"
@py_format5 = "test_module\n\n>assert {'test_module'} == {'test_module._f'}\nExtra items in the left set:\n'test_module'\nExtra items in the right set:\n'test_module._f'\n~Use -v to get the full diff"
output = 'test_module\n', actual_errors = {'test_module'}

def test(*args: Any, **kwargs: Any) -> None:
    cases = list(fn(*args, **kwargs))
    expected_errors = set()
    for c in cases:
        if c.error is None:
            continue
        expected_error = "{}.{}".format(TEST_MODULE_NAME, c.error)
        assert expected_error not in expected_errors, (
            "collect_cases merges cases into a single stubtest invocation; we already "
            "expect an error for {}".format(expected_error)
        )
        expected_errors.add(expected_error)
    output = run_stubtest(
        stub="\n\n".join(textwrap.dedent(c.stub.lstrip("\n")) for c in cases),
        runtime="\n\n".join(textwrap.dedent(c.runtime.lstrip("\n")) for c in cases),
        options=["--generate-allowlist"],
    )

    actual_errors = set(output.splitlines())

  assert actual_errors == expected_errors, output

E AssertionError: test_module
E
E assert {'test_module'} == {'test_module._f'}
E Extra items in the left set:
E 'test_module'
E Extra items in the right set:
E 'test_module._f'
E Use -v to get the full diff

mypy/test/teststubtest.py:128: AssertionError
________________________ StubtestUnit.test_non_public_2 ________________________
[gw3] linux -- Python 3.8.12 /usr/bin/python3

args = (<mypy.test.teststubtest.StubtestUnit testMethod=test_non_public_2>,)
kwargs = {}
cases = [<mypy.test.teststubtest.Case object at 0x7f50e8d0c4f0>, <mypy.test.teststubtest.Case object at 0x7f50e8d0c850>, <mypy.test.teststubtest.Case object at 0x7f50e8d0c940>]
expected_errors = {'test_module.f', 'test_module.g'}
c = <mypy.test.teststubtest.Case object at 0x7f50e8d0c940>
expected_error = 'test_module.g', @py_assert1 = False
@py_format3 = "{'test_module'} == {'test_module...est_module.g'}\nExtra items in the left set:\n'test_module'\nExtra items in the right set:\n'test_module.f'\n~'test_module.g'\nUse -v to get the full diff"
@py_format5 = "test_module\n\n>assert {'test_module'} == {'test_module...est_module.g'}\nExtra items in the left set:\n'test_module'\nExtra items in the right set:\n'test_module.f'\n~'test_module.g'\n~Use -v to get the full diff"
output = 'test_module\n', actual_errors = {'test_module'}

def test(*args: Any, **kwargs: Any) -> None:
    cases = list(fn(*args, **kwargs))
    expected_errors = set()
    for c in cases:
        if c.error is None:
            continue
        expected_error = "{}.{}".format(TEST_MODULE_NAME, c.error)
        assert expected_error not in expected_errors, (
            "collect_cases merges cases into a single stubtest invocation; we already "
            "expect an error for {}".format(expected_error)
        )
        expected_errors.add(expected_error)
    output = run_stubtest(
        stub="\n\n".join(textwrap.dedent(c.stub.lstrip("\n")) for c in cases),
        runtime="\n\n".join(textwrap.dedent(c.runtime.lstrip("\n")) for c in cases),
        options=["--generate-allowlist"],
    )

    actual_errors = set(output.splitlines())

  assert actual_errors == expected_errors, output

E AssertionError: test_module
E
E assert {'test_module'} == {'test_module...est_module.g'}
E Extra items in the left set:
E 'test_module'
E Extra items in the right set:
E 'test_module.f'
E 'test_module.g'
E Use -v to get the full diff

mypy/test/teststubtest.py:128: AssertionError
__________________________ StubtestUnit.test_overload __________________________
[gw3] linux -- Python 3.8.12 /usr/bin/python3

args = (<mypy.test.teststubtest.StubtestUnit testMethod=test_overload>,)
kwargs = {}
cases = [<mypy.test.teststubtest.Case object at 0x7f50e8b710d0>, <mypy.test.teststubtest.Case object at 0x7f50e8b713a0>, <mypy...71be0>, <mypy.test.teststubtest.Case object at 0x7f50e935f250>, <mypy.test.teststubtest.Case object at 0x7f50e935fa60>]
expected_errors = {'test_module.f2', 'test_module.f3'}
c = <mypy.test.teststubtest.Case object at 0x7f50e935fa60>
expected_error = 'test_module.f3', @py_assert1 = False
@py_format3 = "{'test_module'} == {'test_module...st_module.f3'}\nExtra items in the left set:\n'test_module'\nExtra items in the right set:\n'test_module.f2'\n~'test_module.f3'\nUse -v to get the full diff"
@py_format5 = "test_module\n\n>assert {'test_module'} == {'test_module...st_module.f3'}\nExtra items in the left set:\n'test_module'\nExtra items in the right set:\n'test_module.f2'\n~'test_module.f3'\n~Use -v to get the full diff"
output = 'test_module\n', actual_errors = {'test_module'}

def test(*args: Any, **kwargs: Any) -> None:
    cases = list(fn(*args, **kwargs))
    expected_errors = set()
    for c in cases:
        if c.error is None:
            continue
        expected_error = "{}.{}".format(TEST_MODULE_NAME, c.error)
        assert expected_error not in expected_errors, (
            "collect_cases merges cases into a single stubtest invocation; we already "
            "expect an error for {}".format(expected_error)
        )
        expected_errors.add(expected_error)
    output = run_stubtest(
        stub="\n\n".join(textwrap.dedent(c.stub.lstrip("\n")) for c in cases),
        runtime="\n\n".join(textwrap.dedent(c.runtime.lstrip("\n")) for c in cases),
        options=["--generate-allowlist"],
    )

    actual_errors = set(output.splitlines())

  assert actual_errors == expected_errors, output

E AssertionError: test_module
E
E assert {'test_module'} == {'test_module...st_module.f3'}
E Extra items in the left set:
E 'test_module'
E Extra items in the right set:
E 'test_module.f2'
E 'test_module.f3'
E Use -v to get the full diff

mypy/test/teststubtest.py:128: AssertionError
__________________________ StubtestUnit.test_property __________________________
[gw3] linux -- Python 3.8.12 /usr/bin/python3

args = (<mypy.test.teststubtest.StubtestUnit testMethod=test_property>,)
kwargs = {}
cases = [<mypy.test.teststubtest.Case object at 0x7f50e8f4a280>, <mypy.test.teststubtest.Case object at 0x7f50e8f4ad60>, <mypy.test.teststubtest.Case object at 0x7f50e8e09fd0>, <mypy.test.teststubtest.Case object at 0x7f50e8e09550>]
expected_errors = {'test_module.Bad.f', 'test_module.BadReadOnly.f'}
c = <mypy.test.teststubtest.Case object at 0x7f50e8e09550>
expected_error = 'test_module.BadReadOnly.f', @py_assert1 = False
@py_format3 = "{'test_module'} == {'test_module...adReadOnly.f'}\nExtra items in the left set:\n'test_module'\nExtra items in the right set:\n'test_module.BadReadOnly.f'\n~'test_module.Bad.f'\nUse -v to get the full diff"
@py_format5 = "test_module\n\n>assert {'test_module'} == {'test_module...adReadOnly.f'}\nExtra items in the left set:\n'test_module'\nExtra items in the right set:\n'test_module.BadReadOnly.f'\n~'test_module.Bad.f'\n~Use -v to get the full diff"
output = 'test_module\n', actual_errors = {'test_module'}

def test(*args: Any, **kwargs: Any) -> None:
    cases = list(fn(*args, **kwargs))
    expected_errors = set()
    for c in cases:
        if c.error is None:
            continue
        expected_error = "{}.{}".format(TEST_MODULE_NAME, c.error)
        assert expected_error not in expected_errors, (
            "collect_cases merges cases into a single stubtest invocation; we already "
            "expect an error for {}".format(expected_error)
        )
        expected_errors.add(expected_error)
    output = run_stubtest(
        stub="\n\n".join(textwrap.dedent(c.stub.lstrip("\n")) for c in cases),
        runtime="\n\n".join(textwrap.dedent(c.runtime.lstrip("\n")) for c in cases),
        options=["--generate-allowlist"],
    )

    actual_errors = set(output.splitlines())

  assert actual_errors == expected_errors, output

E AssertionError: test_module
E
E assert {'test_module'} == {'test_module...adReadOnly.f'}
E Extra items in the left set:
E 'test_module'
E Extra items in the right set:
E 'test_module.BadReadOnly.f'
E 'test_module.Bad.f'
E Use -v to get the full diff

mypy/test/teststubtest.py:128: AssertionError
______________________ StubtestUnit.test_special_dunders _______________________
[gw3] linux -- Python 3.8.12 /usr/bin/python3

args = (<mypy.test.teststubtest.StubtestUnit testMethod=test_special_dunders>,)
kwargs = {}
cases = [<mypy.test.teststubtest.Case object at 0x7f50e8f05a30>, <mypy.test.teststubtest.Case object at 0x7f50e8f05a00>, <mypy.test.teststubtest.Case object at 0x7f50e9099a30>]
expected_errors = {'test_module.A.init', 'test_module.B.call'}
c = <mypy.test.teststubtest.Case object at 0x7f50e9099a30>
expected_error = 'test_module.B.call', @py_assert1 = False
@py_format3 = "{'test_module'} == {'test_module...e.B.call'}\nExtra items in the left set:\n'test_module'\nExtra items in the right set:\n'test_module.B.call'\n~'test_module.A.init'\nUse -v to get the full diff"
@py_format5 = "test_module\n\n>assert {'test_module'} == {'test_module...e.B.call'}\nExtra items in the left set:\n'test_module'\nExtra items in the right set:\n'test_module.B.call'\n~'test_module.A.init'\n~Use -v to get the full diff"
output = 'test_module\n', actual_errors = {'test_module'}

def test(*args: Any, **kwargs: Any) -> None:
    cases = list(fn(*args, **kwargs))
    expected_errors = set()
    for c in cases:
        if c.error is None:
            continue
        expected_error = "{}.{}".format(TEST_MODULE_NAME, c.error)
        assert expected_error not in expected_errors, (
            "collect_cases merges cases into a single stubtest invocation; we already "
            "expect an error for {}".format(expected_error)
        )
        expected_errors.add(expected_error)
    output = run_stubtest(
        stub="\n\n".join(textwrap.dedent(c.stub.lstrip("\n")) for c in cases),
        runtime="\n\n".join(textwrap.dedent(c.runtime.lstrip("\n")) for c in cases),
        options=["--generate-allowlist"],
    )

    actual_errors = set(output.splitlines())

  assert actual_errors == expected_errors, output

E AssertionError: test_module
E
E assert {'test_module'} == {'test_module...e.B.call'}
E Extra items in the left set:
E 'test_module'
E Extra items in the right set:
E 'test_module.B.call'
E 'test_module.A.init'
E Use -v to get the full diff

mypy/test/teststubtest.py:128: AssertionError
____________________ StubtestUnit.test_static_class_method _____________________
[gw3] linux -- Python 3.8.12 /usr/bin/python3

args = (<mypy.test.teststubtest.StubtestUnit testMethod=test_static_class_method>,)
kwargs = {}
cases = [<mypy.test.teststubtest.Case object at 0x7f50e8ac2430>, <mypy.test.teststubtest.Case object at 0x7f50e8ac2a00>, <mypy...c2910>, <mypy.test.teststubtest.Case object at 0x7f50e8ac2d60>, <mypy.test.teststubtest.Case object at 0x7f50e8ac2df0>]
expected_errors = {'test_module.Bad1.f', 'test_module.Bad2.f', 'test_module.Bad3.f'}
c = <mypy.test.teststubtest.Case object at 0x7f50e8ac2df0>
expected_error = 'test_module.Bad3.f', @py_assert1 = False
@py_format3 = "{'test_module'} == {'test_module...odule.Bad3.f'}\nExtra items in the left set:\n'test_module'\nExtra items in the right set:\n'test_module.Bad1.f'\n~'test_module.Bad2.f'\n~'test_module.Bad3.f'\nUse -v to get the full diff"
@py_format5 = "test_module\n\n>assert {'test_module'} == {'test_module...odule.Bad3.f'}\nExtra items in the left set:\n'test_modu...s in the right set:\n~'test_module.Bad1.f'\n~'test_module.Bad2.f'\n~'test_module.Bad3.f'\n~Use -v to get the full diff"
output = 'test_module\n', actual_errors = {'test_module'}

def test(*args: Any, **kwargs: Any) -> None:
    cases = list(fn(*args, **kwargs))
    expected_errors = set()
    for c in cases:
        if c.error is None:
            continue
        expected_error = "{}.{}".format(TEST_MODULE_NAME, c.error)
        assert expected_error not in expected_errors, (
            "collect_cases merges cases into a single stubtest invocation; we already "
            "expect an error for {}".format(expected_error)
        )
        expected_errors.add(expected_error)
    output = run_stubtest(
        stub="\n\n".join(textwrap.dedent(c.stub.lstrip("\n")) for c in cases),
        runtime="\n\n".join(textwrap.dedent(c.runtime.lstrip("\n")) for c in cases),
        options=["--generate-allowlist"],
    )

    actual_errors = set(output.splitlines())

  assert actual_errors == expected_errors, output

E AssertionError: test_module
E
E assert {'test_module'} == {'test_module...odule.Bad3.f'}
E Extra items in the left set:
E 'test_module'
E Extra items in the right set:
E 'test_module.Bad1.f'
E 'test_module.Bad2.f'
E 'test_module.Bad3.f'
E Use -v to get the full diff

mypy/test/teststubtest.py:128: AssertionError
_________________________ StubtestUnit.test_type_alias _________________________
[gw3] linux -- Python 3.8.12 /usr/bin/python3

args = (<mypy.test.teststubtest.StubtestUnit testMethod=test_type_alias>,)
kwargs = {}
cases = [<mypy.test.teststubtest.Case object at 0x7f50e9193ac0>, <mypy.test.teststubtest.Case object at 0x7f50e9193a60>]
expected_errors = {'test_module.A', 'test_module.Y.f'}
c = <mypy.test.teststubtest.Case object at 0x7f50e9193a60>
expected_error = 'test_module.A', @py_assert1 = False
@py_format3 = "{'test_module'} == {'test_module...t_module.Y.f'}\nExtra items in the left set:\n'test_module'\nExtra items in the right set:\n'test_module.Y.f'\n~'test_module.A'\nUse -v to get the full diff"
@py_format5 = "test_module\n\n>assert {'test_module'} == {'test_module...t_module.Y.f'}\nExtra items in the left set:\n'test_module'\nExtra items in the right set:\n'test_module.Y.f'\n~'test_module.A'\n~Use -v to get the full diff"
output = 'test_module\n', actual_errors = {'test_module'}

def test(*args: Any, **kwargs: Any) -> None:
    cases = list(fn(*args, **kwargs))
    expected_errors = set()
    for c in cases:
        if c.error is None:
            continue
        expected_error = "{}.{}".format(TEST_MODULE_NAME, c.error)
        assert expected_error not in expected_errors, (
            "collect_cases merges cases into a single stubtest invocation; we already "
            "expect an error for {}".format(expected_error)
        )
        expected_errors.add(expected_error)
    output = run_stubtest(
        stub="\n\n".join(textwrap.dedent(c.stub.lstrip("\n")) for c in cases),
        runtime="\n\n".join(textwrap.dedent(c.runtime.lstrip("\n")) for c in cases),
        options=["--generate-allowlist"],
    )

    actual_errors = set(output.splitlines())

  assert actual_errors == expected_errors, output

E AssertionError: test_module
E
E assert {'test_module'} == {'test_module...t_module.Y.f'}
E Extra items in the left set:
E 'test_module'
E Extra items in the right set:
E 'test_module.Y.f'
E 'test_module.A'
E Use -v to get the full diff

mypy/test/teststubtest.py:128: AssertionError
___________________________ StubtestUnit.test_types ____________________________
[gw3] linux -- Python 3.8.12 /usr/bin/python3

args = (<mypy.test.teststubtest.StubtestUnit testMethod=test_types>,)
kwargs = {}
cases = [<mypy.test.teststubtest.Case object at 0x7f50e92dd910>, <mypy.test.teststubtest.Case object at 0x7f50e9b03670>, <mypy.test.teststubtest.Case object at 0x7f50e9b033a0>]
expected_errors = {'test_module.X.mistyped_var', 'test_module.mistyped_class', 'test_module.mistyped_fn'}
c = <mypy.test.teststubtest.Case object at 0x7f50e9b033a0>
expected_error = 'test_module.X.mistyped_var', @py_assert1 = False
@py_format3 = "{'test_module'} == {'test_module....mistyped_fn'}\nExtra items in the left set:\n'test_module'\nExtra items in the...'test_module.mistyped_class'\n~'test_module.mistyped_fn'\n~'test_module.X.mistyped_var'\nUse -v to get the full diff"
@py_format5 = "test_module\n\n>assert {'test_module'} == {'test_module....mistyped_fn'}\nExtra items in the left set:\n'test_modu...'test_module.mistyped_class'\n'test_module.mistyped_fn'\n~'test_module.X.mistyped_var'\n~Use -v to get the full diff"
output = 'test_module\n', actual_errors = {'test_module'}

def test(*args: Any, **kwargs: Any) -> None:
    cases = list(fn(*args, **kwargs))
    expected_errors = set()
    for c in cases:
        if c.error is None:
            continue
        expected_error = "{}.{}".format(TEST_MODULE_NAME, c.error)
        assert expected_error not in expected_errors, (
            "collect_cases merges cases into a single stubtest invocation; we already "
            "expect an error for {}".format(expected_error)
        )
        expected_errors.add(expected_error)
    output = run_stubtest(
        stub="\n\n".join(textwrap.dedent(c.stub.lstrip("\n")) for c in cases),
        runtime="\n\n".join(textwrap.dedent(c.runtime.lstrip("\n")) for c in cases),
        options=["--generate-allowlist"],
    )

    actual_errors = set(output.splitlines())

  assert actual_errors == expected_errors, output

E AssertionError: test_module
E
E assert {'test_module'} == {'test_module....mistyped_fn'}
E Extra items in the left set:
E 'test_module'
E Extra items in the right set:
E 'test_module.mistyped_class'
E 'test_module.mistyped_fn'
E 'test_module.X.mistyped_var'
E Use -v to get the full diff

mypy/test/teststubtest.py:128: AssertionError
____________________________ StubtestUnit.test_var _____________________________
[gw3] linux -- Python 3.8.12 /usr/bin/python3

args = (<mypy.test.teststubtest.StubtestUnit testMethod=test_var>,), kwargs = {}
cases = [<mypy.test.teststubtest.Case object at 0x7f50e9015310>, <mypy.test.teststubtest.Case object at 0x7f50e9015d60>, <mypy...>, <mypy.test.teststubtest.Case object at 0x7f50e9015910>, <mypy.test.teststubtest.Case object at 0x7f50e9015e50>, ...]
expected_errors = {'test_module.x2', 'test_module.x4', 'test_module.x5', 'test_module.x6'}
c = <mypy.test.teststubtest.Case object at 0x7f50e9015d30>
expected_error = 'test_module.x6', @py_assert1 = False
@py_format3 = "{'test_module'} == {'test_module...st_module.x6'}\nExtra items in the left set:\n'test_module'\nExtra items in the..._module.x5'\n'test_module.x2'\n~'test_module.x4'...\n~\n~...Full output truncated (2 lines hidden), use '-vv' to show"
@py_format5 = "test_module\n~\n>assert {'test_module'} == {'test_module...st_module.x6'}\nExtra items in the left set:\n'test_modu..._module.x5'\n~'test_module.x2'\n~'test_module.x4'...\n~\n~...Full output truncated (2 lines hidden), use '-vv' to show"
output = 'test_module\n', actual_errors = {'test_module'}

def test(*args: Any, **kwargs: Any) -> None:
    cases = list(fn(*args, **kwargs))
    expected_errors = set()
    for c in cases:
        if c.error is None:
            continue
        expected_error = "{}.{}".format(TEST_MODULE_NAME, c.error)
        assert expected_error not in expected_errors, (
            "collect_cases merges cases into a single stubtest invocation; we already "
            "expect an error for {}".format(expected_error)
        )
        expected_errors.add(expected_error)
    output = run_stubtest(
        stub="\n\n".join(textwrap.dedent(c.stub.lstrip("\n")) for c in cases),
        runtime="\n\n".join(textwrap.dedent(c.runtime.lstrip("\n")) for c in cases),
        options=["--generate-allowlist"],
    )

    actual_errors = set(output.splitlines())

  assert actual_errors == expected_errors, output

E AssertionError: test_module
E
E assert {'test_module'} == {'test_module...st_module.x6'}
E Extra items in the left set:
E 'test_module'
E Extra items in the right set:
E 'test_module.x6'
E 'test_module.x5'
E 'test_module.x2'
E 'test_module.x4'...
E
E ...Full output truncated (2 lines hidden), use '-vv' to show

mypy/test/teststubtest.py:128: AssertionError
_____________________ StubtestUnit.test_varargs_varkwargs ______________________
[gw3] linux -- Python 3.8.12 /usr/bin/python3

args = (<mypy.test.teststubtest.StubtestUnit testMethod=test_varargs_varkwargs>,)
kwargs = {}
cases = [<mypy.test.teststubtest.Case object at 0x7f50e7ad0f70>, <mypy.test.teststubtest.Case object at 0x7f50e7ad03d0>, <mypy...>, <mypy.test.teststubtest.Case object at 0x7f50e8dd94f0>, <mypy.test.teststubtest.Case object at 0x7f50e8dd9c40>, ...]
expected_errors = {'test_module.f2', 'test_module.g2', 'test_module.h1', 'test_module.h2', 'test_module.h3', 'test_module.j1', ...}
c = <mypy.test.teststubtest.Case object at 0x7f50e8dd9f70>
expected_error = 'test_module.k6', @py_assert1 = False
@py_format3 = "{'test_module'} == {'test_module...dule.j1', ...}\nExtra items in the left set:\n'test_module'\nExtra items in the...module.k6'\n'test_module.k1'\n~'test_module.h2'...\n~\n~...Full output truncated (10 lines hidden), use '-vv' to show"
@py_format5 = "test_module\n~\n>assert {'test_module'} == {'test_module...dule.j1', ...}\nExtra items in the left set:\n'test_modu...module.k6'\n~'test_module.k1'\n~'test_module.h2'...\n~\n~...Full output truncated (10 lines hidden), use '-vv' to show"
output = 'test_module\n', actual_errors = {'test_module'}

def test(*args: Any, **kwargs: Any) -> None:
    cases = list(fn(*args, **kwargs))
    expected_errors = set()
    for c in cases:
        if c.error is None:
            continue
        expected_error = "{}.{}".format(TEST_MODULE_NAME, c.error)
        assert expected_error not in expected_errors, (
            "collect_cases merges cases into a single stubtest invocation; we already "
            "expect an error for {}".format(expected_error)
        )
        expected_errors.add(expected_error)
    output = run_stubtest(
        stub="\n\n".join(textwrap.dedent(c.stub.lstrip("\n")) for c in cases),
        runtime="\n\n".join(textwrap.dedent(c.runtime.lstrip("\n")) for c in cases),
        options=["--generate-allowlist"],
    )

    actual_errors = set(output.splitlines())

  assert actual_errors == expected_errors, output

E AssertionError: test_module
E
E assert {'test_module'} == {'test_module...dule.j1', ...}
E Extra items in the left set:
E 'test_module'
E Extra items in the right set:
E 'test_module.k5'
E 'test_module.k6'
E 'test_module.k1'
E 'test_module.h2'...
E
E ...Full output truncated (10 lines hidden), use '-vv' to show

mypy/test/teststubtest.py:128: AssertionError
_______________________ StubtestMiscUnit.test_allowlist ________________________
[gw3] linux -- Python 3.8.12 /usr/bin/python3

self = <mypy.test.teststubtest.StubtestMiscUnit testMethod=test_allowlist>

def test_allowlist(self) -> None:
    # Can't use this as a context because Windows
    allowlist = tempfile.NamedTemporaryFile(mode="w+", delete=False)
    try:
        with allowlist:
            allowlist.write("{}.bad  # comment\n# comment".format(TEST_MODULE_NAME))

        output = run_stubtest(
            stub="def bad(number: int, text: str) -> None: ...",
            runtime="def bad(asdf, text): pass",
            options=["--allowlist", allowlist.name],
        )

      assert not output

E AssertionError: assert not "error: test_module failed to import: No module named 'test_module'\nStub: at line 1\nMypyFile:1(\n test_module.pyi)\nRuntime:\nMISSING\n\nnote: unused allowlist entry test_module.bad\n"

mypy/test/teststubtest.py:889: AssertionError
______________________ StubtestMiscUnit.test_config_file _______________________
[gw3] linux -- Python 3.8.12 /usr/bin/python3

self = <mypy.test.teststubtest.StubtestMiscUnit testMethod=test_config_file>

def test_config_file(self) -> None:
    runtime = "temp = 5\n"
    stub = "from decimal import Decimal\ntemp: Decimal\n"
    config_file = (
        "[mypy]\n"
        "plugins={}/test-data/unit/plugins/decimal_to_int.py\n".format(root_dir)
    )
    output = run_stubtest(stub=stub, runtime=runtime, options=[])

  assert output == (

        "error: test_module.temp variable differs from runtime type Literal[5]\n"
        "Stub: at line 2\ndecimal.Decimal\nRuntime:\n5\n\n"
    )

E AssertionError: assert 'error: test_...\nMISSING\n\n' == 'error: test_...ntime:\n5\n\n'
E - error: test_module.temp variable differs from runtime type Literal[5]
E + error: test_module failed to import: No module named 'test_module'
E - Stub: at line 2
E ? ^
E + Stub: at line 1
E ? ^
E - decimal.Decimal...
E
E ...Full output truncated (7 lines hidden), use '-vv' to show

mypy/test/teststubtest.py:975: AssertionError
______________________ StubtestMiscUnit.test_ignore_flags ______________________
[gw3] linux -- Python 3.8.12 /usr/bin/python3

self = <mypy.test.teststubtest.StubtestMiscUnit testMethod=test_ignore_flags>

def test_ignore_flags(self) -> None:
    output = run_stubtest(
        stub="", runtime="__all__ = ['f']\ndef f(): pass", options=["--ignore-missing-stub"]
    )

  assert not output

E AssertionError: assert not "error: test_module failed to import: No module named 'test_module'\nStub: at line 1\nMypyFile:1(\n test_module.pyi)\nRuntime:\nMISSING\n\n"

mypy/test/teststubtest.py:865: AssertionError
_________________________ StubtestMiscUnit.test_output _________________________
[gw3] linux -- Python 3.8.12 /usr/bin/python3

self = <mypy.test.teststubtest.StubtestMiscUnit testMethod=test_output>

def test_output(self) -> None:
    output = run_stubtest(
        stub="def bad(number: int, text: str) -> None: ...",
        runtime="def bad(num, text): pass",
        options=[],
    )
    expected = (
        'error: {0}.bad is inconsistent, stub argument "number" differs from runtime '
        'argument "num"\nStub: at line 1\ndef (number: builtins.int, text: builtins.str)\n'
        "Runtime: at line 1 in file {0}.py\ndef (num, text)\n\n".format(TEST_MODULE_NAME)
    )

  assert remove_color_code(output) == expected

E AssertionError: assert 'error: test_...\nMISSING\n\n' == 'error: test_...um, text)\n\n'
E - error: test_module.bad is inconsistent, stub argument "number" differs from runtime argument "num"
E + error: test_module failed to import: No module named 'test_module'
E Stub: at line 1
E - def (number: builtins.int, text: builtins.str)
E - Runtime: at line 1 in file test_module.py
E - def (num, text)
E + MypyFile:1(...
E
E ...Full output truncated (5 lines hidden), use '-vv' to show

mypy/test/teststubtest.py:848: AssertionError
____________________________ testMultipleAssignment ____________________________
[gw4] linux -- Python 3.8.12 /usr/bin/python3
data: /home/tkloczko/rpmbuild/BUILD/mypy-0.931/mypyc/test-data/run-misc.test:347:
/home/tkloczko/rpmbuild/BUILD/mypy-0.931/mypyc/test/test_run.py:137: in run_case
self.run_case_inner(testcase)
/home/tkloczko/rpmbuild/BUILD/mypy-0.931/mypyc/test/test_run.py:153: in run_case_inner
self.run_case_step(testcase, step)
/home/tkloczko/rpmbuild/BUILD/mypy-0.931/mypyc/test/test_run.py:262: in run_case_step
assert False, "Compilation failed"
E AssertionError: Compilation failed
E assert False
----------------------------- Captured stdout call -----------------------------
running build_ext
creating build/temp.linux-x86_64-3.8
creating build/temp.linux-x86_64-3.8/build
/usr/bin/gcc -DDYNAMIC_ANNOTATIONS_ENABLED=1 -DNDEBUG -O2 -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fstack-protector-strong -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -fdata-sections -ffunction-sections -flto=auto -flto-partition=none -D_GNU_SOURCE -fPIC -fwrapv -ffat-lto-objects -D_GNU_SOURCE -fPIC -fwrapv -O2 -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -fstack-protector-strong -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1 -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -fdata-sections -ffunction-sections -flto=auto -flto-partition=none -D_GNU_SOURCE -fPIC -fwrapv -ffat-lto-objects -O2 -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -fstack-protector-strong -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1 -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -fdata-sections -ffunction-sections -flto=auto -flto-partition=none -D_GNU_SOURCE -fPIC -fwrapv -ffat-lto-objects -O2 -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -fstack-protector-strong -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1 -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -fdata-sections -ffunction-sections -flto=auto -flto-partition=none -fPIC -I/home/tkloczko/rpmbuild/BUILD/mypy-0.931/mypyc/lib-rt -I/usr/include/python3.8 -c build/__native.c -o build/temp.linux-x86_64-3.8/build/__native.o -O0 -g1 -Werror -Wno-unused-function -Wno-unused-label -Wno-unreachable-code -Wno-unused-variable -Wno-unused-command-line-argument -Wno-unknown-warning-option -Wno-unused-but-set-variable
----------------------------- Captured stderr call -----------------------------
In file included from /usr/include/bits/libc-header-start.h:33,
from /usr/include/limits.h:26,
from /usr/lib/gcc/x86_64-redhat-linux/11/include/limits.h:203,
from /usr/lib/gcc/x86_64-redhat-linux/11/include/syslimits.h:7,
from /usr/lib/gcc/x86_64-redhat-linux/11/include/limits.h:34,
from /usr/include/python3.8/Python.h:11,
from /home/tkloczko/rpmbuild/BUILD/mypy-0.931/mypyc/lib-rt/init.c:1,
from build/__native.c:1:
/usr/include/features.h:412:4: error: #warning _FORTIFY_SOURCE requires compiling with optimization (-O) [-Werror=cpp]
412 | # warning _FORTIFY_SOURCE requires compiling with optimization (-O)
| ^~~~~~~
cc1: note: unrecognized command-line option ‘-Wno-unknown-warning-option’ may have been intended to silence earlier diagnostics
cc1: note: unrecognized command-line option ‘-Wno-unused-command-line-argument’ may have been intended to silence earlier diagnostics
cc1: all warnings being treated as errors
__________________________________ testUnpack __________________________________
[gw4] linux -- Python 3.8.12 /usr/bin/python3
data: /home/tkloczko/rpmbuild/BUILD/mypy-0.931/mypyc/test-data/run-misc.test:410:
/home/tkloczko/rpmbuild/BUILD/mypy-0.931/mypyc/test/test_run.py:137: in run_case
self.run_case_inner(testcase)
/home/tkloczko/rpmbuild/BUILD/mypy-0.931/mypyc/test/test_run.py:153: in run_case_inner
self.run_case_step(testcase, step)
/home/tkloczko/rpmbuild/BUILD/mypy-0.931/mypyc/test/test_run.py:262: in run_case_step
assert False, "Compilation failed"
E AssertionError: Compilation failed
E assert False
----------------------------- Captured stdout call -----------------------------
running build_ext
creating build/temp.linux-x86_64-3.8
creating build/temp.linux-x86_64-3.8/build
/usr/bin/gcc -DDYNAMIC_ANNOTATIONS_ENABLED=1 -DNDEBUG -O2 -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fstack-protector-strong -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -fdata-sections -ffunction-sections -flto=auto -flto-partition=none -D_GNU_SOURCE -fPIC -fwrapv -ffat-lto-objects -D_GNU_SOURCE -fPIC -fwrapv -O2 -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -fstack-protector-strong -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1 -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -fdata-sections -ffunction-sections -flto=auto -flto-partition=none -D_GNU_SOURCE -fPIC -fwrapv -ffat-lto-objects -O2 -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -fstack-protector-strong -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1 -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -fdata-sections -ffunction-sections -flto=auto -flto-partition=none -D_GNU_SOURCE -fPIC -fwrapv -ffat-lto-objects -O2 -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -fstack-protector-strong -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1 -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -fdata-sections -ffunction-sections -flto=auto -flto-partition=none -fPIC -I/home/tkloczko/rpmbuild/BUILD/mypy-0.931/mypyc/lib-rt -I/usr/include/python3.8 -c build/__native.c -o build/temp.linux-x86_64-3.8/build/__native.o -O0 -g1 -Werror -Wno-unused-function -Wno-unused-label -Wno-unreachable-code -Wno-unused-variable -Wno-unused-command-line-argument -Wno-unknown-warning-option -Wno-unused-but-set-variable
----------------------------- Captured stderr call -----------------------------
In file included from /usr/include/bits/libc-header-start.h:33,
from /usr/include/limits.h:26,
from /usr/lib/gcc/x86_64-redhat-linux/11/include/limits.h:203,
from /usr/lib/gcc/x86_64-redhat-linux/11/include/syslimits.h:7,
from /usr/lib/gcc/x86_64-redhat-linux/11/include/limits.h:34,
from /usr/include/python3.8/Python.h:11,
from /home/tkloczko/rpmbuild/BUILD/mypy-0.931/mypyc/lib-rt/init.c:1,
from build/__native.c:1:
/usr/include/features.h:412:4: error: #warning _FORTIFY_SOURCE requires compiling with optimization (-O) [-Werror=cpp]
412 | # warning _FORTIFY_SOURCE requires compiling with optimization (-O)
| ^~~~~~~
cc1: note: unrecognized command-line option ‘-Wno-unknown-warning-option’ may have been intended to silence earlier diagnostics
cc1: note: unrecognized command-line option ‘-Wno-unused-command-line-argument’ may have been intended to silence earlier diagnostics
cc1: all warnings being treated as errors

[..]

=========================== short test summary info ============================
SKIPPED [32] mypy/test/data.py:256: Skipped
SKIPPED [214] mypy/test/testfinegrained.py:77: Skipped
SKIPPED [72] mypy/test/testparse.py:69: Skipped
SKIPPED [1] mypy/test/testipc.py:59: unconditional skip
SKIPPED [1] mypy/test/teststubgen.py:475: Tests building the paths common ancestor on Windows
SKIPPED [1] mypy/test/testsubtypes.py:70: unconditional skip
SKIPPED [1] mypy/test/testtypes.py:738: unconditional skip
SKIPPED [1] mypy/test/testtypes.py:730: unconditional skip
SKIPPED [1] mypy/test/testtypes.py:723: unconditional skip
SKIPPED [1] mypy/test/testtypes.py:717: unconditional skip
SKIPPED [1] mypy/test/testtypes.py:984: unconditional skip
SKIPPED [2] mypy/test/testpep561.py:95: Skipped
SKIPPED [43] mypy/test/testpythoneval.py:68: Skipped
XFAIL mypy/test/testcheck.py::TypeCheckSuite::check-typeguard.test::testTypeGuardNestedRestrictionUnionIsInstance
XFAIL mypy/test/testcheck.py::TypeCheckSuite::check-typeguard.test::testTypeGuardMultipleCondition
XFAIL mypy/test/testcheck.py::TypeCheckSuite::check-singledispatch.test::testImplementationHasSameDispatchTypeAsFallback
XFAIL mypy/test/testcheck.py::TypeCheckSuite::check-singledispatch.test::testRegisterHasDifferentTypeThanTypeSignature
XFAIL mypy/test/testcheck.py::TypeCheckSuite::check-singledispatch.test::testDispatchBasedOnTypeAnnotationsRequires37
XFAIL mypyc/test/test_run.py::TestRun::run-singledispatch.test::testSingleDispatchMethod
XFAIL mypyc/test/test_run.py::TestRun::run-singledispatch.test::testSingleDispatchMethodWithOtherDecorator
FAILED mypy/test/teststubtest.py::StubtestUnit::test_arg_mismatch - Assertion...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_arg_name - AssertionErro...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_bad_literal - AssertionE...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_basic_good - AssertionEr...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_decorator - AssertionErr...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_default_value - Assertio...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_enum - AssertionError: t...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_good_literal - Assertion...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_missing - AssertionError...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_missing_no_runtime_all
FAILED mypy/test/teststubtest.py::StubtestUnit::test_mro - AssertionError: te...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_name_mangling - Assertio...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_non_public_1 - Assertion...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_non_public_2 - Assertion...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_overload - AssertionErro...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_property - AssertionErro...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_special_dunders - Assert...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_static_class_method - As...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_type_alias - AssertionEr...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_types - AssertionError: ...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_var - AssertionError: te...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_varargs_varkwargs - Asse...
FAILED mypy/test/teststubtest.py::StubtestMiscUnit::test_allowlist - Assertio...
FAILED mypy/test/teststubtest.py::StubtestMiscUnit::test_config_file - Assert...
FAILED mypy/test/teststubtest.py::StubtestMiscUnit::test_ignore_flags - Asser...
FAILED mypy/test/teststubtest.py::StubtestMiscUnit::test_output - AssertionEr...
FAILED mypyc/test/test_run.py::TestRun::run-misc.test::testMultipleAssignment
FAILED mypyc/test/test_run.py::TestRun::run-misc.test::testUnpack
FAILED mypyc/test/test_run.py::TestRun::run-misc.test::testModuleTopLevel
FAILED mypyc/test/test_run.py::TestRun::run-misc.test::testComprehensions
FAILED mypyc/test/test_run.py::TestRun::run-misc.test::testDummyTypes
FAILED mypyc/test/test_run.py::TestRun::run-misc.test::testClassBasedTypedDict
FAILED mypyc/test/test_run.py::TestRun::run-functions.test::testNestedFunctions2
FAILED mypyc/test/test_run.py::TestRun::run-misc.test::testClassBasedNamedTuple
FAILED mypyc/test/test_run.py::TestRun::run-functions.test::testFunctionCallWithDefaultArgs
FAILED mypyc/test/test_run.py::TestRun::run-misc.test::testAsync
FAILED mypyc/test/test_run.py::TestRun::run-misc.test::testUnion
FAILED mypyc/test/test_run.py::TestRun::run-misc.test::testMaybeUninitVar
FAILED mypyc/test/test_run.py::TestRun::run-functions.test::testMethodCallWithDefaultArgs
FAILED mypyc/test/test_run.py::TestRun::run-misc.test::testAnyAll
FAILED mypyc/test/test_run.py::TestRun::run-misc.test::testUninitBoom
FAILED mypyc/test/test_run.py::TestRun::run-functions.test::testMethodCallOrdering
FAILED mypyc/test/test_run.py::TestRun::run-misc.test::testSum
FAILED mypyc/test/test_run.py::TestRun::run-misc.test::testBuiltins
FAILED mypyc/test/test_run.py::TestRun::run-functions.test::testPyMethodCall
FAILED mypyc/test/test_run.py::TestRun::run-misc.test::testNoneStuff
FAILED mypyc/test/test_run.py::TestRun::run-misc.test::testOptional
FAILED mypyc/test/test_run.py::TestRun::run-functions.test::testMethodCallWithKeywordArgs
FAILED mypyc/test/test_run.py::TestRun::run-misc.test::testBorrowRefs
FAILED mypyc/test/test_run.py::TestRun::run-functions.test::testAnyCall
FAILED mypyc/test/test_run.py::TestRun::run-misc.test::testWith
FAILED mypyc/test/test_run.py::TestRun::run-misc.test::testFinalStaticRunFail
FAILED mypyc/test/test_run.py::TestRun::run-functions.test::testCallableTypes
FAILED mypyc/test/test_run.py::TestRun::run-misc.test::testDisplays
FAILED mypyc/test/test_run.py::TestRun::run-misc.test::testFinalStaticRunListTupleInt
FAILED mypyc/test/test_run.py::TestRun::run-misc.test::testArbitraryLvalues
FAILED mypyc/test/test_run.py::TestRun::run-functions.test::testKeywordArgs
FAILED mypyc/test/test_run.py::TestRun::run-misc.test::testCheckVersion
FAILED mypyc/test/test_run.py::TestRun::run-misc.test::testControlFlowExprs
FAILED mypyc/test/test_run.py::TestRun::run-functions.test::testStarArgs
FAILED mypyc/test/test_run.py::TestRun::run-misc.test::testTypeErrorMessages
FAILED mypyc/test/test_run.py::TestRun::run-integers.test::testBigIntLiteral
FAILED mypyc/test/test_run.py::TestRun::run-functions.test::testStar2Args
FAILED mypyc/test/test_run.py::TestRun::run-misc.test::testComprehensionShadowBinder
FAILED mypyc/test/test_run.py::TestRun::run-integers.test::testNeg
FAILED mypyc/test/test_run.py::TestRun::run-functions.test::testStarAndStar2Args
FAILED mypyc/test/test_run.py::TestRun::run-misc.test::testAllLiterals
FAILED mypyc/test/test_run.py::TestRun::run-integers.test::testIsinstanceIntAndNotBool
FAILED mypyc/test/test_run.py::TestRun::run-functions.test::testAllTheArgCombinations
FAILED mypyc/test/test_run.py::TestRun::run-misc.test::testUnreachableExpressions
FAILED mypyc/test/test_run.py::TestRun::run-functions.test::testOverloads
FAILED mypyc/test/test_run.py::TestRun::run-misc.test::testDoesntSegfaultWhenTopLevelFails
FAILED mypyc/test/test_run.py::TestRun::run-integers.test::testIntOps
FAILED mypyc/test/test_run.py::TestRun::run-misc.test::testRepeatedUnderscoreFunctions
FAILED mypyc/test/test_run.py::TestRun::run-functions.test::testDecorators1
FAILED mypyc/test/test_run.py::TestRun::run-misc.test::testUnderscoreFunctionsInMethods
FAILED mypyc/test/test_run.py::TestRun::run-integers.test::testIntMinMax
FAILED mypyc/test/test_run.py::TestRun::run-functions.test::testDecoratorsMethods
FAILED mypyc/test/test_run.py::TestRun::run-misc.test::testGlobalRedefinition_toplevel
FAILED mypyc/test/test_run.py::TestRun::run-floats.test::testStrToFloat
FAILED mypyc/test/test_run.py::TestRun::run-functions.test::testUnannotatedFunction
FAILED mypyc/test/test_run.py::TestRun::run-functions.test::testCallTrivialFunction
FAILED mypyc/test/test_run.py::TestRun::run-floats.test::testFloatArithmetic
FAILED mypyc/test/test_run.py::TestRun::run-functions.test::testUnannotatedModuleLevelInitFunction
FAILED mypyc/test/test_run.py::TestRun::run-functions.test::testRecursiveFibonacci
FAILED mypyc/test/test_run.py::TestRun::run-bools.test::testTrueAndFalse
FAILED mypyc/test/test_run.py::TestRun::run-functions.test::testDifferentArgCountsFromInterpreted
FAILED mypyc/test/test_run.py::TestRun::run-bools.test::testBoolOps
FAILED mypyc/test/test_run.py::TestRun::run-bools.test::testIsinstanceBool
FAILED mypyc/test/test_run.py::TestRun::run-functions.test::testNestedFunctions
FAILED mypyc/test/test_run.py::TestRun::run-functions.test::testComplicatedArgs
FAILED mypyc/test/test_run.py::TestRun::run-strings.test::testStrBasics
FAILED mypyc/test/test_run.py::TestRun::run-bytes.test::testBytesSlicing
FAILED mypyc/test/test_run.py::TestRun::run-functions.test::testDecoratorName
FAILED mypyc/test/test_run.py::TestRun::run-strings.test::testStringOps
FAILED mypyc/test/test_run.py::TestRun::run-bytes.test::testBytearrayBasics
FAILED mypyc/test/test_run.py::TestRun::run-integers.test::testInc
FAILED mypyc/test/test_run.py::TestRun::run-lists.test::testOperatorInExpression
FAILED mypyc/test/test_run.py::TestRun::run-integers.test::testCount
FAILED mypyc/test/test_run.py::TestRun::run-strings.test::testStringFormattingCStyle
FAILED mypyc/test/test_run.py::TestRun::run-bytes.test::testBytearraySlicing
FAILED mypyc/test/test_run.py::TestRun::run-lists.test::testListBuiltFromGenerator
FAILED mypyc/test/test_run.py::TestRun::run-integers.test::testIntMathOps
FAILED mypyc/test/test_run.py::TestRun::run-bytes.test::testBytearrayIndexing
FAILED mypyc/test/test_run.py::TestRun::run-lists.test::testNextBug
FAILED mypyc/test/test_run.py::TestRun::run-loops.test::testContinueFor
FAILED mypyc/test/test_run.py::TestRun::run-bytes.test::testBytesJoin
FAILED mypyc/test/test_run.py::TestRun::run-strings.test::testFStrings
FAILED mypyc/test/test_run.py::TestRun::run-loops.test::testMultipleVarsWithLoops
FAILED mypyc/test/test_run.py::TestRun::run-dicts.test::testDictStuff
FAILED mypyc/test/test_run.py::TestRun::run-bytes.test::testBytesFormatting
FAILED mypyc/test/test_run.py::TestRun::run-loops.test::testForZipAndEnumerate
FAILED mypyc/test/test_run.py::TestRun::run-dicts.test::testDictIterationMethodsRun
FAILED mypyc/test/test_run.py::TestRun::run-tuples.test::testTuple
FAILED mypyc/test/test_run.py::TestRun::run-strings.test::testStringFormatMethod
FAILED mypyc/test/test_run.py::TestRun::run-loops.test::testIterTypeTrickiness
FAILED mypyc/test/test_run.py::TestRun::run-tuples.test::testTupleGet
FAILED mypyc/test/test_run.py::TestRun::run-dicts.test::testDictMethods
FAILED mypyc/test/test_run.py::TestRun::run-strings.test::testChr
FAILED mypyc/test/test_run.py::TestRun::run-loops.test::testRangeObject
FAILED mypyc/test/test_run.py::TestRun::run-tuples.test::testSequenceTupleArg
FAILED mypyc/test/test_run.py::TestRun::run-dicts.test::testDictToBool
FAILED mypyc/test/test_run.py::TestRun::run-strings.test::testOrd
FAILED mypyc/test/test_run.py::TestRun::run-exceptions.test::testException
FAILED mypyc/test/test_run.py::TestRun::run-tuples.test::testTupleAttr
FAILED mypyc/test/test_run.py::TestRun::run-sets.test::testSets
FAILED mypyc/test/test_run.py::TestRun::run-strings.test::testDecode
FAILED mypyc/test/test_run.py::TestRun::run-tuples.test::testNamedTupleAttributeRun
FAILED mypyc/test/test_run.py::TestRun::run-exceptions.test::testTryExcept
FAILED mypyc/test/test_run.py::TestRun::run-primitives.test::testGenericEquality
FAILED mypyc/test/test_run.py::TestRun::run-strings.test::testEncode
FAILED mypyc/test/test_run.py::TestRun::run-exceptions.test::testTryFinally
FAILED mypyc/test/test_run.py::TestRun::run-tuples.test::testTupleOps
FAILED mypyc/test/test_run.py::TestRun::run-primitives.test::testGenericBinaryOps
FAILED mypyc/test/test_run.py::TestRun::run-bytes.test::testBytesBasics
FAILED mypyc/test/test_run.py::TestRun::run-exceptions.test::testCustomException
FAILED mypyc/test/test_run.py::TestRun::run-lists.test::testListPlusEquals
FAILED mypyc/test/test_run.py::TestRun::run-primitives.test::testGenericMiscOps
FAILED mypyc/test/test_run.py::TestRun::run-bytes.test::testBytesInit
FAILED mypyc/test/test_run.py::TestRun::run-exceptions.test::testExceptionAtModuleTopLevel
FAILED mypyc/test/test_run.py::TestRun::run-lists.test::testListSum
FAILED mypyc/test/test_run.py::TestRun::run-primitives.test::testAnyAttributeAndMethodAccess
FAILED mypyc/test/test_run.py::TestRun::run-imports.test::testImports
FAILED mypyc/test/test_run.py::TestRun::run-bytes.test::testBytesOps
FAILED mypyc/test/test_run.py::TestRun::run-lists.test::testListSet
FAILED mypyc/test/test_run.py::TestRun::run-primitives.test::testFloat
FAILED mypyc/test/test_run.py::TestRun::run-imports.test::testImportMissing
FAILED mypyc/test/test_run.py::TestRun::run-imports.test::testReexport
FAILED mypyc/test/test_run.py::TestRun::run-lists.test::testSieve
FAILED mypyc/test/test_run.py::TestRun::run-primitives.test::testDel
FAILED mypyc/test/test_run.py::TestRun::run-imports.test::testFromImport
FAILED mypyc/test/test_run.py::TestRun::run-imports.test::testAssignModule
FAILED mypyc/test/test_run.py::TestRun::run-lists.test::testListBuild
FAILED mypyc/test/test_run.py::TestRun::run-imports.test::testFromImportWithUntypedModule
FAILED mypyc/test/test_run.py::TestRun::run-loops.test::testFor
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testEmptyClass
FAILED mypyc/test/test_run.py::TestRun::run-lists.test::testListPrims
FAILED mypyc/test/test_run.py::TestRun::run-imports.test::testFromImportWithKnownModule
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testClassWithFields
FAILED mypyc/test/test_run.py::TestRun::run-loops.test::testLoopElse
FAILED mypyc/test/test_run.py::TestRun::run-lists.test::testListOfUserDefinedClass
FAILED mypyc/test/test_run.py::TestRun::run-imports.test::testFromImportWithUnKnownModule
FAILED mypyc/test/test_run.py::TestRun::run-loops.test::testNestedLoopSameIdx
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testClassWithDeletableAttributes
FAILED mypyc/test/test_run.py::TestRun::run-imports.test::testMultipleFromImportsWithSamePackageButDifferentModules
FAILED mypyc/test/test_run.py::TestRun::run-lists.test::testListOps
FAILED mypyc/test/test_run.py::TestRun::run-loops.test::testForIterable
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testMethodOverrideDefault1
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testSubclass1
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testNonExtMisc
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testInterpretedParentInit
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testMethodOverrideDefault2
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testSubclassSpecialize1
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testEnum
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testInterpretedInherit
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testMethodOverrideDefault3
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testGetAttribute
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testSubclassSpecialize2
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testMethodOverrideDefault4
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testSetAttribute
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testProperty
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testIsInstance
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testAttributeTypes
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testMethodOverrideDefault5
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testSubclassUninitAttr
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testPropertySetters
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testInitMethodWithMissingNoneReturnAnnotation
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testMethodOverrideDefault6
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testClassMethods
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testSubclassAttributeAccess
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testConstructClassWithDefaultConstructor
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testMethodOverrideDefault7
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testSuper
FAILED mypyc/test/test_run.py::TestRun::run-traits.test::testTraitBasic1
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testCastUserClass
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testMethodOverrideDefault8
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testSubclassException
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testClass1
FAILED mypyc/test/test_run.py::TestRun::run-traits.test::testTraitBasic2
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testMethodOverrideDefault9
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testSubclassDict
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testGenericClass
FAILED mypyc/test/test_run.py::TestRun::run-traits.test::testTrait3
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testOverride
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testSubclassPy
FAILED mypyc/test/test_run.py::TestRun::run-traits.test::testTraitAttrsTriangle
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testNoMetaclass
FAILED mypyc/test/test_run.py::TestRun::run-traits.test::testTrait4
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testDisallowSubclassFromPy
FAILED mypyc/test/test_run.py::TestRun::run-traits.test::testTraitAttrsTree
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testMetaclass
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testClassVariable
FAILED mypyc/test/test_run.py::TestRun::run-traits.test::testTraitErrorMessages
FAILED mypyc/test/test_run.py::TestRun::run-traits.test::testTraitOrdering
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testPickling
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testDefaultVars
FAILED mypyc/test/test_run.py::TestRun::run-traits.test::testDiamond
FAILED mypyc/test/test_run.py::TestRun::run-classes.test::testProtocol
FAILED mypyc/test/test_run.py::TestRun::run-generators.test::testNameClashIssues
FAILED mypyc/test/test_run.py::TestRun::run-generators.test::testYield
FAILED mypyc/test/test_run.py::TestRun::run-traits.test::testTraitAttrsSubTrait
FAILED mypyc/test/test_run.py::TestRun::run-multimodule.test::testMultiModuleCycleWithClasses
FAILED mypyc/test/test_run.py::TestRun::run-multimodule.test::testMultiModulePackage
FAILED mypyc/test/test_run.py::TestRun::run-multimodule.test::testTrivialIncremental
FAILED mypyc/test/test_run.py::TestRun::run-generators.test::testYieldTryFinallyWith
FAILED mypyc/test/test_run.py::TestRun::run-multimodule.test::testMultiModuleCycleWithInheritance
FAILED mypyc/test/test_run.py::TestRun::run-multimodule.test::testMultiModuleFastpaths
FAILED mypyc/test/test_run.py::TestRun::run-multimodule.test::testIncrementalCompilation1
FAILED mypyc/test/test_run.py::TestRun::run-multimodule.test::testMultiModuleTraitInheritance
FAILED mypyc/test/test_run.py::TestRun::run-multimodule.test::testMultiModuleSameNames
FAILED mypyc/test/test_run.py::TestRun::run-multimodule.test::testIncrementalCompilation2
FAILED mypyc/test/test_run.py::TestRun::run-generators.test::testYieldNested
FAILED mypyc/test/test_run.py::TestRun::run-multimodule.test::testImportCycleWithNonCompiledModule
FAILED mypyc/test/test_run.py::TestRun::run-multimodule.test::testMultiModuleInitializeImportedModules
FAILED mypyc/test/test_run.py::TestRun::run-multimodule.test::testIncrementalCompilation3
FAILED mypyc/test/test_run.py::TestRun::run-multimodule.test::testImportCycleWithTopLevelStatements
FAILED mypyc/test/test_run.py::TestRun::run-multimodule.test::testMultiModuleImportClass
FAILED mypyc/test/test_run.py::TestRun::run-multimodule.test::testIncrementalCompilation4
FAILED mypyc/test/test_run.py::TestRun::run-multimodule.test::testMultiModuleCycleIfMypy1
FAILED mypyc/test/test_run.py::TestRun::run-multimodule.test::testMultiModuleSpecialize
FAILED mypyc/test/test_run.py::TestRun::run-multimodule.test::testIncrementalCompilation5
FAILED mypyc/test/test_run.py::TestRun::run-multimodule.test::testMultiModuleCycleIfMypy2
FAILED mypyc/test/test_run.py::TestRun::run-multimodule.test::testMultiModuleLiterals
FAILED mypyc/test/test_run.py::TestRun::run-multimodule.test::testIncrementalCompilation6
FAILED mypyc/test/test_run.py::TestRun::run-generators.test::testYieldThrow
FAILED mypyc/test/test_run.py::TestRun::run-multimodule.test::testMultiModuleRelative
FAILED mypyc/test/test_run.py::TestRun::run-multimodule.test::testMultiModuleTraceback
FAILED mypyc/test/test_run.py::TestRun::run-bench.test::testBenchmarkTree
FAILED mypyc/test/test_run.py::TestRun::run-multimodule.test::testMultiModuleCrash
FAILED mypyc/test/test_run.py::TestRun::run-multimodule.test::testMultiModuleCycle
FAILED mypyc/test/test_run.py::TestRun::run-generators.test::testYieldSend
FAILED mypyc/test/test_run.py::TestRun::run-bench.test::testBenchmarkVisitorTree
FAILED mypyc/test/test_run.py::TestRun::run-generators.test::testYieldFrom
FAILED mypyc/test/test_run.py::TestRun::run-dunders.test::testDundersBinaryNotImplemented
FAILED mypyc/test/test_run.py::TestRun::run-generators.test::testNextGenerator
FAILED mypyc/test/test_run.py::TestRun::run-dunders.test::testDifferentReverseDunders
FAILED mypyc/test/test_run.py::TestRun::run-mypy-sim.test::testSimulateMypy
FAILED mypyc/test/test_run.py::TestRun::run-generators.test::testGeneratorSuper
FAILED mypyc/test/test_run.py::TestRun::run-singledispatch.test::testMultipleUnderscoreFunctionsIsntError
FAILED mypyc/test/test_run.py::TestRun::run-dunders.test::testDundersMisc
FAILED mypyc/test/test_run.py::TestRun::run-dunders.test::testDundersInplace
FAILED mypyc/test/test_run.py::TestRun::run-dunders.test::testDunderMinMax
FAILED mypyc/test/test_run.py::TestRun::run-dunders.test::testDundersContainer
FAILED mypyc/test/test_run.py::TestRun::run-singledispatch.test::testRegisteringTheSameFunctionSeveralTimes
FAILED mypyc/test/test_run.py::TestRun::run-dunders.test::testDundersNumber
FAILED mypyc/test/test_run.py::TestRun::run-singledispatch.test::testCanRegisterCompiledClasses
FAILED mypyc/test/test_run.py::TestRun::run-dunders.test::testDundersBinarySimple
FAILED mypyc/test/test_run.py::TestRun::run-singledispatch.test::testSpecializedImplementationUsed
FAILED mypyc/test/test_run.py::TestRun::run-dunders.test::testDundersBinaryReverse
FAILED mypyc/test/test_run.py::TestRun::run-singledispatch.test::testTypeIsAnABC
FAILED mypyc/test/test_run.py::TestRun::run-singledispatch.test::testTypeUsedAsArgumentToRegister
FAILED mypyc/test/test_run.py::TestRun::run-singledispatch.test::testSubclassesOfExpectedTypeUseSpecialized
FAILED mypyc/test/test_run.py::TestRun::run-singledispatch.test::testArgsInRegisteredImplNamedDifferentlyFromMainFunction
FAILED mypyc/test/test_run.py::TestRun::run-singledispatch.test::testUseRegisterAsAFunction
FAILED mypyc/test/test_run.py::TestRun::run-singledispatch.test::testSuperclassImplementationNotUsedWhenSubclassHasImplementation
FAILED mypyc/test/test_run.py::TestRun::run-singledispatch.test::testKeywordArguments
FAILED mypyc/test/test_run.py::TestRun::run-singledispatch.test::testRegisterDoesntChangeFunction
FAILED mypyc/test/test_run.py::TestRun::run-singledispatch.test::testMoreSpecificTypeBeforeLessSpecificType
FAILED mypyc/test/test_run.py::TestRun::run-singledispatch.test::testGeneratorAndMultipleTypesOfIterable
FAILED mypyc/test/test_run.py::TestRun::run-singledispatch.test::testNoneIsntATypeWhenUsedAsArgumentToRegister
FAILED mypyc/test/test_run.py::TestRun::run-singledispatch.test::testSingledispatchTreeSumAndEqual
FAILED mypyc/test/test_run.py::TestRun::run-singledispatch.test::testMultipleRelatedClassesBeingRegistered
FAILED mypyc/test/test_run.py::TestRun::run-singledispatch.test::testRegisterUsedAtSameTimeAsOtherDecorators
FAILED mypyc/test/test_run.py::TestRun::run-singledispatch.test::testDynamicallyRegisteringFunctionFromInterpretedCode
FAILED mypyc/test/test_run.py::TestRun::run-singledispatch.test::testSimulateMypySingledispatch
FAILED mypyc/test/test_run.py::TestRun::run-singledispatch.test::testRegisteredImplementationsInDifferentFiles
FAILED mypyc/test/test_run.py::TestRun::run-singledispatch.test::testDecoratorModifiesFunction
FAILED mypyc/test/test_run.py::TestRun::run-singledispatch.test::testMalformedDynamicRegisterCall
FAILED mypyc/test/test_run.py::TestRun::run-attrs.test::testRunAttrsclassNonAuto
FAILED mypyc/test/test_run.py::TestRun::run-python38.test::testFStrings
FAILED mypyc/test/test_run.py::TestRun::run-python38.test::testMethodOverrideDefaultPosOnly1
FAILED mypyc/test/test_run.py::TestRun::run-python37.test::testRunDataclass
FAILED mypyc/test/test_run.py::TestRun::run-singledispatch.test::testOrderCanOnlyBeDeterminedFromMRONotIsinstanceChecks
FAILED mypyc/test/test_run.py::TestRunMultiFile::run-multimodule.test::testMultiModulePackage_multi
FAILED mypyc/test/test_run.py::TestRunMultiFile::run-multimodule.test::testMultiModuleFastpaths_multi
FAILED mypyc/test/test_run.py::TestRun::run-python38.test::testWalrus1
FAILED mypyc/test/test_run.py::TestRunMultiFile::run-multimodule.test::testMultiModuleSpecialize_multi
FAILED mypyc/test/test_run.py::TestRun::run-singledispatch.test::testCacheClearedWhenNewFunctionRegistered
FAILED mypyc/test/test_run.py::TestRunMultiFile::run-multimodule.test::testMultiModuleLiterals_multi
FAILED mypyc/test/test_run.py::TestRun::run-python38.test::testWalrus2
FAILED mypyc/test/test_run.py::TestRunMultiFile::run-multimodule.test::testMultiModuleTraceback_multi
FAILED mypyc/test/test_run.py::TestRunMultiFile::run-multimodule.test::testMultiModuleCycle_multi
FAILED mypyc/test/test_run.py::TestRunMultiFile::run-multimodule.test::testMultiModuleCycleWithClasses_multi
FAILED mypyc/test/test_run.py::TestRunMultiFile::run-multimodule.test::testMultiModuleCycleIfMypy1_multi
FAILED mypyc/test/test_run.py::TestRun::run-attrs.test::testRunAttrsclass
FAILED mypyc/test/test_run.py::TestRun::run-singledispatch.test::testCallingFunctionBeforeAllImplementationsRegistered
FAILED mypyc/test/test_run.py::TestRunMultiFile::run-multimodule.test::testMultiModuleCycleIfMypy2_multi
FAILED mypyc/test/test_run.py::TestRunMultiFile::run-multimodule.test::testMultiModuleCycleWithInheritance_multi
FAILED mypyc/test/test_run.py::TestRunMultiFile::run-multimodule.test::testMultiModuleTraitInheritance_multi
FAILED mypyc/test/test_run.py::TestRunMultiFile::run-multimodule.test::testMultiModuleSameNames_multi
FAILED mypyc/test/test_run.py::TestRunMultiFile::run-multimodule.test::testTrivialIncremental_multi
FAILED mypyc/test/test_run.py::TestRunMultiFile::run-multimodule.test::testMultiModuleRelative_multi
FAILED mypyc/test/test_run.py::TestRunMultiFile::run-multimodule.test::testImportCycleWithNonCompiledModule_multi
FAILED mypyc/test/test_run.py::TestRunMultiFile::run-multimodule.test::testMultiModuleInitializeImportedModules_multi
FAILED mypyc/test/test_run.py::TestRunMultiFile::run-multimodule.test::testMultiModuleCrash_multi
FAILED mypyc/test/test_run.py::TestRunMultiFile::run-multimodule.test::testIncrementalCompilation1_multi
FAILED mypyc/test/test_run.py::TestRunMultiFile::run-multimodule.test::testImportCycleWithTopLevelStatements_multi
FAILED mypyc/test/test_run.py::TestRunMultiFile::run-multimodule.test::testMultiModuleImportClass_multi
FAILED mypyc/test/test_run.py::TestRunMultiFile::run-multimodule.test::testIncrementalCompilation4_multi
FAILED mypyc/test/test_run.py::TestRunMultiFile::run-multimodule.test::testIncrementalCompilation2_multi
FAILED mypyc/test/test_run.py::TestRunMultiFile::run-multimodule.test::testIncrementalCompilation6_multi
FAILED mypyc/test/test_run.py::TestRunMultiFile::run-multimodule.test::testIncrementalCompilation5_multi
FAILED mypyc/test/test_run.py::TestRunMultiFile::run-multimodule.test::testIncrementalCompilation3_multi
FAILED mypyc/test/test_run.py::TestRunSeparate::run-multimodule.test::testMultiModulePackage_separate
FAILED mypyc/test/test_run.py::TestRunMultiFile::run-mypy-sim.test::testSimulateMypy_multi
FAILED mypyc/test/test_run.py::TestRunSeparate::run-multimodule.test::testMultiModuleSameNames_separate
FAILED mypyc/test/test_run.py::TestRunSeparate::run-multimodule.test::testMultiModuleInitializeImportedModules_separate
FAILED mypyc/test/test_run.py::TestRunSeparate::run-multimodule.test::testMultiModuleFastpaths_separate
FAILED mypyc/test/test_run.py::TestRunSeparate::run-multimodule.test::testMultiModuleImportClass_separate
FAILED mypyc/test/test_run.py::TestRunSeparate::run-multimodule.test::testMultiModuleSpecialize_separate
FAILED mypyc/test/test_run.py::TestRunSeparate::run-multimodule.test::testMultiModuleLiterals_separate
FAILED mypyc/test/test_run.py::TestRunSeparate::run-multimodule.test::testMultiModuleTraceback_separate
FAILED mypyc/test/test_run.py::TestRunSeparate::run-multimodule.test::testMultiModuleCycle_separate
FAILED mypyc/test/test_run.py::TestRunSeparate::run-multimodule.test::testMultiModuleCycleWithClasses_separate
FAILED mypyc/test/test_run.py::TestRunSeparate::run-multimodule.test::testMultiModuleTraitInheritance_separate
FAILED mypyc/test/test_run.py::TestRunSeparate::run-multimodule.test::testMultiModuleCycleWithInheritance_separate
FAILED mypyc/test/test_run.py::TestRunSeparate::run-multimodule.test::testImportCycleWithNonCompiledModule_separate
FAILED mypyc/test/test_run.py::TestRunSeparate::run-multimodule.test::testImportCycleWithTopLevelStatements_separate
FAILED mypyc/test/test_run.py::TestRunSeparate::run-multimodule.test::testMultiModuleCycleIfMypy2_separate
FAILED mypyc/test/test_run.py::TestRunSeparate::run-multimodule.test::testMultiModuleCycleIfMypy1_separate
FAILED mypyc/test/test_run.py::TestRunSeparate::run-multimodule.test::testMultiModuleRelative_separate
FAILED mypyc/test/test_run.py::TestRunSeparate::run-multimodule.test::testMultiModuleCrash_separate
FAILED mypyc/test/test_run.py::TestRunSeparate::run-multimodule.test::testTrivialIncremental_separate
FAILED mypyc/test/test_run.py::TestRunSeparate::run-multimodule.test::testIncrementalCompilation1_separate
FAILED mypyc/test/test_run.py::TestRunSeparate::run-multimodule.test::testIncrementalCompilation2_separate
FAILED mypyc/test/test_run.py::TestRunSeparate::run-multimodule.test::testIncrementalCompilation3_separate
FAILED mypyc/test/test_run.py::TestRunSeparate::run-multimodule.test::testIncrementalCompilation4_separate
FAILED mypyc/test/test_run.py::TestRunSeparate::run-multimodule.test::testIncrementalCompilation5_separate
FAILED mypyc/test/test_run.py::TestRunSeparate::run-multimodule.test::testIncrementalCompilation6_separate
FAILED mypyc/test/test_run.py::TestRunSeparate::run-mypy-sim.test::testSimulateMypy_separate
===== 350 failed, 9328 passed, 371 skipped, 7 xfailed in 704.52s (0:11:44) =====

Most of the errors looks like last one quoted and 
```console
[tkloczko@ss-desktop SPECS]$ grep Werror=cpp python-mypy.out  | wc -l
324

So that number is almost equal to total number of pytest units failing.
Your Environment

  • Mypy version used: 0.931
  • Mypy command-line flags: compiler flags passed to pytest env are in above log.
  • Mypy configuration options from mypy.ini (and other config files): N/A
  • Python version used: 3.8.12
  • Operating system and version: Linux x86/64

Will try to perform whole build (I'm building mypy as rpm package) with -Wno-error=cpp to separate all most of the units failing by compiler error.
@kloczek kloczek added the bug mypy got something wrong label Jan 9, 2022
@kloczek
Copy link
Author

kloczek commented Jan 10, 2022

Will try to perform whole build (I'm building mypy as rpm package) with -Wno-error=cpp to separate all most of the units failing by compiler error.

And indeed that helped reduce number of errors as predicted.

=========================== short test summary info ============================
SKIPPED [32] mypy/test/data.py:256: Skipped
SKIPPED [214] mypy/test/testfinegrained.py:77: Skipped
SKIPPED [72] mypy/test/testparse.py:69: Skipped
SKIPPED [1] mypy/test/testipc.py:59: unconditional skip
SKIPPED [1] mypy/test/teststubgen.py:475: Tests building the paths common ancestor on Windows
SKIPPED [1] mypy/test/testsubtypes.py:70: unconditional skip
SKIPPED [1] mypy/test/testtypes.py:738: unconditional skip
SKIPPED [1] mypy/test/testtypes.py:730: unconditional skip
SKIPPED [1] mypy/test/testtypes.py:723: unconditional skip
SKIPPED [1] mypy/test/testtypes.py:717: unconditional skip
SKIPPED [1] mypy/test/testtypes.py:984: unconditional skip
SKIPPED [43] mypy/test/testpythoneval.py:68: Skipped
SKIPPED [2] mypy/test/testpep561.py:95: Skipped
XFAIL mypy/test/testcheck.py::TypeCheckSuite::check-typeguard.test::testTypeGuardNestedRestrictionUnionIsInstance
XFAIL mypy/test/testcheck.py::TypeCheckSuite::check-typeguard.test::testTypeGuardMultipleCondition
XFAIL mypy/test/testcheck.py::TypeCheckSuite::check-singledispatch.test::testImplementationHasSameDispatchTypeAsFallback
XFAIL mypy/test/testcheck.py::TypeCheckSuite::check-singledispatch.test::testRegisterHasDifferentTypeThanTypeSignature
XFAIL mypy/test/testcheck.py::TypeCheckSuite::check-singledispatch.test::testDispatchBasedOnTypeAnnotationsRequires37
XFAIL mypyc/test/test_run.py::TestRun::run-singledispatch.test::testSingleDispatchMethod
XFAIL mypyc/test/test_run.py::TestRun::run-singledispatch.test::testSingleDispatchMethodWithOtherDecorator
FAILED mypy/test/teststubtest.py::StubtestUnit::test_arg_mismatch - Assertion...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_arg_name - AssertionErro...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_bad_literal - AssertionE...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_basic_good - AssertionEr...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_decorator - AssertionErr...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_default_value - Assertio...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_enum - AssertionError: t...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_good_literal - Assertion...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_missing - AssertionError...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_missing_no_runtime_all
FAILED mypy/test/teststubtest.py::StubtestUnit::test_mro - AssertionError: te...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_name_mangling - Assertio...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_non_public_1 - Assertion...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_non_public_2 - Assertion...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_overload - AssertionErro...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_property - AssertionErro...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_special_dunders - Assert...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_static_class_method - As...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_type_alias - AssertionEr...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_types - AssertionError: ...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_var - AssertionError: te...
FAILED mypy/test/teststubtest.py::StubtestUnit::test_varargs_varkwargs - Asse...
FAILED mypy/test/teststubtest.py::StubtestMiscUnit::test_allowlist - Assertio...
FAILED mypy/test/teststubtest.py::StubtestMiscUnit::test_config_file - Assert...
FAILED mypy/test/teststubtest.py::StubtestMiscUnit::test_ignore_flags - Asser...
FAILED mypy/test/teststubtest.py::StubtestMiscUnit::test_output - AssertionEr...
===== 26 failed, 9652 passed, 371 skipped, 7 xfailed in 756.72s (0:12:36) ======

Because whole rpm %check log is still 80KB long I'm attaching that file instead c&p.
python-mypy_pytest_log.txt

I'm going to --deselect for now all remaining failing units to have some product with which I would be able to play with pytest-mypy.
Please let me know what do you think about all above. If you see some missing bit in my build env or want me to do some additional diagnostics please let me know about that :)

@kloczek
Copy link
Author

kloczek commented Apr 1, 2022

Just tested 0.940 and looks lik ethat version passes pytest without errors/fails 😄

+ PYTHONPATH=/home/tkloczko/rpmbuild/BUILDROOT/python-mypy-0.940-2.fc35.x86_64/usr/lib64/python3.8/site-packages:/home/tkloczko/rpmbuild/BUILDROOT/python-mypy-0.940-2.fc35.x86_64/usr/lib/python3.8/site-packages
+ /usr/bin/pytest -ra
=========================================================================== test session starts ============================================================================
platform linux -- Python 3.8.12, pytest-7.1.1, pluggy-1.0.0
rootdir: /home/tkloczko/rpmbuild/BUILD/mypy-0.940, configfile: pytest.ini, testpaths: mypy/test, mypyc/test
plugins: forked-1.4.0, cov-3.0.0, xdist-2.5.0
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I / gw8 I / gw9 I / gw10 I / gw11 I / gw12 I / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gwgw0 C / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I / gw8 I / gw9 I / gw10 I / gw11 I / gw12 I / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gwgw0 C / gw1 C / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I / gw8 I / gw9 I / gw10 I / gw11 I / gw12 I / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gwgw0 C / gw1 C / gw2 C / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I / gw8 I / gw9 I / gw10 I / gw11 I / gw12 I / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gwgw0 C / gw1 C / gw2 C / gw3 C / gw4 I / gw5 I / gw6 I / gw7 I / gw8 I / gw9 I / gw10 I / gw11 I / gw12 I / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gwgw0 C / gw1 C / gw2 C / gw3 C / gw4 C / gw5 I / gw6 I / gw7 I / gw8 I / gw9 I / gw10 I / gw11 I / gw12 I / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gwgw0 C / gw1 C / gw2 C / gw3 C / gw4 C / gw5 C / gw6 I / gw7 I / gw8 I / gw9 I / gw10 I / gw11 I / gw12 I / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gwgw0 C / gw1 C / gw2 C / gw3 C / gw4 C / gw5 C / gw6 C / gw7 I / gw8 I / gw9 I / gw10 I / gw11 I / gw12 I / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gwgw0 C / gw1 C / gw2 C / gw3 C / gw4 C / gw5 C / gw6 C / gw7 C / gw8 I / gw9 I / gw10 I / gw11 I / gw12 I / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gwgw0 C / gw1 C / gw2 C / gw3 C / gw4 C / gw5 C / gw6 C / gw7 C / gw8 C / gw9 I / gw10 I / gw11 I / gw12 I / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gwgw0 C / gw1 C / gw2 C / gw3 C / gw4 C / gw5 C / gw6 C / gw7 C / gw8 C / gw9 C / gw10 I / gw11 I / gw12 I / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gwgw0 C / gw1 C / gw2 C / gw3 C / gw4 C / gw5 C / gw6 C / gw7 C / gw8 C / gw9 C / gw10 C / gw11 I / gw12 I / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gwgw0 C / gw1 C / gw2 C / gw3 C / gw4 C / gw5 C / gw6 C / gw7 C / gw8 C / gw9 C / gw10 C / gw11 C / gw12 I / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gwgw0 C / gw1 C / gw2 C / gw3 C / gw4 C / gw5 C / gw6 C / gw7 C / gw8 C / gw9 C / gw10 C / gw11 C / gw12 C / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gwgw0 C / gw1 C / gw2 C / gw3 C / gw4 C / gw5 C / gw6 C / gw7 C / gw8 C / gw9 C / gw10 C / gw11 C / gw12 C / gw13 C / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gwgw0 C / gw1 C / gw2 C / gw3 C / gw4 C / gw5 C / gw6 C / gw7 C / gw8 C / gw9 C / gw10 C / gw11 C / gw12 C / gw13 C / gw14 C / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gwgw0 C / gw1 C / gw2 C / gw3 C / gw4 C / gw5 C / gw6 C / gw7 C / gw8 C / gw9 C / gw10 C / gw11 C / gw12 C / gw13 C / gw14 C / gw15 C / gw16 I / gw17 I / gw18 I / gw19 I / gwgw0 C / gw1 C / gw2 C / gw3 C / gw4 C / gw5 C / gw6 C / gw7 C / gw8 C / gw9 C / gw10 C / gw11 C / gw12 C / gw13 C / gw14 C / gw15 C / gw16 C / gw17 I / gw18 I / gw19 I / gwgw0 C / gw1 C / gw2 C / gw3 C / gw4 C / gw5 C / gw6 C / gw7 C / gw8 C / gw9 C / gw10 C / gw11 C / gw12 C / gw13 C / gw14 C / gw15 C / gw16 C / gw17 C / gw18 I / gw19 I / gwgw0 C / gw1 C / gw2 C / gw3 C / gw4 C / gw5 C / gw6 C / gw7 C / gw8 C / gw9 C / gw10 C / gw11 C / gw12 C / gw13 C / gw14 C / gw15 C / gw16 C / gw17 C / gw18 C / gw19 I / gwgw0 C / gw1 C / gw2 C / gw3 C / gw4 C / gw5 C / gw6 C / gw7 C / gw8 C / gw9 C / gw10 C / gw11 C / gw12 C / gw13 C / gw14 C / gw15 C / gw16 C / gw17 C / gw18 C / gw19 C / gwgw0 C / gw1 C / gw2 C / gw3 C / gw4 C / gw5 C / gw6 C / gw7 C / gw8 C / gw9 C / gw10 C / gw11 C / gw12 C / gw13 C / gw14 C / gw15 C / gw16 C / gw17 C / gw18 C / gw19 C / gwgw0 C / gw1 C / gw2 C / gw3 C / gw4 C / gw5 C / gw6 C / gw7 C / gw8 C / gw9 C / gw10 C / gw11 C / gw12 C / gw13 C / gw14 C / gw15 C / gw16 C / gw17 C / gw18 C / gw19 C / gwgw0 C / gw1 C / gw2 C / gw3 C / gw4 C / gw5 C / gw6 C / gw7 C / gw8 C / gw9 C / gw10 C / gw11 C / gw12 C / gw13 C / gw14 C / gw15 C / gw16 C / gw17 C / gw18 C / gw19 C / gwgw0 C / gw1 C / gw2 C / gw3 C / gw4 C / gw5 C / gw6 C / gw7 C / gw8 C / gw9 C / gw10 C / gw11 C / gw12 C / gw13 C / gw14 C / gw15 C / gw16 C / gw17 C / gw18 C / gw19 C / gwgw0 ok / gw1 C / gw2 C / gw3 C / gw4 C / gw5 C / gw6 C / gw7 C / gw8 C / gw9 C / gw10 C / gw11 C / gw12 C / gw13 C / gw14 C / gw15 C / gw16 C / gw17 C / gw18 C / gw19 C / ggw0 ok / gw1 ok / gw2 C / gw3 C / gw4 C / gw5 C / gw6 C / gw7 C / gw8 C / gw9 C / gw10 C / gw11 C / gw12 C / gw13 C / gw14 C / gw15 C / gw16 C / gw17 C / gw18 C / gw19 C / gw0 ok / gw1 ok / gw2 ok / gw3 C / gw4 C / gw5 C / gw6 C / gw7 C / gw8 C / gw9 C / gw10 C / gw11 C / gw12 C / gw13 C / gw14 C / gw15 C / gw16 C / gw17 C / gw18 C / gw19 C /gw0 ok / gw1 ok / gw2 ok / gw3 ok / gw4 C / gw5 C / gw6 C / gw7 C / gw8 C / gw9 C / gw10 C / gw11 C / gw12 C / gw13 C / gw14 C / gw15 C / gw16 C / gw17 C / gw18 C / gw19 C gw0 ok / gw1 ok / gw2 ok / gw3 ok / gw4 ok / gw5 C / gw6 C / gw7 C / gw8 C / gw9 C / gw10 C / gw11 C / gw12 C / gw13 C / gw14 C / gw15 C / gw16 C / gw17 C / gw18 C / gw19 Cgw0 ok / gw1 ok / gw2 ok / gw3 ok / gw4 ok / gw5 ok / gw6 C / gw7 C / gw8 C / gw9 C / gw10 C / gw11 C / gw12 C / gw13 C / gw14 C / gw15 C / gw16 C / gw17 C / gw18 C / gw19 gw0 ok / gw1 ok / gw2 ok / gw3 ok / gw4 ok / gw5 ok / gw6 ok / gw7 C / gw8 C / gw9 C / gw10 C / gw11 C / gw12 C / gw13 C / gw14 C / gw15 C / gw16 C / gw17 C / gw18 C / gw19gw0 ok / gw1 ok / gw2 ok / gw3 ok / gw4 ok / gw5 ok / gw6 ok / gw7 ok / gw8 C / gw9 C / gw10 C / gw11 C / gw12 C / gw13 C / gw14 C / gw15 C / gw16 C / gw17 C / gw18 C / gw1gw0 ok / gw1 ok / gw2 ok / gw3 ok / gw4 ok / gw5 ok / gw6 ok / gw7 ok / gw8 ok / gw9 C / gw10 C / gw11 C / gw12 C / gw13 C / gw14 C / gw15 C / gw16 C / gw17 C / gw18 C / gwgw0 ok / gw1 ok / gw2 ok / gw3 ok / gw4 ok / gw5 ok / gw6 ok / gw7 ok / gw8 ok / gw9 ok / gw10 C / gw11 C / gw12 C / gw13 C / gw14 C / gw15 C / gw16 C / gw17 C / gw18 C / ggw0 ok / gw1 ok / gw2 ok / gw3 ok / gw4 ok / gw5 ok / gw6 ok / gw7 ok / gw8 ok / gw9 ok / gw10 ok / gw11 C / gw12 C / gw13 C / gw14 C / gw15 C / gw16 C / gw17 C / gw18 C / gw0 ok / gw1 ok / gw2 ok / gw3 ok / gw4 ok / gw5 ok / gw6 ok / gw7 ok / gw8 ok / gw9 ok / gw10 ok / gw11 ok / gw12 C / gw13 C / gw14 C / gw15 C / gw16 C / gw17 C / gw18 C /gw0 ok / gw1 ok / gw2 ok / gw3 ok / gw4 ok / gw5 ok / gw6 ok / gw7 ok / gw8 ok / gw9 ok / gw10 ok / gw11 ok / gw12 ok / gw13 C / gw14 C / gw15 C / gw16 C / gw17 C / gw18 C gw0 ok / gw1 ok / gw2 ok / gw3 ok / gw4 ok / gw5 ok / gw6 ok / gw7 ok / gw8 ok / gw9 ok / gw10 ok / gw11 ok / gw12 ok / gw13 ok / gw14 C / gw15 C / gw16 C / gw17 C / gw18 Cgw0 ok / gw1 ok / gw2 ok / gw3 ok / gw4 ok / gw5 ok / gw6 ok / gw7 ok / gw8 ok / gw9 ok / gw10 ok / gw11 ok / gw12 ok / gw13 ok / gw14 ok / gw15 C / gw16 C / gw17 C / gw18 gw0 ok / gw1 ok / gw2 ok / gw3 ok / gw4 ok / gw5 ok / gw6 ok / gw7 ok / gw8 ok / gw9 ok / gw10 ok / gw11 ok / gw12 ok / gw13 ok / gw14 ok / gw15 ok / gw16 C / gw17 C / gw18gw0 ok / gw1 ok / gw2 ok / gw3 ok / gw4 ok / gw5 ok / gw6 ok / gw7 ok / gw8 ok / gw9 ok / gw10 ok / gw11 ok / gw12 ok / gw13 ok / gw14 ok / gw15 ok / gw16 ok / gw17 C / gw1gw0 ok / gw1 ok / gw2 ok / gw3 ok / gw4 ok / gw5 ok / gw6 ok / gw7 ok / gw8 ok / gw9 ok / gw10 ok / gw11 ok / gw12 ok / gw13 ok / gw14 ok / gw15 ok / gw16 ok / gw17 ok / gwgw0 ok / gw1 ok / gw2 ok / gw3 ok / gw4 ok / gw5 ok / gw6 ok / gw7 ok / gw8 ok / gw9 ok / gw10 ok / gw11 ok / gw12 ok / gw13 ok / gw14 ok / gw15 ok / gw16 ok / gw17 ok / gwgw0 ok / gw1 ok / gw2 ok / gw3 ok / gw4 ok / gw5 ok / gw6 ok / gw7 ok / gw8 ok / gw9 ok / gw10 ok / gw11 ok / gw12 ok / gw13 ok / gw14 ok / gw15 ok / gw16 ok / gw17 ok / gwgw0 ok / gw1 ok / gw2 ok / gw3 ok / gw4 ok / gw5 ok / gw6 ok / gw7 ok / gw8 ok / gw9 ok / gw10 ok / gw11 ok / gw12 ok / gw13 ok / gw14 ok / gw15 ok / gw16 ok / gw17 ok / gwgw0 ok / gw1 ok / gw2 ok / gw3 ok / gw4 ok / gw5 ok / gw6 ok / gw7 ok / gw8 ok / gw9 ok / gw10 ok / gw11 ok / gw12 ok / gw13 ok / gw14 ok / gw15 ok / gw16 ok / gw17 ok / gwgw0 ok / gw1 ok / gw2 ok / gw3 ok / gw4 ok / gw5 ok / gw6 ok / gw7 ok / gw8 ok / gw9 ok / gw10 ok / gw11 ok / gw12 ok / gw13 ok / gw14 ok / gw15 ok / gw16 ok / gw17 ok / gwgw0 ok / gw1 ok / gw2 ok / gw3 ok / gw4 ok / gw5 ok / gw6 ok / gw7 ok / gw8 ok / gw9 ok / gw10 ok / gw11 ok / gw12 ok / gw13 ok / gw14 ok / gw15 ok / gw16 ok / gw17 ok / gwgw0 [10166] / gw1 ok / gw2 ok / gw3 ok / gw4 ok / gw5 ok / gw6 ok / gw7 ok / gw8 ok / gw9 ok / gw10 ok / gw11 ok / gw12 ok / gw13 ok / gw14 ok / gw15 ok / gw16 ok / gw17 okgw0 [10166] / gw1 [10166] / gw2 ok / gw3 ok / gw4 ok / gw5 ok / gw6 ok / gw7 ok / gw8 ok / gw9 ok / gw10 ok / gw11 ok / gw12 ok / gw13 ok / gw14 ok / gw15 ok / gw16 ok / gwgw0 [10166] / gw1 [10166] / gw2 [10166] / gw3 ok / gw4 ok / gw5 ok / gw6 ok / gw7 ok / gw8 ok / gw9 ok / gw10 ok / gw11 ok / gw12 ok / gw13 ok / gw14 ok / gw15 ok / gw16 okgw0 [10166] / gw1 [10166] / gw2 [10166] / gw3 [10166] / gw4 ok / gw5 ok / gw6 ok / gw7 ok / gw8 ok / gw9 ok / gw10 ok / gw11 ok / gw12 ok / gw13 ok / gw14 ok / gw15 ok / gwgw0 [10166] / gw1 [10166] / gw2 [10166] / gw3 [10166] / gw4 [10166] / gw5 ok / gw6 ok / gw7 ok / gw8 ok / gw9 ok / gw10 ok / gw11 ok / gw12 ok / gw13 ok / gw14 ok / gw15 okgw0 [10166] / gw1 [10166] / gw2 [10166] / gw3 [10166] / gw4 [10166] / gw5 [10166] / gw6 ok / gw7 ok / gw8 ok / gw9 ok / gw10 ok / gw11 ok / gw12 ok / gw13 ok / gw14 ok / gwgw0 [10166] / gw1 [10166] / gw2 [10166] / gw3 [10166] / gw4 [10166] / gw5 [10166] / gw6 ok / gw7 [10166] / gw8 ok / gw9 ok / gw10 ok / gw11 ok / gw12 ok / gw13 ok / gw14 okgw0 [10166] / gw1 [10166] / gw2 [10166] / gw3 [10166] / gw4 [10166] / gw5 [10166] / gw6 [10166] / gw7 [10166] / gw8 ok / gw9 ok / gw10 ok / gw11 ok / gw12 ok / gw13 ok / gwgw0 [10166] / gw1 [10166] / gw2 [10166] / gw3 [10166] / gw4 [10166] / gw5 [10166] / gw6 [10166] / gw7 [10166] / gw8 [10166] / gw9 ok / gw10 ok / gw11 ok / gw12 ok / gw13 okgw0 [10166] / gw1 [10166] / gw2 [10166] / gw3 [10166] / gw4 [10166] / gw5 [10166] / gw6 [10166] / gw7 [10166] / gw8 [10166] / gw9 ok / gw10 ok / gw11 [10166] / gw12 ok / gwgw0 [10166] / gw1 [10166] / gw2 [10166] / gw3 [10166] / gw4 [10166] / gw5 [10166] / gw6 [10166] / gw7 [10166] / gw8 [10166] / gw9 ok / gw10 ok / gw11 [10166] / gw12 ok / gwgw0 [10166] / gw1 [10166] / gw2 [10166] / gw3 [10166] / gw4 [10166] / gw5 [10166] / gw6 [10166] / gw7 [10166] / gw8 [10166] / gw9 [10166] / gw10 ok / gw11 [10166] / gw12 okgw0 [10166] / gw1 [10166] / gw2 [10166] / gw3 [10166] / gw4 [10166] / gw5 [10166] / gw6 [10166] / gw7 [10166] / gw8 [10166] / gw9 [10166] / gw10 ok / gw11 [10166] / gw12 okgw0 [10166] / gw1 [10166] / gw2 [10166] / gw3 [10166] / gw4 [10166] / gw5 [10166] / gw6 [10166] / gw7 [10166] / gw8 [10166] / gw9 [10166] / gw10 [10166] / gw11 [10166] / gwgw0 [10166] / gw1 [10166] / gw2 [10166] / gw3 [10166] / gw4 [10166] / gw5 [10166] / gw6 [10166] / gw7 [10166] / gw8 [10166] / gw9 [10166] / gw10 [10166] / gw11 [10166] / gwgw0 [10166] / gw1 [10166] / gw2 [10166] / gw3 [10166] / gw4 [10166] / gw5 [10166] / gw6 [10166] / gw7 [10166] / gw8 [10166] / gw9 [10166] / gw10 [10166] / gw11 [10166] / gwgw0 [10166] / gw1 [10166] / gw2 [10166] / gw3 [10166] / gw4 [10166] / gw5 [10166] / gw6 [10166] / gw7 [10166] / gw8 [10166] / gw9 [10166] / gw10 [10166] / gw11 [10166] / gwgw0 [10166] / gw1 [10166] / gw2 [10166] / gw3 [10166] / gw4 [10166] / gw5 [10166] / gw6 [10166] / gw7 [10166] / gw8 [10166] / gw9 [10166] / gw10 [10166] / gw11 [10166] / gwgw0 [10166] / gw1 [10166] / gw2 [10166] / gw3 [10166] / gw4 [10166] / gw5 [10166] / gw6 [10166] / gw7 [10166] / gw8 [10166] / gw9 [10166] / gw10 [10166] / gw11 [10166] / gwgw0 [10166] / gw1 [10166] / gw2 [10166] / gw3 [10166] / gw4 [10166] / gw5 [10166] / gw6 [10166] / gw7 [10166] / gw8 [10166] / gw9 [10166] / gw10 [10166] / gw11 [10166] / gwgw0 [10166] / gw1 [10166] / gw2 [10166] / gw3 [10166] / gw4 [10166] / gw5 [10166] / gw6 [10166] / gw7 [10166] / gw8 [10166] / gw9 [10166] / gw10 [10166] / gw11 [10166] / gwgw0 [10166] / gw1 [10166] / gw2 [10166] / gw3 [10166] / gw4 [10166] / gw5 [10166] / gw6 [10166] / gw7 [10166] / gw8 [10166] / gw9 [10166] / gw10 [10166] / gw11 [10166] / gwgw0 [10166] / gw1 [10166] / gw2 [10166] / gw3 [10166] / gw4 [10166] / gw5 [10166] / gw6 [10166] / gw7 [10166] / gw8 [10166] / gw9 [10166] / gw10 [10166] / gw11 [10166] / gwgw0 [10166] / gw1 [10166] / gw2 [10166] / gw3 [10166] / gw4 [10166] / gw5 [10166] / gw6 [10166] / gw7 [10166] / gw8 [10166] / gw9 [10166] / gw10 [10166] / gw11 [10166] / gw12 [10166] / gw13 [10166] / gw14 [10166] / gw15 [10166] / gw16 [10166] / gw17 [10166] / gw18 [10166] / gw19 [10166] / gw20 [10166] / gw21 [10166] / gw22 [10166] / gw23 [10166]
.....................s.....................................................................................................................x........................ [  1%]
.................................................................................................................................................................... [  3%]
.................................................................................................................................................................... [  4%]
.................................................................................................................................................................... [  6%]
.................................................................................................................................................s.................. [  8%]
...............................s...........................................................s........................................................................ [  9%]
s................................................................................................................................................................... [ 11%]
.................................................................................................................................................................... [ 12%]
.................................................................................................................................................................... [ 14%]
................................................................s.................................................................................................... [ 16%]
.................................................................................................................................................................... [ 17%]
.................................................................................................................................................................... [ 19%]
.................................................................................................................................................................... [ 20%]
....................................................s............................................................................................................... [ 22%]
...................................................................................................................................................................... [ 24%]
.................................................................................................................................................................... [ 25%]
.....................s.............................................................................................................................................. [ 27%]
.................................................................................................................................................................... [ 29%]
.................s..s............................................................................................................................................... [ 30%]
.................................................................................................................................................................... [ 32%]
.................................................................................................................................................................... [ 33%]
.................................................................................................................................................................... [ 35%]
.................................................................................................................................................................... [ 37%]
.................................................................................................................................................................... [ 38%]
.................................................................................................................................................................... [ 40%]
..........................................................................................................................s......................................... [ 41%]
.................................................................................................................................................................... [ 43%]
...s.......................................................s..........................................................s............................................. [ 45%]
.................................................................................................................................................................s.. [ 46%]
.................................................................................................................................................................... [ 48%]
.........x.....................................x..................................................................................................................... [ 50%]
.................s.................................................................................................................................................. [ 51%]
.................................................................................................................................................................... [ 53%]
..................................................................................................................................................................... [ 54%]
......................................................................................................................s.............................................. [ 56%]
.ss.ss.s.ss..s..............................................................................................................................................s....... [ 58%]
.......................s..................s...s......................................................s...............s.............................................. [ 59%]
..................ss........s......................................s...............................................s.ss..ss.s..................................s.... [ 61%]
.....s............s......s..............ss..ss............s..sss.s..ss..............s.......s...............................s.ssssssss.........s....s.............ss.. [ 62%]
s.ssss.sssssssss..s.......s.s.s.s.ss.s.s.s.s....................s...............................................sss...........ss...........................s....s.s. [ 64%]
.s.........................s........sss.s...........................ssss.s...........s..........s...s.......s..ss..s.ss...ss.....s..s....s...........s........s..... [ 66%]
.....s..s............s...s.ss....s..s................s....s.............s.s...........................................ssss..sssssss.sssss.ss.s.ssss..ss...ssssssssss [ 67%]
ssssssssss...ssssss.s.s..ss..sss.................................................sssss....s..ss.ssss......ss.......ssss...s..................s...........sss...ss.ss [ 69%]
sss.sssssss...ssss..ss.sssss....s...sssss.ssssssssss...ss.ssssss.ssssssss..........ssss.................s.....ss...................s............s....s.....s......s. [ 71%]
.....s.......................................................s......s........................s.................................s..s..........s.s..s................. [ 72%]
.....................s..s........s....sss.ss.................s..................s...sss.......s..............s..........s.............s.............s.....ssss..s... [ 74%]
......s..........s...........s.........s..s.............s...........s..............s........s...s.......s....s......s.............s..............s..............s... [ 75%]
.....s............s...........s..................................................................................................................................... [ 77%]
........................s........................................................................................................................................... [ 79%]
.................................................................................................................................................................... [ 80%]
.................................................................................................................................................................... [ 82%]
..........................s......................................................................................................................................... [ 83%]
................................................s..................................................................................s................................ [ 85%]
.......s.......................................s.ss................................................................................................................. [ 87%]
............................x..........s...s.....s..................................................................x............................................... [ 88%]
........................x..............................................................................................................x............................ [ 90%]
.................................................................................................................................s.................................. [ 92%]
.................................................................................................................................................................... [ 93%]
.................................................................................................................................................................... [ 95%]
.............................................................................................ss..sss.s..s...s...s.s................................................. [ 96%]
..................................................x.....x......................................................................................................s.s.. [ 98%]
........................................................................................s......................s..........................................           [100%]
========================================================================= short test summary info ==========================================================================
SKIPPED [32] mypy/test/data.py:256: Skipped
SKIPPED [214] mypy/test/testfinegrained.py:78: Skipped
SKIPPED [72] mypy/test/testparse.py:74: Skipped
SKIPPED [1] mypy/test/testipc.py:59: unconditional skip
SKIPPED [43] mypy/test/testpythoneval.py:68: Skipped
SKIPPED [1] mypy/test/teststubgen.py:475: Tests building the paths common ancestor on Windows
SKIPPED [1] mypy/test/testsubtypes.py:70: unconditional skip
SKIPPED [1] mypy/test/testtypes.py:739: unconditional skip
SKIPPED [1] mypy/test/testtypes.py:985: unconditional skip
SKIPPED [1] mypy/test/testtypes.py:731: unconditional skip
SKIPPED [1] mypy/test/testtypes.py:724: unconditional skip
SKIPPED [1] mypy/test/testtypes.py:718: unconditional skip
SKIPPED [2] mypy/test/testpep561.py:95: Skipped
XFAIL mypy/test/testcheck.py::TypeCheckSuite::check-union-or-syntax.test::testImplicit604TypeAliasWithCyclicImportNotInStub
XFAIL mypy/test/testcheck.py::TypeCheckSuite::check-typeguard.test::testTypeGuardNestedRestrictionUnionIsInstance
XFAIL mypy/test/testcheck.py::TypeCheckSuite::check-typeguard.test::testTypeGuardMultipleCondition
XFAIL mypy/test/testcheck.py::TypeCheckSuite::check-singledispatch.test::testImplementationHasSameDispatchTypeAsFallback
XFAIL mypy/test/testcheck.py::TypeCheckSuite::check-singledispatch.test::testRegisterHasDifferentTypeThanTypeSignature
XFAIL mypy/test/testcheck.py::TypeCheckSuite::check-singledispatch.test::testDispatchBasedOnTypeAnnotationsRequires37
XFAIL mypy/test/testpythoneval.py::PythonEvaluationSuite::pythoneval.test::testAsyncioGatherPreciseType
XFAIL mypyc/test/test_run.py::TestRun::run-singledispatch.test::testSingleDispatchMethodWithOtherDecorator
XFAIL mypyc/test/test_run.py::TestRun::run-singledispatch.test::testSingleDispatchMethod
========================================================= 9786 passed, 371 skipped, 9 xfailed in 222.36s (0:03:42) =========================================================
/usr/lib/python3.8/site-packages/_pytest/pathlib.py:79: PytestWarning: (rm_rf) error removing /tmp/pytest-of-tkloczko/garbage-091cddb2-8f40-498e-bae4-779754454c9d/test_rmtree_errorhandler_rerai0
<class 'OSError'>: [Errno 39] Directory not empty: 'test_rmtree_errorhandler_rerai0'
  warnings.warn(
/usr/lib/python3.8/site-packages/_pytest/pathlib.py:79: PytestWarning: (rm_rf) error removing /tmp/pytest-of-tkloczko/garbage-091cddb2-8f40-498e-bae4-779754454c9d/test_rmtree_errorhandler_reado0
<class 'OSError'>: [Errno 39] Directory not empty: 'test_rmtree_errorhandler_reado0'
  warnings.warn(
/usr/lib/python3.8/site-packages/_pytest/pathlib.py:79: PytestWarning: (rm_rf) error removing /tmp/pytest-of-tkloczko/garbage-091cddb2-8f40-498e-bae4-779754454c9d/test_safe_delete_no_perms0
<class 'OSError'>: [Errno 39] Directory not empty: 'test_safe_delete_no_perms0'
  warnings.warn(
/usr/lib/python3.8/site-packages/_pytest/pathlib.py:79: PytestWarning: (rm_rf) error removing /tmp/pytest-of-tkloczko/garbage-091cddb2-8f40-498e-bae4-779754454c9d/test_safe_set_no_perms0
<class 'OSError'>: [Errno 39] Directory not empty: 'test_safe_set_no_perms0'
  warnings.warn(
/usr/lib/python3.8/site-packages/_pytest/pathlib.py:79: PytestWarning: (rm_rf) error removing /tmp/pytest-of-tkloczko/garbage-091cddb2-8f40-498e-bae4-779754454c9d/test_safe_get_no_perms0
<class 'OSError'>: [Errno 39] Directory not empty: 'test_safe_get_no_perms0'
  warnings.warn(
/usr/lib/python3.8/site-packages/_pytest/pathlib.py:79: PytestWarning: (rm_rf) error removing /tmp/pytest-of-tkloczko/garbage-091cddb2-8f40-498e-bae4-779754454c9d
<class 'OSError'>: [Errno 39] Directory not empty: '/tmp/pytest-of-tkloczko/garbage-091cddb2-8f40-498e-bae4-779754454c9d'
  warnings.warn(

Thank you and closing.

@kloczek kloczek closed this as completed Apr 1, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug mypy got something wrong topic-stubtest topic-tests
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@JelleZijlstra @kloczek