Skip to content

Pkg.test("Test") fails #57723

Open
Open
@KristofferC

Description

@KristofferC

Unclear why it passes in the Base test suite.

(@v1.13) pkg> test Test
     Testing Test
      Status `/private/var/folders/tp/2p4x9ygx48sgsdl1ccg1mp_40000gn/T/jl_Oao9PR/Project.toml`
  [8ba89e20] Distributed v1.11.0
  [b77e0a4c] InteractiveUtils v1.11.0
  [56ddb016] Logging v1.11.0
  [9a3f8284] Random v1.11.0
  [9e88b42a] Serialization v1.11.0
  [8dfed614] Test v1.11.0
      Status `/private/var/folders/tp/2p4x9ygx48sgsdl1ccg1mp_40000gn/T/jl_Oao9PR/Manifest.toml`
  [2a0f44e3] Base64 v1.11.0
  [8ba89e20] Distributed v1.11.0
  [b77e0a4c] InteractiveUtils v1.11.0
  [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0
  [56ddb016] Logging v1.11.0
  [d6f4376e] Markdown v1.11.0
  [9a3f8284] Random v1.11.0
  [ea8e919c] SHA v0.7.0
  [9e88b42a] Serialization v1.11.0
  [6462fe0b] Sockets v1.11.0
  [f489334b] StyledStrings v1.11.0
  [8dfed614] Test v1.11.0
     Testing Running tests...
Test Summary: | Pass  Total  Time
@test         |   14     14  0.0s
Test Summary:                 | Pass  Broken  Total  Time
@test with skip/broken kwargs |    5       3      8  0.0s
Test Summary:            | Pass  Total  Time
@test keyword precedence |    4      4  0.0s
Test Summary:                                 | Pass  Total  Time
@test should only evaluate the arguments once |    4      4  0.0s
Test Summary:          | Broken  Total  Time
@test_broken with fail |      5      5  0.0s
Test Summary:            | Broken  Total  Time
@test_broken with errors |      2      2  0.0s
Test Summary: | Broken  Total  Time
@test_skip    |      4      4  0.0s
Test Summary: | Pass  Total  Time
@test_warn    |    7      7  0.0s
Test Summary:                  | Pass  Total  Time
@test and elements of an array |    2      2  0.1s
Test Summary:    | Pass  Total  Time
Pass - exception |   14     14  0.1s
Mock for testing retval of record(::DefaultTestSet, ::T <: Result) methods: Error During Test at An Error Mock:0

Mock for testing retval of record(::DefaultTestSet, ::T <: Result) methods: Test Failed at A Fail Mock:0
  Expression: 1
   Evaluated: 2

Stacktrace:
 [1] backtrace()
   @ Base ./error.jl:124
 [2] record(ts::Test.DefaultTestSet, t::Union{Test.Error, Test.Fail}; print_result::Bool)
   @ Test ~/.julia/juliaup/julia-nightly/share/julia/stdlib/v1.13/Test/src/Test.jl:1115
 [3] record(ts::Test.DefaultTestSet, t::Union{Test.Error, Test.Fail})
   @ Test ~/.julia/juliaup/julia-nightly/share/julia/stdlib/v1.13/Test/src/Test.jl:1108
 [4] macro expansion
   @ ~/.julia/juliaup/julia-nightly/share/julia/stdlib/v1.13/Test/src/Test.jl:676 [inlined]
 [5] macro expansion
   @ ~/.julia/juliaup/julia-nightly/share/julia/stdlib/v1.13/Test/test/runtests.jl:350 [inlined]
 [6] macro expansion
   @ ~/.julia/juliaup/julia-nightly/share/julia/stdlib/v1.13/Test/src/Test.jl:1771 [inlined]
 [7] top-level scope
   @ ~/.julia/juliaup/julia-nightly/share/julia/stdlib/v1.13/Test/test/runtests.jl:344
Test Summary:                  | Pass  Total  Time
printing of a TestSetException |    4      4  0.0s
Test Summary: | Pass  Total  Time
accounting    |    5      5  0.9s
Test Summary:                      | Pass  Total  Time
@testset should return the testset |    1      1  0.0s
Test Summary:                                      | Pass  Total  Time
@testset/for should return an array of testsets: 1 |    1      1  0.0s
Test Summary:                                      | Pass  Total  Time
@testset/for should return an array of testsets: 2 |    1      1  0.0s
Test Summary:                                      | Pass  Total  Time
@testset/for should return an array of testsets: 3 |    1      1  0.0s
Test Summary: | Pass  Total  Time
i = 1         |    1      1  0.0s
Test Summary: | Total  Time
i = 2         |     0  0.0s
Test Summary: | Pass  Total  Time
x = 1         |    1      1  0.0s
Test Summary: | Pass  Total  Time
x = 2         |    3      3  0.0s
Test Summary: | Pass  Total  Time
x = 3         |    1      1  0.0s
Test Summary:                                            | Broken  Total  Time
@test_broken and @test_skip should not give an exception |      3      3  0.0s
Test Summary:                         | Pass  Total  Time
@inferred works with A[i] expressions |    3      3  0.0s
Test Summary:             | Pass  Total  Time
backtraces in test errors |    4      4  1.8s
Test Summary:                                               | Pass  Total  Time
provide informative location in backtrace for test failures |   36     36  2.2s
Test Summary: | Pass  Total  Time
#19750        |    3      3  0.0s
Test Summary:             | Pass  Total  Time
test guarded Random.seed! |    6      6  0.3s
Test Summary:            | Pass  Total  Time
file info in test errors |    3      3  1.7s
Test Summary: | Pass  Total  Time
≈ with atol   |    2      2  1.6s
Test Summary: | Pass  Total  Time
@test_logs    |   19     19  0.5s
Test Summary: | Pass  Total  Time
task 1        |    1      1  0.0s
Test Summary: | Pass  Total  Time
task 2        |    1      1  0.0s
Test Summary:                                          | Pass  Total  Time
@testset preserves GLOBAL_RNG's state, and re-seeds it |   17     17  0.1s
Test Summary:              | Pass  Total  Time
InterruptExceptions #21043 |    2      2  0.6s
Test Summary:                  | Pass  Total  Time
non AbstractTestSet as testset |    1      1  1.1s
Test Summary:         | Pass  Total  Time
keywords in @inferred |   10     10  0.1s
Test Summary:         | Pass  Total  Time
splatting in isapprox |    1      1  0.2s
Test Summary:                             | Pass  Total  Time
treat NaN and missing in exception fields |    4      4  0.0s
Test Summary:                             | Pass  Total  Time
push/pop_testset invariance (Issue 32937) |    1      1  1.6s
Test Summary:  | Pass  Total  Time
verbose option |    1      1  0.5s
Test Summary:   | Pass  Total  Time
failfast option |    4      4  7.2s
Test Summary:                                                | Pass  Total  Time
Soft deprecation of @test_throws LoadError [@]macroexpand[1] |    7      7  0.2s
FieldError Shim tests and Softdeprecation of @test_throws ErrorException: Log Test Failed at /Users/kristoffercarlsson/.julia/juliaup/julia-nightly/share/julia/stdlib/v1.13/Test/test/runtests.jl:1550
  Expression: $(Expr(:escape, :(#= /Users/kristoffercarlsson/.julia/juliaup/julia-nightly/share/julia/stdlib/v1.13/Test/test/runtests.jl:1550 =# @test_throws ErrorException feexc.c)))
  Log Pattern: (:warn, r"deprecated"i, Ignored(), :depwarn) match_mode = :any
  Captured Logs: 
    LogRecord(Warn, "ErrorException should no longer be used to test field access; FieldError should be used instead!", Core, :depwarn, (Ptr{Nothing}(0x00000003107901ff), :do_test_throws), "/Users/kristoffercarlsson/.julia/juliaup/julia-nightly/share/julia/stdlib/v1.13/Test/src/Test.jl", 778, Base.Pairs{Symbol, Any, Tuple{Symbol, Symbol}, @NamedTuple{caller::Base.StackTraces.StackFrame, maxlog::Int64}}(:caller => macro expansion at Test.jl:778 [inlined], :maxlog => 1))

Stacktrace:
 [1] record(ts::Test.DefaultTestSet, t::Test.LogTestFailure)
   @ Test ~/.julia/juliaup/julia-nightly/share/julia/stdlib/v1.13/Test/src/logging.jl:166
 [2] top-level scope
   @ ~/.julia/juliaup/julia-nightly/share/julia/stdlib/v1.13/Test/test/runtests.jl:1544
 [3] macro expansion
   @ ~/.julia/juliaup/julia-nightly/share/julia/stdlib/v1.13/Test/src/Test.jl:1771 [inlined]
 [4] macro expansion
   @ ~/.julia/juliaup/julia-nightly/share/julia/stdlib/v1.13/Test/test/runtests.jl:1550 [inlined]
 [5] macro expansion
   @ ~/.julia/juliaup/julia-nightly/share/julia/stdlib/v1.13/Test/src/logging.jl:340 [inlined]
Test Summary:                                                            | Pass  Fail  Total  Time
FieldError Shim tests and Softdeprecation of @test_throws ErrorException |    3     1      4  1.5s
RNG of the outermost testset: Xoshiro(0x204821ed1f789f4c, 0x063a49213df2eb23, 0x395bfa4cfb7048b0, 0xc6b056e024fb456a, 0xc09540f2c561b20b)
ERROR: LoadError: Some tests did not pass: 3 passed, 1 failed, 0 errored, 0 broken.
in expression starting at /Users/kristoffercarlsson/.julia/juliaup/julia-nightly/share/julia/stdlib/v1.13/Test/test/runtests.jl:1543
ERROR: Package Test errored during testing

Metadata

Metadata

Assignees

No one assigned

    Labels

    testsystemThe unit testing framework and Test stdlib

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions