solve never terminates with threading=true

[AayushSabharwal]

This might be a platform-specific thing. Or related to #560 ?

MWE: (threading = false works as expected)

julia> using HomotopyContinuation
julia> @var x y z
julia> eqs = [
           x^2 + y^2 + 2x*y
           x^2 + 4x + 4
           y * z + 4x^2
       ]
julia> sys = System(eqs)
julia> sol = solve(sys)

This never terminates. I've had it running for upwards of 10 minutes. Nothing is printed either. Interrupting with Ctrl-C does nothing, but if I press it again I get:

julia> sol = solve(sys)
^C^CError showing value of type

And nothing more. Interrupting once more:

^C^CError showing value of type ^CERROR:

Then I interrupt several times more:

^C^CError showing value of type ^CERROR: ^C
^C^C^C^C^C^C^C^C^CWARNING: Force throwing a SIGINT
ERROR:

Then once more:

InterruptException()
safepoint at ./gcutils.jl:255 [inlined]
multiq_deletemin at ./partr.jl:134
trypoptask at ./task.jl:1004
jfptr_trypoptask_65985.1 at /Users/aayush/.julia/juliaup/julia-1.11.0+0.aarch64.apple.darwin14/lib/julia/sys.dylib (unknown line)
get_next_task at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-honeycrisp-XC9YQX9HH2.0/build/default-honeycrisp-XC9YQX9HH2-0/julialang/julia-release-1-dot-11/src/scheduler.c:377 [inlined]
ijl_task_get_next at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-honeycrisp-XC9YQX9HH2.0/build/default-honeycrisp-XC9YQX9HH2-0/julialang/julia-release-1-dot-11/src/scheduler.c:438
poptask at ./task.jl:1012
wait at ./task.jl:1021
task_done_hook at ./task.jl:694
jfptr_task_done_hook_65908.1 at /Users/aayush/.julia/juliaup/julia-1.11.0+0.aarch64.apple.darwin14/lib/julia/sys.dylib (unknown line)
jl_apply at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-honeycrisp-XC9YQX9HH2.0/build/default-honeycrisp-XC9YQX9HH2-0/julialang/julia-release-1-dot-11/src/./julia.h:2157 [inlined]
jl_finish_task at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-honeycrisp-XC9YQX9HH2.0/build/default-honeycrisp-XC9YQX9HH2-0/julialang/julia-release-1-dot-11/src/task.c:319
start_task at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-honeycrisp-XC9YQX9HH2.0/build/default-honeycrisp-XC9YQX9HH2-0/julialang/julia-release-1-dot-11/src/task.c:1213

And then a few more times:

^C^CError showing value of type ^CERROR: ^C
^C^C^C^C^C^C^C^C^CWARNING: Force throwing a SIGINT
ERROR: ^Cfatal: error thrown and no exception handler available.
InterruptException()
safepoint at ./gcutils.jl:255 [inlined]
multiq_deletemin at ./partr.jl:134
trypoptask at ./task.jl:1004
jfptr_trypoptask_65985.1 at /Users/aayush/.julia/juliaup/julia-1.11.0+0.aarch64.apple.darwin14/lib/julia/sys.dylib (unknown line)
get_next_task at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-honeycrisp-XC9YQX9HH2.0/build/default-honeycrisp-XC9YQX9HH2-0/julialang/julia-release-1-dot-11/src/scheduler.c:377 [inlined]
ijl_task_get_next at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-honeycrisp-XC9YQX9HH2.0/build/default-honeycrisp-XC9YQX9HH2-0/julialang/julia-release-1-dot-11/src/scheduler.c:438
poptask at ./task.jl:1012
wait at ./task.jl:1021
task_done_hook at ./task.jl:694
jfptr_task_done_hook_65908.1 at /Users/aayush/.julia/juliaup/julia-1.11.0+0.aarch64.apple.darwin14/lib/julia/sys.dylib (unknown line)
jl_apply at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-honeycrisp-XC9YQX9HH2.0/build/default-honeycrisp-XC9YQX9HH2-0/julialang/julia-release-1-dot-11/src/./julia.h:2157 [inlined]
jl_finish_task at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-honeycrisp-XC9YQX9HH2.0/build/default-honeycrisp-XC9YQX9HH2-0/julialang/julia-release-1-dot-11/src/task.c:319
start_task at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-honeycrisp-XC9YQX9HH2.0/build/default-honeycrisp-XC9YQX9HH2-0/julialang/julia-release-1-dot-11/src/task.c:1213
^CInterruptException:^C
atexit hook threw an error: InterruptException()
safepoint at ./gcutils.jl:255 [inlined]
multiq_deletemin at ./partr.jl:134
trypoptask at ./task.jl:1004
jfptr_trypoptask_65985.1 at /Users/aayush/.julia/juliaup/julia-1.11.0+0.aarch64.apple.darwin14/lib/julia/sys.dylib (unknown line)
get_next_task at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-honeycrisp-XC9YQX9HH2.0/build/default-honeycrisp-XC9YQX9HH2-0/julialang/julia-release-1-dot-11/src/scheduler.c:377 [inlined]
ijl_task_get_next at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-honeycrisp-XC9YQX9HH2.0/build/default-honeycrisp-XC9YQX9HH2-0/julialang/julia-release-1-dot-11/src/scheduler.c:438
poptask at ./task.jl:1012
wait at ./task.jl:1021
uv_write at ./stream.jl:1072
unsafe_write at ./stream.jl:1145
write at ./strings/io.jl:248 [inlined]
print at ./strings/io.jl:250 [inlined]
showerror at ./errorshow.jl:156
unknown function (ip: 0x34250005b)
_atexit at ./initdefs.jl:459
jfptr__atexit_68559.1 at /Users/aayush/.julia/juliaup/julia-1.11.0+0.aarch64.apple.darwin14/lib/julia/sys.dylib (unknown line)
jl_apply at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-honeycrisp-XC9YQX9HH2.0/build/default-honeycrisp-XC9YQX9HH2-0/julialang/julia-release-1-dot-11/src/./julia.h:2157 [inlined]
ijl_atexit_hook at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-honeycrisp-XC9YQX9HH2.0/build/default-honeycrisp-XC9YQX9HH2-0/julialang/julia-release-1-dot-11/src/init.c:271
ijl_exit at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-honeycrisp-XC9YQX9HH2.0/build/default-honeycrisp-XC9YQX9HH2-0/julialang/julia-release-1-dot-11/src/init.c:207
ijl_no_exc_handler at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-honeycrisp-XC9YQX9HH2.0/build/default-honeycrisp-XC9YQX9HH2-0/julialang/julia-release-1-dot-11/src/task.c:698
jl_finish_task at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-honeycrisp-XC9YQX9HH2.0/build/default-honeycrisp-XC9YQX9HH2-0/julialang/julia-release-1-dot-11/src/task.c:322
start_task at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-honeycrisp-XC9YQX9HH2.0/build/default-honeycrisp-XC9YQX9HH2-0/julialang/julia-release-1-dot-11/src/task.c:1213

Environment:

Project and Manifest

  Updating `/private/var/folders/8b/tx4_63kd6c51swrwfwj8g3mr0000gn/T/jl_RJPvX6/Project.toml`
  [f213a82b] + HomotopyContinuation v2.11.1
    Updating `/private/var/folders/8b/tx4_63kd6c51swrwfwj8g3mr0000gn/T/jl_RJPvX6/Manifest.toml`
  [398f06c4] + AbstractLattices v0.3.1
  [79e6a3ab] + Adapt v4.0.4
  [66dad0bd] + AliasTables v1.1.3
  [fb37089c] + Arblib v1.2.1
  [4fba245c] + ArrayInterface v7.16.0
  [62783981] + BitTwiddlingConvenienceFunctions v0.1.6
  [2a0fbf3d] + CPUSummary v0.2.6
  [d360d2e6] + ChainRulesCore v1.25.0
  [fb6a15b2] + CloseOpenIntervals v0.1.13
  [861a8166] + Combinatorics v1.0.2
  [38540f10] + CommonSolve v0.2.4
  [bbf7d656] + CommonSubexpressions v0.3.1
  [f70d9fcc] + CommonWorldInvalidations v1.0.0
  [34da2185] + Compat v4.16.0
  [187b0558] + ConstructionBase v1.5.8
  [adafc99b] + CpuId v0.3.1
  [a8cc5b0e] + Crayons v4.1.1
  [9a962f9c] + DataAPI v1.16.0
  [864edb3b] + DataStructures v0.18.20
  [e2d170a0] + DataValueInterfaces v1.0.0
  [8bb1440f] + DelimitedFiles v1.9.1
  [163ba53b] + DiffResults v1.1.0
  [b552c78f] + DiffRules v1.15.1
  [31c24e10] + Distributions v0.25.112
  [ffbed154] + DocStringExtensions v0.9.3
  [7c1d4256] + DynamicPolynomials v0.6.0
  [fdbdab4c] + ElasticArrays v1.2.12
  [1a297f60] + FillArrays v1.13.0
  [6a86dc24] + FiniteDiff v2.26.0
  [f6369f11] + ForwardDiff v0.10.36
  [f213a82b] + HomotopyContinuation v2.11.1
  [3e5b6fbb] + HostCPUFeatures v0.1.17
  [34004b35] + HypergeometricFunctions v0.3.24
  [615f187c] + IfElse v0.1.1
  [18e54dd8] + IntegerMathUtils v0.1.2
  [524e6230] + IntervalTrees v1.1.0
  [92d709cd] + IrrationalConstants v0.2.2
  [c8e1da08] + IterTools v1.10.0
  [82899510] + IteratorInterfaceExtensions v1.0.0
  [692b3bcd] + JLLWrappers v1.6.1
  [8ac3fa9e] + LRUCache v1.6.1
  [b964fa9f] + LaTeXStrings v1.3.1
  [10f19ff3] + LayoutPointers v0.1.17
  [9c8b4983] + LightXML v0.9.1
  [d3d80556] + LineSearches v7.3.0
  [9b3f67b0] + LinearAlgebraX v0.2.10
  [2ab3a3ac] + LogExpFunctions v0.3.28
  [bdcacae8] + LoopVectorization v0.12.171
  [1914dd2f] + MacroTools v0.5.13
  [d125e4d3] + ManualMemory v0.1.8
  [e1d29d7a] + Missings v1.2.0
  [291d046c] + MixedSubdivisions v1.1.5
  [7475f97c] + Mods v2.2.5
  [3b2b4ff1] + Multisets v0.4.5
  [102ac46a] + MultivariatePolynomials v0.5.7
  [d8a4904e] + MutableArithmetics v1.5.0
  [d41bc354] + NLSolversBase v7.8.3
  [77ba4419] + NaNMath v1.0.2
  [6fe1bfb0] + OffsetArrays v1.14.1
  [429524aa] + Optim v1.9.4
  [bac558e1] + OrderedCollections v1.6.3
  [90014a1f] + PDMats v0.11.31
  [d96e819e] + Parameters v0.12.3
  [2ae35dd2] + Permutations v0.4.22
  [1d0040c9] + PolyesterWeave v0.2.2
  [f27b6e38] + Polynomials v4.0.11
  [85a6dd25] + PositiveFactorizations v0.2.4
  [aea7be01] + PrecompileTools v1.2.1
  [21216c6a] + Preferences v1.4.3
  [08abe8d2] + PrettyTables v2.4.0
  [27ebfcd6] + Primes v0.5.6
  [92933f4c] + ProgressMeter v1.10.2
  [01f381cc] + ProjectiveVectors v1.1.4
  [43287f4e] + PtrArrays v1.2.1
  [1fd47b50] + QuadGK v2.11.1
  [3cdcf5f2] + RecipesBase v1.3.4
  [189a3867] + Reexport v1.2.2
  [ae029012] + Requires v1.3.0
  [286e9d63] + RingLists v0.2.9
  [79098fc4] + Rmath v0.8.0
  [94e857df] + SIMDTypes v0.1.0
  [476501e8] + SLEEFPirates v0.6.43
  [8e049039] + SemialgebraicSets v0.3.3
  [efcf1570] + Setfield v1.1.1
  [55797a34] + SimpleGraphs v0.8.6
  [ec83eff0] + SimplePartitions v0.3.3
  [cc47b68c] + SimplePolynomials v0.2.18
  [a6525b86] + SimpleRandom v0.3.2
  [a2af1166] + SortingAlgorithms v1.2.1
  [276daf66] + SpecialFunctions v2.4.0
  [aedffcd0] + Static v1.1.1
  [0d7ed370] + StaticArrayInterface v1.8.0
  [90137ffa] + StaticArrays v1.9.7
  [1e83bf80] + StaticArraysCore v1.4.3
  [10745b16] + Statistics v1.11.1
  [82ae8749] + StatsAPI v1.7.0
  [2913bbd2] + StatsBase v0.34.3
  [4c63d2b9] + StatsFuns v1.3.2
  [892a3eda] + StringManipulation v0.4.0
  [09ab397b] + StructArrays v0.6.18
  [3783bdb8] + TableTraits v1.0.1
  [bd369af6] + Tables v1.12.0
  [8290d209] + ThreadingUtilities v0.5.2
  [a2a6695c] + TreeViews v0.3.0
  [3a884ed6] + UnPack v1.0.2
  [3d5dd08c] + VectorizationBase v0.21.70
  [e134572f] + FLINT_jll v300.100.300+0
  [94ce4f54] + Libiconv_jll v1.17.0+0
  [2ce0c516] + MPC_jll v1.2.1+0
  [656ef2d0] + OpenBLAS32_jll v0.3.28+3
  [efe28fd5] + OpenSpecFun_jll v0.5.5+0
  [f50d1b31] + Rmath_jll v0.5.1+0
⌅ [3428059b] + SymEngine_jll v0.9.0+1
  [02c8fc9c] + XML2_jll v2.13.3+0
  [0dad84c5] + ArgTools v1.1.2
  [56f22d72] + Artifacts v1.11.0
  [2a0f44e3] + Base64 v1.11.0
  [ade2ca70] + Dates v1.11.0
  [8ba89e20] + Distributed v1.11.0
  [f43a241f] + Downloads v1.6.0
  [7b1f6079] + FileWatching v1.11.0
  [9fa8497b] + Future v1.11.0
  [b77e0a4c] + InteractiveUtils v1.11.0
  [b27032c2] + LibCURL v0.6.4
  [76f85450] + LibGit2 v1.11.0
  [8f399da3] + Libdl v1.11.0
  [37e2e46d] + LinearAlgebra v1.11.0
  [56ddb016] + Logging v1.11.0
  [d6f4376e] + Markdown v1.11.0
  [a63ad114] + Mmap v1.11.0
  [ca575930] + NetworkOptions v1.2.0
  [44cfe95a] + Pkg v1.11.0
  [de0858da] + Printf v1.11.0
  [9a3f8284] + Random v1.11.0
  [ea8e919c] + SHA v0.7.0
  [9e88b42a] + Serialization v1.11.0
  [6462fe0b] + Sockets v1.11.0
  [2f01184e] + SparseArrays v1.11.0
  [4607b0f0] + SuiteSparse
  [fa267f1f] + TOML v1.0.3
  [a4e569a6] + Tar v1.10.0
  [8dfed614] + Test v1.11.0
  [cf7118a7] + UUIDs v1.11.0
  [4ec0a83e] + Unicode v1.11.0
  [e66e0078] + CompilerSupportLibraries_jll v1.1.1+0
  [781609d7] + GMP_jll v6.3.0+0
  [deac9b47] + LibCURL_jll v8.6.0+0
  [e37daf67] + LibGit2_jll v1.7.2+0
  [29816b5a] + LibSSH2_jll v1.11.0+1
  [3a97d323] + MPFR_jll v4.2.1+0
  [c8ffd9c3] + MbedTLS_jll v2.28.6+0
  [14a3606d] + MozillaCACerts_jll v2023.12.12
  [4536629a] + OpenBLAS_jll v0.3.27+1
  [05823500] + OpenLibm_jll v0.8.1+2
  [bea87d4a] + SuiteSparse_jll v7.7.0+0
  [83775a58] + Zlib_jll v1.2.13+1
  [8e850b90] + libblastrampoline_jll v5.11.0+0
  [8e850ede] + nghttp2_jll v1.59.0+0
  [3f19e933] + p7zip_jll v17.4.0+2

versioninfo():

julia> versioninfo()
Julia Version 1.11.0
Commit 501a4f25c2b (2024-10-07 11:40 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: macOS (arm64-apple-darwin22.4.0)
  CPU: 8 × Apple M2
  WORD_SIZE: 64
  LLVM: libLLVM-16.0.6 (ORCJIT, apple-m2)
Threads: 16 default, 2 interactive, 4 GC (on 4 virtual cores)
Environment:
  JULIA_PKG_USE_CLI_GIT = true
  JULIA_PKG_SERVER = https://internal.juliahub.com

This happens on 1.10 as well.

[PBrdng]

This is odd given that some tests include testing threading. I will look into it later this month (I have no time to do it earlier, sorry...). Thanks for noticing.

[PBrdng]

@AayushSabharwal Can you run the code on your computer using #598? I use threading and solve terminates.

[AayushSabharwal]

Unfortunately it does not fix the issue. Thank you for looking into the problem though!

[PBrdng]

The problem is that I can't reproduce this error (and hence not fix it). Here is my versioninfo():

Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: macOS (x86_64-apple-darwin22.4.0)
  CPU: 4 × Intel(R) Core(TM) i5-7360U CPU @ 2.30GHz
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, skylake)
Threads: 2 default, 0 interactive, 1 GC (on 4 virtual cores)
Environment:
  JULIA_EDITOR = code
  JULIA_NUM_THREADS = 2

Any idea where I can change my setting so that I can reproduce the error?

[AayushSabharwal]

I don't think it's a setting thing unfortunately. It feels like a platform issue with Apple silicon. Considering that threading = true is the default for solve, I imagine if this was easy to hit you would've seen a lot more people complaining. I'll try and step through solve with the debugger when I have the time. If I'm able to isolate where it freezes, I'll update this thread.

[PBrdng]

Ok. Thank you!