[VL] Flaky TPCDS q24a

[zhouyuan]

Backend

VL (Velox)

Bug description

#6928 (comment)

Executing SQL query from resource path /tpcds-queries/q24b.sql...
#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x00007fd86d9bd966, pid=6067, tid=0x00007fd874626700
#
# JRE version: OpenJDK Runtime Environment (8.0_312-b07) (build 1.8.0_312-b07)
# Java VM: OpenJDK 64-Bit Server VM (25.312-b07 mixed mode linux-amd64 compressed oops)
# Problematic frame:
# C  [libvelox.so+0x1807966]  facebook::velox::memory::ScopedMemoryPoolArbitrationCtx::~ScopedMemoryPoolArbitrationCtx()+0x6
#
# Core dump written. Default location: /__w/incubator-gluten/incubator-gluten/tools/gluten-it/core or core.6067
#
# An error report file with more information is saved as:
# /__w/incubator-gluten/incubator-gluten/tools/gluten-it/hs_err_pid6067.log
#
# If you would like to submit a bug report, please visit:
#   https://bugzilla.redhat.com/enter_bug.cgi?product=Red%20Hat%20Enterprise%20Linux%208&component=java-1.8.0-openjdk
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#
sbin/gluten-it.sh: line 50:  6067 Aborted                 (core dumped) $JAVA_HOME/bin/java $SPARK_JVM_OPTIONS $GLUTEN_IT_JVM_ARGS -XX:ErrorFile=/var/log/java/hs_err_pid%p.log -Dio.netty.tryReflectionSetAccessible=true -cp $JAR_PATH org.apache.gluten.integration.Cli $@

Spark version

None

Spark configurations

No response

System information

No response

Relevant logs

No response

[zhztheplayer]

Another https://github.com/apache/incubator-gluten/actions/runs/10465766725/job/28981570997?pr=6931

[FelixYBW]

recent Velox PR?

[zhztheplayer]

Not sure for a certain PR but the issue appeared recently in several days. Was not able to repeat locally yet but am trying.

[zhztheplayer]

Update: Ran q23a + q24b for 100 rounds locally, didn't repeat.

[FelixYBW]

Does it still appear now?