heap-buffer-overflow with subcolumns on JsonBench #26750
Description
Воспроизводится на локально поднятом ydbd, собранном c asan
./ya make --build=release -DDEBUGINFO_LINES_ONLY --sanitize=address ydb/apps/ydbd
загружаю первый файл данных JsonBench, таким скриптом:
https://paste.yandex-team.ru/71d0bbc5-f65e-4752-a143-8ab206ca4915
GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
=================================================================
==1811854==ERROR: AddressSanitizer: heap-buffer-overflow on address 0x7d0009274c02 at pc 0x0000289b532f bp 0x7b6f73b45410 sp 0x7b6f73b45408
READ of size 1 at 0x7d0009274c02 thread T122 (ydbd.User)
warning: address range table at offset 0x10c0 has a premature terminator entry at offset 0x10d0
#0 0x0000289b532e in GetBit /-S/contrib/libs/apache/arrow/cpp/src/arrow/util/bit_util.h:294:11
#1 0x0000289b532e in IsNull /-S/contrib/libs/apache/arrow/cpp/src/arrow/array/array_base.h:60:19
#2 0x0000289b532e in NKikimr::NArrow::NAccessor::NSubColumns::TColumnsData::TIterator::InitArrays() /-S/ydb/core/formats/arrow/accessor/sub_columns/columns_storage.cpp:72:35
#3 0x00001e0ebff8 in NKikimr::NArrow::NAccessor::NSubColumns::TColumnsData::TIterator::Next() /home/zverevgeny/github/my/ydb/ydb/core/formats/arrow/accessor/sub_columns/columns_storage.h:114:13
#4 0x00001e0ebb2b in operator() /home/zverevgeny/github/my/ydb/ydb/core/formats/arrow/accessor/sub_columns/iterators.h:130:30
#5 0x00001e0ebb2b in __invoke<TVisitor, NKikimr::NArrow::NAccessor::NSubColumns::TColumnsData::TIterator &> /home/zverevgeny/github/my/ydb/contrib/libs/cxxsupp/libcxx/include/__type_traits/invoke.h:149:25
#6 0x00001e0ebb2b in operator()<std::__y1::__variant_detail::__alt<0UL, NKikimr::NArrow::NAccessor::NSubColumns::TColumnsData::TIterator> &> /home/zverevgeny/github/my/ydb/contrib/libs/cxxsupp/libcxx/include/variant:617:14
#7 0x00001e0ebb2b in __invoke<std::__y1::__variant_detail::__visitation::__variant::__value_visitor<TVisitor>, std::__y1::__variant_detail::__alt<0UL, NKikimr::NArrow::NAccessor::NSubColumns::TColumnsData::TIterator> &> /home/zverevgeny/github/my/ydb/contrib/libs/cxxsupp/libcxx/include/__type_traits/invoke.h:149:25
#8 0x00001e0ebb2b in decltype(auto) std::__y1::__variant_detail::__visitation::__base::__dispatcher<0ul>::__dispatch[abi:fe200000]<std::__y1::__variant_detail::__visitation::__variant::__value_visitor<NKikimr::NArrow::NAccessor::NSubColumns::TGeneralIterator::Next()::TVisitor>&&, std::__y1::__variant_detail::__base<(std::__y1::__variant_detail::_Trait)1, NKikimr::NArrow::NAccessor::NSubColumns::TColumnsData::TIterator, NKikimr::NArrow::NAccessor::NSubColumns::TOthersData::TIterator>&>(std::__y1::__variant_detail::__visitation::__variant::__value_visitor<NKikimr::NArrow::NAccessor::NSubColumns::TGeneralIterator::Next()::TVisitor>&&, std::__y1::__variant_detail::__base<(std::__y1::__variant_detail::_Trait)1, NKikimr::NArrow::NAccessor::NSubColumns::TColumnsData::TIterator, NKikimr::NArrow::NAccessor::NSubColumns::TOthersData::TIterator>&) /home/zverevgeny/github/my/ydb/contrib/libs/cxxsupp/libcxx/include/variant:531:14
#9 0x00001e0d952c in __visit_alt<std::__y1::__variant_detail::__visitation::__variant::__value_visitor<TVisitor>, std::__y1::__variant_detail::__impl<NKikimr::NArrow::NAccessor::NSubColumns::TColumnsData::TIterator, NKikimr::NArrow::NAccessor::NSubColumns::TOthersData::TIterator> &> /home/zverevgeny/github/my/ydb/contrib/libs/cxxsupp/libcxx/include/variant:499:12
#10 0x00001e0d952c in __visit_alt<std::__y1::__variant_detail::__visitation::__variant::__value_visitor<TVisitor>, std::__y1::variant<NKikimr::NArrow::NAccessor::NSubColumns::TColumnsData::TIterator, NKikimr::NArrow::NAccessor::NSubColumns::TOthersData::TIterator> &> /home/zverevgeny/github/my/ydb/contrib/libs/cxxsupp/libcxx/include/variant:584:12
#11 0x00001e0d952c in __visit_value<TVisitor, std::__y1::variant<NKikimr::NArrow::NAccessor::NSubColumns::TColumnsData::TIterator, NKikimr::NArrow::NAccessor::NSubColumns::TOthersData::TIterator> &> /home/zverevgeny/github/my/ydb/contrib/libs/cxxsupp/libcxx/include/variant:596:12
#12 0x00001e0d952c in visit<TVisitor, std::__y1::variant<NKikimr::NArrow::NAccessor::NSubColumns::TColumnsData::TIterator, NKikimr::NArrow::NAccessor::NSubColumns::TOthersData::TIterator> &, void> /home/zverevgeny/github/my/ydb/contrib/libs/cxxsupp/libcxx/include/variant:1567:10
#13 0x00001e0d952c in Next /home/zverevgeny/github/my/ydb/ydb/core/formats/arrow/accessor/sub_columns/iterators.h:138:16
#14 0x00001e0d952c in ReadRecord<(lambda at /home/zverevgeny/github/my/ydb/ydb/core/tx/columnshard/engines/changes/compaction/sub_columns/logic.cpp:45:34), (lambda at /home/zverevgeny/github/my/ydb/ydb/core/tx/columnshard/engines/changes/compaction/sub_columns/logic.cpp:48:28), (lambda at /home/zverevgeny/github/my/ydb/ydb/core/tx/columnshard/engines/changes/compaction/sub_columns/logic.cpp:58:35)> /home/zverevgeny/github/my/ydb/ydb/core/formats/arrow/accessor/sub_columns/iterators.h:325:31
#15 0x00001e0d952c in ReadRecord<(lambda at /home/zverevgeny/github/my/ydb/ydb/core/tx/columnshard/engines/changes/compaction/sub_columns/logic.cpp:45:34), (lambda at /home/zverevgeny/github/my/ydb/ydb/core/tx/columnshard/engines/changes/compaction/sub_columns/logic.cpp:48:28), (lambda at /home/zverevgeny/github/my/ydb/ydb/core/tx/columnshard/engines/changes/compaction/sub_columns/logic.cpp:58:35)> /home/zverevgeny/github/my/ydb/ydb/core/tx/columnshard/engines/changes/compaction/sub_columns/iterator.h:80:23
#16 0x00001e0d952c in NKikimr::NOlap::NCompaction::TSubColumnsMerger::DoExecute(NKikimr::NOlap::NCompaction::TChunkMergeContext const&, NKikimr::NOlap::NCompaction::TMergingContext&) /home/zverevgeny/github/my/ydb/ydb/core/tx/columnshard/engines/changes/compaction/sub_columns/logic.cpp:61:37
#17 0x00003b44d199 in NKikimr::NOlap::NCompaction::IColumnMerger::Execute(NKikimr::NOlap::NCompaction::TChunkMergeContext const&, NKikimr::NOlap::NCompaction::TMergingContext&) /home/zverevgeny/github/my/ydb/ydb/core/tx/columnshard/engines/changes/compaction/abstract/merger.h:378:23
#18 0x00003b446064 in NKikimr::NOlap::NCompaction::TMerger::Execute(std::__y1::shared_ptr<NKikimr::NArrow::NSplitter::TSerializationStats> const&, NKikimr::NArrow::NMerger::TIntervalPositions const&, std::__y1::shared_ptr<NKikimr::NOlap::TFilteredSnapshotSchema> const&, NKikimr::NColumnShard::TInternalPathId, std::__y1::optional<unsigned long>) /home/zverevgeny/github/my/ydb/ydb/core/tx/columnshard/engines/changes/compaction/merger.cpp:322:63
#19 0x00003b429a71 in NKikimr::NOlap::NCompaction::TGeneralCompactColumnEngineChanges::BuildAppendedPortionsByChunks(NKikimr::NOlap::TConstructionContext&, std::__y1::vector<NKikimr::NOlap::NCompaction::TPortionToMerge, std::__y1::allocator<NKikimr::NOlap::NCompaction::TPortionToMerge>>&&, std::__y1::shared_ptr<NKikimr::NOlap::TFilteredSnapshotSchema> const&, std::__y1::shared_ptr<NKikimr::NArrow::NSplitter::TSerializationStats> const&) /home/zverevgeny/github/my/ydb/ydb/core/tx/columnshard/engines/changes/general_compaction.cpp:32:19
#20 0x00003b42c0e8 in NKikimr::NOlap::NCompaction::TGeneralCompactColumnEngineChanges::DoConstructBlobs(NKikimr::NOlap::TConstructionContext&) /home/zverevgeny/github/my/ydb/ydb/core/tx/columnshard/engines/changes/general_compaction.cpp:107:31
#21 0x00003b41830d in NKikimr::NOlap::TColumnEngineChanges::ConstructBlobs(NKikimr::NOlap::TConstructionContext&) /home/zverevgeny/github/my/ydb/ydb/core/tx/columnshard/engines/changes/abstract/abstract.cpp:32:32
#22 0x00003db96bb9 in NKikimr::NColumnShard::TCompactionExecutor::DoOnFinished(NKikimr::NOlap::NDataFetcher::TCurrentContext&&) /-S/ydb/core/tx/columnshard/columnshard_impl.cpp:570:26
#23 0x00003dc27022 in NKikimr::NOlap::NDataFetcher::IFetchCallback::OnFinished(NKikimr::NOlap::NDataFetcher::TCurrentContext&&) /-S/ydb/core/tx/columnshard/data_reader/contexts.h:145:16
#24 0x00003dc262c2 in NKikimr::NOlap::NDataFetcher::TPortionsDataFetcher::OnFinished() /-S/ydb/core/tx/columnshard/data_reader/fetcher.h:157:19
#25 0x00003dc25868 in NKikimr::NOlap::NDataFetcher::TFetchingExecutor::DoExecute(std::__y1::shared_ptr<NKikimr::NConveyor::ITask> const&) /-S/ydb/core/tx/columnshard/data_reader/fetching_executor.cpp:21:14
#26 0x00003b50ff13 in NKikimr::NConveyor::ITask::Execute(std::__y1::shared_ptr<NKikimr::NConveyor::TTaskSignals>, std::__y1::shared_ptr<NKikimr::NConveyor::ITask> const&) /home/zverevgeny/github/my/ydb/ydb/core/tx/conveyor/usage/abstract.cpp:16:9
#27 0x00005261a1cc in NKikimr::NConveyorComposite::TWorker::ExecuteTask(std::__y1::vector<NKikimr::NConveyorComposite::TWorkerTask, std::__y1::allocator<NKikimr::NConveyorComposite::TWorkerTask>>&&) /-S/ydb/core/tx/conveyor_composite/service/worker.cpp:17:22
#28 0x00005261dc05 in NKikimr::NConveyorComposite::TWorker::HandleMain(TAutoPtr<NActors::TEventHandle<NKikimr::NConveyorComposite::TEvInternal::TEvNewTask>, TDelete>&) /-S/ydb/core/tx/conveyor_composite/service/worker.cpp:59:5
#29 0x00005260890f in NKikimr::NConveyorComposite::TWorker::StateMain(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/core/tx/conveyor_composite/service/worker.h:39:13
#30 0x000021d97b87 in NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor.cpp:350:17
#31 0x000021e4ee01 in NActors::TExecutorThread::Execute(NActors::TMailbox*, bool) /-S/ydb/library/actors/core/executor_thread.cpp:267:28
#32 0x000021e589f4 in NActors::TExecutorThread::ProcessExecutorPool()::$_0::operator()(NActors::TMailbox*, bool) const /-S/ydb/library/actors/core/executor_thread.cpp:455:39
#33 0x000021e57fad in NActors::TExecutorThread::ProcessExecutorPool() /-S/ydb/library/actors/core/executor_thread.cpp:507:13
#34 0x000021e5a01e in NActors::TExecutorThread::ThreadProc() /-S/ydb/library/actors/core/executor_thread.cpp:533:9
#35 0x00001f6166a4 in (anonymous namespace)::TPosixThread::ThreadProxy(void*) /-S/util/system/thread.cpp:245:20
#36 0x00001f2b3fb6 in asan_thread_start(void*) /-S/contrib/libs/clang20-rt/lib/asan/asan_interceptors.cpp:239:28
#37 0x7f7007c7ab59 in start_thread nptl/pthread_create.c:444:8
#38 0x7f7007d0b5fb in clone3 misc/../sysdeps/unix/sysv/linux/x86_64/clone3.S:78
0x7d0009274c02 is located 2 bytes after 896-byte region [0x7d0009274880,0x7d0009274c00)
allocated by thread T122 (ydbd.User) here:
#0 0x00001f2b70b7 in posix_memalign /-S/contrib/libs/clang20-rt/lib/asan/asan_malloc_linux.cpp:139:3
#1 0x000025f218d5 in arrow::(anonymous namespace)::SystemAllocator::AllocateAligned(long, unsigned char**) /-S/contrib/libs/apache/arrow/cpp/src/arrow/memory_pool.cc:213:24
#2 0x000025f21190 in arrow::BaseMemoryPoolImpl<arrow::(anonymous namespace)::SystemAllocator>::Allocate(long, unsigned char**) /-S/contrib/libs/apache/arrow/cpp/src/arrow/memory_pool.cc:405:5
#3 0x000025f22c6e in arrow::PoolBuffer::Reserve(long) /-S/contrib/libs/apache/arrow/cpp/src/arrow/memory_pool.cc:717:9
#4 0x000025f226f6 in arrow::PoolBuffer::Resize(long, bool) /-S/contrib/libs/apache/arrow/cpp/src/arrow/memory_pool.cc:741:7
#5 0x000025f1f26f in ResizePoolBuffer<std::__y1::unique_ptr<arrow::Buffer, std::__y1::default_delete<arrow::Buffer> >, std::__y1::unique_ptr<arrow::PoolBuffer, std::__y1::default_delete<arrow::PoolBuffer> > > /-S/contrib/libs/apache/arrow/cpp/src/arrow/memory_pool.cc:780:3
#6 0x000025f1f26f in arrow::AllocateBuffer(long, arrow::MemoryPool*) /-S/contrib/libs/apache/arrow/cpp/src/arrow/memory_pool.cc:788:10
#7 0x000024d02ac7 in CreateBuffer /-S/contrib/libs/apache/arrow/cpp/src/arrow/array/util.cc:387:5
#8 0x000024d02ac7 in arrow::(anonymous namespace)::NullArrayFactory::Create() /-S/contrib/libs/apache/arrow/cpp/src/arrow/array/util.cc:394:7
#9 0x000024d02451 in arrow::MakeArrayOfNull(std::__y1::shared_ptr<arrow::DataType> const&, long, arrow::MemoryPool*) /-S/contrib/libs/apache/arrow/cpp/src/arrow/array/util.cc:667:3
#10 0x0000286034ac in operator() /-S/ydb/library/formats/arrow/simple_arrays_cache.cpp:13:43
#11 0x0000286034ac in InitializePosition<(lambda at /-S/ydb/library/formats/arrow/simple_arrays_cache.cpp:12:30)> /-S/ydb/library/formats/arrow/simple_arrays_cache.h:46:26
#12 0x0000286034ac in NKikimr::NArrow::TThreadSimpleArraysCache::GetNullImpl(std::__y1::shared_ptr<arrow::DataType> const&, unsigned int) /-S/ydb/library/formats/arrow/simple_arrays_cache.cpp:15:12
#13 0x000028609d85 in GetNull /-S/ydb/library/formats/arrow/simple_arrays_cache.cpp:34:30
#14 0x000028609d85 in NKikimr::NArrow::TThreadSimpleArraysCache::Get(std::__y1::shared_ptr<arrow::DataType> const&, std::__y1::shared_ptr<arrow::Scalar> const&, unsigned int) /-S/ydb/library/formats/arrow/simple_arrays_cache.cpp:47:16
#15 0x0000288e2f27 in NKikimr::NArrow::NAccessor::TSparsedArrayChunk::GetChunk(std::__y1::optional<NKikimr::NArrow::NAccessor::IChunkedArray::TCommonChunkAddress> const&, unsigned long) const /-S/ydb/core/formats/arrow/accessor/sparsed/accessor.cpp:115:19
#16 0x0000288eeea1 in NKikimr::NArrow::NAccessor::TSparsedArray::DoGetLocalData(std::__y1::optional<NKikimr::NArrow::NAccessor::IChunkedArray::TCommonChunkAddress> const&, unsigned long) const /-S/ydb/core/formats/arrow/accessor/sparsed/accessor.h:164:23
#17 0x000028691c83 in NKikimr::NArrow::NAccessor::IChunkedArray::GetLocalData(std::__y1::optional<NKikimr::NArrow::NAccessor::IChunkedArray::TCommonChunkAddress> const&, unsigned long) const /-S/ydb/core/formats/arrow/accessor/abstract/accessor.h:398:16
#18 0x00002869028a in NKikimr::NArrow::NAccessor::IChunkedArray::GetChunk(std::__y1::optional<NKikimr::NArrow::NAccessor::IChunkedArray::TAddressChain> const&, unsigned long) const /-S/ydb/core/formats/arrow/accessor/abstract/accessor.cpp:39:29
#19 0x000028697ed5 in NKikimr::NArrow::NAccessor::IChunkedArray::GetChunk(std::__y1::optional<NKikimr::NArrow::NAccessor::IChunkedArray::TFullDataAddress> const&, unsigned long) const /-S/ydb/core/formats/arrow/accessor/abstract/accessor.h:493:20
#20 0x0000289b3ef3 in NKikimr::NArrow::NAccessor::NSubColumns::TColumnsData::TIterator::InitArrays() /-S/ydb/core/formats/arrow/accessor/sub_columns/columns_storage.cpp:63:54
#21 0x00001e0ebff8 in NKikimr::NArrow::NAccessor::NSubColumns::TColumnsData::TIterator::Next() /home/zverevgeny/github/my/ydb/ydb/core/formats/arrow/accessor/sub_columns/columns_storage.h:114:13
#22 0x00001e0ebb2b in operator() /home/zverevgeny/github/my/ydb/ydb/core/formats/arrow/accessor/sub_columns/iterators.h:130:30
#23 0x00001e0ebb2b in __invoke<TVisitor, NKikimr::NArrow::NAccessor::NSubColumns::TColumnsData::TIterator &> /home/zverevgeny/github/my/ydb/contrib/libs/cxxsupp/libcxx/include/__type_traits/invoke.h:149:25
#24 0x00001e0ebb2b in operator()<std::__y1::__variant_detail::__alt<0UL, NKikimr::NArrow::NAccessor::NSubColumns::TColumnsData::TIterator> &> /home/zverevgeny/github/my/ydb/contrib/libs/cxxsupp/libcxx/include/variant:617:14
#25 0x00001e0ebb2b in __invoke<std::__y1::__variant_detail::__visitation::__variant::__value_visitor<TVisitor>, std::__y1::__variant_detail::__alt<0UL, NKikimr::NArrow::NAccessor::NSubColumns::TColumnsData::TIterator> &> /home/zverevgeny/github/my/ydb/contrib/libs/cxxsupp/libcxx/include/__type_traits/invoke.h:149:25
#26 0x00001e0ebb2b in decltype(auto) std::__y1::__variant_detail::__visitation::__base::__dispatcher<0ul>::__dispatch[abi:fe200000]<std::__y1::__variant_detail::__visitation::__variant::__value_visitor<NKikimr::NArrow::NAccessor::NSubColumns::TGeneralIterator::Next()::TVisitor>&&, std::__y1::__variant_detail::__base<(std::__y1::__variant_detail::_Trait)1, NKikimr::NArrow::NAccessor::NSubColumns::TColumnsData::TIterator, NKikimr::NArrow::NAccessor::NSubColumns::TOthersData::TIterator>&>(std::__y1::__variant_detail::__visitation::__variant::__value_visitor<NKikimr::NArrow::NAccessor::NSubColumns::TGeneralIterator::Next()::TVisitor>&&, std::__y1::__variant_detail::__base<(std::__y1::__variant_detail::_Trait)1, NKikimr::NArrow::NAccessor::NSubColumns::TColumnsData::TIterator, NKikimr::NArrow::NAccessor::NSubColumns::TOthersData::TIterator>&) /home/zverevgeny/github/my/ydb/contrib/libs/cxxsupp/libcxx/include/variant:531:14
#27 0x00001e0d952c in __visit_alt<std::__y1::__variant_detail::__visitation::__variant::__value_visitor<TVisitor>, std::__y1::__variant_detail::__impl<NKikimr::NArrow::NAccessor::NSubColumns::TColumnsData::TIterator, NKikimr::NArrow::NAccessor::NSubColumns::TOthersData::TIterator> &> /home/zverevgeny/github/my/ydb/contrib/libs/cxxsupp/libcxx/include/variant:499:12
#28 0x00001e0d952c in __visit_alt<std::__y1::__variant_detail::__visitation::__variant::__value_visitor<TVisitor>, std::__y1::variant<NKikimr::NArrow::NAccessor::NSubColumns::TColumnsData::TIterator, NKikimr::NArrow::NAccessor::NSubColumns::TOthersData::TIterator> &> /home/zverevgeny/github/my/ydb/contrib/libs/cxxsupp/libcxx/include/variant:584:12
#29 0x00001e0d952c in __visit_value<TVisitor, std::__y1::variant<NKikimr::NArrow::NAccessor::NSubColumns::TColumnsData::TIterator, NKikimr::NArrow::NAccessor::NSubColumns::TOthersData::TIterator> &> /home/zverevgeny/github/my/ydb/contrib/libs/cxxsupp/libcxx/include/variant:596:12
#30 0x00001e0d952c in visit<TVisitor, std::__y1::variant<NKikimr::NArrow::NAccessor::NSubColumns::TColumnsData::TIterator, NKikimr::NArrow::NAccessor::NSubColumns::TOthersData::TIterator> &, void> /home/zverevgeny/github/my/ydb/contrib/libs/cxxsupp/libcxx/include/variant:1567:10
#31 0x00001e0d952c in Next /home/zverevgeny/github/my/ydb/ydb/core/formats/arrow/accessor/sub_columns/iterators.h:138:16
#32 0x00001e0d952c in ReadRecord<(lambda at /home/zverevgeny/github/my/ydb/ydb/core/tx/columnshard/engines/changes/compaction/sub_columns/logic.cpp:45:34), (lambda at /home/zverevgeny/github/my/ydb/ydb/core/tx/columnshard/engines/changes/compaction/sub_columns/logic.cpp:48:28), (lambda at /home/zverevgeny/github/my/ydb/ydb/core/tx/columnshard/engines/changes/compaction/sub_columns/logic.cpp:58:35)> /home/zverevgeny/github/my/ydb/ydb/core/formats/arrow/accessor/sub_columns/iterators.h:325:31
#33 0x00001e0d952c in ReadRecord<(lambda at /home/zverevgeny/github/my/ydb/ydb/core/tx/columnshard/engines/changes/compaction/sub_columns/logic.cpp:45:34), (lambda at /home/zverevgeny/github/my/ydb/ydb/core/tx/columnshard/engines/changes/compaction/sub_columns/logic.cpp:48:28), (lambda at /home/zverevgeny/github/my/ydb/ydb/core/tx/columnshard/engines/changes/compaction/sub_columns/logic.cpp:58:35)> /home/zverevgeny/github/my/ydb/ydb/core/tx/columnshard/engines/changes/compaction/sub_columns/iterator.h:80:23
#34 0x00001e0d952c in NKikimr::NOlap::NCompaction::TSubColumnsMerger::DoExecute(NKikimr::NOlap::NCompaction::TChunkMergeContext const&, NKikimr::NOlap::NCompaction::TMergingContext&) /home/zverevgeny/github/my/ydb/ydb/core/tx/columnshard/engines/changes/compaction/sub_columns/logic.cpp:61:37
#35 0x00003b44d199 in NKikimr::NOlap::NCompaction::IColumnMerger::Execute(NKikimr::NOlap::NCompaction::TChunkMergeContext const&, NKikimr::NOlap::NCompaction::TMergingContext&) /home/zverevgeny/github/my/ydb/ydb/core/tx/columnshard/engines/changes/compaction/abstract/merger.h:378:23
#36 0x00003b446064 in NKikimr::NOlap::NCompaction::TMerger::Execute(std::__y1::shared_ptr<NKikimr::NArrow::NSplitter::TSerializationStats> const&, NKikimr::NArrow::NMerger::TIntervalPositions const&, std::__y1::shared_ptr<NKikimr::NOlap::TFilteredSnapshotSchema> const&, NKikimr::NColumnShard::TInternalPathId, std::__y1::optional<unsigned long>) /home/zverevgeny/github/my/ydb/ydb/core/tx/columnshard/engines/changes/compaction/merger.cpp:322:63
#37 0x00003b429a71 in NKikimr::NOlap::NCompaction::TGeneralCompactColumnEngineChanges::BuildAppendedPortionsByChunks(NKikimr::NOlap::TConstructionContext&, std::__y1::vector<NKikimr::NOlap::NCompaction::TPortionToMerge, std::__y1::allocator<NKikimr::NOlap::NCompaction::TPortionToMerge>>&&, std::__y1::shared_ptr<NKikimr::NOlap::TFilteredSnapshotSchema> const&, std::__y1::shared_ptr<NKikimr::NArrow::NSplitter::TSerializationStats> const&) /home/zverevgeny/github/my/ydb/ydb/core/tx/columnshard/engines/changes/general_compaction.cpp:32:19
#38 0x00003b42c0e8 in NKikimr::NOlap::NCompaction::TGeneralCompactColumnEngineChanges::DoConstructBlobs(NKikimr::NOlap::TConstructionContext&) /home/zverevgeny/github/my/ydb/ydb/core/tx/columnshard/engines/changes/general_compaction.cpp:107:31
#39 0x00003b41830d in NKikimr::NOlap::TColumnEngineChanges::ConstructBlobs(NKikimr::NOlap::TConstructionContext&) /home/zverevgeny/github/my/ydb/ydb/core/tx/columnshard/engines/changes/abstract/abstract.cpp:32:32
#40 0x00003db96bb9 in NKikimr::NColumnShard::TCompactionExecutor::DoOnFinished(NKikimr::NOlap::NDataFetcher::TCurrentContext&&) /-S/ydb/core/tx/columnshard/columnshard_impl.cpp:570:26
#41 0x00003dc27022 in NKikimr::NOlap::NDataFetcher::IFetchCallback::OnFinished(NKikimr::NOlap::NDataFetcher::TCurrentContext&&) /-S/ydb/core/tx/columnshard/data_reader/contexts.h:145:16
#42 0x00003dc262c2 in NKikimr::NOlap::NDataFetcher::TPortionsDataFetcher::OnFinished() /-S/ydb/core/tx/columnshard/data_reader/fetcher.h:157:19
#43 0x00003dc25868 in NKikimr::NOlap::NDataFetcher::TFetchingExecutor::DoExecute(std::__y1::shared_ptr<NKikimr::NConveyor::ITask> const&) /-S/ydb/core/tx/columnshard/data_reader/fetching_executor.cpp:21:14
#44 0x00003b50ff13 in NKikimr::NConveyor::ITask::Execute(std::__y1::shared_ptr<NKikimr::NConveyor::TTaskSignals>, std::__y1::shared_ptr<NKikimr::NConveyor::ITask> const&) /home/zverevgeny/github/my/ydb/ydb/core/tx/conveyor/usage/abstract.cpp:16:9
#45 0x00005261a1cc in NKikimr::NConveyorComposite::TWorker::ExecuteTask(std::__y1::vector<NKikimr::NConveyorComposite::TWorkerTask, std::__y1::allocator<NKikimr::NConveyorComposite::TWorkerTask>>&&) /-S/ydb/core/tx/conveyor_composite/service/worker.cpp:17:22
Thread T122 (ydbd.User) created by T0 here:
#0 0x00001f29abf1 in pthread_create /-S/contrib/libs/clang20-rt/lib/asan/asan_interceptors.cpp:250:3
#1 0x00001f607485 in Start /-S/util/system/thread.cpp:230:27
#2 0x00001f607485 in TThread::Start() /-S/util/system/thread.cpp:315:34
#3 0x000021e1d4fc in NActors::TBasicExecutorPool::Start() /-S/ydb/library/actors/core/executor_pool_basic.cpp:568:32
#4 0x000021dbc5b3 in NActors::TCpuManager::Start() /-S/ydb/library/actors/core/cpu_manager.cpp:141:32
#5 0x000021dafa1d in NActors::TActorSystem::Start() /-S/ydb/library/actors/core/actorsystem.cpp:412:21
#6 0x00004120670a in NKikimr::TKikimrRunner::KikimrStart() /-S/ydb/core/driver_lib/run/run.cpp:2032:22
#7 0x00003e572e0a in NKikimr::MainRun(NKikimr::TKikimrRunConfig const&, std::__y1::shared_ptr<NKikimr::TModuleFactories>) /-S/ydb/core/driver_lib/run/main.cpp:46:17
#8 0x00004109345b in NKikimr::NDriverClient::TClientCommandServer::Run(NYdb::NConsoleClient::TClientCommand::TConfig&) /home/zverevgeny/github/my/ydb/ydb/core/driver_lib/cli_utils/cli_cmds_server.cpp:50:12
#9 0x00003e5f79d5 in NYdb::NConsoleClient::TClientCommandTree::Run(NYdb::NConsoleClient::TClientCommand::TConfig&) /-S/ydb/public/lib/ydb_cli/common/command.cpp:512:33
#10 0x00003e5f1635 in NYdb::NConsoleClient::TClientCommand::Process(NYdb::NConsoleClient::TClientCommand::TConfig&) /-S/ydb/public/lib/ydb_cli/common/command.cpp:257:16
#11 0x00003e5e3df7 in NKikimr::NDriverClient::NewClient(int, char**, std::__y1::shared_ptr<NKikimr::TModuleFactories>) /home/zverevgeny/github/my/ydb/ydb/core/driver_lib/cli_utils/cli_cmds_root.cpp:77:26
#12 0x00003e578f16 in NKikimr::Main(int, char**, std::__y1::shared_ptr<NKikimr::TModuleFactories>) /-S/ydb/core/driver_lib/run/main.cpp:151:20
#13 0x00003e57cdcd in ParameterizedMain(int, char**, std::__y1::shared_ptr<NKikimr::TModuleFactories>) /-S/ydb/core/driver_lib/run/main.cpp:201:16
#14 0x00001f2144d5 in main /home/zverevgeny/github/my/ydb/ydb/apps/ydbd/main.cpp:31:12
#15 0x7f7007c0b14f in __libc_start_call_main csu/../sysdeps/nptl/libc_start_call_main.h:58:16
SUMMARY: AddressSanitizer: heap-buffer-overflow /-S/contrib/libs/apache/arrow/cpp/src/arrow/util/bit_util.h:294:11 in GetBit
Shadow bytes around the buggy address:
0x7d0009274980: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
0x7d0009274a00: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
0x7d0009274a80: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
0x7d0009274b00: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
0x7d0009274b80: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
=>0x7d0009274c00:[fa]fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
0x7d0009274c80: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
0x7d0009274d00: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
0x7d0009274d80: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
0x7d0009274e00: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
0x7d0009274e80: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
Shadow byte legend (one shadow byte represents 8 application bytes):
Addressable: 00
Partially addressable: 01 02 03 04 05 06 07
Heap left redzone: fa
Freed heap region: fd
Stack left redzone: f1
Stack mid redzone: f2
Stack right redzone: f3
Stack after return: f5
Stack use after scope: f8
Global redzone: f9
Global init order: f6
Poisoned by user: f7
Container overflow: fc
Array cookie: ac
Intra object redzone: bb
ASan internal: fe
Left alloca redzone: ca
Right alloca redzone: cb
==1811854==ABORTING