tag:github.com,2008:https://github.com/lance-format/lance/releases Release notes from lance 2026-04-16T02:15:05Z tag:github.com,2008:Repository/511691380/v6.0.0-beta.1 2026-04-16T02:15:20Z v6.0.0-beta.1 <h2>What's Changed</h2> <h3>Breaking Changes šŸ› </h3> <ul> <li>refactor!: vendor the tokenizer stack into lance by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Xuanwo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Xuanwo">@Xuanwo</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4261987714" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6512" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6512/hovercard" href="https://github.com/lance-format/lance/pull/6512">#6512</a></li> </ul> <h3>New Features šŸŽ‰</h3> <ul> <li>feat(dictionary-namespace): support table related operation by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/zhangyue19921010/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/zhangyue19921010">@zhangyue19921010</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4150301781" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6308" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6308/hovercard" href="https://github.com/lance-format/lance/pull/6308">#6308</a></li> <li>feat: clean up transaction files on failed commits by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/wjones127/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/wjones127">@wjones127</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4156229902" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6319" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6319/hovercard" href="https://github.com/lance-format/lance/pull/6319">#6319</a></li> <li>refactor: use exact base-scoped store bindings by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Xuanwo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Xuanwo">@Xuanwo</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4216473195" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6422" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6422/hovercard" href="https://github.com/lance-format/lance/pull/6422">#6422</a></li> <li>feat: wire batch_size_bytes to Python and public Rust API by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/westonpace/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/westonpace">@westonpace</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4219229707" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6428" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6428/hovercard" href="https://github.com/lance-format/lance/pull/6428">#6428</a></li> <li>feat(index): support float16 and float64 in IVF_FLAT by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/BubbleCal/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/BubbleCal">@BubbleCal</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4239429040" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6476" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6476/hovercard" href="https://github.com/lance-format/lance/pull/6476">#6476</a></li> <li>feat: batch chopping fallback for filtered read by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/westonpace/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/westonpace">@westonpace</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4242037303" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6482" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6482/hovercard" href="https://github.com/lance-format/lance/pull/6482">#6482</a></li> <li>feat: add ANN proto codecs and extract table_identifier module by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/LuQQiu/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/LuQQiu">@LuQQiu</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4258554947" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6503" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6503/hovercard" href="https://github.com/lance-format/lance/pull/6503">#6503</a></li> <li>feat: add configurable blob v2 pack file size by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/hamersaw/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/hamersaw">@hamersaw</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4261093740" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6508" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6508/hovercard" href="https://github.com/lance-format/lance/pull/6508">#6508</a></li> </ul> <h3>Bug Fixes šŸ›</h3> <ul> <li>fix: warn and clamp LANCE_INITIAL_UPLOAD_SIZE instead of panicking by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/LuciferYang/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/LuciferYang">@LuciferYang</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4195133266" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6389" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6389/hovercard" href="https://github.com/lance-format/lance/pull/6389">#6389</a></li> <li>fix: keep delete-by-source fast path with scalar indexes by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Xuanwo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Xuanwo">@Xuanwo</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4223380572" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6435" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6435/hovercard" href="https://github.com/lance-format/lance/pull/6435">#6435</a></li> <li>fix: include column_metadatas and column_infos in CachedFileMetadata::DeepSizeOf by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jiaoew1991/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jiaoew1991">@jiaoew1991</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4241891318" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6480" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6480/hovercard" href="https://github.com/lance-format/lance/pull/6480">#6480</a></li> <li>fix(index): preserve fts prewarm position codec by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/BubbleCal/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/BubbleCal">@BubbleCal</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4243681492" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6485" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6485/hovercard" href="https://github.com/lance-format/lance/pull/6485">#6485</a></li> <li>fix: handle FlatBin quantization in optimize_vector_indices_v2 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jackye1995/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jackye1995">@jackye1995</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4245709892" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6488" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6488/hovercard" href="https://github.com/lance-format/lance/pull/6488">#6488</a></li> <li>fix: use logical OR instead of bitwise OR in conflict resolver by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/dentiny/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/dentiny">@dentiny</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4251453746" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6492" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6492/hovercard" href="https://github.com/lance-format/lance/pull/6492">#6492</a></li> <li>fix: bump jieba-rs to 0.9.0 to fix build-no-lock CI by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/westonpace/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/westonpace">@westonpace</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4264873742" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6518" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6518/hovercard" href="https://github.com/lance-format/lance/pull/6518">#6518</a></li> <li>fix: blob projection schema compatibility by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Xuanwo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Xuanwo">@Xuanwo</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4266704005" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6521" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6521/hovercard" href="https://github.com/lance-format/lance/pull/6521">#6521</a></li> <li>fix(namespace): serialize manifest mutations by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Xuanwo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Xuanwo">@Xuanwo</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4267140684" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6525" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6525/hovercard" href="https://github.com/lance-format/lance/pull/6525">#6525</a></li> <li>fix: missing bumpversion entry for lance-tokenizer by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Xuanwo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Xuanwo">@Xuanwo</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4267156118" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6526" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6526/hovercard" href="https://github.com/lance-format/lance/pull/6526">#6526</a></li> </ul> <h3>Documentation šŸ“š</h3> <ul> <li>docs: tighten python environment workflow guidance by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Xuanwo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Xuanwo">@Xuanwo</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4266507320" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6520" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6520/hovercard" href="https://github.com/lance-format/lance/pull/6520">#6520</a></li> </ul> <h3>Performance Improvements šŸš€</h3> <ul> <li>perf: intern DataFile fields/column_indices to reduce manifest memory by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/beinan/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/beinan">@beinan</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4240784649" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6477" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6477/hovercard" href="https://github.com/lance-format/lance/pull/6477">#6477</a></li> <li>perf: intern RowDatasetVersionMeta inline bytes to reduce manifest memory by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/beinan/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/beinan">@beinan</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4257232333" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6499" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6499/hovercard" href="https://github.com/lance-format/lance/pull/6499">#6499</a></li> <li>perf: submit I/O requests eagerly in FullZipScheduler by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/hushengquan/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/hushengquan">@hushengquan</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4262079360" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6513" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6513/hovercard" href="https://github.com/lance-format/lance/pull/6513">#6513</a></li> <li>perf: add SIMD-accelerated u8 L2 and cosine distance kernels by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/justinrmiller/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/justinrmiller">@justinrmiller</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4263820120" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6517" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6517/hovercard" href="https://github.com/lance-format/lance/pull/6517">#6517</a></li> </ul> <p><strong>Full Changelog</strong>: <a class="commit-link" href="https://github.com/lance-format/lance/compare/release-root/6.0.0-beta.N...v6.0.0-beta.1"><tt>release-root/6.0.0-beta.N...v6.0.0-beta.1</tt></a></p> lance-community tag:github.com,2008:Repository/511691380/release-root/6.0.0-beta.N 2026-04-16T02:15:05Z release-root/6.0.0-beta.N: Base: 5.0.0-rc.1 <p>Release root for 6.0.0-beta.N series (same base as 5.1.0-beta.N)</p> changhiskhan tag:github.com,2008:Repository/511691380/v5.1.0-beta.3 2026-04-11T22:32:42Z v5.1.0-beta.3 <h2>What's Changed</h2> <h3>Bug Fixes šŸ›</h3> <ul> <li>fix: include column_metadatas and column_infos in CachedFileMetadata::DeepSizeOf by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jiaoew1991/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jiaoew1991">@jiaoew1991</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4241891318" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6480" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6480/hovercard" href="https://github.com/lance-format/lance/pull/6480">#6480</a></li> <li>fix(index): preserve fts prewarm position codec by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/BubbleCal/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/BubbleCal">@BubbleCal</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4243681492" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6485" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6485/hovercard" href="https://github.com/lance-format/lance/pull/6485">#6485</a></li> <li>fix: handle FlatBin quantization in optimize_vector_indices_v2 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jackye1995/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jackye1995">@jackye1995</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4245709892" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6488" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6488/hovercard" href="https://github.com/lance-format/lance/pull/6488">#6488</a></li> </ul> <p><strong>Full Changelog</strong>: <a class="commit-link" href="https://github.com/lance-format/lance/compare/v5.1.0-beta.2...v5.1.0-beta.3"><tt>v5.1.0-beta.2...v5.1.0-beta.3</tt></a></p> lance-community tag:github.com,2008:Repository/511691380/v5.1.0-beta.2 2026-04-11T03:56:45Z v5.1.0-beta.2 <h2>What's Changed</h2> <h3>New Features šŸŽ‰</h3> <ul> <li>feat: clean up transaction files on failed commits by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/wjones127/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/wjones127">@wjones127</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4156229902" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6319" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6319/hovercard" href="https://github.com/lance-format/lance/pull/6319">#6319</a></li> <li>feat: wire batch_size_bytes to Python and public Rust API by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/westonpace/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/westonpace">@westonpace</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4219229707" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6428" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6428/hovercard" href="https://github.com/lance-format/lance/pull/6428">#6428</a></li> </ul> <p><strong>Full Changelog</strong>: <a class="commit-link" href="https://github.com/lance-format/lance/compare/v5.1.0-beta.1...v5.1.0-beta.2"><tt>v5.1.0-beta.1...v5.1.0-beta.2</tt></a></p> lance-community tag:github.com,2008:Repository/511691380/v5.1.0-beta.1 2026-04-10T14:53:58Z v5.1.0-beta.1 <h2>What's Changed</h2> <h3>New Features šŸŽ‰</h3> <ul> <li>feat(index): support float16 and float64 in IVF_FLAT by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/BubbleCal/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/BubbleCal">@BubbleCal</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4239429040" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6476" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6476/hovercard" href="https://github.com/lance-format/lance/pull/6476">#6476</a></li> </ul> <h3>Bug Fixes šŸ›</h3> <ul> <li>fix: warn and clamp LANCE_INITIAL_UPLOAD_SIZE instead of panicking by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/LuciferYang/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/LuciferYang">@LuciferYang</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4195133266" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6389" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6389/hovercard" href="https://github.com/lance-format/lance/pull/6389">#6389</a></li> </ul> <p><strong>Full Changelog</strong>: <a class="commit-link" href="https://github.com/lance-format/lance/compare/release-root/5.1.0-beta.N...v5.1.0-beta.1"><tt>release-root/5.1.0-beta.N...v5.1.0-beta.1</tt></a></p> lance-community tag:github.com,2008:Repository/511691380/v5.0.0-rc.1 2026-04-09T16:05:00Z v5.0.0-rc.1 <h2>What's Changed</h2> <h3>Breaking Changes šŸ› </h3> <ul> <li>refactor!: cleanup namespace related APIs by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jackye1995/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jackye1995">@jackye1995</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4069085204" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6186" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6186/hovercard" href="https://github.com/lance-format/lance/pull/6186">#6186</a></li> <li>feat!: add progress monitoring via callbacks for distributed merge by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/vivek-bharathan/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/vivek-bharathan">@vivek-bharathan</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4085981641" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6210" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6210/hovercard" href="https://github.com/lance-format/lance/pull/6210">#6210</a></li> <li>refactor!: remove staging from distributed vector indexing by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Xuanwo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Xuanwo">@Xuanwo</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4126769628" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6269" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6269/hovercard" href="https://github.com/lance-format/lance/pull/6269">#6269</a></li> <li>refactor: move DatasetIndexExt out of lance-index by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Xuanwo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Xuanwo">@Xuanwo</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4129391249" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6280" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6280/hovercard" href="https://github.com/lance-format/lance/pull/6280">#6280</a></li> <li>feat!: support sampling selected fragments by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Xuanwo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Xuanwo">@Xuanwo</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4137050159" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6294" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6294/hovercard" href="https://github.com/lance-format/lance/pull/6294">#6294</a></li> <li>refactor!: align distributed index build around segments by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Xuanwo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Xuanwo">@Xuanwo</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4152113762" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6313" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6313/hovercard" href="https://github.com/lance-format/lance/pull/6313">#6313</a></li> </ul> <h3>New Features šŸŽ‰</h3> <ul> <li>feat: io_uring based file reader by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/westonpace/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/westonpace">@westonpace</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="3840412485" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/5777" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/5777/hovercard" href="https://github.com/lance-format/lance/pull/5777">#5777</a></li> <li>feat: add an arrow-stats crate with the ability to calculate basic stats on arrays by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/westonpace/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/westonpace">@westonpace</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="3959820214" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/5967" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/5967/hovercard" href="https://github.com/lance-format/lance/pull/5967">#5967</a></li> <li>feat(java): add non-blocking AsyncScanner with CompletableFuture API by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/beinan/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/beinan">@beinan</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4024898935" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6102" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6102/hovercard" href="https://github.com/lance-format/lance/pull/6102">#6102</a></li> <li>feat: change default file format version to 2.1 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/westonpace/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/westonpace">@westonpace</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4034390274" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6115" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6115/hovercard" href="https://github.com/lance-format/lance/pull/6115">#6115</a></li> <li>feat(namespace): add count_table_rows, insert_into_table, query_table by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/XuQianJin-Stars/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/XuQianJin-Stars">@XuQianJin-Stars</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4044033694" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6132" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6132/hovercard" href="https://github.com/lance-format/lance/pull/6132">#6132</a></li> <li>feat(DirectoryNamespace): support index and transaction related operations by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/zhangyue19921010/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/zhangyue19921010">@zhangyue19921010</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4071562200" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6196" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6196/hovercard" href="https://github.com/lance-format/lance/pull/6196">#6196</a></li> <li>feat: pluggable index cache via CacheBackend trait by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/wjones127/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/wjones127">@wjones127</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4096514291" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6222" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6222/hovercard" href="https://github.com/lance-format/lance/pull/6222">#6222</a></li> <li>feat: introduce <code>CacheCodec</code> for serializing index cache entries by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/wjones127/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/wjones127">@wjones127</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4096661342" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6223" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6223/hovercard" href="https://github.com/lance-format/lance/pull/6223">#6223</a></li> <li>feat: bounding source fragments for compaction execution by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/hamersaw/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/hamersaw">@hamersaw</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4103665580" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6232" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6232/hovercard" href="https://github.com/lance-format/lance/pull/6232">#6232</a></li> <li>fix: filter out detached versions when scanning manifests by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jackye1995/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jackye1995">@jackye1995</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4109392452" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6245" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6245/hovercard" href="https://github.com/lance-format/lance/pull/6245">#6245</a></li> <li>feat: allow setting transaction properties in various operations by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jackye1995/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jackye1995">@jackye1995</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4109834213" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6246" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6246/hovercard" href="https://github.com/lance-format/lance/pull/6246">#6246</a></li> <li>feat: add OpenDAL Azdls backend for abfss:// with use_opendal flag by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/burlacio/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/burlacio">@burlacio</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4120145533" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6256" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6256/hovercard" href="https://github.com/lance-format/lance/pull/6256">#6256</a></li> <li>feat: add aimd throttled object store by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/westonpace/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/westonpace">@westonpace</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4125208653" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6266" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6266/hovercard" href="https://github.com/lance-format/lance/pull/6266">#6266</a></li> <li>feat: clarify logical indices and physical index segments by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Xuanwo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Xuanwo">@Xuanwo</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4127006473" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6270" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6270/hovercard" href="https://github.com/lance-format/lance/pull/6270">#6270</a></li> <li>feat: support stop-word gaps in phrase queries by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/BubbleCal/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/BubbleCal">@BubbleCal</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4128677927" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6277" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6277/hovercard" href="https://github.com/lance-format/lance/pull/6277">#6277</a></li> <li>feat: move rate limiting to the object store by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/westonpace/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/westonpace">@westonpace</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4135647905" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6293" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6293/hovercard" href="https://github.com/lance-format/lance/pull/6293">#6293</a></li> <li>feat: support non-shared centroid vector index builds by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Xuanwo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Xuanwo">@Xuanwo</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4137483398" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6296" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6296/hovercard" href="https://github.com/lance-format/lance/pull/6296">#6296</a></li> <li>feat: add configurable FTS index prewarm options by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/BubbleCal/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/BubbleCal">@BubbleCal</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4142094554" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6298" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6298/hovercard" href="https://github.com/lance-format/lance/pull/6298">#6298</a></li> <li>feat: add a fast dataset version ID API by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/BubbleCal/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/BubbleCal">@BubbleCal</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4143390165" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6303" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6303/hovercard" href="https://github.com/lance-format/lance/pull/6303">#6303</a></li> <li>feat(python): add storage_options to IvfModel and PqModel save/load by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/hushengquan/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/hushengquan">@hushengquan</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4151782836" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6312" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6312/hovercard" href="https://github.com/lance-format/lance/pull/6312">#6312</a></li> <li>feat: add write progress callback to InsertBuilder by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/wjones127/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/wjones127">@wjones127</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4155693952" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6318" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6318/hovercard" href="https://github.com/lance-format/lance/pull/6318">#6318</a></li> <li>feat: expose stable row ids by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ivscheianu/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ivscheianu">@ivscheianu</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4160376760" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6325" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6325/hovercard" href="https://github.com/lance-format/lance/pull/6325">#6325</a></li> <li>feat(java): add allowExternalBlobOutsideBases to WriteParams by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/beinan/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/beinan">@beinan</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4167588749" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6330" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6330/hovercard" href="https://github.com/lance-format/lance/pull/6330">#6330</a></li> <li>feat: support hamming distance in HNSW by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/BubbleCal/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/BubbleCal">@BubbleCal</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4169943262" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6336" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6336/hovercard" href="https://github.com/lance-format/lance/pull/6336">#6336</a></li> <li>feat: make MAX_MINIBLOCK_VALUES configurable via env var by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/westonpace/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/westonpace">@westonpace</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4170897287" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6340" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6340/hovercard" href="https://github.com/lance-format/lance/pull/6340">#6340</a></li> <li>feat: support bf16 from pytorch dataset by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/eddyxu/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/eddyxu">@eddyxu</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4171903350" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6342" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6342/hovercard" href="https://github.com/lance-format/lance/pull/6342">#6342</a></li> <li>feat: support DataFusion Expr in DeleteBuilder by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/wjones127/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/wjones127">@wjones127</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4172218481" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6343" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6343/hovercard" href="https://github.com/lance-format/lance/pull/6343">#6343</a></li> <li>feat: support ingest mode for external blob writes by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Xuanwo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Xuanwo">@Xuanwo</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4177440185" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6356" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6356/hovercard" href="https://github.com/lance-format/lance/pull/6356">#6356</a></li> <li>feat: support distributed IVF_RQ segment builds by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Xuanwo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Xuanwo">@Xuanwo</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4177750426" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6359" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6359/hovercard" href="https://github.com/lance-format/lance/pull/6359">#6359</a></li> <li>feat: expose branch_identifier in python and java bindings by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/majin1102/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/majin1102">@majin1102</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4178481286" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6360" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6360/hovercard" href="https://github.com/lance-format/lance/pull/6360">#6360</a></li> <li>feat: object store decides scheduler type by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/westonpace/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/westonpace">@westonpace</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4186827104" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6373" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6373/hovercard" href="https://github.com/lance-format/lance/pull/6373">#6373</a></li> <li>feat: support vector query pruning by index segments by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Xuanwo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Xuanwo">@Xuanwo</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4189448389" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6376" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6376/hovercard" href="https://github.com/lance-format/lance/pull/6376">#6376</a></li> <li>feat: add batch_size_bytes to encoding decode stream by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/westonpace/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/westonpace">@westonpace</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4194703432" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6388" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6388/hovercard" href="https://github.com/lance-format/lance/pull/6388">#6388</a></li> <li>feat: thread data_size through decode pipeline by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/westonpace/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/westonpace">@westonpace</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4195869631" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6391" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6391/hovercard" href="https://github.com/lance-format/lance/pull/6391">#6391</a></li> <li>feat: support index build progress callbacks in Python bindings by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/vivek-bharathan/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/vivek-bharathan">@vivek-bharathan</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4197664971" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6394" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6394/hovercard" href="https://github.com/lance-format/lance/pull/6394">#6394</a></li> <li>feat: refine logical vector index into an IVF view by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Xuanwo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Xuanwo">@Xuanwo</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4199803333" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6400" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6400/hovercard" href="https://github.com/lance-format/lance/pull/6400">#6400</a></li> <li>feat: optimize one segmented vector segment per run by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Xuanwo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Xuanwo">@Xuanwo</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4199922828" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6402" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6402/hovercard" href="https://github.com/lance-format/lance/pull/6402">#6402</a></li> <li>feat: validate DataFile column_indices at commit time by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/westonpace/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/westonpace">@westonpace</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4212093656" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6414" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6414/hovercard" href="https://github.com/lance-format/lance/pull/6414">#6414</a></li> <li>feat(java): add Dataset.getZonemapStats() API by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/beinan/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/beinan">@beinan</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4215774641" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6421" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6421/hovercard" href="https://github.com/lance-format/lance/pull/6421">#6421</a></li> <li>feat: support IVF partitions multi-split by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/BubbleCal/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/BubbleCal">@BubbleCal</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4217098499" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6423" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6423/hovercard" href="https://github.com/lance-format/lance/pull/6423">#6423</a></li> <li>feat(python): add blob-aware to_pandas by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/BubbleCal/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/BubbleCal">@BubbleCal</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4217129021" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6424" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6424/hovercard" href="https://github.com/lance-format/lance/pull/6424">#6424</a></li> <li>feat: add DataFile.create helper for building DataFile metadata by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/westonpace/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/westonpace">@westonpace</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4218861774" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6427" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6427/hovercard" href="https://github.com/lance-format/lance/pull/6427">#6427</a></li> </ul> <h3>Bug Fixes šŸ›</h3> <ul> <li>fix: handle list-level NULLs in NOT filters by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/fenfeng9/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/fenfeng9">@fenfeng9</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4001559121" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6044" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6044/hovercard" href="https://github.com/lance-format/lance/pull/6044">#6044</a></li> <li>fix: like queries with a prefix should be accelerated by btree and zonemap by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jackye1995/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jackye1995">@jackye1995</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4069276401" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6188" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6188/hovercard" href="https://github.com/lance-format/lance/pull/6188">#6188</a></li> <li>fix: respect the old data filter on inverted index by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/westonpace/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/westonpace">@westonpace</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4091239985" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6216" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6216/hovercard" href="https://github.com/lance-format/lance/pull/6216">#6216</a></li> <li>fix: 2.1/2.2 panic when a list column had small values and many empty values by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/westonpace/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/westonpace">@westonpace</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4104371848" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6234" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6234/hovercard" href="https://github.com/lance-format/lance/pull/6234">#6234</a></li> <li>fix: resolve_latest_location converts errors to not_found unconditionally by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/wkalt/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/wkalt">@wkalt</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4110895904" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6248" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6248/hovercard" href="https://github.com/lance-format/lance/pull/6248">#6248</a></li> <li>fix: return errors for unsupported fixed-size-list child types by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/myandpr/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/myandpr">@myandpr</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4116811756" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6253" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6253/hovercard" href="https://github.com/lance-format/lance/pull/6253">#6253</a></li> <li>fix: adding namespace support to java SDK CommitBuilder from dataset by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/hamersaw/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/hamersaw">@hamersaw</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4120937976" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6257" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6257/hovercard" href="https://github.com/lance-format/lance/pull/6257">#6257</a></li> <li>fix: pass dataset_options to SafeLanceDataset in worker processes by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/eddyxu/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/eddyxu">@eddyxu</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4129136799" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6278" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6278/hovercard" href="https://github.com/lance-format/lance/pull/6278">#6278</a></li> <li>fix(python): preserve index details in python index metadata by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Xuanwo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Xuanwo">@Xuanwo</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4129322785" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6279" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6279/hovercard" href="https://github.com/lance-format/lance/pull/6279">#6279</a></li> <li>fix: support hamming distance in IndicesBuilder by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jmhsieh/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jmhsieh">@jmhsieh</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4137212473" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6295" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6295/hovercard" href="https://github.com/lance-format/lance/pull/6295">#6295</a></li> <li>fix(namespace): support nested types in convert_json_arrow_type by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jiaoew1991/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jiaoew1991">@jiaoew1991</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4142545531" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6300" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6300/hovercard" href="https://github.com/lance-format/lance/pull/6300">#6300</a></li> <li>fix: restore namespace build after DatasetIndexExt move by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Xuanwo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Xuanwo">@Xuanwo</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4142675178" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6302" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6302/hovercard" href="https://github.com/lance-format/lance/pull/6302">#6302</a></li> <li>fix: multiple improvements for gh workflows by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/esteban/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/esteban">@esteban</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4145932522" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6306" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6306/hovercard" href="https://github.com/lance-format/lance/pull/6306">#6306</a></li> <li>fix: use StorageOptions::new() in cloud providers to pick up env vars by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/westonpace/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/westonpace">@westonpace</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4152988486" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6316" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6316/hovercard" href="https://github.com/lance-format/lance/pull/6316">#6316</a></li> <li>refactor: remove row-id ordering from vector index merge by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Xuanwo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Xuanwo">@Xuanwo</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4168375856" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6332" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6332/hovercard" href="https://github.com/lance-format/lance/pull/6332">#6332</a></li> <li>fix: avoid full scan for nullable vector fragment sampling by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Xuanwo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Xuanwo">@Xuanwo</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4171788771" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6341" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6341/hovercard" href="https://github.com/lance-format/lance/pull/6341">#6341</a></li> <li>fix: respect fragment filters during distributed worker training by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Xuanwo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Xuanwo">@Xuanwo</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4177484278" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6358" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6358/hovercard" href="https://github.com/lance-format/lance/pull/6358">#6358</a></li> <li>fix: ensure durable writes actually wait for WAL flush by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/hamersaw/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/hamersaw">@hamersaw</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4183688923" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6368" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6368/hovercard" href="https://github.com/lance-format/lance/pull/6368">#6368</a></li> <li>fix: return error instead of OOM on corrupt binary page offsets by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/westonpace/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/westonpace">@westonpace</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4196787972" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6392" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6392/hovercard" href="https://github.com/lance-format/lance/pull/6392">#6392</a></li> <li>fix: preserve multipart part ordering in throttle wrapper by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/westonpace/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/westonpace">@westonpace</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4196933887" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6393" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6393/hovercard" href="https://github.com/lance-format/lance/pull/6393">#6393</a></li> <li>fix: remove legacy tempfile save of IVF centroids in GPU training path by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/hushengquan/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/hushengquan">@hushengquan</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4197973293" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6396" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6396/hovercard" href="https://github.com/lance-format/lance/pull/6396">#6396</a></li> <li>fix: implement RowIdMeta.asdict() and from_dict() for stable row ID serialization by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/pengw0048/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/pengw0048">@pengw0048</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4201980585" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6405" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6405/hovercard" href="https://github.com/lance-format/lance/pull/6405">#6405</a></li> <li>fix(namespace): remove trailing empty query in table uri by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jackye1995/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jackye1995">@jackye1995</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4212413909" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6415" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6415/hovercard" href="https://github.com/lance-format/lance/pull/6415">#6415</a></li> <li>fix: skip legacy validation for Overwrite operations by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/hamersaw/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/hamersaw">@hamersaw</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4215229735" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6418" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6418/hovercard" href="https://github.com/lance-format/lance/pull/6418">#6418</a></li> <li>fix: implement next page token support in list namespaces and tables by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ayao227/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ayao227">@ayao227</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4215420598" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6419" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6419/hovercard" href="https://github.com/lance-format/lance/pull/6419">#6419</a></li> <li>fix: avoid corrupting sub-schema merge_insert pages on v2.2 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Xuanwo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Xuanwo">@Xuanwo</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4215503054" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6420" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6420/hovercard" href="https://github.com/lance-format/lance/pull/6420">#6420</a></li> <li>fix(merge_insert): use sentinel column for NULL-safe source row detection by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/pratik0316/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/pratik0316">@pratik0316</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4225529389" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6439" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6439/hovercard" href="https://github.com/lance-format/lance/pull/6439">#6439</a></li> </ul> <h3>Documentation šŸ“š</h3> <ul> <li>docs: shorten core major release vote window by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Xuanwo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Xuanwo">@Xuanwo</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4052870186" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6154" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6154/hovercard" href="https://github.com/lance-format/lance/pull/6154">#6154</a></li> <li>docs: add conflict handling and FRI guidance by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/westonpace/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/westonpace">@westonpace</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4143905228" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6304" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6304/hovercard" href="https://github.com/lance-format/lance/pull/6304">#6304</a></li> <li>docs(python): prefer uv for local environment setup by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Xuanwo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Xuanwo">@Xuanwo</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4169377603" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6335" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6335/hovercard" href="https://github.com/lance-format/lance/pull/6335">#6335</a></li> <li>docs: clarify helper function guidance in AGENTS.md by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Xuanwo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Xuanwo">@Xuanwo</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4177451027" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6357" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6357/hovercard" href="https://github.com/lance-format/lance/pull/6357">#6357</a></li> <li>docs: document DataFile column_indices changes in 2.1 format by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/westonpace/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/westonpace">@westonpace</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4212502913" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6416" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6416/hovercard" href="https://github.com/lance-format/lance/pull/6416">#6416</a></li> <li>docs: add community sync to docs by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ccmao1130/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ccmao1130">@ccmao1130</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4221506324" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6434" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6434/hovercard" href="https://github.com/lance-format/lance/pull/6434">#6434</a></li> </ul> <h3>Performance Improvements šŸš€</h3> <ul> <li>perf: add benchmark for distributed vector merge finalization by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Xuanwo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Xuanwo">@Xuanwo</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4063501265" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6176" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6176/hovercard" href="https://github.com/lance-format/lance/pull/6176">#6176</a></li> <li>perf: new layout for positions and new algo for phrase query by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/BubbleCal/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/BubbleCal">@BubbleCal</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4080609132" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6203" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6203/hovercard" href="https://github.com/lance-format/lance/pull/6203">#6203</a></li> <li>perf: batched WAND and new WAND structure, ~50% faster by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/BubbleCal/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/BubbleCal">@BubbleCal</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4108637020" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6241" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6241/hovercard" href="https://github.com/lance-format/lance/pull/6241">#6241</a></li> <li>perf: optimize stable row_id index build from O(rows) to O(fragments) by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jiaoew1991/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jiaoew1991">@jiaoew1991</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4151642216" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6310" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6310/hovercard" href="https://github.com/lance-format/lance/pull/6310">#6310</a></li> <li>perf: remove O(n²) performance regression in take() with duplicate indices by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/YSBF/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/YSBF">@YSBF</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4174525366" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6351" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6351/hovercard" href="https://github.com/lance-format/lance/pull/6351">#6351</a></li> <li>perf: reduce bitmap index build to 1 bitmap in RAM by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/wkalt/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/wkalt">@wkalt</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4184290296" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6371" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6371/hovercard" href="https://github.com/lance-format/lance/pull/6371">#6371</a></li> <li>perf: fix O(N²) version column scan with deletion vectors by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/pengw0048/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/pengw0048">@pengw0048</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4188426096" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6375" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6375/hovercard" href="https://github.com/lance-format/lance/pull/6375">#6375</a></li> </ul> <h3>Other Changes</h3> <ul> <li>refactor: distributed vector segment build by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Xuanwo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Xuanwo">@Xuanwo</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4093079881" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6220" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6220/hovercard" href="https://github.com/lance-format/lance/pull/6220">#6220</a></li> <li>refactor: rename "region" to "shard" in mem_wal implementation by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/hamersaw/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/hamersaw">@hamersaw</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4181527044" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6367" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6367/hovercard" href="https://github.com/lance-format/lance/pull/6367">#6367</a></li> </ul> <p><strong>Full Changelog</strong>: <a class="commit-link" href="https://github.com/lance-format/lance/compare/release-root/5.0.0-beta.N...v5.0.0-rc.1"><tt>release-root/5.0.0-beta.N...v5.0.0-rc.1</tt></a></p> lance-community tag:github.com,2008:Repository/511691380/v5.0.0-beta.6 2026-04-09T06:30:17Z v5.0.0-beta.6 <h2>What's Changed</h2> <h3>New Features šŸŽ‰</h3> <ul> <li>feat: introduce <code>CacheCodec</code> for serializing index cache entries by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/wjones127/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/wjones127">@wjones127</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4096661342" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6223" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6223/hovercard" href="https://github.com/lance-format/lance/pull/6223">#6223</a></li> <li>feat(java): add allowExternalBlobOutsideBases to WriteParams by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/beinan/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/beinan">@beinan</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4167588749" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6330" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6330/hovercard" href="https://github.com/lance-format/lance/pull/6330">#6330</a></li> <li>feat: add batch_size_bytes to encoding decode stream by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/westonpace/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/westonpace">@westonpace</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4194703432" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6388" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6388/hovercard" href="https://github.com/lance-format/lance/pull/6388">#6388</a></li> <li>feat: validate DataFile column_indices at commit time by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/westonpace/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/westonpace">@westonpace</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4212093656" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6414" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6414/hovercard" href="https://github.com/lance-format/lance/pull/6414">#6414</a></li> <li>feat(java): add Dataset.getZonemapStats() API by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/beinan/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/beinan">@beinan</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4215774641" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6421" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6421/hovercard" href="https://github.com/lance-format/lance/pull/6421">#6421</a></li> <li>feat: support IVF partitions multi-split by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/BubbleCal/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/BubbleCal">@BubbleCal</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4217098499" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6423" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6423/hovercard" href="https://github.com/lance-format/lance/pull/6423">#6423</a></li> <li>feat(python): add blob-aware to_pandas by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/BubbleCal/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/BubbleCal">@BubbleCal</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4217129021" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6424" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6424/hovercard" href="https://github.com/lance-format/lance/pull/6424">#6424</a></li> <li>feat: add DataFile.create helper for building DataFile metadata by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/westonpace/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/westonpace">@westonpace</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4218861774" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6427" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6427/hovercard" href="https://github.com/lance-format/lance/pull/6427">#6427</a></li> </ul> <h3>Bug Fixes šŸ›</h3> <ul> <li>fix: return error instead of OOM on corrupt binary page offsets by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/westonpace/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/westonpace">@westonpace</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4196787972" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6392" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6392/hovercard" href="https://github.com/lance-format/lance/pull/6392">#6392</a></li> <li>fix: implement RowIdMeta.asdict() and from_dict() for stable row ID serialization by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/pengw0048/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/pengw0048">@pengw0048</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4201980585" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6405" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6405/hovercard" href="https://github.com/lance-format/lance/pull/6405">#6405</a></li> <li>fix(namespace): remove trailing empty query in table uri by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/jackye1995/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/jackye1995">@jackye1995</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4212413909" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6415" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6415/hovercard" href="https://github.com/lance-format/lance/pull/6415">#6415</a></li> <li>fix: skip legacy validation for Overwrite operations by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/hamersaw/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/hamersaw">@hamersaw</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4215229735" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6418" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6418/hovercard" href="https://github.com/lance-format/lance/pull/6418">#6418</a></li> <li>fix: implement next page token support in list namespaces and tables by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ayao227/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ayao227">@ayao227</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4215420598" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6419" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6419/hovercard" href="https://github.com/lance-format/lance/pull/6419">#6419</a></li> <li>fix: avoid corrupting sub-schema merge_insert pages on v2.2 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Xuanwo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Xuanwo">@Xuanwo</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4215503054" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6420" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6420/hovercard" href="https://github.com/lance-format/lance/pull/6420">#6420</a></li> <li>fix(merge_insert): use sentinel column for NULL-safe source row detection by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/pratik0316/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/pratik0316">@pratik0316</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4225529389" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6439" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6439/hovercard" href="https://github.com/lance-format/lance/pull/6439">#6439</a></li> </ul> <h3>Documentation šŸ“š</h3> <ul> <li>docs: document DataFile column_indices changes in 2.1 format by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/westonpace/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/westonpace">@westonpace</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4212502913" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6416" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6416/hovercard" href="https://github.com/lance-format/lance/pull/6416">#6416</a></li> <li>docs: add community sync to docs by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ccmao1130/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ccmao1130">@ccmao1130</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4221506324" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6434" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6434/hovercard" href="https://github.com/lance-format/lance/pull/6434">#6434</a></li> </ul> <p><strong>Full Changelog</strong>: <a class="commit-link" href="https://github.com/lance-format/lance/compare/v5.0.0-beta.5...v5.0.0-beta.6"><tt>v5.0.0-beta.5...v5.0.0-beta.6</tt></a></p> lance-community tag:github.com,2008:Repository/511691380/release-root/5.1.0-beta.N 2026-04-09T16:04:08Z release-root/5.1.0-beta.N: Base: 5.0.0-rc.1 <p>Release root for 5.1.0-beta.N series</p> changhiskhan tag:github.com,2008:Repository/511691380/v5.0.0-beta.5 2026-04-04T07:28:48Z v5.0.0-beta.5 <h2>What's Changed</h2> <h3>New Features šŸŽ‰</h3> <ul> <li>feat(namespace): add count_table_rows, insert_into_table, query_table by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/XuQianJin-Stars/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/XuQianJin-Stars">@XuQianJin-Stars</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4044033694" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6132" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6132/hovercard" href="https://github.com/lance-format/lance/pull/6132">#6132</a></li> <li>feat: thread data_size through decode pipeline by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/westonpace/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/westonpace">@westonpace</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4195869631" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6391" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6391/hovercard" href="https://github.com/lance-format/lance/pull/6391">#6391</a></li> <li>feat: support index build progress callbacks in Python bindings by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/vivek-bharathan/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/vivek-bharathan">@vivek-bharathan</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4197664971" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6394" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6394/hovercard" href="https://github.com/lance-format/lance/pull/6394">#6394</a></li> <li>feat: refine logical vector index into an IVF view by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Xuanwo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Xuanwo">@Xuanwo</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4199803333" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6400" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6400/hovercard" href="https://github.com/lance-format/lance/pull/6400">#6400</a></li> <li>feat: optimize one segmented vector segment per run by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Xuanwo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Xuanwo">@Xuanwo</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4199922828" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6402" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6402/hovercard" href="https://github.com/lance-format/lance/pull/6402">#6402</a></li> </ul> <h3>Bug Fixes šŸ›</h3> <ul> <li>fix: remove legacy tempfile save of IVF centroids in GPU training path by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/hushengquan/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/hushengquan">@hushengquan</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4197973293" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6396" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6396/hovercard" href="https://github.com/lance-format/lance/pull/6396">#6396</a></li> </ul> <h3>Other Changes</h3> <ul> <li>refactor: rename "region" to "shard" in mem_wal implementation by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/hamersaw/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/hamersaw">@hamersaw</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4181527044" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6367" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6367/hovercard" href="https://github.com/lance-format/lance/pull/6367">#6367</a></li> </ul> <p><strong>Full Changelog</strong>: <a class="commit-link" href="https://github.com/lance-format/lance/compare/v5.0.0-beta.4...v5.0.0-beta.5"><tt>v5.0.0-beta.4...v5.0.0-beta.5</tt></a></p> lance-community tag:github.com,2008:Repository/511691380/v5.0.0-beta.4 2026-04-02T21:37:34Z v5.0.0-beta.4 <h2>What's Changed</h2> <h3>Breaking Changes šŸ› </h3> <ul> <li>feat!: add progress monitoring via callbacks for distributed merge by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/vivek-bharathan/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/vivek-bharathan">@vivek-bharathan</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4085981641" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6210" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6210/hovercard" href="https://github.com/lance-format/lance/pull/6210">#6210</a></li> </ul> <h3>New Features šŸŽ‰</h3> <ul> <li>feat: support ingest mode for external blob writes by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Xuanwo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Xuanwo">@Xuanwo</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4177440185" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6356" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6356/hovercard" href="https://github.com/lance-format/lance/pull/6356">#6356</a></li> <li>feat: support vector query pruning by index segments by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Xuanwo/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Xuanwo">@Xuanwo</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4189448389" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6376" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6376/hovercard" href="https://github.com/lance-format/lance/pull/6376">#6376</a></li> </ul> <h3>Bug Fixes šŸ›</h3> <ul> <li>fix: ensure durable writes actually wait for WAL flush by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/hamersaw/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/hamersaw">@hamersaw</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4183688923" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6368" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6368/hovercard" href="https://github.com/lance-format/lance/pull/6368">#6368</a></li> <li>fix: preserve multipart part ordering in throttle wrapper by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/westonpace/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/westonpace">@westonpace</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4196933887" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6393" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6393/hovercard" href="https://github.com/lance-format/lance/pull/6393">#6393</a></li> </ul> <h3>Performance Improvements šŸš€</h3> <ul> <li>perf: fix O(N²) version column scan with deletion vectors by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/pengw0048/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/pengw0048">@pengw0048</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4188426096" data-permission-text="Title is private" data-url="https://github.com/lance-format/lance/issues/6375" data-hovercard-type="pull_request" data-hovercard-url="/lance-format/lance/pull/6375/hovercard" href="https://github.com/lance-format/lance/pull/6375">#6375</a></li> </ul> <p><strong>Full Changelog</strong>: <a class="commit-link" href="https://github.com/lance-format/lance/compare/v5.0.0-beta.3...v5.0.0-beta.4"><tt>v5.0.0-beta.3...v5.0.0-beta.4</tt></a></p> lance-community