Skip to content
View Velosearch's full-sized avatar

Achievements

Achievement: YOLO

Achievements

Achievement: YOLO

Block or report Velosearch

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Please don't include any personal information such as legal names or email addresses. Maximum 100 characters, markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
Velosearch/README.md

VeloSearch

This is the source code of the submissioned paper at SIGMOD'25: Enabling Efficient In-Memory Full-Text Search with Vectorization on Compacted Columnar Format.

Env requirement

Rust version: 1.68.0

OS: 20.04.1-Ubuntu

CPU: x86_64 and supports AVX512, AVX, SSE4.0 and SSE SIMD instruction extensions.

Setup

Install Rust

curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh -s --default-toolchain=1.68.0

Pull dependences

Pull the customized Apache Datafusion library.

git submodule update

Compile

cargo build --release

Usage

Evalute batched search queries

Command: (the bin is generated after the rustc compilation)

./target/release/fastful-search

help info:

Usage: fastfull-search [OPTIONS] --handler <HANDLER> --base <BASE> [PATH]...

Arguments:
  [PATH]...  file path

Options:
      --handler <HANDLER>              [possible values: base, split-base, split-o1, load-data, boolean-query, posting-table, tantivy]
  -p, --partition-num <PARTITION_NUM>  
  -b, --batch-size <BATCH_SIZE>        
      --base <BASE>                    
  -d, --dump-path <DUMP_PATH>          
  -h, --help                           Print help

Interactive full-text search mode:

Command: (the bin is generated after the compilation)

./target/release/do_query <idx_dir> <thread_num>

Popular repositories Loading

  1. velosearch velosearch Public

    See https://velosearch.github.io

    Rust

  2. velosearch.github.io velosearch.github.io Public

    JavaScript