Search results

Adding max token budget per batch

Status: Open.

#87 In michaelfeil/infinity;

· michaelfeil opened on Feb 5, 2024

any tutorial on how to use Infinity?

documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open.

#18 In michaelfeil/infinity;

· abcnow opened on Oct 25, 2023

float16 and other optimizations help?

Status: Open.

#159 In michaelfeil/infinity;

· BBC-Esq opened on Mar 18, 2024

Add a TextSplitter in LangChain to share the model of the embedding model

Status: Open.

#193 In michaelfeil/infinity;

· Jimmy-Newtron opened on Apr 4, 2024

Support for instructur/instructor-xl models

Status: Open.

#125 In michaelfeil/infinity;

· BBC-Esq opened on Mar 2, 2024

Tensor-parallelism for multi-gpu support

wontfixThis will not be worked onThis will not be worked on

Status: Open.

#213 In michaelfeil/infinity;

· SalomonKisters opened on Apr 29, 2024

[Benchmark] - embedding quantization

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#250 In michaelfeil/infinity;

· michaelfeil opened on Jun 8, 2024

[Benchmark] - clip embeddings

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#259 In michaelfeil/infinity;

· michaelfeil opened on Jun 10, 2024

AMD ROCm docker images support (+ optimization)

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#94 In michaelfeil/infinity;

· michaelfeil opened on Feb 9, 2024

AWQ-Bert / 4-bit Bert

enhancementNew feature or requestNew feature or request

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#95 In michaelfeil/infinity;

· michaelfeil opened on Feb 10, 2024

Love the repo! Wish I could help!

Status: Open.

#157 In michaelfeil/infinity;

· BBC-Esq opened on Mar 18, 2024

how to accelerate bge m3 sparse embeding module when inference？

Status: Open.

#294 In michaelfeil/infinity;

· seetimee opened on Jul 2, 2024