Search results

Truncation of sequences that are beyond the model's maximum length

feat/tokenizationFeature: Tokenization/piecerFeature: Tokenization/piecer

type/bugType: BugType: Bug

type/featureType: FeatureType: Feature

Status: Open.

#359 In explosion/curated-transformers;

· MootezSaaD opened on Jan 14, 2024

· Updated on Jan 31, 2024

Add suggested PyTorch LLM optimizations

feat/generationFeature: GenerationFeature: Generation

feat/modelFeature: modelsFeature: models

Status: Open.

#356 In explosion/curated-transformers;

· danieldk opened on Dec 1, 2023

· Updated on Dec 1, 2023

Output logits for generation

feat/generationFeature: GenerationFeature: Generation

type/featureType: FeatureType: Feature

Status: Open.

#311 In explosion/curated-transformers;

· mayankjobanputra opened on Aug 24, 2023

· Updated on Oct 19, 2023

 ·  

v2.0.0

Optimal Qlora settings

feat/trainingFeature: Training/Fine-tuningFeature: Training/Fine-tuning

type/featureType: FeatureType: Feature

Status: Open.

#316 In explosion/curated-transformers;

· KnutJaegersberg opened on Sep 2, 2023

· Updated on Oct 19, 2023

 ·  

Undecided

Thoughts on jaxtyping

feat/miscFeature: MiscellaneousFeature: Miscellaneous

type/featureType: FeatureType: Feature

Status: Open.

#246 In explosion/curated-transformers;

· Ryu1845 opened on Jul 14, 2023

· Updated on Oct 19, 2023

 ·  

Undecided

Add Low-Rank Adapters injection into base models

feat/trainingFeature: Training/Fine-tuningFeature: Training/Fine-tuning

type/featureType: FeatureType: Feature

Status: Open.

#312 In explosion/curated-transformers;

· bilelomrani1 opened on Aug 28, 2023

· Updated on Oct 19, 2023

 ·  

Undecided

Move the old Falcon architecuture to the extras/addons pacakage

type/maintenanceType: MaintenanceType: Maintenance

Status: Open.

#355 In explosion/curated-transformers;

· shadeMe opened on Oct 19, 2023

· Updated on Oct 19, 2023

 ·  

Undecided

Support DeBERTa v2/3

feat/modelFeature: modelsFeature: models

type/featureType: FeatureType: Feature

Status: Open.

#348 In explosion/curated-transformers;

· danieldk opened on Oct 3, 2023

· Updated on Oct 19, 2023

 ·  

Undecided

Add support for Mistral

feat/modelFeature: modelsFeature: models

type/featureType: FeatureType: Feature

Status: Open.

#341 In explosion/curated-transformers;

· danieldk opened on Oct 3, 2023

· Updated on Oct 19, 2023

 ·  

v2.1.0

Support for Encoder-Decoder-style architectures

feat/modelFeature: modelsFeature: models

type/featureType: FeatureType: Feature

Status: Open.

#340 In explosion/curated-transformers;

· bilelomrani1 opened on Oct 2, 2023

· Updated on Oct 5, 2023

 ·  

Undecided

Add support for attention sinks

feat/layersFeature: LayersFeature: Layers

feat/modelFeature: modelsFeature: models

type/featureType: FeatureType: Feature

Status: Open.

#350 In explosion/curated-transformers;

· danieldk opened on Oct 4, 2023

· Updated on Oct 4, 2023

 ·  

Undecided

Option to only return the last hidden layer output from models

feat/modelFeature: modelsFeature: models

type/featureType: FeatureType: Feature

Status: Open.

#342 In explosion/curated-transformers;

· danieldk opened on Oct 3, 2023

· Updated on Oct 4, 2023

 ·  

v2.0.0