Search results

Implement Maximal Update Parametrization (muP)

WIPLabel your PR/Issue with WIP for some long outstanding Issues/PRs that are work in progressLabel your PR/Issue with WIP for some long outstanding Issues/PRs that are work in progress

Status: Open.

#16157 In huggingface/transformers;

· thegregyang opened on Mar 14, 2022

Model Parallelism and Big Models

Model ParallelModel Parallelilsm ImplementationsModel Parallelilsm Implementations

WIPLabel your PR/Issue with WIP for some long outstanding Issues/PRs that are work in progressLabel your PR/Issue with WIP for some long outstanding Issues/PRs that are work in progress

Status: Open.

#8771 In huggingface/transformers;

· alexorona opened on Nov 24, 2020

[Benchmark] HF Trainer on RTX-3090

BenchmarksIssues related to Memory regressions in tests and scriptsIssues related to Memory regressions in tests and scripts

WIPLabel your PR/Issue with WIP for some long outstanding Issues/PRs that are work in progressLabel your PR/Issue with WIP for some long outstanding Issues/PRs that are work in progress

Status: Open.

#14608 In huggingface/transformers;

· stas00 opened on Dec 3, 2021

[RFC] Add modeling_xxx_fusion.py to support kernel fusion

Performance

WIPLabel your PR/Issue with WIP for some long outstanding Issues/PRs that are work in progressLabel your PR/Issue with WIP for some long outstanding Issues/PRs that are work in progress

Status: Open.

#13845 In huggingface/transformers;

· hyunwoongko opened on Oct 2, 2021

Refactor Pytorch model.generate method to work on TPU

WIPLabel your PR/Issue with WIP for some long outstanding Issues/PRs that are work in progressLabel your PR/Issue with WIP for some long outstanding Issues/PRs that are work in progress

Status: Open.

#18661 In huggingface/transformers;

· mikcnt opened on Aug 17, 2022

[Kernel Fusion] training benchmarks of AOTAutograd (multiple models)

Kernel Fusion

Performance

WIPLabel your PR/Issue with WIP for some long outstanding Issues/PRs that are work in progressLabel your PR/Issue with WIP for some long outstanding Issues/PRs that are work in progress

Status: Draft (not ready).

huggingface/transformersnumber 15264

#15264 In huggingface/transformers;

· Chillee opened on Jan 21, 2022

[WIP] Add Support for masking output using a Context-Free-Grammar

WIPLabel your PR/Issue with WIP for some long outstanding Issues/PRs that are work in progressLabel your PR/Issue with WIP for some long outstanding Issues/PRs that are work in progress

Status: Open (in progress).

huggingface/transformersnumber 26520

#26520 In huggingface/transformers;

· jvhoffbauer opened on Oct 1, 2023

dalle mega

WIPLabel your PR/Issue with WIP for some long outstanding Issues/PRs that are work in progressLabel your PR/Issue with WIP for some long outstanding Issues/PRs that are work in progress

Status: Open (in progress).

huggingface/transformersnumber 18152

#18152 In huggingface/transformers;

· patil-suraj opened on Jul 15, 2022

🌐 [i18n-KO] Translating docs to Korean

Documentation

WIPLabel your PR/Issue with WIP for some long outstanding Issues/PRs that are work in progressLabel your PR/Issue with WIP for some long outstanding Issues/PRs that are work in progress

Status: Open.

#20179 In huggingface/transformers;

· wonhyeongseo opened on Nov 12, 2022

tracker: generate composability refactor

WIPLabel your PR/Issue with WIP for some long outstanding Issues/PRs that are work in progressLabel your PR/Issue with WIP for some long outstanding Issues/PRs that are work in progress

Status: Open.

#30810 In huggingface/transformers;

· gante opened on May 14, 2024

[WIP] Quantized StaticCache + compile (x2 less memory)

Cache

WIPLabel your PR/Issue with WIP for some long outstanding Issues/PRs that are work in progressLabel your PR/Issue with WIP for some long outstanding Issues/PRs that are work in progress

Status: Draft (not ready).

huggingface/transformersnumber 31277

#31277 In huggingface/transformers;

· zucchini-nlp opened on Jun 6, 2024

🌐 [i18n-zh-hant] Translating docs to Traditional Chinese (zh-hant)

WIPLabel your PR/Issue with WIP for some long outstanding Issues/PRs that are work in progressLabel your PR/Issue with WIP for some long outstanding Issues/PRs that are work in progress

Status: Open.

#26265 In huggingface/transformers;

· annahung31 opened on Sep 19, 2023