Search results

unable to run FSDP2 with low bit optimizers like adam 8 bit

DuplicateThis issue or pull request already existsThis issue or pull request already exists

FSDP

OptimizersIssues or feature requests relating to optimizersIssues or feature requests relating to optimizers

Status: Open.

Feature

#1403 In bitsandbytes-foundation/bitsandbytes;

· nighting0le01 opened on Oct 28, 2024

Support 8bit Optimizers on CPU

Cross Platform

DuplicateThis issue or pull request already existsThis issue or pull request already exists

EnhancementNew feature or requestNew feature or request

High Priority(first issues that will be worked on)(first issues that will be worked on)

OptimizersIssues or feature requests relating to optimizersIssues or feature requests relating to optimizers

x64 CPU

Status: Open.

Feature

#1402 In bitsandbytes-foundation/bitsandbytes;

· fzyzcjy opened on Oct 25, 2024

Paged optimizer resuming from checkpoint - attributeError: 'int' object has no attribute 'cpu'

DuplicateThis issue or pull request already existsThis issue or pull request already exists

FSDP

Status: Open.

Feature

#1381 In bitsandbytes-foundation/bitsandbytes;

· shivam15s opened on Oct 1, 2024

4bit quantized model.dequantize() fails on CPU

Cross Platform

DuplicateThis issue or pull request already existsThis issue or pull request already exists

Proposing to Close

x64 CPU

Status: Open.

Feature

#1311 In bitsandbytes-foundation/bitsandbytes;

· npbool opened on Aug 7, 2024

· 

v0.48.0

[RFC] Cross-Platform Refactor: Mac M1 support

Cross Platform

DuplicateThis issue or pull request already existsThis issue or pull request already exists

macOS

RFCrequest for comments on proposed library improvementsrequest for comments on proposed library improvements

Status: Open.

Feature

#1020 In bitsandbytes-foundation/bitsandbytes;

· rickardp opened on Feb 3, 2024

· 

v0.48.0

Support block size of 32

DuplicateThis issue or pull request already existsThis issue or pull request already exists

EnhancementNew feature or requestNew feature or request

Feature Request

To Discuss Internally

Status: Open.

Feature

#986 In bitsandbytes-foundation/bitsandbytes;

· puyuanOT opened on Jan 24, 2024

Support for Apple silicon

Cross Platform

DuplicateThis issue or pull request already existsThis issue or pull request already exists

EnhancementNew feature or requestNew feature or request

macOS

Status: Open.

Feature

#252 In bitsandbytes-foundation/bitsandbytes;

· rickardp opened on Apr 1, 2023

8-bit optimizers dont work with FSDP

Contributions WelcomeWe welcome contributions to fix this issue!We welcome contributions to fix this issue!

DuplicateThis issue or pull request already existsThis issue or pull request already exists

FSDP

OptimizersIssues or feature requests relating to optimizersIssues or feature requests relating to optimizers

To Discuss Internally

Status: Open.

Feature

#89 In bitsandbytes-foundation/bitsandbytes;

· prajdabre opened on Nov 5, 2022