Skip to content

Adding support for sequence sharding with tensor parallelism#1136

Merged
copybara-service[bot] merged 8 commits intoAI-Hypercomputer:mainfrom
abhinavgoel95:abgoel/tensor-sequence-parallelism
Jan 4, 2025
Merged

Adding support for sequence sharding with tensor parallelism#1136
copybara-service[bot] merged 8 commits intoAI-Hypercomputer:mainfrom
abhinavgoel95:abgoel/tensor-sequence-parallelism