#

pjit

Here are 2 public repositories matching this topic...

fattorib / ZeRO-transformer

Two implementations of ZeRO-1 optimizer sharding in JAX

nlp deep-learning transformers gpt xmap zero jax pjit

Updated Jun 11, 2023
Python

fattorib / transformer_shmap

Tensor Parallelism with JAX + Shard Map

transformers gpt tpu jax tensor-parallelism pjit shmap

Updated Sep 29, 2023
Python

Improve this page

Add a description, image, and links to the pjit topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the pjit topic, visit your repo's landing page and select "manage topics."