Skip to content

Commit

Permalink
input data type in fuji
Browse files Browse the repository at this point in the history
  • Loading branch information
penxujun committed Mar 12, 2024
1 parent d4265dc commit 47b21f0
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions axlearn/experiments/text/gpt/fuji.py
Original file line number Diff line number Diff line change
Expand Up @@ -16,6 +16,7 @@
RepeatedTransformerLayer,
RoFormerQKVLinear,
)
from axlearn.common.utils import DataPartitionType
from axlearn.common.embedding import TransformerTextEmbeddings
from axlearn.common.layers import RMSNorm
from axlearn.experiments.text.gpt.common import STEP_DTYPE, learner_config, mesh_shape_from_axes
Expand Down

0 comments on commit 47b21f0

Please sign in to comment.