Commit 55cddb1

Mark Obozov

authored and

Mark Obozov

committed

fix assets

1 parent d1cd4a3 commit 55cddb1Copy full SHA for 55cddb1

3 files changed

+388963

-38954

lines changed

tests
- assets
  - tokenizer_gemma_croped.json
  - trimmed_tokenizer.json
- torchtune/modules/transforms/tokenizers
  - test_hf_model_tokenizer.py

3 files changed

+388963

-38954

lines changed

Comments

(0)