Skip to content

Commit 1335c41

Browse files
JeronymousJeronymous
committed
use programmatic table instead of an ugly slide screenshot to illustrate trade-off between vocabulary size and tokenized sequence lengths
1 parent 8f465ac commit 1335c41

File tree

1 file changed

+178
-12
lines changed

1 file changed

+178
-12
lines changed

‎tokenizers.ipynb‎

Lines changed: 178 additions & 12 deletions
Large diffs are not rendered by default.

0 commit comments

Comments
 (0)