Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Nov 16, 2023

• Fix: Inconsistent results in byte-level tokenization when using pre_tokenizer.sequence

  Show description for a609178
  

  jun.4

  committed
  a609178

Commits on Nov 15, 2023

• udpate to version = "0.15.1-dev0" (huggingface#1390)

  Show description for e3bcef2
  ArthurZucker

  authored
  e3bcef2

Commits on Nov 14, 2023

• [pre_tokenizers] Fix sentencepiece based Metaspace (huggingface#1357)

  Show description for f55822b
  

  ArthurZucker

  and

  Narsil

  authored
  f55822b

Commits on Nov 10, 2023

• Allow huggingface_hub<1.0 (huggingface#1385)

  Wauplin

  authored
  ee2af9e

Commits on Nov 6, 2023

• Allow hf_hub 0.18 (huggingface#1383)

  mariosasko

  authored
  648b33a

Commits on Oct 25, 2023

• Bump @babel/traverse from 7.22.11 to 7.23.2 in /bindings/node (huggingface#1370)

  Show description for c718c53
  dependabot[bot]

  authored
  c718c53

Commits on Oct 19, 2023

• fix: remove useless token (huggingface#1371)

  rtrompier

  authored
  985d49a

Commits on Oct 10, 2023

• fix a clerical error in the comment (huggingface#1356)

  

  天地

  authored
  0d8c57d

Commits on Oct 6, 2023

• Preparing release. (huggingface#1355)

  Show description for 4322056
  Narsil

  authored
  4322056

Commits on Oct 5, 2023

• Fixing the progressbar. (huggingface#1353)

  Show description for aed491d
  Narsil

  authored
  aed491d

Commits on Oct 2, 2023

• Let's allow hf_hub < 1.0 (huggingface#1344)

  Show description for 7e8e69a
  ArthurZucker

  authored
  7e8e69a

Commits on Sep 21, 2023

• Added ability to inspect a 'Sequence' pre-tokenizer. (huggingface#1341)

  Show description for 18bd5e8
  eaplatanios

  authored
  18bd5e8

Commits on Sep 7, 2023

• update package version for dev (huggingface#1339)

  ArthurZucker

  authored
  2c565e4

• Merge pull request huggingface#1335 from ArthurZucker/update-added-tokens

  Show description for 3dce63f
  ArthurZucker

  authored
  3dce63f

Commits on Sep 6, 2023

• get_added_tokens_decoder returns BTREEMap

  ArthurZucker

  committed
  efec086

Commits on Sep 5, 2023

• python stub.py

  ArthurZucker

  committed
  a7ace44

• linting

  ArthurZucker

  committed
  f435af8

• style

  ArthurZucker

  committed
  26fdfc2

• #[allow(dead_code)] // Suppress the "method is never used" warning

  ArthurZucker

  committed
  b57e1c3

• nits

  ArthurZucker

  committed
  c3fa75f

• make tests happy

  ArthurZucker

  committed
  08af8ea

• update the get_vocab_size to compute actual length of the get_vocab function

  ArthurZucker

  committed
  531b06f

• add support for get_added_tokens_decoder

  ArthurZucker

  committed
  f1da83f

• update

  ArthurZucker

  committed
  e5fc051

Commits on Sep 4, 2023

• styling

  ArthurZucker

  committed
  93b37f3

• make special editable as well

  ArthurZucker

  committed
  058e34b

• python stub.py

  ArthurZucker

  committed
  2291c89

• clippy

  ArthurZucker

  committed
  b235f85

• fmt

  ArthurZucker

  committed
  9aab096

• update and todo

  ArthurZucker

  committed
  a59bb76

• nits

  ArthurZucker

  committed
  c599db1

• cliipy

  ArthurZucker

  committed
  d4008b0

• updates

  ArthurZucker

  committed
  b117ac7

• make content writable in python

  ArthurZucker

  committed
  a53dff9

• fix more tests

  ArthurZucker

  committed
  d9829cd

Pagination

PreviousNext