-
Notifications
You must be signed in to change notification settings - Fork 31
Closed
Labels
bugSomething isn't workingSomething isn't workingdiscojsRelated to Disco.jsRelated to Disco.jsweb clientRelated to the browser environmentRelated to the browser environment
Milestone
Description
Uploading the training file wiki.train.tokens in the web-client and hitting Train alone triggers the error:
SyntaxError: JSON.parse: unexpected character at line 1 column 1 of the JSON data
getModelJSON hub.js:584
loadTokenizer tokenizers.js:62
from_pretrained tokenizers.js:4406
getTaskTokenizer tokenizer.js:18
apply text_preprocessing.js:65
async*get preprocessing/preprocessingChain</< data.js:62
get preprocessing/preprocessingChain</< data.js:62
get preprocessing/< data.js:63
next lazy_iterator.ts:803
serialNext lazy_iterator.ts:650
lastRead lazy_iterator.ts:643
promise callback*next lazy_iterator.ts:643
next lazy_iterator.ts:711
fitDataset model.js:56
train index.js:31
fitModel trainer.js:36
It seems the web-client doesn't manage to load the Transformers.js tokenizer.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't workingdiscojsRelated to Disco.jsRelated to Disco.jsweb clientRelated to the browser environmentRelated to the browser environment