-
Notifications
You must be signed in to change notification settings - Fork 31
Description
add a new task as an example for NLP such as text classifiers. can probably use the .csv dataloaders for it.
-
Plan A: MobileBert
Preprocessing pipeline and pretrained model for TFjs is already available here:
https://github.com/tensorflow/tfjs-models/tree/master/qna
the question is if the model is compiled graph format (inference only) or could be available as layered model as well for training. see also huggingface for more [pretrained model infos], potentially converting to keras-style layered model (https://huggingface.co/docs/transformers/model_doc/mobilebert), and the google blog post on the TFjs one -
Plan B: LSTM
If finetuning mobileBert as above doesn't work in js yet, we can try simpler LSTM models as for example here: https://blog.ldtalentwork.com/2020/01/10/tensorflowjs-how-to-create-a-language-translator/
In either case, what's nice is that we have existing tokenizers/preprocessing code already available so don't need to start from scratch
what do others think?