Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

0.2 #126

Merged
merged 101 commits into from
Feb 15, 2023
Merged

0.2 #126

merged 101 commits into from
Feb 15, 2023

Commits on Nov 27, 2022

  1. rewrite wordpiece with DAT

    @chengchingwen
    chengchingwen committed Nov 27, 2022
    Configuration menu
    Copy the full SHA
    34f247f View commit details
    Browse the repository at this point in the history

  2. show func for wordpiece

    @chengchingwen
    chengchingwen committed Nov 27, 2022
    Configuration menu
    Copy the full SHA
    7c8437f View commit details
    Browse the repository at this point in the history

  3. update test

    @chengchingwen
    chengchingwen committed Nov 27, 2022
    Configuration menu
    Copy the full SHA
    f01f9b9 View commit details
    Browse the repository at this point in the history

  4. correct way to get unk

    @chengchingwen
    chengchingwen committed Nov 27, 2022
    Configuration menu
    Copy the full SHA
    341b614 View commit details
    Browse the repository at this point in the history

Commits on Nov 28, 2022

  1. Merge branch 'wp_v2'

    @chengchingwen
    chengchingwen committed Nov 28, 2022
    Configuration menu
    Copy the full SHA
    a096de7 View commit details
    Browse the repository at this point in the history

Commits on Nov 30, 2022

  1. refactor hgf config

    @chengchingwen
    chengchingwen committed Nov 30, 2022
    Configuration menu
    Copy the full SHA
    0787086 View commit details
    Browse the repository at this point in the history

Commits on Dec 3, 2022

  1. remove old codes

    @chengchingwen
    chengchingwen committed Dec 3, 2022
    Configuration menu
    Copy the full SHA
    4f980e7 View commit details
    Browse the repository at this point in the history

  2. update to pre-0.2.0

    @chengchingwen
    chengchingwen committed Dec 3, 2022
    Configuration menu
    Copy the full SHA
    9e1ca4d View commit details
    Browse the repository at this point in the history

  3. rewrite loss; borrow api from Flux and add rrule

    @chengchingwen
    chengchingwen committed Dec 3, 2022
    Configuration menu
    Copy the full SHA
    b51d5fd View commit details
    Browse the repository at this point in the history

Commits on Dec 4, 2022

  1. refine loss

    @chengchingwen
    chengchingwen committed Dec 4, 2022
    Configuration menu
    Copy the full SHA
    bae559c View commit details
    Browse the repository at this point in the history

Commits on Dec 13, 2022

  1. Merge remote-tracking branch 'origin/master' into 0.2

    @chengchingwen
    chengchingwen committed Dec 13, 2022
    Configuration menu
    Copy the full SHA
    5698c66 View commit details
    Browse the repository at this point in the history

  2. remove include of removed files

    @chengchingwen
    chengchingwen committed Dec 13, 2022
    Configuration menu
    Copy the full SHA
    eab1087 View commit details
    Browse the repository at this point in the history

  3. update t5 impl with new design

    @chengchingwen
    chengchingwen committed Dec 13, 2022
    Configuration menu
    Copy the full SHA
    1ce4ad9 View commit details
    Browse the repository at this point in the history

  4. add new layer design

    @chengchingwen
    chengchingwen committed Dec 13, 2022
    Configuration menu
    Copy the full SHA
    6b52994 View commit details
    Browse the repository at this point in the history

  5. small refine

    @chengchingwen
    chengchingwen committed Dec 13, 2022
    Configuration menu
    Copy the full SHA
    71c892b View commit details
    Browse the repository at this point in the history

Commits on Dec 15, 2022

  1. update bert default config

    @chengchingwen
    chengchingwen committed Dec 15, 2022
    Configuration menu
    Copy the full SHA
    faf7ff4 View commit details
    Browse the repository at this point in the history

  2. update bert impl with new design

    @chengchingwen
    chengchingwen committed Dec 15, 2022
    Configuration menu
    Copy the full SHA
    c10eab0 View commit details
    Browse the repository at this point in the history

Commits on Dec 16, 2022

  1. fix new t5 impl

    @chengchingwen
    chengchingwen committed Dec 16, 2022
    Configuration menu
    Copy the full SHA
    1a9875f View commit details
    Browse the repository at this point in the history

  2. new load model api

    @chengchingwen
    chengchingwen committed Dec 16, 2022
    Configuration menu
    Copy the full SHA
    76859bb View commit details
    Browse the repository at this point in the history

  3. add bias to embed decoder

    @chengchingwen
    chengchingwen committed Dec 16, 2022
    Configuration menu
    Copy the full SHA
    04494aa View commit details
    Browse the repository at this point in the history

  4. fix embed method

    @chengchingwen
    chengchingwen committed Dec 16, 2022
    Configuration menu
    Copy the full SHA
    8c097ee View commit details
    Browse the repository at this point in the history

  5. update huggingface based model validate code with new api

    @chengchingwen
    chengchingwen committed Dec 16, 2022
    Configuration menu
    Copy the full SHA
    e64630b View commit details
    Browse the repository at this point in the history

Commits on Dec 23, 2022

  1. load gpt2 with new design

    @chengchingwen
    chengchingwen committed Dec 23, 2022
    Configuration menu
    Copy the full SHA
    c9656ed View commit details
    Browse the repository at this point in the history

  2. load gptj

    @chengchingwen
    chengchingwen committed Dec 23, 2022
    Configuration menu
    Copy the full SHA
    86b3575 View commit details
    Browse the repository at this point in the history

  3. update validate code with confing overwrite

    @chengchingwen
    chengchingwen committed Dec 23, 2022
    Configuration menu
    Copy the full SHA
    db261af View commit details
    Browse the repository at this point in the history

Commits on Dec 24, 2022

  1. fix cfg overwrite

    @chengchingwen
    chengchingwen committed Dec 24, 2022
    Configuration menu
    Copy the full SHA
    0981564 View commit details
    Browse the repository at this point in the history

  2. load gpt_neo

    @chengchingwen
    chengchingwen committed Dec 24, 2022
    Configuration menu
    Copy the full SHA
    c25eb47 View commit details
    Browse the repository at this point in the history

  3. load model utils; force load as float32

    @chengchingwen
    chengchingwen committed Dec 24, 2022
    Configuration menu
    Copy the full SHA
    711aaf8 View commit details
    Browse the repository at this point in the history

Commits on Dec 25, 2022

  1. move pe to NAlib

    @chengchingwen
    chengchingwen committed Dec 25, 2022
    Configuration menu
    Copy the full SHA
    dacaba5 View commit details
    Browse the repository at this point in the history

  2. move atten ops to Layers

    @chengchingwen
    chengchingwen committed Dec 25, 2022
    Configuration menu
    Copy the full SHA
    a75de7c View commit details
    Browse the repository at this point in the history

Commits on Dec 27, 2022

  1. refine code

    @chengchingwen
    chengchingwen committed Dec 27, 2022
    Configuration menu
    Copy the full SHA
    a4f8287 View commit details
    Browse the repository at this point in the history

  2. remove old model code

    @chengchingwen
    chengchingwen committed Dec 27, 2022
    Configuration menu
    Copy the full SHA
    36f58df View commit details
    Browse the repository at this point in the history

  3. clip tokenizer w/ new cfg

    @chengchingwen
    chengchingwen committed Dec 27, 2022
    Configuration menu
    Copy the full SHA
    8ebdb44 View commit details
    Browse the repository at this point in the history

  4. remove old test

    @chengchingwen
    chengchingwen committed Dec 27, 2022
    Configuration menu
    Copy the full SHA
    4c2fb39 View commit details
    Browse the repository at this point in the history

  5. update huggingface task validate code

    @chengchingwen
    chengchingwen committed Dec 27, 2022
    Configuration menu
    Copy the full SHA
    f2b30d0 View commit details
    Browse the repository at this point in the history

Commits on Dec 30, 2022

  1. update tokenizer

    @chengchingwen
    chengchingwen committed Dec 30, 2022
    Configuration menu
    Copy the full SHA
    68ab3ea View commit details
    Browse the repository at this point in the history

Commits on Dec 31, 2022

  1. test and fix huggingface load

    @chengchingwen
    chengchingwen committed Dec 31, 2022
    Configuration menu
    Copy the full SHA
    7633cd5 View commit details
    Browse the repository at this point in the history

  2. self attention construct with op

    @chengchingwen
    chengchingwen committed Dec 31, 2022
    Configuration menu
    Copy the full SHA
    7f6277f View commit details
    Browse the repository at this point in the history

Commits on Jan 4, 2023

  1. allow fast tkr to load without text encoder registed

    @chengchingwen
    chengchingwen committed Jan 4, 2023
    Configuration menu
    Copy the full SHA
    046a553 View commit details
    Browse the repository at this point in the history

  2. update huggingface validate tokenizer code

    @chengchingwen
    chengchingwen committed Jan 4, 2023
    Configuration menu
    Copy the full SHA
    f25378e View commit details
    Browse the repository at this point in the history

  3. update test

    @chengchingwen
    chengchingwen committed Jan 4, 2023
    Configuration menu
    Copy the full SHA
    44de7cf View commit details
    Browse the repository at this point in the history

  4. update env

    @chengchingwen
    chengchingwen committed Jan 4, 2023
    Configuration menu
    Copy the full SHA
    09ccfd6 View commit details
    Browse the repository at this point in the history

  5. fix test

    @chengchingwen
    chengchingwen committed Jan 4, 2023
    Configuration menu
    Copy the full SHA
    4eb6149 View commit details
    Browse the repository at this point in the history

Commits on Jan 9, 2023

  1. move all text encoders to new module TextEncoders; destruct Basic/Gen… 

    …erativePreTrain/BidirectionalEncoder
    @chengchingwen
    chengchingwen committed Jan 9, 2023
    Configuration menu
    Copy the full SHA
    8146e95 View commit details
    Browse the repository at this point in the history

  2. organize code

    @chengchingwen
    chengchingwen committed Jan 9, 2023
    Configuration menu
    Copy the full SHA
    497f804 View commit details
    Browse the repository at this point in the history

  3. update test

    @chengchingwen
    chengchingwen committed Jan 9, 2023
    Configuration menu
    Copy the full SHA
    2fdd272 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' into 0.2

    @chengchingwen
    chengchingwen committed Jan 9, 2023
    Configuration menu
    Copy the full SHA
    dd69a59 View commit details
    Browse the repository at this point in the history

Commits on Jan 10, 2023

  1. refine code; remove JSON

    @chengchingwen
    chengchingwen committed Jan 10, 2023
    Configuration menu
    Copy the full SHA
    c53bf5b View commit details
    Browse the repository at this point in the history

  2. organize code

    @chengchingwen
    chengchingwen committed Jan 10, 2023
    Configuration menu
    Copy the full SHA
    fa4aaaa View commit details
    Browse the repository at this point in the history

  3. add set_dropout

    @chengchingwen
    chengchingwen committed Jan 10, 2023
    Configuration menu
    Copy the full SHA
    acf6614 View commit details
    Browse the repository at this point in the history

  4. zip the vocab file in test

    @chengchingwen
    chengchingwen committed Jan 10, 2023
    Configuration menu
    Copy the full SHA
    0eab94a View commit details
    Browse the repository at this point in the history

  5. remove unsed packages

    @chengchingwen
    chengchingwen committed Jan 10, 2023
    Configuration menu
    Copy the full SHA
    0a334e7 View commit details
    Browse the repository at this point in the history

  6. update hgf_str and export

    @chengchingwen
    chengchingwen committed Jan 10, 2023
    Configuration menu
    Copy the full SHA
    0af78e8 View commit details
    Browse the repository at this point in the history

  7. small refine

    @chengchingwen
    chengchingwen committed Jan 10, 2023
    Configuration menu
    Copy the full SHA
    0c09e1f View commit details
    Browse the repository at this point in the history

  8. update copy example

    @chengchingwen
    chengchingwen committed Jan 10, 2023
    Configuration menu
    Copy the full SHA
    3ba74a7 View commit details
    Browse the repository at this point in the history

  9. make testmode work with Flux Dropout

    @chengchingwen
    chengchingwen committed Jan 10, 2023
    Configuration menu
    Copy the full SHA
    ea8d2ac View commit details
    Browse the repository at this point in the history

  10. update readme

    @chengchingwen
    chengchingwen committed Jan 10, 2023
    Configuration menu
    Copy the full SHA
    1d69d62 View commit details
    Browse the repository at this point in the history

  11. add missing namespace

    @chengchingwen
    chengchingwen committed Jan 10, 2023
    Configuration menu
    Copy the full SHA
    60e9440 View commit details
    Browse the repository at this point in the history

Commits on Jan 11, 2023

  1. improve type stability of todevice

    @chengchingwen
    chengchingwen committed Jan 11, 2023
    Configuration menu
    Copy the full SHA
    dce90a1 View commit details
    Browse the repository at this point in the history

  2. update AIAYN examples

    @chengchingwen
    chengchingwen committed Jan 11, 2023
    Configuration menu
    Copy the full SHA
    575131c View commit details
    Browse the repository at this point in the history

  3. update bert examples

    @chengchingwen
    chengchingwen committed Jan 11, 2023
    Configuration menu
    Copy the full SHA
    4392b16 View commit details
    Browse the repository at this point in the history

Commits on Jan 13, 2023

  1. remove/update some docs

    @chengchingwen
    chengchingwen committed Jan 13, 2023
    Configuration menu
    Copy the full SHA
    7f0239d View commit details
    Browse the repository at this point in the history

  2. update export

    @chengchingwen
    chengchingwen committed Jan 13, 2023
    Configuration menu
    Copy the full SHA
    753bf8f View commit details
    Browse the repository at this point in the history

Commits on Jan 17, 2023

  1. update changelogs

    @chengchingwen
    chengchingwen committed Jan 17, 2023
    Configuration menu
    Copy the full SHA
    e9dd168 View commit details
    Browse the repository at this point in the history

Commits on Jan 18, 2023

  1. update docs

    @chengchingwen
    chengchingwen committed Jan 18, 2023
    Configuration menu
    Copy the full SHA
    c7eaa08 View commit details
    Browse the repository at this point in the history

  2. encode for seq2seq setting

    @chengchingwen
    chengchingwen committed Jan 18, 2023
    Configuration menu
    Copy the full SHA
    d2915f0 View commit details
    Browse the repository at this point in the history

  3. Layers.WithScore for fmap NAlib.WithScore

    @chengchingwen
    chengchingwen committed Jan 18, 2023
    Configuration menu
    Copy the full SHA
    6d5baf3 View commit details
    Browse the repository at this point in the history

  4. refine set_dropout

    @chengchingwen
    chengchingwen committed Jan 18, 2023
    Configuration menu
    Copy the full SHA
    70b6b86 View commit details
    Browse the repository at this point in the history

Commits on Jan 23, 2023

  1. fix & test loss

    @chengchingwen
    chengchingwen committed Jan 23, 2023
    Configuration menu
    Copy the full SHA
    cd89f05 View commit details
    Browse the repository at this point in the history

  2. refine export

    @chengchingwen
    chengchingwen committed Jan 23, 2023
    Configuration menu
    Copy the full SHA
    3d3518d View commit details
    Browse the repository at this point in the history

  3. refine example

    @chengchingwen
    chengchingwen committed Jan 23, 2023
    Configuration menu
    Copy the full SHA
    ca3fcee View commit details
    Browse the repository at this point in the history

  4. update env

    @chengchingwen
    chengchingwen committed Jan 23, 2023
    Configuration menu
    Copy the full SHA
    4c71573 View commit details
    Browse the repository at this point in the history

  5. some docs

    @chengchingwen
    chengchingwen committed Jan 23, 2023
    Configuration menu
    Copy the full SHA
    59d254c View commit details
    Browse the repository at this point in the history

Commits on Jan 24, 2023

  1. argument non_differentiable

    @chengchingwen
    chengchingwen committed Jan 24, 2023
    Configuration menu
    Copy the full SHA
    afbb401 View commit details
    Browse the repository at this point in the history

  2. fix loss on 1.6

    @chengchingwen
    chengchingwen committed Jan 24, 2023
    Configuration menu
    Copy the full SHA
    6a059c5 View commit details
    Browse the repository at this point in the history

Commits on Jan 29, 2023

  1. refine & docs for textencoders

    @chengchingwen
    chengchingwen committed Jan 29, 2023
    Configuration menu
    Copy the full SHA
    2f43283 View commit details
    Browse the repository at this point in the history

  2. refine tutorial

    @chengchingwen
    chengchingwen committed Jan 29, 2023
    Configuration menu
    Copy the full SHA
    e055e13 View commit details
    Browse the repository at this point in the history

Commits on Jan 30, 2023

  1. docstring for HuggingFace

    @chengchingwen
    chengchingwen committed Jan 30, 2023
    Configuration menu
    Copy the full SHA
    2fb89b5 View commit details
    Browse the repository at this point in the history

Commits on Jan 31, 2023

  1. test decode

    @chengchingwen
    chengchingwen committed Jan 31, 2023
    Configuration menu
    Copy the full SHA
    c7656c8 View commit details
    Browse the repository at this point in the history

  2. relax Functors compat

    @chengchingwen
    chengchingwen committed Jan 31, 2023
    Configuration menu
    Copy the full SHA
    69b9490 View commit details
    Browse the repository at this point in the history

  3. update example

    @chengchingwen
    chengchingwen committed Jan 31, 2023
    Configuration menu
    Copy the full SHA
    f57e3a7 View commit details
    Browse the repository at this point in the history

  4. remove example

    @chengchingwen
    chengchingwen committed Jan 31, 2023
    Configuration menu
    Copy the full SHA
    e3d87f3 View commit details
    Browse the repository at this point in the history

  5. refine docstring

    @chengchingwen
    chengchingwen committed Jan 31, 2023
    Configuration menu
    Copy the full SHA
    e27d750 View commit details
    Browse the repository at this point in the history

  6. fix hgf tokenizer

    @chengchingwen
    chengchingwen committed Jan 31, 2023
    Configuration menu
    Copy the full SHA
    704889e View commit details
    Browse the repository at this point in the history

  7. more docs

    @chengchingwen
    chengchingwen committed Jan 31, 2023
    Configuration menu
    Copy the full SHA
    0777550 View commit details
    Browse the repository at this point in the history

Commits on Feb 8, 2023

  1. refine Layers: organize code and better printing

    @chengchingwen
    chengchingwen committed Feb 8, 2023
    Configuration menu
    Copy the full SHA
    f880e39 View commit details
    Browse the repository at this point in the history

  2. refine huggingface show

    @chengchingwen
    chengchingwen committed Feb 8, 2023
    Configuration menu
    Copy the full SHA
    e5233b7 View commit details
    Browse the repository at this point in the history

  3. some docstring

    @chengchingwen
    chengchingwen committed Feb 8, 2023
    Configuration menu
    Copy the full SHA
    55d0371 View commit details
    Browse the repository at this point in the history

Commits on Feb 9, 2023

  1. dense without bias

    @chengchingwen
    chengchingwen committed Feb 9, 2023
    Configuration menu
    Copy the full SHA
    d3e80df View commit details
    Browse the repository at this point in the history

Commits on Feb 11, 2023

  1. fix sequence mask type stability with todevice

    @chengchingwen
    chengchingwen committed Feb 11, 2023
    Configuration menu
    Copy the full SHA
    8499ce2 View commit details
    Browse the repository at this point in the history

  2. remove InternedString

    @chengchingwen
    chengchingwen committed Feb 11, 2023
    Configuration menu
    Copy the full SHA
    fe2caec View commit details
    Browse the repository at this point in the history

Commits on Feb 14, 2023

  1. use N(0, 1) for embedding init

    @chengchingwen
    chengchingwen committed Feb 14, 2023
    Configuration menu
    Copy the full SHA
    307bb6e View commit details
    Browse the repository at this point in the history

  2. use zeros for embed decoder bias init

    @chengchingwen
    chengchingwen committed Feb 14, 2023
    Configuration menu
    Copy the full SHA
    b0ddec7 View commit details
    Browse the repository at this point in the history

Commits on Feb 15, 2023

  1. make model global var

    @chengchingwen
    chengchingwen committed Feb 15, 2023
    Configuration menu
    Copy the full SHA
    71330c0 View commit details
    Browse the repository at this point in the history

  2. ignore indices func; allow ce passing ApplyEmbed

    @chengchingwen
    chengchingwen committed Feb 15, 2023
    Configuration menu
    Copy the full SHA
    754c706 View commit details
    Browse the repository at this point in the history

  3. fix default text encoder construct func

    @chengchingwen
    chengchingwen committed Feb 15, 2023
    Configuration menu
    Copy the full SHA
    aaf2188 View commit details
    Browse the repository at this point in the history

  4. add robeta

    @chengchingwen
    chengchingwen committed Feb 15, 2023
    Configuration menu
    Copy the full SHA
    f6524ae View commit details
    Browse the repository at this point in the history

  5. replacce view with selectdim

    @chengchingwen
    chengchingwen committed Feb 15, 2023
    Configuration menu
    Copy the full SHA
    24b0b1b View commit details
    Browse the repository at this point in the history

  6. roberta use gpt2 tokenizer

    @chengchingwen
    chengchingwen committed Feb 15, 2023
    Configuration menu
    Copy the full SHA
    a9fde55 View commit details
    Browse the repository at this point in the history

  7. update readme

    @chengchingwen
    chengchingwen committed Feb 15, 2023
    Configuration menu
    Copy the full SHA
    0620870 View commit details
    Browse the repository at this point in the history

  8. update tutorial

    @chengchingwen
    chengchingwen committed Feb 15, 2023
    Configuration menu
    Copy the full SHA
    838f2a6 View commit details
    Browse the repository at this point in the history