Code

Multilevel text field#1216

Code

Merged

vince62s merged 18 commits intoOpenNMT:masterOpenNMT/OpenNMT-py:masterfrom flauted:multilevel-text-fieldflauted/OpenNMT-py:multilevel-text-fieldCopy head branch name to clipboardJan 25, 2019

+182-118

Commits

Commits on Jan 22, 2019

• Move batching and field logic from inputter to dsets.

  flauted

  committed
  8af58cb

  Copy full SHA for 8af58cb

• Remove _feature_tokenize from inputter.

  flauted

  committed
  f395638

  Copy full SHA for f395638

• Merge branch 'master' into fields

  flauted

  authored
  2bd30a2

  Copy full SHA for 2bd30a2

• Remove src_lengths from audio.

  flauted

  committed
  3177176

  Copy full SHA for 3177176

• Make lengths a torch.int instead of self.dtype in AudioSeqField.

  flauted

  committed
  71c1271

  Copy full SHA for 71c1271

• Don't output src_lengths in AudioDataset.make_examples since they're no longer necessary

  flauted

  committed
  3957afb

  Copy full SHA for 3957afb

• Add temp fix for checking if data is text in make_features.

  flauted

  committed
  2dbb48a

  Copy full SHA for 2dbb48a

Commits on Jan 23, 2019

• First pass at a multi-level field design.

  flauted

  committed
  31cae5a

  Copy full SHA for 31cae5a

• Remove some unused code.

  flauted

  committed
  ea19d87

  Copy full SHA for ea19d87

• Merge branch 'master' into multilevel-text-field

  flauted

  committed
  4551293

  Copy full SHA for 4551293

• Remove batch.src_is_text attr.

  flauted

  committed
  47fa339

  Copy full SHA for 47fa339

Commits on Jan 24, 2019

• Clean up by adding __iter__ to MultiField.

  flauted

  committed
  184c426

  Copy full SHA for 184c426

• Fix extract embeddings.

  flauted

  committed
  1d95347

  Copy full SHA for 1d95347

• Clean build_vocab (including bad indentation level), incorporate OpenNMT#1199, rename TextMultiField attrs.

  flauted

  committed
  d952335

  Copy full SHA for d952335

• Remove make_features.

  flauted

  committed
  d13c6b1

  Copy full SHA for d13c6b1

• Merge branch 'master' into multilevel-text-field

  flauted

  committed
  d76ec5b

  Copy full SHA for d76ec5b

Commits on Jan 25, 2019

• Update semantics in direct calls to batch.src, batch.tgt.

  flauted

  committed
  dfc6036

  Copy full SHA for dfc6036

• Test for old-style text fields while checking for old-style vocab.

  flauted

  committed
  31246c9

  Copy full SHA for 31246c9