Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Move batching and field logic from inputter to dsets #1210

Merged
merged 9 commits into from
Jan 23, 2019
Merged

Move batching and field logic from inputter to dsets #1210

Changes from 1 commit
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
8af58cb
Move batching and field logic from inputter to dsets.
flauted Jan 22, 2019
f395638
Remove _feature_tokenize from inputter.
flauted Jan 22, 2019
2bd30a2
Merge branch 'master' into fields
flauted Jan 22, 2019
3177176
Remove src_lengths from audio.
flauted Jan 22, 2019
71c1271
Make lengths a torch.int instead of self.dtype in AudioSeqField.
flauted Jan 22, 2019
3957afb
Don't output src_lengths in AudioDataset.make_examples since they're …
flauted Jan 22, 2019
2dbb48a
Add temp fix for checking if data is text in make_features.
flauted Jan 22, 2019
667d4c7
Fix for #6
flauted Jan 23, 2019
266b904
Solution for img model backwards compatibility.
flauted Jan 23, 2019
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Solution for img model backwards compatibility.
  • Loading branch information
@flauted
flauted committed Jan 23, 2019
commit 266b904e75880d9e86a51cd453d9f2a5958c5321
2 changes: 2 additions & 0 deletions onmt/inputters/inputter.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,8 @@
from onmt.utils.logging import logger
# backwards compatibility
from onmt.inputters.text_dataset import _feature_tokenize # noqa: F401
from onmt.inputters.image_dataset import ( # noqa: F401
batch_img as make_img)

import gc

Expand Down