Skip to content

Change to parallel reader #635

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 14 commits into from
Feb 6, 2018
Merged

Change to parallel reader #635

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
bfda10a
Add init version of paralleled data reader.
pkuyym Feb 3, 2018
49fb3e6
Refine parallel reader.
pkuyym Feb 3, 2018
79cb57c
Fix the exiting logic for sample generator.
pkuyym Feb 3, 2018
4da0c0c
Remove cache and simplify some logic.
pkuyym Feb 4, 2018
b24a2c2
Bug fix which results main process hanging.
pkuyym Feb 4, 2018
91b3ed0
Make some parameters configurable including buffer size and random seed
pkuyym Feb 4, 2018
ecdb396
Make some parameters be arguments.
pkuyym Feb 5, 2018
ee1a4aa
Merge branch 'develop' of github.com:PaddlePaddle/models into fix-630
pkuyym Feb 5, 2018
f12deac
Add comments for data reader and adapt the model according to parallel
pkuyym Feb 5, 2018
dd008f1
Make batch assembling parallel.
pkuyym Feb 5, 2018
9e9cc52
Remove redundant argument.
pkuyym Feb 5, 2018
a830020
Polish some comments.
pkuyym Feb 6, 2018
2c59afb
Simplify some logic.
pkuyym Feb 6, 2018
f34b795
Change default value of minimum_batch_size to 1.
pkuyym Feb 6, 2018
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading