Skip to content
This repository has been archived by the owner on Nov 22, 2022. It is now read-only.

Add shuffling to new pytext data #410

Closed
wants to merge 1 commit into from

Conversation

mwu1993
Copy link
Contributor

@mwu1993 mwu1993 commented Mar 18, 2019

Summary: When batchifying data, add a flag to load some number of batches and shuffle all examples before creating batches.

Differential Revision: D14513256

@facebook-github-bot facebook-github-bot added the CLA Signed Do not delete this pull request or issue due to inactivity. label Mar 18, 2019
mwu1993 pushed a commit to mwu1993/pytext-1 that referenced this pull request Mar 19, 2019
)

Summary:
Pull Request resolved: facebookresearch#410

Create a new batcher that will sort, batch from, and shuffle from pools of examples (instead of streaming one batch at a time as the current batcher does).

Differential Revision: D14513256

fbshipit-source-id: 17644c669084ac92cecbdfcc25988970e06a1767
)

Summary:
Pull Request resolved: facebookresearch#410

Create a new batcher that will sort, batch from, and shuffle from pools of examples (instead of streaming one batch at a time as the current batcher does).

Differential Revision: D14513256

fbshipit-source-id: a81ba795f8535a975c6a5311c8390e33d3a7db66
@facebook-github-bot
Copy link
Contributor

This pull request has been merged in 5b7a68d.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
CLA Signed Do not delete this pull request or issue due to inactivity. Merged
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants