Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Scrubber sample code now handles tokens correctly that also appear by…
… their own. When adding a token to the scrubber list like "two" that also exists as an individual term not just together with other tokens like "two sentences" the original code failed because the while loop consumed the whole span consisting of just one token. Fixed.
- Loading branch information