EnglishRoberta is not thread-safe #7005

Closed

Closed

EnglishRoberta is not thread-safe#7005

stephentoub
openedon Feb 16, 2024

_mergeRanks is mutated as part of encoding:

machinelearning/src/Microsoft.ML.Tokenizers/Model/EnglishRoberta.cs

Line 591 in 4635a86

    
           var (first, second) = pairs.ArgMin(pair => _mergeRanks.GetOrAdd(pair, int.MaxValue));

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Assignees

tarekgh

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests