Please provide examples of the vocab and merge file formats


Please provide examples of the vocab and merge file formats. Better yet, provide links to downloadable pre-created files for common purposes GPT3 etc. 


---
#### Document Details

⚠ *Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.*

* ID: 909b9e8c-f08c-ba0a-6c31-7dd151699999
* Version Independent ID: 909b9e8c-f08c-ba0a-6c31-7dd151699999
* Content: [Bpe Constructor (Microsoft.ML.Tokenizers)](https://learn.microsoft.com/en-us/dotnet/api/microsoft.ml.tokenizers.bpe.-ctor?view=ml-dotnet-preview#microsoft-ml-tokenizers-bpe-ctor(system-string-system-string-system-string-system-string-system-string))
* Content Source: [dotnet/xml/Microsoft.ML.Tokenizers/Bpe.xml](https://github.com/dotnet/ml-api-docs/blob/live/dotnet/xml/Microsoft.ML.Tokenizers/Bpe.xml)
* Product: **dotnet-ml-api**
* GitHub Login: @natke
* Microsoft Alias: **nakersha**

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Please provide examples of the vocab and merge file formats #6583

Ben-Pattinson
openedon Mar 1, 2023

Document Details

Assignees

Labels

Type

Projects

Milestone

Relationships

Development