Skip to content
#

torchdata

Star

Here are 8 public repositories matching this topic...

Language: All
Filter by language
All 8 Python 5 Jupyter Notebook 3
smashed

allenai / smashed

Star 31

SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batching, and more. Supports datasets from Huggingface, torchdata iterables, or simple lists of dictionaries.

nlp natural-language-processing pipeline text transformers pytorch dataset transformer dict prefix datasets preprocessing mappers huggingface in-context-learning torchdata prompting prefix-tuning
  • Updated May 24, 2024
  • Python

Improve this page

Add a description, image, and links to the torchdata topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the torchdata topic, visit your repo's landing page and select "manage topics."

Learn more