Skip to content

Commit

Permalink
Fix Documentation Overflow Issues for Long URLs in SFTConfig (hugging…
Browse files Browse the repository at this point in the history
…face#1774)

* Update sft_config.py

* Update sft_config.py
  • Loading branch information
Mubin17 authored Jun 26, 2024
1 parent 3479606 commit c8c01cc
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion trl/trainer/sft_config.py
Original file line number Diff line number Diff line change
Expand Up @@ -49,7 +49,8 @@ class SFTConfig(TrainingArguments):
The number of sequences to use for the `ConstantLengthDataset`. Defaults to `1024`.
chars_per_token (`Optional[float]`):
The number of characters per token to use for the `ConstantLengthDataset`. Defaults to `3.6`. You can check how this is computed in the
stack-llama example: https://github.com/huggingface/trl/blob/08f550674c553c36c51d1027613c29f14f3676a5/examples/stack_llama/scripts/supervised_finetuning.py#L53.
stack-llama example:
[chars_token_ratio](https://github.com/huggingface/trl/blob/08f550674c553c36c51d1027613c29f14f3676a5/examples/stack_llama/scripts/supervised_finetuning.py#L53).
"""

dataset_text_field: Optional[str] = None
Expand Down

0 comments on commit c8c01cc

Please sign in to comment.