Skip to content

Commit

Permalink
Update src/lighteval/models/nanotron_model.py
Browse files Browse the repository at this point in the history
Co-authored-by: Thomas Wolf <thomwolf@users.noreply.github.com>
  • Loading branch information
NathanHB and thomwolf authored Feb 7, 2024
1 parent de4dd7e commit 98f767f
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/lighteval/models/nanotron_model.py
Original file line number Diff line number Diff line change
Expand Up @@ -1116,7 +1116,7 @@ def greedy_until(
# automatic (variable) batch size detection for vectorization
# pull longest context sample from request
for request in requests:
request.stop_sequence = request.stop_sequence + [self.tokenizer.eos_token]
request.stop_sequence = list(request.stop_sequence) + [self.tokenizer.eos_token]
request.tokenized_context = self.tok_encode(request.context)

dataset = GenerativeTaskDatasetNanotron(requests=requests, dataset_splits=dataset_splits)
Expand Down

0 comments on commit 98f767f

Please sign in to comment.