Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add wmt22 recipes with TowerInstruct and Llama3.1 LLMs #103

Merged
merged 5 commits into from
Sep 12, 2024
Merged

add wmt22 recipes with TowerInstruct and Llama3.1 LLMs #103

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
6f454da
add wmt22 recipes with TowerInstruct and Llama3.1 LLMs
vince62s Sep 12, 2024
bd26562
black
vince62s Sep 12, 2024
b7185d6
flake
vince62s Sep 12, 2024
a5c6edd
black
vince62s Sep 12, 2024
7b25f8c
black
vince62s Sep 12, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
black
  • Loading branch information
@vince62s
vince62s committed Sep 12, 2024
commit bd26562a030816744b31580398aa9c1a4df06e8b
5 changes: 3 additions & 2 deletions recipes/wmt22_with_TowerInstruct-Mistral/promptize_mistral.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,10 +1,11 @@

# Input and output file paths
input_file_path = "newstest2022-src.en"
output_file_path = "newstest2022-src-prompt.en"

# Open the input file for reading and the output file for writing
with open(input_file_path, "r") as input_file, open(output_file_path, "w") as output_file:
with open(input_file_path, "r") as input_file, open(
output_file_path, "w"
) as output_file:
# Loop through each line in the input file
for line in input_file:
# Set up the prompt provided by Tower-instruct with the current line's content
Expand Down
5 changes: 3 additions & 2 deletions recipes/wmt22_with_TowerInstruct-llama2/promptize_llama2.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,10 +1,11 @@

# Input and output file paths
input_file_path = "newstest2022-src.en"
output_file_path = "newstest2022-src-prompt.en"

# Open the input file for reading and the output file for writing
with open(input_file_path, "r") as input_file, open(output_file_path, "w") as output_file:
with open(input_file_path, "r") as input_file, open(
output_file_path, "w"
) as output_file:
# Loop through each line in the input file
for line in input_file:
# Set up the prompt provided by Tower-instruct with the current line's content
Expand Down
5 changes: 3 additions & 2 deletions recipes/wmt22_with_llama3.1/promptize_llama3.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,10 +1,11 @@

# Input and output file paths
input_file_path = "newstest2022-src.en"
output_file_path = "newstest2022-src-prompt.en"

# Open the input file for reading and the output file for writing
with open(input_file_path, "r") as input_file, open(output_file_path, "w") as output_file:
with open(input_file_path, "r") as input_file, open(
output_file_path, "w"
) as output_file:
# Loop through each line in the input file
for line in input_file:
# Set up the prompt provided by Lama3 with the current line's content
Expand Down
Loading