Skip to content

Commit 7842d2d

Browse files
committed
core(data generation): corner case in string
1 parent 96a29d2 commit 7842d2d

File tree

1 file changed

+3
-3
lines changed

1 file changed

+3
-3
lines changed

code_bert/cli/generate_train_script.py

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -41,10 +41,10 @@ def _create_train_files_and_regenerate_vocab():
4141
"</s>",
4242
"<unk>",
4343
"<mask>",
44-
"<indent>",
45-
"<dedent>",
44+
"indent",
45+
"dedent",
4646
"<newline>",
47-
"<foreignchars>"
47+
"foreignchars"
4848
])
4949
try:
5050
shutil.rmtree("codeBERT")

0 commit comments

Comments
 (0)