Skip to content

Commit 096d9c5

Browse files
new: Add test data for tokens to tsv
1 parent 568a74c commit 096d9c5

File tree

5 files changed

+7
-1780
lines changed

5 files changed

+7
-1780
lines changed

tests/prodigy/common.py

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -10,5 +10,7 @@ def get_path(p):
1010
p
1111
)
1212

13-
TEST_TOKENS = get_path('test_data/test_reference_to_tsv_tokens.jsonl')
14-
TEST_SPANS = get_path('test_data/test_reference_to_tsv_spans.jsonl')
13+
TEST_TOKENS = get_path('test_data/test_tokens_to_tsv_tokens.jsonl')
14+
TEST_SPANS = get_path('test_data/test_tokens_to_tsv_spans.jsonl')
15+
TEST_REF_TOKENS = get_path('test_data/test_reference_to_tsv_tokens.jsonl')
16+
TEST_REF_SPANS = get_path('test_data/test_reference_to_tsv_spans.jsonl')

0 commit comments

Comments
 (0)