@@ -81,20 +81,20 @@ def create(
8181 ) -> CreateDatasetResponse :
8282 """
8383 Create a new evaluation `Dataset` for the specified `Agent` using the provided
84- JSONL file. A `Dataset` is a versioned collection of samples conforming to a
85- particular schema, and can be used to store `Evaluation` test-sets and retrieve
86- `Evaluation` results.
84+ JSONL or CSV file. A `Dataset` is a versioned collection of samples conforming
85+ to a particular schema, and can be used to store `Evaluation` test-sets and
86+ retrieve `Evaluation` results.
8787
8888 Each `Dataset` is versioned and validated against its schema during creation and
8989 subsequent updates. The provided `Dataset` file must conform to the schema
9090 defined for the `dataset_type`.
9191
92- File schema for `dataset_type` `evaluation_set` is a JSONL or CSV file where
93- each line is one JSON object with the following required keys:
92+ File schema for `dataset_type` `evaluation_set` is a CSV file or a JSONL file
93+ where each line is one JSON object. The following keys are required :
9494
95- - `prompt` (required, `string`): Prompt or question
95+ - `prompt` (`string`): Prompt or question
9696
97- - `reference` (required, `string`): Required reference or ground truth response
97+ - `reference` (`string`): Reference or ground truth response
9898
9999 Args:
100100 agent_id: Agent ID to associate with the evaluation dataset
@@ -103,7 +103,7 @@ def create(
103103
104104 dataset_type: Type of evaluation dataset which determines its schema and validation rules.
105105
106- file: JSONL file containing the evaluation dataset
106+ file: JSONL or CSV file containing the evaluation dataset
107107
108108 extra_headers: Send extra headers
109109
@@ -228,12 +228,12 @@ def update(
228228 Create a new version of the dataset by appending content to the `Dataset` and
229229 validating against its schema.
230230
231- File schema for `dataset_type` `evaluation_set` is a JSONL file where each line
232- is one JSON object with the following required keys:
231+ File schema for `dataset_type` `evaluation_set` is a CSV file or a JSONL file
232+ where each line is one JSON object. The following keys are required :
233233
234234 - `prompt` (`string`): Prompt or question
235235
236- - `reference` (`string`): Required reference or ground truth response
236+ - `reference` (`string`): Reference or ground truth response
237237
238238 Args:
239239 agent_id: Agent ID associated with the evaluation dataset
@@ -243,7 +243,7 @@ def update(
243243 dataset_type: Type of evaluation dataset which determines its schema and validation rules.
244244 Must match the `dataset_type` used at dataset creation time.
245245
246- file: JSONL file containing the entries to append to the evaluation dataset
246+ file: JSONL or CSV file containing the entries to append to the evaluation dataset
247247
248248 extra_headers: Send extra headers
249249
@@ -459,20 +459,20 @@ async def create(
459459 ) -> CreateDatasetResponse :
460460 """
461461 Create a new evaluation `Dataset` for the specified `Agent` using the provided
462- JSONL file. A `Dataset` is a versioned collection of samples conforming to a
463- particular schema, and can be used to store `Evaluation` test-sets and retrieve
464- `Evaluation` results.
462+ JSONL or CSV file. A `Dataset` is a versioned collection of samples conforming
463+ to a particular schema, and can be used to store `Evaluation` test-sets and
464+ retrieve `Evaluation` results.
465465
466466 Each `Dataset` is versioned and validated against its schema during creation and
467467 subsequent updates. The provided `Dataset` file must conform to the schema
468468 defined for the `dataset_type`.
469469
470- File schema for `dataset_type` `evaluation_set` is a JSONL or CSV file where
471- each line is one JSON object with the following required keys:
470+ File schema for `dataset_type` `evaluation_set` is a CSV file or a JSONL file
471+ where each line is one JSON object. The following keys are required :
472472
473- - `prompt` (required, `string`): Prompt or question
473+ - `prompt` (`string`): Prompt or question
474474
475- - `reference` (required, `string`): Required reference or ground truth response
475+ - `reference` (`string`): Reference or ground truth response
476476
477477 Args:
478478 agent_id: Agent ID to associate with the evaluation dataset
@@ -481,7 +481,7 @@ async def create(
481481
482482 dataset_type: Type of evaluation dataset which determines its schema and validation rules.
483483
484- file: JSONL file containing the evaluation dataset
484+ file: JSONL or CSV file containing the evaluation dataset
485485
486486 extra_headers: Send extra headers
487487
@@ -606,12 +606,12 @@ async def update(
606606 Create a new version of the dataset by appending content to the `Dataset` and
607607 validating against its schema.
608608
609- File schema for `dataset_type` `evaluation_set` is a JSONL file where each line
610- is one JSON object with the following required keys:
609+ File schema for `dataset_type` `evaluation_set` is a CSV file or a JSONL file
610+ where each line is one JSON object. The following keys are required :
611611
612612 - `prompt` (`string`): Prompt or question
613613
614- - `reference` (`string`): Required reference or ground truth response
614+ - `reference` (`string`): Reference or ground truth response
615615
616616 Args:
617617 agent_id: Agent ID associated with the evaluation dataset
@@ -621,7 +621,7 @@ async def update(
621621 dataset_type: Type of evaluation dataset which determines its schema and validation rules.
622622 Must match the `dataset_type` used at dataset creation time.
623623
624- file: JSONL file containing the entries to append to the evaluation dataset
624+ file: JSONL or CSV file containing the entries to append to the evaluation dataset
625625
626626 extra_headers: Send extra headers
627627
0 commit comments