Skip to content

Merge main into staging #648

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Feb 5, 2025
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 3 additions & 1 deletion site/developer/model-testing/testing-overview.qmd
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,7 @@ aliases:
listing:
- id: tests-beginner
type: grid
grid-columns: 2
max-description-length: 250
sort: false
fields: [title, description]
Expand All @@ -28,7 +29,7 @@ listing:
max-description-length: 250
sort: false
fields: [title, description]
contents:
contents:
- ../../notebooks/code_samples/custom_tests/integrate_external_test_providers.ipynb
- ../../notebooks/how_to/configure_dataset_features.ipynb
- ../../notebooks/how_to/run_documentation_sections.ipynb
Expand All @@ -43,6 +44,7 @@ listing:
contents:
- ../../notebooks/how_to/document_multiple_results_for_the_same_test.ipynb
- ../../notebooks/how_to/load_datasets_predictions.ipynb
- ../../notebooks/how_to/understand_utilize_rawdata.ipynb
- id: tests-custom
type: grid
max-description-length: 250
Expand Down
8 changes: 5 additions & 3 deletions site/faq/faq-testing.qmd
Original file line number Diff line number Diff line change
Expand Up @@ -37,10 +37,10 @@ Yes, {{< var vm.product >}} allows tests to be manipulated at several levels:
- You can configure which tests are required to run programmatically depending on the model use case.[^4]
- You can change the thresholds and parameters for default tests already available in the {{< var vm.developer >}} — for instance, changing the threshold parameter for the class imbalance flag.[^5]
- You can also connect your own custom tests with the {{< var validmind.developer >}}. These custom tests are configurable and are able to run programmatically, just like the rest of the {{< var vm.developer >}}.[^6]
- Personalize tests further for your use case by using {{< var vm.product >}}'s `RawData` feature[^7] to customize the output of tests.

::: {.callout}
In addition to custom tests, you can also add use case and test-specific context for any test to enhance the LLM-generated test descriptions using the {{< var validmind.developer >}}.[^7]

In addition to custom tests, you can also add use case and test-specific context for any test to enhance the LLM-generated test descriptions using the {{< var validmind.developer >}}.[^8]
:::

{{< include _faq-explainability.qmd >}}
Expand Down Expand Up @@ -69,4 +69,6 @@ In addition to custom tests, you can also add use case and test-specific context

[^6]: [Can I use my own tests?](/developer/model-testing/testing-overview.qmd#can-i-use-my-own-tests)

[^7]: [Add context to LLM-generated test descriptions](/notebooks/how_to/add_context_to_llm_descriptions.ipynb)
[^7]: [Understand and utilize `RawData` in {{< var vm.product >}} tests](/notebooks/how_to/understand_utilize_rawdata.ipynb)

[^8]: [Add context to LLM-generated test descriptions](/notebooks/how_to/add_context_to_llm_descriptions.ipynb)
Binary file modified site/notebooks.zip
Binary file not shown.
Loading