Skip to content

Commit a19e5f6

Browse files
User journey improvements (#128)
* Update glossary * Getting started section edits * Restructure developer framework section * WIP content work & Makefile tweak * Re-add glossary * Temporarily fix glossary embed * WIP glossary work * WIP glossary work * WIP glossary, fix broken links * Complete first glossary draft * WIP dev framework intro rework * WIP developer framework section rework * WIP Developer Framework rework, single source concepts, edits * Update supported model definition * Edits * Update landing page links and terminology * Update illustrations * Reduce whitespace in sidebar * WIP Get started rework * WIP Get started rework * WIP Get started rework * Edits * WIP More dev framework content * Move some content to site-unused * WIP edits * Edits * WIP edits * Edit get started * Dev framework edits, other edits * Update rendered site * Simplify docs-demo deploy * Update site/guide/glossary.qmd Co-authored-by: Sydney Sugar <134960633+sydneysugar@users.noreply.github.com> * Address review comments from Andres * Address review comments from Sydney and Andres --------- Co-authored-by: Sydney Sugar <134960633+sydneysugar@users.noreply.github.com>
1 parent 59505e4 commit a19e5f6

File tree

186 files changed

+3699
-1854
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

186 files changed

+3699
-1854
lines changed

site-unused/architecture.qmd

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
---
22
title: "Architecture"
3-
keywords: "architecture, model risk management, ValidMind"
3+
keywords: "architecture, ai risk, model risk management, ValidMind"
44
---
55

66
## Brief Introduction

site-unused/assign-model-validators.qmd

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
---
22
title: "Assign model validators"
3-
keywords: "assign model validators, model risk management, ValidMind"
3+
keywords: "assign model validators, ai risk, model risk management, ValidMind"
44
---
55

66
[Include a brief description of what this task is about, why it's important, and who it's intended for.]
@@ -25,7 +25,7 @@ keywords: "assign model validators, model risk management, ValidMind"
2525

2626
[Include any common issues or errors that may arise during the task and how to resolve them.]
2727

28-
## What's Next
28+
## What's next
2929

3030
[Summarize the task and provide any next steps or resources for the user to continue their learning or work.]
3131

site-unused/cloud-platforms.qmd

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
---
22
title: "Cloud platforms"
3-
keywords: "cloud platforms, model risk management, ValidMind"
3+
keywords: "cloud platforms, ai risk, model risk management, ValidMind"
44
---
55

66
## Brief Introduction

site-unused/configure-sso.qmd

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
---
22
title: "Configure Single Sign-On (SSO)"
3-
keywords: "configure single sign-on (SSO), model risk management, ValidMind"
3+
keywords: "configure single sign-on (SSO), ai risk, model risk management, ValidMind"
44
---
55

66
[Include a brief description of what this task is about, why it's important, and who it's intended for.]
@@ -25,7 +25,7 @@ keywords: "configure single sign-on (SSO), model risk management, ValidMind"
2525

2626
[Include any common issues or errors that may arise during the task and how to resolve them.]
2727

28-
## What's Next
28+
## What's next
2929

3030
[Summarize the task and provide any next steps or resources for the user to continue their learning or work.]
3131

site-unused/configure-test-plans.qmd

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
---
22
title: "Configure test plans"
3-
keywords: "configure test plans, model risk management, ValidMind"
3+
keywords: "configure test plans, ai risk, model risk management, ValidMind"
44
---
55

66
[Include a brief description of what this task is about, why it's important, and who it's intended for.]
@@ -25,7 +25,7 @@ keywords: "configure test plans, model risk management, ValidMind"
2525

2626
[Include any common issues or errors that may arise during the task and how to resolve them.]
2727

28-
## What's Next
28+
## What's next
2929

3030
[Summarize the task and provide any next steps or resources for the user to continue their learning or work.]
3131

site-unused/configure-workflows.qmd

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
---
22
title: "Configure workflows"
3-
keywords: "configure workflows, administrator, model risk management, ValidMind"
3+
keywords: "configure workflows, administrator, ai risk, model risk management, ValidMind"
44
---
55

66
As part of the initial setup of the ValidMind solution for your company or organization, you need to configure the validation workflows that users such as model developers and model validators will follow.
@@ -25,7 +25,7 @@ As part of the initial setup of the ValidMind solution for your company or organ
2525

2626
[Include any common issues or errors that may arise during the task and how to resolve them.]
2727

28-
## What's Next
28+
## What's next
2929

3030
[Summarize the task and provide any next steps or resources for the user to continue their learning or work.]
3131

site-unused/create-project-findings.qmd

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
---
22
title: "Create project findings"
3-
keywords: "create project findings, model risk management, ValidMind"
3+
keywords: "create project findings, ai risk, model risk management, ValidMind"
44
---
55

66
[Include a brief description of what this task is about, why it's important, and who it's intended for.]
@@ -25,7 +25,7 @@ keywords: "create project findings, model risk management, ValidMind"
2525

2626
[Include any common issues or errors that may arise during the task and how to resolve them.]
2727

28-
## What's Next
28+
## What's next
2929

3030
[Summarize the task and provide any next steps or resources for the user to continue their learning or work.]
3131

site-unused/dataset-object.qmd

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
---
22
title: "The dataset object"
3-
keywords: "dataset object, model risk management, ValidMind"
3+
keywords: "dataset object, ai risk, model risk management, ValidMind"
44
---
55

66
## Brief Introduction

site-unused/edit-templates.qmd

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
---
22
title: "Configure templates"
3-
keywords: "configure templates, administrator, model risk management, ValidMind"
3+
keywords: "configure templates, administrator, ai risk, model risk management, ValidMind"
44
---
55

66
As part of the initial setup of the ValidMind solution for your company or organization, you need to configure what templates are available to your users. Templates are a way to configure required validation tests and standardize the documentation table of contents for specific model use cases.
@@ -25,7 +25,7 @@ As part of the initial setup of the ValidMind solution for your company or organ
2525

2626
[Include any common issues or errors that may arise during the task and how to resolve them.]
2727

28-
## What's Next
28+
## What's next
2929

3030
[Summarize the task and provide any next steps or resources for the user to continue their learning or work.]
3131

site-unused/explore-validmind.qmd

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
---
22
title: "Explore ValidMind"
3-
keywords: "explore, model risk management, ValidMind"
3+
keywords: "explore, ai risk, model risk management, ValidMind"
44
---
55

66
## Access the sample Jupyter notebook

site-unused/glossary.qmd

Lines changed: 0 additions & 37 deletions
This file was deleted.

site-unused/manage-project-findings.qmd

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
---
22
title: "Manage project findings"
3-
keywords: "manage project findings, model risk management, ValidMind"
3+
keywords: "manage project findings, ai risk, model risk management, ValidMind"
44
---
55

66
[Include a brief description of what this task is about, why it's important, and who it's intended for.]
@@ -25,7 +25,7 @@ keywords: "manage project findings, model risk management, ValidMind"
2525

2626
[Include any common issues or errors that may arise during the task and how to resolve them.]
2727

28-
## What's Next
28+
## What's next
2929

3030
[Summarize the task and provide any next steps or resources for the user to continue their learning or work.]
3131

site-unused/manage-users-and-roles.qmd

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
---
22
title: "Manage users and roles"
3-
keywords: "manage users, manage roles, model risk management, ValidMind"
3+
keywords: "manage users, manage roles, ai risk, model risk management, ValidMind"
44
---
55

66
[Include a brief description of what this task is about, why it's important, and who it's intended for.]
@@ -27,7 +27,7 @@ keywords: "manage users, manage roles, model risk management, ValidMind"
2727

2828
[Include any common issues or errors that may arise during the task and how to resolve them.]
2929

30-
### What's Next
30+
### What's next
3131

3232
[Summarize the task and provide any next steps or resources for the user to continue their learning or work.]
3333

@@ -49,7 +49,7 @@ keywords: "manage users, manage roles, model risk management, ValidMind"
4949

5050
[Include any common issues or errors that may arise during the task and how to resolve them.]
5151

52-
### What's Next
52+
### What's next
5353

5454
[Summarize the task and provide any next steps or resources for the user to continue their learning or work.]
5555

@@ -71,7 +71,7 @@ keywords: "manage users, manage roles, model risk management, ValidMind"
7171

7272
[Include any common issues or errors that may arise during the task and how to resolve them.]
7373

74-
### What's Next
74+
### What's next
7575

7676
[Summarize the task and provide any next steps or resources for the user to continue their learning or work.]
7777

Lines changed: 43 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,43 @@
1+
### In your modeling environment
2+
3+
```{mermaid}
4+
graph TD
5+
A[Build the model] --> B[Export datasets and models]
6+
B --> C[In your documentation environment:<br>Load training datasets and models]
7+
```
8+
9+
### In your documentation environment
10+
11+
```{mermaid}
12+
graph TD
13+
A[Create notebook<br>to select and<br>build relevant tests] --> B[From your modeling<br>environment,<br>load trained datasets<br>and models.]
14+
B --> C[Initialize developer framework.]
15+
C --> D[Select relevant tests.]
16+
D --> E{Check if all<br>tests covered by<br>ValidMind or<br>custom test<br>provider?}
17+
E -- Yes --> F[Run selected tests]
18+
F --> G[Review test results]
19+
E -- No --> H[Create and register additional tests]
20+
G --> I[ValidMind Platform UI:<br>Add content blocks to model documentation]
21+
H --> E
22+
```
23+
24+
### In ValidMind Platform UI
25+
26+
```{mermaid}
27+
graph TB
28+
A[Register new model] --> B[Select documentation template]
29+
B --> C[Review template structure]
30+
C --> D[View framework integration instructions]
31+
D --> E[Add content blocks to model documentation:]
32+
E --> F[Select the block type:]
33+
F --> G[Test-driven block: Select from available test provider results]
34+
F --> H[Text block:]
35+
H --> I{New or existing block?:}
36+
I --> J[New]
37+
J --> K[Add new editable text content block]
38+
K --> L[Review and collaborate]
39+
I --> M[Existing: Select from available texts from content provider]
40+
L --> N[Submit for review]
41+
M --> N
42+
G --> N
43+
```

site-unused/model-evaluation-tests.qmd

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
---
22
title: "Model evaluation tests"
3-
keywords: "model evaluation tests, model risk management, ValidMind"
3+
keywords: "model evaluation tests, ai risk, model risk management, ValidMind"
44
---
55

66
This article provides an examples of how to run model evaluation test plans, and provides a reference to other model evaluation tests and test plans available in the Developer Framework.

site-unused/model-object.qmd

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
---
22
title: "The model object"
3-
keywords: "model object, model risk management, ValidMind"
3+
keywords: "model object, ai risk, model risk management, ValidMind"
44
---
55

66
## Brief Introduction

site-unused/mrm-lifecyle.qmd

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
---
22
title: "Model lifecycle and workflow "
3-
keywords: "model lifecycle, workflow, model risk management, ValidMind"
3+
keywords: "model lifecycle, workflow, ai risk, model risk management, ValidMind"
44
---
55

66
Model Risk Management (MRM) plays an important role in ensuring the accuracy, reliability, and effectiveness of models used in decision-making processes. This article focuses on the model lifecycle and process workflow, outlining the key stages and activities that constitute a robust MRM framework.

site-unused/mrm-three-lines-of-defense.qmd

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
---
22
title: "The three line of defense"
3-
keywords: "three lines of defense, model risk management, ValidMind"
3+
keywords: "three lines of defense, ai risk, model risk management, ValidMind"
44
---
55

66
Model Risk Management (MRM) is a crucial process for organizations using mathematical and statistical models to inform decision-making. MRM aims to identify, assess, and mitigate risks arising from model usage, ensuring the accuracy and reliability of model outputs. A key aspect of MRM is its three lines of defense, which provide a structured approach to managing model risk across various functions and roles.

site-unused/mrm.qmd

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
---
22
title: "Model risk management"
3-
keywords: "MRM, model risk management, ValidMind"
3+
keywords: "MRM, ai risk, model risk management, ValidMind"
44
---
55

66
Model risk management (MRM) is a process for organizations using mathematical and statistical models to inform decision-making. MRM aims to identify, assess, and mitigate risks arising from model usage, ensuring the accuracy and reliability of model outputs.

site-unused/release-access.qmd

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
---
22
title: "Release access"
3-
keywords: "release access, model risk management, ValidMind"
3+
keywords: "release access, ai risk, model risk management, ValidMind"
44
---
55

66
Welcome to the {{< var version >}} for ValidMind. On this page you will find important information to help you get access.

site-unused/release-notes.qmd

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
---
22
title: "Release notes"
3-
keywords: "release notes, model risk management, ValidMind"
3+
keywords: "release notes, ai risk, model risk management, ValidMind"
44
---
55

66
## Release highlights

site-unused/run-tests-test-plans-test-suites.qmd

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
---
22
title: "Run test plans"
3-
keywords: "run test plans, model risk management, ValidMind"
3+
keywords: "run test plans, ai risk, model risk management, ValidMind"
44
---
55

66
Learn how you use ValidMind to run tests, test plans, and test suites. This topic is relevant for model developers who want to adopt the testing functionality that is available in the ValidMind Developer Framework.
@@ -10,7 +10,7 @@ Learn how you use ValidMind to run tests, test plans, and test suites. This topi
1010
1111
[Include any common issues or errors that may arise during the task and how to resolve them.]
1212
13-
## What's Next
13+
## What's next
1414
1515
[Summarize the task and provide any next steps or resources for the user to continue their learning or work.]
1616
--->

site-unused/tabular-data-tests.qmd

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
---
22
title: "Tabular data tests"
3-
keywords: "tabular data tests, model risk management, ValidMind"
3+
keywords: "tabular data tests, ai risk, model risk management, ValidMind"
44
---
55

66
This article provides an example of how to run a Test Plan to validate a tabular dataset, and provides a reference to other dataset tests and test plans available in the Developer Framework.

site-unused/track-model-lifecycle.qmd

Lines changed: 33 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,33 @@
1+
---
2+
title: "Tracking the model lifecycle"
3+
keywords: "track model lifecycle, ai risk, model risk management, ValidMind"
4+
---
5+
6+
A typical high-level model lifecycle workflow looks like this:
7+
8+
```{mermaid}
9+
graph LR
10+
A[New model<br>registration] --> B[Initial<br>validation]
11+
B --> C[Validation<br>approval]
12+
C --> D[In production]
13+
D --> E[Periodic review<br>and revalidation]
14+
E --> B
15+
```
16+
<br>
17+
18+
New model registration
19+
: Model owners and validators use the model inventory to manage all metadata associated with a model, including compliance and regulatory attributes. Users select a documentation template when registering a new inventory model.
20+
21+
**Initial validation**
22+
: Triggers a new documentation workflow, resulting in a model that is ready for production deployment after its documentation and validation reports are approved.
23+
24+
See [Track the documentation workflow](#tracking-the-documentation-workflow) for more details.
25+
26+
**Validation approval**
27+
: Perform validation of the model to ascertain that it meets the needs for which it was designed. ValidMind can connect to third-party systems to send events when a model has been approved for production.
28+
29+
**In production**
30+
: Use the model in production while ensuring its ongoing reliability, accuracy, and compliance with regulations by monitoring the model's performance.
31+
32+
**Periodic review and revalidation**
33+
: As part of regular performance monitoring or change management, developers and validators follow a process similar to that seen in the **Initial validation** step.

site/Makefile

Lines changed: 1 addition & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -75,12 +75,7 @@ docs-site: clean clone notebooks python-docs
7575

7676
# Deployment to https://docs-demo.vm.validmind.ai/
7777
deploy-demo:
78-
@if [ "`git rev-parse --abbrev-ref HEAD`" != "docs-demo" ]; then \
79-
echo "You're not on the docs-demo branch, no action taken."; \
80-
else \
81-
echo "\nDeploying docs-demo site ..."; \
82-
quarto render && aws s3 sync ./_site s3://docs-ci-cd-demo/site/ --delete && aws cloudfront create-invalidation --distribution-id E38AINJY5CYN6P --paths "/*" --no-cli-pager > /dev/null; \
83-
fi
78+
quarto render && aws s3 sync ./_site s3://docs-ci-cd-demo/site/ --delete && aws cloudfront create-invalidation --distribution-id E38AINJY5CYN6P --paths "/*" --no-cli-pager > /dev/null; \
8479

8580
# Deployment to https://docs.validmind.ai/
8681
deploy-prod:

0 commit comments

Comments
 (0)