Skip to content

User journey improvements #128

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 40 commits into from
Aug 19, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
40 commits
Select commit Hold shift + click to select a range
a6c202d
Update glossary
nrichers Jul 20, 2023
49fae23
Getting started section edits
nrichers Jul 20, 2023
f84e155
Fix merge conflicts
nrichers Jul 26, 2023
a02468f
Restructure developer framework section
nrichers Jul 26, 2023
a08e53b
WIP content work & Makefile tweak
nrichers Jul 26, 2023
284a379
Fix merge conflicts
nrichers Jul 28, 2023
4aaba43
Re-add glossary
nrichers Jul 29, 2023
409c763
Merge branch 'main' of github.com:validmind/documentation into user-j…
nrichers Jul 31, 2023
bc51336
Temporarily fix glossary embed
nrichers Jul 31, 2023
df537b5
WIP glossary work
nrichers Jul 31, 2023
aca03ab
WIP glossary work
nrichers Aug 1, 2023
e224558
WIP glossary, fix broken links
nrichers Aug 2, 2023
f62ce7a
Complete first glossary draft
nrichers Aug 2, 2023
a1f76f4
WIP dev framework intro rework
nrichers Aug 2, 2023
4815f86
WIP developer framework section rework
nrichers Aug 2, 2023
c7e9dfd
WIP Developer Framework rework, single source concepts, edits
nrichers Aug 3, 2023
c7b0d68
Update supported model definition
nrichers Aug 3, 2023
2f1b903
Edits
nrichers Aug 4, 2023
8e91982
Fix merge conflicts
nrichers Aug 9, 2023
ed70a96
Update landing page links and terminology
nrichers Aug 9, 2023
56739a4
Update illustrations
nrichers Aug 10, 2023
ec8d28f
Reduce whitespace in sidebar
nrichers Aug 10, 2023
79db3ee
WIP Get started rework
nrichers Aug 10, 2023
07acb67
WIP Get started rework
nrichers Aug 10, 2023
c2040f0
WIP Get started rework
nrichers Aug 10, 2023
5786fae
Edits
nrichers Aug 10, 2023
37582b9
WIP More dev framework content
nrichers Aug 10, 2023
b0f2c96
Move some content to site-unused
nrichers Aug 11, 2023
ee60fe5
WIP edits
nrichers Aug 11, 2023
22f634a
Edits
nrichers Aug 11, 2023
8b09719
WIP edits
nrichers Aug 15, 2023
5188852
Fix merge conflicts
nrichers Aug 16, 2023
75803a5
Edit get started
nrichers Aug 16, 2023
a02fb5e
Dev framework edits, other edits
nrichers Aug 16, 2023
49b9e97
Update rendered site
nrichers Aug 16, 2023
eb30d90
Simplify docs-demo deploy
nrichers Aug 18, 2023
cd1bad0
Update site/guide/glossary.qmd
nrichers Aug 18, 2023
8f20df8
Address review comments from Andres
nrichers Aug 19, 2023
621880f
Merge branch 'user-journey-improvements' of github.com:validmind/docu…
nrichers Aug 19, 2023
d53f630
Address review comments from Sydney and Andres
nrichers Aug 19, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion site-unused/architecture.qmd
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
title: "Architecture"
keywords: "architecture, model risk management, ValidMind"
keywords: "architecture, ai risk, model risk management, ValidMind"
---

## Brief Introduction
Expand Down
4 changes: 2 additions & 2 deletions site-unused/assign-model-validators.qmd
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
title: "Assign model validators"
keywords: "assign model validators, model risk management, ValidMind"
keywords: "assign model validators, ai risk, model risk management, ValidMind"
---

[Include a brief description of what this task is about, why it's important, and who it's intended for.]
Expand All @@ -25,7 +25,7 @@ keywords: "assign model validators, model risk management, ValidMind"

[Include any common issues or errors that may arise during the task and how to resolve them.]

## What's Next
## What's next

[Summarize the task and provide any next steps or resources for the user to continue their learning or work.]

2 changes: 1 addition & 1 deletion site-unused/cloud-platforms.qmd
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
title: "Cloud platforms"
keywords: "cloud platforms, model risk management, ValidMind"
keywords: "cloud platforms, ai risk, model risk management, ValidMind"
---

## Brief Introduction
Expand Down
4 changes: 2 additions & 2 deletions site-unused/configure-sso.qmd
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
title: "Configure Single Sign-On (SSO)"
keywords: "configure single sign-on (SSO), model risk management, ValidMind"
keywords: "configure single sign-on (SSO), ai risk, model risk management, ValidMind"
---

[Include a brief description of what this task is about, why it's important, and who it's intended for.]
Expand All @@ -25,7 +25,7 @@ keywords: "configure single sign-on (SSO), model risk management, ValidMind"

[Include any common issues or errors that may arise during the task and how to resolve them.]

## What's Next
## What's next

[Summarize the task and provide any next steps or resources for the user to continue their learning or work.]

4 changes: 2 additions & 2 deletions site-unused/configure-test-plans.qmd
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
title: "Configure test plans"
keywords: "configure test plans, model risk management, ValidMind"
keywords: "configure test plans, ai risk, model risk management, ValidMind"
---

[Include a brief description of what this task is about, why it's important, and who it's intended for.]
Expand All @@ -25,7 +25,7 @@ keywords: "configure test plans, model risk management, ValidMind"

[Include any common issues or errors that may arise during the task and how to resolve them.]

## What's Next
## What's next

[Summarize the task and provide any next steps or resources for the user to continue their learning or work.]

4 changes: 2 additions & 2 deletions site-unused/configure-workflows.qmd
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
title: "Configure workflows"
keywords: "configure workflows, administrator, model risk management, ValidMind"
keywords: "configure workflows, administrator, ai risk, model risk management, ValidMind"
---

As part of the initial setup of the ValidMind solution for your company or organization, you need to configure the validation workflows that users such as model developers and model validators will follow.
Expand All @@ -25,7 +25,7 @@ As part of the initial setup of the ValidMind solution for your company or organ

[Include any common issues or errors that may arise during the task and how to resolve them.]

## What's Next
## What's next

[Summarize the task and provide any next steps or resources for the user to continue their learning or work.]

4 changes: 2 additions & 2 deletions site-unused/create-project-findings.qmd
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
title: "Create project findings"
keywords: "create project findings, model risk management, ValidMind"
keywords: "create project findings, ai risk, model risk management, ValidMind"
---

[Include a brief description of what this task is about, why it's important, and who it's intended for.]
Expand All @@ -25,7 +25,7 @@ keywords: "create project findings, model risk management, ValidMind"

[Include any common issues or errors that may arise during the task and how to resolve them.]

## What's Next
## What's next

[Summarize the task and provide any next steps or resources for the user to continue their learning or work.]

2 changes: 1 addition & 1 deletion site-unused/dataset-object.qmd
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
title: "The dataset object"
keywords: "dataset object, model risk management, ValidMind"
keywords: "dataset object, ai risk, model risk management, ValidMind"
---

## Brief Introduction
Expand Down
4 changes: 2 additions & 2 deletions site-unused/edit-templates.qmd
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
title: "Configure templates"
keywords: "configure templates, administrator, model risk management, ValidMind"
keywords: "configure templates, administrator, ai risk, model risk management, ValidMind"
---

As part of the initial setup of the ValidMind solution for your company or organization, you need to configure what templates are available to your users. Templates are a way to configure required validation tests and standardize the documentation table of contents for specific model use cases.
Expand All @@ -25,7 +25,7 @@ As part of the initial setup of the ValidMind solution for your company or organ

[Include any common issues or errors that may arise during the task and how to resolve them.]

## What's Next
## What's next

[Summarize the task and provide any next steps or resources for the user to continue their learning or work.]

2 changes: 1 addition & 1 deletion site-unused/explore-validmind.qmd
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
title: "Explore ValidMind"
keywords: "explore, model risk management, ValidMind"
keywords: "explore, ai risk, model risk management, ValidMind"
---

## Access the sample Jupyter notebook
Expand Down
37 changes: 0 additions & 37 deletions site-unused/glossary.qmd

This file was deleted.

4 changes: 2 additions & 2 deletions site-unused/manage-project-findings.qmd
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
title: "Manage project findings"
keywords: "manage project findings, model risk management, ValidMind"
keywords: "manage project findings, ai risk, model risk management, ValidMind"
---

[Include a brief description of what this task is about, why it's important, and who it's intended for.]
Expand All @@ -25,7 +25,7 @@ keywords: "manage project findings, model risk management, ValidMind"

[Include any common issues or errors that may arise during the task and how to resolve them.]

## What's Next
## What's next

[Summarize the task and provide any next steps or resources for the user to continue their learning or work.]

8 changes: 4 additions & 4 deletions site-unused/manage-users-and-roles.qmd
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
title: "Manage users and roles"
keywords: "manage users, manage roles, model risk management, ValidMind"
keywords: "manage users, manage roles, ai risk, model risk management, ValidMind"
---

[Include a brief description of what this task is about, why it's important, and who it's intended for.]
Expand All @@ -27,7 +27,7 @@ keywords: "manage users, manage roles, model risk management, ValidMind"

[Include any common issues or errors that may arise during the task and how to resolve them.]

### What's Next
### What's next

[Summarize the task and provide any next steps or resources for the user to continue their learning or work.]

Expand All @@ -49,7 +49,7 @@ keywords: "manage users, manage roles, model risk management, ValidMind"

[Include any common issues or errors that may arise during the task and how to resolve them.]

### What's Next
### What's next

[Summarize the task and provide any next steps or resources for the user to continue their learning or work.]

Expand All @@ -71,7 +71,7 @@ keywords: "manage users, manage roles, model risk management, ValidMind"

[Include any common issues or errors that may arise during the task and how to resolve them.]

### What's Next
### What's next

[Summarize the task and provide any next steps or resources for the user to continue their learning or work.]

Expand Down
43 changes: 43 additions & 0 deletions site-unused/mermaid-diagrams-dev-framework.qmd
Original file line number Diff line number Diff line change
@@ -0,0 +1,43 @@
### In your modeling environment

```{mermaid}
graph TD
A[Build the model] --> B[Export datasets and models]
B --> C[In your documentation environment:<br>Load training datasets and models]
```

### In your documentation environment

```{mermaid}
graph TD
A[Create notebook<br>to select and<br>build relevant tests] --> B[From your modeling<br>environment,<br>load trained datasets<br>and models.]
B --> C[Initialize developer framework.]
C --> D[Select relevant tests.]
D --> E{Check if all<br>tests covered by<br>ValidMind or<br>custom test<br>provider?}
E -- Yes --> F[Run selected tests]
F --> G[Review test results]
E -- No --> H[Create and register additional tests]
G --> I[ValidMind Platform UI:<br>Add content blocks to model documentation]
H --> E
```

### In ValidMind Platform UI

```{mermaid}
graph TB
A[Register new model] --> B[Select documentation template]
B --> C[Review template structure]
C --> D[View framework integration instructions]
D --> E[Add content blocks to model documentation:]
E --> F[Select the block type:]
F --> G[Test-driven block: Select from available test provider results]
F --> H[Text block:]
H --> I{New or existing block?:}
I --> J[New]
J --> K[Add new editable text content block]
K --> L[Review and collaborate]
I --> M[Existing: Select from available texts from content provider]
L --> N[Submit for review]
M --> N
G --> N
```
2 changes: 1 addition & 1 deletion site-unused/model-evaluation-tests.qmd
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
title: "Model evaluation tests"
keywords: "model evaluation tests, model risk management, ValidMind"
keywords: "model evaluation tests, ai risk, model risk management, ValidMind"
---

This article provides an examples of how to run model evaluation test plans, and provides a reference to other model evaluation tests and test plans available in the Developer Framework.
Expand Down
2 changes: 1 addition & 1 deletion site-unused/model-object.qmd
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
title: "The model object"
keywords: "model object, model risk management, ValidMind"
keywords: "model object, ai risk, model risk management, ValidMind"
---

## Brief Introduction
Expand Down
2 changes: 1 addition & 1 deletion site-unused/mrm-lifecyle.qmd
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
title: "Model lifecycle and workflow "
keywords: "model lifecycle, workflow, model risk management, ValidMind"
keywords: "model lifecycle, workflow, ai risk, model risk management, ValidMind"
---

Model Risk Management (MRM) plays an important role in ensuring the accuracy, reliability, and effectiveness of models used in decision-making processes. This article focuses on the model lifecycle and process workflow, outlining the key stages and activities that constitute a robust MRM framework.
Expand Down
2 changes: 1 addition & 1 deletion site-unused/mrm-three-lines-of-defense.qmd
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
title: "The three line of defense"
keywords: "three lines of defense, model risk management, ValidMind"
keywords: "three lines of defense, ai risk, model risk management, ValidMind"
---

Model Risk Management (MRM) is a crucial process for organizations using mathematical and statistical models to inform decision-making. MRM aims to identify, assess, and mitigate risks arising from model usage, ensuring the accuracy and reliability of model outputs. A key aspect of MRM is its three lines of defense, which provide a structured approach to managing model risk across various functions and roles.
Expand Down
2 changes: 1 addition & 1 deletion site-unused/mrm.qmd
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
title: "Model risk management"
keywords: "MRM, model risk management, ValidMind"
keywords: "MRM, ai risk, model risk management, ValidMind"
---

Model risk management (MRM) is a process for organizations using mathematical and statistical models to inform decision-making. MRM aims to identify, assess, and mitigate risks arising from model usage, ensuring the accuracy and reliability of model outputs.
Expand Down
2 changes: 1 addition & 1 deletion site-unused/release-access.qmd
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
title: "Release access"
keywords: "release access, model risk management, ValidMind"
keywords: "release access, ai risk, model risk management, ValidMind"
---

Welcome to the {{< var version >}} for ValidMind. On this page you will find important information to help you get access.
Expand Down
2 changes: 1 addition & 1 deletion site-unused/release-notes.qmd
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
title: "Release notes"
keywords: "release notes, model risk management, ValidMind"
keywords: "release notes, ai risk, model risk management, ValidMind"
---

## Release highlights
Expand Down
4 changes: 2 additions & 2 deletions site-unused/run-tests-test-plans-test-suites.qmd
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
title: "Run test plans"
keywords: "run test plans, model risk management, ValidMind"
keywords: "run test plans, ai risk, model risk management, ValidMind"
---

Learn how you use ValidMind to run tests, test plans, and test suites. This topic is relevant for model developers who want to adopt the testing functionality that is available in the ValidMind Developer Framework.
Expand All @@ -10,7 +10,7 @@ Learn how you use ValidMind to run tests, test plans, and test suites. This topi

[Include any common issues or errors that may arise during the task and how to resolve them.]

## What's Next
## What's next

[Summarize the task and provide any next steps or resources for the user to continue their learning or work.]
--->
Expand Down
2 changes: 1 addition & 1 deletion site-unused/tabular-data-tests.qmd
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
title: "Tabular data tests"
keywords: "tabular data tests, model risk management, ValidMind"
keywords: "tabular data tests, ai risk, model risk management, ValidMind"
---

This article provides an example of how to run a Test Plan to validate a tabular dataset, and provides a reference to other dataset tests and test plans available in the Developer Framework.
Expand Down
33 changes: 33 additions & 0 deletions site-unused/track-model-lifecycle.qmd
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
---
title: "Tracking the model lifecycle"
keywords: "track model lifecycle, ai risk, model risk management, ValidMind"
---

A typical high-level model lifecycle workflow looks like this:

```{mermaid}
graph LR
A[New model<br>registration] --> B[Initial<br>validation]
B --> C[Validation<br>approval]
C --> D[In production]
D --> E[Periodic review<br>and revalidation]
E --> B
```
<br>

New model registration
: Model owners and validators use the model inventory to manage all metadata associated with a model, including compliance and regulatory attributes. Users select a documentation template when registering a new inventory model.

**Initial validation**
: Triggers a new documentation workflow, resulting in a model that is ready for production deployment after its documentation and validation reports are approved.

See [Track the documentation workflow](#tracking-the-documentation-workflow) for more details.

**Validation approval**
: Perform validation of the model to ascertain that it meets the needs for which it was designed. ValidMind can connect to third-party systems to send events when a model has been approved for production.

**In production**
: Use the model in production while ensuring its ongoing reliability, accuracy, and compliance with regulations by monitoring the model's performance.

**Periodic review and revalidation**
: As part of regular performance monitoring or change management, developers and validators follow a process similar to that seen in the **Initial validation** step.
7 changes: 1 addition & 6 deletions site/Makefile
Original file line number Diff line number Diff line change
Expand Up @@ -75,12 +75,7 @@ docs-site: clean clone notebooks python-docs

# Deployment to https://docs-demo.vm.validmind.ai/
deploy-demo:
@if [ "`git rev-parse --abbrev-ref HEAD`" != "docs-demo" ]; then \
echo "You're not on the docs-demo branch, no action taken."; \
else \
echo "\nDeploying docs-demo site ..."; \
quarto render && aws s3 sync ./_site s3://docs-ci-cd-demo/site/ --delete && aws cloudfront create-invalidation --distribution-id E38AINJY5CYN6P --paths "/*" --no-cli-pager > /dev/null; \
fi
quarto render && aws s3 sync ./_site s3://docs-ci-cd-demo/site/ --delete && aws cloudfront create-invalidation --distribution-id E38AINJY5CYN6P --paths "/*" --no-cli-pager > /dev/null; \

# Deployment to https://docs.validmind.ai/
deploy-prod:
Expand Down
Loading