Skip to content

Commit 83c1a63

Browse files
zphzph
committed
Expand e2e test cases
1 parent 201031b commit 83c1a63

File tree

6 files changed

+2958
-54
lines changed

6 files changed

+2958
-54
lines changed

‎Justfile

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,8 +1,9 @@
11
test:
22
uv run pytest --disable-warnings -s
3+
deno test -A tests/cli_test.ts
34

45
test-watch:
5-
watchexec -- pytest --disable-warnings -s
6+
watchexec -- uv run pytest --disable-warnings -s && deno test -A tests/cli_test.ts
67

78
open NOTEBOOK:
89
uv run runbook edit {{NOTEBOOK}}

‎TESTING.md

Lines changed: 18 additions & 21 deletions
Original file line numberDiff line numberDiff line change
@@ -1,28 +1,25 @@
11
# Testing
22

3-
## CLI
3+
## Coverage
44

5-
| Command | Description | Unit Tests | Manual Testing Required |
6-
| ------- | ---------------------------------------------------------- | ---------- | ------------------------------------- |
7-
| check | Check language validity and formatting of a notebook | ✅ | No |
8-
| convert | Convert an existing runbook to different format | ✅ | Yes - Test conversion between formats |
9-
| create | Create a new runbook from [template] | ✅ | Yes - Verify template rendering |
10-
| diff | Diff two notebooks | ✅ | Yes - Visual verification |
11-
| edit | Edit an existing runbook | ✅ | Yes - Interactive editing |
12-
| init | Initialize a folder as a runbook repository | ✅ | No |
13-
| list | List runbooks | ✅ | No |
14-
| plan | Prepares the runbook for execution by injecting parameters | ❌ | Yes - Parameter injection |
15-
| review | [Unimplemented] Entrypoint for reviewing runbook | ❌ | N/A |
16-
| run | Run a notebook | ✅ | Yes - Full execution |
17-
| show | Show runbook parameters and metadata | ✅ | No |
18-
| version | Display version information about runbook | ✅ | No |
5+
| Command | Description | Unit/Integration Tests | Manual Testing Required |
6+
| ------- | ---------------------------------------------------------- | ---------------------- | ----------------------- |
7+
| check | Check language validity and formatting of a notebook | ✅ | ❌ |
8+
| convert | Convert an existing runbook to different format | ✅ | ❌ |
9+
| create | Create a new runbook from [template] | ✅ | ❌ |
10+
| diff | Diff two notebooks | ✅ | ❌ |
11+
| edit | Edit an existing runbook | ❌ | ✅️ |
12+
| init | Initialize a folder as a runbook repository | ✅ | ❌ |
13+
| list | List runbooks | ✅ | ❌ |
14+
| plan | Prepares the runbook for execution by injecting parameters | ✅ | ❌️ |
15+
| review | [Unimplemented] Entrypoint for reviewing runbook | ❌ | N/A |
16+
| run | Run a notebook | ❌ | ✅️ |
17+
| show | Show runbook parameters and metadata | ✅ | ❌ |
18+
| version | Display version information about runbook | ✅ | ❌ |
1919

2020
Commands marked with "Manual Testing Required: Yes" should be tested manually as
2121
they cannot be easily automation tested. Key areas to verify:
2222

23-
- `convert`: Test conversion between all supported formats
24-
- `create`: Verify template rendering and parameter substitution
25-
- `diff`: Visually verify diff output is correct
26-
- `edit`: Test interactive editing workflow
27-
- `plan`: Verify parameter injection and validation
28-
- `run`: Test full execution with various parameter combinations
23+
- `edit`: `runbook edit _template-deno.ipynb`
24+
- `run`: `runbook run _template-deno.ipynb`
25+
- `run`: `runbook run --no-interactive _template-deno.ipynb`

‎deno.json

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
{
2+
"imports": {
3+
"@david/dax": "jsr:@david/dax@^0.42.0"
4+
}
5+
}

0 commit comments

Comments
 (0)