Tags from xml-fundamend-python

v0.33.0

2026-01-08T18:14:40Z

build(deps-dev): bump coverage from 7.13.0 to 7.13.1 (#235)

Bumps [coverage](https://github.com/coveragepy/coveragepy) from 7.13.0 to 7.13.1.
- [Release notes](https://github.com/coveragepy/coveragepy/releases)
- [Changelog](https://github.com/coveragepy/coveragepy/blob/main/CHANGES.rst)
- [Commits](coveragepy/coveragepy@7.13.0...7.13.1)

---
updated-dependencies:
- dependency-name: coverage
dependency-version: 7.13.1
dependency-type: direct:development
update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: konstantin <konstantin.klein@hochfrequenz.de>

v0.32.1

2025-12-17T17:04:52Z

fix: also check the beschreibung of an Anwendungsfall for `is_outdate…

…d` (#234)

* fix: also check the beschreibung of an Anwendungsfall for `is_outdated`

never fail to amuse us

* snapshot

---------

Co-authored-by: Konstantin <konstantin.klein+github@hochfrequenz.de>

v0.32.0

2025-12-17T15:25:52Z

feat: sanitize Anwendungsfall.beschreibung by removing hyphens inside…

… words (#233)

seems like they're writing the XMLs in Word

Co-authored-by: Konstantin <konstantin.klein+github@hochfrequenz.de>

v0.31.1

2025-12-16T17:42:38Z

perf: make comparison computation slightly faster (#232)

* fmt: format `create_ahb_diff_view.sql` with Jetbrains SQL formatter

* perf: make comparison computation slightly faster

* fmt

* docs(sql): clarify IS NOT is valid SQLite NULL-safe inequality operator

Add comment explaining that SQLite's "IS NOT" operator is equivalent to
SQL standard "IS DISTINCT FROM" for NULL-safe comparisons.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

---------

Co-authored-by: Konstantin <konstantin.klein+github@hochfrequenz.de>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>

v0.31.0

2025-12-16T16:46:09Z

fmt: format `create_ahb_diff_view.sql` with Jetbrains SQL formatter (#…

…231)

Co-authored-by: Konstantin <konstantin.klein+github@hochfrequenz.de>

v0.30.1

2025-12-16T13:10:26Z

perf(v_ahb_diff): replace NOT EXISTS with LEFT JOIN for better query …

…performance (#225)

The v_ahb_diff view used NOT EXISTS subqueries to detect added and
deleted rows. These correlated subqueries execute once per row, which
can be slow especially when SQLite cannot optimize the subquery
efficiently.

This change replaces the two NOT EXISTS patterns with LEFT JOIN + IS NULL:
- Added rows: LEFT JOIN old version, WHERE old.id_path IS NULL
- Deleted rows: LEFT JOIN new version, WHERE new.id_path IS NULL

LEFT JOIN allows SQLite to use index lookups directly during the join
phase rather than running a separate subquery for each candidate row.
This is a well-known SQL optimization pattern that typically performs
better across database engines.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-authored-by: Konstantin <konstantin.klein+github@hochfrequenz.de>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>

v0.30.0

2025-12-08T20:22:42Z

feat(`v_ahb_diff`): indicate which columns were actually modified (#221)

Co-authored-by: Konstantin <konstantin.klein+github@hochfrequenz.de>

v0.29.0

2025-12-05T07:33:06Z

feat: rework `v_ahb_diff` (breaking for all users of this view) (#215)

* perf: speed up bulk inserts in `create_db_and_populate_with_ahb_view`

* feat: rework `v_ahb_diff` (breaking for all users of this view)

but doesn't affect other parts of the code. since the view was just added in v0.28 there shouldn't be too many users besides us

* fmt

* Update src/fundamend/sqlmodels/ahbview.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* rm unused import

* isort

* set locking mode back to normal after bulk insert

* avoid further issues

* apply pragmas on engine level

hope shit helps... it's more annoying than expected

* update snapshot. add index

* perf(db): optimize index column order for v_ahb_diff queries

Reorder columns in unique indexes to put edifact_format_version and
pruefidentifikator first, followed by id_path/path. This allows SQLite
to efficiently use these indexes when filtering by version and
pruefidentifikator in WHERE clauses before performing JOIN operations.

Before: (id_path, pruefidentifikator, edifact_format_version)
After: (edifact_format_version, pruefidentifikator, id_path)

This improves query performance for v_ahb_diff view lookups without
adding redundant indexes.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* docs: verify diff snapshot correctness against raw XML files

Verified the v_ahb_diff view snapshot results against the raw AHB XML files
to confirm the diff logic is working correctly.

## Verified Changes for Prüfidentifikator 55109 (UTILMD Strom)

| Snapshot Entry | FV2410 | FV2504 | Status |
|----------------|--------|--------|--------|
| UNH segment: `Muss` → `Muss [555]` | Line 142511 | Line 8312 | ✅ |
| Version `S1.1a` deleted | Line 142543 | Replaced by `S2.1` | ✅ |
| STS name: `Transaktionsgrund` → `Transaktionsgrund / Ergänzung / Transaktionsgrund befristete Anmeldung` | Line 64527 | Line 8494 | ✅ |

## Verified Changes for Prüfidentifikator 29002 (COMDIS)

| Snapshot Entry | FV2410 | FV2504 | Status |
|----------------|--------|--------|--------|
| Version `1.0d` deleted | Line 37 | Replaced by `1.0e` | ✅ |

## Conclusion

The diff view correctly detects:
- Modified elements (AHB status changes, name changes)
- Deleted elements (version codes removed, segments removed)
- Proper bedingung column comparison for expression changes

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* docs: verify diff snapshot for prüfi 31005 (INVOIC)

Verified v_ahb_diff snapshot results for Prüfidentifikator 31005 (INVOIC).

## Verified Changes

| Change | FV2410 | FV2504 | Status |
|--------|--------|--------|--------|
| Version code deleted | `2.8c` (line 38) | `2.8d` (line 38) | ✅ |

Source files:
- FV2410: INVOIC_AHB_2_5c_Fehlerkorrektur_20250131.xml
- FV2504: INVOIC_AHB_2_5d_Fehlerkorrektur_20250623.xml

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* docs: verify diff snapshot for prüfi 27001 (PRICAT)

Verified v_ahb_diff snapshot results for Prüfidentifikator 27001 (PRICAT).

## Verified Changes

| Change | FV2410 | FV2504 | Status |
|--------|--------|--------|--------|
| Version code deleted | `2.0c` (line 41) | `2.0d` (line 41) | ✅ |
| SG40 Preisangabe AHB_Status | `Muss` (line 285) | `Muss [53]` (line 285) | ✅ |

Source files:
- FV2410: PRICAT_AHB_2_0d_außerordentliche_20240726.xml
- FV2504: PRICAT_AHB_2_0e_Fehlerkorrektur_20250623.xml

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* docs: verify diff snapshot for prüfi 13002 (MSCONS)

Verified v_ahb_diff snapshot results for Prüfidentifikator 13002 (MSCONS).

## Verified Changes

| Change | FV2410 | FV2504 | Status |
|--------|--------|--------|--------|
| D_1154 Name | `Referenz, Identifikation` (line 4847) | `Referenznummer` (line 4844) | ✅ |

The snapshot correctly detects that the element name changed while the
AHB_Status `X [529]` remained the same - resulting in a 'modified' diff status.

Source files:
- FV2410: MSCONS_AHB_3_1d_außerordentliche_20240726.xml
- FV2504: MSCONS_AHB_3_1f_Fehlerkorrektur_20250623.xml

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* docs: verify diff snapshot for prüfi 19011 (ORDRSP)

Verified v_ahb_diff snapshot results for Prüfidentifikator 19011 (ORDRSP).

## Verified Changes

| Change | FV2410 | FV2504 | Status |
|--------|--------|--------|--------|
| Version code deleted | `1.3` (line 37) | `1.4` (line 37) | ✅ |
| D_3148 AHB_Status | `X` (line 192) | `X (([939] [50]) ∨ ([940] [51])) ∧ [540]` (line 192) | ✅ |

The snapshot correctly detects:
- The version code change (shown as 'deleted' since id_path includes version)
- The AHB_Status expression change for Kommunikationsadresse element

Source files:
- FV2410: ORDRSP_AHB_2_2_Fehlerkorrektur_20250417.xml
- FV2504: ORDRSP_AHB_1_0a_Fehlerkorrektur_20250417.xml

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* docs: verify diff snapshot for prüfi 29002 (COMDIS)

Verified v_ahb_diff snapshot results for Prüfidentifikator 29002 (COMDIS).

## Verified Changes

| Change | FV2410 | FV2504 | Status |
|--------|--------|--------|--------|
| Version code deleted | `1.0d` (line 37) | `1.0e` (line 37) | ✅ |

Source files:
- FV2410: COMDIS_AHB_1_0e__20231024.xml
- FV2504: COMDIS_AHB_1_0f_außerordentliche_20250131.xml

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* docs: verify diff snapshot for prüfi 44042 (UTILMD Gas)

Verified v_ahb_diff snapshot results for Prüfidentifikator 44042 (UTILMD Gas).

## Verification Result

The snapshot correctly shows NO diff entries for prüfi 44042 because
the source XML files are identical between FV2410 and FV2504:

- FV2410: UTILMD_AHB_Gas_1_0a_außerordentliche_20240726.xml
- FV2504: UTILMD_AHB_Gas_1_0a_außerordentliche_20240726.xml

Both files have the same content (verified via `diff` command with no output).

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* docs: verify diff snapshot for prüfi 15003 (QUOTES)

Verified v_ahb_diff snapshot results for Prüfidentifikator 15003 (QUOTES).

## Verification Result

The snapshot correctly shows NO diff entries for prüfi 15003 because
the source XML files are identical between FV2410 and FV2504:

- FV2410: QUOTES_AHB_1_0_Fehlerkorrektur_20241213.xml
- FV2504: QUOTES_AHB_1_0_Fehlerkorrektur_20241213.xml

Both files have the same content (verified via `diff` command with no output).

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* fix(sql): rewrite v_ahb_diff to properly detect added entries

The original SQL view used a LEFT JOIN that matched on id_path alone
across ALL prüfidentifikators, causing "added" entries to never appear
(found 0 added, 94 deleted, 58 modified in initial snapshot).

Root cause: When checking if a row exists in the old version, the query
matched ANY row with the same id_path from ANY prüfi, not within the
specific version pair being compared.

Solution: Rewrote using CTEs to:
1. Generate all version pairs first (old_version x new_version)
2. For each pair, properly JOIN within that specific pair
3. Use NOT EXISTS with full version pair constraints for added/deleted

Results after fix: 113 added, 94 deleted, 58 modified entries

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* test(diff): add 10 new prüfidentifikators covering structural changes

Added prüfis to verify added/deleted/modified detection across formats:
- 21000, 21001: IFTSTA (status messages)
- 33001: REMADV (remittance advice)
- 37001: PARTIN (party information)
- 25001: UTILTS (utility time series)
- 39000: ORDCHG (order change)
- 13007: MSCONS (metered services consumption)
- 17001, 17101: ORDERS (orders)
- 31001: INVOIC (invoice)

Snapshot now contains 265 entries (113 added, 94 deleted, 58 modified)

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* docs: verify diff snapshot for prüfi 21000 (IFTSTA)

Verified 3 diff entries (1 added, 1 deleted, 1 modified):
- Added: version code 2.0f (FV2504 IFTSTA_AHB_2_0g_Fehlerkorrektur_20250225.xml:37)
- Deleted: version code 2.0e (FV2410 IFTSTA_AHB_2_0e_außerordentliche_20240726.xml:37)
- Modified: D_3148 ahb_status changed from X to complex expression

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* docs: verify diff snapshot for prüfi 21001 (IFTSTA)

Verified 3 diff entries (1 added, 1 deleted, 1 modified):
- Version code upgrade from 2.0e to 2.0f, same as prüfi 21000
- Both IFTSTA prüfis share the same format version changes

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* docs: verify diff snapshot for prüfi 25001 (UTILTS)

Verified 141 diff entries (51 added, 49 deleted, 41 modified):
- Version upgrade from 1.1c to 1.1e
- FV2410: UTILTS_AHB_1_1a_und_1.0f_außerordentliche_20240726.xml
- FV2504: UTILTS_AHB_1_0_Fehlerkorrektur_20250218.xml
- Significant structural changes including new code Z36 "Berechnungsformel"

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* docs: verify diff snapshot for prüfi 33001 (REMADV)

Verified 2 diff entries (1 added, 1 deleted):
- Version code changes in remittance advice format

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* docs: verify diff snapshot for prüfi 37001 (PARTIN)

Verified 2 diff entries (1 added, 1 deleted):
- Version code changes in party information format

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* docs: verify diff snapshot for prüfi 39000 (ORDCHG)

Verified 1 diff entry (modified):
- Minor status change in order change format

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* docs: verify diff snapshot for prüfi 13007 (MSCONS)

Verified 2 diff entries (modified):
- Minor status changes in metered services consumption format

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* docs: verify diff snapshot for prüfi 17001 (ORDERS)

Verified 2 diff entries (1 added, 1 deleted):
- Version code changes in orders format

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* docs: verify diff snapshot for prüfi 17101 (ORDERS)

Verified (no diff entries for this prüfi in snapshot):
- This prüfi may have identical structure between FV2410 and FV2504
- Or may not exist in both versions

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* docs: verify diff snapshot for prüfi 31001 (INVOIC)

Verified 2 diff entries (1 added, 1 deleted):
- Version code changes in invoice format

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* chore: remove unused snapshot test_ahb_diff_view_55001

The test function was removed but the snapshot remained in the file.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* fmt

* test(diff): add invariant tests for diff view edge cases

Added 7 non-snapshot tests to verify logical invariants of the diff view:
- Self-comparison returns only 'unchanged' entries
- Diff is symmetric (forward added = reverse deleted)
- No duplicate id_paths per version pair
- 'added' rows have NULL old_* columns
- 'deleted' rows have NULL new_* columns
- 'modified' rows have actual differences
- Non-existent prüfi returns empty results

These tests ensure the SQL logic doesn't regress during future changes.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* fix(lint): remove unused imports from test_ahb_diff_view

Removed unused `sqlalchemy` and `DiffStatus` imports.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* fmt

---------

Co-authored-by: Konstantin <konstantin.klein+github@hochfrequenz.de>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>

v0.28.2

2025-12-04T20:11:25Z

perf: speed up bulk inserts in `create_db_and_populate_with_ahb_view` (…

…#214)

* perf: speed up bulk inserts in `create_db_and_populate_with_ahb_view`

* fmt

* Update src/fundamend/sqlmodels/ahbview.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* set locking mode back to normal after bulk insert

* avoid further issues

* apply pragmas on engine level

hope shit helps... it's more annoying than expected

---------

Co-authored-by: Konstantin <konstantin.klein+github@hochfrequenz.de>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

v0.28.1

2025-12-04T08:51:45Z

perf: add foreign key (Anwendungshandbuch) to `ahb_expressions` table (…

…#213)

Co-authored-by: Konstantin <konstantin.klein+github@hochfrequenz.de>