Meltano: Add example cratedb-to-file

[amotl]

About

A Meltano recipe definition for loading data into CrateDB. It uses the meltano-tap-cratedb data source pipeline component.

What's inside

• Example cratedb-to-file

Documentation

• Meltano Examples
• CrateDB -> File

References

• CrateDB: Hello, World! meltano-tap-cratedb#1

/cc @seut

[coderabbitai]

Walkthrough

Adds a new Meltano example "cratedb-to-file" (configs, docs, CI/test tasks) demonstrating exporting CrateDB to file targets, and updates the Meltano README and CI Python matrix (3.14 → 3.12).

Changes

Cohort / File(s)	Summary
CI/CD Workflow /.github/workflows/framework-meltano.yml	Updated GitHub Actions Python matrix from 3.14 to 3.12; added explanatory comments and issue link.
Top-level Meltano docs framework/meltano/README.md	Updated intro to mention both meltano-tap-cratedb and meltano-target-cratedb; added "cratedb-to-file" example section and external reference.
New cratedb-to-file example — docs framework/meltano/cratedb-to-file/README.md	Added usage guide describing export workflows, example commands, config notes, and development/testing hints.
New cratedb-to-file example — Meltano config framework/meltano/cratedb-to-file/meltano.yml	New Meltano project config: environments, tap-cratedb extractor (SQLAlchemy URL, stream selection rules), and multiple targets (target-csv, target-jsonl, target-singer-jsonl, target-jsonl-blob) with output paths and notes.
New cratedb-to-file example — automation framework/meltano/cratedb-to-file/pyproject.toml	Adds Poe tasks to run a meltano pipeline (install, discover, run targets) and verify-export checks for output existence and record counts.
Root Poe integration framework/meltano/pyproject.toml	Added test step to run the cratedb-to-file Poe test (poe --root cratedb-to-file test).

Sequence Diagram(s)

sequenceDiagram
    participant Dev as Developer
    participant Poe as Poe (task runner)
    participant Meltano as Meltano
    participant Tap as tap-cratedb
    participant Target as target-* (CSV/JSONL/Singer)
    participant FS as Filesystem

    Dev->>Poe: run "poe test" (meltano-pipeline)
    Poe->>Meltano: meltano lock / meltano install
    Poe->>Meltano: meltano invoke tap-cratedb --discover
    Meltano->>Tap: run extractor (connect to CrateDB)
    Tap-->>Meltano: emit catalog/records
    Meltano->>Target: run target-csv / target-jsonl / target-singer-jsonl
    Target->>FS: write output files (./output/...)
    Poe->>FS: verify outputs exist & record counts (verify-export)
    FS-->>Poe: verification results

Loading

Estimated code review effort

🎯 3 (Moderate) | ⏱️ ~25 minutes

Possibly related PRs

• Meltano: Add example file-to-cratedb #190 — Also modifies the same CI workflow Python matrix; likely related to Python version adjustments in CI.

Suggested reviewers

• seut
• surister
• kneth

Poem

🐰 I hopped through YAML, docs, and a test,
Tap-CrateDB woke from its nest,
CSV and JSONL danced in a file,
Poe ran the steps with a confident smile,
Hooray—data exported, and I’ll rest a while! 🥕

🚥 Pre-merge checks | ✅ 3

✅ Passed checks (3 passed)

Check name	Status	Explanation
Title check	✅ Passed	The title directly and concisely describes the main change: adding a Meltano example for exporting CrateDB data to files.
Docstring Coverage	✅ Passed	No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Description check	✅ Passed	The pull request description clearly relates to the changeset, describing the addition of a Meltano recipe for loading data into CrateDB with an example 'cratedb-to-file' and providing relevant documentation links.

_{✏️ Tip: You can configure your own custom pre-merge checks in the settings.}

✨ Finishing touches

• 📝 Generate docstrings

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Post copyable unit tests in a comment
• Commit unit tests in branch meltano-tap

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}