Add SimpleDataSourceStreamReader documentation

[allisonwang-db]

Add documentation for SimpleDataSourceStreamReader

Summary by CodeRabbit

• Documentation
  • Added an in-depth architecture guide for SimpleDataSourceStreamReader (Spark Structured Streaming), detailing components, data flow, execution, integration, design trade-offs, performance considerations (memory/offsets), monitoring and failure recovery, limitations, and a concrete example with code snippets and a diagram.
  • Updated Data Sources documentation by removing the SimpleJsonDataSource entry.

[coderabbitai]

Caution

Review failed

The pull request is closed.

Walkthrough

Removed the SimpleJsonDataSource row from docs/index.md and added a new documentation page describing the SimpleDataSourceStreamReader architecture, flow, examples, and limitations. No code or exported/public entity changes.

Changes

Cohort / File(s)	Summary of Changes
Docs update docs/index.md, docs/simple-stream-reader-architecture.md	Removed the SimpleJsonDataSource row from the Data Sources table. Added a new architecture document detailing SimpleDataSourceStreamReader components, data flow, usage examples, performance considerations, and limitations.

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~2 minutes

Possibly related PRs

• Update README to add new data sources #22 — Also updates documentation around data sources, including removal of the SimpleJsonDataSource entry and additions related to streaming reader architecture.

Poem

I hop through docs with gentle cheer,
One row gone—now crystal clear.
A streaming map, new paths to read,
Offsets nibble, batches feed.
Burrow of bytes, diagrams bright—
Thump! The reader’s flow takes flight.
Carrot-shaped pointers, all set right. 🥕

✨ Finishing touches

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Post copyable unit tests in a comment
• Commit unit tests in branch add-docs

---

📜 Recent review details

Configuration used: CodeRabbit UI

Review profile: CHILL

Plan: Pro

📥 Commits

Reviewing files that changed from the base of the PR and between 2bcae6a and 97a3600.

📒 Files selected for processing (2)

• docs/index.md (0 hunks)
• docs/simple-stream-reader-architecture.md (1 hunks)

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}