Skip to content

Add fan-out reference implementation#44

Merged
jacobthebanana merged 2 commits into
mainfrom
jjt/fan-out
Nov 25, 2025
Merged

Add fan-out reference implementation#44
jacobthebanana merged 2 commits into
mainfrom
jjt/fan-out

Conversation

@jacobthebanana

Copy link
Copy Markdown
Collaborator

PR Type

Feature

Short Description

Add async fan-out reference implementation for handling second-order tasks efficiently at scale.

Example task: identify conflicts between information presented across 50 document chunks.

Tests Added

Test manually:

uv run --env-file .env src/2_frameworks/2_multi_agent/fan_out.py \
--source_dataset laliyepeng/test-cra-dataset \
--num_rows 10 \
--output_report report.md

Example output: (gist URL)

@jacobthebanana

jacobthebanana commented Nov 23, 2025

Copy link
Copy Markdown
Collaborator Author

Ready for review. As expected, this setup can consume a lot of tokens. The example below shows an attempt to identify conflicts between 50 CRA document chunks, producing this massive markdown report.

LangFuse traces:

image

@jacobthebanana jacobthebanana merged commit 88569d3 into main Nov 25, 2025
4 checks passed
@jacobthebanana jacobthebanana deleted the jjt/fan-out branch November 25, 2025 20:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant