Skip to content

feat(autoresearch): add Layer 4 Save-as-CLI eval with complex zhihu/xhs chains#750

Merged
jackwener merged 1 commit intomainfrom
feat/save-as-cli-eval
Apr 3, 2026
Merged

feat(autoresearch): add Layer 4 Save-as-CLI eval with complex zhihu/xhs chains#750
jackwener merged 1 commit intomainfrom
feat/save-as-cli-eval

Conversation

@jackwener
Copy link
Copy Markdown
Owner

Summary

Add autoresearch Layer 4: tests the full "Save as CLI" pipeline (operate init → write adapter → operate verify), ensuring users can reliably crystallize browser exploration into reusable CLI adapters.

Key changes:

  • eval-save.ts: test harness (init → write → verify → judge per task)
  • save-tasks.json: 26 tasks (20 PUBLIC + 6 COOKIE complex multi-step)
  • save-adapters/*.ts: 6 complex adapter files for zhihu/xhs (avoid JSON escape issues)
  • save-reliability preset for autoresearch engine iteration
  • operate verify fix: no longer hardcodes --limit 3 for adapters without limit arg
  • Engine timeout: 180s → 300s to reduce ETIMEDOUT failures

Complex COOKIE chains (6-8 steps each):

Task Steps Pattern
zhihu hot+top-answer 6 navigate → hot API → parse big-int IDs → loop fetch answers → strip HTML → merge
zhihu search+stats 7 navigate → search API → filter types → extract question IDs → fetch detail per result → merge
zhihu question+related 8 navigate → question API → answers API → related API → merge 3 layers
xhs search+scroll 6 navigate → MutationObserver wait → scroll 3x → DOM extract with dedup
xhs note+comments 7 navigate → extract meta → scroll container → extract comments → merge
xhs explore+sort 8 navigate → MutationObserver → adaptive scroll → dedup → parse likes → sort → slice

AutoResearch results (5 rounds):

  • Baseline: 14 → Final: 26 tasks, all passing
  • 3 KEEP rounds (+12 tasks auto-generated)
  • operate verify bugfix enabled COOKIE strategy testing

Test plan

  • npx tsx autoresearch/eval-save.ts → 26/26
  • npm run build passes
  • zhihu COOKIE tasks pass (hot-detail, search-detail, question-full)
  • xhs COOKIE tasks pass (search-full, note-comments, explore-deep)

@jackwener jackwener force-pushed the feat/save-as-cli-eval branch from 480af82 to 72362c0 Compare April 3, 2026 17:46
@jackwener jackwener merged commit c2ac552 into main Apr 3, 2026
11 checks passed
just-buer pushed a commit to just-buer/opencli that referenced this pull request Apr 8, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant