You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
GoTor already emits a versioned integration-safe JSON crawl report and exposes a documented job-control API. TorBot still has separate legacy result shapes and prior closed requests for JSON/save behavior, which makes the related crawler stack harder to integrate and test consistently.
Adopting one versioned crawl-result and run-evidence contract would reduce duplicate serialization logic across TorBot, GoTor, and desktop consumers while preserving each repository's implementation boundaries.
Proposed scope
Use GoTor's versioned report as the starting contract, document the compatibility decisions, and add a TorBot adapter that emits the shared shape.
The shared shape should include:
schema and run identifiers;
normalized target and effective crawl settings;
backend/component version;
per-page outcome, status, skip reason, and bounded error category;
extracted link/contact provenance;
cancellation and terminal status;
start/end timestamps and duration;
privacy-safe diagnostics without credentials, cookies, or unnecessary sensitive content.
Acceptance criteria
Document the canonical versioned crawl-result schema and compatibility rules.
Add a TorBot serializer/adapter for the shared schema without breaking existing human-readable CLI output.
Why
GoTor already emits a versioned integration-safe JSON crawl report and exposes a documented job-control API. TorBot still has separate legacy result shapes and prior closed requests for JSON/save behavior, which makes the related crawler stack harder to integrate and test consistently.
Adopting one versioned crawl-result and run-evidence contract would reduce duplicate serialization logic across TorBot, GoTor, and desktop consumers while preserving each repository's implementation boundaries.
Proposed scope
Use GoTor's versioned report as the starting contract, document the compatibility decisions, and add a TorBot adapter that emits the shared shape.
The shared shape should include:
Acceptance criteria
Existing-work boundaries