Skip to content

Latest commit

 

History

History
193 lines (154 loc) · 16.3 KB

File metadata and controls

193 lines (154 loc) · 16.3 KB
tags
features
index
catalog
aliases
Capability Catalog
Feature Catalog
What AutoBot Can Do
Buried Features
status current

AutoBot Capability Catalog

This is the single registry for AutoBot features. Feature documentation lives in one place — docs/features/ — and this catalog is its index: every capability maps to a design doc and a tracking issue. It includes capabilities that were previously documented only in archived plans, design specs, and implementation reports and were not reachable from the main navigation.

Verified. Statuses below were verified against the codebase on 2026-06-10 (evidence captured in the linked issues #9874–#9885, under umbrella #9872). Most capabilities verified as more complete than first documented. Remaining gaps are tracked as discovery issues — see Gaps found during verification.

  • Shipped — implemented and wired end-to-end (backend + frontend where applicable), with code evidence.
  • Partial — backend shipped but no frontend consumer, or a sub-capability still planned. Each has a wire-in issue.
  • Planned — specified, implementation not yet started.
  • Design — design spec only.

See the Platform Model for how these fit together.


Modules

Some capabilities are packaged as installable modules built on the platform core, not as part of the core itself:

Module Status Design doc Issue What it adds
AutoBot LLC Shipped llc/_index, PRD #9883 Autonomous agent-company: 27 LLC routers under /api/llc, heartbeat/adapters, full views/llc/ UI (incremental follow-ups remain)
Codebase Analytics Shipped code-intelligence-dashboard-design #9884 Code structure analysis, risk detection, dependency insights — /analytics/codebase end-to-end
Transcriber Shipped transcriber-plan-1-foundation #9885 Audio transcription module: projects, recordings, local pipeline (diarization), export (srt/vtt/docx/pdf), UI

The themed tables below break down the capabilities inside the core and these modules.


Conversation & Voice

Capability Status Design doc Issue What it does
Voice conversation mode Shipped voice-conversation-mode-design #9874 Walkie-talkie, hands-free, duplex, and realtime-WebRTC modes (/voice WS + useVoiceConversation)
Streaming TTS (per-sentence) Shipped archives/plans #9874 Real-time per-sentence text-to-speech with sub-second time-to-first-chunk (_tts_queue_worker, worker generate_audio_stream, #12501)
Chat knowledge management Shipped CHAT_KNOWLEDGE_MANAGEMENT #9874 Chat-scoped knowledge, file associations, conversation→KB compilation (11 endpoints)

Knowledge, RAG & Memory

Capability Status Design doc Issue What it does
Graph-RAG hybrid search Shipped issue-55-complete-summary #9875 Weighted vector + knowledge-graph retrieval with entity extraction at query time (/graph-rag/search)
Graph entity extractor Shipped issue-55-complete-summary #9875 Extracts facts/entities from conversations, infers relationships (/entities/extract)
Memory graph semantic search Shipped MEMORY_GRAPH_SEMANTIC_SEARCH #9875 Hybrid full-text + vector over the memory graph (service layer; consumed internally — no public REST)
Enhanced memory manager Shipped PHASE_7_MEMORY_ENHANCEMENT #9875 Task execution history, embedding cache, subtask relationships, task lifecycle
RAG optimization suite Shipped RAG_Optimization_Implementation_Plan #9875 Semantic chunking, atomic facts, entity resolution, temporal invalidation + temporal KG (all four pillars present)
Neural Mesh RAG Shipped neural-mesh-rag-design #9875 Self-evolving RAG (neural_mesh_retriever + mesh_brain/: promoter, pruner, edge-learner; mesh tables)
Individual document vectorization Shipped individual-document-vectorization-ux-spec #9875 Per-document vectorization triggers + status badges in the file tree (both ends wired)
Knowledge-enhanced chat Shipped knowledge_chat_integration #9875 RAG context augmentation with source citations in chat (CitationsDisplay.vue)
MCP knowledge-base tools Shipped mcp-knowledge-base-integration #9875 Direct LLM access to the KB via MCP (search, add, similarity, QA chain)

Code Intelligence & Analytics

Capability Status Design doc Issue What it does
Advanced code intelligence Partial AutoBot_Advanced_Code_Intelligence #9876 31 endpoints: git-evolution, CFG/data-flow, bug prediction, auto review (shipped); semantic NL code search still planned
Code intelligence dashboard Shipped code-intelligence-dashboard-design #9876 Real-time code-health dashboard with bug-prediction trends (useCodeIntelligence)
Code pattern detection Shipped Graph_code_patern_detection #9876 RAG-based duplicate/anti-pattern detection (ChromaDB + NPU embeddings), dead-code/complexity
Error monitoring Partial code-intelligence-dashboard-design #9876 12 backend endpoints shipped; no frontend consumer (wire-in #9891)
Causal inference engine Partial changelog #9876 Root-cause/confounder analysis shipped (/diagnostics/analyze-failure); no UI consumer (wire-in #9892)
Advanced visualizations Shipped ADVANCED_VISUALIZATIONS #9876 Resource heatmaps, workflow graphs, agent-activity dashboards (in CustomDashboard.vue)

Vision, Browser & Desktop

Capability Status Design doc Issue What it does
Interactive browser control Shipped interactive-browser-control-design #9877 Navigate/click/fill/screenshot automation + live stream (/browser, BrowserAutomationView.vue)
Desktop streaming & takeover Shipped PHASE_8_ENHANCED_INTERFACE #9877 NoVNC desktop streaming with human takeover/approval (/streaming/*, /takeover/*)
Vision-automation integration Partial archives/plans #9877 Vision /analyze,/ocr,/automation-opportunities shipped; no frontend consumer (wire-in #9890)

Automation, Safety & Human-in-the-loop

Capability Status Design doc Issue What it does
Session takeover & control Shipped COMPLETE_SESSION_TAKEOVER_IMPLEMENTATION #9878 Pause/resume, approval gate, risk triggers (takeover_manager, /takeover/*)
Visual workflow builder Shipped visual-workflow-parallel-execution #585 Drag-and-drop workflow canvas for composing multi-step agent workflows, with a code view (WorkflowBuilderView.vue, WorkflowCanvas.vue, route /automation)
Chat approval-gate interrupt Partial #11202 #11202 LangGraph human-in-the-loop interrupt in the chat workflow: pauses on a proposed plan and resumes after confirmation. Opt-in per session via AUTOBOT_CHAT_APPROVAL_GATE (chat_workflow/graph.py, session_role.CHAT_APPROVAL_GATE_ENABLED); distinct from session takeover
Terminal safety Shipped TERMINAL_SAFETY_IMPLEMENTATION #9878 Command risk assessment + dangerous-command confirmation gate (command_patterns, security_risk_judge)
Skills system Shipped skills-system #9878 Skill discovery + 3-phase routing (skill_router, /skills)

Fleet, SLM & Infrastructure Ops

Capability Status Design doc Issue What it does
Service Lifecycle Manager (SLM) Shipped slm-docker-ansible-deployment #9879 Fleet deploy/operate/scale control plane (autobot-slm-backend, 40+ routers, ansible suite)
SLM bash execution Shipped slm-bash-execution #9879 Run bash across node groups (/infrastructure/execute) + per-node execution
NPU worker pool Shipped npu-worker-pool-design #9879 Load-balanced NPU pool with health loop + failover (npu_worker_manager, autobot-npu-worker)
Windows native NPU deployment Shipped INTEL_NPU_WINDOWS_DEPLOYMENT_ANALYSIS #9879 OpenVINO worker + Windows PowerShell deployment scripts (not research-only)
Release system (git-cliff) Shipped release-system-design #9879 Automated release notes (cliff.toml, release.yml) + SLM package-update indicators
Service discovery & message bus Partial service-discovery-design #9879 Message bus + mTLS shipped; dynamic service-discovery modules unwired (wire-in #9893)
Configuration management Partial CONFIGURATION_MANAGEMENT_IMPLEMENTATION_PLAN #9879 Env-var priority + validation shipped (ssot_config); full config hot-reload + cross-service settings-sync not present

Security & Governance

Capability Status Design doc Issue What it does
Service auth enforcement Shipped WEEK_3_ENFORCEMENT_MODE_DEPLOYMENT_PLAN #9880 JWT service-to-service authentication across the fleet (registered middleware)
Secrets management Shipped secrets_management_system #9880 Encrypted, dual-scope (general + chat) secrets with audit log (cipher is Fernet, not AES-256 — see #9894)

Platform Extensibility

Capability Status Design doc Issue What it does
Plugin SDK Shipped plugin-sdk-required-env #9881 plugin_sdk + plugin_manager API (install/load/enable/env-status) + core plugins
MCP agent workflows Shipped mcp_agent_workflows #9881 Four runnable example workflows (code analysis, research, VNC monitoring)
Language switcher (i18n) Shipped language-switcher #9881 vue-i18n, 11 locales (incl. RTL), LanguageSwitcher.vue + settings panel

Emerging Surfaces

Capability Status Design doc Issue What it does
Live Canvas Shipped live-canvas-phase1 #9882 Vue canvas + streaming cells + export (md/json/html/pdf) (/canvas, CanvasView.vue)
AutoResearch Shipped autoresearch-m3 #9882 Self-improving loop (meta-agent patch proposal + prompt optimizer) + dashboard (/experiments)

Gaps found during verification

Verification (2026-06-10) confirmed nearly all capabilities are real and wired. The remaining gaps are tracked as discovery issues:

Gap Issue
Vision automation backend shipped, no frontend consumer #9890
Error-monitoring backend (12 endpoints) has no frontend #9891
Causal-inference engine (/diagnostics/analyze-failure) has no UI #9892
Service-discovery modules written but unwired (zero callers) #9893
Secrets cipher: doc says AES-256-GCM, code is Fernet (AES-128) #9894

Smaller notes: Advanced code intelligence has all sub-analyzers shipped except semantic NL code search (still planned); Configuration management lacks full config hot-reload + cross-service settings-sync; Memory graph semantic search is a service-layer component with no public REST route (by design).

Single home for feature docs

docs/features/ is the single canonical home for feature documentation, and this catalog is its single registry — the one place that indexes every capability. By decision (#9872), this is a registry-only model: design specs that are dated/historical stay in their zones (archives/plans/, superpowers/plans/, planning/, research/) and this catalog links them. The genuine current feature docs already live in docs/features/; archival/planning specs are intentionally not relocated, to keep the zone taxonomy and the Obsidian graph intact.

How this catalog was built

This catalog consolidates a sweep of the archived/planning/design/implementation documentation zones for capabilities that were not reachable from INDEX.md. Pure refactors, CI plumbing, and internal test infrastructure were excluded. Per-feature verification (with code evidence) is recorded in the issues linked above under #9872.

Related