-
Notifications
You must be signed in to change notification settings - Fork 11
Closed
Labels
enhancementNew feature or requestNew feature or request
Description
Summary
The AI Insights panel in deck --web analytics is currently disabled. The Ollama-backed facet extraction has reliability and performance issues that need to be resolved before re-enabling.
Problems
- Ollama responses often fail JSON parsing (
invalid character 'O' looking for beginning of value) even withformat: "json"set - Backfilling all sessions blocks the
/api/facetsendpoint, making the analytics page load extremely slow - Auto-detecting Ollama on startup adds latency even when insights aren't needed
Current State
- UI is commented out in
deck.js(analyticsInsightsEl.hidden = true) - Server-side facet endpoints still exist and work with
--insightsflag facets_ollama.gohasformat: "json"set but models still return non-JSON
Proposed Work
- Investigate async/background backfill so it doesn't block page load
- Add retry logic or better prompt engineering for JSON extraction
- Consider streaming partial results to the UI as sessions are processed
- Re-enable the insights UI once extraction is reliable

Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request