Collect more analytics on key factor creation

[SylvainChevalier]

Collect:

• user creates a key factor by hand
• key factors are generated automatically
• user clicks the generate key factor button
• user edits an llm-generated key factor
• user accepts an llm-generated key factor

And anything else that makes sense given the ui.

[SylvainChevalier]

@claude

[claude]

Claude finished @SylvainChevalier's task in 6m 27s —— View job • claude/issue-4194-20260129-1414 • Create PR ➔

---

Analytics for key factor creation implemented successfully!

• Read repository guidelines (CLAUDE.md)
• Explore codebase to find key factor related code
• Identify existing analytics patterns
• Implement analytics tracking for:
  • User creates a key factor by hand
  • Key factors are generated automatically (backend)
  • User clicks the "Ask an LLM" button
  • User edits an LLM-generated key factor
  • User accepts an LLM-generated key factor
  • User rejects an LLM-generated key factor (bonus)
• Test and verify implementation
• Commit and push changes

Analytics events implemented:

1. addKeyFactor (enhanced) - Tracks when key factors are submitted

   • event_category: Type of key factor (driver, base_rate, news)
   • event_label: Location (fromList, fromComment)
   • source: Creation method (manual, llm_suggestion, mixed)
   • count: Number of key factors added

2. keyFactorGenerateClicked - Tracks when user clicks "Ask an LLM"

   • event_category: Context (fromComment, fromList)
   • force: Whether it's a reload

3. keyFactorLLMGenerated - Tracks successful LLM generation

   • event_category: "success"
   • count: Total suggestions generated
   • driver_count, base_rate_count, news_count: Breakdown by type

4. keyFactorLLMSuggestionAccepted - Tracks accepting a suggestion

   • event_category: Key factor type (driver, base_rate, news)

5. keyFactorLLMSuggestionEdited - Tracks editing a suggestion before accepting

   • event_category: Key factor type (driver, base_rate, news)

6. keyFactorLLMSuggestionRejected - Tracks rejecting/dismissing a suggestion

   • event_category: Key factor type (driver, base_rate, news)

Files modified:

• front_end/src/app/(main)/questions/[id]/components/key_factors/hooks.ts
• front_end/src/app/(main)/questions/[id]/components/key_factors/key_factors_context.tsx
• front_end/src/app/(main)/questions/[id]/components/key_factors/add_in_comment/key_factors_add_in_comment_llm_suggestions.tsx

What was implemented:

The analytics now comprehensively track the entire key factor creation workflow:

• Manual creation: When users create key factors by hand, the existing addKeyFactor event now includes a source: "manual" property to distinguish it from LLM-generated ones
• LLM button click: When users click the "Ask an LLM" button to generate suggestions, keyFactorGenerateClicked is fired
• Automatic generation: When the backend successfully generates suggestions, keyFactorLLMGenerated is fired with detailed counts
• User interactions with suggestions: All three actions (accept, edit, reject) are now tracked with their respective events

This provides complete visibility into how users interact with the key factors feature, including adoption of the LLM suggestion functionality.

---

Branch: claude/issue-4194-20260129-1414 |