docs: Consolidate and reorganize documentation structure (mrveiss#791)

Major documentation cleanup following docs/plans/2026-02-07-documentation-consolidation-plan.md:

Phase 1 - Remove Duplicates:
- Delete case-duplicate files (e.g., comprehensive_troubleshooting_guide.md)
- Remove content duplicates in guides/

Phase 2 - User Guide Consolidation:
- Merge docs/user/, docs/user_guide/, docs/user-guides/ into docs/user-guide/
- Rename files with consistent numbering

Phase 3 - Roadmap Consolidation:
- Archive legacy roadmaps to docs/archives/roadmaps/
- Move documentation roadmap to docs/planning/

Phase 4 - Root-Level Organization:
- Move 30+ root-level files to appropriate subdirectories
- Files organized by category: api/, architecture/, planning/, migration/, etc.

Phase 5 - Archive Old Reports:
- Archive multiple dated report directories to docs/archives/
- Remove duplicate Report_* directories

Phase 6 - Update INDEX.md:
- Update documentation index with new paths
- Fix internal references

Result: Root-level files reduced from 41 to ~8, user guide directories from 3 to 1

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

Author: mrveiss

README.md

@@ -106,7 +106,8 @@ AutoBot now includes comprehensive Redis service management capabilities:
 
 ### Core Documentation
 - [**System Configuration**](CLAUDE.md) - Complete development notes, fixes, and architecture
-- [**Scripts Organization**](scripts/README.md) - All scripts and utilities documentation
+- [**Infrastructure**](infrastructure/README.md) - Per-role infrastructure and deployment scripts
+- [**Scripts & Utilities**](infrastructure/shared/scripts/README.md) - All scripts and utilities documentation
 
 ### MCP & Agent Integration
 - [**LangChain MCP Integration Guide**](docs/developer/LANGCHAIN_MCP_INTEGRATION.md) - How to integrate AutoBot MCP tools with LangChain agents