Empowering Indian developers with intelligent, RAG-powered resource discovery
An AI-first marketplace that transforms how developers discover, evaluate, and integrate APIs, models, and datasets through context-aware search with multilingual support for English, Hindi, and Hinglish.
Frontend: Next.js 16 (App Router) โข TypeScript โข Tailwind CSS โข NextAuth
Backend: FastAPI โข Python 3.11 โข Pydantic โข Mangum (Lambda)
AI/ML: AWS Bedrock (Claude 3.5 Sonnet) โข Titan Embeddings v2
Database: Neon (Serverless PostgreSQL) โข Pinecone (Serverless Vector Store)
Infrastructure: AWS Amplify โข EC2 โข Redis โข S3
Advanced search combining SQL metadata filtering (category, pricing, popularity) with vector similarity ranking. SQL filters narrow the dataset, then vector search ranks by semantic relevance.
Context-aware AI assistant using AWS Bedrock Claude 3.5 Sonnet that understands developer intent and provides personalized resource recommendations with code examples.
Automated data pipeline ingesting from:
- GitHub: 654+ repositories and developer tools
- HuggingFace: 1,100+ ML models and datasets
- Kaggle: 40+ structured datasets
- OpenRouter: 346+ LLM models with pricing
Custom ranking algorithm normalizing scores across different platforms using composite metrics: relevance, popularity, optimization, and freshness with unified rank_score computation.
Native support for English, Hindi, and Hinglish queries with intelligent language detection and culturally-aware response matching for India's 5M+ developers.
Serverless-First Approach with hybrid deployment strategy:
graph TB
A[Next.js 16 Frontend<br/>AWS Amplify] --> B[FastAPI Gateway<br/>EC2 + Gunicorn]
B --> C[Neon PostgreSQL<br/>Serverless Metadata]
B --> D[Pinecone Vector DB<br/>Serverless Search]
B --> E[AWS Bedrock<br/>Claude 3.5 + Titan]
B --> F[Redis Cache<br/>ElastiCache]
G[Ingestion Pipeline<br/>Python Orchestrator] --> C
G --> D
G --> E
Key Design Decisions:
- Frontend: Amplify for global CDN and auto-scaling
- Backend: EC2 for cost optimization with reserved instances
- Database: Neon for serverless PostgreSQL with connection pooling
- Vector Store: Pinecone for sub-100ms semantic search
- AI: Bedrock for enterprise-grade LLM access
- Cache: Redis for distributed locks and embedding cache
dev-store-ai-bharat/
โโโ backend/ # FastAPI backend
โ โโโ main.py # Application entry point
โ โโโ api_gateway.py # EC2 deployment gateway
โ โโโ config.py # Configuration management
โ โโโ clients/ # AWS Bedrock & Database clients
โ โโโ routers/ # API route handlers
โ โ โโโ search.py # Dual-layer search endpoint
โ โ โโโ rag.py # RAG chat assistant
โ โ โโโ resources.py # Resource management
โ โ โโโ auth.py # Authentication
โ โโโ services/ # Business logic
โ โ โโโ search.py # Search orchestration
โ โ โโโ embeddings.py # Vector operations
โ โ โโโ ranking.py # Score normalization
โ โโโ models/ # Pydantic data models
โ โโโ ingestion/ # Multi-source pipeline
โ โ โโโ orchestrator_production.py # Main pipeline
โ โ โโโ fetchers/ # Source-specific harvesters
โ โ โโโ services/ # Chunking, embedding, ranking
โ โ โโโ stages/ # Atomic pipeline stages
โ โ โโโ INGESTION_GUIDE.md # Pipeline documentation
โ โโโ migrations/ # Database schema
โ โโโ tests/ # Test suite
โโโ frontend/ # Next.js 16 frontend
โ โโโ app/ # App Router pages
โ โโโ components/ # React components
โ โ โโโ DevStoreDashboard.jsx # Main dashboard
โ โโโ lib/ # API client utilities
โ โโโ auth.ts # NextAuth configuration
โโโ docs/ # Documentation
โโโ .kiro/specs/ # Feature specifications
git clone https://github.com/your-org/dev-store-ai-bharat.git
cd dev-store-ai-bharat# Backend
cp backend/.env.example backend/.env
# Frontend
cp frontend/.env.local.example frontend/.env.local
# Configure your API keys (see .env files for details)# Terminal 1 - Backend
cd backend && pip install -r requirements.txt
uvicorn main:app --reload --port 8000
# Terminal 2 - Frontend
cd frontend && npm install && npm run dev
# Or use the convenience script
./start_all.sh๐ Access: Frontend at http://localhost:3000 โข API docs at http://localhost:8000/docs
- Frontend: AWS Amplify with global CDN (configured via
amplify.yml) - Backend: EC2 with Application Load Balancer (see
backend/deploy.sh) - Database: Neon PostgreSQL with connection pooling
- Monitoring: Custom health checks and systemd services
# Frontend (Amplify auto-deploys on push)
git push origin main
# Backend (EC2 deployment)
cd backend && ./deploy.sh- Search Latency: <200ms average response time
- Vector Search: Sub-100ms with Pinecone serverless optimization
- Pipeline Throughput: 10-15 resources/sec (Bedrock embedding limited)
- Full Sync: 3-5 minutes for 2,500+ resources
- Scale: Optimized for 100K+ resource tier
| Endpoint | Method | Description |
|---|---|---|
/api/v1/search |
POST | Dual-layer semantic search (SQL + Vector) |
/api/v1/rag/chat |
POST | RAG-powered AI assistant |
/api/v1/resources |
GET | Resource listing with filters |
/api/v1/resources/{id} |
GET | Resource details with metadata |
/api/v1/health |
GET | System health and metrics |
Run the automated multi-source ingestion:
cd backend
# Production pipeline (requires AWS credentials)
python ingestion/run_production.py
# Development pipeline (JSON output only)
python ingestion/run_ingestion.pyPipeline Stages: Fetch โ Normalize โ Deduplicate โ Upsert (Neon) โ Embed (Bedrock) โ Upsert (Pinecone) โ Rank โ Cache
See backend/ingestion/INGESTION_GUIDE.md for detailed documentation.
Team Dev-Store-AI-Bharat:
- Mohd Arsh - AI/ML Engineering (RAG, Embeddings, Multilingual)
- Raunak - Data Engineering (Pipelines, Infrastructure, Monitoring)
- Vansh - Frontend Engineering (UI/UX, Performance, Accessibility)
- Aryan - Backend Engineering (APIs, DevOps, Architecture)
- ๐ง Backend Setup Guide
- ๐ค RAG System Documentation
- ๐ Ranking Algorithm Details
- ๐ Ingestion Pipeline Guide
- ๐ EC2 Deployment Guide
Apache License 2.0 - Built with โค๏ธ for the Indian developer community