Skip to content

Latest commit

 

History

History
47 lines (38 loc) · 981 Bytes

mlsd-template.md

File metadata and controls

47 lines (38 loc) · 981 Bytes

The 9 Step ML System Design Formula Template

  1. Problem Formulation

    • Clarifying questions
    • Use case(s) and business goal
    • Requirements
    • Constraints
    • Data: sources and availability
    • Assumptions
    • ML formulation

  2. Metrics

    • Offline metrics
    • Online metrics

  3. Architectural Components

    • High level architecture

  4. Data Collection and Preparation

    • Data needs
    • Data Sources
    • Data storage
    • ML Data types
    • Labelling

  5. Feature Engineering

    • Feature selection
    • Feature representation
    • Feature preprocessing

  6. Model Development and Offline Evaluation

    • Model selection
    • Dataset construction
    • Model Training
    • Model eval and HP tuning
    • Iterations

  7. Prediction Service

  8. Online Testing and Deployment

    • A/B Test
    • Deployment and release

  9. Scaling, Monitoring, and Updates

    • Scaling (SW and ML systems)
    • Monitoring
    • Updates