Skip to content

This repo provides an interactive A/B dashboard built with Streamlit. It allows you to simulate or use real A/B testing data, perform statistical analysis (Frequentist and Bayesian), and visualize conversion rates and other business metrics over time. It aims to help to make data-driven decisions on which model (or variant) performs best.

Notifications You must be signed in to change notification settings

sivkri/interactive-ab-testing

Repository files navigation

Interactive A/B Testing Dashboard

This repository contains a Streamlit web application for performing A/B testing analysis using both Frequentist and Bayesian (Monte Carlo-based) methods. It supports simulated and predefined test datasets and provides statistical metrics, visualizations, and multi-metric comparisons.

Features

  • Simulate or load A/B test data
  • Frequentist Z-Test analysis
  • Bayesian-style posterior comparison using Monte Carlo (Beta distribution)
  • Conversion rate visualizations over time
  • Multi-metric evaluation (revenue, session time)
  • Streamlit interactive interface

Setup Instructions

Run locally with Python

  1. Clone the repository:
    git clone https://github.com/sivkri/interactive-ab-testing.git
    
    cd interactive-ab-testing

About

This repo provides an interactive A/B dashboard built with Streamlit. It allows you to simulate or use real A/B testing data, perform statistical analysis (Frequentist and Bayesian), and visualize conversion rates and other business metrics over time. It aims to help to make data-driven decisions on which model (or variant) performs best.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published