Skip to content

About

`Cross-platform` `Python` `CSV` `Utility` - Merge multiple CSV files into one mega CSV. Simple, fast, offline. Handles huge files with smart header detection and batch processing.

Topics

Resources

Stars

14 stars

Watchers

0 watching

Forks

Repository files navigation

CSV MERGER

Cross-platform Python CSV Utility - Merge multiple CSV files into one mega CSV. Simple, fast, offline. Handles huge files with smart header detection and batch processing.

Typing SVG


Project Format

Stars Forks Repo Size Last Commit


📊 CSV Merger

License: MIT Python 3.x Platform PRs Welcome Made with ❤️

Merge multiple CSV files into one mega CSV. Simple, fast, offline.

> why_this

Manual Merging CSV Merger
❌ Tedious copy-paste ✅ One click
❌ Duplicate headers ✅ Smart header handling
❌ Error-prone ✅ Automatic validation
❌ Time-consuming ✅ Batch processing
❌ Scattered outputs ✅ Organized vault

> features

  • 🎯 Drag & Drop - Interactive interface (Windows)
  • Batch Processing - Merge 100+ files at once
  • Smart Headers - Automatically keeps one header, skips duplicates
  • Recursive Mode - Find CSVs in subfolders
  • Organized Output - Timestamped folders in merge_vault/
  • Cross-Platform - Windows, Linux, macOS
  • No Dependencies - Just Python 3.x standard library
  • No Size Limits - Handles huge files

> quick_start

Windows (Interactive Mode!)

# 1. Double-click to launch
CSV Merger.bat

# 2. Type or paste folder path - done!

Linux/Mac

chmod +x convert.sh
./convert.sh /path/to/csvs

Python (All Platforms)

# Merge entire folder
python3 csv_merger.py -d ./data -o merged.csv -v

# Merge specific files
python3 csv_merger.py file1.csv file2.csv file3.csv -o merged.csv -v

# Recursive merge (include subfolders)
python3 csv_merger.py -d ./data -o merged.csv --recursive -v

> output

All outputs saved to timestamped folders:

CSV-Merger/
└── merge_vault/
    ├── 20241107_093015/
    │   └── MERGED_ALL.csv
    ├── 20241107_143022/
    │   └── MERGED_ALL.csv
    └── 20241107_201545/
        └── MERGED_ALL.csv

> example

# Before: 50 CSV files scattered everywhere
# After: One clean CSV with all data combined

python3 csv_merger.py -d ~/data/csvs -o mega.csv -v
# Output: merge_vault/20241107_1430/MERGED_ALL.csv

> how_it_works

  1. Scans folder for .csv files
  2. Reads header from first CSV
  3. Writes that header to output file
  4. Iterates through all files, skipping their headers
  5. Appends all data rows to output
  6. Skips empty rows and handles errors gracefully

> use_cases

✅ Combine monthly/weekly CSV reports ✅ Merge data exports from multiple sources ✅ Consolidate database dumps ✅ Aggregate Excel exports ✅ Combine WiGLE/Kismet wardriving data ✅ Merge sensor/IoT data logs ✅ Any CSV files!

> installation

No installation needed! Just requires Python 3.x:

Windows: Download Python Linux: sudo apt install python3 (Ubuntu/Debian) Mac: brew install python3

> documentation

  • START_HERE.txt - Quick start guide with ASCII art
  • HOW_TO_USE.txt - Visual guide for Windows
  • QUICKSTART.md - Platform-specific instructions
  • README.md - This file

> options

python3 csv_merger.py --help

Options:
  -d, --directory     Directory containing CSV files
  -o, --output        Output merged CSV file (required)
  -v, --verbose       Show detailed progress
  --recursive         Include CSVs in subfolders

> requirements

  • Python 3.6 or higher
  • No external dependencies (uses standard library only)

> license

MIT - See LICENSE


Made with ❤️ by ringmast4r


CSV MERGER footer

About

`Cross-platform` `Python` `CSV` `Utility` - Merge multiple CSV files into one mega CSV. Simple, fast, offline. Handles huge files with smart header detection and batch processing.

Topics

Resources

Stars

14 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages