Fully managed, safe, extremely fast .NET library to 📖read and ✍️write Apache Parquet files designed for .NET world (not a wrapper). Targets .NET 8
, .NET 7
, .NET 6.0
, .NET Core 3.1
, .NET Standard 2.1
and .NET Standard 2.0
.
Whether you want to build apps for Linux, MacOS, Windows, iOS, Android, Tizen, Xbox, PS4, Raspberry Pi, Samsung TVs or much more, Parquet.Net has you covered.
- 0️⃣ Has zero dependencies - pure library that just works anywhere .NET works i.e. desktops, servers, phones, watches and so on.
- 🚀Really fast. Faster than Python and Java, and alternative C# implementations out there. It's often even faster than native C++ implementations.
- 🏠NET native. Designed to utilise .NET and made for .NET developers, not the other way around.
- ❤️🩹Not a "wrapper" that forces you to fit in. It's the other way around - forces parquet to fit into .NET.
- 🦄Unique Features:
- The only library that supports dynamic schemas.
- Supports all parquet types, encodings and compressions.
- Fully supports C# class serialization, for all simple and complex Parquet types.
- Provides low-level, high-level, and untyped API.
- Access to file and column metadata.
- Integration with DataFrames (
Microsoft.Data.Analysis
).
This repository now includes an implementation of parquet desktop viewer application called Floor (parquet floor, get it?). It's cross-platform, self-contained executable made with Avalonia, and is compiled for Linux, Windows and MacOS.
Floor is not meant to be the best parquet viewer on the planet, but just a reference implementation. There are probably better, more feature-rich applications out there.
Download it from the releases section. On Windows, you can install it with winget - winget install aloneguid.ParquetDotnet.floor
.
- Azure Cosmos DB Desktop Data Migration Tool.
- RavenDB - An ACID NoSQL Document Database.
- Cinchoo ETL: An ETL framework for .NET.
- ParquetViewer: Simple Windows desktop application for viewing & querying Apache Parquet files.
- ML.NET: Machine Learning for .NET.
- PSParquet: PowerShell Module for Parquet.
- Omni Loader: Self-tuning Database Migration Accelerator.
- Contoso Data Generator V2 : sample data generator.
- Recfuence - An analysis of YouTube's political influence through recommendations.
- Kusto-loco - C# KQL query engine with flexible I/O layers and visualization.
...raise a PR to appear here...
See the contribution page. The first important thing you can do is simply star ⭐ this project.