PySparkTemplate (Inside DevContainer)

This repository serves as a foundational template for pyspark projects, equipped with essential tools for maintaining code quality and documentation consistency.

Prerequisites

Make sure you have the following installed:

• Visual Studio Code
• Docker
• Remote - Containers extension for VS Code

Getting Started

1. Clone the Snippets Repository

First, clone the repository containing the code to your local machine:

git clone https://github.com/gvatsal60/PySparkTemplate.git

2. Open the Directory in VSCode:

• Open the current directory in VS Code.
• Press F1 (or Ctrl+Shift+P on Windows/Linux, Cmd+Shift+P on macOS).
• Search for and select "Dev Containers: Reopen in Container".

3. Wait for the Setup:

• VS Code will build the dev container image (if required) and start the container.
• Once completed, you’ll be inside the dev container environment.

4. Start Working:

• Now you can develop in the isolated and pre-configured PySpark container environment.

Contributing

Contributions are welcome! Please read our Contribution Guidelines before submitting pull requests.

License

This project is licensed under the Apache License 2.0 License - see the LICENSE file for details.