Welcome to smap_io
contributor's guide.
This document focuses on getting any potential contributor familiarized with the development processes, but other kinds of contributions are also appreciated.
If you are new to using git or have never collaborated in a project previously, please have a look at contribution-guide.org. Other resources are also listed in the excellent guide created by FreeCodeCamp [1].
Please notice, all users and contributors are expected to be open, considerate, reasonable, and respectful. When in doubt, Python Software Foundation's Code of Conduct is a good reference in terms of behavior guidelines.
If you experience bugs or general issues with smap_io
, please have a look
on the issue tracker. If you don't see anything useful there, please feel
free to fire an issue report.
Tip
Please don't forget to include the closed issues in your search. Sometimes a solution was already reported, and the problem is considered solved.
New issue reports should include information about your programming environment (e.g., operating system, Python version) and steps to reproduce the problem. Please try also to simplify the reproduction steps to a very minimal example that still illustrates the problem you are facing. By removing other factors, you help us to identify the root cause of the issue.
You can help improve smap_io
docs by making them more readable and coherent, or
by adding missing information and correcting mistakes.
smap_io
documentation uses Sphinx as its main documentation compiler.
This means that the docs are kept in the same repository as the project code, and
that any documentation update is done in the same way was a code contribution.
.. todo:: Don't forget to mention which markup language you are using. e.g., reStructuredText_ or CommonMark_ with MyST_ extensions.
.. todo:: If your project is hosted on GitHub, you can also mention the following tip: .. tip:: Please notice that the `GitHub web interface`_ provides a quick way of propose changes in ``smap_io``'s files. While this mechanism can be tricky for normal code contributions, it works perfectly fine for contributing to the docs, and can be quite handy. If you are interested in trying this method out, please navigate to the ``docs`` folder in the source repository_, find which file you would like to propose changes and click in the little pencil icon at the top, to open `GitHub's code editor`_. Once you finish editing the file, please write a message in the form at the bottom of the page describing which changes have you made and what are the motivations behind them and submit your proposal.
When working on documentation changes in your local machine, you can
compile them using tox
:
tox -e docs
and use Python's built-in web server for a preview in your web browser
(http://localhost:8000
):
python3 -m http.server --directory 'docs/_build/html'
This packages provides easy download access and preprocessing utilities for SMAP data from https://nsidc.org. It consists of 3 modules
- A download interface to programmatically download SMAP netcdf data from https://nsidc.org
- Image readers to extract variables from the downloaded images
- A time series converter to transpose and chunk the downloaded images into files optimised for extracting time series.
Before you work on any non-trivial code contribution it's best to first create a report in the issue tracker to start a discussion on the subject. This often provides additional considerations and avoids unnecessary work.
Before you start coding, we recommend creating an isolated virtual
environment to avoid any problems with your installed Python packages.
This can easily be done via either virtualenv
:
virtualenv <PATH TO VENV> source <PATH TO VENV>/bin/activate
or Miniconda:
conda create -n smap_io python=3 conda env update -f environment.yml -n smap_io conda activate smap_io
Create an user account on smap_io if you do not already have one.
Fork the project repository: click on the Fork button near the top of the page. This creates a copy of the code under your account on smap_io.
If you need test data files, you have to install Git LFS
Clone this copy to your local disk:
git clone git@github.com:YourLogin/smap_io.git cd smap_io
You should run:
pip install -U pip setuptools -e .
to be able to import the package under development in the Python REPL.
Create a branch to hold your changes:
git checkout -b my-feature
and start making changes. Never work on the main branch!
Start your work on this branch. Don't forget to add docstrings to new functions, modules and classes, especially if they are part of public APIs.
Add yourself to the list of contributors in
AUTHORS.rst
.When you’re done editing, do:
git add <MODIFIED FILES> git commit
to record your changes in git.
Important
Don't forget to add unit tests and documentation in case your contribution adds an additional feature and is not just a bugfix.
Moreover, writing a descriptive commit message is highly recommended. In case of doubt, you can check the commit history with:
git log --graph --decorate --pretty=oneline --abbrev-commit --all
to look for recurring communication patterns.
Please check that your changes don't break any unit tests with:
tox
(after having installed
tox
withpip install tox
orpipx
).You can also use
tox
to run several other pre-configured tasks in the repository. Trytox -av
to see a list of the available checks.
To apply pep8 conform styling to any changed files we use yapf. The correct settings are already set in setup.cfg. Therefore the following command should be enough:
yapf file.py --in-place
If everything works fine, push your local branch to smap_io with:
git push -u origin my-feature
Go to the web page of your fork and click "Create pull request" to send your changes for review.
The following tips can be used when facing problems to build or test the package:
Make sure to fetch all the tags from the upstream repository. The command
git describe --abbrev=0 --tags
should return the version you are expecting. If you are trying to run CI scripts in a fork repository, make sure to push all the tags. You can also try to remove all the egg files or the complete egg folder, i.e.,.eggs
, as well as the*.egg-info
folders in thesrc
folder or potentially in the root of your project.Sometimes
tox
misses out when new dependencies are added, especially tosetup.cfg
anddocs/requirements.txt
. If you find any problems with missing dependencies when running a command withtox
, try to recreate thetox
environment using the-r
flag. For example, instead of:tox -e docs
Try running:
tox -r -e docs
Make sure to have a reliable
tox
installation that uses the correct Python version (e.g., 3.7+). When in doubt you can run:tox --version # OR which tox
If you have trouble and are seeing weird errors upon running
tox
, you can also try to create a dedicated virtual environment with atox
binary freshly installed. For example:virtualenv .venv source .venv/bin/activate .venv/bin/pip install tox .venv/bin/tox -e all
Pytest can drop you in an interactive session in the case an error occurs. In order to do that you need to pass a
--pdb
option (for example by runningtox -- -k <NAME OF THE FALLING TEST> --pdb
). You can also setup breakpoints manually instead of using the--pdb
option.
To release a new version of this package, make sure all tests are passing on the master branch and the CHANGELOG.rst is up-to-date, with changes for the new version at the top.
Then draft a new release on GitHub. Create a version tag following the
v{MAJOR}.{MINOR}.{PATCH}
pattern.
This will trigger a new build on GitHub and should push the packages
to pypi after all tests have passed.
If this does not work (tests pass but upload fails) you can download the whl and dist packages for each workflow run from https://github.com/TUW-GEO/smap_io/actions (Artifacts) and push them manually to https://pypi.org/project/pytesmo/ e.g. using twine (you need to be a package maintainer on pypi for that).
[1] | Even though, these resources focus on open source projects and communities, the general ideas behind collaborating with other developers to collectively create software are general and can be applied to all sorts of environments, including private companies and proprietary code bases. |