Skip to content
236 changes: 201 additions & 35 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,67 +1,168 @@
# Polywrap python client
![Public Release Announcement](https://user-images.githubusercontent.com/5522128/177473887-2689cf25-7937-4620-8ca5-17620729a65d.png)

[Polywrap](https://polywrap.io/#/) is a developer tool that enables easy integration of Web3 protocols into any application. It makes it possible for applications on any platform, written in any language, to read and write data to Web3 protocols.
# Polywrap Python Client

## Setup for building and testing
- Requirement: Python ^3.10, Poetry ^1.1.14
- If you are using a linux system or WSL, which comes with Python3.8, then you will need to upgrade Python3.8 to Python3.10 and also fix the pip and distutil as upgrading to Python3.10 will break them. You may follow [this guide](https://cloudbytes.dev/snippets/upgrade-python-to-latest-version-on-ubuntu-linux) to upgrade.
- To install poetry follow [this guide](https://python-poetry.org/docs/#installation). If you are on macos then you can install poetry simply with the following homebrew command
[Polywrap](https://polywrap.io) is a developer tool that enables easy integration of Web3 protocols into any application. It makes it possible for applications on any platform, written in any language, to read and write data to Web3 protocols.


# Working Features

This MVP Python client enables the execution of **[WebAssembly](https://en.wikipedia.org/wiki/WebAssembly) Polywrappers** *(or just "wrappers")* on a python environment, regardless of what language this wrapper was built in.

The client is built following the functionality of the [JavaScript Polywrap Client](https://github.com/polywrap/toolchain), which is currently more robust and battle tested, as it has additional capabilities than this MVP. In the future, the Polywrap DAO will continue improving this Python capabilities to reach feature parity with the JS stack, while building in parallel clients for other languages like Go and Rust.

[Here](https://github.com/polywrap/client-test-harness) you can see which features have been implemented on each language, and make the decision of which one to use for your project.


# Getting Started:

Have questions or want to get involved? Join our community [Discord](https://discord.polywrap.io) or [open an issue](https://github.com/polywrap/toolchain/issues) on Github.

For detailed information about Polywrap and the WRAP standard, visit our [developer documentation](https://docs.polywrap.io/).

## Pre-requisites

### Clone the repo.
```
brew install poetry
git clone https://github.com/polywrap/python-client
```
- Clone the repo.

### `python ˆ3.10`
- Make sure you're running the correct version of python by running:
```
git clone https://github.com/polywrap/python-client
python3 --version
```
- We will be using [Poetry](https://python-poetry.org) for building and testing our packages.
> If you are using a Linux system or WSL, which comes with Python3.8, then you will need to upgrade from Python3.8 to Python3.10 and also fix the `pip` and `distutil` as upgrading to Python3.10 will break them. You may follow [this guide](https://cloudbytes.dev/snippets/upgrade-python-to-latest-version-on-ubuntu-linux) to upgrade.

### `poetry ^1.1.14`
- To install poetry follow [this guide](https://python-poetry.org/docs/#installation).
- If you are on MacOS then you can install poetry simply with the following homebrew command
```
brew install poetry
```
> To make sure you're it's installed properly, run `poetry`. Learn more [here](https://python-poetry.org/docs/)



# Building and Testing

- Each of the package folders consists the pyproject.toml file and the poetry.lock file. In pyproject.toml file, one can find out all the project dependencies and configs related to the package. These files will be utilized by Poetry to install correct dependencies, build, lint and test the package.
## Poetry

- For example, we can install deps, build and test the polywrap-msgpack package using Poetry.
- We will be using [Poetry](https://python-poetry.org) for building and testing our packages.
Each of the package folders consists of the `pyproject.toml` file and the `poetry.lock` file. In `pyproject.toml` file, one can find out all the project dependencies and configs related to the package. These files will be utilized by Poetry to install correct dependencies, build, lint and test the package.

- For example, we can **install** deps, **build** and **test** the `polywrap-msgpack` package using Poetry.

- Install dependencies using Poetry.
```
poetry install
```
> Make sure your cwd is `polywrap-msgpack` package.
- As we can see in the pyproject.toml file, we installed [PyTest](https://docs.pytest.org) package. We will be using the same as our testing framework.
- Now we are ready to build and test the core package using Poetry and PyTest.
- To build the package run the following command
> Make sure your cwd is the appropriate module, for example `polywrap-msgpack`, `polywrap-wasm` or `polywrap-client`.

## Pytest

In order to assure the integrity of the modules Polywrap Python Client uses [pytest 7.1.3](https://docs.pytest.org/en/7.1.x/contents.html) as a testing framework.

- As we can see in the `pyproject.toml` files, we installed the [PyTest](https://docs.pytest.org) package. We will be using it as our testing framework.
- Now we are ready to **build** and **test** the core package using Poetry and PyTest.

To build the package run the following command
```
poetry build
```
- You need to activate the venv with poetry using `poetry shell` command before running any other command
- We are using tox to run lint and tests easily. You can list all the testenv defined in the
tox config with following command

You need to activate the venv with poetry using the `shell` command before running any other command
```
poetry shell
```

Finally, to test your module to execute the test suite:
```
poetry run pytest
```


This last command will run a series of scripts that verify that the specific module of the client is performing as expected in your local machine. The output on your console should look something like this:

```
$ poetry run pytest
>>
================================= test session starts =================================
platform darwin -- Python 3.10.0, pytest-7.1.3, pluggy-1.0.0
rootdir: /Users/polywrap/pycode/polywrap/toolchain/packages/py, configfile: pytest.ini
collected 26 items

tests/test_msgpack.py ........................ [100%]
```

### Debugging with Pytest:

You should expect to see the tests passing with a 100% accuracy. To better understand these outputs, read [this quick guide](https://docs.pytest.org/en/7.1.x/how-to/output.html). If any of the functionality fails (marked with an 'F'), or if there are any Warnings raised, you can debug them by running a verbose version of the test suite:
- `poetry run pytests -v` or `poetry run pytests -vv` for even more detail
- Reach out to the devs on the [Discord](https://discord.polywrap.io) explaining your situation, and what configuration you're using on your machine.


## TOX
We are using [`tox`](https://tox.wiki/en) to run lint and tests even more easily. Below are some basic commands to get you running.

### List all the testenv defined in the tox config
```
tox -a
```
- To run tests using tox simply run `tox`
- You can run linters with the `tox -e lint` and check type with `tox -e typecheck`. By running `tox -e secure`, you can find security vulnerability if any.
- While developing, you can run `tox -e dev` and apply lint fixes and style formatting.
- As we see the mentioned tests passing, we are ready to update and test the package.
### Run tests
```
tox
```
### Linting
```
tox -e lint
```
### Check types
```
tox -e typecheck
```

## For VSCode users
If you use VSCode, open this setup using the workspace file python-monorepo.code-workspace:
### Find security vulnerabilities, if any
```
tox -e secure
```

### Dev environment
Use this command to only apply lint fixes and style formatting.
```
File -> Open Workspace from File...
tox -e dev
```

Each folder is now a project to VSCode. For the Python virtual environments to be picked up automatically, you need to create .vscode/settings.json file in each folder, pointing to the in-project virtual environment created by the poetry.
- After running these commands we should see all the tests passing and commands executing successfully, which means that we are ready to update and test the package.
- To create your own tox scripts, modify the `tox.ini` file in the respective module.

## VSCode users: Improved dev experience
If you use VSCode, we have prepared a pre-configured workspace that improves your dev experience. So when you open VScode, set up the workspace file `python-monorepo.code-workspace` by going to:

You can easily find the correct virtual env by running following command in the package for which you want to find it
```
poetry shell
File -> Open Workspace from File...
```
![File -> Open Workspace from File](misc/VScode_OpenWorkspaceFromFile.png)

Each folder is now a project to VSCode. This action does not change the underlying code, but facilitates the development process. So our file directory should look like this now:

![all modules have their respective folder, along with a root folder](misc/VScode_workspace.png)

Once you get the virtual env, you need to create the following `settings.json` file under the .vscode folder of the given package.
Ex: in case of polywrap-client package, it would be under:
> Note: You might have to do this step again next time you close and open VS code!

### Picking up the virtual environments automatically
We will need to create a `.vscode/settings.json` file in each module's folder, pointing to the in-project virtual environment created by the poetry.

- You can easily find the path to the virtual env by running following command in the package for which you want to find it for:
```
polywrap-client -> .vscode -> settings.json
poetry shell
```

Here's the `settings.json` file we are using for configuring the vscode:
- Once you get the path virtual env, you need to create the following `settings.json` file under the `.vscode/` folder of the given package. For example, in case of `polywrap-client` package, it would be under
`./polywrap-client/.vscode/settings.json`


Here's the structure `settings.json` file we are using for configuring the vscode. Make sure you update your virtual env path you got from poetry as the `python.defaultInterpreterPath` argument:
```json
{
"python.formatting.provider": "black",
Expand All @@ -70,6 +171,71 @@ Here's the `settings.json` file we are using for configuring the vscode:
"python.defaultInterpreterPath": "/Users/polywrap/Library/Caches/pypoetry/virtualenvs/polywrap-client-abcdef-py3.10"
}
```
You need to put your virtual env path you got from the poetry under: `python.defaultInterpreterPath`

Once you configure this you should be good to go.
Keep in mind that these venv paths will vary for each module you run `poetry shell` on. Once you configure these `setting.json` files correctly on each module you should be good to go!


# What WASM wrappers can you execute today?

Check these resources to browse a variety available wrappers, for DeFi, decentralised storage, and other development utilites:

- [Wrappers.io](https://wrappers.io/)
- [Polywrap Integrations Repository](https://github.com/polywrap/integrations)

# Example call

Calling a function of a wrapper from the python client is as simple as creating a file in the `TODO (?polywrap-client)` directory, importing the `PolywrapClient`, calling the `Uri` where the WASM wrapper is hosted, and specifying any required `arguments`.

Here is an example which takes in a message as a string and returns it.

```python
# hello_world.py
from polywrap_client import PolywrapClient
from polywrap_core import Uri, InvokerOptions

async def echo_message(message: str):

# Instantiate the client
client = PolywrapClient()

# Load the WebAssembly wrapper through a URI that points to local file system
uri = Uri('wrap://ens/rinkeby/helloworld.dev.polywrap.eth')

args = {"arg": message }

# Configure the client
options = InvokerOptions(
uri=uri, method="simpleMethod", args=args, encode_result=False
)

# Invoke the wrapper
result = await client.invoke(options)

return result.result

if __name__ == "__main__":
return echo_message('hello polywrap!')
```


## Creating your own tests for the client

By creating tests you can quickly experiment with the Polywrap Client and its growing set of wrappers. Since Pytest is already set up on the repo, go to the `polywrap-client\tests\` directory, and take a look at how some of the functions are built. You can use similar patterns to mod your own apps and build new prototypes with more complex functionality.

Here's a good guide to learn about [building tests with Pytest](https://realpython.com/pytest-python-testing/)

# Contributing

The Polywrap project is completely open-source and we welcome contributors of all levels. Learn more about how you can contribute [here](https://github.com/polywrap/toolchain#contributing).

# Contact Us:

[Join our discord](https://discord.polywrap.io) and ask your questions right away!


# Resources

- [Polywrap Documentation](https://docs.polywrap.io)
- [Polywrap Integrations Repository](https://github.com/polywrap/integrations)
- [Running operations concurrently with python's asyncio](https://realpython.com/async-io-python/#the-10000-foot-view-of-async-io)
- [Intro Video](TODO)
Binary file added misc/VScode_OpenWorkspaceFromFile.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added misc/VScode_workspace.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.