fsspec-python

Native python integration for fsspec backends

Overview

This library wraps an fsspec filesystem so that files and folders inside it can be imported in Python.

from fsspec import open

open(f"python::s3://my-python-bucket")

import my_bucket_lib  # s3://my-python-bucket/my_bucket_lib.py

Usage

In addition to the python:: chained protocol url, this library exposes a handful of functions and monkey patches for connecting Python internal mechanisms to an fsspec-based filesystem.

• install_importer: install an
• install_importer(fs: Union[str, AbstractFileSystem], **kwargs): install an fsspec url/args or filesystem instance as an importer
• uninstall_importer(fs: Union[str, AbstractFileSystem] = ""): uninstall an fsspec url or filesystem instance, or if nothing provided remove the last-installed one
• install_open_hook(fsspec: str, **fsspec_args): monkeypatch Python's open builtin to run off an fsspec filesystem
• uninstall_open_hook(): remove the monkeypatched open

Coming soon:

• Monkey patching for os / os.path / pathlib

Note

This library was generated using copier from the Base Python Project Template repository.