Description
The following is what exactly we want Pipcook v1 looks like:
We will introduce a new and unified layer for end-user that's so-called "Pipcook ML App", its goal is to simplify the developing machine learning applications, for more details you can go #33.
Now Pipcook is to be runtime for building ML applications, rather than a Node.js library. So we also make original pipcook-core to be a Daemon Process, it's used to operate plugins, and manage Pipelines via a new declarative language Pipeline IR.
To make sure what every plugin could run in more safety and powerful, Pipcook v1 is also to add the Plugin Runtime, which should be a standalone process/thread (via configuration), and there are the followings for plugin developers:
- ML API: it's the low-level machine learning APIs.
- Builtin Tensorflow.js library.
- Python APIs via Node.js lets you call other Python functions in JavaScript seamlessly.
Okay, let's see what the detailed v1 milestone tasks will be:
- CI/CD workflow.
- pull request workflow.
- GitHub Actions.
- unit testing framework.
- Solid documentation.
- refactoring documentation build scripts docs: refactor the directory, add typedoc and hosted on ghpages #39.
- tutorials includes: ML App, Pipeline and Plugin.
- typedoc includes: ML App APIs and Plugin APIs.
- Experiment ML App
- definition of APIs and usage PipApp: the application framework for machine learning #33.
- pipelines generator for training/serving.
-
Pipboard supports running ML App. -
Pipboard supports preparing the dataset/samples.
- Stable Pipeline.
- decoupling the plugins at different stage.
- using a static DSL to represent a pipeline, and it's also the IR for the high-level ML App layer.
- refactoring for Pipcook daemon architecture for deploying online service.
- HTTP APIs.
- using HTTP APIs at CLI.
- preparing the v1 builtin plugins list and complete them.
- Stable Plugin APIs, how to valid a plugin works.
- plugin specification.
- plugin runtime.
- provide the ml-base APIs.
- provide the bridge(boa) to Python's library.
- Pipboard: a Web application for using Pipcook:
-
Pipboard Extension. - interactive GUI to CRUD pipelines.
-
plugin discovery and configuration. - ability to run pipeline.
-
ability to run ML App.
-