From b8c30255efe71c06d6504a140ad3066a5826c7ee Mon Sep 17 00:00:00 2001 From: Andreas Motl Date: Sun, 22 Sep 2024 12:01:46 +0200 Subject: [PATCH] Chore: Update backlog --- doc/backlog.md | 20 ++++++++++++++++++++ 1 file changed, 20 insertions(+) diff --git a/doc/backlog.md b/doc/backlog.md index 1a25a5d9..026fb76a 100644 --- a/doc/backlog.md +++ b/doc/backlog.md @@ -1,5 +1,25 @@ # Backlog +## Iteration +1 +- Table Loader: Refactor URL dispatcher, use fsspec +- Table Loader/Docs: Advertise using OCI image +- MongoDB: Load table with querying by single object id +- MongoDB: Multi-phase BulkProcessor batch size adjustments +- MongoDB: Report byte sizes (cur/avg/total) in progress bar +- Documentation: + > The procedure employed by CTK uses the catch-all `data OBJECT(DYNAMIC)` + > storage strategy, which is sinking the source record/document into a + > single column in CrateDB. + > + > The transformation recipe attempts to outline a few features provided by + > Zyp Transformations, in this case exclusively applying transformations + > described by expressions written in jqlang. +- MongoDB/Docs: Describe usage of `mongoimport` and `mongoexport`. + ```shell + mongoimport --uri 'mongodb+srv://MYUSERNAME:SECRETPASSWORD@mycluster-ABCDE.azure.mongodb.net/test?retryWrites=true&w=majority' + ``` +- MongoDB: Convert dates like `"date": "Sep 18 2015"`, see `testdrive.city_inspections`. + ## Iteration +2 - Address `fix_job_info_table_name` - Add more items about `ctk load table` to `examples/` folder