Merge develop to release-0.4 branch #2830

sneaxiy · 2020-08-14T09:28:58Z

No description provided.

…ine-learning#2778) * change optflow api * polish * add more ut

* test alps submitter * add alps codegen * update

* support download model to local in cli * update * update * update

* Add query to db.py * change delete with truncate

…ine-learning#2786) * Make the attribute check for XGBoost model compatible with reg:linear * set EnableWindowFunc to true by default for TiDB parser.

* add optimization guide doc * polish according to comments

* WIP generate workflow using runtime * wip update * update * update * fix hive ci

* Add query to db.py * change delete with truncate * DB interface base class

* fix develop jupyter image build * update

…ng#2791) * WIP generate workflow step code using runtime fea der * tested local * update * update * update * fix tests

* Add query to db.py * change delete with truncate * DB interface base class * Add MySQL db-api implementation * remove unused import

* test ci * test again * update * update and fix * fix travis ci env

* Add query to db.py * change delete with truncate * DB interface base class * Add MySQL db-api implementation * remove unused import * polish mysql db-api * Add hive DB-API * modify doc * format code

…g#2794) * add json dump load support * update vocabulary type * update * update * update

* Add maxcompute DB-API * remove unused import * format code

* push images on self hosted machine * update * update * update * update * test install.sh * fix go mirrors * clean up * add clean up * update clean up script

…he executable or script program (sql-machine-learning#2804) * Make the attribute check for XGBoost model compatible with reg:linear * Derive the absolute path of the runnable program if users just input a file name. * Use python -m command to invoke the TO RUN statement in default submitter. * Move getRunnableProgramAbsPath to alisa.go

…l-machine-learning#2808) * Add maxcompute DB-API * remove unused import * format code * polish db-api

* wip * fix yaml generate * fix tests * fix package deps * fix pip package deps * update

* move and refine metadata * fix ci ut * fix ut * follow lhw comment

* Add maxcompute DB-API * remove unused import * format code * polish db-api * Adapt paiio with DB-API * Adapt paiio with DB-API * add try import paiio * fix typo

* install baron solver in Docker image * polish * add pyomo baron into step docker image

…ing#2815) * polish db-api to support Python2 so can run on PAI * enable unittest for hive db-api

* add experimental workflow end2end test * fix workflow ci env * update test code * pull latest step before running workflow

) * add save_to_oss/load_from_oss * change pickle protocol * add more explanations on oss_model_dir doc * fix ut

* fix relative importing cause error * clean up

* Add maxcompute DB-API * remove unused import * format code * polish db-api * Adapt paiio with DB-API * Adapt paiio with DB-API * add try import paiio * use db-api in old code * DB-API support Python2 so can run on PAI * polish db-api to support Python2 so can run on PAI * polish db-api to support Python2 so can run on PAI * polish db-api to support Python2 so can run on PAI * Use unified DB-API in codebase. * Use unified DB-API in codebase. * polish code * remove debug info * fix ut

…#2824) * generate workflow step for normal statement run * clean up * build step image before run workflow test * fix is_query

* fix pai training with optimizer config * remove template

* save trained xgboost model * fix flake8 check * fix ut * fix ut * fix workflow ut * fix cwd error

sneaxiy and others added 30 commits July 31, 2020 15:49

Update OptFlow FSL generation code when len(variables) == 2 (sql-mach…

c7217ee

…ine-learning#2778) * change optflow api * polish * add more ut

alps submitter and codegen (sql-machine-learning#2771)

66f606e

* test alps submitter * add alps codegen * update

Support download model to local in cli (sql-machine-learning#2779)

0963268

* support download model to local in cli * update * update * update

Add query api to db.py (sql-machine-learning#2782)

79029d8

* Add query to db.py * change delete with truncate

Set EnableWindowFunc to be true by default for TiDB parser. (sql-mach…

d4f9617

…ine-learning#2786) * Make the attribute check for XGBoost model compatible with reg:linear * set EnableWindowFunc to true by default for TiDB parser.

fix Tensorflow -> TensorFlow (sql-machine-learning#2783)

962de9c

Add optimization guide doc (sql-machine-learning#2785)

a28f009

* add optimization guide doc * polish according to comments

Generate workflow using runtime (sql-machine-learning#2784)

388172a

* WIP generate workflow using runtime * wip update * update * update * fix hive ci

DB api base class (sql-machine-learning#2787)

89dfa1a

* Add query to db.py * change delete with truncate * DB interface base class

add to_dict and from_dict method (sql-machine-learning#2792)

1e10b8a

Fix develop jupyter image build (sql-machine-learning#2790)

44b964a

* fix develop jupyter image build * update

Generate workflow step code using runtime fea der (sql-machine-learni…

c015114

…ng#2791) * WIP generate workflow step code using runtime fea der * tested local * update * update * update * fix tests

Add MySQL db-api implementation (sql-machine-learning#2793)

a3d566b

* Add query to db.py * change delete with truncate * DB interface base class * Add MySQL db-api implementation * remove unused import

fix actions maxcompute test not running (sql-machine-learning#2795)

f0ec9e8

Enable flake8 check on CI (sql-machine-learning#2788)

2443661

* test ci * test again * update * update and fix * fix travis ci env

generate python feacol code (sql-machine-learning#2797)

ccea266

Add hive DB-API (sql-machine-learning#2798)

3d90abe

* Add query to db.py * change delete with truncate * DB interface base class * Add MySQL db-api implementation * remove unused import * polish mysql db-api * Add hive DB-API * modify doc * format code

modify cora dataset to adapt csv format (sql-machine-learning#2780)

ae288e3

Add json dump and load support for FeatureColumn (sql-machine-learnin…

ee93f21

…g#2794) * add json dump load support * update vocabulary type * update * update * update

Add maxcompute DB-API (sql-machine-learning#2801)

fe9da69

* Add maxcompute DB-API * remove unused import * format code

Push images on self hosted machine (sql-machine-learning#2799)

29d8df5

* push images on self hosted machine * update * update * update * update * test install.sh * fix go mirrors * clean up * add clean up * update clean up script

fix pai xgboost package deps (sql-machine-learning#2803)

13d9821

Polish DB-API code, export unified connect function from package. (sq…

feade33

…l-machine-learning#2808) * Add maxcompute DB-API * remove unused import * format code * polish db-api

add solved y to optimize (sql-machine-learning#2810)

28cace1

Generate couler code of workflow steps (sql-machine-learning#2806)

b167375

* wip * fix yaml generate * fix tests * fix package deps * fix pip package deps * update

Refine metadata collect and save/load (sql-machine-learning#2807)

9d0af16

* move and refine metadata * fix ci ut * fix ut * follow lhw comment

Adapt paiio with DB-API (sql-machine-learning#2809)

5fdff8e

* Add maxcompute DB-API * remove unused import * format code * polish db-api * Adapt paiio with DB-API * Adapt paiio with DB-API * add try import paiio * fix typo

disable actions maxcompute test (sql-machine-learning#2814)

22fb5d4

make constraint optional (sql-machine-learning#2812)

2099ba2

sneaxiy and others added 11 commits August 12, 2020 16:27

fix typo (sql-machine-learning#2820)

564de6a

Install BARON solver in Docker image (sql-machine-learning#2811)

31a2f08

* install baron solver in Docker image * polish * add pyomo baron into step docker image

Polish DB-API to support Python2 so can run on PAI (sql-machine-learn…

7426cf0

…ing#2815) * polish db-api to support Python2 so can run on PAI * enable unittest for hive db-api

switch to github actions (sql-machine-learning#2818)

ed8bce9

Add experimental workflow end2end test (sql-machine-learning#2813)

4d46f6e

* add experimental workflow end2end test * fix workflow ci env * update test code * pull latest step before running workflow

Add Model.save_to_oss and Model.load_from_oss (sql-machine-learning#2817

b67d233

) * add save_to_oss/load_from_oss * change pickle protocol * add more explanations on oss_model_dir doc * fix ut

Fix relative importing cause error (sql-machine-learning#2823)

6556299

* fix relative importing cause error * clean up

Generate workflow step for normal statement run (sql-machine-learning…

6974de2

…#2824) * generate workflow step for normal statement run * clean up * build step image before run workflow test * fix is_query

Fix pai training with optimizer config (sql-machine-learning#2828)

a2871a3

* fix pai training with optimizer config * remove template

Save the trained xgboost model (sql-machine-learning#2822)

927173c

* save trained xgboost model * fix flake8 check * fix ut * fix ut * fix workflow ut * fix cwd error

sneaxiy requested a review from typhoonzero August 14, 2020 09:29

typhoonzero approved these changes Aug 14, 2020

View reviewed changes

sneaxiy merged commit b5888cc into sql-machine-learning:release-0.4 Aug 14, 2020

sneaxiy deleted the release-0.4.1 branch August 14, 2020 10:05

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Merge develop to release-0.4 branch #2830

Merge develop to release-0.4 branch #2830

Uh oh!

sneaxiy commented Aug 14, 2020

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Merge develop to release-0.4 branch #2830

Merge develop to release-0.4 branch #2830

Uh oh!

Conversation

sneaxiy commented Aug 14, 2020

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants