Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

code migration from machinelearning-automl to machinelearning repo feature branch #3324

Merged
merged 213 commits into from
Apr 13, 2019
Merged

code migration from machinelearning-automl to machinelearning repo feature branch #3324

merged 213 commits into from
Apr 13, 2019

Conversation

Dmitry-A
Copy link
Contributor

  • Shuffle code to conform to ml.net folder structure
  • Add automl and automl test components to build
  • Fix issues so it builds

Note this does NOT include running tests or publishing nuget packages, that will come in as a separate PR

jongalloway and others added 30 commits January 4, 2019 13:22
@jongalloway
Initial commit
8481317
@Dmitry-A
ci test build
7ba62c4
@Dmitry-A
forgot to save this one file
bf40476
@Dmitry-A
Debug-Intrinsics isn't a valid config, trying windows-x64
233829b
@Dmitry-A
disabled tests for now
d758d72
@Dmitry-A
disable tests attempt 2
1770ff8
@Dmitry-A
initial code push, no history, test project not in the build so is th…
63b3438 
…e internal client
@Dmitry-A
battling with warn as err
1e451c2
@Dmitry-A
test build
ae67a1d
@Dmitry-A
test change
6448213
@Dmitry-A
Merge pull request #1 from dotnet/users/dmitrya/ci-testing2
ef3a6b3 
Users/dmitrya/ci testing2
@daholste
make params for MLContext data extensions match ML.NET default names …
e402e14 
…and values; update gitignore; nit rev for Benchmarking.cs (dotnet#5)
@justinormont
Create README.md (#2)
d65315f
@vinodshanbhag
API folder changes (dotnet#6)
27f5afd
@daholste
comment out fast forest trainer, per discussion on ML.NET open issue d…
f1e7617 
…otnet#1983, for now, to run E2E w/o exceptions (dotnet#7)
@daholste
Make validation data param mandatory; remove GetFirstPipeline sample (d…
3d9eb10 
…otnet#10)

* Make validation data param mandatory; remove GetFirstPipeline sample

* remove deprecated todo
@justinormont
Create ISSUE_TEMPLATE.md & PULL_REQUEST_TEMPLATE.md (dotnet#12)
030e25a 
* Create ISSUE_TEMPLATE.md

* Create PULL_REQUEST_TEMPLATE.md
@vinodshanbhag
NestedObject For pipeline (dotnet#14)
4e58b0b
@daholste
add estimator extensions / catalog; add conversion from external to i…
d47a17d 
…nternal pipeline; transform clean-up; add back in test proj and fix build; refactor trainer ext name mappings (dotnet#15)

* Make validation data param mandatory; remove GetFirstPipeline sample

* remove deprecated todo

* add estimator extensions / catalog; add ability to go from external to internal pipeline; a lot of transform clean-up; add back in test proj and get it building; refactor trainer ext name mappings
@srsaggam @justinormont
corrected the typo in readme (dotnet#16)
181fbe2
@daholste
make GetNextPipeline API w/ public Pipeline method on PipelineSuggest…
23862a1 
…er; write GetNextPipeline API test; fix public Pipeline object serialization; fix header inferencing bug; write test utils for fetching datasets (dotnet#18)
@daholste
get next pipeline API rev -- refactor API to consume column dimension…
ae423a9 
…s, purpose, type, and name instead of available trainers & transforms (dotnet#19)
@daholste
mark get next pipeline test as ignore for now (dotnet#20)
9f49cf1
@daholste
fix dataview take util bug, add dataview skip util, add some UTs to i…
ab6930c 
…ncrease code coverage (dotnet#21)

* fix dataview take util bug, add dataview skip util, add some UTs to increase code coverage

* add accuracy threshold on AutoFit test

* add null check to best pipeline on autofit result
@daholste
unit test additions (including user input validation testing); dead c…
f7e6376 
…ode removal for code coverage (including KDO & associated utils); misc fixes & revs (dotnet#22)
@daholste
add trainer extension tests, & misc fixes (dotnet#23)
3d3567c
@daholste
add estimator extension tests (dotnet#24)
35099ad
@daholste
add conversions tests (dotnet#25)
5caf142
@daholste
fix multiclass runs & add multiclass autofit UT (dotnet#27)
fb6390b
@daholste
add basic autofit regression test (dotnet#28)
468a1b7
srsaggam and others added 25 commits April 2, 2019 10:15
@srsaggam
Fix progress bar in linux/osx (dotnet#336)
93cf2d3 
* progressbar

* added progressbar and refactoring

* reverted

* revert sign assembly

* added headers and removed exception rethrow

* bug fixes and updates to UI

* added friendly name printing for metric

* formatting

* change from task to thread

* Update src/mlnet/CodeGenerator/CodeGenerationHelper.cs

Co-Authored-By: srsaggam <41802116+srsaggam@users.noreply.github.com>
@Dmitry-A
Mem leak fix (dotnet#328)
6a752a5 
* Create test.txt

* Create test.txt

* changes needed for benchmarking

* forgot one file

* merge conflict fix

* fix build break

* back out my version of the fix for Label column issue and fix the original fix

* bogus file removal

* undo SuggestedPipeline change

* remove labelCol from pipeline suggester

* fix build break

* rename AutoML to Microsoft.ML.Auto everywhere and a shot at publishing nuget package (will probably need tweaks once I try to use the pipleline)

* tweak queue in vsts-ci.yml

* there is still investigation to be done but this fix works and solves memory leak problems

* minor refactor
@daholste
Upgrade ML.NET package (dotnet#343)
f9d547b
@daholste
Add cross-validation (CV), and auto-CV for small datasets; push commo…
43fe8b8 
…n API experiment methods into base class (dotnet#287)
@Dmitry-A
restore old yml for internal pipeline so we can publish nuget again t…
6b2eca8 
…o devdiv stream (dotnet#344)
@srsaggam
Polishing the CLI UI part-1 (dotnet#338)
3c492c4 
* formatting of pbar message

* Polishing the UI

* optimization

* rename variable

* Update src/mlnet/AutoML/AutoMLEngine.cs

Co-Authored-By: srsaggam <41802116+srsaggam@users.noreply.github.com>

* Update src/mlnet/CodeGenerator/CodeGenerationHelper.cs

Co-Authored-By: srsaggam <41802116+srsaggam@users.noreply.github.com>

* new message

* changed hhtp to https

* added iteration num + 1

* change string name and add color to artifacts

* change the message

* build errors

* added null checks

* added exception messsages to log file

* added exception messsages to log file
@daholste
CLI ML.NET version upgrade (dotnet#345)
cab5809
@daholste
Sample revs; ColumnInformation property name revs; pre-featurizer fix…
a810d8d 
…es (dotnet#346)
@daholste
CLI -- consume logs from AutoML SDK (dotnet#349)
e89b9a8
@daholste
Rename RunDetails --> RunDetail (dotnet#350)
b68b8f2
@srsaggam
command line api upgrade and progress bar rendering bug (dotnet#366)
ba08a53 
* added fix for all platforms progress bar

* upgrade nuget

* removed args from writeline
@srsaggam
change in the version (dotnet#368)
9b6adcd
@srsaggam
fix few bugs in progressbar and verbosity (dotnet#374)
4f9dc40 
* fix few bugs in progressbar and verbosity

* removed unused name space
@srsaggam
Fix for folders with space in it while generating project (dotnet#376)
96d2427 
* support for folders with spaces

* added support for paths with space

* revert file

* change name of var

* remove spaces
@daholste
SMAC fix for minimizing metrics (dotnet#363)
40496fd
@srsaggam
Formatting Regression metrics and progress bar display days. (dotnet#379
9faceb2 
)

* added progress bar day display and fix regression metrics

* fix formatting

* added total time

* formatted total time
@srsaggam
change command name and add pbar message (dotnet#380)
ffd773b 
* change command name and add pbar message

* fix tests

* added aliases

* duplicate alias

* added another alias for task
@srsaggam
UI missing features (dotnet#382)
662a8ea 
* added formatting changes

* added accuracy specifically
@srsaggam
downgrade the codepages (dotnet#384)
e257648
@srsaggam
Change in project structure (dotnet#385)
c5ec302 
* initial changes

* Change in project structure

* correcting test

* change variable name

* fix tests

* fix tests

* fix more tests

* fix codegen errors

* adde log file message

* changed name of args

* change variable names

* fix test
@justinormont
FileSizeBuckets in correct units (dotnet#387)
d4b7700 
* Minor telemetry change to log in correct units and make our life easier in the future

* Use Ceiling instead of Round
@srsaggam
changed order (dotnet#388)
5227ee5
@Dmitry-A
prep work to transfer to ml.net (dotnet#389)
553e089 
* move test projects to top level test subdir

* rename some projects to make naming consistent and make it build again

* fix test project refs
@Dmitry-A
moving code and history over from machinelearning-automl
2d32ee0
@Dmitry-A
Add AutoML components to build, fix issues related to that so it builds
013a8d3
@Dmitry-A Dmitry-A changed the base branch from master to features/automl April 12, 2019 23:59
@Dmitry-A Dmitry-A merged commit 1702658 into dotnet:features/automl Apr 13, 2019
@shauheen shauheen added the AutoML.NET Automating various steps of the machine learning process label Apr 21, 2019
@Dmitry-A Dmitry-A deleted the users/dmitrya/move-to-mlnet branch May 1, 2019 23:13
@ghost ghost locked as resolved and limited conversation to collaborators Mar 22, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers
No reviews
Assignees
No one assigned
Labels
AutoML.NET Automating various steps of the machine learning process
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
8 participants
@Dmitry-A @shauheen @jongalloway @daholste @justinormont @vinodshanbhag @srsaggam @CESARDELATORRE