Image classification performance improvements and option to create validation set from train set. #4522
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
codemzs
changed the title
harshithapv
approved these changes
Dec 11, 2019
Contributor
harshithapv
left a comment
harshithapv
left a comment
There was a problem hiding this comment.
Do you have any statistics on the improvements in training time ? Could you share them ?
codemzs
force-pushed
the
imgclassperf
branch
from
4c20a98 to
11f31ad
Compare
Codecov Report
@@ Coverage Diff @@
## master #4522 +/- ##
==========================================
- Coverage 75.12% 75.09% -0.03%
==========================================
Files 909 909
Lines 160262 160188 -74
Branches 17257 17267 +10
==========================================
- Hits 120395 120298 -97
- Misses 35051 35056 +5
- Partials 4816 4834 +18
|
ghost
locked as resolved and limited conversation to collaborators
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
2 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This change improves the overall performance of image classification API and tensorflow transform by making the graph runner memory efficient and saving the bottleneck cached values in image classification API in binary format instead of text format.
This change also adds the option in Image Classification API to create validation set from train set in the event validation set is not provided by the user. Validation set is used for early stopping.