RC-4.5.0: AutoInterface introduce #118
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
✂️ CarveKit v4.1.0
Fixed typos in tracer b7 prepared for adding postprocessing and preprocessing
2. Added warning about fp16 to u2net class
AutoScene Description:
Performs a primary analysis of the image in order to automatically select the necessary method for removing the background.
The choice is made by classifying the scene type.
The output can be the following types:
- hard
- soft
- digital
More info here: https://huggingface.co/Carve/scene_classifier/
…erfaces. 2. Updated Russian README.md 3. Updated examples
…setup not being fully configured. Fixed models download(added scene classifier) and tests(same here).
Added AutoInterface to automatically select the best methods for images with different scene types. AutoInterface uses a scene classifier and an object classifier to perform full analysis on all images. At the moment, since there are not enough models for so many types of scenes, universal models are selected for some domains. In the future, when some variety of models is added, auto-selection will be rewritten for the better.
…ods for images with different scene types. auto uses a scene classifier and an object classifier to perform full analysis on all images. At the moment, since there are not enough models for so many types of scenes, universal models are selected for some domains. In the future, when some variety of models is added, auto-selection will be rewritten for the better.
It will refine the segmentation mask before passing it to the matting network. This should provide more accurate background removal for objects and people. (Check repo from CREDITS.md for more details) Updated README.md Updated Russian README.md
Optimized FBA input image size
… Added more fixtures
… implemented here
Changelog 1. Added ISNet segmentation network 2. Added object classifier YOLOv4. 3. Added AutoInterface to automatically select the best methods for images with different scene types. AutoInterface uses a scene classifier and an object classifier to perform full analysis on all images. At the moment, since there are not enough models for so many types of scenes, universal models are selected for some domains. In the future, when some variety of models is added, auto-selection will be rewritten for the better. 4. Updated metrics 5. Added CascadePSP segmentation refinement network. It will refine the segmentation mask before passing it to the matting network. This should provide more accurate background removal for objects and people. (Check repo from CREDITS.md for more details) 6. Fixed trimap generator `unknown` area value as FBA Matting expect. 7. Added noise filter switch (needed for smooth mask prediction on the final stage) 8. Updated alpha composition algorithm
OPHoperHPO
changed the title
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Changelog:
AutoInterface uses a scene classifier and an object classifier to perform full analysis on all images. At the moment, since there are not enough models for so many types of scenes, universal models are selected for some domains. In the future, when some variety of models is added, auto-selection will be rewritten for the better.
It will refine the segmentation mask before passing it to the matting network. This should provide more accurate background removal for objects and people. (Check repo from CREDITS.md for more details)
unknownarea value as FBA Matting expect.soft scenes)AutoScene RC-4.2.0
Description
It performs a primary analysis of the image in order to automatically select the necessary method for removing the background.
The choice is made by classifying the scene type.
Model accuracy:
Model achieves 91.3% accuracy on the validation set.
Classes info
The output can be the following types:
The hard class denotes a group of scenes to which a coarser background removal method should be applied, intended for objects with an edge without small details.
The hard class contains the following categories of objects:
object, laptop, charger, pc mouse, pc, rocks, table, bed, box, sneakers, ship, wire, guitar, fork, spoon, plate, keyboard, car, bus, screwdriver, ball, door, flower, clocks, fruit , food, robot.The soft class denotes a group of scenes to which you want to apply a soft background removal method intended for people, hair, clothes, and other similar types of objects.
The soft class contains the following categories of objects:
animal, people, human, man, woman, t-shirt, hairs, hair, dog, cat, monkey, cow, medusa, clothesThe digital* class denotes a group of images with digital graphics, such as screenshots, logos, and so on.
The digital class contains the following categories of scenes:
screenshotArchitecture
The classifier uses DenseNet161 as the encoder and some linear layers at classifier base.
Some examples