Skip to content

Commit e02d04c

Browse files
committed
Documentation changes
* "Viewing" deleted, as it's info was moved to a separate page in the wiki * "Forks and Related"->"Generate normal maps" deleted, now a feature is this repo * Changelog moved to a separate file * Added 0.4.3 changelog
1 parent 639f550 commit e02d04c

File tree

2 files changed

+115
-145
lines changed

2 files changed

+115
-145
lines changed

CHANGELOG.md

Lines changed: 114 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,114 @@
1+
## Changelog
2+
### 0.4.2
3+
* Added UI options for 2 additional rembg models.
4+
* Heatmap generation UI option is hidden - if you want to use it, please activate it in the extension settings.
5+
* Bugfixes.
6+
### 0.4.1 standalone mode
7+
* Added ability to run DepthMap without WebUI. (Use main.py. Make sure all the dependencies are installed. The support is not feature-complete.)
8+
* NormalMap generation
9+
### 0.4.0 large code refactor
10+
* UI improvements
11+
* Improved Batch from Directory, Clip and renormalize DepthMap
12+
* Slightly changed the behaviour of various options
13+
* Extension may partially work even if some of the dependencies are unmet
14+
15+
### 0.3.12
16+
* Fixed stereo image generation
17+
* Other bugfixes
18+
### 0.3.11
19+
* 3D model viewer (Experimental!)
20+
* simple and fast (occluded) 3D mesh generation, support for equirectangular projection
21+
(accurate results with ZoeDepth models only, no boost, no custom maps)
22+
* default output format is now obj for inpainted mesh and simple mesh
23+
### 0.3.10
24+
* ZoeDepth support (with boost), 3 new models, best results so far
25+
* better heatmap
26+
### 0.3.9
27+
* use existing/custom depthmaps in output dir for batch mode
28+
* custom depthmap support for single file
29+
* wavefront obj output support for inpainted mesh (enabled in settings)
30+
* option to generate all stereo formats at once
31+
* bugfix: convert single channel input image to rgb
32+
* renamed midas imports to fix conflict with deforum
33+
* ui cleanup
34+
### 0.3.8 bugfix
35+
* bugfix in remove background path
36+
### 0.3.7 new features
37+
* [rembg](https://github.com/danielgatis/rembg) Remove Background [PR](https://github.com/thygate/stable-diffusion-webui-depthmap-script/pull/78) by [@graemeniedermayer](https://github.com/graemeniedermayer) merged
38+
* setting to flip Left/Right SBS images
39+
* added missing parameter for 3d inpainting (repeat_inpaint_edge)
40+
* option to generate demo videos with mesh
41+
### 0.3.6 new feature
42+
* implemented binary ply file format for the inpainted 3D mesh, big reduction in filesize and save/load times.
43+
* added progress indicators to the inpainting process
44+
### 0.3.5 bugfix
45+
* create path to 3dphoto models before download (see [issue](https://github.com/thygate/stable-diffusion-webui-depthmap-script/issues/76))
46+
### 0.3.4 new featues
47+
* depth clipping option (original idea by [@Extraltodeus](https://github.com/Extraltodeus))
48+
* by popular demand, 3D-Photo-Inpainting is now implemented
49+
* generate inpainted 3D mesh (PLY) and videos of said mesh
50+
### 0.3.3 bugfix and new midas models
51+
* updated to midas 3.1, bringing 2 new depth models (the 512 one eats VRAM for breakfast!)
52+
* fix Next-ViT dependency issue for new installs
53+
* extension no longer clones repositories, all dependencies are now contained in the extension
54+
### 0.3.2 new feature and bugfixes
55+
* several bug fixes for apple silicon and other machines without cuda
56+
* NEW Stereo Image Generation techniques for gap filling by [@semjon00](https://github.com/semjon00) using polylines. (See [here](https://github.com/thygate/stable-diffusion-webui-depthmap-script/pull/56)) Significant improvement in quality.
57+
### 0.3.1 bugfix
58+
* small speed increase for anaglyph creation
59+
* clone midas repo before midas 3.1 to fix issue (see [here](https://github.com/thygate/stable-diffusion-webui-depthmap-script/issues/55#issue-1510266008))
60+
### 0.3.0 improved stereo image generation
61+
* New improved technique for generating stereo images and balancing distortion between eyes by [@semjon00](https://github.com/semjon00) (See [here](https://github.com/thygate/stable-diffusion-webui-depthmap-script/pull/51))
62+
* Substantial speedup of stereo image generation code using numba JIT
63+
### 0.2.9 new feature
64+
* 3D Stereo (side-by-side) and red/cyan anaglyph image generation.
65+
(Thanks to [@sina-masoud-ansari](https://github.com/sina-masoud-ansari) for the tip! Discussion [here](https://github.com/thygate/stable-diffusion-webui-depthmap-script/discussions/45))
66+
### 0.2.8 bugfix
67+
* boost (pix2pix) now also able to compute on cpu
68+
* res101 able to compute on cpu
69+
### 0.2.7 separate tab
70+
* Depth Tab now available for easier stand-alone (batch) processing
71+
### 0.2.6 ui layout and settings
72+
* added link to repo so more people find their way to the instructions.
73+
* boost rmax setting
74+
### 0.2.5 bugfix
75+
* error checking on model download (now with progressbar)
76+
### 0.2.4 high resolution depthmaps
77+
* multi-resolution merging is now implemented, significantly improving results!
78+
* res101 can now also compute on CPU
79+
### 0.2.3 bugfix
80+
* path error on linux fixed
81+
### 0.2.2 new features
82+
* added (experimental) support for AdelaiDepth/LeReS (GPU Only!)
83+
* new option to view depthmap as heatmap
84+
* optimised ui layout
85+
### 0.2.1 bugfix
86+
* Correct seed is now used in filename and pnginfo when running batches. (see [issue](https://github.com/thygate/stable-diffusion-webui-depthmap-script/issues/35))
87+
### 0.2.0 upgrade
88+
* the script is now an extension, enabling auto installation.
89+
### 0.1.9 bugfixes
90+
* sd model moved to system memory while computing depthmap
91+
* memory leak/fragmentation issue fixed
92+
* recover from out of memory error
93+
### 0.1.8 new options
94+
* net size can now be set as width and height, option to match input size, sliders now have the same range as generation parameters. (see usage below)
95+
* better error handling
96+
### 0.1.7 bugfixes
97+
* batch img2img now works (see [issue](https://github.com/thygate/stable-diffusion-webui-depthmap-script/issues/21#issuecomment-1306445056))
98+
* generation parameters now only saved when enabled in settings
99+
* model memory freed explicitly at end of script
100+
### 0.1.6 new option
101+
* option to invert depthmap (black=near, white=far), as required by some viewers.
102+
### 0.1.5 bugfix
103+
* saving as any format other than PNG now always produces an 8 bit, 3 channel RGB image. A single channel 16 bit image is only supported when saving as PNG. (see [issue](https://github.com/thygate/stable-diffusion-webui-depthmap-script/issues/15#issuecomment-1304909019))
104+
### 0.1.4 update
105+
* added support for `--no-half`. Now also works with cards that don't support half precision like GTX 16xx. ([verified](https://github.com/thygate/stable-diffusion-webui-depthmap-script/issues/12#issuecomment-1304656398))
106+
### 0.1.3 bugfix
107+
* bugfix where some controls where not visible (see [issue](https://github.com/thygate/stable-diffusion-webui-depthmap-script/issues/11#issuecomment-1304400537))
108+
### 0.1.2 new option
109+
* network size slider. higher resolution depth maps (see usage below)
110+
### 0.1.1 bugfixes
111+
* overflow issue (see [here](https://github.com/thygate/stable-diffusion-webui-depthmap-script/issues/10) for details and examples of artifacts)
112+
* when not combining, depthmap is now saved as single channel 16 bit
113+
### 0.1.0
114+
* initial version: script mode, supports generating depthmaps with 4 different midas models

README.md

Lines changed: 1 addition & 145 deletions
Original file line numberDiff line numberDiff line change
@@ -20,117 +20,6 @@ video by [@graemeniedermayer](https://github.com/graemeniedermayer), more exampl
2020
![](https://user-images.githubusercontent.com/54073010/210012661-ef07986c-2320-4700-bc54-fad3899f0186.png)
2121
images generated by [@semjon00](https://github.com/semjon00) from CC0 photos, more examples [here](https://github.com/thygate/stable-diffusion-webui-depthmap-script/pull/56#issuecomment-1367596463).
2222

23-
## Changelog
24-
* v0.4.2
25-
* added UI options for 2 additional rembg models
26-
* heatmap generation UI option is hidden - if you want to use it, please activate it in the extension settings
27-
* other bugfixes
28-
* v0.4.1 standalone mode
29-
* ability to run DepthMap without WebUI (Use main.py. Make sure all the dependencies are installed. The support is not feature-complete.)
30-
* NormalMap generation
31-
* v0.4.0 large code refactor
32-
* UI improvements
33-
* improved Batch from Directory, Clip and renormalize DepthMap
34-
* slightly changed the behaviour of various options
35-
* extension may partially work even if some of the dependencies are unmet
36-
* v0.3.12
37-
* Fixed stereo image generation
38-
* Other bugfixes
39-
* v0.3.11
40-
* 3D model viewer (Experimental!)
41-
* simple and fast (occluded) 3D mesh generation, support for equirectangular projection
42-
(accurate results with ZoeDepth models only, no boost, no custom maps)
43-
* default output format is now obj for inpainted mesh and simple mesh
44-
* v0.3.10
45-
* ZoeDepth support (with boost), 3 new models, best results so far
46-
* better heatmap
47-
* v0.3.9
48-
* use existing/custom depthmaps in output dir for batch mode
49-
* custom depthmap support for single file
50-
* wavefront obj output support for inpainted mesh (enabled in settings)
51-
* option to generate all stereo formats at once
52-
* bugfix: convert single channel input image to rgb
53-
* renamed midas imports to fix conflict with deforum
54-
* ui cleanup
55-
* v0.3.8 bugfix
56-
* bugfix in remove background path
57-
* v0.3.7 new features
58-
* [rembg](https://github.com/danielgatis/rembg) Remove Background [PR](https://github.com/thygate/stable-diffusion-webui-depthmap-script/pull/78) by [@graemeniedermayer](https://github.com/graemeniedermayer) merged
59-
* setting to flip Left/Right SBS images
60-
* added missing parameter for 3d inpainting (repeat_inpaint_edge)
61-
* option to generate demo videos with mesh
62-
* v0.3.6 new feature
63-
* implemented binary ply file format for the inpainted 3D mesh, big reduction in filesize and save/load times.
64-
* added progress indicators to the inpainting process
65-
* v0.3.5 bugfix
66-
* create path to 3dphoto models before download (see [issue](https://github.com/thygate/stable-diffusion-webui-depthmap-script/issues/76))
67-
* v0.3.4 new featues
68-
* depth clipping option (original idea by [@Extraltodeus](https://github.com/Extraltodeus))
69-
* by popular demand, 3D-Photo-Inpainting is now implemented
70-
* generate inpainted 3D mesh (PLY) and videos of said mesh
71-
* v0.3.3 bugfix and new midas models
72-
* updated to midas 3.1, bringing 2 new depth models (the 512 one eats VRAM for breakfast!)
73-
* fix Next-ViT dependency issue for new installs
74-
* extension no longer clones repositories, all dependencies are now contained in the extension
75-
* v0.3.2 new feature and bugfixes
76-
* several bug fixes for apple silicon and other machines without cuda
77-
* NEW Stereo Image Generation techniques for gap filling by [@semjon00](https://github.com/semjon00) using polylines. (See [here](https://github.com/thygate/stable-diffusion-webui-depthmap-script/pull/56)) Significant improvement in quality.
78-
* v0.3.1 bugfix
79-
* small speed increase for anaglyph creation
80-
* clone midas repo before midas 3.1 to fix issue (see [here](https://github.com/thygate/stable-diffusion-webui-depthmap-script/issues/55#issue-1510266008))
81-
* v0.3.0 improved stereo image generation
82-
* New improved technique for generating stereo images and balancing distortion between eyes by [@semjon00](https://github.com/semjon00) (See [here](https://github.com/thygate/stable-diffusion-webui-depthmap-script/pull/51))
83-
* Substantial speedup of stereo image generation code using numba JIT
84-
* v0.2.9 new feature
85-
* 3D Stereo (side-by-side) and red/cyan anaglyph image generation.
86-
(Thanks to [@sina-masoud-ansari](https://github.com/sina-masoud-ansari) for the tip! Discussion [here](https://github.com/thygate/stable-diffusion-webui-depthmap-script/discussions/45))
87-
* v0.2.8 bugfix
88-
* boost (pix2pix) now also able to compute on cpu
89-
* res101 able to compute on cpu
90-
* v0.2.7 separate tab
91-
* Depth Tab now available for easier stand-alone (batch) processing
92-
* v0.2.6 ui layout and settings
93-
* added link to repo so more people find their way to the instructions.
94-
* boost rmax setting
95-
* v0.2.5 bugfix
96-
* error checking on model download (now with progressbar)
97-
* v0.2.4 high resolution depthmaps
98-
* multi-resolution merging is now implemented, significantly improving results!
99-
* res101 can now also compute on CPU
100-
* v0.2.3 bugfix
101-
* path error on linux fixed
102-
* v0.2.2 new features
103-
* added (experimental) support for AdelaiDepth/LeReS (GPU Only!)
104-
* new option to view depthmap as heatmap
105-
* optimised ui layout
106-
* v0.2.1 bugfix
107-
* Correct seed is now used in filename and pnginfo when running batches. (see [issue](https://github.com/thygate/stable-diffusion-webui-depthmap-script/issues/35))
108-
* v0.2.0 upgrade
109-
* the script is now an extension, enabling auto installation.
110-
* v0.1.9 bugfixes
111-
* sd model moved to system memory while computing depthmap
112-
* memory leak/fragmentation issue fixed
113-
* recover from out of memory error
114-
* v0.1.8 new options
115-
* net size can now be set as width and height, option to match input size, sliders now have the same range as generation parameters. (see usage below)
116-
* better error handling
117-
* v0.1.7 bugfixes
118-
* batch img2img now works (see [issue](https://github.com/thygate/stable-diffusion-webui-depthmap-script/issues/21#issuecomment-1306445056))
119-
* generation parameters now only saved when enabled in settings
120-
* model memory freed explicitly at end of script
121-
* v0.1.6 new option
122-
* option to invert depthmap (black=near, white=far), as required by some viewers.
123-
* v0.1.5 bugfix
124-
* saving as any format other than PNG now always produces an 8 bit, 3 channel RGB image. A single channel 16 bit image is only supported when saving as PNG. (see [issue](https://github.com/thygate/stable-diffusion-webui-depthmap-script/issues/15#issuecomment-1304909019))
125-
* v0.1.4 update
126-
* added support for `--no-half`. Now also works with cards that don't support half precision like GTX 16xx. ([verified](https://github.com/thygate/stable-diffusion-webui-depthmap-script/issues/12#issuecomment-1304656398))
127-
* v0.1.3 bugfix
128-
* bugfix where some controls where not visible (see [issue](https://github.com/thygate/stable-diffusion-webui-depthmap-script/issues/11#issuecomment-1304400537))
129-
* v0.1.2 new option
130-
* network size slider. higher resolution depth maps (see usage below)
131-
* v0.1.1 bugfixes
132-
* overflow issue (see [here](https://github.com/thygate/stable-diffusion-webui-depthmap-script/issues/10) for details and examples of artifacts)
133-
* when not combining, depthmap is now saved as single channel 16 bit
13423

13524
## Install instructions
13625
The script is now also available to install from the `Available` subtab under the `Extensions` tab in the WebUI.
@@ -195,48 +84,15 @@ If you often get out of memory errors when computing a depthmap on GPU while usi
19584
- You can run the MiDaS network on their colab linked here https://pytorch.org/hub/intelisl_midas_v2/
19685
- You can run BoostingMonocularDepth on their colab linked here : https://colab.research.google.com/github/compphoto/BoostingMonocularDepth/blob/main/Boostmonoculardepth.ipynb
19786

198-
## Viewing
199-
200-
### For viewing on 2D displays
201-
202-
* There is the excellent [depthy](https://github.com/panrafal/depthy) by Rafał Lindemann. LIVE link : [https://depthy.stamina.pl/](https://depthy.stamina.pl/)
203-
(Instructions: Drag the rgb image into the window, then select Load depthmap, and drag the depthmap into the dialog inside the window.) Generates GIF and video.
204-
205-
* The [depth-player](https://github.com/spite/depth-player) by [@spite](https://github.com/spite) can load rgb and depthmap images and export a Wavefront OBJ file of a displaced plane mesh with the rgb image applied as texture. LIVE link : [https://depthplayer.ugocapeto.com/](https://depthplayer.ugocapeto.com/) Thanks to [@AugmentedRealityCat](https://github.com/AugmentedRealityCat) for the tip.
206-
207-
* Simple interactive depthmap viewer using three ([source](https://github.com/thygate/depthmap-viewer-three)). LIVE link : [https://thygate.github.io/depthmap-viewer-three](https://thygate.github.io/depthmap-viewer-three) (Instructions: Drag a combined-rgb-and-depth-horizontally image into the window to view it)
208-
209-
### For viewing on 3D devices
210-
211-
* SBS Stereo images can easily be viewed in 3D on VR devices, even cheap ones that use a smartphone like [Google Cardboard](https://arvr.google.com/cardboard/). To view an SBS image, you may simply display it on the phone screen and then insert the phone into the headset. A more convenient option may be to stream the picture from the computer screen to the phone using Sunshine. You may want to change resolution to match phone's aspect ratio. If you decide to buy a headset, pay attention to the lens' size - usually headsets with larger lenses work the best.
212-
213-
* Simple interactive depthmap viewer for Looking Glass using three. LIVE link : [https://thygate.github.io/depthmap-viewer-three-lookingglass](https://thygate.github.io/depthmap-viewer-three-lookingglass) (Instructions: Drag a combined-rgb-and-depth-horizontally image into the window to view it)
214-
215-
* Unity3D project to view the depthmaps on Looking Glass in realtime as images are generated. Leave a message in the discussion section if you want me to publish it too.
216-
217-
### Blender
218-
* Blender depthmap import addon by [@Ladypoly](https://github.com/LadyPoly) ([comment](https://github.com/AUTOMATIC1111/stable-diffusion-webui/discussions/4252#discussioncomment-4333661)).
219-
Download the addon here : [importdepthmap_1.0.3.zip](https://github.com/AUTOMATIC1111/stable-diffusion-webui/files/10194086/importdepthmap_1.0.3.zip) (Blender 3.3.0 or newer)
220-
Demonstration videos : (1) https://www.youtube.com/watch?v=vfu5yzs_2EU , (2) https://www.youtube.com/watch?v=AeDngG9kQNI
221-
222-
[![video](https://img.youtube.com/vi/vfu5yzs_2EU/1.jpg)](https://www.youtube.com/watch?v=vfu5yzs_2EU) [![video](https://img.youtube.com/vi/AeDngG9kQNI/2.jpg)](https://www.youtube.com/watch?v=AeDngG9kQNI)
223-
224-
* To view the 3D-inpainted mesh in blender:
225-
* import the PLY file
226-
* Set camera to origin (0, 0, 0) and pointing up to align it with the mesh
227-
* adjust camera FOV to match the mesh
228-
* Add a 'Color Attribute' Node and connect it to the shader color input
229-
23087
## Forks and Related
231-
* Generate normal maps from depth maps : [stable-diffusion-webui-normalmap-script](https://github.com/graemeniedermayer/stable-diffusion-webui-normalmap-script) by [@graemeniedermayer](https://github.com/graemeniedermayer), also check his [clothseg](https://github.com/graemeniedermayer/clothseg) extension.
23288

23389
* Several scripts by [@Extraltodeus](https://github.com/Extraltodeus) using depth maps : https://github.com/Extraltodeus?tab=repositories
23490

23591
### More updates soon .. Feel free to comment and share in the discussions.
23692

23793
## Acknowledgements
23894

239-
This project uses code and information from following papers :
95+
This project relies on code and information from following papers :
24096

24197
MiDaS :
24298

0 commit comments

Comments
 (0)