Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix the bugs associated with blender datas #2704

Merged
merged 49 commits into from
Jan 20, 2024

Conversation

KevinXu02
Copy link
Contributor

fix the bug when camera.distortion_params is None, which will lead to no data when using blender data.

@KevinXu02
Copy link
Contributor Author

KevinXu02 commented Dec 25, 2023

I tested it with lego, seems that gsplat trys hard to learn the background colour. setting background in nerfstudio\models\gaussian_splatting.py the same as blender bg colour fixs this. I forced overwriting the bg color, but it is super inelegant.

@KevinXu02 KevinXu02 changed the title fix the bug when camera.distortion_params is None fix the bugs associated with blender datas Dec 25, 2023
@KevinXu02 KevinXu02 marked this pull request as draft January 19, 2024 03:16
@KevinXu02 KevinXu02 marked this pull request as ready for review January 19, 2024 05:08
@KevinXu02 KevinXu02 marked this pull request as draft January 19, 2024 05:10
@KevinXu02
Copy link
Contributor Author

It seems that my ruff formatter keeps messing everything up, but the background should work now. When using blender data the background_color should be changed to white to avoid cloulds. In the viser the rendered bg color is always overwritten to grey, it will not affect training, but I wonder if there is some way to modify it without using overwrite.

@KevinXu02 KevinXu02 marked this pull request as ready for review January 19, 2024 06:14
@brentyi brentyi enabled auto-merge (squash) January 20, 2024 02:00
@brentyi brentyi merged commit c83ed7d into nerfstudio-project:main Jan 20, 2024
2 checks passed
@danperazzo
Copy link

Hi everyone! How can I change the background color to white? I tried doing this, but I kept getting some strange visualizations

ArpegorPSGH pushed a commit to ArpegorPSGH/nerfstudio that referenced this pull request Jun 22, 2024
* fix the bug when camera.distortion_params is None

* Handle background color override when using blender.

* fix bare except

* format

* Update background color override in Blender dataparser

* Add ability to download EyefulTower dataset

* wip before I copy linning's stuff in

* Generate per-resolution cameras.xml

* Generate transforms.json at download

* Fix a couple of quotes

* Use official EyefulTower splits for train and val

* Disable projectaria-tools on windows

* Fix extra imports

* Add a new nerfacto method tund for EyefulTower

* Split eyefultower download into a separate file

* Fix typo

* Add some fisheye support for eyeful data

* Reformatted imports to not be dumb

* Apparently this file was missed when formatting originally

* Added 1k resolution scenes

* revert method_configs.py to original values

* Also add 1k exrs

* Add option to modify bg color in gaussian splatting

* fix back the config, bg color should work now

* removed camera optimizer for gs to align with main

* Address feedback

* Revert changes to pyproject.toml, to be added in a later PR

* Oops, probably shouldn't have gotten rid of awscli ...

* adding support for bg color, tested and reformatted now

* formatted

* formatted

* changed glob variable name

* Refactor background color variable name

* prevent viser overriding

---------

Co-authored-by: Vasu Agrawal <vasuagrawal@meta.com>
Co-authored-by: Ethan Weber <ethanweber@berkeley.edu>
Co-authored-by: Brent Yi <yibrenth@gmail.com>
Co-authored-by: Justin Kerr <justin.g.kerr@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants