Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP] Add latest Gaussian Splatting techiques to 2DGS #151

Open
wants to merge 84 commits into
base: main
Choose a base branch
from
Open
Changes from 1 commit
Commits
Show all changes
84 commits
Select commit Hold shift + click to select a range
6c298b0
add supportment for non-centralized pinhole cameras data
yulunwu0108 Jun 12, 2024
15b3aa8
feat: Add normal loader
hugoycj Jul 23, 2024
ee41a99
Merge branch 'main' into leonwu0108/main
hugoycj Jul 23, 2024
9c49968
feat: Add ranking normal loss from Wonder3D
hugoycj Aug 30, 2024
79a475b
feat: Add normal gradient loss
hugoycj Aug 30, 2024
da4d038
feat: Add low contribution gaussian pruning
hugoycj Sep 1, 2024
340792a
fix: Update transmittance recording for prune
hugoycj Sep 1, 2024
da727ef
fix: Update normal_prior, pruning config
hugoycj Sep 1, 2024
33095da
feat: Add appearance network model and update optimization params
hugoycj Sep 4, 2024
c0d1c27
feat: Add edge-aware normal gradient loss and appearance model
hugoycj Sep 4, 2024
0df56b5
fix: Update submodule
hugoycj Sep 4, 2024
25ab52a
Merge branch 'main' of https://github.com/hugoycj/2d-gaussian-splatti…
hugoycj Sep 4, 2024
69fd664
fix: Update default resolution
hugoycj Sep 4, 2024
99dba7b
fix: Update diff-surfel-rasterization and appearance model
hugoycj Sep 8, 2024
b48e332
fix: Tune hyperparameters
hugoycj Sep 11, 2024
d799e51
update
Sep 12, 2024
a56dbba
feat: Enhance propagation and normal rendering in patchmatch
hugoycj Sep 16, 2024
4fd89f0
feat: Add depth rendering and camera intrinsic calculation
hugoycj Sep 16, 2024
3273705
feat: Add normal to rotation conversion and improve depth propagation
hugoycj Sep 16, 2024
6d9c326
feat: Enhance PatchMatch with normal initialization and improved plan…
hugoycj Sep 16, 2024
e1926b0
fix: Clean egg
hugoycj Sep 16, 2024
9ed89df
feat: Add pixelgs densification
hugoycj Sep 22, 2024
51661a9
Merge branch 'feat/propagation' into main
hugoycj Sep 22, 2024
a883585
Merge branch 'feat/pixelgs' into main
hugoycj Sep 22, 2024
e9f0577
feat: Add big points splitting
hugoycj Sep 22, 2024
dd521f1
feat: Improve Gaussian model pruning and splitting logic
hugoycj Sep 23, 2024
464bdce
fix: Replace distortion loss with modified normal consistency loss
hugoycj Sep 23, 2024
963dca3
Merge pull request #2 from hugoycj/feat/split_big_points
hugoycj Sep 23, 2024
7ca5c22
fix: Tune normal prior and trimgs hyperparameters
hugoycj Sep 23, 2024
484303a
feat: Add progressive training
hugoycj Sep 25, 2024
106ec91
fix: update config
hugoycj Sep 25, 2024
455204d
feat: Remove opencv dependency
hugoycj Sep 27, 2024
e65c3f2
fix: Add depth, depth_mask for depth loss
hugoycj Sep 27, 2024
33a137c
fix: Update diff-surfel-rasterization
hugoycj Sep 27, 2024
2419d68
fix: Update normal initialization
hugoycj Sep 27, 2024
949e8c7
fix: Improve initialization speed by fusion operation
hugoycj Sep 27, 2024
5243b9f
feat: Enhance depth handling and bug fixes
hugoycj Sep 27, 2024
4fc87f4
Merge pull request #3 from hugoycj/feat/torch_propagation
hugoycj Sep 27, 2024
0818608
fix: Update diff-surfel-rasterization
hugoycj Sep 29, 2024
a4e9312
feat: Add normal guided 2dgs init
hugoycj Sep 29, 2024
90e3687
fix: Update normal-guided init
hugoycj Sep 30, 2024
d02d891
Merge branch 'hbb1:main' into main
hugoycj Oct 10, 2024
7fcf600
fix: Update train_progressive
hugoycj Oct 13, 2024
8b3f0b7
fix: Update fetchPly to load point cloud without normals
hugoycj Oct 13, 2024
465ba80
feat: Add background gaussian
hugoycj Oct 13, 2024
0b28dce
feat: Update BgGaussianModel training setup
hugoycj Oct 14, 2024
66feecf
feat: Add bg_gaussians export and import
hugoycj Oct 14, 2024
f6a348d
feat: Add bg_gaussians pretraining and finetune
hugoycj Oct 14, 2024
b2b4447
feat: Add ms_l1_loss
hugoycj Oct 14, 2024
1c0fd9d
feat: Add skip_geometric flag to improve efficiency
hugoycj Oct 14, 2024
3192088
clean: Remove bg gaussian code from train.py
hugoycj Oct 16, 2024
2b8e156
fix: Update skip_geometric flag
hugoycj Oct 16, 2024
7f37cbb
feat: Optimize Gaussian model training
hugoycj Oct 16, 2024
0faddba
Merge pull request #4 from hugoycj/feat/bg_gaussians
hugoycj Oct 16, 2024
3c0e0fc
Merge branch 'hbb1:main' into main
hugoycj Oct 16, 2024
dbcd181
feat: Add w_mask flag to load extra mask
hugoycj Oct 16, 2024
6b63529
feat: Add alpha loss
hugoycj Oct 16, 2024
ab2cadc
fix: Update nerf evaluation scripts
hugoycj Oct 16, 2024
04323e9
Merge pull request #5 from hugoycj/feat/alpha_loss
hugoycj Oct 16, 2024
ff9149e
fix: Update lambda_mask
hugoycj Oct 16, 2024
7bf6498
Merge branch 'feat/alpha_loss' into main
hugoycj Oct 16, 2024
fb8cd9c
fix: Add default principal_point_ndc
hugoycj Oct 16, 2024
608afe0
fix: Fix masked normal loss
hugoycj Oct 16, 2024
a474861
feat: Enable normals and depth normals processing
hugoycj Oct 16, 2024
e5641a3
fix: Update train_progressive
hugoycj Oct 16, 2024
4e414e8
feat: Add training scripts
hugoycj Oct 16, 2024
965fc37
fix: Add background model init
hugoycj Oct 16, 2024
4615fa5
fix: Add init_normal scripts
hugoycj Oct 16, 2024
e7b4bbb
fix: Update normal_prior_loss
hugoycj Oct 16, 2024
de9d8fe
fix: Update normal loading
hugoycj Oct 16, 2024
b194160
docs: Add wnormal training scripts
hugoycj Oct 16, 2024
163372d
fix: Update wmask scripts
hugoycj Oct 16, 2024
a339fb3
fix: Update diff-surfel-rasterization
hugoycj Oct 17, 2024
83ded47
fix: Improve mask handling and prevent NaN in normals
hugoycj Oct 17, 2024
eb55716
fix: Add edge_aware_curvature_loss from atomg
hugoycj Oct 17, 2024
1604bf3
fix: Update curvature loss
hugoycj Oct 17, 2024
2301269
fix: Update training scripts
hugoycj Oct 17, 2024
c403e24
fix: Update normal supervision
hugoycj Oct 23, 2024
51bf7db
Update train_wmask_wnormal.sh
hugoycj Oct 25, 2024
9eea484
feat: Add 2dgs fast scripts
hugoycj Oct 27, 2024
de77878
Merge remote-tracking branch 'git/main' into main
hugoycj Oct 27, 2024
515588a
fix: Update scripts
hugoycj Oct 29, 2024
d4b3dcb
feat: Add fused-ssim for acceleration
hugoycj Nov 5, 2024
323ad80
fix: Update normal scripts to latest version and fix some bugs
hugoycj Nov 11, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Update train_wmask_wnormal.sh
  • Loading branch information
hugoycj authored Oct 25, 2024
commit 51bf7dbeff44d09fa267de81be21d580d2cd9a5e
4 changes: 2 additions & 2 deletions scripts/train_wmask_wnormal.sh
Original file line number Diff line number Diff line change
@@ -1,10 +1,10 @@
data=$1
postix=gaustudio_wmask_wnormal
# gs-init -s $data -o ${data}_${postix} --w_mask mask
gs-init -s $data -o ${data}_${postix} --w_mask mask
python scripts/init_normal.py -s ${data}_${postix}
rm -r ${data}_${postix}/result_2
python train_progressive.py -s ${data}_${postix} -r 1 --lambda_dist 1000 \
--w_mask masks --lambda_mask 0.1 --w_normal_prior normals \
--max_screen_size 5 -m ${data}_${postix}/result_2 --iteration 7000
gs-extract-pcd -m ${data}_${postix}/result_2 -o ${data}_${postix}/result_2/fusion_2 \
--meshing sap --config 2dgs
--meshing sap --config 2dgs