Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implementation status #1

Open
4 tasks done
inuex35 opened this issue Oct 9, 2024 · 3 comments
Open
4 tasks done

Implementation status #1

inuex35 opened this issue Oct 9, 2024 · 3 comments

Comments

@inuex35
Copy link
Owner

inuex35 commented Oct 9, 2024

Working on spherical_render branch

Todo

  • Load Opensfm data for spherical camera
  • Render forward - Need to check pixels are in the right position
  • Render forward - Need to check if jacobian is okay
  • Render backward - Need to check mathematical correctness for backward

Current status
Forward pass is not good
Frame_00115_FinalColor

Sample dataset

https://dtbn.jp/6eEZeo8e
(The url will expire in a week)

image
363364054-58ee52a3-4200-4397-bd81-b876470dfaf6

reconstruction
363273991-74f99747-e588-484f-a6d6-feffef6627d9 (1)

@inuex35
Copy link
Owner Author

inuex35 commented Oct 10, 2024

Forward pass is look okay

Frame_00105_FinalColor

image

Iterations 7000
image

Iterations 30000
image

rendering result is not good and need to check jacobian and backward

image

@inuex35
Copy link
Owner Author

inuex35 commented Oct 12, 2024

Worked! I dont know why it's upside down.

image

Clipchamp.mp4

Problem was the original dataset. It does not happen in another dataset.

image

@inuex35
Copy link
Owner Author

inuex35 commented Oct 14, 2024

Real data is not as good as simulated data, but looks working well.

walk_sakura.mp4

Rendering perspective from spherical model is okay but smoky because of large floaters under ground.

image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant