Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

how to distinguish whether the generated video is 2D or 4D? #16

Open
Fancy93 opened this issue Nov 15, 2024 · 7 comments
Open

how to distinguish whether the generated video is 2D or 4D? #16

Fancy93 opened this issue Nov 15, 2024 · 7 comments

Comments

@Fancy93
Copy link

Fancy93 commented Nov 15, 2024

Very interesting work. I have a question: how to distinguish whether the generated video is 2D or 4D in the paper?

@Fancy93 Fancy93 changed the title distinguish whether the generated video is 2D or 4D? how to distinguish whether the generated video is 2D or 4D? Nov 15, 2024
@wenqsun
Copy link
Owner

wenqsun commented Nov 15, 2024

Thanks for your interest! In our paper, Fig. 4 shows the spatial- and temporal-variant videos, Fig. 5 shows the 3dgs renderings of spatial-variant videos, and Fig. 6 presents the novel-view videos of 4D scenes.

Is it clear now? Welcome to ask us if you have any questions.

@Fancy93
Copy link
Author

Fancy93 commented Nov 15, 2024

Thanks for your kind reply, I have another question, is the input video 2D or 4D?
1731659551392

@wenqsun
Copy link
Owner

wenqsun commented Nov 15, 2024

Hi, the input view video means the 4D scene video from the input view.

I should use clearer expression to emphasize the results in the paper. Thanks for your question.

@wenqsun
Copy link
Owner

wenqsun commented Nov 15, 2024

I want to talk more about the input view video in Fig. 6. For the first row, we use the real-world video as the input view (front view) video and generate the 4D scene with our controllable video generation, which is used to generate the novel view videos below.

@Fancy93
Copy link
Author

Fancy93 commented Nov 15, 2024

Oh, I see. You want to generate a scene with three perspectives, not a video, right?

@wenqsun
Copy link
Owner

wenqsun commented Nov 30, 2024

Actually, we use not just three-view videos, but dozens of multi-view videos to reconstruct this 4D scene. In our paper, we only present 3 views.

@Fancy93
Copy link
Author

Fancy93 commented Dec 3, 2024

so,How to distinguish whether the generated video is 2D or 4D?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants