Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

about one-step multiview generation #12

Open
garychan22 opened this issue Aug 22, 2024 · 1 comment
Open

about one-step multiview generation #12

garychan22 opened this issue Aug 22, 2024 · 1 comment

Comments

@garychan22
Copy link

garychan22 commented Aug 22, 2024

hi, thanks for the great project here. i have a question about the one-step multiview generation with wonder3d. though in the demo code the num_inference_steps is set as 1, while in the scheduler_perflow.py, the behavior is reset to at least config.num_time_windows (4) steps (the actual timesteps are [1000, 750, 500, 250]),

if num_inference_steps < self.config.num_time_windows:
    num_inference_steps = self.config.num_time_windows
    print(f"### We recommend a num_inference_steps not less than num_time_windows. It's set as {self.config.num_time_windows}.")

is my understanding right?

@HanshuYAN
Copy link
Collaborator

Hi,
We updated the perflow scheduler recently. Considering the stability, we forced the inference steps to be equal to or larger than the number of windows.
The multiview experiments were implemented before the update and used only one step, [1000]. You can remove the three lines and try one-step inference for wonder3d.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants