Skip to content

How to keep camera static in SVD? #38

@ljcheng136

Description

@ljcheng136

Nice work! I'm running inference with MotionCtrl and SVD from the svd branch with ckpt downloaded from here. I try to keep the camera trajectory static using RAW Camera Poses in Custom Camera Poses, that is 1 0 0 0 0 1 0 0 0 0 1 0 repeats 14 lines. However, the camera trajectory in the output video cannot remain static and tend to move randomly.
Here are some examples of my experiments:

  1. default setting:
    https://github.com/user-attachments/assets/12daa130-55c3-482c-a6ad-97e94b858719
  2. change motion speed:
    https://github.com/user-attachments/assets/4d0eb5f9-326e-4043-bcfd-f6d91ec7236b
  3. change seed:
    https://github.com/user-attachments/assets/6c401028-8bcc-4a52-b832-2a643547527e
  4. test other input images:
    https://github.com/user-attachments/assets/c972a8b5-4ccb-42f8-85af-661bfe4f07af
    Does anyone know where my operation went wrong? Thanks a lot!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions