10000 Add Wan-FUN Camera Control models and Add WanCameraImageToVideo node by George0726 · Pull Request #8013 · comfyanonymous/ComfyUI · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Add Wan-FUN Camera Control models and Add WanCameraImageToVideo node #8013

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 6 commits into
base: master
Choose a base branch
from
Open

Add Wan-FUN Camera Control models and Add WanCameraImageToVideo node #8013

wants to merge 6 commits into from
+431 −1

Conversation

George0726
Copy link
@George0726 George0726 commente 8000 d May 8, 2025 •
edited
Loading

VideoX-Fun recently released two models for camera control, Wan2.1-Fun-V1.1-1.3B-Control-Camera and Wan2.1-Fun-V1.1-14B-Control-Camera.

To support these two models, I add a new node WanCameraImageToVideo, for customizing inputs for camera control models.

I also added a node VideoAcc_CameraTrajectoryRecam to calculate Plücker embeddings as the input of WanCameraImageToVideo node, in my customized node repo.

Here I attached the JSON workflow for your reference.
wan2.1_fun_Camera_Control.json

@George0726 George0726 mentioned this pull request May 8, 2025
Closed
@George0726
Copy link
Author

I uploaded two different versions of quantization models to the community.
https://huggingface.co/George0667/Wan2.1-Fun-V1.1-Control-Camera-quantization/tree/main

@Foul-Tarnished
Copy link
Foul-Tarnished commented May 11, 2025 •
edited
Loading

You wrote two hyperlinks tha points to the same model

Is the other one this one ?
https://huggingface.co/alibaba-pai/Wan2.1-Fun-V1.1-14B-Control-Camera

There are also two other models that are the same but without the camera word (just 1.3B-Control and 14B-Control)
No idea what these are

@George0726
Copy link
Author

You wrote two hyperlinks tha points to the same model

Is the other one this one ? https://huggingface.co/alibaba-pai/Wan2.1-Fun-V1.1-14B-Control-Camera

There are also two other models that are the same but without the camera word (just 1.3B-Control and 14B-Control) No idea what these are

Yep sorry, it should be https://huggingface.co/alibaba-pai/Wan2.1-Fun-V1.1-14B-Control-Camera and https://huggingface.co/alibaba-pai/Wan2.1-Fun-V1.1-1.3B-Control-Camera

@comfyanonymous
Copy link
Owner

I don't think the camera_conditions should be of type LATENT because it's confusing, it should be a different type like WAN_CAMERA_EMBEDDING. Can you also make it an optional input like the start image?

You should also include a node that can generate some basic camera_conditions in this pr.

@George0726
Copy link
Author

I don't think the camera_conditions should be of type LATENT because it's confusing, it should be a different type like WAN_CAMERA_EMBEDDING. Can you also make it an optional input like the start image?

You should also include a node that can generate some basic camera_conditions in this pr.

I have updated the code based on your suggestions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@yoland68 yoland68 Awaiting requested review from yoland68 yoland68 is a code owner

@robinjhuang robinjhuang Awaiting requested review from robinjhuang robinjhuang is a code owner

@huchenlei huchenlei Awaiting requested review from huchenlei huchenlei is a code owner

@pythongosssss pythongosssss Awaiting requested review from pythongosssss pythongosssss is a code owner

@ltdrdata ltdrdata Awaiting requested review from ltdrdata ltdrdata is a code owner

@Kosinkadink Kosinkadink Awaiting requested review from Kosinkadink Kosinkadink is a code owner

6460

@webfiltered webfiltered Awaiting requested review from webfiltered webfiltered is a code owner

@comfyanonymous comfyanonymous Awaiting requested review from comfyanonymous comfyanonymous is a code owner

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@George0726 @Foul-Tarnished @comfyanonymous
0