Added Wan 2.2 fun control docs

docs.json

@@ -152,6 +152,7 @@
                         "pages": [
                           "tutorials/video/wan/wan2_2",
                           "tutorials/video/wan/wan2-2-fun-inp",
+                          "tutorials/video/wan/wan2-2-fun-control",
                           {
                             "group": "Wan2.1",
                             "pages": [
@@ -700,6 +701,7 @@
                         "pages": [
                           "zh-CN/tutorials/video/wan/wan2_2",
                           "zh-CN/tutorials/video/wan/wan2-2-fun-inp",
+                          "zh-CN/tutorials/video/wan/wan2-2-fun-control",
                           {
                             "group": "Wan2.1",
                             "pages": [

tutorials/video/wan/wan2-2-fun-control.mdx

@@ -0,0 +1,123 @@
+---
+title: "ComfyUI Wan2.2 Fun Control Video Generation Example"
+description: "This article introduces how to use ComfyUI to complete the Wan2.2 Fun Control video generation using control videos"
+sidebarTitle: "Wan2.2 Fun Control"
+---
+
+import UpdateReminder from '/snippets/tutorials/update-reminder.mdx'
+
+**Wan2.2-Fun-Control** is a next-generation video generation and control model launched by Alibaba PAI team. Through innovative Control Codes mechanism combined with deep learning and multi-modal conditional inputs, it can generate high-quality videos that comply with preset control conditions. The model is released under the **Apache 2.0 license** and supports commercial use.
+
+**Key Features**:
+- **Multi-modal Control**: Supports multiple control conditions including **Canny (line art)**, **Depth**, **OpenPose (human pose)**, **MLSD (geometric edges)**, and **trajectory control**
+- **High-Quality Video Generation**: Based on the Wan2.2 architecture, outputs film-level quality videos
+- **Multi-language Support**: Supports multi-language prompts including Chinese and English
+
+Below are the relevant model weights and code repositories:
+
+- [🤗Wan2.2-Fun-A14B-Control](https://huggingface.co/alibaba-pai/Wan2.2-Fun-A14B-Control)
+- Code repository: [VideoX-Fun](https://github.com/aigc-apps/VideoX-Fun)
+
+<UpdateReminder/>
+
+## Wan2.2 Fun Control Video Generation Workflow Example
+
+This workflow provides two versions:
+1. A version using [Wan2.2-Lightning](https://huggingface.co/lightx2v/Wan2.2-Lightning) 4-step LoRA from lightx2v: may cause some loss in video dynamics but offers faster speed
+2. A fp8_scaled version without acceleration LoRA
+
+Below are the test results using an RTX4090D 24GB VRAM GPU at 640×640 resolution with 81 frames
+
+| Model Type               | VRAM Usage | First Generation Time | Second Generation Time |
+| ------------------------ | ---------- | -------------------- | --------------------- |
+| fp8_scaled               | 83%        | ≈ 524s               | ≈ 520s                |
+| fp8_scaled + 4-step LoRA | 89%        | ≈ 138s               | ≈ 79s                 |
+
+Since using the 4-step LoRA provides a better experience for first-time workflow users, but may cause some loss in video dynamics, we have enabled the accelerated LoRA version by default. If you want to enable the other workflow, select it and use **Ctrl+B** to activate.
+
+### 1. Download Workflow and Materials
+
+Download the video below or JSON file and drag it into ComfyUI to load the workflow
+
+<video
+  controls
+  className="w-full aspect-video"
+  src="https://raw.githubusercontent.com/Comfy-Org/example_workflows/refs/heads/main/video/wan/wan2.2_fun_control/wan2.2_14B_fun_inp.mp4"
+></video>
+
+<a className="prose"  target='_blank'  href="https://raw.githubusercontent.com/Comfy-Org/workflow_templates/refs/heads/main/templates/video_wan2_2_14B_fun_control.json" style={{ display: 'inline-block', backgroundColor: '#0078D6', color: '#ffffff', padding: '10px 20px', borderRadius: '8px', borderColor: "transparent", textDecoration: 'none', fontWeight: 'bold'}}>
+    <p className="prose" style={{ margin: 0, fontSize: "0.8rem" }}>Download JSON Workflow</p>
+</a>
+
+Please download the following images and videos as input materials.
+
+![Input start image](https://raw.githubusercontent.com/Comfy-Org/example_workflows/refs/heads/main/video/wan/wan2.2_fun_control/input.jpg)
+
+<video
+  controls
+  className="w-full aspect-video"
+  src="https://raw.githubusercontent.com/Comfy-Org/example_workflows/refs/heads/main/video/wan/wan2.2_fun_control/control_video.mp4"
+></video>
+
+> We use a preprocessed video here. 
+
+### 2. Models
+
+You can find the models below at [Wan_2.2_ComfyUI_Repackaged](https://huggingface.co/Comfy-Org/Wan_2.2_ComfyUI_Repackaged)
+
+**Diffusion Model**
+- [wan2.2_fun_control_high_noise_14B_fp8_scaled.safetensors](https://huggingface.co/Comfy-Org/Wan_2.2_ComfyUI_Repackaged/resolve/main/split_files/diffusion_models/wan2.2_fun_control_high_noise_14B_fp8_scaled.safetensors)
+- [wan2.2_fun_control_low_noise_14B_fp8_scaled.safetensors](https://huggingface.co/Comfy-Org/Wan_2.2_ComfyUI_Repackaged/resolve/main/split_files/diffusion_models/wan2.2_fun_control_low_noise_14B_fp8_scaled.safetensors)
+
+**Wan2.2-Lightning LoRA (Optional, for acceleration)**
+- [wan2.2_i2v_lightx2v_4steps_lora_v1_high_noise.safetensors](https://huggingface.co/Comfy-Org/Wan_2.2_ComfyUI_Repackaged/resolve/main/split_files/loras/wan2.2_i2v_lightx2v_4steps_lora_v1_high_noise.safetensors)
+- [wan2.2_i2v_lightx2v_4steps_lora_v1_low_noise.safetensors](https://huggingface.co/Comfy-Org/Wan_2.2_ComfyUI_Repackaged/resolve/main/split_files/loras/wan2.2_i2v_lightx2v_4steps_lora_v1_low_noise.safetensors)
+
+**VAE**
+- [wan_2.1_vae.safetensors](https://huggingface.co/Comfy-Org/Wan_2.2_ComfyUI_Repackaged/resolve/main/split_files/vae/wan_2.1_vae.safetensors)
+
+**Text Encoder**   
+- [umt5_xxl_fp8_e4m3fn_scaled.safetensors](https://huggingface.co/Comfy-Org/Wan_2.1_ComfyUI_repackaged/resolve/main/split_files/text_encoders/umt5_xxl_fp8_e4m3fn_scaled.safetensors)
+
+```
+ComfyUI/
+├───📂 models/
+│   ├───📂 diffusion_models/
+│   │   ├─── wan2.2_fun_control_low_noise_14B_fp8_scaled.safetensors
+│   │   └─── wan2.2_fun_control_high_noise_14B_fp8_scaled.safetensors
+│   ├───📂 loras/
+│   │   ├─── wan2.2_i2v_lightx2v_4steps_lora_v1_high_noise.safetensors
+│   │   └─── wan2.2_i2v_lightx2v_4steps_lora_v1_low_noise.safetensors
+│   ├───📂 text_encoders/
+│   │   └─── umt5_xxl_fp8_e4m3fn_scaled.safetensors 
+│   └───📂 vae/
+│       └── wan_2.1_vae.safetensors
+```
+
+
+### 3. Workflow Guide
+
+![Wan2.2 Fun Control Workflow Steps](/images/tutorial/video/wan/wan2_2/wan_2.2_14b_fun_control.jpg)
+
+<Note>
+  This workflow uses LoRA. Please ensure the corresponding Diffusion model and LoRA are matched - high noise and low noise models and LoRAs need to be used correspondingly.
+</Note>
+
+1. **High noise** model and **LoRA** loading
+   - Ensure the `Load Diffusion Model` node loads the `wan2.2_fun_control_high_noise_14B_fp8_scaled.safetensors` model
+   - Ensure the `LoraLoaderModelOnly` node loads the `wan2.2_i2v_lightx2v_4steps_lora_v1_high_noise.safetensors`
+2. **Low noise** model and **LoRA** loading
+   - Ensure the `Load Diffusion Model` node loads the `wan2.2_fun_control_low_noise_14B_fp8_scaled.safetensors` model
+   - Ensure the `LoraLoaderModelOnly` node loads the `wan2.2_i2v_lightx2v_4steps_lora_v1_low_noise.safetensors`
+3. Ensure the `Load CLIP` node loads the `umt5_xxl_fp8_e4m3fn_scaled.safetensors` model
+4. Ensure the `Load VAE` node loads the `wan_2.1_vae.safetensors` model
+5. Upload the start frame in the `Load Image` node
+6. In the second `Load video` node, load the pose control video. The provided video has been preprocessed and can be used directly
+7. Since we provide a preprocessed pose video, the corresponding video image preprocessing node needs to be disabled. You can select it and use `Ctrl + B` to disable it
+8. Modify the Prompt - you can use both Chinese and English
+9. In `Wan22FunControlToVideo`, modify the video dimensions. The default is set to 640×640 resolution to avoid excessive processing time for users with low VRAM
+10. Click the `Run` button, or use the shortcut `Ctrl(cmd) + Enter` to execute video generation
+
+### Additional Notes
+
+Since ComfyUI's built-in nodes only include Canny preprocessor, you can use tools like [ComfyUI-comfyui_controlnet_aux](https://github.com/Fannovel16/comfyui_controlnet_aux) to implement other types of image preprocessing

tutorials/video/wan/wan2-2-fun-inp.mdx

@@ -29,14 +29,14 @@ This workflow provides two versions:
 1. A version using [Wan2.2-Lightning](https://huggingface.co/lightx2v/Wan2.2-Lightning) 4-step LoRA from lightx2v for accelerated video generation
 2. A fp8_scaled version without acceleration LoRA
 
-Below are the test results using an RTX4090D 24GB VRAM GPU
+Below are the test results using an RTX4090D 24GB VRAM GPU at 640×640 resolution with 81 frames
 
-| Model Type               | Resolution | VRAM Usage | First Generation Time | Second Generation Time |
-| ------------------------ | ---------- | ---------- | -------------------- | --------------------- |
-| fp8_scaled               | 640×640    | 83%        | ≈ 524s               | ≈ 520s                |
-| fp8_scaled + 4-step LoRA | 640×640    | 89%        | ≈ 138s               | ≈ 79s                 |
+| Model Type               | VRAM Usage | First Generation Time | Second Generation Time |
+| ------------------------ | ---------- | -------------------- | --------------------- |
+| fp8_scaled               | 83%        | ≈ 524s               | ≈ 520s                |
+| fp8_scaled + 4-step LoRA | 89%        | ≈ 138s               | ≈ 79s                 |
 
-Since the acceleration with LoRA is significant, the provided workflows enable the accelerated LoRA version by default. If you want to enable the other workflow, select it and use **Ctrl+B** to activate.
+Since the acceleration with LoRA is significant but the video dynamic is lost,  the provided workflows enable the accelerated LoRA version by default. If you want to enable the other workflow, select it and use **Ctrl+B** to activate.
 
 ### 1. Download Workflow File
 
@@ -59,7 +59,7 @@ Use the following materials as the start and end frames
 ![Wan2.2 Fun Control ComfyUI Workflow Start Frame Material](https://raw.githubusercontent.com/Comfy-Org/example_workflows/refs/heads/main/video/wan/wan2.2_fun_inp/start_image.png)
 ![Wan2.2 Fun Control ComfyUI Workflow End Frame Material](https://raw.githubusercontent.com/Comfy-Org/example_workflows/refs/heads/main/video/wan/wan2.2_fun_inp/end_image.png)
 
-### 2. Manually Download Models
+### 2. Models
 
 **Diffusion Model**
 - [wan2.2_fun_inpaint_high_noise_14B_fp8_scaled.safetensors](https://huggingface.co/Comfy-Org/Wan_2.2_ComfyUI_Repackaged/resolve/main/split_files/diffusion_models/wan2.2_fun_inpaint_high_noise_14B_fp8_scaled.safetensors)
@@ -90,7 +90,7 @@ ComfyUI/
 │       └── wan_2.1_vae.safetensors
 ```
 
-### 3. Step-by-Step Workflow Guide
+### 3. Workflow Guide
 
 ![Workflow Step Image](/images/tutorial/video/wan/wan2_2/wan_2.2_14b_fun_inp.jpg)