ComfyPilotComfyPilot
工作流 / 视频 / Gemini Omni 1.1 Flash：参考生视频
Gemini Omni 1.1 Flash：参考生视频

Gemini Omni 1.1 Flash：参考生视频

Gemini Omni 1.1 Flash: Reference to Video

使用Gemini Omni 1.1 Flash的参考模式生成视频，将多张参考图像中的特定主体融入其中：图像中的角色、产品和物体会出现在场景中，而图像本身绝不会作为帧显示。使用<IMAGE_REF_0>等标签将每张图像绑定到一个角色，将角色参考与风格参考组合，并用自然语言配合原生音频指导场景。非常适合角色驱动的故事、产品植入和品牌一致的内容。

视频 5 个节点 2 个输入 90 次使用 ComfyUI ≥ 0.34.2 ComfyUI 6 KB

下载工作流 JSON 查看官方来源

下载后把文件拖进 ComfyUI 窗口即可打开。

节点构成

LoadImage × 2
GeminiVideoOmniV2 × 1
SaveVideo × 1
MarkdownNote × 1

官方标注的模型

Gemini Omni 1.1 Flash

工作流 JSON

和上面「下载工作流 JSON」是同一份文件。

1{
2 "id": "7e83a61c-87e6-43db-b836-8a684bbc8993",
3 "revision": 0,
4 "last_node_id": 15,
5 "last_link_id": 15,
6 "nodes": [
7 {
8 "id": 7,
9 "type": "GeminiVideoOmniV2",
10 "pos": [
11 388,
12 1090
13 ],
14 "size": [
15 400,
16 389.875
17 ],
18 "flags": [],
19 "order": 3,
20 "mode": 0,
21 "inputs": [
22 {
23 "label": "image_1",
24 "name": "model.images.image_1",
25 "shape": 7,
26 "type": "IMAGE",
27 "link": 12
28 },
29 {
30 "label": "image_2",
31 "name": "model.images.image_2",
32 "shape": 7,
33 "type": "IMAGE",
34 "link": 15
35 },
36 {
37 "label": "image_3",
38 "name": "model.images.image_3",
39 "shape": 7,
40 "type": "IMAGE",
41 "link": null
42 },
43 {
44 "label": "video_1",
45 "name": "model.videos.video_1",
46 "shape": 7,
47 "type": "VIDEO",
48 "link": null
49 }
50 ],
51 "outputs": [
52 {
53 "name": "VIDEO",
54 "type": "VIDEO",
55 "links": [
56 7
57 ]
58 },
59 {
60 "name": "STRING",
61 "type": "STRING",
62 "links": null
63 }
64 ],
65 "properties": {
66 "Node name for S&R": "GeminiVideoOmniV2"
67 },
68 "widgets_values": [
69 "Omni Flash 1.1",
70 "[# References <IMAGE_REF_0>@Image1 <IMAGE_REF_1>@Image2]\nA luxury eyeshadow commercial. The woman in <IMAGE_REF_1> sits at a bright makeup table in a soft daylight studio, wearing her cream blazer exactly as shown, her sleek pulled-back hairstyle and natural makeup unchanged. She opens the nude eyeshadow palette from <IMAGE_REF_1>, holding it up so the six warm terracotta shades catch the light, then sweeps a fluffy brush across the deep terracotta pan and blends one smooth stroke onto her eyelid. She turns her gaze to the camera with a calm confident smile, showing the finished look, the shade matching <IMAGE_REF_0> exactly. Use the reference images only for the character's identity and the product's design and colors; the infographic layout and text labels in <IMAGE_REF_0> must not appear. Single continuous shot, shallow depth of field, warm beige and terracotta palette, photorealistic beauty advertising style. Audio: soft elegant piano with a gentle brush-on-powder sound. 5 seconds, 16:9. No subtitles, no text overlays, no layout graphics, no black frames.",
71 "720p",
72 "16:9",
73 "reference_to_video",
74 648193469,
75 "randomize",
76 "randomize"
77 ],
78 "color": "#432",
79 "bgcolor": "#653"
80 },
81 {
82 "id": 8,
83 "type": "SaveVideo",
84 "pos": [
85 836,
86 1090
87 ],
88 "size": [
89 390,
90 381.890625
91 ],
92 "flags": [],
93 "order": 4,
94 "mode": 0,
95 "inputs": [
96 {
97 "name": "video",
98 "type": "VIDEO",
99 "link": 7
100 }
101 ],
102 "outputs": [
103 {
104 "name": "video",
105 "type": "VIDEO",
106 "links": null
107 }
108 ],
109 "properties": [],
110 "widgets_values": [
111 "video/Omni_Flash_1.1_r2v",
112 "auto",
113 "auto",
114 "auto"
115 ]
116 },
117 {
118 "id": 11,
119 "type": "LoadImage",
120 "pos": [
121 50,
122 1090
123 ],
124 "size": [
125 290,
126 345.9375
127 ],
128 "flags": [],
129 "order": 0,
130 "mode": 0,
131 "inputs": [],
132 "outputs": [
133 {
134 "name": "IMAGE",
135 "type": "IMAGE",
136 "links": [
137 12
138 ]
139 },
140 {
141 "name": "MASK",
142 "type": "MASK",
143 "links": null
144 }
145 ],
146 "properties": {
147 "Node name for S&R": "LoadImage"
148 },
149 "widgets_values": [
150 "terracotta_eyeshadow_palette.png",
151 "image"
152 ]
153 },
154 {
155 "id": 13,
156 "type": "MarkdownNote",
157 "pos": [
158 -330,
159 1090
160 ],
161 "size": [
162 331.015625,
163 363.03125
164 ],
165 "flags": [],
166 "order": 1,
167 "mode": 0,
168 "inputs": [],
169 "outputs": [],
170 "properties": [],
171 "widgets_values": [
172 "## Input Assets\n\n- [terracotta_eyeshadow_palette.png](https://raw.githubusercontent.com/Comfy-Org/workflow_templates/refs/heads/main/input/terracotta_eyeshadow_palette.png) — required workflow input (`input/terracotta_eyeshadow_palette.png`)\n- [asian_female_model_beige_suit.png](https://raw.githubusercontent.com/Comfy-Org/workflow_templates/refs/heads/main/input/asian_female_model_beige_suit.png) — required workflow input (`input/asian_female_model_beige_suit.png`)\n\n\n## Report Issue\n\nNote: Please update ComfyUI first ([guide](https://docs.comfy.org/installation/update_comfyui)) and prepare required models. Desktop/Cloud updates follow stable releases, so some nightly-supported models may not be available yet.\n\n- Cannot run / runtime errors: [ComfyUI/issues](https://github.com/comfyanonymous/ComfyUI/issues)\n- UI / frontend issues: [ComfyUI_frontend/issues](https://github.com/Comfy-Org/ComfyUI_frontend/issues)\n- Workflow issues: [workflow_templates/issues](https://github.com/Comfy-Org/workflow_templates/issues)\n"
173 ],
174 "color": "#222",
175 "bgcolor": "#000"
176 },
177 {
178 "id": 15,
179 "type": "LoadImage",
180 "pos": [
181 50,
182 1513.9375
183 ],
184 "size": [
185 282.78125,
186 345.9375
187 ],
188 "flags": [],
189 "order": 2,
190 "mode": 0,
191 "inputs": [],
192 "outputs": [
193 {
194 "name": "IMAGE",
195 "type": "IMAGE",
196 "links": [
197 15
198 ]
199 },
200 {
201 "name": "MASK",
202 "type": "MASK",
203 "links": null
204 }
205 ],
206 "properties": {
207 "Node name for S&R": "LoadImage"
208 },
209 "widgets_values": [
210 "asian_female_model_beige_suit.png",
211 "image"
212 ]
213 }
214 ],
215 "links": [
216 [
217 7,
218 7,
219 0,
220 8,
221 0,
222 "VIDEO"
223 ],
224 [
225 12,
226 11,
227 0,
228 7,
229 0,
230 "IMAGE"
231 ],
232 [
233 15,
234 15,
235 0,
236 7,
237 1,
238 "IMAGE"
239 ]
240 ],
241 "groups": [],
242 "config": [],
243 "extra": {
244 "ds": {
245 "scale": 0.4288881817042997,
246 "offset": [
247 1467.397091626438,
248 -424.5337363555544
249 ]
250 },
251 "frontendVersion": "1.48.7",
252 "VHS_latentpreview": false,
253 "VHS_latentpreviewrate": 0,
254 "VHS_MetadataImage": true,
255 "VHS_KeepIntermediate": true
256 },
257 "version": 0.4
258}