Repository navigation
[LTX-2] conditioning_frame_rate (fix branch, not to be merged) - #6
Open
christopher5106 wants to merge 1 commit into
Open
christopher5106 wants to merge 1 commit into
christopher5106 wants to merge 1 commit into
Conversation
christopher5106
force-pushed
the
fix_ltx2_conditioning_frame_rate
branch
from
October 6, 2026 15:44
ac1aa33 to
446cbaf
Compare
… base from the playback frame rate LTX-2 places video tokens on a time axis in seconds (`pixel_frame / fps` in the RoPE coordinates), derived from `frame_rate`. Adapters such as the LTX-2.5 Slow-Motion-Control LoRA are conditioned on a different rate (`fps / speed`) than the video plays at. Add an optional `conditioning_frame_rate` to the LTX-2 classic pipelines and modular blocks: it drives the video, keyframe and reference coordinates and the transformer's `fps`, while the audio length, the duration head and the returned video keep following `frame_rate`. `None` resolves to `frame_rate`, leaving current outputs unchanged.
christopher5106
force-pushed
the
fix_ltx2_conditioning_frame_rate
branch
from
October 7, 2026 09:35
446cbaf to
05f0e34
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Tracking PR for
fix_ltx2_conditioning_frame_rate, opened againstmain(the upstream mirror). It is never merged here. The commit is cherry-picked ontoscenariountil upstream merges it.Upstream PR: huggingface#14967
Adds an optional
conditioning_frame_rateto the LTX-2 classic pipelines and modular blocks. It sets the time base of the positional embeddings separately fromframe_rate, the playback rate, which keeps driving the audio length, the duration head and the output. It is needed forLightricks/LTX-2.5-22b-LoRA-Slow-Motion-Control, which conditions onframe_rate / speed. The default (None→frame_rate) leaves current behavior bit-identical.Tests:
test_conditioning_frame_rate_rescales_only_the_video_time_axisintests/pipelines/ltx2/test_ltx2.pyandtests/modular_pipelines/ltx2/test_modular_pipeline_ltx25.py.When upstream merges it: delete this branch, close this PR, sync
main, and rebasescenariodropping the cherry-pick.