Conversation
Add the isolated LTX-2.5 distilled model, T2V/I2V pipeline, NATTEN-backed DiffVAE decoder, and single-H100 example.\n\nAdd frozen upstream capture, artifact comparison, and cold/warm benchmark harnesses. Default DiffVAE decoding follows upstream CHUNKED_EAGER with cutlass-fna.\n\nVerification: 61 passed, 1 skipped in the LTX model, pipeline, and validation suites; formal T2V/I2V artifact comparisons passed.
Reuse a block-streamed LTX-2.5 transformer for CPU-offload requests while retaining pinned CPU weights and releasing transient GPU buffers between calls.\n\nAdd coverage for streamed-transformer reuse and release.\n\nVerification: ruff format --check; ruff check; pytest tests/unit/pipelines/ltx25_distilled -q (27 passed); formal 5-sample T2V performance comparator passed against pinned upstream.
Document the matched five-sample H100 p50 results for T2V and frozen I2V in CPU-offload and no-offload modes. Record the transformer block-streaming behavior, comparison artifacts, and no-offload memory headroom.\n\nVerification: ruff check and format audits for LTX-2.5 and LTX-2.3 paths; focused LTX-2.5 tests (62 passed, 1 model-root skip); shared flow-matching regression (42 passed); public LTX-2.5 and LTX-2.3 CLI help; matched upstream/TeleFuser five-sample GPU comparison gates for all four documented workloads.
Add a reusable example README template and make it the documented convention for new model-family examples. Expand the LTX-2.5 distilled guide with the official model source, checkpoint layout, supported features, T2V/I2V commands, CLI options, configuration constraints, and troubleshooting guidance. Verification: - git diff --cached --check - LTX-2.5 example --help - full LTX-2.5 T2V generation and ffmpeg decode validation
Load all LTX2.5 checkpoint components through ModuleManager and initialize the public pipeline from manager-owned modules. Split text encoding, video conditioning, denoising, latent upsampling, video decoding, and audio decoding into flat stage modules while preserving the two-phase sampling and output contracts. Update the example, documentation, and focused tests. Verification: pytest tests/unit/pipelines/ltx25_distilled -q; ruff check; ruff format --check; git diff --check; full H100 T2V output matched all decoded baseline video frames.
- add configurable dense attention and Ulysses sequence parallelism for 1/2/4-GPU execution - split T2V and I2V examples, add the default I2V reference asset, and register full two-GPU regressions - consolidate LTX-2.5 documentation and news while standardizing input_image_path across LTX and MiniMax examples Verification: - full 121-frame two-GPU T2V and I2V regression comparisons - pytest tests/unit/test_run_examples.py -q - pytest tests/unit/pipelines/minimax_h3/test_examples.py -q - ruff check, ruff format --check, and git diff --check
- package the LTX2.5 pipeline tests so duplicate test_pipeline module names collect independently - register LTX2.5 and MiniMax Turbo examples in service parity coverage and preserve first_image_path compatibility - remove the unreferenced transformer structure comparison probe while retaining reproducible artifact and benchmark tools Verification: - pytest tests/unit -q --cov=telefuser --cov-report=xml --cov-report=term-missing -m 'not gpu and not distributed and not slow and not quant' (1358 passed, 1 skipped) - pytest tests/unit/pipelines/ltx25_distilled -q (31 passed) - pytest tests/unit/service/test_example_service_parity.py -q (55 passed) - pytest tests/unit/pipelines/minimax_h3/test_examples.py -q (26 passed) - ruff check, ruff format --check, and git diff --check
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Add isolated LTX-2.5 distilled text-to-video and image-to-video inference with synchronized audio generation.
The implementation loads checkpoint components through
ModuleManagerand composes six stages: text encoding, video conditioning, denoising, latent upsampling, video decoding, and audio decoding. It supports one, two, or four H100 GPUs with Ulysses sequence parallelism, FSDP2 transformer sharding, and selectable dense attention backends.The default DiffVAE path follows upstream
CHUNKED_EAGERdecoding with NATTENcutlass-fna. This PR also adds upstream capture, artifact comparison, checkpoint inspection, and cold/warm benchmark tooling.Motivation
LTX-2.5 differs substantially from the existing LTX-2.3 implementation in model architecture, checkpoint layout, conditioning, sampling, and audio/video decoding. A separate implementation preserves upstream behavior without coupling the two model families.
The integration also provides reproducible quality and performance gates, framework-native stage composition, and multi-GPU regression coverage.
Type of Change
Changes Made
ModuleManagerand a six-stage distilled T2V/I2V pipeline.examples/run_examples.py.input_image_path.Testing
Test commands:
Verification results:
Checklist
pre-commit run --all-filesexecutedpytest tests/) executedRelated Issues
N/A
Additional Notes
GPU Architecture Support
Performance Impact
Matched single-H100 BF16 p50 end-to-end results:
The no-offload TeleFuser profile reserved 79.14 GB at peak.