Skip to content

Implement missing features on ModularPipeline #12386

Description

@vladmandic

as i'm looking to take advantage of new ModularPipeline ask is to implement some currently missing features

my use case is to convert existing loaded model using standard pipeline into modular pipeline. that functionality was provided via #11915 and is now working.

first minor obstacle is that modular pipeline does not have defined params for execution
in standard pipeline i can inspect __call__ signature to see which are allowed params
i currently work around this using
possible = [input_param.name for input_param in model.blocks.inputs]
please advise if this is acceptable

second one is that modular pipelines don't seem to implement normal callbacks at all (e.g. callback_on_step_end_tensor_inputs? at the minimum we need some kind of callback functionality to capture interim latents on each step

third is more cosmetic - modular pipeline does implement set_progress_bar_config, but its not doing anything as its not implement on actual block (tested with StableDiffusionXLModularPipeline)

cc @yiyixuxu @DN6 @sayakpaul

Activity

  1. added
    roadmapAdd to current release roadmap
    on Sep 29, 2025
  2. github-actions commented on Jan 9, 2026

    @github-actions
    Contributor

    This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

    Please note that issues that do not follow the contributing guidelines are likely to be ignored.

  3. removed
    staleIssues that haven't received updates
    on Jan 10, 2026
  4. yiyixuxu commented on Jan 10, 2026

    @yiyixuxu
    Collaborator

    we will add support for callback etc

  5. moved this from Todo to Future Release in Diffusers Roadmapon Jan 15, 2026
  6. github-actions commented on Feb 3, 2026

    @github-actions
    Contributor

    This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

    Please note that issues that do not follow the contributing guidelines are likely to be ignored.

  7. vladmandic commented on Aug 28, 2026

    @vladmandic
    ContributorAuthor

    diffusers is moving to modular-only for new pipelines, but modular pipelines still dont have clear way to perform callbacks more than 6 months later?
    cc @sayakpaul

  8. yiyixuxu commented on Oct 6, 2026

    @yiyixuxu
    Collaborator

    hi hi
    we will include this PR in next release #14159
    it adds first-class streaming to modulaar pipelines, so you won't need the callback/interrupt mechanism from the standard pipeline: pipe.stream() let you work with the pipeline interactively:

    for event in pipe.stream(prompt=...):
          latent = event.state.get("latents")
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    roadmapAdd to current release roadmapstaleIssues that haven't received updates

    Type

    No type

    Projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions