Skip to content

[TLE][Ascend][XCS][FEAT] Add enable-legacy-insert-load-store-for-mix-cv kernel lau… - #1132

Open
huanghaoXcore wants to merge 1 commit into
triton_v3.5.xfrom
hh_3.5_dev
Open

huanghaoXcore wants to merge 1 commit into
triton_v3.5.xfrom
hh_3.5_dev

Conversation

@huanghaoXcore

Copy link
Copy Markdown
Collaborator

Add an enable_legacy_insert_load_store_for_mix_cv field to NPUOptions so the flag can be passed as a per-kernel launch kwarg, and forward it to bishengir-compile as --enable-legacy-insert-load-store-for-mix-cv in both the 910_95 and A2/A3 paths, following the existing disable_auto_cv_work_space_manage pattern. The option rolls the InsertLoadStoreForMixCV pass back to its pre-refactor implementation, avoiding the refactored pass misinferring memscope/coreType for PIPE_MTE2 custom ops (out planned into GM workspace plus spurious cbuf-to-cbuf loads that conflict with the __cbuf__/__ubuf__ C++ ABI).

Switch the gather_gm_to_l1 / gather_gm_to_ub examples in test_custom_ops.py from the disable_auto_cv_work_space_manage=True workaround to the new option, and update CUSTOM_OP_USAGE.md accordingly. The old kwarg disabled mix-CV workspace management wholesale (also disabling multi-buffering / CV pipelining), while the new one only rolls back this single pass. The kwarg can be dropped once bishengir fixes the custom-op inference bug in the refactored pass.

@github-actions github-actions Bot added DOC Improvements or additions to documentation tle ascend CORE triton_v3.5.x labels Sep 9, 2026
…cv kernel launch option

Add an `enable_legacy_insert_load_store_for_mix_cv` field to NPUOptions so
the flag can be passed as a per-kernel launch kwarg, and forward it to
bishengir-compile as `--enable-legacy-insert-load-store-for-mix-cv` in both
the 910_95 and A2/A3 paths, following the existing
`disable_auto_cv_work_space_manage` pattern. The option rolls the
`InsertLoadStoreForMixCV` pass back to its pre-refactor implementation,
avoiding the refactored pass misinferring memscope/coreType for PIPE_MTE2
custom ops (out planned into GM workspace plus spurious cbuf-to-cbuf
loads that conflict with the `__cbuf__`/`__ubuf__` C++ ABI).

Switch the gather_gm_to_l1 / gather_gm_to_ub examples in
test_custom_ops.py from the `disable_auto_cv_work_space_manage=True`
workaround to the new option, and update CUSTOM_OP_USAGE.md accordingly.
The old kwarg disabled mix-CV workspace management wholesale (also
disabling multi-buffering / CV pipelining), while the new one only rolls
back this single pass. The kwarg can be dropped once bishengir fixes the
custom-op inference bug in the refactored pass.
@huanghaoXcore huanghaoXcore changed the title [TLE][FEAT] Add enable-legacy-insert-load-store-for-mix-cv kernel lau… [TLE][Ascend][XCS][FEAT] Add enable-legacy-insert-load-store-for-mix-cv kernel lau… Sep 9, 2026
@neoskypig

Copy link
Copy Markdown
Collaborator

LGTM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ascend CORE DOC Improvements or additions to documentation tle triton_v3.5.x

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants