Skip to content

TF upgrade to 5.15.1 - #1287

Open
quic-mamta wants to merge 18 commits into
quic:mainfrom
quic-mamta:tf_upgrade
Open

quic-mamta wants to merge 18 commits into
quic:mainfrom
quic-mamta:tf_upgrade

Conversation

@quic-mamta

@quic-mamta quic-mamta commented Aug 26, 2026 •

Copy link
Copy Markdown
Contributor

Summary

This PR upgrades QEfficient’s Transformers dependency from 5.5.4 to 5.15.1 and updates the affected model wrappers/tests for API changes introduced in the newer Transformers release.

Changes

  • Updated the Transformers pin to 5.15.1.
  • Added compatibility for renamed/moved Transformers classes:
    • CLIPTextTransformer fallback to CLIPTextModel
    • GraniteMoE expert/router rename handling
  • Fixed Gemma4 heterogeneous config handling:
    • Avoid direct global access to per-layer attributes like head_dim/global_head_dim
    • Resolve per-layer config values when building dummy KV cache tensors
    • Updated Gemma4 accuracy tests to avoid unsafe hasattr(...) on heterogeneous configs
  • Updated Qwen3.5 and Qwen3.5-MoE wrappers for Transformers 5.15.1 recurrent attention mask/layer-type behavior.
  • Fixed GLM4-MoE router reshaping to use hidden_dim.
  • Updated transform coverage for renamed optimized MoE components.

Signed-off-by: Mamta Singh <mamtsing@qti.qualcomm.com>
@quic-mamta quic-mamta self-assigned this Aug 26, 2026
@quic-mamta
quic-mamta marked this pull request as draft August 26, 2026 08:34
Signed-off-by: Mamta Singh <mamtsing@qti.qualcomm.com>
@quic-mamta
quic-mamta force-pushed the tf_upgrade branch 2 times, most recently from 5fb66bc to 6f095ae Compare August 26, 2026 10:18
Signed-off-by: Mamta Singh <mamtsing@qti.qualcomm.com>
Comment thread QEfficient/transformers/models/clip/modeling_clip.py Outdated
quic-mamta and others added 3 commits August 27, 2026 02:33
Signed-off-by: Mamta Singh <mamtsing@qti.qualcomm.com>
Signed-off-by: Mamta Singh <168400541+quic-mamta@users.noreply.github.com>
@quic-mamta
quic-mamta marked this pull request as ready for review August 31, 2026 06:39
quic-mamta and others added 2 commits September 7, 2026 12:20
Signed-off-by: Mamta Singh <mamtsing@qti.qualcomm.com>
quic-mamta and others added 5 commits September 14, 2026 00:05
Signed-off-by: Mamta Singh <168400541+quic-mamta@users.noreply.github.com>
Signed-off-by: Mamta Singh <168400541+quic-mamta@users.noreply.github.com>
Signed-off-by: Mamta Singh <168400541+quic-mamta@users.noreply.github.com>
Signed-off-by: Mamta Singh <mamtsing@qti.qualcomm.com>
@quic-mamta

Copy link
Copy Markdown
Contributor Author

CI-Ready

quic-mamta and others added 2 commits September 27, 2026 01:54
Signed-off-by: Mamta Singh <168400541+quic-mamta@users.noreply.github.com>
Signed-off-by: Mamta Singh <mamtsing@qti.qualcomm.com>
@quic-mamta

Copy link
Copy Markdown
Contributor Author

CI-Ready

Signed-off-by: Mamta Singh <mamtsing@qti.qualcomm.com>
@quic-mamta

Copy link
Copy Markdown
Contributor Author

CI-Ready

Signed-off-by: Mamta Singh <mamtsing@qti.qualcomm.com>
Signed-off-by: Mamta Singh <mamtsing@qti.qualcomm.com>

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants