Repository navigation

Allow tensor parallelism and context parallelism in one ParallelConfig - #14725

Open

whn09 wants to merge 8 commits into

huggingface:mainfrom

whn09:tp-cp-compose

Open

Allow tensor parallelism and context parallelism in one ParallelConfig#14725
whn09 wants to merge 8 commits into
huggingface:mainfrom
whn09:tp-cp-compose

Commits on Sep 7, 2026
- Allow tensor parallelism and context parallelism in one ParallelConfig
  
  whn09
  and
  claude
  committed
  9c81ac6
Commits on Sep 16, 2026
- Merge branch 'main' into tp-cp-compose
  JingyaHuang
  authored
  2e6afea
Commits on Sep 22, 2026
- Merge branch 'main' into tp-cp-compose
  JingyaHuang
  authored
  12058ee
Commits on Sep 30, 2026
- Merge branch 'main' into tp-cp-compose
  JingyaHuang
  authored
  2eff547
Commits on Oct 14, 2026
- Merge branch 'main' into tp-cp-compose
  JingyaHuang
  committed
  7077cf2
- Apply the context-parallel hooks on the sharded-load path too
  
  authored and
  JingyaHuang
  committed
  3f55884
- fix: pad uneven all-gathers on Neuron and TPU in _all_gather_anything
  JingyaHuang
  committed
  8a1c4d7
- Validate TP+CP degrees up front and add tests for the combined mesh
  
  JingyaHuang
  and
  claude
  committed
  ce1581f