Skip to content

feat(checkpoint): support sharded Gym turn recovery - #4322

Open
macandro96 wants to merge 1 commit into
amahishi/rl-checkpoint-scale-optimizationsfrom
amahishi/prefix-recovery-sharded-gym
Open

macandro96 wants to merge 1 commit into
amahishi/rl-checkpoint-scale-optimizationsfrom
amahishi/prefix-recovery-sharded-gym

Conversation

@macandro96

Copy link
Copy Markdown
Contributor

Summary

  • coordinate turn-level Gym checkpoint prepare, commit, restore, resume, and abort across multiple shards
  • persist shard-local artifacts under deterministic gym-shards/<instance>/ paths
  • merge shard topology while deduplicating the shared policy-model participant
  • route recovered continuations and completion ACKs back to their owning shard
  • retain the one-replica-per-shard guard

Stack

Validation

  • ruff check and ruff format --check passed on the sharded-turn tree
  • Python compilation passed
  • the two-shard turn-recovery functional test still needs to run on the cluster

@copy-pr-bot

copy-pr-bot Bot commented Sep 29, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@github-actions github-actions Bot added the Documentation Improvements or additions to documentation label Sep 29, 2026
@macandro96
macandro96 added this pull request to stack #4267 September 29, 2026 04:25
@macandro96
macandro96 marked this pull request as ready for review September 29, 2026 04:28
Signed-off-by: Anish Mahishi <amahishi@nvidia.com>
@macandro96
macandro96 force-pushed the amahishi/prefix-recovery-sharded-gym branch from 3edc562 to e170a6e Compare September 29, 2026 04:45

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant