Skip to content

[rollout] In-memory relayout between sharded layouts (two-stage relay, pipelined execution) and ZeRO-3 training-state move - #9074

Draft
LiRunGuo wants to merge 9 commits into
deepspeedai:masterfrom
LiRunGuo:in-memory-relayout
Draft

LiRunGuo wants to merge 9 commits into
deepspeedai:masterfrom
LiRunGuo:in-memory-relayout

Commits

  1. Commits on Nov 12, 2026

  2. Commits on Nov 14, 2026

  3. Commits on Nov 15, 2026

  4. Commits on Nov 17, 2026

  5. Commits on Nov 18, 2026

  6. Commits on Nov 19, 2026