feat: 新增FSDP并行后端

- FSDPExecutor通过**fsdp_kwargs直传FSDP参数 - unwrap_model同时支持DDP和FSDP - parallel_mode新增fsdp选项
2026-05-25 19:43:14 +08:00
parent 82a3f2626f
commit 7df6eb9211
4 changed files with 39 additions and 2 deletions
@@ -97,7 +97,7 @@ class TrainConfig(BaseConfig):
    )
    parallel_mode: str = field(
        default="none",
-        metadata={"help": "Parallel strategy: none, ddp."},
+        metadata={"help": "Parallel strategy: none, ddp, fsdp."},
    )
    start_method: str = field(
        default="spawn",