feat: 新增FSDP并行后端

- FSDPExecutor通过**fsdp_kwargs直传FSDP参数
- unwrap_model同时支持DDP和FSDP
- parallel_mode新增fsdp选项
This commit is contained in:
2026-05-25 19:43:14 +08:00
parent 82a3f2626f
commit 7df6eb9211
4 changed files with 39 additions and 2 deletions
+4
View File
@@ -2,7 +2,9 @@ from astrai.parallel.executor import (
AccumOptimizer,
AccumScheduler,
BaseExecutor,
DDPExecutor,
ExecutorFactory,
FSDPExecutor,
GradientState,
NoneExecutor,
)
@@ -31,4 +33,6 @@ __all__ = [
"AccumOptimizer",
"AccumScheduler",
"NoneExecutor",
"DDPExecutor",
"FSDPExecutor",
]