AstrAI

Files

T

ViperEkura ceadc34ea9 feat: auto-checkpoint on SIGTERM/SIGINT with DDP support

- Register SIGTERM/SIGINT handlers in training loop, set stop flag on signal
- Check stop_requested at each epoch/batch boundary, break and call on_error to save checkpoint
- LocalStrategy parent forwards signal to child processes via terminate(), waits up to 600s for graceful exit
- TrainContext gains threading.Event-based stop_requested/request_stop
- Tests verify SIGTERM/SIGINT trigger checkpoint save with exit code 0, works on both CPU and GPU

2026-07-25 20:40:54 +08:00

__init__.py

chore : 升级 torch 2.11.0+cu128，移除自定义 Muon，修复 gloo device_id

2026-06-27 16:10:37 +08:00

metric_util.py

refactor : grad_norm 指标简化，clip_grad_norm 移至 executor

2026-06-30 14:59:43 +08:00

rollout.py

fix: correct online rollout lifecycle

2026-07-23 19:01:37 +08:00

schedule.py

fix: scheduler division-by-zero, loss_mask bool