ViperEkura b092316385 feat : add distributed checkpoint via executor checkpoint_context ...

- Add checkpoint_context context manager to BaseExecutor with entry/exit barrier
- Add _gather_state_dict hook overridden per executor (template method)
- DDPExecutor skips unwrap on non-rank-0 to avoid redundant state_dict gather
- FSDPExecutor uses rank0_only=True to reduce memory on non-writers
- Remove redundant rank-0 guard from Checkpoint.save and manual barrier from Callback

2026-07-13 12:27:09 +08:00

..

config

fix : SFT pipeline position_ids default & doc boundary preservation

2026-07-04 15:59:11 +08:00

dataset

feat: add JSONL dataset store with on-the-fly tokenization

2026-07-04 15:42:33 +08:00

extension

feat: wire up paged decode CUDA kernel to Python extension

2026-07-11 18:40:49 +08:00

inference

refactor: clean up inference design patterns

2026-07-05 11:41:54 +08:00

model

perf: replace paged KV cache with contiguous ContiguousCache, decode all groups

2026-07-05 11:34:36 +08:00

parallel

feat : add distributed checkpoint via executor checkpoint_context

2026-07-13 12:27:09 +08:00

preprocessing

refactor: split mask builder by single/multi output

2026-07-08 21:18:34 +08:00

serialization

feat : add distributed checkpoint via executor checkpoint_context

2026-07-13 12:27:09 +08:00

tokenize

refactor : Pipeline 去除去重，ids 重命名为 sequence，泛型透传

2026-05-31 15:14:27 +08:00

trainer

feat : add distributed checkpoint via executor checkpoint_context

2026-07-13 12:27:09 +08:00

__init__.py

chore: bump version to 1.3.9

2026-07-12 21:04:20 +08:00

factory.py

fix: ForwardRef._evaluate Python 3.12 compatibility

2026-07-03 18:41:19 +08:00

protocols.py

refactor: 重构训练后端为 Executor 模式

2026-05-24 20:35:44 +08:00