ViperEkura 7feeb0b93e refactor: replace magic layout ints with TensorLayout enum ...

- Add TensorLayout enum (C++ + Python) to replace magic layout ints
- Add C10_CUDA_CHECK post-launch error checking to all kernel entries
- Add CUDAGuard + freqs_cis shape validation to rotary_emb.cu
- Cache SM count to eliminate per-call cudaDeviceGetAttribute
- Add DISPATCH_CAUSAL_MASK macro to deduplicate dispatcher if/else
- Convert mask type hints from X|None to Optional[X]

2026-08-01 11:05:52 +08:00

..

config

Make Nora+NAdamW the default optimizer

2026-07-31 23:16:39 +08:00

dataset

refactor: remove H5 storage backend in favor of mmap bin

2026-07-29 12:50:27 +08:00

extension

refactor: replace magic layout ints with TensorLayout enum

2026-08-01 11:05:52 +08:00

inference

perf: reduce decode overhead in scheduler and executor

2026-07-31 14:50:16 +08:00

model

refactor: unify rotary embedding interface and update docs

2026-07-31 16:52:25 +08:00

optim

fix: use torch.optim.AdamW in ManoAdamW instead of NAdamW

2026-08-01 09:20:54 +08:00

parallel

fix: broadcast ref/old model state_dict for FSDP

2026-07-31 08:32:22 +08:00

preprocessing

refactor: remove H5 storage backend in favor of mmap bin

2026-07-29 12:50:27 +08:00

serialization

refactor: remove H5 storage backend in favor of mmap bin

2026-07-29 12:50:27 +08:00

tokenize

refactor: simplify BaseFactory and separate ModelFactory from AutoModel

2026-07-30 09:38:20 +08:00

trainer

feat: add grad_snr metric with EMA-based gradient SNR tracking

2026-08-01 08:54:44 +08:00

__init__.py

chore: bump version to 1.3.12

2026-08-01 09:22:16 +08:00

factory.py

refactor: simplify BaseFactory and separate ModelFactory from AutoModel

2026-07-30 09:38:20 +08:00

protocols.py

refactor: 重构训练后端为 Executor 模式

2026-05-24 20:35:44 +08:00

signal_handler.py

refactor: move signal_handler from parallel/ to top-level for broader reuse

2026-07-28 10:36:17 +08:00