ViperEkura 99b5d2b2da perf: batch tokenizer preprocessing

2026-07-23 18:42:19 +08:00

..

config

perf: batch tokenizer preprocessing

2026-07-23 18:42:19 +08:00

dataset

feat: support SFT directly from JSONL without dataset_config.json

2026-07-20 17:25:09 +08:00

extension

feat: add attention dimension dispatch

2026-07-21 12:52:45 +08:00

inference

perf: eliminate GPU syncs in contiguous cache write/gather hot paths

2026-07-21 16:40:56 +08:00

model

refactor : align config field names with Hugging Face

2026-07-20 22:05:31 +08:00

parallel

style: apply ruff formatting to FSDP2 changes

2026-07-23 16:30:10 +08:00

preprocessing

perf: batch tokenizer preprocessing

2026-07-23 18:42:19 +08:00

serialization

fix: use copy-on-write mmap mode to silence non-writable tensor warning

2026-07-22 17:37:41 +08:00

tokenize

refactor: unify tokenizer encode and apply_chat_template for batch support

2026-07-20 17:49:26 +08:00

trainer

fix: separate attn_mask and loss_mask in get_logprobs, compose causal masking in strategy

2026-07-21 23:47:28 +08:00

__init__.py

chore: bump to 1.3.10

2026-07-19 16:40:27 +08:00

factory.py

fix: make FSDP2 executor work with ABC+Generic model hierarchy

2026-07-23 16:11:02 +08:00

protocols.py

refactor: 重构训练后端为 Executor 模式

2026-05-24 20:35:44 +08:00