ViperEkura 958df58f9d refactor: unify tokenizer encode and apply_chat_template for batch support ...

- encode(str) single-thread, encode(List[str]) Rust parallel encode_batch
- apply_chat_template accepts single Messages or List[Messages] for batch
- add Message/Messages type aliases at module level

2026-07-20 17:49:26 +08:00

..

config

feat: add online rollout framework for RL strategies

2026-07-20 03:49:56 +08:00

dataset

feat: support SFT directly from JSONL without dataset_config.json

2026-07-20 17:25:09 +08:00

extension

refactor: stride-based attn interface with layout and causal mask

2026-07-14 21:34:42 +08:00

inference

refactor: map instruction/input/output to chat roles

2026-07-20 13:55:25 +08:00

model

refactor: split LoRA param init into local vars

2026-07-20 16:23:47 +08:00

parallel

feat: add FSDP2Executor using torch.distributed.fsdp.fully_shard API

2026-07-20 01:46:25 +08:00

preprocessing

refactor: map instruction/input/output to chat roles

2026-07-20 13:55:25 +08:00

serialization

fix: memmap mode=r, tool parser json.loads, greedy decode

2026-07-19 16:38:28 +08:00

tokenize

refactor: unify tokenizer encode and apply_chat_template for batch support

2026-07-20 17:49:26 +08:00

trainer

refactor: map instruction/input/output to chat roles

2026-07-20 13:55:25 +08:00

__init__.py

chore: bump to 1.3.10

2026-07-19 16:40:27 +08:00

factory.py

fix: ForwardRef._evaluate Python 3.12 compatibility

2026-07-03 18:41:19 +08:00

protocols.py

refactor: 重构训练后端为 Executor 模式

2026-05-24 20:35:44 +08:00