ViperEkura df979b4469 refactor: use single-index access and update docs for cache architecture ...

- Replace all buffer[layer_id][loc] double indexing with buffer[layer_id, loc] single advanced indexing in cache.py and attention.py
- Revert KVStorage buffers back to 4D [n_layers, size, n_kv_heads, head_dim], remove leftover 3D reshape/view in MLA path
- Update docs/guides/inference.md, docs/developer/internals.md, docs/developer/architecture.md to reflect new PagePool/KVStorage/ReqToTokenPool/KVCache classes

2026-07-30 17:47:04 +08:00

..

data

refactor: remove H5 storage backend in favor of mmap bin

2026-07-29 12:50:27 +08:00

inference

refactor: use single-index access and update docs for cache architecture

2026-07-30 17:47:04 +08:00

module

refactor: simplify BaseFactory and separate ModelFactory from AutoModel

2026-07-30 09:38:20 +08:00

parallel

feat: 增加server, 并且修改测试单元

2026-04-02 15:05:07 +08:00

trainer

refactor: simplify BaseFactory and separate ModelFactory from AutoModel

2026-07-30 09:38:20 +08:00

conftest.py

refactor: eliminate test duplication via shared helpers

2026-07-27 22:34:53 +08:00

helpers.py

refactor: eliminate test duplication via shared helpers

2026-07-27 22:34:53 +08:00