ViperEkura
  • Joined on 2026-04-02
ViperEkura pushed to main at ViperEkura/AstrAI 2026-05-14 20:32:13 +08:00
d8da2cf17c docs: 修复文档中与源码不符的类名、方法签名和模块归属
205b40bd28 refactor: 重构 cache 和 inference 参数体系,分离存储与分配
18fe6e9339 refactor: 消除多处重复模式,统一工厂和参数传递
2196c34c52 refactor: 重构 inference 模块架构,引入设计模式并分组文件
466c2e1efd fix: process_attention_mask 中 expand 后的 inplace 写导致 alias 报错
Compare 18 commits »
ViperEkura pushed to main at ViperEkura/postgraduate-prep 2026-05-14 15:40:39 +08:00
89a3b16ef5 feat: 积分-万能代换增加判别式分析(a²-b²决定arctan/ln形式)
2fdf8e35ab feat: 增加错题 1/(1+√((1+x)/x)) 积分(有理化分母+配平方)
f3dfb5273d feat: 增加错题 1/(a+b cosx) 积分(万能代换+判别式分情况)
900e6c3e62 refactor: 规划对齐张宇+王道课程,按子专题细化,目标6月底完成第一轮
Compare 4 commits »
ViperEkura pushed to main at ViperEkura/AstrAI 2026-05-11 17:52:52 +08:00
38e18fdfd3 refactor: PagedCache Facade 模式,提取 PagePool/PrefixCache/TaskTable
4753958f92 refactor: 页状态移入 PagedCache,Task 纯化为域对象
73d6cc0f26 refactor: TaskManager 剥离页管理,STOP 移至 task.py
317ed90bac refactor: 拆分 scheduler 为 TaskManager + Executor
Compare 4 commits »
ViperEkura pushed to main at ViperEkura/AstrAI 2026-05-10 21:07:53 +08:00
951df8155c perf: gather 向量化
a58fab8d6e fix: max_seq_len 检查改为仅 prompt 超限发 STOP,max_tokens 超出部分 clamp
a3c8296135 fix: page cache 分配失败越界崩溃 + 长度超限终止
c95ace41aa fix: prefill 时 attention mask 长度不足导致 expand 崩溃
Compare 4 commits »
ViperEkura pushed to main at ViperEkura/AstrAI 2026-05-10 18:25:42 +08:00
ViperEkura pushed to main at ViperEkura/AstrAI 2026-05-10 18:23:33 +08:00
a3bde30fb1 feat: 服务化基础设施 - 有界队列/超时/优雅关闭/metrics
3da428e0e4 perf: PagedCache 持久前缀缓存 + LRU 逐出
133a9de98f feat: _generate_streaming 支持 batch 模式
Compare 3 commits »
ViperEkura pushed to main at ViperEkura/postgraduate-prep 2026-05-10 17:31:11 +08:00
6335d21418 feat: 增加杂项随手记(个人发现与零散规律总结)
ViperEkura pushed to main at ViperEkura/AstrAI 2026-05-10 17:25:42 +08:00
523eacf5fe release: v1.3.4
cffedaad5e perf: 消除非流式推理 CPU 空转并减少 decode GPU 张量冗余分配
Compare 2 commits »
ViperEkura pushed to main at ViperEkura/postgraduate-prep 2026-05-10 16:55:02 +08:00
d744d4605b feat: 增加级数敛散性判别与反常积分审敛法(含错题与比值审敛证明)
ViperEkura pushed to main at ViperEkura/AstrAI 2026-05-09 23:55:12 +08:00
3583c46b66 feat: 推理引擎前缀缓存(KV cache 复用)
ViperEkura created repository ViperEkura/ToolAgent 2026-05-09 23:13:24 +08:00
ViperEkura pushed to main at ViperEkura/video-promo 2026-05-09 20:19:42 +08:00
4f14d09fe3 fix paged_cache: _TaskRow class, expand rendering bug, and order corrected
ViperEkura pushed to main at ViperEkura/video-promo 2026-05-09 18:53:11 +08:00
bb0c32b032 redesign continuous batching: simplify to lane-based FSM with Prefill state
ViperEkura pushed to main at ViperEkura/AstrAI 2026-05-09 16:00:02 +08:00
ca4e6b907c feat: Checkpoint 支持 extra 通用扩展数据,用户通过函数自定义保存/恢复优化器等状态
db99d8b254 fix: 修复文档多处不准确 + inference scheduler 越界 bug + SchedulerCallback 回调阶段修正
b98c9cefdc refactor: 移除 device_ids 参数设计,统一通过 CUDA_VISIBLE_DEVICES 控制 GPU 分配;更新 README 训练示例
283bcaf2ff fix: 修复 CLI 参数缺失/重复、device_ids 越界、generate 参数名不一致、scheduler 时序、非流式截断等 bug
Compare 4 commits »
ViperEkura pushed to main at ViperEkura/video-promo 2026-05-09 14:35:57 +08:00
c9f290c3c8 Merge PROMO_GUIDE into README, add AGENTS.md, parallelize render_all
ViperEkura pushed to main at ViperEkura/video-promo 2026-05-09 13:53:21 +08:00
f5499866ad refactor: replace prefix cache with paged KV cache across promo guide, architecture, and animation
ViperEkura pushed to main at ViperEkura/AstrAI 2026-05-09 12:25:47 +08:00
bc7c82977e feat: GRPO CLI 接入 + on-policy,OpenAI API top_k 参数化,补充训练参数表
34a511e36e feat: 新增 Docker Compose 一键部署,支持 GPU/CPU 双模式
d73f52a2f8 feat: 新增 Anthropic 兼容 /v1/messages API,移除旧版 /generate 端点
Compare 3 commits »
ViperEkura pushed to main at ViperEkura/AstrAI 2026-05-08 23:01:53 +08:00
9d96b0431d docs: 更新文档以匹配分页 KV cache 等代码重构
f81e2b4a73 feat: OpenAI 兼容的 chat completion API(流式+非流式+usage)
4e324d8f26 fix: benchmark 改用 PagedCache 替代已删除的 persistent_key_values
6ed0506491 fix: 减少调度器延迟 — 移除解码路径 5ms 睡眠,修复 refill 任务丢失 bug
30cc2d67a4 refactor: 分页 KV cache 替换固定 slot,删除 PrefixCache 及相关死代码
Compare 14 commits »
ViperEkura pushed to main at ViperEkura/postgraduate-prep 2026-05-08 18:19:30 +08:00
97af47ecc0 fix: README积分导航改为按要点逐条列出
ViperEkura pushed to main at ViperEkura/postgraduate-prep 2026-05-08 18:17:45 +08:00
5640bb167f refactor: 拆分积分章节为4个子章节,更新README导航