ViperEkura
/
AstrAI
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
AstrAI/astrai/model/components
History
ViperEkura e12f1a7ee5 feat: BaseModelConfig + DeepSeekMoE + 工厂模式替代 if/else 
- BaseModelConfig: fields() 精确字段匹配 + 类型矫正 + 未知key警告
- DeepSeekMoE: 共享专家 + 路由专家 + top-K 门控
- AttnFactory/FFNFactory: 装饰器注册，DecoderBlock 零分支
- config 用 attn_type/ffn_type 驱动组件选择
 		2026-05-15 20:34:52 +08:00
..
__init__.py refactor: 拆分 module.py 为 components 子包 2026-05-15 20:08:36 +08:00
attention.py feat: BaseModelConfig + DeepSeekMoE + 工厂模式替代 if/else 2026-05-15 20:34:52 +08:00
decoder_block.py feat: BaseModelConfig + DeepSeekMoE + 工厂模式替代 if/else 2026-05-15 20:34:52 +08:00
embedding.py refactor: 拆分 module.py 为 components 子包 2026-05-15 20:08:36 +08:00
linear.py refactor: 拆分 module.py 为 components 子包 2026-05-15 20:08:36 +08:00
mlp.py feat: BaseModelConfig + DeepSeekMoE + 工厂模式替代 if/else 2026-05-15 20:34:52 +08:00
norm.py refactor: 拆分 module.py 为 components 子包 2026-05-15 20:08:36 +08:00
rope.py refactor: 拆分 module.py 为 components 子包 2026-05-15 20:08:36 +08:00