ViperEkura
/
AstrAI
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
357 Commits 1 Branch 8 Tags 3 MiB
Commit Graph

2 Commits

Author SHA1 Message Date
ViperEkura a304e16ff0 feat: 新增NTK-Aware RoPE缩放支持 
- RotaryEmbedding接受rope_scaling配置,自动计算scaled base

- AutoRegressiveLMConfig和EncoderConfig新增rope_scaling字段
 2026-05-25 21:20:10 +08:00
ViperEkura 97c7ac0f4f refactor: Transformer更名为AutoRegressiveLM并新增EmbeddingEncoder 
- AutoRegressiveLM 注册名改为 autoregressive_lm
- 新增 EmbeddingEncoder 支持 mean/cls/last pooling
- ModelConfig 增加 pooling_type / normalize_embeddings 字段
- 导入、注释、测试全部同步更新
 2026-05-17 15:29:20 +08:00