AstrAI/astrai/model
ViperEkura 737585a32a feat: 新增NTK-Aware RoPE缩放支持
- RotaryEmbedding接受rope_scaling配置,自动计算scaled base
- AutoRegressiveLMConfig和EncoderConfig新增rope_scaling字段
2026-05-25 21:22:07 +08:00
..
components feat: 新增NTK-Aware RoPE缩放支持 2026-05-25 21:22:07 +08:00
__init__.py feat: 新增LoRA微调模块 2026-05-25 20:15:31 +08:00
automodel.py refactor: Transformer更名为AutoRegressiveLM并新增EmbeddingEncoder 2026-05-17 15:29:20 +08:00
encoder.py feat: 新增NTK-Aware RoPE缩放支持 2026-05-25 21:22:07 +08:00
transformer.py feat: 新增NTK-Aware RoPE缩放支持 2026-05-25 21:22:07 +08:00