- RotaryEmbedding接受rope_scaling配置,自动计算scaled base - AutoRegressiveLMConfig和EncoderConfig新增rope_scaling字段 |
||
|---|---|---|
| .. | ||
| components | ||
| __init__.py | ||
| automodel.py | ||
| encoder.py | ||
| transformer.py | ||
- RotaryEmbedding接受rope_scaling配置,自动计算scaled base - AutoRegressiveLMConfig和EncoderConfig新增rope_scaling字段 |
||
|---|---|---|
| .. | ||
| components | ||
| __init__.py | ||
| automodel.py | ||
| encoder.py | ||
| transformer.py | ||