- RotaryEmbedding接受rope_scaling配置,自动计算scaled base - AutoRegressiveLMConfig和EncoderConfig新增rope_scaling字段 |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| base.py | ||
| model_config.py | ||
| train_config.py | ||
- RotaryEmbedding接受rope_scaling配置,自动计算scaled base - AutoRegressiveLMConfig和EncoderConfig新增rope_scaling字段 |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| base.py | ||
| model_config.py | ||
| train_config.py | ||