- Add gqa_decode_attn/gqa_prefill_attn dispatch functions - Internal _available/__modules with underscore prefix - CUDA kernel path with F.scaled_dot_product_attention fallback - GQA head expansion in fallback path |
||
|---|---|---|
| .. | ||
| config | ||
| dataset | ||
| extension | ||
| inference | ||
| model | ||
| parallel | ||
| preprocessing | ||
| serialization | ||
| tokenize | ||
| trainer | ||
| __init__.py | ||
| factory.py | ||
| protocols.py | ||