ViperEkura/AstrAI
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
821 Commits 1 Branch 14 Tags
a144d7f30647f92981e01048f5135641ad7f0db5
Commit Graph
2 Commits
Author SHA1 Message Date
0z5a a144d7f306 perf: accelerate decode linear with bf16 gemv 
- add decode-shape benchmark harness
- add bf16 GEMV CUDA primitive with head-dim generic kernel
- dispatch decode-time linear layers to gemv for M=1
- extend gemv coverage to small decode batches
 2026-09-02 13:11:25 +08:00
ViperEkura 6ac3b51496 refactor: separate extension ops and backends 2026-08-16 21:15:52 +08:00