Lib.rs

› Science › Machine learning
#machine-learning #tensor #blas

candle-flash-attn

Flash attention layer for the candle ML framework

by Laurent Mazare, Nicolas Patry and 97 contributors

15 releases (5 breaking)

0.6.0 Jun 29, 2024
0.4.1 Feb 28, 2024
0.3.2 Dec 20, 2023
0.3.1 Nov 12, 2023

#652 in Machine learning

Download history 11/week @ 2024-05-13 185/week @ 2024-05-20 72/week @ 2024-05-27 19/week @ 2024-06-03 33/week @ 2024-06-10 8/week @ 2024-06-17 178/week @ 2024-06-24 43/week @ 2024-07-01 49/week @ 2024-07-08 131/week @ 2024-07-15 12/week @ 2024-07-22 11/week @ 2024-07-29 10/week @ 2024-08-05 43/week @ 2024-08-12 45/week @ 2024-08-19 58/week @ 2024-08-26

157 downloads per month
Used in 8 crates (4 directly)

MIT/Apache

2MB
26K SLoC

candle-flash-attn

Dependencies

~32MB
~699K SLoC