Cargo Features
kalosm-llama has no features set by default.
[dependencies]
kalosm-llama = { version = "0.2.2", features = ["accelerate", "cuda", "cudnn", "mkl", "nccl"] }- accelerate
-
Enables accelerate-src, accelerate of candle-core =0.3.2, candle-nn =0.3.2, and candle-transformers =0.3.2
- cuda nccl?
-
Enables cuda of candle-core =0.3.2, candle-nn =0.3.2, and candle-transformers =0.3.2
- cudnn
-
Enables cudnn of candle-core =0.3.2
- mkl
-
Enables intel-mkl-src, mkl of candle-core =0.3.2, candle-nn =0.3.2, and candle-transformers =0.3.2
- nccl = cuda
-
Enables nccl of cudarc ^0.9.14, num-traits, rand_distr and use-intrinsics of half
Features from optional dependencies
In crates that don't use the dep: syntax, optional dependencies automatically become Cargo features. These features may have been created by mistake, and this functionality may be removed in the future.
- cudarc nccl?
-
Enables cudarc ^0.9.14