Cargo Features
llama-cpp-2 has no features set by default.
[dependencies]
llama-cpp-2 = { version = "0.1.56", features = ["cuda", "metal", "sampler"] }
- cuda
-
Enables cuda of llama-cpp-sys-2
- metal
-
Enables metal of llama-cpp-sys-2
- sampler
-
Affects
sample::sampler
…