Cargo Features
Paddler has no features set by default.
[dependencies]
paddler = { version = "2.2.0", features = ["cuda", "tests_that_use_llms", "web_admin_panel", "vulkan"] }- cuda
-
Enables cuda of llama-cpp-2
- tests_that_use_llms
- web_admin_panel
-
Enables askama ^0.14, esbuild-metafile ^0.5.2, mime_guess, and rust-embed
askama:
web dashboard deps
Affects
inference_service::InferenceService.web_admin_panel_service_configuration,management_service::ManagementService.web_admin_panel_service_configuration,balancer::web_admin_panel_service,paddler::static_files,paddler::ESBUILD_META_CONTENTS… - vulkan
-
Enables vulkan of llama-cpp-2