Cargo Features

[dependencies]
norma = { version = "0.0.3", default-features = false, features = ["whisper", "serde", "jack", "oboe-shared-stdcxx", "cuda", "flash-attn", "cudnn", "metal", "accelerate", "openssl"] }
default = _mock, serde, whisper

By default ship with all models enabled

whisper default = byteorder, candle-core, candle-nn, candle-transformers, hf-hub, rand, serde_json, strum, tokenizers

Affects models::whisper

_mock default

A mock model used for testing

Affects models::mock

serde default

Enables serde

Serde

jack

Enables jack of cpal

oboe-shared-stdcxx

Enables oboe-shared-stdcxx of cpal

cpal:

Only available on Android. See README for what it does.

cuda cudnn? flash-attn?

Require cuda

Enables cuda of candle-core ^0.7.2, candle-nn ^0.7.2, and candle-transformers ^0.7.2

candle-core:

Whisper

flash-attn = cuda

Enables flash-attn of candle-transformers ^0.7.2

cudnn = cuda

Require cudnn

Enables cudnn of candle-core ^0.7.2

metal

Only applicable to MacOS

Enables metal of candle-core ^0.7.2, candle-nn ^0.7.2, and candle-transformers ^0.7.2

accelerate

Enables accelerate of candle-core ^0.7.2, candle-nn ^0.7.2, and candle-transformers ^0.7.2

Features from optional dependencies

In crates that don't use the dep: syntax, optional dependencies automatically become Cargo features. These features may have been created by mistake, and this functionality may be removed in the future.

candle-core accelerate? cuda? cudnn? metal? whisper

Enables candle-core ^0.7.2

candle-nn accelerate? cuda? metal? whisper

Enables candle-nn ^0.7.2

candle-transformers accelerate? cuda? flash-attn? metal? whisper

Enables candle-transformers ^0.7.2

tokenizers whisper
hf-hub whisper
serde_json whisper
rand whisper
byteorder whisper
strum whisper
openssl cfg(any()) implicit feature

Enables openssl

openssl:

OpenSSL bindings