diff options
Diffstat (limited to 'development/whisper.cpp/README')
-rw-r--r-- | development/whisper.cpp/README | 16 |
1 files changed, 16 insertions, 0 deletions
diff --git a/development/whisper.cpp/README b/development/whisper.cpp/README new file mode 100644 index 0000000000..2c0e887b33 --- /dev/null +++ b/development/whisper.cpp/README @@ -0,0 +1,16 @@ +High-performance inference of OpenAI's Whisper automatic speech +recognition (ASR) model: + + -Plain C/C++ implementation without dependencies + -Apple Silicon first-class citizen - optimized via ARM NEON, + Accelerate framework, Metal and Core ML + -AVX intrinsics support for x86 architectures + -VSX intrinsics support for POWER architectures + -Mixed F16 / F32 precision + -4-bit and 5-bit integer quantization support + -Zero memory allocations at runtime + -Support for CPU-only inference + -Efficient GPU support for NVIDIA + -Partial OpenCL GPU support via CLBlast + -OpenVINO Support + -C-style API |