|
|
@@ -549,7 +549,7 @@ Building the program with BLAS support may lead to some performance improvements
|
|
|
OpenCL acceleration is provided by the matrix multiplication kernels from the [CLBlast](https://github.com/CNugteren/CLBlast) project and custom kernels for ggml that can generate tokens on the GPU.
|
|
|
|
|
|
You will need the [OpenCL SDK](https://github.com/KhronosGroup/OpenCL-SDK).
|
|
|
- - For Ubuntu or Debian, the packages `opencl-headers`, `ocl-icd` may be needed.
|
|
|
+ - For Ubuntu, Debian, and Fedora the packages `opencl-headers`, `ocl-icd` may be needed.
|
|
|
|
|
|
- For Windows, a pre-built SDK is available on the [OpenCL Releases](https://github.com/KhronosGroup/OpenCL-SDK/releases) page.
|
|
|
|
|
|
@@ -574,6 +574,12 @@ Building the program with BLAS support may lead to some performance improvements
|
|
|
|
|
|
Pre-built CLBlast binaries may be found on the [CLBlast Releases](https://github.com/CNugteren/CLBlast/releases) page. For Unix variants, it may also be found in your operating system's packages.
|
|
|
|
|
|
+ Linux packaging:
|
|
|
+ Fedora Linux:
|
|
|
+ ```bash
|
|
|
+ sudo dnf install clblast
|
|
|
+ ```
|
|
|
+
|
|
|
Alternatively, they may be built from source.
|
|
|
|
|
|
- <details>
|