File tree Expand file tree Collapse file tree 1 file changed +6
-1
lines changed Expand file tree Collapse file tree 1 file changed +6
-1
lines changed Original file line number Diff line number Diff line change @@ -41,7 +41,7 @@ bash Miniforge3-MacOSX-arm64.sh
4141```
4242Otherwise, while installing it will build the llama.ccp x86 version which will be 10x slower on Apple Silicon (M1) Mac.
4343
44- ### Installation with OpenBLAS / cuBLAS / CLBlast
44+ ### Installation with OpenBLAS / cuBLAS / CLBlast / Metal
4545
4646` llama.cpp ` supports multiple BLAS backends for faster processing.
4747Use the ` FORCE_CMAKE=1 ` environment variable to force the use of ` cmake ` and install the pip package for the desired BLAS backend.
@@ -64,6 +64,11 @@ To install with CLBlast, set the `LLAMA_CLBLAST=1` environment variable before i
6464CMAKE_ARGS=" -DLLAMA_CLBLAST=on" FORCE_CMAKE=1 pip install llama-cpp-python
6565```
6666
67+ To install with Metal (MPS), set the ` LLAMA_METAL=on ` environment variable before installing:
68+
69+ ``` bash
70+ CMAKE_ARGS=" -DLLAMA_METAL=on" FORCE_CMAKE=1 pip install llama-cpp-python
71+ ```
6772
6873## High-level API
6974
You can’t perform that action at this time.
0 commit comments