Skip to content

Commit 5546acb

Browse files
[Bug]: Set LD_LIBRARY_PATH to include the 'standard' CUDA location (vllm-project#25766)
Signed-off-by: Clayton Coleman <smarterclayton@gmail.com>
1 parent c0ec818 commit 5546acb

File tree

1 file changed

+6
-0
lines changed

1 file changed

+6
-0
lines changed

docker/Dockerfile

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -474,6 +474,12 @@ ENV CUDA_HOME=/usr/local/cuda
474474
RUN export TORCH_CUDA_ARCH_LIST="${TORCH_CUDA_ARCH_LIST:-9.0a+PTX}" \
475475
&& bash install_python_libraries.sh
476476

477+
# CUDA image changed from /usr/local/nvidia to /usr/local/cuda in 12.8 but will
478+
# return to /usr/local/nvidia in 13.0 to allow container providers to mount drivers
479+
# consistently from the host (see https://github.com/vllm-project/vllm/issues/18859).
480+
# Until then, add /usr/local/nvidia/lib64 before the image cuda path to allow override.
481+
ENV LD_LIBRARY_PATH=/usr/local/nvidia/lib64:${LD_LIBRARY_PATH}
482+
477483
#################### vLLM installation IMAGE ####################
478484

479485
#################### TEST IMAGE ####################

0 commit comments

Comments
 (0)