In this article we will see how to install llama.cpp on ubuntu Installing build essentials and Initial Setup 1sudo apt update 2sudo apt install -y build-essential libcurl4-openssl-dev cmake git Setup nvcc path 1export CUDACXX=/usr/local/cuda-13.0/bin/nvcc find gpu arch, make sure nvidia-smi command works 1# Queries the …

Read More