llama-cpp-docker

Simple dockerfile / docker-compose to run llama-cpp

Usage

Just put your models in models and run docker-compose up -d --build and you're good to go.