llama.cpp server

llama.cpp server as a MainSDK driver for ai. Pick it in main.yaml; your calls stay the same.

1 interface1 driverFrom the catalog

Updated 2026-10-28

Interfaces it serves

Pick llama.cpp server in main.yaml for any of these. Your calls stay the same, and you can swap later.

AI callsaiBuilding for 0.3

Driver llama-cpp llama.cpp serverFrom the ai-local spec

not built yet

main.yaml

ai:
  driver: llama-cpp

Swap to another provider

Was this page helpful?