llama.cpp by ggml-org — GitHub Repo Review

LLM inference in C/C++

Stars
118,847
Forks
20,120
Language
License
Topic
AI Tools
Updated
Dec 2025
Homepage
GitHub

What is llama.cpp?

LLM inference in C/C++

A full original TopGit review of this repo is in progress. In the meantime, the facts above come straight from GitHub — visit the source repository for full documentation.
View on GitHub

Frequently asked questions

Is LLM inference in C/C++ open source?

Yes. LLM inference in C/C++ is an open-source project hosted on GitHub at https://github.com/ggml-org/llama.cpp.

How popular is LLM inference in C/C++?

As of the last sync, LLM inference in C/C++ had 118,847 GitHub stars and 20,120 forks.

What is LLM inference in C/C++ used for?

LLM inference in C/C++

Related repositories

llama.cpp by ggml-org — GitHub Repo Review | TopGit | TopGit