TopGit
GITHUB SNAPSHOT

NVIDIA/TensorRT-LLM

NVIDIA/TensorRT-LLM
NTopGit repo profile image for NVIDIA/TensorRT-LLM
TopGit repo profile for NVIDIA/TensorRT-LLM, with GitHub repository stats and README context.
Stars
★ 14.3k
Forks
⑂ 2.6k
Language
Python
Topic
AI Tools
License
—
Updated
9d ago
Contributors
👥 440
Homepage
QUICK VERDICT

NVIDIA/TensorRT-LLM sits at 14.3k stars on GitHub, written primarily in Python. TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

Snapshot summary built from the project's own GitHub metadata — there's no written TopGit review yet. The page will update automatically when a full review is published.

WHY NO REVIEW YET

TopGit writes full reviews for the most-starred, most-requested repositories. This page is a snapshot until then — see the READ ME tab for the original README in full.

Snapshot

Stars★ 14.3k
Forks⑂ 2.6k
LanguagePython
TopicAI Tools
License—
HomepageView ↗

Read our review methodology ↗

Top contributors

Show top contributors
Top 21 contributors to NVIDIA/TensorRT-LLM

Related repositories

vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

★ 88.3k
huggingface/transformers

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

★ 163.4k
rasbt/LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

★ 100.5k
obra/superpowers

Superpowers is an open-source (MIT) skills library and bootstrap instruction set that turns a coding agent's ad-hoc habits into a fixed pipeline: brainstorm a spec, write a plan, build under TDD, review, then close out the branch. Skills trigger automatically once installed, and the same methodology works across eleven different agent harnesses, each requiring its own install step.

★ 268.2k
FREQUENTLY ASKED

Quick answers

How active is development on NVIDIA/TensorRT-LLM?

The most recent commit recorded on NVIDIA/TensorRT-LLM was 8 days ago, based on the GitHub push timestamp. The repository has 2.6k forks — one of the better signals of community interest.

How many stars does NVIDIA/TensorRT-LLM have?

NVIDIA/TensorRT-LLM has 14.3k GitHub stars — refresh the page for the live number, or check github.com/NVIDIA/TensorRT-LLM. TopGit mirrors GitHub's count but does not claim minute-by-minute accuracy.

Is NVIDIA/TensorRT-LLM open source?

TopGit's metadata for NVIDIA/TensorRT-LLM does not record a license. Most public repositories on GitHub ARE open source, but the exact terms vary — verify by opening the LICENSE file directly.

What else is in the AI Tools space?

NVIDIA/TensorRT-LLM is tracked by TopGit under the AI Tools category, alongside 5 GitHub-tagged topics. Trending and Topics pages list peer repositories of comparable stars and language.

What topics is NVIDIA/TensorRT-LLM associated with?

GitHub's repository topics for NVIDIA/TensorRT-LLM: "blackwell", "cuda", "llm-serving", "moe", "pytorch". TopGit's editorial category is AI Tools.

Where can I see NVIDIA/TensorRT-LLM in action?

The project maintains a homepage at https://nvidia.github.io/TensorRT-LLM. The README tab on this page also usually contains screenshots and a quickstart.

Where do I read more about NVIDIA/TensorRT-LLM?

This TopGit page is a snapshot — the READ ME tab shows the project's own README content (links stripped, images preserved). The GitHub repository at github.com/NVIDIA/TensorRT-LLM is the definitive source.

Read full README in the tab above.