h2oai/h2ogpt is a Python project with 12.0k stars in the AI Tools space. Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://gpt-docs.h2o.ai/
Snapshot summary built from the project's own GitHub metadata — there's no written TopGit review yet. The page will update automatically when a full review is published.
WHY NO REVIEW YET
TopGit writes full reviews for the most-starred, most-requested repositories. This page is a snapshot until then — see the READ ME tab for the original README in full.
Voice STT using Whisper with streaming audio conversion
Voice TTS using MIT-Licensed Microsoft Speech T5 with multiple voices and Streaming audio conversion
Voice TTS using MPL2-Licensed TTS including Voice Cloning and Streaming audio conversion
AI Assistant Voice Control Mode for hands-free control of h2oGPT chat
Bake-off UI mode against many models at the same time
Easy Download of model artifacts and control over models like LLaMa.cpp through the UI
Authentication in the UI by user/password via Native or Google OAuth
State Preservation in the UI by user/password
Open Web UI with h2oGPT as backend via OpenAI Proxy
See Start-up Docs.
Chat completion with streaming
Document Q/A using h2oGPT ingestion with advanced OCR from DocTR
Vision models
Audio Transcription (STT)
Audio Generation (TTS)
Image generation
Authentication
State preservation
Linux, Docker, macOS, and Windows support
Inference Servers support for oLLaMa, HF TGI server, vLLM, Gradio, ExLLaMa, Replicate, Together.ai, OpenAI, Azure OpenAI, Anthropic, MistralAI, Google, and Groq
OpenAI compliant
Server Proxy API (h2oGPT acts as drop-in-replacement to OpenAI server)
Chat and Text Completions (streaming and non-streaming)
Audio Transcription (STT)
Audio Generation (TTS)
Image Generation
Embedding
Function tool calling w/auto tool selection
AutoGen Code Execution Agent
JSON Mode
Strict schema control for vLLM via its use of outlines
Strict schema control for OpenAI, Anthropic, Google Gemini, MistralAI models
JSON mode for some older OpenAI or Gemini models with schema control if model is smart enough (e.g. gemini 1.5 flash)
Any model via code block extraction
Web-Search integration with Chat and Document Q/A
Agents for Search, Document Q/A, Python Code, CSV frames
High quality Agents via OpenAI proxy server on separate port
Code-first agent that generates plots, researches, evaluates images via vision model, etc. (client code openai_server/openai_client.py).
No UI for this, just API
Evaluate performance using reward models
Quality maintained with over 1000 unit and integration tests taking over 24 GPU-hours
Get Started
Install h2oGPT
Docker is recommended for Linux, Windows, and MAC for full capabilities. Linux Script also has full capability, while Windows and MAC scripts have less capabilities than using Docker.
Adding LLM Models (including using GGUF and Attention Sinks)
Adding Embedding Models
Adding Prompts
In-Context Learning
Multiple GPUs
Low-Memory Usage
Environment Variables
HTTPS access for server and client
Useful Links
Fine-Tuning
Triton
Commercial viability
Acknowledgements
Why H2O.ai?
Disclaimer
Development
To create a development environment for training and generation, follow the installation instructions.
To fine-tune any LLM models on your data, follow the fine-tuning instructions.
To run h2oGPT tests:
pip install requirements-parser pytest-instafail pytest-random-order playsound==1.3.0
conda install -c conda-forge gst-python -y
sudo apt-get install gstreamer-1.0
pip install pygame
GPT_H2O_AI=0 CONCURRENCY_COUNT=1 pytest --instafail -s -v tests
# for openai server test on already-running local server
pytest -s -v -n 4 openai_server/test_openai_server.py::test_openai_client
or tweak/run tests/test4gpus.sh to run tests in parallel.
Acknowledgements
Some training code was based upon March 24 version of Alpaca-LoRA.
Used high-quality created data by OpenAssistant.
Used base models by EleutherAI.
Used OIG data created by LAION.
Why H2O.ai?
Our Makers at H2O.ai have built several world-class Machine Learning, Deep Learning and AI platforms:
#1 open-source machine learning platform for the enterprise H2O-3
The world's best AutoML (Automatic Machine Learning) with H2O Driverless AI
No-Code Deep Learning with H2O Hydrogen Torch
Document Processing with Deep Learning in Document AI
We also built platforms for deployment and monitoring, and for data wrangling and governance:
H2O MLOps to deploy and monitor models at scale
H2O Feature Store in collaboration with AT&T
Open-source Low-Code AI App Development Frameworks Wave and Nitro
Open-source Python datatable (the engine for H2O Driverless AI feature engineering)
Many of our customers are creating models and deploying them enterprise-wide and at scale in the H2O AI Cloud:
Multi-Cloud or on Premises
Managed Cloud (SaaS)
Hybrid Cloud
AI Appstore
We are proud to have over 25 (of the world's 280) Kaggle Grandmasters call H2O home, including three Kaggle Grandmasters who have made it to world #1.
Disclaimer
Please read this disclaimer carefully before using the large language model provided in this repository. Your use of the model signifies your agreement to the following terms and conditions.
Biases and Offensiveness: The large language model is trained on a diverse range of internet text data, which may contain biased, racist, offensive, or otherwise inappropriate content. By using this model, you acknowledge and accept that the generated content may sometimes exhibit biases or produce content that is offensive or inappropriate. The developers of this repository do not endorse, support, or promote any such content or viewpoints.
Limitations: The large language model is an AI-based tool and not a human. It may produce incorrect, nonsensical, or irrelevant responses. It is the user's responsibility to critically evaluate the generated content and use it at their discretion.
Use at Your Own Risk: Users of this large language model must assume full responsibility for any consequences that may arise from their use of the tool. The developers and contributors of this repository shall not be held liable for any damages, losses, or harm resulting from the use or misuse of the provided model.
Ethical Considerations: Users are encouraged to use the large language model responsibly and ethically. By using this model, you agree not to use it for purposes that promote hate speech, discrimination, harassment, or any form of illegal or harmful activities.
Reporting Issues: If you encounter any biased, offensive, or otherwise inappropriate content generated by the large language model, please report it to the repository maintainers through the provided channels. Your feedback will help improve the model and mitigate potential issues.
Changes to this Disclaimer: The developers of this repository reserve the right to modify or update this disclaimer at any time without prior notice. It is the user's responsibility to periodically review the disclaimer to stay informed about any changes.
By using the large language model provided in this repository, you agree to accept and comply with the terms and conditions outlined in this disclaimer. If you do not agree with any part of this disclaimer, you should refrain from using the model and any content generated by it.
Yes — h2oai/h2ogpt ships under the Apache-2.0 license, which makes its source code freely readable (and, depending on license terms, forkable and reusable). Source: github.com/h2oai/h2ogpt.
What else is in the AI Tools space?
h2oai/h2ogpt is tracked by TopGit under the AI Tools category, alongside 14 GitHub-tagged topics. Trending and Topics pages list peer repositories of comparable stars and language.
What is h2oai/h2ogpt?
h2oai/h2ogpt (h2oai/h2ogpt) is a Python project on GitHub. From the project's own README: Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://gpt-docs.h2o.ai/
What license does h2oai/h2ogpt use?
h2oai/h2ogpt is released under the Apache-2.0 license. Always verify the LICENSE file directly on GitHub for the authoritative terms — license strings can be edited out of sync with a project's actual stance.
Where can I see h2oai/h2ogpt in action?
The project maintains a homepage at http://h2o.ai. The README tab on this page also usually contains screenshots and a quickstart.
Where do I read more about h2oai/h2ogpt?
This TopGit page is a snapshot — the READ ME tab shows the project's own README content (links stripped, images preserved). The GitHub repository at github.com/h2oai/h2ogpt is the definitive source.
Why is h2oai/h2ogpt categorized under AI Tools?
TopGit places h2oai/h2ogpt in the AI Tools category based on its GitHub topics and description (tagged: "ai", "chatgpt", "embeddings"). Categories are assigned from real repository metadata, not editorial guesswork.
Read full README in the tab above.
Still deciding about h2ogpt?
One click hands the question to an AI along with this page — see what it says about h2ogpt.