taosdata/TDengine

English | 简体中文 | TDengine Cloud | Documentation | Learn more about TSDB

TDengine

1. Introduction

TDengine is an open source, high-performance, cloud native and AI powered time-series database designed for Internet of Things (IoT), Connected Cars, and Industrial IoT. It enables efficient, real-time data ingestion, processing, and analysis of TB and even PB scale data per day, generated by billions of sensors and data collectors. TDengine differentiates itself from other time-series databases with the following advantages:

• High Performance: TDengine is the only time-series database to solve the high cardinality issue to support billions of data collection points while out performing other time-series databases for data ingestion, querying and data compression.

• Simplified Solution: Through built-in caching, stream processing, data subscription and AI agent features, TDengine provides a simplified solution for time-series data processing. It reduces system design complexity and operation costs significantly.

• Cloud Native: Through native distributed design, sharding and partitioning, separation of compute and storage, RAFT, support for kubernetes deployment and full observability, TDengine is a cloud native Time-Series Database and can be deployed on public, private or hybrid clouds.

• AI Powered: Through the built in AI agent TDgpt, TDengine can connect to a variety of time series foundation model, large language model, machine learning and traditional algorithms to provide time series data forecasting, anomaly detection, imputation and classification.

• Ease of Use: For administrators, TDengine significantly reduces the effort to deploy and maintain. For developers, it provides a simple interface, simplified solution and seamless integrations for third party tools. For data users, it gives easy data access.

• Easy Data Analytics: Through super tables, storage and compute separation, data partitioning by time interval, pre-computation and AI agent, TDengine makes it easy to explore, format, and get access to data in a highly efficient way.

• Open Source: TDengine's core modules, including cluster feature and AI agent, are all available under open source licenses. It has gathered 23.7k stars on GitHub. There is an active developer community, and over 730k running instances worldwide.

For a full list of TDengine competitive advantages, please check here. The easiest way to experience TDengine is through TDengine Cloud. For the latest TDengine component TDgpt, please refer to TDgpt README for details.

2. Documentation

For user manual, system design and architecture, please refer to TDengine Documentation (TDengine 文档)

You can choose to install TDengine via container, installation package, Kubernetes or try fully managed service without installation. This quick guide is for developers who want to contribute, build, release and test TDengine by themselves.

Table of Contents

• 1. Introduction
• 2. Documentation
• 3. Prerequisites
  • 3.1 System Requirements
  • 3.2 Installing Build Tools
  • 3.3 Optional Tools
• 4. Building
  • 4.1 Quick Start
  • 4.2 Build Options
  • 4.3 Build Output
• 5. Testing
  • 5.1 Unit Tests
  • 5.2 Integration Tests
• 6. Packaging
  • 6.1 Package the Community Tarballs
• 7. Installing from Package
• 8. Running
• 9. Workflow
• 10. Coverage
• 11. Contributing
• 12. License

3. Prerequisites

3.1 System Requirements

• Operating systems: Linux (Ubuntu 18.04+, CentOS 7+), macOS 10.15+, Windows (limited; open-source builds are primarily Linux/macOS)
• CPU: x86_64 or ARM64
• Memory: 4 GB RAM or more recommended
• Disk: 2 GB free space or more recommended
• Primary build platform: Linux

TDengine is built and tested primarily on Linux. macOS builds are supported for local development. Windows support in the open-source tree is limited, so Linux should be your default choice for reproducible builds.

3.2 Installing Build Tools

Ubuntu/Debian:

sudo apt-get update
sudo apt-get install -y build-essential cmake git

CentOS/RHEL:

sudo yum groupinstall -y "Development Tools"
sudo yum install -y cmake3 git

Note: CMake >= 3.21 is required for external builds. If your distro provides an older version, install a newer release from https://cmake.org/download/.

You may also need these tools depending on what you build:

• Python 3 for the test framework in tests/
• Go 1.23+ if you want to build components such as taosAdapter or taosKeeper

3.3 Optional Tools

• ccache — speeds up rebuilds: sudo apt install ccache
• Conan 2.x — required only for the taos-gen component: pip3 install conan

4. Building

4.1 Quick Start

git clone https://github.com/taosdata/TDengine.git
cd TDengine
mkdir debug && cd debug
cmake .. -DBUILD_CONTRIB=ON    # First build: -DBUILD_CONTRIB=ON is REQUIRED
make -j$(nproc)

Important The first source build must use -DBUILD_CONTRIB=ON. This downloads and builds external dependencies such as xxhash, zstd, and lz4 into .externals/. Subsequent builds can usually omit this flag and reuse the cached artifacts automatically.

Useful variants:

# Release build with CLI tools
cmake .. -DBUILD_CONTRIB=ON -DCMAKE_BUILD_TYPE=Release -DBUILD_TOOLS=ON
make -j$(nproc)

# macOS equivalent parallel build
cmake .. -DBUILD_CONTRIB=ON -DCMAKE_BUILD_TYPE=Release
cmake --build . --parallel "$(sysctl -n hw.ncpu)"

4.2 Build Options

Defaults below are the standalone open-source defaults from cmake/options.cmake unless noted otherwise.

Example:

cmake .. -DBUILD_CONTRIB=ON -DCMAKE_BUILD_TYPE=Release -DBUILD_TOOLS=ON

4.3 Build Output

The default build tree under debug/ looks like this:

• Binaries in debug/build/bin/
  • taosd — TDengine server daemon
  • taos — TDengine CLI client
  • taosBenchmark — benchmark tool (BUILD_TOOLS=ON)
  • taosdump — import/export tool (BUILD_TOOLS=ON)
• Libraries in debug/build/lib/
  • libtaos.so on Linux (or the platform-equivalent client library)

5. Testing

5.1 Unit Tests

cd debug
cmake .. -DBUILD_CONTRIB=ON -DBUILD_TEST=ON
make -j$(nproc)
ctest --output-on-failure

Some individual test binaries are also emitted into debug/build/bin/.

5.2 Integration Tests

TDengine includes a Python-based test framework in tests/.

# Build the server and tools first
cd debug
cmake .. -DBUILD_CONTRIB=ON -DBUILD_TOOLS=ON -DBUILD_TEST=ON
make -j$(nproc)

# Start taosd with the generated test configuration
./build/bin/taosd -c test/cfg &

# Run a system test
cd ../tests/system-test
python3 test.py -f 2-query/basic.py

For more test details, see tests/README.md.

6. Packaging

Use source/taos-community/packaging/pack_community_tar.sh after a successful Linux build to assemble the open-source community tarballs.

This script packages only artifacts that are built from the taos-community repository itself:

• taosd
• taos
• taosBenchmark (BUILD_TOOLS=ON, when present)
• taosdump (BUILD_TOOLS=ON, when present)
• taosudf (when present)
• libtaos.so
• libtaosnative.so
• headers, examples/c, and the install scripts

It does not package components that live in other repositories or require separate build flows, such as taoskeeper, taos-explorer, taosx, connectors, or taosinspect.

6.1 Package the Community Tarballs

Build first:

mkdir debug && cd debug
cmake .. -DCMAKE_BUILD_TYPE=Release -DBUILD_CONTRIB=ON -DBUILD_TOOLS=ON
make -j$(nproc)

Then run the packaging script from the repository root:

cd ..
./source/taos-community/packaging/pack_community_tar.sh -c debug -n 3.3.6.0

Optional arguments:

• -m <compatible_version> — defaults to 3.0.0.0
• -V <stable|beta|preRelease> — defaults to stable

Example:

./source/taos-community/packaging/pack_community_tar.sh \
  -c debug \
  -n 3.3.6.0 \
  -m 3.0.0.0 \
  -V stable

Generated packages are written to:

source/taos-community/release/

Typical outputs:

source/taos-community/release/TDengine-server-3.3.6.0-Linux-x64.tar.gz
source/taos-community/release/TDengine-client-3.3.6.0-Linux-x64.tar.gz

The server and client archives use the same two-layer layout as the existing packaging flow:

• outer tarball for distribution
• inner package.tar.gz containing bin/, cfg/, and inc/

This is the standard packaging approach for repository-local OSS artifacts and should be followed consistently in future repositories as well.

7. Installing from Package

For an official installer package produced by packaging/tools/makepkg.sh:

tar -xzf TDengine-server-<version>-Linux-x86_64.tar.gz
cd TDengine-server-<version>
sudo ./install.sh

If you are installing directly from a local source build instead of a packaged archive, you can also run:

cd debug
sudo make install

8. Running

# Start the server after installation
sudo systemctl start taosd

# Connect with the CLI
taos

For a quick local run from the build tree, use:

cd debug
./build/bin/taosd -c test/cfg

Then, in another shell:

cd debug
./build/bin/taos -c test/cfg

9. Workflow

TDengine build check workflow can be found in this GitHub Action. More workflows will be available soon.

10. Coverage

Latest TDengine test coverage report can be found on coveralls.io.

cd tests
bash setup-lcov.sh -v 1.16 && ./run_local_coverage.sh -b main -c task
# on main branch and run cases in longtimeruning_cases.task
# for more information about options please refer to ./run_local_coverage.sh -h

11. Contributing

Please follow the contribution guidelines to contribute to TDengine.

12. License

TDengine is licensed under the GNU Affero General Public License 3.0.