The platform that treats exabytes like everybody else treats gigabytes.
T

The platform that treats exabytes like everybody else treats gigabytes.

The platform that treats exabytes like everybody else treats gigabytes.

2,196 stars
N/A forks
N/A contributors

README

Project documentation from GitHub

Here’s a developer-friendly blog post based on the tweet and repository.


YTsaurus: The Platform That Treats Exabytes Like Gigabytes

You know that sinking feeling when your cluster starts groaning under a few hundred terabytes? Now imagine scaling that to exabytes without rewriting your entire stack. Most big data systems handle petabytes well, but a truly massive scale? That usually means custom infrastructure, a team of SREs, and a prayer.

YTsaurus is an open source platform that flips that script. It’s built to handle exabytes of data with the same operational simplicity you’d expect from a smaller system. It’s not a toy. It’s the actual infrastructure that’s been running inside one of the largest internet companies in the world for years. And now it’s open source.

What It Does

YTsaurus is a distributed storage and computation platform. Think of it as a hybrid between a key-value store, a columnar database, and a MapReduce engine, all wrapped in a single system. You store your data in a dynamic table or a static table, then run SQL-like queries, map-reduce jobs, or even real-time operations on top of it.

The core pieces are:

  • Cypress – a fault-tolerant, transactional key-value tree (like a distributed filesystem with ACID properties).
  • Dynamic tables – real-time, row-based storage with support for transactions and replication.
  • Static tables – immutable, columnar storage optimized for batch processing.
  • Scheduler – distributes and manages jobs (MapReduce, SQL, etc.) across thousands of nodes.

It’s designed to be the single source of truth for massive datasets, handling both batch and interactive workloads.

Why It’s Cool

The first thing that stands out is the scale. YTsaurus has been running in production for years at a company that processes hundreds of petabytes daily. That’s not a proof of concept. It’s battle tested.

But scale alone isn’t interesting if it’s painful. What makes YTsaurus cool is how it balances power with usability. You get:

  • Strong consistency – transactions, linearizability, and snapshot isolation. No eventual consistency weirdness.
  • Multi-tenancy – thousands of users or services can share the same cluster without stepping on each other.
  • Flexible computation – run SQL via its query engine, or drop down to raw MapReduce jobs. You choose the level of control.
  • Real-time capabilities – dynamic tables let you ingest and query streaming data without a separate streaming pipeline.

Did you like this issue?

Join our weekly newsletter

Love discovering amazing projects?

Help us continue bringing you the best open-source discoveries every week.

Back to Projects
Last updated: May 19, 2026