ashishps1/awesome-engineering-articles
ashishps1/awesome-engineering-articles is tracked by TopGit as a data project, with 1.1k stars on GitHub. A curated collection of 300+ engineering blog articles from top tech companies. Learn how the best engineering teams solve real-world problems at scale.
Snapshot summary built from the project's own GitHub metadata — there's no written TopGit review yet. The page will update automatically when a full review is published.
TopGit writes full reviews for the most-starred, most-requested repositories. This page is a snapshot until then — see the READ ME tab for the original README in full.
Snapshot
Top contributors
Show top contributors
Awesome Engineering Articles
A curated collection of 300+ engineering blog articles from top tech companies. Learn how the best engineering teams solve real-world problems at scale.
Table of Contents
Airbnb · Amazon Science · Atlassian · Booking.com · Canva · Coinbase · Discord · DoorDash · Dropbox · eBay · Facebook/Meta · Figma · Flipkart · GitHub · Google Research · Instagram · Instacart · LinkedIn · Lyft · Netflix · Notion · PayPal · Pinterest · Quora · Razorpay · Reddit · Salesforce · Shopify · Slack · Snap · Spotify · Stripe · Swiggy · Tinder · Twitch · Twitter/X · Uber · Walmart · Zomato
Airbnb
Airbnb Engineering Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | Embedding-Based Retrieval for Airbnb Search | Search, AI/ML | 2025 |
| 2 | How Airbnb improved page performance using HTTP Streaming | Performance, Frontend | 2023 |
| 3 | Airbnb's Data Framework for faster and more reliable read-heavy workloads | Data Engineering, Performance | 2023 |
| 4 | Avoiding Double Payments in a Distributed Payments System | Payments, Architecture | 2019 |
Amazon Science
Amazon Science Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | Training code generation models to debug their own outputs | AI/ML | 2025 |
| 2 | The technology behind Amazon's GenAI-powered shopping assistant, Rufus | AI/ML | 2024 |
| 3 | Ensuring that customers don't miss out on trending products | Search, AI/ML | 2023 |
| 4 | From structured search to learning-to-rank-and-retrieve | Search, AI/ML | 2023 |
| 5 | Invalidating robotic ad clicks in real time | Security, Data Engineering | 2023 |
| 6 | Using large language models (LLMs) to synthesize training data | AI/ML | 2023 |
| 7 | Lessons learned from 10 years of DynamoDB | Databases | 2022 |
| 8 | Using graph neural networks to recommend related products | AI/ML, Search | 2022 |
Atlassian
Atlassian Engineering Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | How Atlassian Scaled and Enhanced Throughput in the Jira Export Service | Performance, Architecture | 2025 |
| 2 | How one of Atlassian's critical services consistently gets above 99.9999% of availability | Infrastructure | 2022 |
| 3 | How Atlassian made Git push over HTTPS faster for Bitbucket Cloud | Performance | 2022 |
| 4 | How Atlassian Revamped Confluence Cloud Search | Search | 2021 |
| 5 | Caching JQL search in Jira Cloud | Caching, Databases | 2021 |
| 6 | Scaling, rearchitecting, and decomposing Confluence Cloud | Architecture | 2020 |
| 7 | Scaling Bitbucket's Database | Databases | 2020 |
| 8 | Atlassian's journey scaling low latency, multi-region services on AWS | Infrastructure, Performance | 2019 |
Booking.com
Booking.com Tech Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | Anomaly Detection in Time Series Using Statistical Analysis | Observability, Data Engineering | 2025 |
| 2 | How Booking Cut 20% of the Cloud Cost with a Single Code Change | Cost Optimization | 2025 |
| 3 | The Engineering Behind Booking.com's High-Performance Ranking Platform | Search, Performance | 2024 |
| 4 | How Booking.com Leverage graph technology for real-time Fraud Detection and Prevention | Security | 2024 |
| 5 | How Booking.com Predicts cancellations with survival modeling | AI/ML | 2024 |
Canva
Canva Engineering Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | Canva's continuous data platform | Data Engineering | 2025 |
| 2 | How Canva's drawing tool works | Frontend | 2024 |
| 3 | How Canva collects 25 billion events per day | Data Engineering | 2024 |
| 4 | Canva's scalable and reliable content usage counting service | Architecture, Performance | 2024 |
| 5 | How Canva saves millions annually in Amazon S3 costs | Cost Optimization | 2023 |
| 6 | How Canva scaled media uploads from Zero to 50 Million per day | Performance, Infrastructure | 2022 |
| 7 | Canva's fast and scalable reverse image search | Search, Databases | 2022 |
| 8 | How Canva enables real-time collaboration with RSocket | Messaging, Architecture | 2021 |
Coinbase
Coinbase Engineering Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | How Coinbase Optimizes Network Requests | Performance | 2024 |
| 2 | Accelerating Deep Learning Adoption at Coinbase | AI/ML | 2024 |
| 3 | Lessons from launching Enterprise-grade GenAI solutions at Coinbase | AI/ML | 2024 |
| 4 | How Coinbase Uses ML to Predict Traffic and Scale Databases | AI/ML, Databases | 2024 |
| 5 | Detecting Fraudulent Transactions at Coinbase | Security | 2023 |
| 6 | Building a notification platform at Coinbase | Messaging, Architecture | 2022 |
Discord
Discord Engineering Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | How Discord Reduced Websocket Traffic by 40% | Performance, Messaging | 2024 |
| 2 | How Discord Stores Trillions of Messages | Databases | 2023 |
| 3 | Pushing Discord's Limits with a Million+ Online Users in a Single Server | Performance, Infrastructure | 2023 |
| 4 | How Discord uses ML to Build a Delightful Notification Experience | AI/ML, Messaging | 2022 |
| 5 | How Discord Creates Insights from Trillions of Data Points | Data Engineering | 2021 |
DoorDash
DoorDash Engineering Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | How DoorDash Uses LLMs to transcribe restaurant menu photos | AI/ML | 2025 |
| 2 | How DoorDash leverages LLMs for better search retrieval | AI/ML, Search | 2024 |
| 3 | Building DoorDash's product knowledge graph with large language models | AI/ML, Data Engineering | 2024 |
| 4 | DoorDash's in-house search engine | Search | 2024 |
| 5 | DoorDash's write-heavy scalable and reliable inventory platform | Architecture, Databases | 2023 |
| 6 | Doordash's scalable real time event processing with Kafka and Flink | Data Engineering | 2022 |
| 7 | DoorDash's Lessons on Improving Performance on High-Traffic Web Pages | Performance, Frontend | 2022 |
| 8 | How DoorDash Applied Client-Side Caching to Improve Feature Store Performance by 70% | Caching, AI/ML | 2022 |
| 9 | Building a Unified Chat Experience at DoorDash | Messaging | 2022 |
Dropbox
Dropbox Tech Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | How Dropbox evolved its infrastructure through the messaging system model | Architecture, Messaging | 2025 |
| 2 | Dropbox's scalable, consistent, metadata caching solution | Caching | 2024 |
| 3 | Bringing AI-powered answers and summaries to file previews on the web | AI/ML | 2024 |
| 4 | Dropbox's ML-powered file organization | AI/ML | 2023 |
| 5 | How Dropbox uses ML to identify date formats in file names | AI/ML | 2023 |
| 6 | How Dropbox optimizes payments with machine learning | AI/ML, Payments | 2021 |
eBay
eBay Tech Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | How ebay Exports Billion-Scale Graphs on Transactional Graph Databases | Databases | 2023 |
| 2 | eBay's Personalized User-Based Ranking Model for Recommendations | AI/ML, Search | 2023 |
| 3 | How Multimodal Embeddings Elevate eBay's Product Recommendations | AI/ML, Search | 2023 |
| 4 | eBay's Blazingly Fast Billion-Scale Vector Similarity Engine | Search, Performance | 2023 |
| 5 | How eBay Handles Real-Time Push Notifications at Scale | Messaging | 2022 |
| 6 | Building a Deep Learning Based Retrieval System for Personalized Recommendations | AI/ML, Search | 2022 |
| 7 | How eBay Loads and Updates Over Ten-Billion-Vertex Graphs | Databases, Performance | 2021 |
| 8 | eBay's real-time and performant index service for its large-scale, in-house database platform | Databases | 2021 |
Facebook/Meta
Meta Engineering Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | Indexing code at scale with Glean - Meta's open source system | Search, Infrastructure | 2024 |
| 2 | Inside Facebook's video delivery system | Video/Media | 2024 |
| 3 | Meta's Sequence learning Model for personalized ads recommendations | AI/ML | 2024 |
| 4 | How Meta animates AI-generated images at scale | AI/ML, Infrastructure | 2024 |
| 5 | How Meta trains large language models at scale | AI/ML, Infrastructure | 2024 |
| 6 | Building Meta's GenAI Infrastructure | AI/ML, Infrastructure | 2024 |
| 7 | RoCE networks for distributed AI training at scale | Infrastructure, AI/ML | 2024 |
| 8 | How Meta built the infrastructure for Threads | Infrastructure | 2023 |
| 9 | Building end-to-end security for Messenger | Security | 2023 |
| 10 | Modernizing Meta's data platform | Data Engineering | 2023 |
| 11 | How Precision Time Protocol is being deployed at Meta | Infrastructure | 2022 |
| 12 | Scaling data ingestion for machine learning training at Meta | AI/ML, Data Engineering | 2022 |
| 13 | Meta's cloud gaming infrastructure | Infrastructure | 2022 |
| 14 | Cache made consistent - How Meta handles cache invalidation | Caching | 2022 |
| 15 | A highly available, strongly consistent storage service using chain replication | Databases, Architecture | 2022 |
| 16 | Making a distributed priority queue disaster-ready | Architecture | 2022 |
| 17 | How we built a general purpose key value store for Facebook with ZippyDB | Databases | 2021 |
| 18 | Fully Sharded Data Parallel: faster AI training with fewer GPUs | AI/ML, Infrastructure | 2021 |
| 19 | How Facebook encodes your videos | Video/Media | 2021 |
| 20 | Scaling a distributed priority queue at Meta | Architecture | 2021 |
| 21 | How machine learning powers Facebook's News Feed ranking algorithm | AI/ML | 2021 |
| 22 | How Meta scaled Live streaming for millions of viewers simultaneously | Video/Media, Performance | 2020 |
Figma
Figma Engineering Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | The infrastructure behind AI search in Figma | Search, AI/ML | 2024 |
| 2 | Speeding up file load times at Figma | Performance | 2024 |
| 3 | Figma's LiveGraph: a real-time data system at scale | Architecture, Data Engineering | 2024 |
| 4 | How Figma horizontally scaled Postgres to unlock nearly infinite scalability | Databases | 2024 |
| 5 | How Figma improved performance and load time with incremental frame loading | Performance | 2024 |
| 6 | How Figma reduced potential instability by scaling to multiple databases | Databases | 2023 |
| 7 | The hidden challenges of autosave | Architecture | 2020 |
| 8 | Figma's deep search to find the right files even faster | Search | 2020 |
Flipkart
Flipkart Tech Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | Flipkart's MySQL Highly Available Setup | Databases | 2023 |
| 2 | Running a multi-region Zookeeper at Flipkart | Infrastructure | 2021 |
| 3 | Memory Tuning a High Throughput Microservice | Performance | 2021 |
| 4 | Building Flipkart's Personalized Search Autosuggestion | AI/ML, Search | 2021 |
| 5 | Predicting your next query even before you type! | AI/ML, Search | 2021 |
| 6 | How Flipkart Adapted Search to Indian Phonetics | Search | 2020 |
GitHub
GitHub Engineering Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | How we improved push processing on GitHub | Performance | 2024 |
| 2 | How GitHub uses merge queue to ship hundreds of changes every day | Infrastructure | 2024 |
| 3 | How GitHub Docs' new search works | Search | 2023 |
| 4 | The technology behind GitHub's new code search | Search | 2023 |
| 5 | Scaling Git's garbage collection | Performance | 2022 |
| 6 | Improve Git monorepo performance with a file system monitor | Performance, Infrastructure | 2022 |
| 7 | Partitioning GitHub's relational databases to handle scale | Databases | 2021 |
Google Research
Google Research Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | Load balancing with random job arrivals | Infrastructure | 2025 |
| 2 | Transformers in music recommendation | AI/ML, Search | 2024 |
| 3 | Scaling multimodal understanding to long videos | AI/ML, Video/Media | 2023 |
| 4 | Answering billions of reporting queries each day with low latency | Databases, Performance | 2023 |
| 5 | Grammar checking at Google Search scale | AI/ML, Search | 2023 |
| 6 | World scale inverse reinforcement learning in Google Maps | AI/ML | 2023 |
| 7 | Resolving code review comments with ML | AI/ML | 2023 |
Instagram Engineering Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | Scaling the Instagram Explore recommendations system | AI/ML, Search | 2023 |
| 2 | Reducing Instagram's basic video compute time by 94 percent | Video/Media, Performance | 2022 |
| 3 | Improving Instagram notification management with machine learning and causal inference | AI/ML, Messaging | 2022 |
| 4 | Building text animations for Instagram Stories | Frontend | 2022 |
| 5 | Pushing the limits of compression in Facebook's mobile apps | Mobile, Performance | 2021 |
| 6 | How Instagram suggests new content | AI/ML, Search | 2020 |
Instacart
Instacart Tech Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | Real-time Fraud Detection with Yoda and ClickHouse | Security, Data Engineering | 2024 |
| 2 | How Instacart Uses ML to Suggest Replacements for Out-of-Stock Products | AI/ML | 2024 |
| 3 | Sequence models for Contextual Recommendations at Instacart | AI/ML, Search | 2024 |
| 4 | Supercharging Discovery in Search with LLMs | AI/ML, Search | 2024 |
| 5 | Optimizing search relevance at Instacart using hybrid retrieval | Search | 2024 |
| 6 | Instacart's Item Availability Architecture: Solving for scale and consistency | Architecture | 2023 |
| 7 | Instacart's one Deep Learning model for multiple surfaces | AI/ML | 2023 |
| 8 | Distributed Machine Learning at Instacart | AI/ML, Infrastructure | 2023 |
| 9 | How Instacart Uses Embeddings to Improve Search Relevance | AI/ML, Search | 2022 |
| 10 | The Journey to Real-Time Machine Learning at Instacart | AI/ML | 2022 |
| 11 | How Instacart Uses ML-Driven Autocomplete to Help People Fill Their Carts | AI/ML, Search | 2022 |
| 12 | How Instacart optimized its Logistics engine using ML | AI/ML | 2021 |
| 13 | A simple search query correction heuristic for the resource-constrained | Search | 2020 |
| 14 | Predicting the real-time availability of 200 million grocery items | AI/ML | 2018 |
| 15 | How Instacart delivers on time | AI/ML | 2018 |
LinkedIn Engineering Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | Scalable federated learning at LinkedIn | AI/ML | 2025 |
| 2 | Building a resilient DNS client for web-scale infrastructure | Infrastructure | 2025 |
| 3 | Journey of next generation control plane for data systems | Infrastructure, Data Engineering | 2025 |
| 4 | Candidate Generation in a Large Scale Graph Recommendation System | AI/ML, Search | 2024 |
| 5 | Accelerating LinkedIn's My Network tab by reducing latency and improving UX | Performance, Frontend | 2024 |
| 6 | Tuning Java for high-performance services | Performance | 2024 |
| 7 | LinkedIn OpenHouse for Big Data Management | Data Engineering | 2023 |
| 8 | How LinkedIn Adopted A GraphQL Architecture for Product Development | Architecture | 2023 |
| 9 | How LinkedIn Is Using Embeddings to Up Its Match Game for Job Seekers | AI/ML, Search | 2023 |
| 10 | Building the Infrastructure for Delivering Labor Market Insights from LinkedIn Data | Data Engineering | 2023 |
| 11 | Upscaling LinkedIn's Profile Datastore While Reducing Costs | Databases, Cost Optimization | 2023 |
| 12 | Unifying Messaging Experiences across LinkedIn | Messaging | 2023 |
| 13 | Applying multitask learning to AI models at LinkedIn | AI/ML | 2022 |
| 14 | Building a mutable dataset in data lake | Data Engineering | 2022 |
| 15 | Completing a member knowledge graph with Graph Neural Networks | AI/ML | 2021 |
| 16 | Homepage feed multi-task learning using TensorFlow | AI/ML | 2021 |
| 17 | Evolving LinkedIn's analytics tech stack | Data Engineering | 2021 |
| 18 | Scaling LinkedIn's Hadoop YARN cluster beyond 10,000 nodes | Infrastructure, Data Engineering | 2021 |
| 19 | HTTP/2 in infrastructure: Ambry network stack refactoring | Infrastructure, Performance | 2021 |
| 20 | Building a heterogeneous social network recommendation system | AI/ML, Search | 2020 |
Lyft
Lyft Engineering Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | From Big Data to Better Data: Ensuring Data Quality with Verity | Data Engineering | 2023 |
| 2 | Building Real-time Machine Learning Foundations at Lyft | AI/ML, Infrastructure | 2023 |
| 3 | The Recommendation System at Lyft | AI/ML, Search | 2023 |
| 4 | lyft2vec — Embeddings at Lyft | AI/ML | 2023 |
| 5 | Powering Millions of Real-Time Decisions with LyftLearn Serving | AI/ML, Infrastructure | 2023 |
| 6 | Pricing at Lyft | Architecture | 2022 |
| 7 | ML Model Training Infrastructure built on Kubernetes | AI/ML, Infrastructure | 2021 |
| 8 | Elasticsearch Optimizations at Lyft | Search, Performance | 2021 |
| 9 | How Lyft discovered OpenStreetMap is the Freshest Map for Rideshare | Data Engineering | 2021 |
| 10 | Using Client-Side Map Data to Improve Real-Time Positioning | Mobile | 2021 |
| 11 | How Lyft predicts a rider's destination for better in-app experience | AI/ML | 2020 |
| 12 | A New Real-Time Map-Matching Algorithm at Lyft | AI/ML | 2020 |
Netflix
Netflix Tech Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | Foundation Model for Personalized Recommendation | AI/ML, Search | 2025 |
| 2 | How Netflix processes billions of impressions daily | Data Engineering | 2025 |
| 3 | Netflix's Distributed Counter Abstraction | Architecture | 2024 |
| 4 | Evolving Netflix's WebSocket proxy for the future | Messaging, Infrastructure | 2024 |
| 5 | Netflix's Key-Value Data Abstraction Layer | Databases | 2024 |
| 6 | Netflix's TimeSeries Data Abstraction Layer | Databases | 2024 |
| 7 | Recommending for Long-Term Member Satisfaction at Netflix | AI/ML | 2024 |
| 8 | Maestro: Data/ML Workflow Orchestrator at Netflix | Data Engineering, AI/ML | 2024 |
| 9 | Reverse Searching Netflix's Federated Graph | Architecture, Search | 2024 |
| 10 | Supporting Diverse ML Systems at Netflix | AI/ML, Infrastructure | 2024 |
| 11 | Rebuilding Netflix Video Processing Pipeline with Microservices | Video/Media, Architecture | 2024 |
| 12 | Building In-Video Search | Search, Video/Media | 2023 |
| 13 | Streaming SQL in Data Mesh | Data Engineering | 2023 |
| 14 | Migrating Netflix to GraphQL Safely | Architecture | 2023 |
| 15 | Scaling Media Machine Learning at Netflix | AI/ML, Video/Media | 2023 |
| 16 | Building a Media Understanding Platform for ML Innovations | AI/ML, Video/Media | 2023 |
| 17 | Finding Cuts with Smooth Visual Transitions Using Machine Learning | AI/ML, Video/Media | 2022 |
| 18 | Machine Learning for Fraud Detection in Streaming Services | AI/ML, Security | 2022 |
| 19 | Netflix's High-Throughput, Low-Latency Priority Queueing System | Architecture, Performance | 2022 |
| 20 | Rapid Event Notification System at Netflix | Messaging | 2022 |
| 21 | Building Netflix's Distributed Tracing Infrastructure | Observability | 2020 |
Notion
Notion Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | Building and scaling Notion's data lake | Data Engineering | 2024 |
| 2 | How we sped up Notion in the browser with WASM SQLite | Performance, Frontend | 2024 |
| 3 | The Great Re-shard: adding Postgres capacity (again) with zero downtime | Databases | 2023 |
| 4 | Creating the Notion API | Architecture | 2022 |
| 5 | The data model behind Notion's flexibility | Architecture, Databases | 2021 |
| 6 | Lessons learned from sharding Postgres at Notion | Databases | 2021 |
PayPal
PayPal Tech Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | Scaling PayPal's AI Capabilities with PayPal Cosmos.AI Platform | AI/ML, Infrastructure | 2024 |
| 2 | Scaling Kafka to Support PayPal's Data Growth | Data Engineering | 2023 |
| 3 | JunoDB: PayPal's Key-Value Store | Databases | 2023 |
| 4 | Scaling Kubernetes to Over 4k Nodes and 200k Pods | Infrastructure | 2022 |
| 5 | GraphQL at PayPal: An Adoption Story | Architecture | 2021 |
| 6 | How PayPal Uses Real-time Graph Database and Graph Analysis to Fight Fraud | Security, Databases | 2021 |
| 7 | Next-Gen Data Movement Platform at PayPal | Data Engineering | 2021 |
| 8 | Deploying Large-scale Fraud Detection Machine Learning Models at PayPal | AI/ML, Security | 2021 |
Pinterest Engineering Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | How Pinterest improved Search Relevance using LLMs | AI/ML, Search | 2025 |
| 2 | How Pinterest built it's Text-to-SQL feature | AI/ML, Data Engineering | 2024 |
| 3 | Change Data Capture at Pinterest | Data Engineering | 2024 |
| 4 | Real Time Anomaly Detection at Pinterest | Observability | 2023 |
| 5 | Improving Distributed Caching Performance and Efficiency at Pinterest | Caching | 2022 |
| 6 | How Pinterest Leverages Realtime User Actions to Boost Homefeed Engagement Volume | AI/ML, Search | 2022 |
| 7 | How Pinterest scaled the size of it's ad corpus by 60x | Performance | 2021 |
| 8 | The machine learning behind delivering relevant ads | AI/ML | 2021 |
Quora
Quora Engineering Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | Building Embedding Search at Quora | Search, AI/ML | 2024 |
| 2 | Migrating a decade of Redshift usages to Trino at Quora | Data Engineering | 2024 |
| 3 | Trino at Quora Scale: Cost, Speed, and Reliability | Data Engineering, Performance | 2023 |
| 4 | MySQL sharding at Quora | Databases | 2020 |
Razorpay
Razorpay Engineering Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | Razorpay's Authentication Revamp | Performance, Security | 2023 |
| 2 | The Making of Razorpay Developer-Console | Frontend | 2023 |
| 3 | How Razorpay Reduced Data Platform Cost by $2M | Cost Optimization | 2023 |
| 4 | Reducing Kubernetes cost by $300,000 at Razorpay | Cost Optimization, Infrastructure | 2023 |
| 5 | How does Razorpay Capital Detect Duplicate or Fraud Merchants? | Security, AI/ML | 2023 |
| 6 | Razorpay's Real-Time Denormalized Data Streaming Platform | Data Engineering | 2023 |
| 7 | How Razorpay's Notification Service Handles Increasing Load | Messaging, Performance | 2022 |
| 8 | How Trino and Alluxio power analytics at Razorpay | Data Engineering | 2022 |
| 9 | Handling Burst Traffic During IPL | Performance, Infrastructure | 2021 |
Reddit Engineering Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | Evolving Reddit's Media Infrastructure | Video/Media, Infrastructure | 2025 |
| 2 | Scaling our Apache Flink powered real-time ad event validation pipeline | Data Engineering | 2025 |
| 3 | Scaling Reddit's ad-serving system | Performance | 2024 |
| 4 | Product Candidate Generation for Reddit Dynamic Product Ads | AI/ML | 2024 |
| 5 | Scaling Ads Pacing: from Singleton to Sharded | Architecture | 2024 |
| 6 | Introducing a Global Retrieval Ranking Model in the Ads Funnel | AI/ML | 2024 |
| 7 | Building an Experiment-Based Routing Service | Architecture | 2023 |
| 8 | The Reddit Media Metadata Store | Video/Media, Databases | 2023 |
Salesforce
Salesforce Engineering Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | Scaling Real-Time Search to 30 Billion Queries with Sub-Second Latency and 0% Downtime | Search, Performance | 2025 |
| 2 | Scaling Agentic AI Powering 2 Billion Predictions Monthly | AI/ML | 2025 |
| 3 | How Agentforce Data Library Powers RAG with 99.99% Uptime | AI/ML | 2025 |
| 4 | Secrets for Managing 100,000 Training and Metadata Requests Per Minute | AI/ML, Infrastructure | 2024 |
| 5 | Inside the Brain of Agentforce | AI/ML | 2024 |
| 6 | How Salesforce Supports Millions of Users Seamlessly for GenAI | AI/ML, Infrastructure | 2024 |
| 7 | Inside Salesforce's Scalable Time Series Forecasting AI Platform | AI/ML, Data Engineering | 2024 |
| 8 | How Salesforce's Data Cloud Handles 250 Trillion Transactions Weekly | Data Engineering, Performance | 2024 |
Shopify
Shopify Engineering Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | How Shopify improved consumer search intent with real-time ML | AI/ML, Search | 2024 |
| 2 | Horizontally scaling the Rails backend of Shop app with Vitess | Databases, Performance | 2024 |
| 3 | Improving Shopify App's Performance | Performance, Mobile | 2024 |
| 4 | Building a ShopifyQL Code Editor | Frontend | 2023 |
| 5 | Creating a Flexible Order Routing System with Shopify Functions | Architecture | 2023 |
| 6 | Using Server Sent Events to Simplify Real-time Streaming at Scale | Architecture, Data Engineering | 2022 |
| 7 | Capturing Every Change From Shopify's Sharded Monolith | Data Engineering, Architecture | 2021 |
Slack
Slack Engineering Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | How Slack Optimizes its E2E Pipeline | Infrastructure | 2025 |
| 2 | How Slack built enterprise search to be secure and private | Search, Security | 2025 |
| 3 | Advancing Our Chef Infrastructure | Infrastructure | 2024 |
| 4 | How We Re-Architected Slack for Our Largest Customers | Architecture | 2024 |
| 5 | How Slack automatically detects stolen session cookies | Security | 2024 |
| 6 | How a request flows — from a Slack's user perspective | Architecture | 2023 |
| 7 | Slack's Migration to a Cellular Architecture | Architecture | 2023 |
| 8 | Real-time Messaging at Slack | Messaging | 2023 |
| 9 | How Slack traces the flow of notifications across systems | Observability, Messaging | 2023 |
| 10 | Slack's Unified end-to-end machine learning infrastructure to generate recommendations | AI/ML | 2023 |
| 11 | How We Design Our APIs at Slack | Architecture | 2021 |
| 12 | How we built an eventually-consistent data model to predict Slack Connect invites | AI/ML, Architecture | 2021 |
| 13 | Migrating Millions of Concurrent Websockets to Envoy | Infrastructure, Messaging | 2021 |
| 14 | Scaling Datastores at Slack with Vitess | Databases | 2020 |
Snap
Snap Engineering Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | Bento - Snap's ML Platform | AI/ML, Infrastructure | 2025 |
| 2 | Snap's Embedding-based Retrieval for its video recommendation system | AI/ML, Search | 2023 |
| 3 | How Snap Speed Up Feature Engineering for Recommendation Systems | AI/ML, Data Engineering | 2022 |
| 4 | How Snap leverages synthetic data to boost the development of ML models | AI/ML | 2022 |
| 5 | Training Large-Scale Recommendation Models with TPUs | AI/ML, Infrastructure | 2022 |
| 6 | Machine Learning for Snapchat Ad Ranking | AI/ML | 2022 |
Spotify
Spotify Engineering Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | How Spotify Generated Millions of Content Annotations | AI/ML, Data Engineering | 2024 |
| 2 | Spotify's Data Platform | Data Engineering | 2024 |
| 3 | The What, Why, and How of Mastering App Size | Mobile, Performance | 2023 |
| 4 | How Spotify Automated Content Marketing to Acquire Users at Scale | AI/ML | 2023 |
| 5 | How We Built Infrastructure to Run User Forecasts at Spotify | Infrastructure, AI/ML | 2022 |
Stripe
Stripe Engineering Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | Stripe's system for tracking and validating money movement | Payments, Architecture | 2024 |
| 2 | How Stripe Processed $1 Trillion in Payments with Zero Downtime | Databases, Payments | 2023 |
| 3 | How Stripe built its fraud prevention system | Security, Payments | 2023 |
| 4 | How Stripe builds interactive docs with Markdoc | Frontend | 2022 |
| 5 | Stripe's payments APIs: The first 10 years | Architecture, Payments | 2020 |
Swiggy
Swiggy Engineering Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | Swiggy's Text-to-SQL Solution | AI/ML, Data Engineering | 2024 |
| 2 | Optimising the picking process for faster Instamart deliveries | AI/ML | 2024 |
| 3 | Improving search relevance using small language models | AI/ML, Search | 2024 |
| 4 | Predicting Food Delivery Time at Cart | AI/ML | 2023 |
| 5 | Contextual Bandits for Ads Recommendations | AI/ML | 2022 |
| 6 | Using deep learning to detect dissonance between address text and location | AI/ML | 2022 |
| 7 | Designing Resilient Microservices at Swiggy | Architecture | 2021 |
| 8 | Designing the Serviceability Platform at Swiggy for High Scale | Architecture, Performance | 2021 |
| 9 | A brief introduction to Engineering challenges at Swiggy | Architecture | 2021 |
| 10 | Re-Architecting Swiggy's logistics systems | Architecture | 2021 |
| 11 | Using Deep Learning for Ranking in Dish Search | AI/ML, Search | 2021 |
| 12 | Learning to Predict Two-Wheeler Travel Distance | AI/ML | 2021 |
| 13 | Learning To Rank Restaurants | AI/ML, Search | 2021 |
| 14 | Running Geo Queries At Scale | Databases, Performance | 2020 |
| 16 | Deploying deep learning models at scale at Swiggy | AI/ML, Infrastructure | 2020 |
Tinder
Tinder Tech Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | Tinder API Style Guide | Architecture | 2024 |
| 2 | Building Obsidian, Tinder's Design System | Frontend | 2023 |
| 3 | How Tinder built its API Gateway | Architecture, Infrastructure | 2022 |
| 4 | Scaling out Tinder Android Payment Flow using State Machine | Mobile, Payments | 2020 |
Twitch
Twitch Engineering Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | Ingesting Live Video Streams at Global Scale | Video/Media, Infrastructure | 2022 |
| 2 | Breaking the Monolith at Twitch | Architecture | 2022 |
| 3 | Using Machine Learning to Review Emotes | AI/ML | 2022 |
| 4 | Defense, threat modeling and High Availability at Twitch | Security, Infrastructure | 2021 |
Twitter/X
Twitter/X Engineering Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | Twitter's Recommendation Algorithm | AI/ML, Search | 2023 |
| 2 | How we scaled Reads On the Twitter Users Database | Databases, Performance | 2023 |
| 3 | Powering real-time data analytics with Druid at Twitter | Data Engineering | 2022 |
| 4 | How we built Twitter's highly reliable ads pacing service | Architecture | 2021 |
| 5 | Storing and retrieving millions of ad impressions per second | Databases, Performance | 2021 |
| 6 | Processing billions of events in real time at Twitter | Data Engineering | 2021 |
| 7 | Logging at Twitter | Observability | 2021 |
| 8 | Twitter's ads serving platform | Architecture | 2021 |
Uber
Uber Engineering Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | Migrating Uber's Compute Platform to Kubernetes | Infrastructure | 2025 |
| 2 | MySQL At Uber | Databases | 2025 |
| 3 | How Uber Uses Ray to Optimize the Rides Business | AI/ML | 2025 |
| 4 | How Uber Optimizes LLM Training | AI/ML | 2024 |
| 5 | Natural Language to SQL Using Gen AI | AI/ML | 2024 |
| 6 | Lucene: Uber's Search Platform | Search | 2024 |
| 7 | Uber's implementation of Live Activity on iOS | Mobile | 2024 |
| 8 | Odin: Uber's Stateful Platform | Infrastructure | 2024 |
| 9 | Kafka Tiered Storage at Uber | Data Engineering | 2024 |
| 10 | Modernizing Logging at Uber with CLP | Observability | 2024 |
| 11 | How Uber ensures Apache Cassandra's tolerance for single-zone failure | Databases, Infrastructure | 2024 |
| 12 | How LedgerStore Supports Trillions of Indexes at Uber | Databases | 2024 |
| 13 | Balancing HDFS DataNodes in the Uber DataLake | Data Engineering | 2024 |
| 14 | How Uber Serves Over 40 Million Reads Per Second from Online Storage Using an Integrated Cache | Caching, Performance | 2024 |
| 15 | How Uber Optimized Cassandra Operations At Scale | Databases | 2023 |
| 16 | How Uber Optimizes the Timing of Push Notifications using ML and Linear Programming | AI/ML, Messaging | 2022 |
| 17 | Deduping and Storing Images at Uber Eats | Infrastructure | 2022 |
| 18 | Uber's Next Gen Push Platform on gRPC | Messaging, Infrastructure | 2022 |
| 19 | Uber's Highly Scalable and Distributed Shuffle as a Service | Data Engineering | 2022 |
| 20 | How Uber Predicts Arrival Times Using Deep Learning | AI/ML | 2022 |
| 21 | Real-Time Exactly-Once Ad Event Processing with Apache Flink, Kafka, and Pinot | Data Engineering | 2021 |
Walmart
Walmart Global Tech Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | Walmart's Cassandra CDC Solution | Data Engineering, Databases | 2022 |
| 2 | Scaling the Walmart Inventory Reservations API for Peak Traffic | Performance, Architecture | 2022 |
| 3 | A Markov Chain Formulation for the Grocery Item Picking Process | AI/ML | 2021 |
| 4 | How we rebuilt the Walmart Autocomplete Backend | Search, Performance | 2021 |
| 5 | Building a Notification Framework for Microservice-based Application | Messaging, Architecture | 2021 |
Zomato
Zomato Tech Blog
| # | Article | Topics | Year |
|---|---|---|---|
| 1 | Building a cost-effective logging platform for petabyte scale | Observability, Cost Optimization | 2023 |
| 2 | How Zomato Handles 100 Million Daily Search Queries | Search, Performance | 2023 |
| 3 | How Zomato Powers restaurant ads using ML | AI/ML | 2022 |
| 4 | How Zomato uses embeddings to identify and cluster unique addresses | AI/ML | 2022 |
| 5 | How Zomato predicts your order's Food preparation time | AI/ML | 2022 |
| 6 | How Zomato locates its users | Mobile | 2021 |
| 7 | The Deep Tech Behind Estimating Food Preparation Time | AI/ML | 2020 |
Contributing
Contributions are welcome! Please read the following guidelines:
- Fork the repository
- Add your article suggestion with the following format:
- Article must be from a well-known tech company's engineering blog
- Include the article title, URL, topic tags, and year
- Submit a pull request
Please ensure:
- The article is a genuine engineering blog post (not a marketing piece)
- The link is working and points to the original source
- The topic tags match the categories used in this list
License
MIT - feel free to use this list however you'd like!
If you find this repository helpful, please consider giving it a star! It helps others discover these valuable engineering resources.
Related repositories
For developers, who are building real-time data-driven applications, Redis is the preferred, fastest, and most feature-rich cache, data structure server, and document and vector query engine.
The 30 Days of Python programming challenge is a step-by-step guide to learn the Python programming language in 30 days. This challenge may take more than 100 days. Follow your own pace. These videos may help too: https://www.youtube.com/channel/UC7PNRuno1rzYPb1xLa4yktw
🔥🔥🔥 AI-driven database tool and SQL client, The hottest GUI client, supporting MySQL, Oracle, PostgreSQL, DB2, SQL Server, DB2, SQLite, H2, ClickHouse, and more.
Chat with your database or your datalake (SQL, CSV, parquet). PandasAI makes data analysis conversational using LLMs and RAG.
Quick answers
Is ashishps1/awesome-engineering-articles open source?
Yes — ashishps1/awesome-engineering-articles ships under the MIT license, which makes its source code freely readable (and, depending on license terms, forkable and reusable). Source: github.com/ashishps1/awesome-engineering-articles.
What else is in the Data space?
ashishps1/awesome-engineering-articles is tracked by TopGit under the Data category, alongside 8 GitHub-tagged topics. Trending and Topics pages list peer repositories of comparable stars and language.
What is ashishps1/awesome-engineering-articles?
ashishps1/awesome-engineering-articles (ashishps1/awesome-engineering-articles) is a multi-language project on GitHub. From the project's own README: A curated collection of 300+ engineering blog articles from top tech companies. Learn how the best engineering teams solve real-world problems at scale.
What license does ashishps1/awesome-engineering-articles use?
ashishps1/awesome-engineering-articles is released under the MIT license. Always verify the LICENSE file directly on GitHub for the authoritative terms — license strings can be edited out of sync with a project's actual stance.
Where can I see ashishps1/awesome-engineering-articles in action?
The project maintains a homepage at https://algomaster.io. The README tab on this page also usually contains screenshots and a quickstart.
Where do I read more about ashishps1/awesome-engineering-articles?
This TopGit page is a snapshot — the READ ME tab shows the project's own README content (links stripped, images preserved). The GitHub repository at github.com/ashishps1/awesome-engineering-articles is the definitive source.
Why is ashishps1/awesome-engineering-articles categorized under Data?
TopGit places ashishps1/awesome-engineering-articles in the Data category based on its GitHub topics and description (tagged: "ai", "data-engineering", "database"). Categories are assigned from real repository metadata, not editorial guesswork.
Read full README in the tab above.