ray-project/kuberay là dự án AI Tools trên GitHub, viết chủ yếu bằng Go, với 2.8k sao. A toolkit to run Ray applications on Kubernetes
Tóm tắt dựng từ metadata GitHub của chính dự án — chưa có bài review TopGit. Trang sẽ tự động cập nhật khi bài review đầy đủ được xuất bản.
VÌ SAO CHƯA CÓ REVIEW
TopGit viết bài đầy đủ cho repo có nhiều sao nhất và được yêu cầu nhiều nhất. Trang này là snapshot trong thời gian chờ — xem README gốc ở tab READ ME.
KubeRay is a powerful, open-source Kubernetes operator that simplifies the deployment and management of Ray applications on Kubernetes. It offers several key components:
KubeRay core: This is the official, fully-maintained component of KubeRay that provides three custom resource definitions, RayCluster, RayJob, and RayService. These resources are designed to help you run a wide range of workloads with ease.
RayCluster: KubeRay fully manages the lifecycle of RayCluster, including cluster creation/deletion, autoscaling, and ensuring fault tolerance.
RayJob: With RayJob, KubeRay automatically creates a RayCluster and submits a job when the cluster is ready. You can also configure RayJob to automatically delete the RayCluster once the job finishes.
RayService: RayService is made up of two parts: a RayCluster and a Ray Serve deployment graph. RayService offers zero-downtime upgrades for RayCluster and high availability.
KubeRay ecosystem: Some optional components.
Kubectl Plugin (Beta): Starting from KubeRay v1.3.0, you can use the kubectl ray plugin to simplify
common workflows when deploying Ray on Kubernetes. If you aren’t familiar with Kubernetes, this
plugin simplifies running Ray on Kubernetes. See kubectl-plugin for more details.
KubeRay APIServer (Alpha): It provides a layer of simplified configuration for KubeRay resources. The KubeRay API server is used internally
by some organizations to back user interfaces for KubeRay resource management. See KubeRay APIServer V2 for more details.
KubeRay Dashboard (Experimental): Starting from KubeRay v1.4.0, we have introduced a new dashboard that enables users to view and manage KubeRay resources.
While it is not yet production-ready, we welcome your feedback. See KubeRay Dashboard for more details.
Documentation
From September 2023, all user-facing KubeRay documentation will be hosted on the Ray documentation.
The KubeRay repository only contains documentation related to the development and maintenance of KubeRay.
Quick Start
RayCluster Quickstart
RayJob Quickstart
RayService Quickstart
Examples
KubeRay examples are hosted on the Ray documentation.
Examples span a wide range of use cases, including training, LLM online inference, batch inference, and more.
Kubernetes Ecosystem
KubeRay integrates with the Kubernetes ecosystem, including observability tools (e.g., Prometheus, Grafana, py-spy), queuing systems (e.g., Volcano, Apache YuniKorn, Kueue), ingress controllers (e.g., Nginx), and more.
See KubeRay Ecosystem for more details.
Blog Posts
Scaling Ray to 10K Models and Beyond Workday
How Klaviyo built a robust model serving platform with Ray Serve Klaviyo
Evolving Niantic AR Mapping Infrastructures with Ray Niantic
Building a Modern Machine Learning Platform with Ray at Samsara Samsara
Using Ray on Kubernetes with KubeRay at Google Cloud Google
How DoorDash Built an Ensemble Learning Model for Time Series Forecasting with KubeRay Doordash
AI/ML Models Batch Training at Scale with Open Data Hub Red Hat
Distributed Machine Learning at Instacart Instacart
Unleashing ML Innovation at Spotify with Ray Spotify
Best Practices For Ray Cluster On ACK Alibaba Cloud
Talks
Advanced Model Serving Techniques with Ray on Kubernetes | KubeCon 2024 NA Anyscale + Google
Building Scalable AI Infrastructure with Kuberay and Kubernetes | Ray Summit 2024 Anyscale + Google
Ray at Scale: Apple's Approach to Elastic GPU Management | Ray Summit 2024 Apple
Scaling Ray Train to 10K Kubernetes Nodes on GKE | Ray Summit 2024 Google
KubeSecRay: Fortifying Multi-Tenant Ray Clusters on Kubernetes | Ray Summit 2024 Microsoft
Scaling LLM Inference: AWS Inferentia Meets Ray Serve on EKS | Ray Summit 2024 AWS
How Roblox Scaled Machine Learning by Leveraging Ray for Efficient Batch Inference | Ray Summit 2024 Roblox
Airbnb's LLM Evolution: Fine-Tuning with Ray | Ray Summit 2024 Airbnb
Ray @ eBay: Pioneering a Next-Gen AI Platform | Ray Summit 2024 eBay
Spotify Harnesses Ray for Next-Gen AI Infrastructure | Ray Summit 2024 Spotify
Spotify's Approach to Distributed LLM Training with Ray on GKE | Ray Summit 2024 Spotify
Reddit's ML Evolution: Scaling with Ray and KubeRay | Ray Summit 2024 Reddit
IBM's Approach to Building a Cloud-Native AI Platform | Ray Summit 2024 IBM
Exploring Hinge's ML Platform Evolution with Ray | Ray Summit 2024 Hinge
How Rubrik Unlocked AI at Scale with Ray Serve | Ray Summit 2024 Rubrik
Supercharge Your AI Platform with KubeRay | KubeCon 2023 NA Anyscale + Google
Sailing Ray Workloads with KubeRay and Kueue in Kubernetes Volcano + DaoCloud
Serving Large Language Models with KubeRay on TPUs Google
Development
Please read our CONTRIBUTING guide before making a pull request. Refer to our DEVELOPMENT to build and run tests locally.
Getting Involved
Join Ray's Slack workspace, and search the following public channels:
#kuberay: This channel aims to help KubeRay users with their questions. The messages will be closely monitored by the Ray and KubeRay maintainers.
KubeRay contributors are welcome to join the bi-weekly KubeRay community meetings.
See the KubeRay community meeting schedule on Ray/KubeRay LFX calendar.
Join the KubeRay community meeting on Zoom.
See GOVERNANCE.md for the roles in the KubeRay community and how they are granted, and
PEOPLE.md for the current role holders.
Security
If you discover a potential security issue in this project, or think you may
have discovered a security issue, please report it according to our
security policy.
Please do not create a public GitHub issue.
License
This project is licensed under the Apache-2.0 License.
We are a Cloud Native Computing Foundation sandbox project.
Copyright Contributors to KubeRay, established as KubeRay a Series of LF Projects, LLC.
For website terms of use, trademark policy and other project policies please see lfprojects.org/policies.
Trang TopGit này là một snapshot — tab "Readme" hiển thị nguyên văn README của repo (đã bỏ link, giữ ảnh). Repo GitHub ở github.com/ray-project/kuberay là nguồn chính thức.
ray-project/kuberay có bao nhiêu sao?
ray-project/kuberay có 2.8k sao GitHub — tải lại trang để xem số mới nhất, hoặc xem trực tiếp github.com/ray-project/kuberay. TopGit phản chiếu số sao của GitHub nhưng không cam kết đến từng phút.
ray-project/kuberay có phải mã nguồn mở không?
Có — ray-project/kuberay phát hành theo license Apache-2.0, nghĩa là mã nguồn mở để đọc, fork và (tùy license) tái sử dụng. Mã: github.com/ray-project/kuberay.
ray-project/kuberay còn đang phát triển không?
Commit gần nhất trên ray-project/kuberay là hôm nay (theo timestamp GitHub). Repo có 916 fork — một chỉ báo về mức độ quan tâm của cộng đồng.
ray-project/kuberay là gì?
ray-project/kuberay (ray-project/kuberay) là dự án Go trên GitHub. Theo mô tả gốc: A toolkit to run Ray applications on Kubernetes
ray-project/kuberay so với các dự án AI Tools khác thế nào?
ray-project/kuberay được TopGit xếp vào nhóm AI Tools, với 2.8k sao GitHub và viết bằng Go. Xem trang chủ đề AI Tools trên TopGit để so sánh với các dự án tương tự theo số sao và mức độ hoạt động.
Đọc đầy đủ README ở tab phía trên.
Chưa chắc kuberay có hợp với bạn?
Để ChatGPT, Claude hoặc Perplexity tìm hiểu giúp — bấm bên dưới và xem AI nói gì về kuberay.