microsoft/UFO

microsoft/UFO là một trong những repo tích hợp AI mà TopGit theo dõi, hiện có 10.2k sao, viết chủ yếu bằng Python. UFO³: Weaving the Digital Agent Galaxy
Tóm tắt dựng từ metadata GitHub của chính dự án — chưa có bài review TopGit. Trang sẽ tự động cập nhật khi bài review đầy đủ được xuất bản.
TopGit viết bài đầy đủ cho repo có nhiều sao nhất và được yêu cầu nhiều nhất. Trang này là snapshot trong thời gian chờ — xem README gốc ở tab READ ME.
Snapshot
Cộng tác viên hàng đầu
Xem cộng tác viên hàng đầu
UFO³
: Weaving the Digital Agent Galaxy
From Single Device Agent to Multi-Device Galaxy
📖 Language / 语言: English | 中文
📚 Quick Links: 🌌 UFO³ README • 🖥️ UFO² README • 📖 Full Documentation
🎯 Choose Your Path
|
|
🎬 See UFO³ Galaxy in Action
Watch how UFO³ Galaxy orchestrates complex workflows across multiple devices:
🎥 Click to watch: Cross-device task orchestration with UFO³ Galaxy
🌟 What's New in UFO³?
Evolution Timeline
%%{init: {'theme':'base', 'themeVariables': { 'primaryColor':'#E8F4F8','primaryTextColor':'#1A1A1A','primaryBorderColor':'#7CB9E8','lineColor':'#A8D5E2','secondaryColor':'#B8E6F0','tertiaryColor':'#D4F1F4','fontSize':'16px','fontFamily':'Segoe UI, Arial, sans-serif'}}}%%
graph LR
A["<b>🎈 UFO</b><br/><span style='font-size:14px'>February 2024</span><br/><span style='font-size:13px; color:#666'><i>GUI Agent for Windows</i></span>"]
B["<b>🖥️ UFO²</b><br/><span style='font-size:14px'>April 2025</span><br/><span style='font-size:13px; color:#666'><i>Desktop AgentOS</i></span>"]
C["<b>🌌 UFO³ Galaxy</b><br/><span style='font-size:14px'>November 2025</span><br/><span style='font-size:13px; color:#666'><i>Multi-Device Orchestration</i></span>"]
A -->|Evolve| B
B -->|Scale| C
style A fill:#E8F4F8,stroke:#7CB9E8,stroke-width:2.5px,color:#1A1A1A,rx:15,ry:15
style B fill:#C5E8F5,stroke:#5BA8D0,stroke-width:2.5px,color:#1A1A1A,rx:15,ry:15
style C fill:#A4DBF0,stroke:#3D96BE,stroke-width:2.5px,color:#1A1A1A,rx:15,ry:15
🚀 UFO³ = Galaxy (Multi-Device Orchestration) + UFO² (Device Agent)
UFO³ introduces Galaxy, a revolutionary multi-device orchestration framework that coordinates intelligent agents across heterogeneous platforms. Built on five tightly integrated design principles:
-
🌟 Declarative Decomposition into Dynamic DAG - Requests decomposed into structured DAG with TaskStars and dependencies for automated scheduling and runtime rewriting
-
🔄 Continuous Result-Driven Graph Evolution - Living constellation that adapts to execution feedback through controlled rewrites and dynamic adjustments
-
⚡ Heterogeneous, Asynchronous & Safe Orchestration - Capability-based device matching with async execution, safe locking, and formally verified correctness
-
🔌 Unified Agent Interaction Protocol (AIP) - WebSocket-based secure coordination layer with fault tolerance and automatic reconnection
-
🛠️ Template-Driven MCP-Empowered Device Agents - Lightweight toolkit for rapid agent development with MCP integration for tool augmentation
| Aspect | UFO² | UFO³ Galaxy |
|---|---|---|
| Architecture | Single Windows Agent | Multi-Device Orchestration |
| Task Model | Sequential ReAct Loop | DAG-based Constellation Workflows |
| Scope | Single device, multi-app | Multi-device, cross-platform |
| Coordination | HostAgent + AppAgents | ConstellationAgent + TaskOrchestrator |
| Device Support | Windows Desktop | Windows, Linux, Android (more coming) |
| Task Planning | Application-level | Device-level with dependencies |
| Execution | Sequential | Parallel DAG execution |
| Device Agent Role | Standalone | Can serve as Galaxy device agent |
| Complexity | Simple to Moderate | Simple to Very Complex |
| Learning Curve | Low | Moderate |
| Cross-Device Collaboration | ❌ Not Supported | ✅ Core Feature |
| Setup Difficulty | ✅ Easy | ⚠️ Moderate |
| Status | ✅ LTS (Long-Term Support) | ⚡ Active Development |
🎓 Migration Path
For UFO² Users:
- ✅ Keep using UFO² – Fully supported, actively maintained
- 🔄 Gradual adoption – Galaxy can use UFO² as Windows device agent
- 📈 Scale up – Move to Galaxy when you need multi-device capabilities
- 📚 Learning resources – Migration Guide
✨ Capabilities at a Glance
🌌 Galaxy Framework – What's Different?
🌟 Constellation PlanningBenefits:
|
🎯 Device AssignmentSmart Matching:
|
📊 OrchestrationOrchestration:
|
🪟 UFO² Desktop AgentOS – Core Strengths
UFO² serves dual roles: standalone Windows automation and Galaxy device agent for Windows platforms.
| Feature | Description | Documentation |
|---|---|---|
| Deep OS Integration | Windows UIA, Win32, WinCOM native control | Learn More |
| Hybrid Actions | GUI clicks + API calls for optimal performance | Learn More |
| Speculative Multi-Action | Batch predictions → 51% fewer LLM calls | Learn More |
| Visual + UIA Detection | Hybrid control detection for robustness | Learn More |
| Knowledge Substrate | RAG with docs, demos, execution traces | Learn More |
| Device Agent Role | Can serve as Windows executor in Galaxy orchestration | Learn More |
As Galaxy Device Agent:
- Receives tasks from ConstellationAgent via Galaxy orchestration layer
- Executes Windows-specific operations using proven UFO² capabilities
- Reports status and results back to TaskOrchestrator
- Participates in cross-device workflows seamlessly
🚀 Quick Start Guide
Choose your path and follow the detailed setup guide:
🌌 Galaxy Quick StartFor cross-device orchestration 📖 Complete Guide:
|
🪟 UFO² Quick StartFor Windows automation 📖 Complete Guide:
|
📋 Common Configuration
Both frameworks require LLM API configuration. Choose your provider:
OpenAI Configuration
For Galaxy (config/galaxy/agent.yaml):
CONSTELLATION_AGENT:
REASONING_MODEL: false
API_TYPE: "openai"
API_BASE: "https://api.openai.com/v1/chat/completions"
API_KEY: "sk-your-key-here"
API_MODEL: "gpt-4o"
For UFO² (config/ufo/agents.yaml):
VISUAL_MODE: True
API_TYPE: "openai"
API_BASE: "https://api.openai.com/v1/chat/completions"
API_KEY: "sk-your-key-here"
API_MODEL: "gpt-4o"
Azure OpenAI Configuration
For Galaxy (config/galaxy/agent.yaml):
CONSTELLATION_AGENT:
REASONING_MODEL: false
API_TYPE: "aoai"
API_BASE: "https://YOUR-RESOURCE.openai.azure.com"
API_KEY: "your-azure-key"
API_MODEL: "gpt-4o"
API_DEPLOYMENT_ID: "your-deployment-id"
For UFO² (config/ufo/agents.yaml):
VISUAL_MODE: True
API_TYPE: "aoai"
API_BASE: "https://YOUR-RESOURCE.openai.azure.com"
API_KEY: "your-azure-key"
API_MODEL: "gpt-4o"
API_DEPLOYMENT_ID: "your-deployment-id"
💡 More LLM Options: See Model Configuration Guide for Qwen, Gemini, Claude, and more.
📚 Documentation Structure
🌌 Galaxy Documentation
📖 Technical Documentation:
|
🪟 UFO² Documentation
📖 Online Docs:
|
📢 Latest Updates
2025-11 – UFO³ Galaxy Framework Released 🌌
Major Research Breakthrough: Multi-Device Orchestration System
- 🌟 Declarative DAG Decomposition: TaskConstellation structure for workflow logic and dependencies
- 🔄 Dynamic Graph Evolution: Living constellation that adapts through controlled rewrites
- 🎯 Heterogeneous Orchestration: Safe, asynchronous execution with capability-based device matching
- 🔌 Unified AIP Protocol: WebSocket-based secure agent coordination with fault tolerance
- 🛠️ MCP-Empowered Agent Framework: Template-driven toolkit for rapid device agent development
- 📄 Research Paper: UFO³: Weaving the Digital Agent Galaxy
Key Features:
- First multi-device orchestration framework for GUI agents
- Result-driven adaptive execution instead of rigid workflows
- Model Context Protocol (MCP) integration for tool augmentation
- Formally verified correctness and concurrency safety guarantees
2025-04 – UFO² v2.0.0
- 📅 UFO² Desktop AgentOS released
- 🏗️ Enhanced architecture with AgentOS concept
- 📄 Technical Report published
- ✅ Entered Long-Term Support (LTS) status
2024-02 – Original UFO
- 🎈 First UFO release - UI-Focused agent for Windows
- 📄 Original Paper
- 🌍 Wide media coverage and adoption
📚 Citation
If you use UFO³ Galaxy or UFO² in your research, please cite the relevant papers:
UFO³ Galaxy Framework (2025)
@article{zhang2025ufo3,
title={UFO$^3$: Weaving the Digital Agent Galaxy},
author = {Zhang, Chaoyun and Li, Liqun and Huang, He and Ni, Chiming and Qiao, Bo and Qin, Si and Kang, Yu and Ma, Minghua and Lin, Qingwei and Rajmohan, Saravan and Zhang, Dongmei},
journal = {arXiv preprint arXiv:2511.11332},
year = {2025},
}
UFO² Desktop AgentOS (2025)
@article{zhang2025ufo2,
title = {{UFO2: The Desktop AgentOS}},
author = {Zhang, Chaoyun and Huang, He and Ni, Chiming and Mu, Jian and Qin, Si and He, Shilin and Wang, Lu and Yang, Fangkai and Zhao, Pu and Du, Chao and Li, Liqun and Kang, Yu and Jiang, Zhao and Zheng, Suzhen and Wang, Rujia and Qian, Jiaxu and Ma, Minghua and Lou, Jian-Guang and Lin, Qingwei and Rajmohan, Saravan and Zhang, Dongmei},
journal = {arXiv preprint arXiv:2504.14603},
year = {2025}
}
Original UFO (2024)
@article{zhang2024ufo,
title = {{UFO: A UI-Focused Agent for Windows OS Interaction}},
author = {Zhang, Chaoyun and Li, Liqun and He, Shilin and Zhang, Xu and Qiao, Bo and Qin, Si and Ma, Minghua and Kang, Yu and Lin, Qingwei and Rajmohan, Saravan and Zhang, Dongmei and Zhang, Qi},
journal = {arXiv preprint arXiv:2402.07939},
year = {2024}
}
🌐 Media & Community
Media Coverage:
- 微软正式开源UFO²,Windows桌面迈入「AgentOS 时代」
- Microsoft's UFO: Smarter Windows Experience
- 下一代Windows系统曝光
- More coverage →
Community:
- 💬 GitHub Discussions
- 🐛 Issue Tracker
- 📧 Email: [email protected]
- 📺 YouTube Channel
🎨 Related Projects & Research
Microsoft Research:
- TaskWeaver – Code-first LLM agent framework for data analytics and task automation
GUI Agent Research:
- LLM-Brained GUI Agents Survey – Comprehensive survey of GUI automation agents
- Interactive Survey Site – Explore latest GUI agent research and developments
Multi-Agent Systems:
- UFO³ Galaxy represents a novel approach to multi-device orchestration, introducing the Constellation framework for coordinating heterogeneous agents across platforms
- Builds on multi-agent coordination research while addressing unique challenges of cross-device GUI automation
Benchmarks:
- Windows Agent Arena (WAA) – Evaluation benchmark for Windows automation agents
- OSWorld – Cross-application task evaluation suite
💡 FAQ
🤔 Should I use Galaxy or UFO²?
Start with UFO² if:
- You only need Windows automation
- You want quick setup and learning
- Tasks are relatively simple
Choose Galaxy if:
- You need cross-device coordination
- Tasks are complex and multi-step
- You want advanced orchestration
- You're comfortable with active development
Hybrid approach if:
- You want best of both worlds
- Some tasks are simple (UFO²), some complex (Galaxy)
- You're gradually migrating
⚠️ Will UFO² be deprecated?
No! UFO² has entered Long-Term Support (LTS) status:
- ✅ Actively maintained
- ✅ Bug fixes and security updates
- ✅ Performance improvements
- ✅ Full community support
- ✅ No plans for deprecation
UFO² is the stable, proven solution for Windows automation.
🔄 How do I migrate from UFO² to Galaxy?
Migration is gradual and optional:
- Phase 1: Learn – Understand Galaxy concepts
- Phase 2: Experiment – Try Galaxy with non-critical tasks
- Phase 3: Hybrid – Use both frameworks
- Phase 4: Migrate – Gradually move complex tasks to Galaxy
No forced migration! Continue using UFO² as long as it meets your needs.
See Migration Guide for details.
🎯 Can Galaxy do everything UFO² does?
Functionally: Yes. Galaxy can use UFO² as a Windows device agent.
Practically: It depends.
- For simple Windows tasks: UFO² standalone is easier and more streamlined
- For complex workflows: Galaxy orchestrates UFO² with other device agents
Recommendation: Use the right tool for the job. UFO² can work standalone or as Galaxy's Windows device agent.
📊 How mature is Galaxy?
Status: Active Development 🚧
Stable:
- ✅ Core architecture
- ✅ DAG orchestration
- ✅ Basic multi-device support
- ✅ Event system
In Development:
- 🔨 Advanced device types
- 🔨 Enhanced monitoring
- 🔨 Performance optimization
- 🔨 Extended documentation
Recommendation: Great for experimentation and non-critical workflows.
🔧 Can I extend or customize?
Both frameworks are highly extensible:
UFO²:
- Custom actions and automators
- Custom knowledge sources (RAG)
- Custom control detectors
- Custom evaluation metrics
Galaxy:
- Custom agents
- Custom device types
- Custom orchestration strategies
- Custom visualization components
See respective documentation for extension guides.
🤝 How can I contribute?
We welcome contributions to both UFO² and Galaxy!
Ways to contribute:
- 🐛 Report bugs and issues
- 💡 Suggest features and improvements
- 📝 Improve documentation
- 🧪 Add tests and examples
- 🔧 Submit pull requests
See CONTRIBUTING.md for guidelines.
⚠️ Disclaimer & License
Disclaimer: By using this software, you acknowledge and agree to the terms in DISCLAIMER.md.
License: This project is licensed under the MIT License.
Trademarks: Use of Microsoft trademarks follows Microsoft's Trademark Guidelines.
🚀 Ready to Get Started?
🌌 Explore GalaxyMulti-Device Orchestration |
🪟 Try UFO²Windows Desktop Agent |
© Microsoft 2025 | UFO³ is an open-source research project
⭐ Star us on GitHub | 🤝 Contribute | 📖 Read the docs | 💬 Join discussions
From Single Agent to Digital Galaxy
UFO³ - Weaving the Future of Intelligent Automation
Repo liên quan
Dify is an open-source LLM app platform that packages a visual workflow/agent builder, RAG pipeline, model provider management, and app-level APIs into one self-hostable (or cloud) stack, aimed at teams who want to skip stitching those pieces together themselves.
The TradingAgents LLM framework splits a trading decision across specialized agents — four analysts, bullish and bearish researchers, a trader, and a risk/portfolio manager — built on LangGraph, with the README explicitly framing it as a research tool rather than investment advice.
Firecrawl is an API and set of SDKs for turning any URL into Markdown, structured JSON, or a screenshot, handling JS rendering and proxy rotation itself. It's built for feeding AI agents and LLM pipelines clean web data, with dedicated search, crawl, map, and agent endpoints, an MCP server, and SDKs for nine languages.
AutoGPT is an open-source platform designed for building, deploying, and running AI agents that can carry out complete workflows. Users can define tasks in plain English or use a visual builder to shape each step. The project offers two primary paths: a managed, hosted AutoGPT Platform that handles infrastructure and model access for a fee, and a self-hosting option that is free but requires users to provide their own infrastructure and model API keys. Agents can run on demand, on schedules, or from triggers, connecting to over 45 platforms and hundreds of AI models. It's presented as a tool to automate various functions, from executive operations and sales research to marketing campaign drafts and incident triage in engineering.
Trả lời nhanh
Cùng nhóm AI Tools còn repo nào?
microsoft/UFO thuộc nhóm AI Tools trên TopGit, cùng 6 topic GitHub. Trang Trending và Topics liệt kê các repo cùng số sao và cùng ngôn ngữ để so sánh.
Đọc thêm về microsoft/UFO ở đâu?
Trang TopGit này là một snapshot — tab "Readme" hiển thị nguyên văn README của repo (đã bỏ link, giữ ảnh). Repo GitHub ở github.com/microsoft/UFO là nguồn chính thức.
microsoft/UFO có bao nhiêu sao?
microsoft/UFO có 10.2k sao GitHub — tải lại trang để xem số mới nhất, hoặc xem trực tiếp github.com/microsoft/UFO. TopGit phản chiếu số sao của GitHub nhưng không cam kết đến từng phút.
microsoft/UFO có những chủ đề gì?
GitHub topics của microsoft/UFO: "agent", "automation", "copilot", "gui", "llm", "windows". TopGit xếp repo vào nhóm AI Tools.
microsoft/UFO có phải mã nguồn mở không?
Có — microsoft/UFO phát hành theo license MIT, nghĩa là mã nguồn mở để đọc, fork và (tùy license) tái sử dụng. Mã: github.com/microsoft/UFO.
microsoft/UFO có trang demo không?
Dự án có trang chủ ở https://microsoft.github.io/UFO/. Tab "Readme" ở trang này thường có ảnh chụp và hướng dẫn bắt đầu nhanh.
microsoft/UFO còn đang phát triển không?
Commit gần nhất trên microsoft/UFO là 4 tháng trước (theo timestamp GitHub). Repo có 1.1k fork — một chỉ báo về mức độ quan tâm của cộng đồng.
Đọc đầy đủ README ở tab phía trên.
Chưa chắc UFO có hợp với bạn?
Để ChatGPT, Claude hoặc Perplexity tìm hiểu giúp — bấm bên dưới và xem AI nói gì về UFO.