Snapshot của leggedrobotics/robotic_world_model: 703★ · Python. Repository for our papers: Robotic World Model: A Neural Network Simulator for Robust Policy Optimization in Robotics and Uncertainty-Aware Robotic World Model Makes Offline Model-Based Reinforcement Learning Work on Real Robots
Tóm tắt dựng từ metadata GitHub của chính dự án — chưa có bài review TopGit. Trang sẽ tự động cập nhật khi bài review đầy đủ được xuất bản.
VÌ SAO CHƯA CÓ REVIEW
TopGit viết bài đầy đủ cho repo có nhiều sao nhất và được yêu cầu nhiều nhất. Trang này là snapshot trong thời gian chờ — xem README gốc ở tab READ ME.
This repository extends Isaac Lab with environments and training pipelines for
Robotic World Model (RWM),
Uncertainty-Aware Robotic World Model (RWM-U),
and related model-based reinforcement learning methods.
It enables:
joint training of policies and neural dynamics models in Isaac Lab (online),
training of policies with learned neural network dynamics without any simulator (offline),
evaluation of model-based vs. model-free policies,
visualization of autoregressive imagination rollouts from learned dynamics,
visualization of trained policies in Isaac Lab.
Paper: Robotic World Model: A Neural Network Simulator for Robust Policy Optimization in Robotics Project Page: https://sites.google.com/view/roboticworldmodel
Paper: Uncertainty-Aware Robotic World Model Makes Offline Model-Based Reinforcement Learning Work on Real Robots Project Page: https://sites.google.com/view/uncertainty-aware-rwm
Authors: Chenhao Li, Andreas Krause, Marco Hutter Affiliation: ETH AI Center, Learning & Adaptive Systems Group and Robotic Systems Lab, ETH Zurich
Installation
Install Isaac Lab (not needed for offline policy training)
Follow the official installation guide. We recommend using the Conda installation as it simplifies calling Python scripts from the terminal.
Install model-based RSL RL
Follow the official installation guide of model-based RSL RL for model-based reinforcement learning to replace the rsl_rl_lib that comes with Isaac Lab.
Clone this repository (outside your Isaac Lab directory)
Robotic World Model is a model-based reinforcement learning algorithm that learns a dynamics model and a policy concurrently.
Configure model inputs/outputs
You can configure the model inputs and outputs under ObservationsCfg_PRETRAIN in AnymalDFlatEnvCfg_PRETRAIN.
Available components:
SystemStateCfg: state input and output head
SystemActionCfg: action input
SystemExtensionCfg: continuous privileged output head (e.g. rewards etc.)
SystemContactCfg: binary privileged output head (e.g. contacts)
SystemTerminationCfg: binary privileged output head (e.g. terminations)
And you can configure the model architecture and training hyperparameters under RslRlSystemDynamicsCfg and RslRlMbrlPpoAlgorithmCfg in AnymalDFlatPPOPretrainRunnerCfg .
Available options:
ensemble_size: ensemble size for uncertainty estimation
It visualizes the learned dynamics model by rolling out the model autoregressively in imagination, conditioned on the actions from the learned policy.
The dynamics_model_path should point to the pretrained dynamics model checkpoint (e.g. model_<iteration>.pt) inside the saved run directory.
Model-Based Policy Training & Evaluation
Once a dynamics model is pretrained, you can train a model-based policy purely from imagined rollouts generated by the learned dynamics.
There are two options:
Option 1: Train policy in imagination online, where additional environment interactions are continually collected using the latest policy to update the dynamics model (as implemented with RWM and MBPO-PPO in Robotic World Model: A Neural Network Simulator for Robust Policy Optimization in Robotics).
Option 2: Train policy in imagination offline where no additional environment interactions are collected and the policy has to rely on the static dynamics model (as implemented with RWM-U and MOPO-PPO in Uncertainty-Aware Robotic World Model Makes Offline Model-Based Reinforcement Learning Work on Real Robots).
Option 1: Train policy in imagination online
The online data collection relies on interactions with the environment and thus brings up the simulator.
You can either start the policy from pretrained checkpoints or from scratch by simply omitting the --checkpoint argument.
Option 2: Train policy in imagination offline
The offline policy training does not request any new data and thus relies solely on the static dynamics model.
Align the model architecture and specify the model load path under ModelArchitectureConfig in AnymalDFlatConfig.
Additionally, the offline imagination needs to branch off from some initial states. Specify the data path under DataConfig in AnymalDFlatConfig.
Environment configurations + Imagination rollout logic (constructs policy observations & rewards from model outputs)
anymal_d_flat.py.
Algorithm configuration + training parameters
anymal_d_flat_cfg.py.
Pretrained RWM-U checkpoint
pretrain_rnn_ens.pt.
Initial states for imagination rollout
state_action_data_0.csv.
Citation
If you find this repository useful for your research, please consider citing:
@article{li2025robotic,
title={Robotic world model: A neural network simulator for robust policy optimization in robotics},
author={Li, Chenhao and Krause, Andreas and Hutter, Marco},
journal={arXiv preprint arXiv:2501.10100},
year={2025}
}
@article{li2025uncertainty,
title={Uncertainty-Aware Robotic World Model Makes Offline Model-Based Reinforcement Learning Work on Real Robots},
author={Li, Chenhao and Krause, Andreas and Hutter, Marco},
journal={arXiv preprint arXiv:2504.16680},
year={2025}
}
Đọc thêm về leggedrobotics/robotic_world_model ở đâu?
Trang TopGit này là một snapshot — tab "Readme" hiển thị nguyên văn README của repo (đã bỏ link, giữ ảnh). Repo GitHub ở github.com/leggedrobotics/robotic_world_model là nguồn chính thức.
leggedrobotics/robotic_world_model có bao nhiêu sao?
leggedrobotics/robotic_world_model có 703 sao GitHub — tải lại trang để xem số mới nhất, hoặc xem trực tiếp github.com/leggedrobotics/robotic_world_model. TopGit phản chiếu số sao của GitHub nhưng không cam kết đến từng phút.
leggedrobotics/robotic_world_model có tag gì không?
Bản đồng bộ chưa ghi nhận topic GitHub nào cho leggedrobotics/robotic_world_model. GitHub topics hiển thị ở thanh bên phải trang repo — đó là nơi đáng kiểm tra nhất.
leggedrobotics/robotic_world_model có trang demo không?
Dự án có trang chủ ở https://sites.google.com/view/roboticworldmodel. Tab "Readme" ở trang này thường có ảnh chụp và hướng dẫn bắt đầu nhanh.
leggedrobotics/robotic_world_model còn đang phát triển không?
Commit gần nhất trên leggedrobotics/robotic_world_model là 19 ngày trước (theo timestamp GitHub). Repo có 54 fork — một chỉ báo về mức độ quan tâm của cộng đồng.
leggedrobotics/robotic_world_model dùng license gì?
leggedrobotics/robotic_world_model phát hành theo license Apache-2.0. Nên mở file LICENSE trên GitHub để xác nhận — license metadata đôi khi lệch với thực tế dự án.
leggedrobotics/robotic_world_model viết bằng ngôn ngữ gì?
leggedrobotics/robotic_world_model chủ yếu viết bằng Python. Trường "language" của GitHub dựa trên phần lớn byte ở nhánh mặc định.
Đọc đầy đủ README ở tab phía trên.
Muốn nghe thêm một ý kiến về robotic_world_model?
Hỏi một AI đọc được trang này — một cú bấm là có ngay nhận định về robotic_world_model.