Ad

habitat-sim: High-performance 3D simulator for Embodied AI

Simulate Embodied AI agents in realistic 3D environments with support for diverse datasets, sensors, and robots. Offers high speed and flexibility for research and development.
Screenshot of facebookresearch/habitat-sim homepage

Habitat-Sim simulates environments for Embodied AI research, prioritizing simulation speed. It supports a wide range of 3D datasets, including scans from Matterport3D, HSSD, and Replica, as well as CAD models and configurable sensors. The platform facilitates experiments in navigation, instruction following, and other embodied AI tasks, typically used with Habitat-Lab for end-to-end experimentation. Habitat-Sim achieves high frame rates even when simulating complex scenes with multiple agents and effects.

Habitat-Sim distinguishes itself through its focus on simulation speed, allowing for thousands of frames per second, even on single GPUs. Its support for diverse datasets and robot models makes it versatile for various embodied AI research problems. The platform's modular design and pre-commit integration facilitate rapid experimentation and reproducible results. It's designed for both single-GPU and multi-GPU setups and integrates with Bullet physics for realistic dynamics.

  • Data Support: Supports diverse 3D datasets (Matterport3D, HSSD, Replica, etc.) for scene environments.
  • Sensor Configuration: Offers configurable RGB-D cameras and egomotion sensing.
  • Robot Models: Supports various robot models via URDF, including mobile manipulators, fixed-base arms, and quadrupeds.
  • Physics Engine: Integrates with Bullet physics for rigid-body mechanics.
  • Performance: Achieves high frame rates (thousands of FPS) through optimizations.
  • Extensibility: Designed for extending with custom sensors, robots, and environments.
  • Developer Tools: Includes pre-commit hooks and integrates with Habitat-Lab for end-to-end experiments.

Habitat-Sim is an actively developed platform with regular updates and a growing community. Recent commits indicate ongoing maintenance and feature development. Documentation is comprehensive and covers installation, usage, and contributing guidelines. The project has a strong presence in the Embodied AI research community, evidenced by its usage in various publications and research projects.

Habitat-Sim benefits researchers developing Embodied AI agents by providing a flexible, high-performance simulation environment. Its capabilities enable training and benchmarking agents for tasks like navigation and manipulation in realistic 3D scenarios. The platform reduces the complexity of setting up and managing simulation environments, enabling researchers to focus on core AI algorithms and advancements.

Summarize:
Share:
Stars
3,737
Forks
539
Issues
264
Created
7 years ago
Commit
2 months ago
License
MIT
Archived
No
Updated 3 days ago

Similar Repositories