Direkt zum Inhalt springen
Computer Vision Group
TUM School of Computation, Information and Technology
Technical University of Munich

Technical University of Munich

Menu

Links

Informatik IX
Computer Vision Group

Boltzmannstrasse 3
85748 Garching info@vision.in.tum.de

Follow us on:

News

04.03.2024

We have twelve papers accepted to CVPR 2024. Check our publication page for more details.

18.07.2023

We have four papers accepted to ICCV 2023. Check out our publication page for more details.

02.03.2023

CVPR 2023

We have six papers accepted to CVPR 2023. Check out our publication page for more details.

15.10.2022

NeurIPS 2022

We have two papers accepted to NeurIPS 2022. Check out our publication page for more details.

15.10.2022

WACV 2023

We have two papers accepted at WACV 2023. Check out our publication page for more details.

More


Learning Kinematic Models of Articulated Objects

How can a manipulation robot robustly operate doors and drawers?

Service robots operating in domestic environments are typically faced with a variety of objects they have to deal with to fulfill their tasks. Some of these objects are articulated such as cabinet doors and drawers, or room and garage doors. The ability to deal with such articulated objects is relevant for service robots, as, for example, they need to open doors when navigating between rooms and to open cabinets to pick up objects in fetch-and-carry applications.

We developed a complete probabilistic framework that enables robots to learn kinematic models of articulated objects from observations of their motion. We combine parametric and nonparametric models consistently and utilize the advantages of both methods. As a result of our approach, a robot can robustly operate articulated objects in unstructured environments. As an illustrating example, consider the images below where a mobile manipulation robot interacts with various articulated objects in a kitchen environment, learns their kinematic properties, and infers their kinematic structure.

All software is available open-source (including documentation and tutorials) on http://www.ros.org/wiki/articulation.

Related Publications


Export as PDF, XML, TEX or BIB

Books | Book Chapters | Journal Articles | Conference and Workshop Papers | PhD Thesis | Technical Reports | Other Publications
Books
2013
[] Approaches to Probabilistic Model Learning for Mobile Manipulation Robots (J. Sturm), Springer, 2013.  [bibtex] [pdf]
Books | Book Chapters | Journal Articles | Conference and Workshop Papers | PhD Thesis | Technical Reports | Other Publications
Book Chapters
2012
[]Body Schema Learning (J. Sturm, C. Plagemann and W. Burgard), Chapter in Towards Service Robots for Everyday Environments, Springer Berlin/Heidelberg, 2012.  [bibtex] [pdf]
Books | Book Chapters | Journal Articles | Conference and Workshop Papers | PhD Thesis | Technical Reports | Other Publications
Journal Articles
2014
[]Scale-Aware Navigation of a Low-Cost Quadrocopter with a Monocular Camera (J. Engel, J. Sturm and D. Cremers), In Robotics and Autonomous Systems (RAS), volume 62, 2014.  [bibtex] [pdf]
2013
[]Introduction to the special issue on visual understanding and applications with RGB-D cameras (Z. Liu, M. Beetz, D. Cremers, J. Gall, W. Li, D. Pangercic, J. Sturm and Y.-W. Tai), In Journal of Visual Communication and Image Representation (JVCI), 2013.  [bibtex]
[]3D Mapping with an RGB-D Camera (F. Endres, J. Hess, J. Sturm, D. Cremers and W. Burgard), In IEEE Transactions on Robotics (T-RO), volume 30, 2013.  [bibtex] [pdf]
2012
[]Online-6D-SLAM für RGB-D-Sensoren (F. Endres, J. Hess, N. Engelhard, J. Sturm and W. Burgard), In at - Automatisierungstechnik, volume 60, 2012.  [bibtex] [pdf]
2011
[]A Probabilistic Framework for Learning Kinematic Models of Articulated Objects (J. Sturm, C. Stachniss and W. Burgard), In Journal on Artificial Intelligence Research (JAIR), volume 41, 2011.  [bibtex] [pdf]
[]Tactile Sensing for Mobile Manipulation (S. Chitta, J. Sturm, M. Piccoli and W. Burgard), In IEEE Transactions on Robotics (T-RO), 2011.  [bibtex] [pdf]
2009
[] An appearance-based visual compass for mobile robots (J. Sturm and A. Visser), In Robotics and Autonomous Systems, volume 57, 2009.  [bibtex] [pdf] [doi] [pdf]
[] Body schema learning for robotic manipulators from visual self-perception (J. Sturm, C. Plagemann and W. Burgard), In Journal of Physiology-Paris, volume 103, 2009. (Neurorobotics) [bibtex] [pdf] [doi] [pdf]
Books | Book Chapters | Journal Articles | Conference and Workshop Papers | PhD Thesis | Technical Reports | Other Publications
Conference and Workshop Papers
2017
[]De-noising, Stabilizing and Completing 3D Reconstructions On-the-go using Plane Priors (M. Dzitsiuk, J. Sturm, R. Maier, L. Ma and D. Cremers), In International Conference on Robotics and Automation (ICRA), 2017. ([video]) [bibtex] [pdf]
2014
[]Towards Illumination-invariant 3D Reconstruction using ToF RGB-D Cameras (C. Kerl, M. Souiai, J. Sturm and D. Cremers), In International Conference on 3D Vision (3DV), 2014. ([supplementary]) [bibtex] [pdf]
[]INS-Camera Calibration without Ground Control Points (D. Bender, M. Schikora, J. Sturm and D. Cremers), In 9th IEEE ISIF Workshop on Sensor Data Fusion: Trends, Solutions, Applications (SDF), 2014.  [bibtex] [pdf]
[]Visual-Inertial Navigation for a Camera-Equipped 25g Nano-Quadrotor (O. Dunkley, J. Engel, J. Sturm and D. Cremers), In IROS2014 Aerial Open Source Robotics Workshop, 2014.  [bibtex] [pdf] [video]
[]Submap-based Bundle Adjustment for 3D Reconstruction from RGB-D Data (R. Maier, J. Sturm and D. Cremers), In German Conference on Pattern Recognition (GCPR), 2014. ([slides]) [bibtex] [pdf]Oral Presentation
[]Collision Avoidance for Quadrotors with a Monocular Camera (H. Alvarez, L.M. Paz, J. Sturm and D. Cremers), In Proc. of The 12th International Symposium on Experimental Robotics (ISER), 2014.  [bibtex] [pdf]
[]Volumetric 3D Mapping in Real-Time on a CPU (F. Steinbruecker, J. Sturm and D. Cremers), In International Conference on Robotics and Automation (ICRA), 2014.  [bibtex] [pdf]
2013
[]Interactive Person Following and Gesture Recognition with a Flying Robot (T. Naseer, J. Sturm and D. Cremers), In Proc. of the Assistance and Service Robotics Workshop (ASROB) at the IEEE. Int. Conf. on Intelligent Robots and Systems (IROS), 2013.  [bibtex] [pdf]
[]Large-Scale Multi-Resolution Surface Reconstruction from RGB-D Sequences (F. Steinbruecker, C. Kerl, J. Sturm and D. Cremers), In IEEE International Conference on Computer Vision (ICCV), 2013.  [bibtex] [pdf]
[]Semi-Dense Visual Odometry for a Monocular Camera (J. Engel, J. Sturm and D. Cremers), In IEEE International Conference on Computer Vision (ICCV), 2013.  [bibtex] [pdf] [video]
[]CopyMe3D: Scanning and Printing Persons in 3D (J. Sturm, E. Bylow, F. Kahl and D. Cremers), In German Conference on Pattern Recognition (GCPR), 2013.  [bibtex] [pdf]
[]Graph-based bundle adjustment for INS-camera calibration (D. Bender, M. Schikora, J. Sturm and D. Cremers), In Unmanned Aerial Vehicle in Geomatics (UAV-g), 2013.  [bibtex] [pdf]Best research paper award
[]Dense Tracking and Mapping with a Quadrocopter (J. Sturm, E. Bylow, F. Kahl and D. Cremers), In Unmanned Aerial Vehicle in Geomatics (UAV-g), 2013.  [bibtex] [pdf]
[]Scale-Aware Object Tracking with Convex Shape Constraints on RGB-D Images (M. Klodt, J. Sturm and D. Cremers), In German Conference on Pattern Recognition (GCPR), 2013.  [bibtex] [pdf]
[]FollowMe: Person Following and Gesture Recognition with a Quadrocopter (T. Naseer, J. Sturm and D. Cremers), In Proc. of the Int. Conf. on Intelligent Robot Systems (IROS), 2013.  [bibtex] [pdf]
[]Dense Visual SLAM for RGB-D Cameras (C. Kerl, J. Sturm and D. Cremers), In Proc. of the Int. Conf. on Intelligent Robot Systems (IROS), 2013.  [bibtex] [pdf]
[]Learning Probabilistic Models for Mobile Manipulation Robots (J. Sturm and W. Burgard), In Proc. of the International Joint Conference on Artificial Intelligence (IJCAI), Track on Best papers in Sister Conferences, 2013.  [bibtex] [pdf]
[]Direct Camera Pose Tracking and Mapping With Signed Distance Functions (E. Bylow, J. Sturm, C. Kerl, F. Kahl and D. Cremers), In Demo Track of the RGB-D Workshop on Advanced Reasoning with Depth Cameras at the Robotics: Science and Systems Conference (RSS), 2013.  [bibtex] [pdf]
[]Real-Time Camera Tracking and 3D Reconstruction Using Signed Distance Functions (E. Bylow, J. Sturm, C. Kerl, F. Kahl and D. Cremers), In Robotics: Science and Systems Conference (RSS), 2013.  [bibtex] [pdf]
[]Robust Odometry Estimation for RGB-D Cameras (C. Kerl, J. Sturm and D. Cremers), In International Conference on Robotics and Automation (ICRA), 2013.  [bibtex] [pdf]Best Vision Paper Award - Finalist
2012
[]Evaluating Egomotion and Structure-from-Motion Approaches Using the TUM RGB-D Benchmark (J. Sturm, W. Burgard and D. Cremers), In Proc. of the Workshop on Color-Depth Camera Fusion in Robotics at the IEEE/RJS International Conference on Intelligent Robot Systems (IROS), 2012.  [bibtex] [pdf]
[]Accurate Figure Flying with a Quadrocopter Using Onboard Visual and Inertial Sensing (J. Engel, J. Sturm and D. Cremers), In Proc. of the Workshop on Visual Control of Mobile Robots (ViCoMoR) at the IEEE/RJS International Conference on Intelligent Robot Systems (IROS), 2012.  [bibtex] [pdf]
[]A Benchmark for the Evaluation of RGB-D SLAM Systems (J. Sturm, N. Engelhard, F. Endres, W. Burgard and D. Cremers), In Proc. of the International Conference on Intelligent Robot Systems (IROS), 2012.  [bibtex] [pdf]
[]Camera-Based Navigation of a Low-Cost Quadrocopter (J. Engel, J. Sturm and D. Cremers), In Proc. of the International Conference on Intelligent Robot Systems (IROS), 2012.  [bibtex] [pdf] [video]
[]Real-Time Human Motion Tracking using Multiple Depth Cameras (L. Zhang, J. Sturm, D. Cremers and D. Lee), In Proc. of the International Conference on Intelligent Robot Systems (IROS), 2012.  [bibtex] [pdf]
[]A Generalized Framework for Opening Doors and Drawers in Kitchen Environments (T. Ruehr, J. Sturm, D. Pangercic, M. Beetz and D. Cremers), In International Conference on Robotics and Automation (ICRA), 2012.  [bibtex] [pdf]
[]An Evaluation of the RGB-D SLAM System (F. Endres, J. Hess, N. Engelhard, J. Sturm, D. Cremers and W. Burgard), In International Conference on Robotics and Automation (ICRA), 2012.  [bibtex] [pdf]
2011
[]Mobile Manipulation of Kitchen Containers (J. Becker, C. Bersch, D. Pangercic, B. Pitzer, T. Rühr, B. Sankaran, J. Sturm, C. Stachniss, M. Beetz and W. Burgard), In Proc. of the IROS'11 Workshop on Results, Challenges and Lessons Learned in Advancing Robots with a Common Platform, 2011.  [bibtex] [pdf]
[]Real-Time Visual Odometry from Dense RGB-D Images (F. Steinbruecker, J. Sturm and D. Cremers), In Workshop on Live Dense Reconstruction with Moving Cameras at the Intl. Conf. on Computer Vision (ICCV), 2011.  [bibtex] [pdf]
[]Towards a benchmark for RGB-D SLAM evaluation (J. Sturm, S. Magnenat, N. Engelhard, F. Pomerleau, F. Colas, W. Burgard, D. Cremers and R. Siegwart), In Proc. of the RGB-D Workshop on Advanced Reasoning with Depth Cameras at Robotics: Science and Systems Conf. (RSS), 2011.  [bibtex] [pdf] [pdf]
[]Real-time 3D visual SLAM with a hand-held camera (N. Engelhard, F. Endres, J. Hess, J. Sturm and W. Burgard), In Proc. of the RGB-D Workshop on 3D Perception in Robotics at the European Robotics Forum, 2011.  [bibtex] [pdf]
[]Learning the State Transition Model to Efficiently Clean Surfaces with Mobile Manipulation Robots (J. Hess, J. Sturm and W. Burgard), In Proc. of the Workshop on Manipulation under Uncertainty at the IEEE Int. Conf. on Robotics and Automation (ICRA), 2011.  [bibtex] [pdf]
2010
[]Operating Articulated Objects Based on Experience (J. Sturm, A. Jain, C. Stachniss, C. C. Kemp and W. Burgard), In Proc. of the International Conference on Intelligent Robot Systems (IROS), 2010.  [bibtex] [pdf]
[]Tactile Object Class and Internal State Recognition for Mobile Manipulation (S. Chitta, M. Piccoli and J. Sturm), In International Conference on Robotics and Automation (ICRA), 2010.  [bibtex] [pdf]
[]Vision-based Detection for Learning Articulation Models of Cabinet Doors and Drawers in Household Environments (J. Sturm, K. Konolige, C. Stachniss and W. Burgard), In International Conference on Robotics and Automation (ICRA), 2010.  [bibtex] [pdf]
[]3D Pose Estimation, Tracking and Model Learning of Articulated Objects from Dense Depth Video using Projected Texture Stereo (J. Sturm, K. Konolige, C. Stachniss and W. Burgard), In Proc. of the Workshop on Advanced Reasoning with Depth Cameras at the Robotics: Science and Systems Conference (RSS), 2010.  [bibtex] [pdf]
2009
[]Object Identification with Tactile Sensors Using Bag-of-Features (A. Schneider, J. Sturm, C. Stachniss, M. Reisert, H. Burkhardt and W. Burgard), In Proc. of the International Conference on Intelligent Robot Systems (IROS), 2009.  [bibtex] [pdf]
[]Regression-Based Online Situation Recognition for Vehicular Traffic Scenarios (D. Meyer-Delius, J. Sturm and W. Burgard), In Proc. of the International Conference on Intelligent Robot Systems (IROS), 2009.  [bibtex] [pdf]
[]Learning Kinematic Models for Articulated Objects (J. Sturm, V. Pradeep, C. Stachniss, C. Plagemann, K. Konolige and W. Burgard), In Proc. of the International Joint Conference on Artificial Intelligence (IJCAI), 2009.  [bibtex] [pdf]
[]Towards Understanding Articulated Objects (J. Sturm, C. Stachniss, V. Pradeep, C. Plagemann, K. Konolige and W. Burgard), In Proc. of the Workshop on Robot Manipulation at Robotics: Science and Systems Conference (RSS), 2009.  [bibtex] [pdf]
[]Learning Kinematics from Direct Self-Observation Using Nearest-Neighbor Methods (H. Schulz, L. Ott, J. Sturm and W. Burgard), In Proc. of the German Workshop on Robotics, 2009.  [bibtex] [pdf]
[]Imitation Learning with Generalized Task Descriptions (C. Eppner, J. Sturm, M. Bennewitz, C. Stachniss and W. Burgard), In International Conference on Robotics and Automation (ICRA), 2009.  [bibtex] [pdf]
2008
[]Body Scheme Learning and Life-Long Adaptation for Robotic Manipulation (J. Sturm, C. Plagemann and W. Burgard), In Proc. of the Workshop on Robot Manipulation at the Robotics: Science and Systems Conference (RSS), 2008.  [bibtex] [pdf]
[]Adaptive Body Scheme Models for Robust Robotic Manipulation (J. Sturm, C. Plagemann and W. Burgard), In Robotics: Science and Systems Conference (RSS), 2008.  [bibtex] [pdf]
[]Unsupervised Body Scheme Learning through Self-Perception (J. Sturm, C. Plagemann and W. Burgard), In International Conference on Robotics and Automation (ICRA), 2008.  [bibtex] [pdf]
2006
[]Dutch AIBO Team at RoboCup 2006 (A. Visser, P. van Rossum, J. Westra, J. Sturm and D. A. van Sand M. de Greef), In Proceedings CD RoboCup 2006, Bremen, Germany, 2006.  [bibtex] [pdf]
[]Robot companion localization at home and in the office (A. Visser, J. Sturm and F.C.A. Groen), In Proc. of the Belgian-Netherlands Artificial Intelligence Conference (BNAIC), 2006.  [bibtex] [pdf]
[]Panoramic Localization in the 4-Legged League (J. Sturm, P. van Rossum and A. Visser), In Proc. of the RoboCup International Symposium (G. Lakemeyer, E. Sklar, D. Sorrenti, T. Takahashi, eds.), Springer, volume 4434, 2006.  [bibtex] [pdf]
[]Autonomous Color Learning in an Artificial Environment (D. A. van Sand M. de Greef, J. Sturm and A. Visser), In Proc. of the Belgian-Netherlands Artificial Intelligence Conference (BNAIC), 2006.  [bibtex] [pdf]
2005
[]Dutch AIBO Team at RoboCup 2005 (N. Wijngaards, F. Dignum, P. Jonker, T. de Ridder, A. Visser, S. Leijnen and J. Sturm), In Proceedings CD RoboCup 2005, Osaka, Japan, 2005.  [bibtex] [pdf]
Books | Book Chapters | Journal Articles | Conference and Workshop Papers | PhD Thesis | Technical Reports | Other Publications
PhD Thesis
2011
[]Approaches to Probabilistic Model Learning for Mobile Manipulation Robots (J. Sturm), PhD thesis, University of Freiburg, 2011.  [bibtex] [pdf]Received the Artificial Intelligence Dissertation Award 2011 (ECCAI) and the Wolfgang-Genter-Award 2011 (University of Freiburg); Finalist at the Georges-Giralt-Award 2012 (EURON); Selected for the Best Paper Track at IJCAI 2013
Books | Book Chapters | Journal Articles | Conference and Workshop Papers | PhD Thesis | Technical Reports | Other Publications
Technical Reports
2006
[]Dutch Aibo Team: Technical Report RoboCup 2006 (A. Visser, J. Sturm, P. van Rossum, J. Westra and T. Bink), Technical report, Dutch Aibo Team, 2006.  [bibtex] [pdf]
2005
[]Dutch Aibo Team: Technical Report RoboCup 2005 (J. Sturm, A. Visser and N. Wijngaards), Technical report, Dutch Aibo Team, 2005.  [bibtex] [pdf]
Books | Book Chapters | Journal Articles | Conference and Workshop Papers | PhD Thesis | Technical Reports | Other Publications
Other Publications
2013
[]Lecture Notes: Visual Navigation for Flying Robots (J. Sturm), Technische Universität München, Germany, 2013.  [bibtex] [pdf]Distinguished with the TUM TeachInf Award for the best lecture in summer term 2013
2012
[]Lecture Notes: Visual Navigation for Flying Robots (J. Sturm), Technische Universität München, Germany, 2012.  [bibtex] [pdf]Distinguished with the TUM TeachInf Award for the best lecture in summer term 2012
2006
[]An appearance-based Visual Compass for Mobile Robots (J. Sturm), Master's thesis, University of Amsterdam, 2006.  [bibtex] [pdf]
Powered by bibtexbrowser
Export as PDF, XML, TEX or BIB

Rechte Seite

Informatik IX
Computer Vision Group

Boltzmannstrasse 3
85748 Garching info@vision.in.tum.de

Follow us on:

News

04.03.2024

We have twelve papers accepted to CVPR 2024. Check our publication page for more details.

18.07.2023

We have four papers accepted to ICCV 2023. Check out our publication page for more details.

02.03.2023

CVPR 2023

We have six papers accepted to CVPR 2023. Check out our publication page for more details.

15.10.2022

NeurIPS 2022

We have two papers accepted to NeurIPS 2022. Check out our publication page for more details.

15.10.2022

WACV 2023

We have two papers accepted at WACV 2023. Check out our publication page for more details.

More