Kim, Jun-Sik Jeon, MyungHwan Park, Jung-Min 2024-01-19T09:38:17Z 2024-01-19T09:38:17Z 2022-03-07 2019-11-07 2153-0858 https://pubs.kist.re.kr/handle/201004/113861 We present a method to manipulate virtual objects which are constrained complexly and reconfigurable as if they would exist in a real world by using multiple hands simultaneously. A complexly constrained, and reconfigurable object, such as a Rubik's cube, is hard to describe its physical motion constraints, mainly because they are determined by the grasping situation and dynamically changeable. Rather than describing the physical motion constraints in a general form, we more focus on the multiple hand interaction of a complex object. A complex object is divided into multiple subparts which are grasped by each hand, and the constraints between the subparts are optimized for inducing natural and continuous movement. For this, we propose a dynamically adjustable data structure for representing object parts grasped by multiple hands, and an optimization-based pose estimation of the constrained subparts along with their grasped hands. The experiments show that human subjects can manipulate a complexly constrained object such as a Rubik's cube without any difficulty as if it exists in the real-world. English IEEE Multi-Hand Direct Manipulation of Complex Constrained Virtual Objects Conference 1 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp.3235 - 3240 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) 3235 3240 US Macau, PEOPLES R CHINA 2019-11-04 2019 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS) 000544658402101 2-s2.0-85081168232