Irawati, S. Calder？n, D. Ko, H. 2024-01-12T08:15:15Z 2024-01-12T08:15:15Z 2022-03-07 2005-12 0000-0000 https://pubs.kist.re.kr/handle/201004/81950 This paper presents a multimodal interaction framework for semantic 3D object manipulation in the virtual reality. In our framework, interaction devices such as keyboard, mouse, joystick, tracker, can be combined with speech utterance to give a command to the system. We define an object ontology based on common sense knowledge which defines relationships between virtual objects. By taking into account the current user context and the object ontology, semantic integration component integrates the interpretation result from input manager, and then sends the result to the interaction manager. That result will be mapped into a proper object manipulation. Thus, the system can understand the user intention and assist him for achieving his goal in the handling process, instead of relying entirely on the user's control upon the interaction device and the object, avoiding nonsensical manipulations. English Association for Computing Machinery Semantic 3D object manipulation using object ontology in multimodal interaction framework Conference 10.1145/1152399.1152407 1 2005 International Conference on Augmented Tele-Existence, ICAT '05, pp.35 - 39 2005 International Conference on Augmented Tele-Existence, ICAT '05 35 39 US Christchurch 2005-12-05 ACM International Conference Proceeding Series 2-s2.0-77953501190