Ryu, Sae-Woon Lee, Sang Hwa Ahn, Sang Chul Park, Jong-Il 2024-01-20T21:02:39Z 2024-01-20T21:02:39Z 2021-09-03 2009-08 0098-3063 https://pubs.kist.re.kr/handle/201004/132280 This paper deals with a real-time image based relighting system fir tangible video teleconference. The proposed image based relighting system renders the extracted human object using the virtual environmental images. The proposed system can homogenize virtually the lighting environments of remote users on the video teleconference, or render the humans like they are in the virtual places. To realize the video teleconference, the paper obtains the reflectance models of users in real-time using the controlled lighting system. The reflectance models of human surface are obtained by a pair of lighting sources which are turned oil and off alternatively. The images with different illuminations are exploited to model the reflectance on the object surfaces. The environment map for rendering is acquired by the mirror ball images or virtual background ones. And the relighting algorithm is implemented by GPU based programming for real-time operation. According to the simulations, the proposed system estimates the reflectance models of human faces, and relights the human faces in real-time. The objects are rendered by the reflectance models and virtual environment map. The proposed system enables the users to immerse video teleconference just as they are in the virtual environments.(1) English IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC DIFFUSE REFLECTION Tangible Video Teleconference System Using Real-Time Image-Based Relighting Article 10.1109/TCE.2009.5277971 1 IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, v.55, no.3, pp.1162 - 1168 IEEE TRANSACTIONS ON CONSUMER ELECTRONICS 55 3 1162 1168 scie scopus 000270358500030 2-s2.0-70350287812 Engineering, Electrical & Electronic Telecommunications Engineering Telecommunications Article DIFFUSE REFLECTION Video teleconference Image based relighting environment map reflectance model GPU controlled lighting