Lee, Minhyeok Cho, Suhwan Lee, Seunghoon Park, Chaewon Lee, Sangyoun 2024-01-12T02:47:39Z 2024-01-12T02:47:39Z 2023-07-28 2023-01 2472-6737 https://pubs.kist.re.kr/handle/201004/76508 Unsupervised video object segmentation aims to segment a target object in the video without a ground truth mask in the initial frame. This challenging task requires extracting features for the most salient common objects within a video sequence. This difficulty can be solved by using motion information such as optical flow, but using only the information between adjacent frames results in poor connectivity between distant frames and poor performance. To solve this problem, we propose a novel prototype memory network architecture. The proposed model effectively extracts the RGB and motion information by extracting superpixel-based component prototypes from the input RGB images and optical flow maps. In addition, the model scores the usefulness of the component prototypes in each frame based on a self-learning algorithm and adaptively stores the most useful prototypes in memory and discards obsolete prototypes. We use the prototypes in the memory bank to predict the next query frame's mask, which enhances the association between distant frames to help with accurate mask prediction. Our method is evaluated on three datasets, achieving state-of-the-art performance. We prove the effectiveness of the proposed model with various ablation studies. English IEEE COMPUTER SOC Unsupervised Video Object Segmentation via Prototype Memory Network Conference 10.1109/WACV56688.2023.00587 1 23rd IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), pp.5913 - 5923 23rd IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 5913 5923 US Waikoloa, HI 2023-01-03 2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV) 000971500206005 2-s2.0-85149017502