Park, Jungin Lee, Jiyoung Kim, Ig-Jae Sohn, Kwanghoon 2024-01-12T03:41:47Z 2024-01-12T03:41:47Z 2023-01-13 2022-06 1063-6919 https://pubs.kist.re.kr/handle/201004/77185 This paper presents Probabilistic Video Contrastive Learning, a self-supervised representation learning method that bridges contrastive learning with probabilistic representation. We hypothesize that the clips composing the video have different distributions in short-term duration, but can represent the complicated and sophisticated video distribution through combination in a common embedding space. Thus, the proposed method represents video clips as normal distributions and combines them into a Mixture of Gaussians to model the whole video distribution. By sampling embeddings from the whole video distribution, we can circumvent the careful sampling strategy or transformations to generate augmented views of the clips, unlike previous deterministic methods that have mainly focused on such sample generation strategies for contrastive learning. We further propose a stochastic contrastive loss to learn proper video distributions and handle the inherent uncertainty from the nature of the raw video. Experimental results verify that our probabilistic embedding stands as a state-of-the-art video representation learning for action recognition and video retrieval on the most popular benchmarks, including UCF101 and HMDB51. English IEEE COMPUTER SOC Probabilistic Representations for Video Contrastive Learning Conference 10.1109/CVPR52688.2022.01430 1 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp.14691 - 14701 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 14691 14701 US New Orleans, LA 2022-06-18 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022) 000870783000028 2-s2.0-85141646491