Top1 Solution Of QQ Browser 2021 Ai Algorithm Competition Track 1 : Multimodal Video Similarity | Awesome Learning to Hash Add your paper to Learning2Hash

Top1 Solution Of QQ Browser 2021 Ai Algorithm Competition Track 1 : Multimodal Video Similarity

Zhuoran Ma, Majing Lou, Xuan Ouyang . Arxiv 2021 – 1 citation

[Paper]   Search on Google Scholar   Search on Semantic Scholar
Uncategorized

In this paper, we describe the solution to the QQ Browser 2021 Ai Algorithm Competition (AIAC) Track 1. We use the multi-modal transformer model for the video embedding extraction. In the pretrain phase, we train the model with three tasks, (1) Video Tag Classification (VTC), (2) Mask Language Modeling (MLM) and (3) Mask Frame Modeling (MFM). In the finetune phase, we train the model with video similarity based on rank normalized human labels. Our full pipeline, after ensembling several models, scores 0.852 on the leaderboard, which we achieved the 1st place in the competition. The source codes have been released at Github.

Similar Work