Publications

Google Scholar | DBLP

Representative Publications:

  1. Guo.-Jun. Qi, Xian-Sheng Hua, Yong Rui, Jinhui Tang, Tao Mei, Hong-Jiang Zhang. “Correlative Multi-Label Video Annotation,” ACM International Conference on Multimedia, pp. 17-26, 2007. (2007 ACM Multimedia Best Paper Award)
  2. Zheng-Jun Zha *, Linjun Yang, Tao Mei, Meng Wang, Zengfu Wang, “Visual Query Suggestion,” ACM International Conference on Multimedia, pp. 15-24, 2009. (2009 ACM Multimedia Best Paper Award)
  3. Emily Moxley *, Tao Mei, B. S. Manjunath. “Video Annotation through Search and Graph Reinforcement Mining,” IEEE Trans. on Multimedia, 12(3): 184-193, April 2010. (2013 IEEE T-MM Prize Paper Award)
  4. Teng Li *, Tao Mei, In-So Kweon, Xian-Sheng Hua. “Contextual Bag of Words for Visual Categorization,” IEEE Trans. on Circuits and Systems for Video Technology, 21(4): 381-392, April 2011. (2014 IEEE T-CSVT Best Paper Award)
  5. Xuyong Yang *, Tao Mei, Ying-Qing Xu, Yong Rui, Shipeng Li. “Automatic Generation of Visual-Textual Presentation Layout,” ACM Trans. on Multimedia Computing Communications and Applications, 12(2): 33, 2016. (2017 ACM TOMM Nicolas D. Georganas Best Paper Award)
  6. Tao Mei, Yong Rui, Shipeng Li, Qi Tian. “Multimedia Search Reranking: A Literature Survey,” ACM Computing Surveys, 46(3): 38, September 2014.
  7. Xinchen Liu, Wu Liu, Tao Mei, Huadong Ma. “PROVID: Progressive and Multimodal Vehicle Reidentification for Large-Scale Urban Surveillance,” IEEE Trans. Multimedia, 20(3): 645-658, 2018. (2019 IEEE T-MM Prize Paper Award)
  8. Tao Mei, Xian-Sheng Hua, Shipeng Li. “VideoSense: A Contextual In-Video Advertising System,” IEEE Trans. on Circuits and Systems for Video Technology, 19(12): 1866-1879, Dec. 2009. (The first computational framework for online video advertising)
  9. Yingwei Pan *, Tao Mei, Ting Yao, Houqiang Li, Yong Rui. “Jointly Modeling Embedding and Translation to Bridge Video and Language,” IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, June 2016.
  10. Tao Mei, Bo Yang, Shi-Qiang Yang, Xian-Sheng Hua. “Video Collage: Presenting a Video Sequence Using a Single Image,” The Visual Computer, 25(1): 39-51, Jan. 2009. (2007 ACM Multimedia Best Demo Award)

Note *: students or interns that I mentored at JD AI Research or Microsoft Research.

Selected Publications since 2017:

[2021]

  1. Ting Yao, Yiheng Zhang, Zhaofan Qiu, Yingwei Pan, Tao Mei. “SeCo: Exploring Sequence Supervision for Unsupervised Representation Learning,” AAAI Conference on Artificial Intelligence (AAAI), 2021.
  2. Yehao Li *, Yingwei Pan, Ting Yao, Jingwen Chen, Tao Mei. “Scheduled Sampling in Vision-Language Pretraining with Decoupled Encoder-Decoder Network,” AAAI Conference on Artificial Intelligence (AAAI), 2021.
  3. Tianyu Hua, Hongdong Zheng, Yalong Bai, Wei Zhang, Xiao-Ping Zhang, Tao Mei. “Exploiting Relationship for Complex-scene Image Generation,” AAAI Conference on Artificial Intelligence (AAAI), 2021.
  4. Yachao Zhang, Zonghao Li, Yuan Xie , Yanyun Qu , Cuihua Li, Tao Mei. “Weakly Supervised Semantic Segmentation for Large-Scale Point Cloud,” AAAI Conference on Artificial Intelligence (AAAI), 2021.

[2020]

  1. Tao Mei, Wei Zhang, Ting Yao, “Vision and language: from visual perception to content creation”, APSIPA Transactions on Signal and Information Processing, 2020.
  2. Sijie Song *, Wei Zhang, Jiaying Liu, Zongming Guo, Tao Mei. “Unpaired Person Image Generation with Semantic Parsing Transformation”, IEEE Trans. on Pattern Analysis and Machine Intelligence, 2020.
  3. Qi Wang, Xinchen Liu, Wu Liu, Wenyin Liu, Tao Mei. “MetaSearch: Incremental Product Search via Deep Meta-learning,” IEEE Trans. on Image Processing, 2020.
  4. Qian Bao, Wu Liu, Yuhao Cheng, Boyan Zhou, Tao Mei. “Pose-Guided Tracking-by-Detection: Robust Multi-Person Pose Tracking,” IEEE Trans. Multimedia, 2020.
  5. Jiajun Deng, Yingwei Pan, Ting Yao, Wengang Zhou, Houqiang Li, Tao Mei. “Single Shot Video Object Detector,” IEEE Trans. on Multimedia, 2020.
  6. Heliang Zheng *, Jianlong Fu, Zheng-Jun Zha, Jiebo Luo, Tao Mei. “Learning Rich Part Hierarchies with Progressive Attention Networks for Fine-Grained Image Recognition,” IEEE Trans. on Image Processing, 29: 476-488, 2020.
  7. Qi Cai *, Yu Wang, Yingwei Pan, Ting Yao, Tao Mei. “Joint Contrastive Learning with Infinite Possibilities,” International Conference on Neural Information Processing Systems (NeurIPS), Vancouver, Canada, 2020.
  8. Fuchen Long, Ting Yao, Zhaofan Qiu, Xinmei Tian, Jiebo Luo, Tao Mei. “Learning to Localize Actions from Moments”, European Conference on Computer Vision (ECCV), 2020.
  9. Mohan Zhou, Yalong Bai, Wei Zhang, Tiejun Zhao, Tao Mei. “Look-into-Object: Self-supervised Structure Modeling for Object Recognition,” IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
  10. Qi Cai *, Yingwei Pan, Yu Wang, Jingen Liu, Ting Yao, Tao Mei. “Learning a Unified Sample Weighting Network for Object Detection,” IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
  11. Yingwei Pan, Ting Yao, Yehao Li, Tao Mei. “X-Linear Attention Networks for Image Captioning,” IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
  12. Yiheng Zhang, Zhaofan Qiu, Ting Yao, Chong-Wah Ngo, Dong Liu, Tao Mei. “Transferring and Regularizing Prediction for Semantic Segmentation,” IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
  13. Xiaobo Wang, Shuo Wang, Cheng Chi, Shifeng Zhang, Tao Mei. “Loss Function Search for Face Recognition,” International Conference on Machine Learning (ICML), 2020.
  14. Yinglu Liu, Hailin Shi, Hao Shen, Yue Si, Xiaobo Wang, Tao Mei. “A New Dataset and Boundary-Attention Semantic Segmentation for Face Parsing,” AAAI Conference on Artificial Intelligence (AAAI), 2020.
  15. Qian Bao, Wu Liu, Jun Hong, Lingyu Duan, Tao Mei. “Pose-native Network Architecture Search for Multi-person Human Pose Estimation,” ACM International Conference on Multimedia (ACM Multimedia), 2020.
  16. Jia Li, Nan Gao, Tong Shen, Wei Zhang, Tao Mei, Hui Ren. “SketchMan: Learning to Create Professional Sketches,” ACM International Conference on Multimedia (ACM Multimedia), 2020.
  17. Boqiang Xu, Lingxiao He, Xingyu Liao, Wu Liu, Zhenan Sun, Tao Mei. “Black Re-ID: A Head-shoulder Descriptor for the Challenging Problem of Person Re-Identification,” ACM International Conference on Multimedia (ACM Multimedia), 2020.
  18. Jiahang Wang, Tong Sha, Wei Zhang, Zhoujun Li, Tao Mei. “Down to the Last Detail: Virtual Try-on with Fine-grained Details,” ACM International Conference on Multimedia (ACM Multimedia), 2020.

[2019]

  1. Zechao Li, Jinhui Tang, Tao Mei. “Deep Collaborative Embedding for Social Image Understanding”, IEEE Trans. on Pattern Analysis and Machine Intelligence, 41(9): 2070-2083, 2019.
  2. Canyi Lu *, Jiashi Feng, Zhouchen Lin, Tao Mei, Shuicheng Yan. “Subspace Clustering by Block Diagonal Representation”, IEEE Trans. on Pattern Analysis and Machine Intelligence, 41(2), 487-501, Feb. 2019.
  3. Dongfei Yu *, Jianlong Fu, Xinmei Tian, Tao Mei. “Multi-source Multi-level Attention Networks for Visual Question Answering,” ACM Trans. on Multimedia Computing Communications and Applications, 2019.
  4. Yitian Yuan *, Tao Mei, Peng Cui, Wenwu Zhu. “Video Summarization by Learning Deep Side Semantic Embedding”, IEEE Trans. on Circuits and Systems for Video Technology, 2019.
  5. Yuanzhi Liang, Yalong Bai, Wei Zhang, Xueming Qian, Li Zhu, Tao Mei. “VrR-VG: Refocusing Visually-Relevant Relationships,” IEEE International Conference on Computer Vision (ICCV), 2019.
  6. Ting Yao, Yingwei Pan, Yehao Li, Tao Mei. “Hierarchy Parsing for Image Captioning,” IEEE International Conference on Computer Vision (ICCV), 2019.
  7. Jiajun Deng, Yingwei Pan, Ting Yao, Wengang Zhou, Houqiang Li, Tao Mei. “Relation Distillation Networks for Video Object Detection,” IEEE International Conference on Computer Vision (ICCV), 2019.
  8. Yu Sun, Yun Ye, Wu Liu, Wenpeng Gao, Yili Fu, Tao Mei. “Skeleton-disentangling based Self-attention Temporal Network for Human 3D Mesh Recovery from Monocular Video,” IEEE International Conference on Computer Vision (ICCV), 2019.
  9. Yang Chen, Yingwei Pan, Ting Yao, Xinmei Tian, Tao Mei. “Mocycle-GAN: Unpaired Video-to-Video Translation,” ACM International Conference on Multimedia (ACM MM), 2019.
  10. Dong Li, Ting Yao, Zhaofan Qiu, Houqiang Li, Tao Mei. “Long Short-Term Relation Networks for Video Action Detection,” ACM International Conference on Multimedia (ACM MM), 2019.
  11. Jianhao Zhang, Yingwei Pan, TIng Yao, He Zhao, Tao Mei. “daBNN: A Super Fast Inference Framework for Binary Neural Networks on ARM devices,” ACM International Conference on Multimedia (ACM MM), Open Source Software Competition, 2019.
  12. Zhaofan Qiu, Ting Yao, Chong-Wah Ngo, Xinmei Tian, Tao Mei. “Learning Spatio-Temporal Representation with Local and Global Diffusion,” IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2019.
  13. Sijie Song, Wei Zhang, Jiaying Liu, Tao Mei. “Unsupervised Person Image Generation with Semantic Parsing Transformation,” IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2019.
  14. Yehao Li, Ting Yao, Yingwei Pan, Hongyang Chao, Tao Mei. “Pointing Novel Objects in Image Captioning,” IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2019.
  15. Yingwei Pan, Ting Yao, Yehao Li, Yu Wang, Chong-Wah Ngo, Tao Mei. “Transferrable Prototypical Networks for Unsupervised Domain Adaptation,” IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2019.
  16. Rui Zhu, Shifeng Zhang, Xiaobo Wang, Longyin Wen, Hailin Shi, Liefeng Bo, Tao Mei. “ScratchDet: Training Single-Shot Object Detectors from Scratch,” IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2019.
  17. Fuchen Long, Ting Yao, Zhaofan Qiu, Xinmei Tian, Jiebo Luo, Tao Mei. “Gaussian Temporal Awareness Networks for Action Location,” IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2019.
  18. Yue Chen, Yalong Bai, Wei Zhang, Tao Mei. “Destruction and Construction Learning for Fine-grained Image Recognition,” IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2019.

[2018]

  1. Sijie Song *, Tao Mei. “When Multimedia Meets Fashion”, IEEE Multimedia, 25(3), July-Sept. 2018.
  2. Xinchen Liu, Wu Liu, Tao Mei, Huadong Ma. “PROVID: Progressive and Multimodal Vehicle Reidentification for Large-Scale Urban Surveillance,” IEEE Trans. Multimedia 20(3): 645-658, 2018.
  3. Dong Li *, Ting Yao, Ling-Yu Duan, Tao Mei, Yong Rui. “Unified Spatio-Temporal Attention Networks for Action Recognition in Videos,” IEEE Trans. on Multimedia, 2018.
  4. Hoseong Kim *, Tao Mei, Hyeran Byun, Ting Yao. “Exploiting Web Images for Video Highlight Detection with Triplet Deep Ranking,” IEEE Trans. on Multimedia, 2018.
  5. Zhaofan Qiu *, Ting Yao, Tao Mei. “Learning Deep Spatio-Temporal Dependency for Semantic Video Segmentation”, IEEE Trans. on Multimedia, 2018.
  6. Fuchen Long *, Ting Yao, Qi Dai, Xinmei Tian, Jiebo Luo, Tao Mei. “Deep Domain Adaptation Hashing with Adversarial Learning,” SIGIR, 725-734, 2018.
  7. Dong Li *, Zhaofan Qiu *, Qi Dai, Ting Yao, Tao Mei. “Recurrent Tubelet Proposal and Recognition Networks for Action Detection”, European Conference on Computer Vision (ECCV), Munich, Germany, Sept 2018.
  8. Yalong Bai *, Jianlong Fu, Tao Mei. “Deep Attention Neural Tensor Network for Visual Question Answering”, European Conference on Computer Vision (ECCV), Munich, Germany, Sept 2018.
  9. Ting Yao, Yingwei Pan, Yehao Li, Tao Mei. “Exploring Visual Relationship for Image Captioning”, European Conference on Computer Vision (ECCV), Munich, Germany, Sept 2018.
  10. Yumin Suh *, Jingdong Wang, Siyu Tang, Tao Mei, Kyoung Mu Lee. “Part-Aligned Bilinear Representations for Person Re-identification,” European Conference on Computer Vision (ECCV), Munich, Germany, Sept 2018.
  11. Yiheng Zhang *, Zhaofan Qiu *, Ting Yao, Dong Liu, Tao Mei. “Fully Convolutional Adaptation Networks for Semantic Segmentation,” IEEE Conference on Computer Vision and Pattern Recognition (CVPR), July 2018.
  12. Qi Cai *, Yingwei Pan *, Ting Yao, Chenggang Yan, Tao Mei. “Memory Matching Networks for One-Shot Image Recognition,” IEEE Conference on Computer Vision and Pattern Recognition (CVPR), July 2018.
  13. Yehao Li *, Ting Yao, Yingwei Pan, Hongyang Chao, Tao Mei. “Jointly Localizing and Describing Events for Dense Video Captioning,” IEEE Conference on Computer Vision and Pattern Recognition (CVPR), July 2018.
  14. Shuang Ma *, Jianlong Fu, Chang Wen Chen, Tao Mei. “DA-GAN: Instance-level Image Translation by Deep Attention Generative Adversarial Network”, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), July 2018.
  15. Jing Wang *, Jianlong Fu, Jinhui Tang, Zechao Li, Tao Mei. “Show, Reward and Tell: Automatic Generation of Narrative Paragraph from Photo Stream by Adversarial Learning,” AAAI Conference on Artificial Intelligence (AAAI), 2018.

[2017]

  1. Heliang Zheng *, Jianlong Fu, Tao Mei, Jiebo Luo. “Learning Multi-Attention Convolutional Neural Network for Fine-Grained Image Recognition,” IEEE International Conference on Computer Vision (ICCV), Oct. 2017.
  2. Zhaofan Qiu *, Ting Yao, Tao Mei. “Learning Spatio-Temporal Representation with Pseudo-3D Residual Network,” IEEE International Conference on Computer Vision (ICCV), Oct. 2017.
  3. Ting Yao, Yingwei Pan, Yehao Li, Zhaofan Qiu, Tao Mei. “Boosting Image Captioning with Attribute,” IEEE International Conference on Computer Vision (ICCV), 2017.
  4. Ryota Hinami *, Tao Mei, Shin’ichi Satoh, “Joint Detection and Recounting of Abnormal Events by Learning Deep Generic Knowledge,” IEEE International Conference on Computer Vision (ICCV), 2017.
  5. Yingwei Pan *, Zhaofan Qiu *, Ting Yao, Houqiang Li, Tao Mei. “To Create What You Tell: Generating Videos from Captions,” ACM International Conference on Multimedia (ACM Multimedia), 2017.
  6. Zhaofan Qiu *, Yingwei Pan *, Ting Yao, Tao Mei. “Deep Semantic Hashing with Generative Adversarial Networks,” ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2017.
  7. Zhaofan Qiu *, Ting Yao, Tao Mei. “Deep Quantization: Encoding Convolutional Activations with Deep Generative Model,” IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
  8. Ting Yao, Yingwei Pan *, Yehao Li *, Tao Mei. “Incorporating Copying Mechanism in Image Captioning for Learning Novel Objects,” IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
  9. Jianlong Fu, Heliang Zheng *, Tao Mei. “Look Closer to See Better: Recurrent Attention Convolutional Neural Network for Fine-grained Image Recognition,” IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
  10. Dongfei Yu *, Jianlong Fu, Yong Rui, Tao Mei. “Multi-level Attention Networks for Visual Question Answering,” IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
  11. Yingwei Pan *, Ting Yao, Houqiang Li, Tao Mei. “Video Captioning with Transferred Semantic Attributes,” IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
  12. Yu Liu *, Jianlong Fu *, Tao Mei, Chang Wen Chen. “Let Your Photos Talk: Generating Narrative Paragraph for Photo Stream via Bidirectional Attention Recurrent Neural Networks,” AAAI Conference on Artificial Intelligence (AAAI), 2017.