Jia Jia, PhD

PROFESSOR OF COMPUTER SCIENCE

Major Awards more


2018
ACM SIGMM emerging leaders, 2018


2018
ACM Multimedia best demo award, 2018


2018
IJCAI Early Career Spotlight, 2018


2016
The Science and Technology Award of the National Ministry of Education, as the first person-in-charge, 2016


2012
ACM Multimedia Grand Challenge Prize, 2012


2009
The Science and Technology Award of the National Ministry of Education, 2009.


About me more

Jia Jia
Associate Professor

  • Department of Computer Science and Technology
  • Tsinghua University

Contact:

  • Email jjia@mail.tsinghua.edu.cn
  • Phone +86-10-62771587
  • Fax +86-10-62771587
  • Moblie +86-13651399048

Office:

  • 3-522, FIT Building, Tsinghua University, Beijing, 100084, China PR.

Biography:

  • Dr. Jia Jia is an associate professor in Department of Computer Science and Technology, Tsinghua University. She got bachelor degree at Tsinghua University in 2003, and received her Ph.D. degree from Tsinghua University in 2008.

Research Interests

  • Her main research interest is social affective computing and human computer speech interaction.

Selected Publications more


Recent Conference Papers

  • Runnan Li, Zhiyong Wu, Jia Jia, Yaohua Bu, Sheng Zhao, Helen Meng Towards Discriminative Representation Learning for Speech Emotion Recognition In Proceedings of the 28th International Joint Conference on Artificial Intelligence (IJCAI'19) [PDF]
  • Runnan Li, Zhiyong Wu, Jia Jia, Sheng Zhao, Helen Meng. Dilated Residual Network with Multi-Head Self-Attention for Speech Emotion Recognition In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP'19) [PDF]
  • Dongyang Dai, Zhiyong Wu, Runnan Li, Xixin Wu, Jia Jia, Helen Meng. Learning Discriminative Features from Spectrograms Using Center Loss for Speech Emotion Recognition In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP'19) [PDF]
  • Pan Zhou, Wenwen Yang, Wei Chen, Yanfeng Wang, Jia Jia Modality Attention for End-to-End Audio-Visual Speech Recognition In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP'19) [PDF]
  • Taoran Tang, Hanyang Mao, Jia Jia. AniDance : Real-Time Dance Motion Synthesize to the Song. In Proceedings of the 26th ACM International Conference on Multimedia (MM'18 Best Demo) [PDF]
  • Taoran Tang, Jia Jia, Hanyang Mao. Dance with Melody: An LSTM-autoencoder Approach to Music-oriented Dance Synthesis In Proceedings of the 26th ACM International Conference on Multimedia (MM'18) [PDF]
  • Runnan Li, Zhiyong Wu, Jingbei Li, Jia Jia, Chen Wei, Helen Meng. Inferring User Emotive State Changes in Realistic Human-Computer Conversational Dialogs. In Proceedings of the 26th ACM International Conference on Multimedia (MM'18) [PDF]
  • Long Zhang, Jia Jia, Fanbo Meng, Suping Zhou, Wei Chen, Cunjun Zhang, Runnan Li. Emphasis Detection for Voice Dialogue Applications Using Multi-channel Convolutional Bidirectional Long Short-Term Memory Network In Proceedings of the 11th International Symposium on Chinese Spoken Language Processing (ISCSLP'18) [PDF]
  • Wenjing Cai, Jia Jia, Wentao Han. Inferring Emotions from Image Social Netwoks Using Group-Based Factor Graph Model. In Proceedings of the 19th International Conference on Multimedia & Expo (ICME'18) [PDF]
  • Jia Jia. Mental Health Computing via Harvesting Social Media Data. In Proceedings of the 27th International Joint Conference on Artificial Intelligence (IJCAI'18) [PDF]
  • Tiancheng Shen, Jia Jia, Guangyao Shen, Fuli Feng, Xiangnan He, Huanbo Luan, Jie Tang, Thanassis Tiropanis, Tat-Seng Chua and Wendy Hall. Cross-Domain Depression Detection via Harvesting Social Media. In Proceedings of the 27th International Joint Conference on Artificial Intelligence (IJCAI'18) [PDF]
  • Peijun Zhao, Jia Jia, Yongsheng An, Jie liang, Lexing Xie and Jiebo Luo. Analyzing and Predicting Emoji Usages in Social Media. In Proceedings of the Web Conference 2018 (WWW'18) [PDF]
  • Yihui Ma, Jia Jia, Yufan Hou, Yaohua Bu and Wentao Han. Understanding the Aesthetic Styles of Social Images. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP'18) [PDF]
  • Suping Zhou, Jia Jia, Qi Wang, Yufei Dong, Yufeng Yin and Kehua Lei. Inferring Emotion from Conversational Voice Data: A Semi-supervised Multi-path Generative Neural Network Approach. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence (AAAI'18) [PDF]
  • Ye Ma, Xinxing Li, Mingxing Xu, Jia Jia and Lianhong Cai. Multi-scale Context Based Attention for Dynamic Music Emotion Prediction. In Proceedings of the 25th ACM International Conference on Multimedia (MM'17) [PDF]
  • Guangyao Shen, Jia Jia, Liqiang Nie, Fuli Feng, Cunjun Zhang, Tianrui Hu, Tat-Seng Chua and Wenwu Zhu. Depression Detection via Harvesting Social Media: A Multimodal Dictionary Learning Solution. In Proceedings of the 26th International Joint Conference on Artificial Intelligence (IJCAI'17) [PDF]
  • Yihui Ma, Jia Jia, Suping Zhou, Jingtian Fu, Yejun Liu and Zijian Tong. Towards Better Understanding the Clothing Fashion Styles: A Multimodal Deep Learning Approach. In Proceedings of the 31th AAAI Conference on Artificial Intelligence (AAAI'17) [PDF]
  • Yishuang Ning, Jia Jia, ZhiyongWu, Runnan Li, Yongsheng An, Yanfeng Wang and Helen Meng. Multi-task Deep Learning for User Intention Understanding in Speech Interaction Systems. In Proceedings of the 31th AAAI Conference on Artificial Intelligence (AAAI'17) [PDF]
  • Shumei Zhang, Jia Jia and Yishuang Ning. INFERRING EMOTIONS FROM HETEROGENEOUS SOCIAL MEDIA DATA: A CROSS-MEDIA AUTO-ENCODER SOLUTION. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP'17) [PDF]
  • Yishuang Ning, Zhiyong Wu, Runnan Li, Jia Jia, Helen Meng and Lianhong Cai. Learning Cross-Lingual Knowledge with Multilingual Blstm for Emphasis Detection with Limited Training Data. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP'17) [PDF]
  • Yuhao Wu, Jia Jia, Feng Lu, and Lianhong Cai. A SYSTEMATIC APPROACH TO COMPUTE PERCEPTUAL DISTRIBUTION OF MONOSYLLABLES. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP'17) [PDF]

Recent Journals

  • Jia Jia, Suping Zhou, Yufeng Yin, Boya Wu, Wei Chen, Fanbo Meng and Yanfeng Wang. Inferring Emotions From Large-scale Internet Voice Data. IEEE Transactions on Multimedia, 2019 (TMM'19) [PDF]
  • Huijie Lin, Jia Jia, Jiezhong Qiu, Yongfeng Zhang, Guangyao Shen, Lexing Xie, Jie Tang, Ling Feng and Tat-Seng Chua. Detecting Stress Based on Social Interactions in Social Networks. IEEE Transactions on Knowledge & Data Engineering, 2017, PP(99):1820-1833 (TKDE'17) [PDF]
  • Boya Wu, Jia Jia, Yang Yang, Peijun Zhao, Jie Tang and Qi Tian. Inferring Emotional Tags From Social Images With User Demographics. IEEE Transactions on Multimedia, 2017, PP(99):1-1 (TMM'17) [PDF]
  • Xishan Zhang, Jia Jia, Ke Gao, Yongdong Zhang, Dongming Zhang, Jintao Li and Qi Tian. Trip Outfits Advisor: Location-Oriented Clothing Recommendation. IEEE Transactions on Multimedia, 2017, PP(99):1-1 (TMM'17) [PDF]
  • Chao Wu, Yaoxue Zhang, Jia Jia and Wenwu Zhu. Mobile Contextual Recommender System for Online Social Media. IEEE Transactions on Mobile Computing, 2017, PP(99):1-1 (TMC'17) [PDF]

Teaching Statement more


Principles of Signal Processing
This course focuses on the theory and practice of signal processing, including the transformation, analysis and synthesis of signal.

Fundamentals and Applications of Multimedia Technolog
This course focuses on fundamentals, key techniques, development and application of multimedia technology.

Professional Practice: HCI and Biometrics Recognition
Professional practice is a large comprehensive, innovative, practical and researchful course, which synthetically utilize students’ skills gained in professional courses and pave the way for their diploma projects.

Demo more



AniDance: Real-Time Dance motion synthesize to the Song. MM'18 Best Demo


IcooBook: when the picture book for children encounters aesthetics of interaction. MM'18


AI Painting: An Aesthetic Painting Generation System. MM'18