Jia Jia, PhD

PROFESSOR OF COMPUTER SCIENCE

Major Awards more


2018
IJCAI Early Career Spotlight, 2018


2016
The Science and Technology Award of the National Ministry of Education, as the first person-in-charge, 2016


2012
ACM Multimedia Grand Challenge Prize, 2012


2009
The Science and Technology Award of the National Ministry of Education, 2009.


About me more

Jia Jia
Associate Professor

  • Department of Computer Science and Technology
  • Tsinghua University

Contact:

  • Email jjia@mail.tsinghua.edu.cn
  • Phone +86-10-62771587
  • Fax +86-10-62771587
  • Moblie +86-13651399048

Office:

  • 3-522, FIT Building, Tsinghua University, Beijing, 100084, China PR.

Biography:

  • Dr. Jia Jia is an associate professor in Department of Computer Science and Technology, Tsinghua University. She got bachelor degree at Tsinghua University in 2003, and received her Ph.D. degree from Tsinghua University in 2008.

Research Interests

  • Her main research interest is social affective computing and human computer speech interaction.

Selected Publications more


Journals

  • Huijie Lin, Jia Jia, Jiezhong Qiu, Yongfeng Zhang, Guangyao Shen, Lexing Xie, Jie Tang, Ling Feng and Tat-Seng Chua. Detecting Stress Based on Social Interactions in Social Networks. IEEE Transactions on Knowledge & Data Engineering, 2017, PP(99):1820-1833 (TKDE'17) [PDF]
  • Boya Wu, Jia Jia, Yang Yang, Peijun Zhao, Jie Tang and Qi Tian. Inferring Emotional Tags From Social Images With User Demographics. IEEE Transactions on Multimedia, 2017, PP(99):1-1 (TMM'17) [PDF]
  • Xishan Zhang, Jia Jia, Ke Gao, Yongdong Zhang, Dongming Zhang, Jintao Li and Qi Tian. Trip Outfits Advisor: Location-Oriented Clothing Recommendation. IEEE Transactions on Multimedia, 2017, PP(99):1-1 (TMM'17) [PDF]
  • Chao Wu, Yaoxue Zhang, Jia Jia and Wenwu Zhu. Mobile Contextual Recommender System for Online Social Media. IEEE Transactions on Mobile Computing, 2017, PP(99):1-1 (TMC'17) [PDF]
  • Xiaohui Wang, Jia Jia, Jie Tang, Boya Wu, Lianhong Cai, Lexing Xie. Modeling Emotion Influence in Image Social Networks. IEEE Transactions on Affective Computing, v 6, n 3, p 286-297, 2015. [PDF]
  • Jia Jia, Wai-Kim Leung, Yuhao Wu, XiuLong Zhang, Hao Wang, Lianhong Cai, Helen Meng. Grading the Severity of Mispronunciations in CAPT Based on Statistical Analysis and Computational Speech Perception. Journal of Computer Science and Technology, v 29, n 5, p 751-761, 2014. [PDF]
  • Xiaohui Wang, Jia Jia, Hanyu Liao, and Lianhong Cai. Affective Image Colorization. Journal of Computer Science and Technology(JCST'12), 2012,V27(6): 1119-1128. [PDF]
  • Jia Jia, Shen Zhang, Fanbo Meng, Yongxin Wang and Lianhong Cai. Emotional Audio-Visual Speech Synthesis based on PAD. IEEE Transactions on Audio, Speech and Language Processing, v 19, n 3, p 570-582, 2011. [PDF]

Conferences

  • Taoran Tang, Hanyang Mao, Jia Jia. AniDance : Real-Time Dance Motion Synthesize to the Song. In Proceedings of the 26th ACM International Conference on Multimedia (MM'18 Best Demo) [PDF]
  • Taoran Tang, Jia Jia, Hanyang Mao. Dance with Melody: An LSTM-autoencoder Approach to Music-oriented Dance Synthesis In Proceedings of the 26th ACM International Conference on Multimedia (MM'18) [PDF]
  • Cunjun Zhang, Kehua Lei, Jia Jia, Yihui Ma, Zhiyuan Hu. AI Painting: An Aesthetic Painting Generation System. In Proceedings of the 26th ACM International Conference on Multimedia (MM'18) [PDF]
  • Runnan Li, Zhiyong Wu, Jingbei Li, Jia Jia, Chen Wei, Helen Meng. Inferring User Emotive State Changes in Realistic Human-Computer Conversational Dialogs. In Proceedings of the 26th ACM International Conference on Multimedia (MM'18) [PDF]
  • Yaohua Bu, Jia Jia, Xiang Li, Suping Zhou and Xiaobo Lu. IcooBook: When the Picture Book for Children Encounters Aesthetics of Interaction In Proceedings of the 26th ACM International Conference on Multimedia (MM'18) [PDF]
  • Wenjing Cai, Jia Jia, Wentao Han. Inferring Emotions from Image Social Netwoks Using Group-Based Factor Graph Model. In Proceedings of the 19th International Conference on Multimedia & Expo (ICME'18) [PDF]
  • Jia Jia. Mental Health Computing via Harvesting Social Media Data. In Proceedings of the 27th International Joint Conference on Artificial Intelligence (IJCAI'18) [PDF]
  • Tiancheng Shen, Jia Jia, Guangyao Shen, Fuli Feng, Xiangnan He, Huanbo Luan, Jie Tang, Thanassis Tiropanis, Tat-Seng Chua and Wendy Hall. Cross-Domain Depression Detection via Harvesting Social Media. In Proceedings of the 27th International Joint Conference on Artificial Intelligence (IJCAI'18) [PDF]
  • Peijun Zhao, Jia Jia, Yongsheng An, Jie liang, Lexing Xie and Jiebo Luo. Analyzing and Predicting Emoji Usages in Social Media. In Proceedings of the Web Conference 2018 (WWW'18) [PDF]
  • Yihui Ma, Jia Jia, Yufan Hou, Yaohua Bu and Wentao Han. Understanding the Aesthetic Styles of Social Images. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP'18) [PDF]
  • Suping Zhou, Jia Jia, Qi Wang, Yufei Dong, Yufeng Yin and Kehua Lei. Inferring Emotion from Conversational Voice Data: A Semi-supervised Multi-path Generative Neural Network Approach. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence (AAAI'18) [PDF]
  • Yaohua Bu, Jia Jia, Yuhan Tang, Xuan Zhang and Tianyu Gao. Lookine: Let the Blind Hear a Smile. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence (AAAI'18) [PDF]
  • Ye Ma, Xinxing Li, Mingxing Xu, Jia Jia and Lianhong Cai. Multi-scale Context Based Attention for Dynamic Music Emotion Prediction. In Proceedings of the 25th ACM International Conference on Multimedia (MM'17) [PDF]
  • Yongsheng An, Yu Cao, JingJing Chen, Chong-Wah Ngo, Jia Jia, Huanbo Luan and Tat-Seng Chua. PIC2DISH: A Customized Cooking Assistant System. In Proceedings of the 25th ACM International Conference on Multimedia (MM'17) [PDF]
  • Guangyao Shen, Jia Jia, Liqiang Nie, Fuli Feng, Cunjun Zhang, Tianrui Hu, Tat-Seng Chua and Wenwu Zhu. Depression Detection via Harvesting Social Media: A Multimodal Dictionary Learning Solution. In Proceedings of the 26th International Joint Conference on Artificial Intelligence (IJCAI'17) [PDF]
  • Yaohua Bu, Taoran Tang, Jia Jia, Zhiyuan Ma, Songyao Wu and Yuming You. Anidraw: When Music and Dance Meet Harmoniously. In Proceedings of the 31th AAAI Conference on Artificial Intelligence (AAAI'17) [PDF]
  • Jingtian Fu, Yejun Liu, Jia Jia, Yihui Ma, Fanhang Meng and Huan Huang. A Virtual Personal Fashion Consultant: Learning from the Personal Preference of Fashion. In Proceedings of the 31th AAAI Conference on Artificial Intelligence (AAAI'17) [PDF]
  • Jiayu Long, Jia Jia, Han Xu. SenseRun: Real-Time Running Routes Recommendation towards Providing Pleasant Running Experiences. In Proceedings of the 31th AAAI Conference on Artificial Intelligence (AAAI'17) [PDF]
  • Yihui Ma, Jia Jia, Suping Zhou, Jingtian Fu, Yejun Liu and Zijian Tong. Towards Better Understanding the Clothing Fashion Styles: A Multimodal Deep Learning Approach. In Proceedings of the 31th AAAI Conference on Artificial Intelligence (AAAI'17) [PDF]
  • Yishuang Ning, Jia Jia, ZhiyongWu, Runnan Li, Yongsheng An, Yanfeng Wang and Helen Meng. Multi-task Deep Learning for User Intention Understanding in Speech Interaction Systems. In Proceedings of the 31th AAAI Conference on Artificial Intelligence (AAAI'17) [PDF]
  • Shumei Zhang, Jia Jia and Yishuang Ning. INFERRING EMOTIONS FROM HETEROGENEOUS SOCIAL MEDIA DATA: A CROSS-MEDIA AUTO-ENCODER SOLUTION. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP'17) [PDF]
  • Yishuang Ning, Zhiyong Wu, Runnan Li, Jia Jia, Helen Meng and Lianhong Cai. Learning Cross-Lingual Knowledge with Multilingual Blstm for Emphasis Detection with Limited Training Data. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP'17) [PDF]
  • Yuhao Wu, Jia Jia, Feng Lu, and Lianhong Cai. A SYSTEMATIC APPROACH TO COMPUTE PERCEPTUAL DISTRIBUTION OF MONOSYLLABLES. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP'17) [PDF]
  • Huijie Lin, Jia Jia, Jie Huang, Enze Zhou, Jingtian Fu, Yejun Liu, Huanbo Luan. Moodee: An Intelligent Mobile Companion For Sensing Your Stress From Your Social Media Postings. In Proceedings of the 30th AAAI Conference on Artificial Intelligence (AAAI'16) [PDF]
  • Jia Jia, Jie Huang, Guangyao Shen, Tao He, Zhiyuan Liu, Huanbo Luan, Chao Yan. Learning to Appreciate the Aesthetic Effects of Clothing. In Proceedings of the 30th AAAI Conference on Artificial Intelligence (AAAI'16) [PDF]
  • Yang Yang, Jia Jia, Boya Wu, Jie Tang. Social Role-Aware Emotion Contagion in Image Social Networks. In Proceedings of the 30th AAAI Conference on Artificial Intelligence (AAAI'16) [PDF]
  • Ruobing Xie, Zhiyuan Liu, Jia Jia, Huanbo Luan and Maosong Sun. Representation Learning of Knowledge Graphs with Entity Descriptions. In Proceedings of the 30th AAAI Conference on Artificial Intelligence (AAAI'16) [PDF]
  • Huijie Lin, Jia Jia, Liqiang Nie, Guangyao Shen and Tat-Seng Chua. What Does Social Media Say about Your Stress? In Proceedings of the 25th International Joint Conference on Artificial Intelligence (IJCAI'16) [PDF]
  • Yejun Liu, Jia Jia, Jingtian Fu, Yihui Ma, Jie Huang and Zijian Tong. Magic Mirror: A Virtual Fashion Consultant. In Proceedings of the 24th ACM International Conference on Multimedia (MM'16) [PDF]
  • Chao Wu, Jia Jia, Wenwu Zhu, Xu Chen, Bowen Yang and Yaoxue Zhang. Affective Contextual Mobile Recommender System. In Proceedings of the 24th ACM International Conference on Multimedia (MM'16) [PDF]
  • Boya Wu, Jia Jia, Tao He, Juan Du, Xiaoyuan Yi and Yishuang Ning. Inferring users' emotions for human-mobile voice dialogue applications. In Proceedings of the 17th International Conference on Multimedia & Expo (ICME'16) [PDF]
  • Xinyu Lan, Xu Li, Yishuang Ning, Zhiyong Wu, Helen Meng, Jia Jia and Lianhong Cai. Low level descriptors based DBLSTM bottleneck feature for speech driven talking avatar. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP'16) [PDF]
  • Boya Wu, Jia Jia, Yang Yang, Peijun Zhao, Jie Tang. Understanding The Emotions Behind Social Images: Inferring With User Demographics. In Proceedings of the 16th International Conference on Multimedia & Expo(ICME'15). [PDF]
  • Yishuang Ning, Zhiyong Wu, Jia Jia, Fanbo Meng, Helen Meng, Lianhong Cai. HMM-based Emphatic Speech Synthesis for Corrective Feedback in Computer-aided Pronunciation Training. IEEE International Conference on Acoustics, Speech and Signal Processing(ICASSP 2015), v 2015-August, p 4934-4938, 2015. [PDF]
  • Yang Yang, Jia Jia, Shumei Zhang, Boya Wu, Juanzi Li, and Jie Tang. How Do Your Friends on Social Media Disclose Your Emotions? Proceedings of the National Conference on Artificial Intelligence(AAAI'14), v 1, p 306-312, 2014. [PDF]
  • Huijie Lin, Jia Jia, Quan Guo, Yuanyuan Xue, Jie Huang, Lianhong Cai, Ling Feng. Psychological Stress Detection From Cross-Media Microblog Data Using Deep Sparse Neural Network. IEEE International Conference on Multimedia & Expo 2014(ICME'14). [PDF]
  • Zhu Ren, Jia Jia, Quan Guo, Kuo Zhang, Lianhong Cai. Acoustics, Content and Geo-Information Based Sentiment Prediction From Large-Scale Networked Voice Data. IEEE International Conference on Multimedia & Expo 2014(ICME'14). [PDF]
  • Huijie Lin, Jia Jia, Quan Guo, Yuanyuan Xue, Qi Li, Jie Huang, Lianhong Cai, Ling Feng. User-level Psychological Stress Detection from Social Media Using Deep Neural Network. Proceedings of the 2014 ACM Conference on Multimedia(MM'2014), p 507-516, 2014. [PDF]
  • Qi Li, Yuanyuan Xue, Jia Jia, Ling Feng. Helping Teenagers Relieve Psychological Pressures: A Micro-blog Based System. 17th International Conference on Extending Database Technology(EDBT'14), p 660-663, 2014. [PDF]
  • Huijie Lin, Jia Jia, Hanyu Liao, Lianhong Cai. WeCard: A Multimodal Solution for Making Personalized Electronic Greeting Cards. Proceedings of the 21st ACM International Conference on Multimedia (MM '13), p 479-480, 2013. [PDF] [Video Demo]
  • Jia Jia, Sen Wu, Xiaohui Wang, Peiyun Hu, Lianhong Cai and Jie Tang. Can We Understand van Gogh's Mood? Learning to Infer Affects from Images in Social Networks. Proceedings of the 20th ACM International Conference on Multimedia, p 857-860, 2012, MM 2012. [PDF]
  • Xiaohui Wang, Jia Jia, Peiyun Hu, Sen Wu, Jie Tang and Lianhong Cai. Understanding the Emotional Impact of Images. Proceedings of the 20th ACM International Conference on Multimedia, p 1369-1370, 2012, MM 2012.(ACM Multimedia Grand Challenge 2nd Prize) [PDF]

Teaching Statement more


Principles of Signal Processing
This course focuses on the theory and practice of signal processing, including the transformation, analysis and synthesis of signal.

Fundamentals and Applications of Multimedia Technolog
This course focuses on fundamentals, key techniques, development and application of multimedia technology.

Professional Practice: HCI and Biometrics Recognition
Professional practice is a large comprehensive, innovative, practical and researchful course, which synthetically utilize students’ skills gained in professional courses and pave the way for their diploma projects.

Demo more



AniDance: Real-Time Dance motion synthesize to the Song. MM'18 Best Demo


IcooBook: when the picture book for children encounters aesthetics of interaction. MM'18


AI Painting: An Aesthetic Painting Generation System. MM'18