Institution of Information Cognition & Intelligent System

Introduction to the Institution:

The Institution of Information Cognition & Intelligent System (It was formed in 2011 through the merger of the former Institute of Image Graphics, Institute of Network and Human-Machine Voice Communication) now has 21 in-service faulty members, including 8 professors (researchers), 11 associate professors (associate researchers), 2 assistant professors (assistant researchers); 8 postdoctoral fellows.

Disciplines of the Institution: The first-level discipline is "Information and Communication Engineering", and the second-level discipline is "Signal and Information Processing".

There are currently 28 undergraduate courses and 27 graduate courses that the Institute is responsible for setting up. About 15 doctoral students and 16 master students are recruited every year. The Institute is provided with the postdoctoral research station and about 3 postdoctoral fellows begin to work at the postdoctoral research station every year.

The Institute has so far won 1 prize of National Science Conference Award, 5 prizes of National Prize for Progress in Science and Technology, more than 10 prizes of S&T Progress Award of Provincial Ministries and Commissions and other honors.

Director: Zhang Yujin   Secretary: Ou Zhijian

Deputy Director: Huang Yongfeng (scientific research), Ma Hongbing (teaching)

Lab Director: Su Guangda, Wang Xia

The Institute includes the following laboratories (Pinyin order):

* Multimedia Signal and Intelligent Information Processing Lab

* 3D Image Simulation Lab

* Visual Computing Lab

* Image Engineering Lab

* Image Recognition and High-speed Image Processing Lab

* UAV Vision Lab

* Next-generation Network and Application Lab

* Remote Sensing Lab

* Voice, Audio, Auditory Information Processing Lab

* Voice Processing and Machine Intelligence Lab

* Intelligent Graphic Information Processing Lab

Multimedia Signal and Intelligent Information Processing Lab

Members: Professor Wu Ji, Senior Engineer Wang Xia, Professor Wang Zuoying

Contact: 8-207, 8-301 - 8-311, Rohm Building; Tel.: 62781706;

E-mail: wuji_ee@tsinghua.edu.cn;

Homepage: http://speech.tsinghua.edu.cn

Direction: Cross-language medical knowledge transfer learning, understanding of natural language of medicine, graphic multi-source information holographic diagnosis, auxiliary diagnosis and treatment system, drug mining, human-computer interaction techniques.

Achievements: More than 120 papers have been published in domestic and foreign journals and high-level academic conferences. In recent years, 5 government sponsored science and technology projects and 19 enterprise sponsored science and technology projects have been undertaken. The first prize of Beijing Science and Technology Award 2014 and the second prize of the National Prize for Progress in Science and Technology 2011 have been won. The second place in KBP-EDL entity detection and link evaluation organized by NIST was won in 2014. The evaluation task of BABEL-OpenKWS 2014 is search of specific language keywords under limited data, which won the second place. In 2017, it participated in the YouTube-8M video understanding evaluation organized by Google, and stood out from thousands of teams participating in competition and won the second place. It participated in the TREC PM evaluation in 2018 and won the first place in the overall performance.

3D Image Simulation Lab

Members: Associate Professor Ma Huimin

Contact: 6 -103/203, Rohm Building; Tel.: 62781432;

E-mail: mhmpub@Tsinghua.edu.cn;

Homepage: http://3dimage.ee.tsinghua.edu.cn

Direction: 3D image recognition, 3D system simulation, image cognitive psychology.

Achievements: More than 40 research papers have been published at home and abroad and 22 projects have been undertaken. Purchased by Beijing Municipal Government: Psychological State Assessment System, Early Warning System for Risk Population.

Visual Computing Lab

Members: Associate Professor Wang Guijin; Postdoctoral fellow: Shi Chenbo, Zhang Chun, Chen Guodong; 10 postgraduate students

Contact: 6-207, Rohm Building; Tel.: 62781430;

E-mail: wangguijin@tsinghua.edu.cn;

Homepage: http://image.ee.tsinghua.edu.cn

Direction: Depth imaging and somatosensory recognition, industrial inspection, wearable devices, etc.

Achievements: Nearly 100 research papers have been published at home and abroad, and more than 10 patents have been authorized; Projects undertaken: Projects of 863 Program, projects supported by the Natural Science Foundation, international cooperation projects; Reward for scientific research: First Prize of "Wu Wenjun" Science and Technology Progress Award 2014 of Chinese Association for Artificial Intelligence, Second Prize of Science and Technology Progress Award of Shandong Province 2014.

Image engineering lab

Members: Professor Zhang Yujin; 7 doctoral students, 3 master students

List of all members: http://oa.ee.tsinghua.edu.cn/~zhangyujin/IELM.htm

Contact: 6-305, Rohm Building; Tel.: 62798540; http://oa.ee.tsinghua.edu.cn/~zhangyujin/

Direction: Object segmentation and segmentation evaluation in images and videos, face image analysis and recognition, image classification and labeling, content-based image and video retrieval, high-level visual information fusion and spatiotemporal behavior understanding, etc.

Achievements: Nearly 500 research papers have been published at home and abroad, and more than 30 books have been published, including image engineering series textbooks (Version 1, 2 and 3), Image Segmentation, Content-based Visual Information Retrieval, Subspace-based Face Recognition, English-Chinese Image Engineering Dictionary (Version 1 and 2), etc.

Image Recognition and High-speed Image Processing Lab

Members: Professor Su Guangda (6-201, Rohm Building); Assistant Professor Chen Jiansheng (6-101, Rohm Building)

Contact: Tel.: 62781434; E-mail: susu@tsinghua.edu.cn; jschenthu@tsinghua.edu.cn

Direction: Image parallel processing and face recognition; Image 3D reconstruction, image spectrum clustering, image recognition and understanding.

Achievements: Professor Su Guangda has published more than 200 papers, 2 monographs, won 13 invention patents, won 7 provincial and ministerial science and technology achievement awards, and has undertaken national scientific and technological research projects, key research projects of the Ministry of Public Security, projects supported by the National Natural Science Foundation of China and other projects; Mr. Chen Jiansheng has published more than 60 papers, won Beijing Science and Technology Award and the Best Student Paper Award of the  International Conference on Biometrics, and has undertaken the projects supported by the National Natural Science Foundation of China, projects of Beijing Youth Talents Program and other projects. The comprehensive face recognition technology successfully developed by the lab has been applied on a large scale and assists the public security departments in uncovering a large number of criminal cases.

UAV Vision Lab

Members: Professor Zhang Li

Contact: 5-306, Rohm Building; Tel.: 62781436;

E-mail: chinazhangli@tsinghua.edu.cn

Direction: UAV vision and navigation, medical surgery navigation, intelligent monitoring, special effects of film and television, etc.

Achievements: More than 80 papers have been published in IEEE Trans.on PAMI, PR and other domestic and foreign academic journals; Projects undertaken: As the subject leader, he has undertaken more than 40 scientific research projects including key projects supported by the National Natural Science Foundation of China.

Next-generation network and application lab (NGNLab)

Members: Professor Li Xing, Researcher Huang Yongfeng; Postdoctoral fellow Zhong Fei, postdoctoral fellow Tu Shanshan; 8 doctoral students and 12 master students

Contact: 5-104, Rohm Building; Tel.: 62792710; E-mail: yfhuang@tsinghua.edu.cn;

Homepage: http://thungnlab.cn

Direction: Next-generation Internet architecture, IPv4 and IPv6 transition technology, cyberspace security, covert communication, Internet big data retrieval and mining, social network media information analysis, etc.

Achievements: It has published more than 300 research papers at home and abroad and has undertaken projects: 1 key project supported by the National Natural Science Foundation of China, 4 general projects supported by the National Natural Science Foundation of China, 1 project of National 973 Program and 863 Program respectively, and 2 supporting plans.

Reward for scientific research: 1 second prize of national invention, 3 second prizes of National Prize for Progress in Science and Technology, 4 prizes of S&T Progress Award of Ministries and Commissions, and more than 20 authorized invention patents.

Remote Sensing Lab

Members: Professor Sun Weidong, Associate Professor Ma Hongbing; 12 doctoral students, 7 master students

Contact: Room 6-311 and 6-309, Rohm Building; Tel.: 62781874, 62773434;

E-mail: wdsun@tsinghua.edu.cn, aaa@tsinghua.edu.cn

Direction: Space information acquisition and application processing technology.

Achievements: Super-resolution image reconstruction, mixed pixel decomposition, multi-resolution composite classification, on-board earth observation and processing, survey of national wetland resources based on 3S technology, atmospheric environment remote sensing monitoring, peat bog carbon pool remote sensing survey and other methods and technologies.

Voice, Audio, Auditory Information Processing Lab

Members: Professor Liu Jia, Associate Professor Zhang Weiqiang, Assistant Professor He Liang

Contact: Tel.: 62781705, 62781847;

E-mail: liuj@tsinghua.edu.cn, wqzhang@tsinghua.edu.cn

Direction: Voice, audio, auditory information processing under big data and complex background conditions

Achievements: It has achieved good results in the most authoritative international evaluation, and the actual system has been applied in important national departments.

Voice Processing and Machine Intelligence Lab

Members: Associate Professor Ou Zhijian, Associate Professor Xiao Xi, Associate Professor Sun Jiasong

Contact: 6-104/105/108/110, Rohm Building   Tel.: 010-62796193;

E-mail: {ozj, xiaoxi, sunjiasong}@tsinghua.edu.cn

Homepage: http://oa.ee.tsinghua.edu.cn/~ouzhijian/index.htm

Direction: Voice processing (voice recognition and understanding, speaker recognition, natural language processing, voice big data), machine intelligence (especially probability graph model theory and application).

Achievements: More than 40 papers have been published in important domestic and foreign journals such as IEEE Transactions. Projects undertaken include projects supported by the National Natural Science Foundation of China, projects of 863 Program, many projects of national ministries and commissions, and Intel, Panasonic, IBM, and Toshiba international cooperation projects. In 2004, the specific content audio recognition system (integrated voice keyword recognition, speaker recognition, audio fingerprint) developed by it passed the evaluation of the National Computer Network and Information Security Administrative Center. The application system has been continuously improved and has been used in many ministries and commissions of the country and has been highly evaluated.

Intelligent Graphic Information Processing Lab

Members: Professor Ding Xiaoqing, Professor Wang Shengjin, Associate Professor Liu Changsong, Associate Professor Peng Liangrui

Contact: 6-301, 6-302, 6-306, 6-202, Rohm Building, (FIT) 1-502, Information Building;

Tel.: 62773710，62772044; Homepage: http://ocrserv.ee.tsinghua.edu.cn

Direction: Text recognition (multilingual document recognition, natural scene text detection and recognition, online and offline handwritten text recognition); Face recognition; Human health signal acquisition and recognition; Embedded image processing; Video monitoring; Machine learning and large-scale object detection, big data image retrieval; Computer vision and intelligent video analysis; BCI brain-computer interface.

Achievements: 3 second prizes of National Prize for Progress in Science and Technology, 1 third prize and more than 10 provincial and ministerial awards have been won. TH-OCR text recognition and TH-ID biometric (face, handwriting, etc.) authentication software products have been industrialized and popularized and applied. The technology is authorized to be used by Nuance, Microsoft, Omron, Samsung, Baidu, Tencent and other companies. More than 600 papers have been published, including 1 paper from PAMI, 5 papers from CVPR, 2 papers from ICCV, 1 paper from ECCV, 2 papers from ICASSP, 9 papers from IEEE Trans, and 53 papers included in SCI.