My research is in Human-Computer Interaction (HCI), using an interdisciplinary approach that combines methods from the fields of Design, Computer applications and Psychology. My research vision is to generate creative digital content and create immersive user interfaces while enhancing human cognitive abilities, ranging from explicit, conscious behavioral interactions to implicit HCI based on physiological signals, as well as exploring ways of visualizing multi-channel physiological signals in virtual environments. My goal is to develop concepts, design methods, and interfaces for human perceptual augmentation in immersive media with a user experience orientation. My research contributes to the design and development of immersive XR application scenarios and interactions, including studies that evaluate their impact on users.
Education
| Ph.D., Intelligent Digital Performance BEIJING INSTITUTE OF TECHNOLOGY (BIT) Thesis: Research on Key Technologies for Digital Performance Evaluation | 09/12 – 09/17 |
| Bachelor of DESIGN, Industrial Design / Business Administration (Double Degree) BEIJING INSTITUTE OF TECHNOLOGY (BIT) | 09/06 – 07/10 |
Professional Experience
| Associate Professor: Beihang University (BUAA) SCHOOL OF NEW MEDIA ART & DESIGN (PRESENT) | Beijing, China 07/17 – Current |
| Focusing on content generation, interaction design, and artistic visualization in immersive media, using XR, physiological signaling, and interactive device technologies. | |
| Research Fellow: Beihang University (BUAA) STATE KEY LABORATORY OF VIRTUAL REALITY TECHNOLOGY AND SYSTEMS (PRESENT) | Beijing, China 09/18 – Current |
| Focusing on virtual reality multi-channel natural human-computer interaction experience and application, and carrying out laboratory independent / collaborative projects. | |
| Visiting Research Student: MIT Media Lab FLUID INTERFACES GROUP. ADVISED BY PROFESSOR PATTIE MAES | Cambridge,U.S.A 09/13 – 09/14 |
| Focusing on designing natural interfaces to integrate data into people’s real lives, ranging from smart hand tools to projection-based Augmented Reality projects. | |
| Research Intern: Intel China Research Center INTERACTION DESIGN INTERN. ADVISED BY WENLONG LI | Beijing, China 02/12 – 08/12 |
| Prototyping innovative mobile applications, including 2D/3D Avatar mockup and UI/UE design. | |
Research Foundations
| Project | Date |
| National Natural Science Foundation of China, Project: Research on Affective Evaluation and Content-Based Adaptive Feedback for Intelligent Interactive Performance from Audience Perception | 01/19 – 12/21 |
| Humanities and Social Science Fund of Ministry of Education of China, Project: XR-Based Intelligent Performance Perception Generation and Interaction Collaboration | 09/22 – 09/25 |
| China National Arts Fund, Project: Construction of Digital Promotion Platform for Intangible Culture Heritage (ICH) ‘Hua er’ | 03/18 – 03/22 |
| National Key Research and Development Program of China, Project: Yunnan Minority Dance Digital Performance Creativity and Display System Based on VR | 01/21 – 01/24 |
| University-Industry Collaborative Education Program, Project: A Study of User Perception Assessment in Virtual Reality Performances (Immersive VR Behavioral Psychoanalysis Lab) | 04/20 – 06/21 |
Fellowships & Awards
- 2023 Winner, Second Prize of Outstanding Innovation Cases of Aesthetic Education in Beijing Universities
- 2023 Mentor Award, BUAA Excellent Master’s Thesis
- 2022 Grant, $14000 Xiaomi Youth Scholarship
- 2022 Grant, $7000 Social Science Youth Scholarship
- 2021-2022 Mentor Award, Outstanding Undergraduate Graduation Design (Thesis)
- 2019 Winner, Third Prize of “Teaching Design” in the 7th National Collegiate and Universities Digital Art and-Design Competition
- 2017 Winner, Outstanding Doctoral Dissertation Award of China Simulation Federation
- 2015 Fellowship, National PhD Scholarship in China
Publications
Published over 20 peer-reviewed publications (2 best XR showcase awards) and 3 patents in the venues of CHI, IEEE VR, SIGGRAPH ASIA, ISMAR, IUI, TiiS, VINCI, and Chinese CHI, ChinaVR.
| Book | |
| Gao, S., Yan, S., Zhao, H., & Nathan, A. (2021). Touch-Based Human-Machine Interaction: Principles and Applications. Springer Nature. | |
| Papers | |
| Luo, S., & Yan, S. (2023). “Achi Mukua Experience Space”— A Multi-Player Immersive Experience of Yunnan ICH Dance. In SIGGRAPH Asia 2023 Art Papers. | |
| Su, X., & Yan, S. (2023, April). NoPhobiar: Designing A VR Game to Prevent Childhood Dark Phobia with Children and Stakeholders. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. | |
| Liu, Z., Yan, S., Lu, Y., & Zhao, Y. (2022, April). Generating Embodied Storytelling and Interactive Experience of China Intangible Cultural Heritage “Hua’er” in Virtual Reality. In CHI Conference on Human Factors in Computing Systems Extended Abstracts. | |
| Ge, S., Luo,S.,Yan,S., & Shen, X. (2022, October). Effects of Augmenting Real-time Biofeedback in An Immersion VR Performance. 2022 IEEE International Symposium on Mixed and Augmented Reality. | |
| Yan, S., Ge, S., Wang, J., and Shen, X. (2021, May). Performing with Me: Enhancing Audience-Performer Interaction in An Immersive Virtual Play. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. | |
| Yan, S., Jiang, W., Xiong, M., & Shen, X. (2020, November). An Exploratory Study for Designing Social Experience of Watching VR Movies Based on Audience’s Voice Comments. 2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) (pp. 147-152). | |
| Yan, S., Ding, G., Li, H., Sun, N., Guan, Z., Wu, Y., … & Huang, T. (2017). Exploring audience response in performing arts with a brain-adaptive digital performance system. ACM Transactions on Interactive Intelligent Systems (TiiS), 7(4), 1-28. | |
| Yan, S., Ding, G., Li, H., Sun, N., Wu, Y., Guan, Z., … & Huang, T. (2016, March). Enhancing audience engagement in performing arts through an adaptive virtual environment with a brain-computer interface. In Proceedings of the 21st international conference on intelligent user interfaces (pp. 306-316). | |
| Yan, S., Ding, G., Guan, Z., Sun, N., Li, H., & Zhang, L. (2015, April). Outsideme: Augmenting dancer’s external self-image by using a mixed reality system. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (pp. 965-970). | |
| Posters / XR / Workshop Papers | |
| Liu, Z., Yan, S., & Shen, X. (2023). Crossing Narrative: Exploring the Possibilities of Crossing the Virtuality and Reality in Interactive Narrative Experiences. In SIGGRAPH Asia 2023 Posters. | |
| Zhao, Y., Yan, S., Zhang, X., & Shen, X. (2023, March). A Comparison of Gesture-based Interaction and Controller-based Interaction for External Users in Co-located Asymmetric Virtual Reality. In 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) (pp. 583-584). | |
| Lu, Y., Dai, W., & Yan, S. (2023). “Dongba Script Character Construction Space”: VR science-based interactive experience of pictographs in intangible cultural heritage. In SIGGRAPH Asia 2023 XR. | |
| Zhang, X., Sun, L., & Yan, S. (2023). NVSHU: Virtual Reality Design and Narrative Popularization for Intangible Cultural Heritage Characters. In SIGGRAPH Asia 2023 XR. | |
| Y Wang, S Yan. (2023). “Dream Songs” Integrating Body Interaction into ICH Oral Literature Virtual Narrative Experience. SIGGRAPH Asia 2023 XR. | |
| Zhao,Y., Yan, S., and Shen, X. (2022). Cohand VR: Towards A Shareable Immersive Experience via Wearable Gesture Interface between VR Audiences and External Audiences. SIGGRAPH Asia 2022 Posters. Zixiao Liu and Shuo Yan. (2022). “Dance of Drums”: An Interactive Installation of ICH Dance Representation Through the Combination of Virtual and Reality. In SIGGRAPH Asia 2022 XR (SA ’22). | |
| Liu, Z., Li, L., & Yan, S. (2021). “Once”: Multi-perspective and Interactive VR Narrative Film. In SIGGRAPH Asia 2021 XR. | |
| Zhang, H., & Yan, S. (2021). “Bodyreath”: An Interactive VR Installation to Experience and Understand People with Autism. In SIGGRAPH Asia 2021 XR. | |
| Lu, Y., Liu, Z., Yan, X., & Yan, S. (2021). “Flower and the Youth”: Virtual Narrative and Creative Methods of Oral Performance in China Intangible Cultural Heritage. In SIGGRAPH Asia 2021 XR. | |
| Yan, S., Yan, X., & Shen, X. (2020). Exploring social interactions for live performance in virtual reality. In SIGGRAPH Asia 2020 Posters. | |
| Lv, Q., Liu, L., & Yan, S. (2020, April). Research on Parents and Left-behind Children Online Communication Solution Based on Habit Formation Theory. In The eighth International Workshop of Chinese CHI (pp. 73-76). | |
| Yan, X., He, Y., & Yan, S. (2020, April). An Experience Study for Exploring Online Emotional Support in Parents of Children with Autism in China. In The eighth International Workshop of Chinese CHI (pp. 65-68). | |
| Artworks | |
| Fang, F., Lu, Y., & Yan, S. (2023, September). “Z Box” Interactive VR Game of Generation Z’s Growth Memories. In The 16th International Symposium on Visual Information Communication and Interaction (VINCI ’23). Fang, F., & Yan, S. (2022). Voight-Kampff 2.0. In Proceedings of the SIGGRAPH Asia 2022 Art Gallery. | |
| Ge, S.,Yan,S. (2020). Womb. SIGGRAPH Asia 2020 VR Theatre. | |
| Zhao, Y.,Yan,S. (2020). Infinity. SIGGRAPH Asia 2020 VR Theatre. | |
Service & Media
Session Chair, Program Committee, Jury
- Session Chair IEEE VR 2023. Perception 2.
- Session Chair ChinaVR 2022. XR & Emerging Technology.
- Jury Member SIGGRAPH ASIA 2020. VR Theatre.
- Secretary General, Specialized Committee on Virtual Technology and Applications, China Simulation Federation, 2020-Current.
- Assistant to the Dean of the Faculty, 2017-Current.
Media
- TEDXChengdu, “From Audience to Creator”
- China Beijing Satellite Television Science and Education Channel (BTV), “The Art of Being Good”.
2019 TEDxChengdu
2021 Beijing Satellite Television Science and Education Channel