All publications

XR

Augmented, virtual, and mixed reality systems and experiences.

AgentHands: Generating Interactive Hand Gestures for Spatially Grounded Agent Conversations in XR

Ziyi Liu, David Li, Zhongyi Zhou, David Kim, Ruofei Du, Xun Qian
Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI 2026) · 2026
View publication →

Beyond the Phone: Exploring Phone-XR Integration through Multi-View Transitions for Real-World Applications

Fengyuan Zhu, Xun Qian, Daniel Kalmar, Mahdi Tayarani, Eric J. Gonzalez, Mar Gonzalez-Franco, David Kim, Ruofei Du
2025 IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR 2025) · 2025
View publication →

Enhancing XR Auditory Realism via Multimodal Scene-Aware Acoustic Rendering

Tianyu Xu, Jihan Li, Penghe Zu, Pranav Sahay, Maruchi Kim, Jack Obeng-Marnu, Farley Miller, Xun Qian, Katrina Passarella, Mahitha Rachumalla, Rajeev Nongpiur, D Shin
Proceedings of the 38th Annual ACM Symposium on User Interface Software and Technology (UIST 2025) · 2025
View publication →

Sensible Agent: A Framework for Unobtrusive Interaction with Proactive AR Agents

Geonsun Lee, Min Xia, Nels Numan, Xun Qian, David Li, Yanhe Chen, Achin Kulshrestha, Ishan Chatterjee, Yinda Zhang, Dinesh Manocha, David Kim, Ruofei Du
Proceedings of the 38th Annual ACM Symposium on User Interface Software and Technology (UIST 2025) · 2025
View publication →

Thing2Reality: Enabling Spontaneous Creation of 3D Objects from 2D Content using Generative AI in XR Meetings

Erzhen Hu, Mingyi Li, Jungtaek Hong, Xun Qian, Alex Olwal, David Kim, Seongkook Heo, Ruofei Du
Proceedings of the 38th Annual ACM Symposium on User Interface Software and Technology (UIST 2025) · 2025
View publication →

AdapTUI: Adaptation of Geometric-Feature-Based Tangible User Interfaces in Augmented Reality

Fengming He, Xiyun Hu, Xun Qian, Zhengzhe Zhu, Karthik Ramani
Proceedings of the ACM on Human-Computer Interaction, Vol. 8, No. ISS (2024) · 2024
View publication →

ChatDirector: Enhancing Video Conferencing with Space-Aware Scene Rendering and Speech-Driven Layout Transition

Xun Qian, Feitong Tan, Yinda Zhang, Brian Collins, Alex Olwal, David Kim, Karthik Ramani, Ruofei Du
Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems (CHI 2024) · 2024
View publication →

Fast-Forward Reality: Authoring Error-Free Context-Aware Policies with Real-Time Unit Tests in Extended Reality

Xun Qian, Tianyi Wang, Xuhai Xu, Tanya R. Jonker, Kashyap Todi
Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems (CHI 2024) · 2024
View publication →

InstruMentAR: Auto-Generation of Augmented Reality Tutorials for Operating Digital Instruments Through Recording Embodied Demonstration

Ziyi Liu, Zhengzhe Zhu, Enze Jiang, Feichi Huang, Ana M. Villanueva, Xun Qian, Tianyi Wang, Karthik Ramani
Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI 2023) · 2023
View publication →
Best Paper Honorable Mention

LearnIoTVR: An End-to-End Virtual Reality Environment Providing Authentic Learning Experiences for Internet of Things

Zhengzhe Zhu, Ziyi Liu, Youyou Zhang, Lijun Zhu, Joey Huang, Ana M. Villanueva, Xun Qian, Kylie Peppler, Karthik Ramani
Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI 2023) — Honorable Mention Award · 2023
View publication →

Ubi Edge: Authoring Edge-Based Opportunistic Tangible User Interfaces in Augmented Reality

Fengming He, Xiyun Hu, Jingyu Shi, Xun Qian, Tianyi Wang, Karthik Ramani
Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI 2023) · 2023
View publication →

Ubi-TOUCH: Ubiquitous Tangible Object Utilization through Consistent Hand-object interaction in Augmented Reality

Rahul Jain, Jingyu Shi, Runlin Duan, Zhengzhe Zhu, Xun Qian, Karthik Ramani
Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (UIST 2023) · 2023
View publication →
Best Paper Honorable Mention

XAIR: A Framework of Explainable AI in Augmented Reality

Xuhai Xu, Mengjie Yu, Tanya R. Jonker, Kashyap Todi, Feiyu Lu, Xun Qian, João Marcelo Evangelista Belo, Tianyi Wang, Michelle Li, Aran Mun, Te-Yen Wu, Junxiao Shen, Ting Zhang, Narine Kokhlikyan, Fulton Wang, Paul Sorenson, Sophie Kahyun Kim, Hrvoje Benko
Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI 2023) · 2023
View publication →

ARnnotate: An Augmented Reality Interface for Collecting Custom Dataset of 3D Hand-Object Interaction Pose Estimation

Xun Qian, Fengming He, Xiyun Hu, Tianyi Wang, Karthik Ramani
Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology (UIST 2022) · 2022
View publication →

MechARspace: An Authoring System Enabling Bidirectional Binding of Augmented Reality with Toys in Real-time

Zhengzhe Zhu, Ziyi Liu, Tianyi Wang, Youyou Zhang, Xun Qian, Pashin Raja, Ana Villanueva, Karthik Ramani
Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology (UIST 2022) · 2022
View publication →

ScalAR: Authoring Semantically Adaptive Augmented Reality Experiences in Virtual Reality

Xun Qian, Fengming He, Xiyun Hu, Tianyi Wang, Ananya Ipsita, Karthik Ramani
Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI 2022) · 2022
View publication →

AdapTutAR: An Adaptive Tutoring System for Machine Tasks in Augmented Reality

Xun Qian, Gaoping Huang, Tianyi Wang, F. Patel, M. Sreeram, Yuanzhi Cao, Karthik Ramani, Alexander J. Quinn
Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI 2021) · 2021
View publication →
Best Paper Honorable Mention

GesturAR: An Authoring System for Creating Freehand Interactive Augmented Reality Applications

Xun Qian, Tianyi Wang, Fengming He, Xiyun Hu, Yuanzhi Cao, Karthik Ramani
Proceedings of the 34th Annual ACM Symposium on User Interface Software and Technology (UIST 2021) — Best Paper Honorable Mention · 2021
View publication →

ProcessAR: An Augmented Reality-Based Tool to Create In-Situ Procedural 2D/3D AR Instructions

Subramanian Chidambaram, Hank Huang, Fengming He, Xun Qian, Ana M. Villanueva, Thomas S. Redick, Wolfgang Stuerzlinger, Karthik Ramani
Proceedings of the 2021 ACM Designing Interactive Systems Conference (DIS 2021) · 2021
View publication →

An Exploratory Study of Augmented Reality Presence for Tutoring Machine Tasks

Yuanzhi Cao, Xun Qian, Tianyi Wang, Rachel Lee, Ke Huo, Karthik Ramani
Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI 2020) · 2020
View publication →

CAPturAR: An Augmented Reality Tool for Authoring Human-Involved Context-Aware Applications

Xun Qian, Tianyi Wang, Fengming He, Xiyun Hu, Ke Huo, Yuanzhi Cao, Karthik Ramani
Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (UIST 2020) · 2020
View publication →

GhostAR: A Time-Space Editor for Embodied Authoring of Human-Robot Collaborative Task with Augmented Reality

Yuanzhi Cao, Tianyi Wang, Xun Qian, Pawan S. Rao, Manav Wadhawan, Ke Huo, Karthik Ramani
Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (UIST 2019) · 2019
View publication →