Seokhyun (Shawn) Hwang

Ph.D. Student in Information Science at the University of Washington

Hi there! My name is Seokhyun (Shawn) Hwang, and I am a Ph.D. student in Information Science at the University of Washington in the ACE Lab (Advisor: Jacob O. Wobbrock). I completed my Master's degree in Intelligent Robotics at Gwangju Institute of Science and Technology HCIS Lab (Advisor: SeungJun Kim). I work on Human-Computer Interaction, VR/AR, haptics, and wearable systems.

Latest CV Contact: seokhyun(at)uw.edu

Google Scholar LinkedIn UW Profile ResearchGate ORCID ACM DL

Education

University of Washington, United States

Doctor of Philosophy (Ph.D.), Information Science, Information School

Sep 2024 - Present (Expected)

Advisor: Jacob O. Wobbrock
Gwangju Institute of Science and Technology, Korea

Master of Science (M.S.), Intelligent Robotics, School of Integrated Technology

Sep 2021 - Aug 2023

Advisor: SeungJun Kim
Gwangju Institute of Science and Technology, Korea

Bachelor of Science (B.S.), Department of Mechanical Engineering

Mar 2017 - Aug 2021
Boston University, United States

Exchange Student

Jun 2018 - Aug 2018

Research Experiences

University of Washington & Toyota Research Institute

Research Assistant

Jan 2025 - Present
Toyota Research Institute

Research Intern (Mentors: Alexandre Filipowicz, Scott Carter)

Jun 2025 - Sep 2025

Human-Centered AI Division
ACE Lab, University of Washington

Ph.D. Student (Advisor: Jacob O. Wobbrock)

Sep 2024 - Present
DRL Lab & CDFG Lab, MIT

Visiting Researcher (Advisors: Daniela Rus, Wojciech Matusik)

Sep 2023 - Oct 2023
Human-Centered Intelligence Systems Lab, GIST

Research Associate

Sep 2023 - Aug 2024
Human-Centered Intelligence Systems Lab, GIST

M.S. Student (Advisor: SeungJun Kim)

Sep 2021 - Aug 2023

Intelligent Robotics, School of Integrated Technology
Human-Centered Intelligence Systems Lab, GIST

Research Intern (Advisor: SeungJun Kim)

Jan 2021 - Aug 2021

School of Integrated Technology internship and undergraduate research internship program
Intelligent Medical Robotics Lab, GIST

Research Intern (Advisor: Jungwon Yoon)

Jun 2020 - Dec 2020
BA Energy Lab, Korea

Industrial-Academic Intern

Dec 2019 - Feb 2020

Teaching Experiences

University of Washington

Teaching Practicum, HCID 520: User Interface Software & Technology

Jan 2026 - Present
University of Washington

Teaching Assistant, INFO360: Design Methods

Sep 2024 - Dec 2024
Gwangju Institute of Science and Technology

Teaching Assistant, RT6304: XR Project Class

2022 Fall - 2023 Spring
National University of Laos & Khon Kaen University

Experiment Instructor (Educational Volunteer), 2019 GIST Global Science Camp in Laos

Jul 2019
Gwangju Institute of Science and Technology

Experiment and Design Team Leader (Educational Volunteer), 2019 GIST Science Camp

Jan 2019

Research Goals : Closed-loop adaptive interaction for dynamic human state + context

Problem

Perception, biomechanics, and cognition vary across people and situations. Static XR/vehicle/wearable/robot systems can reduce safety, comfort, and performance.

Our Approach

Sense → Infer State/Intent → Adapt Feedback/Control/UI → Optimize (Safety, Comfort, Performance, Presence, Trust).

Select a layer to explore the adaptation parameters and signals.

SENSORY LAYER (Input)

Goal

Model multisensory perception + attention to expand the usable envelope without discomfort.

Signals Analyzed

Detection ThresholdJust Noticeable DifferenceSensory ConflictAttentionVisual ScanningSelf-MotionIndividual Differences

System Adapted

Vestibular CuesOptic FlowMultisensory AttractorsHaptic FootwearGait PredictionScan Stimulation

Key Impact

More robust XR locomotion/reorientation and improved accessibility with preserved comfort/presence.

MOTOR LAYER (Output)

Goal

Infer physical intent and deliver biomechanics-grounded wearable actuation/assistance.

Signals Analyzed

Tactile PressureIMU KinematicsRemote ForcesEMG ValidationThermal Contact

System Adapted

Biomech SimulationEMS MappingThermal PressureStability ControlSkill Coaching

Key Impact

Accurate wearable haptics and intent-aware assistance for teleop, training, mobility, and XR touch.

BEHAVIOR LAYER (Closed-Loop Task)

Goal

Optimize user actions across XR, robotics, training, mobility, and driving/AV contexts under cognitive/safety constraints.

Signals Analyzed

WorkloadGlancesTask PerformanceIntentTrustSickness

System Adapted

Adaptive UIContext CuesTeleop FeedbackCPR GuidanceMobility AssistanceRoad CommunicationExplanation Timing

Key Impact

Better task outcomes with lower risk and higher comfort across real-world, mobile, and immersive scenarios.

Publications

Conferences & Journals

HapticsConference

[c.15] A Closed-Loop CPR Training Glove with Integrated Tactile Sensing and Haptic Feedback

Moon, J., Ma, M., Yang, Q., Hwang, S., Choi, Y., Kim, K., Burden, B., Luo, Y.

2026 IEEE International Conference on Robotics & Automation Coming Soon

AutomotiveUXConferenceFA

[c.14] A Framework for Adapting In-Car Touchscreen Interfaces to Driver Behaviors, Perception, and Cognition

Hwang, S., Shen, X., Filipowicz, A., Best, A., Costa, J., Carter, S., Fogarty, J., Wobbrock, J.

Proceedings of the 2026 CHI conference on Human Factors in Computing Systems

AutomotiveUXConferenceFA

[c.13] Touchscreens in Motion: Quantifying the Impact of Cognitive Load on Distracted Drivers

Shen, X.*, Hwang, S.*, Kong, J., Filipowicz, A., Best, A., Costa, J., Carter, S., Fogarty, J., Wobbrock, J.

Proceedings of the 2025 ACM Symposium on User Interface Software and Technology

AutomotiveUXConference

[c.12] You're the One Whom I'm Talking To: The Role of Contextual External Human-Machine Interfaces in Multi-Road User Conflict Scenarios

Kang, Y., Park, J., Hwang, S., Seong, M., Kim, G., Kim, S.

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Vol. 9, No.3

HapticsLocomotionJournal

[j.3] ReD shoes: actuated footwear for multisensory redirected walking in virtual reality

Ataya, A., Elsharkawy, A., Lee, J., Hwang, S., Seong, M., and Kim, S.

Virtual Reality 29, 158 (2025)

HapticsConferenceFAAward

[c.11] TelePulse: Enhancing the Teleoperation Experience through Biomechanical Simulation-Based Electrical Muscle Stimulation in Virtual Reality

🏆 Best Paper

Hwang, S.*, Kang, S.*, Oh, J.*, Park, J., Shin, S., Luo, Y., DelPreto, J., Lee, S., Lee, K., Matusik, W., Rus, D., Kim, S.

Proceedings of the 2025 CHI conference on Human Factors in Computing Systems

LocomotionAutomotiveUXConference

[c.10] I Want to Break Free: Enabling User-Applied Active Locomotion in In-Car VR through Contextual Cues

Gim, B., Hwang, S., Kang, S., Kim, G., Yeo, D., Kim, S.

Proceedings of the 2025 CHI conference on Human Factors in Computing Systems

HapticsLocomotionAccessibilityConference

[c.9] Adaptive Walker: User Intention and Environmentally Aware Intelligent Walker with High-resolution Tactile and IMU Sensor

Choi, Y., Hwang, S., Moon, J., Lee, H., Yeo, D., Seong, M., Luo, Y., Kim, S., Matusik, W., Rus, D., Kim, K.

2025 IEEE International Conference on Robotics & Automation

HapticsConference

[c.8] Flip-Pelt: Motor-Driven Peltier Elements for Rapid Thermal Stimulation and Congruent Pressure Feedback in Virtual Reality

Kang, S., Kim, G., Hwang, S., Park, J., Elsharkawy, A., and Kim, S.

Proceedings of the 2024 ACM Symposium on User Interface Software and Technology

AutomotiveUXConference

[c.7] TimelyTale: A Multimodal Dataset Assessing Passenger's Demands for Explanations in Highly Automated Vehicles

Kim, G., Hwang, S., Seong, M., Yeo, D., Rus, D., Kim, S.

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Vol. 8, No.3

HapticsAccessibilityConference

[c.6] WatchCap: Improving Scanning Efficiency in People with Low Vision through Compensatory Head Movement Stimulation

Jo, T., Yeo, D., Kim, G., Hwang, S., Kim, S.

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Vol. 8, No. 2

HapticsConferenceFAAward

[c.5] ErgoPulse: Electrifying Your Lower Body With Biomechanical Simulation-based Electrical Muscle Stimulation Haptic System in Virtual Reality

🏆 Honorable Mention

Hwang, S., Oh, J., Kang, S., Seong, M., Elsharkawy, A., Kim, S.

Proceedings of the 2024 CHI conference on Human Factors in Computing Systems

HapticsAutomotiveUXConferenceAward

[c.4] SYNC-VR: Synchronizing Your Senses to Conquer Motion Sickness for Enriching In-Vehicle Virtual Reality

🏆 Honorable Mention

Elsharkawy, A., Ataya, A., Yeo, D., An, E., Hwang, S., Kim, S.

Proceedings of the 2024 CHI conference on Human Factors in Computing Systems

HapticsLocomotionJournal

[j.2] Evaluation of Visual, Auditory, and Olfactory Stimulus-Based Attractors for Intermittent Reorientation in Virtual Reality Locomotion

Lee, J., Hwang, S., Kim, K., and Kim, S.

Virtual Reality 28, 104 (2024)

LocomotionJournal

[j.1] Effect of Optical Flow and User VR Familiarity on Curvature Gain Thresholds for Redirected Walking

Lee, J., Hwang, S., Ataya, A., and Kim, S.

Virtual Reality 28, 35 (2024)

HapticsLocomotionConferenceFAAward

[c.3] Enhancing Seamless Walking in Virtual Reality: Application of Bone-Conduction Vibration in Redirected Walking

🏆 Honorable Mention

Hwang, S., Kim, Y., Seo, Y., Kim, S.

2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)

AutomotiveUXConferenceAward

[c.2] Designing Virtual Agent Human-Machine Interfaces Depending on the Communication and Anthropomorphism Levels in Augmented Reality

🏆 Honorable Mention

Kang, Y., Choi, S., An, E., Hwang, S., Kim, S.

Proceedings of the 2023 International Conference on Automotive UI

HapticsLocomotionConferenceFA

[c.1] Electrical, Vibrational, and Cooling Stimuli-Based Redirected Walking: Comparison of Various Vestibular Stimulation-Based Redirected Walking Systems

Hwang, S., Lee, J., Kim, Y., Seo, Y., Kim, S.

Proceedings of the 2023 CHI conference on Human Factors in Computing Systems

Posters & Workshops

Proposal of a Framework for Enhancing Teleoperation Experience with Biomechanical Simulation-Based Electrical Muscle Stimulation in Virtual Reality

HapticsPoster&WorkshopFA

[w.4] Proposal of a Framework for Enhancing Teleoperation Experience with Biomechanical Simulation-Based Electrical Muscle Stimulation in Virtual Reality

Hwang, S., Kang, S., Oh, J., Park, J., Shin, S., Luo, Y., DelPreto, J., Matusik, W., Rus, D., Kim, S.

UbiComp '24: Companion of the 2024 ACM International Joint Conference on Pervasive and Ubiquitous Computing

HapticsAutomotiveUXPoster&Workshop

[w.3] Adaptive In-Vehicle Virtual Reality for Reducing Motion Sickness: Manipulating Passenger Posture During Driving Events

Elsharkawy, A., Ataya, A., Yeo, D., Seong, M., Hwang, S., DelPreto, J., Matusik, W., Rus, D., Kim, S.

UbiComp '24: Companion of the 2024 ACM International Joint Conference on Pervasive and Ubiquitous Computing

HapticsAccessibilityPoster&Workshop

[w.2] Intelligence Walker: A Seamless Mobility Assist Device for the Elderly

Choi, Y., Yeo, D., Hwang, S., Seong, M., Moon, J., Luo, Y., Matusik, W., Rus, D., Kim, K.

2024 IEEE ICRA Workshop on Wearable

HapticsPoster&Workshop

[w.1] Dual-sided Peltier Elements for Rapid Thermal Feedback in Wearables

Kang, S., Kim, G., Hwang, S., Park, J., Elsharkawy, A., and Kim, S.

2024 IEEE ICRA Workshop on Wearable

LocomotionPoster&Workshop

[p.4] GaitWay: Gait Data-Based VR Locomotion Prediction System Robust to Visual Distraction

Kim, Y., Hwang, S., Oh, J., Kim, S.

Extended Abstracts of the 2024 CHI conference on Human Factors in Computing Systems

LocomotionAutomotiveUXPoster&Workshop

[p.3] Curving the Virtual Route: Applying Redirected Steering Gains for Active Locomotion in In-Car VR

Gim, B., Kang, S., Kim, G., Yeo, D., Hwang, S., Kim, S.

Extended Abstracts of the 2024 CHI conference on Human Factors in Computing Systems

HapticsLocomotionPoster&WorkshopFA

[p.2] REVES: Redirection Enhancement Using Four-Pole Vestibular Electrode Stimulation

Hwang, S., Lee, J., Kim, Y., Kim, S.

Extended Abstracts of the 2022 CHI conference on Human Factors in Computing Systems

HapticsLocomotionPoster&Workshop

[p.1] Auditory and Olfactory Stimuli-Based Attractors to Induce Reorientation in Virtual Reality Forward Redirected Walking

Lee, J., Hwang, S., Kim, K., Kim, S.

Extended Abstracts of the 2022 CHI conference on Human Factors in Computing Systems

Patents & Copyrighted Contents

[pa.2] Haptic wearable devices for tactile experiences

Kim, S., Kang, S., Kim, G., Hwang, S., Park, J., Elsharkawy, A.

KR Patent App. KR102541073

[pa.1] Method and System for Supporting Walking in Virtual Environment

Hwang, S., Lee, J., Kim, Y., Seo, Y., Kim, S.

US Patent App. US20250159408A1 | KR Patent App. KR20250069327A

[cc.2] Mobility-Linked Virtual Reality-Based Underwater Exploration Immersive Content Game Software (Underwater Exploration & Ocean Trash Collection Game)

Kim, S., Kang, S., Kang, Y., Kim, K., Seong, M., An, E., Yang, H., Yeo, D., Oh, J., Jeon, H., Jo, T., Hwang, S.

[cc.1] Mobility-Linked Virtual Reality-Based Underwater Exploration Immersive Content Game Software (Underwater Exploration & Underwater Gem Collection Game)

Kim, S., Kang, S., Kang, Y., Kim, K., Seong, M., An, E., Yang, H., Yeo, D., Oh, J., Jeon, H., Jo, T., Hwang, S.

About

Awards & Honors

University Research Partnership, Toyota Research Institute (Jan 2025 - Present)
Best Paper, CHI 2025 (May 2025) - Top 1% of conference papers [c.11]
Special Recognitions, ACM TEI (Sep 2025) - Outstanding reviews in 2025 TEI
Seed for Science, De Luca Foundation (Feb 2025)
Gell Mason Endowed Fellowship, University of Washington (Sep 2024)
Provost-Funded Fellow, University of Washington (Sep 2024)
Startup Funding, University of Washington (Sep 2024)
Special Recognitions, ACM IMWUT (Aug 2024) - Outstanding reviews in 2024 IMWUT
Honorable Mention, CHI 2024 (May 2024) - Top 5% of conference papers [c.5]
Honorable Mention, CHI 2024 (May 2024) - Top 5% of conference papers [c.4]
Honorable Mention, IEEE ISMAR (Oct 2023) - 2nd Prize of conference papers [c.3]
Honorable Mention, ACM AutomotiveUI (Sep 2023) - Top 5% of conference papers [c.2]
Special Recognitions, ACM UIST (May 2023) - Outstanding reviews in 2023 UIST
Government-Sponsored Scholarship, Korea (Sep 2021 - Aug 2023) - Master's degree government scholarship
President Award, GIST (Aug 2020) - 1st Prize in table tennis robot at the 4th GIST Creative Convergence Competition
Scholarship for Academic Excellence (Sep 2020 - Dec 2020)
Industry-Academic Cooperation Scholarship (Dec 2019 - Feb 2020)
Scholarship for Overseas Summer Semester Exchange Students (Jun 2018 - Aug 2018) - Boston University exchange student scholarship
Government-Sponsored Scholarship, Korea (Mar 2017 - Aug 2021) - Bachelor's degree government scholarship

Invited Talks

Toyota Research Institute (Aug 2025) - Invited presentation (hosted by Alexandre Filipowicz)
University of Chicago, Human Computer Integration Lab (Jan 2024) - Invited presentation (hosted by Pedro Lopes)
HCI Korea 2024, ACM SIGCHI (Jan 2024) - Invited presentation on Vestibular Stimuli-Based Redirected Walking (hosted by Inseok Hwang)

Academic Service

Associate Chair:
- UbiComp/ISWC 2024 Workshop on AI-infused Physical Systems (I4U) Service recognition for AC contributions
Conference Reviewer:
- CHI (4 in 2026, 4 in 2025); CHI LBW (1 in 2026, 2 in 2024, 1 in 2023); TEI (1 in 2025 Recognition for an outstanding review); VRST (1 in 2024); UIST (1 in 2023 Recognition for an outstanding review); EuroHaptics (2 in 2026)
Journal Reviewer:
- International Journal of Human–Computer Interaction (3 in 2024, 5 in 2025, 2 in 2026; incl. multi-round reviews)

Media Coverage

Articles from Korean outlets are available in Korean.

"UW study finds touch screens in cars create a multitasking problem that impacts driving." (Dec 2025)
- Outlets: UW News ; GeekWire ; KIRO Seattle's morning News ; KOMO News ; Spotlight on America
"Development of communication technology that informs road users of who, when, and where autonomous vehicles will stop." (Dec 2025)
- Outlets: Veritas Alpha ; Kyosu Shinmun ; AI Times
"Expanding virtual space by 43%: Developing technology that overcomes VR walking limitations." (Dec 2025)
- Outlets: HelloDD ; Veritas Alpha ; Herald Business ; News1 Korea ; Newsworker
"Grandma, you no longer have to push a stroller: AI-equipped walking robot for older adults." (Jun 2025)
- Outlets: The Robot News ; E-News Today ; E-Dong-A ; Newsworker ; NEWSIS ; AI Times ; Seoul Economic Daily ; Veritas Alpha
"Shaken car? No problem – Enjoy VR without motion-sickness even while riding." (May 2025)
- Outlets: Veritas Alpha ; OhmyNews ; Namdo Ilbo ; Herald Business ; Web Economy
"Robot's received force transmitted directly to human arm: Joint development by GIST and MIT." (May 2025)
- Outlets: Digital Chosun Ilbo ; AI Times ; Yonhap News Agency ; EBN ; News1 Korea ; Newsworker ; Veritas Alpha
"Autonomous driving safety information displayed at the right moment: GIST-MIT paper receives top 1% award." (Oct 2024)
- Outlets: NEWSIS ; The University Journal ; Newsworker ; E-News Today ; Veritas Alpha
"Wearable hat helps low-vision users by turning their heads more: WatchCap developed." (Sep 2024)
- Outlets: Brain Media ; Medical News ; ITDaily ; Dong-A Science ; Wide Economy ; NEWSIS ; The University Journal ; News1 Korea ; Newsworker ; iNews24
"GIST research team receives two Honorable Mention awards at ACM CHI 2024 for VR interface work." (May 2024)
- Outlets: Namdo Ilbo ; AI Times ; ITDaily
"GIST virtual-reality interface research wins best-paper awards at IEEE ISMAR 2023." (Nov 2023)
- Outlets: BoanNews ; AI Times ; NEWSIS ; News1 Korea ; AVING News ; Veritas Alpha ; Newsworker ; Newspim

Extra Activities

GIST Society of Automotive Engineers, Korea (GIST) - Founder (Oct 2020 - Mar 2022)
Established a student-created automobile club and led steering-system design and manufacturing. Funded by GIST over $10,000.
GIST Student Creative Activity Support Initiative, Korea (GIST) - Team Leader (Mar 2020 - Nov 2020)
Produced and distributed activity videos under a COVID-19 student club support program. Funded by GIST over $4,500.
GIST Broadcasting Station, Korea (GIST) - Founder (Mar 2019 - Nov 2020)
Established a video production station and managed filming/editing for school promotions and student activities. Funded by GIST over $30,000.
GIST Human Rights Center, Korea (GIST) - Research Intern (Advisor: Kim, Gunoo) (Dec 2018 - Mar 2019)
Conducted research on law, ethics, morality, and philosophy of law.

Fun Projects

The project list below provides brief descriptions of personal projects unrelated to publication.

Natural User Interface-Based Interactive XR System for In-Car Environments

An in-car AR/XR system that combines marker tracking, stereo depth sensing, and hand-gesture interaction for immersive and safe in-vehicle experiences.

Sheet Music Recognition Robot for Automatic Accompaniment

A dual-manipulator robot that reads sheet music with OCR, extracts chords and tempo, and performs autonomous accompaniment on a keyboard.

Automated Drone Design for Kiwi Pollination

An agricultural drone that identifies kiwi flowers and applies a pollen-charcoal mixture using airflow-assisted delivery for efficient pollination.

Vision-Driven Autonomous Table Tennis System

A vision-based robotic table tennis system that tracks ball trajectory in 3D, predicts landing points, and performs autonomous returns with adaptive swings.

✦ Seokhyun Hwang

Google Scholar LinkedIn UW Profile ResearchGate ORCID ACM DL