Publications

2024

1. UIST

   

    

   Pro-Tact: Hierarchical Synthesis of Proprioception and Tactile Exploration for Eyes-Free Ray Pointing on Out-of-View VR Menus

   Yeonsu Kim, Jisu Yim, Kyunghwan Kim, Yohan Yun, and Geehyuk Lee

   UIST ’24

   ABSTRACT DOI HTML

   We introduce Pro-Tact, a novel eyes-free pointing technique for interacting with out-of-view (OoV) VR menus. This technique combines rapid rough pointing using proprioception with fine-grain adjustments through tactile exploration, enabling menu interaction without visual attention. Our user study demonstrated that Pro-Tact allows users to select menu items accurately (95% accuracy for 54 items) in an eyes-free manner, with reduced fatigue and sickness compared to eyes-engaged interaction. Additionally, we observed that participants voluntarily interacted with OoV menus eyes-free when Pro-Tact’s tactile feedback was provided in practical VR application usage contexts. This research contributes by introducing the novel interaction technique, Pro-Tact, and quantitatively evaluating its benefits in terms of performance, user experience, and user preference in OoV menu interactions.

    
2. Virtual Reality

   

    

   Evaluation of visual, auditory, and olfactory stimulus-based attractors for intermittent reorientation in virtual reality locomotion

   Jieun Lee, Seokhyun Hwang, Kyunghwan Kim, and SeungJun Kim

   Springer Virtual Reality ’24

   ABSTRACT DOI

   In virtual reality, redirected walking (RDW) enables users to stay within the tracking area while feeling that they are traveling in a virtual space that is larger than the physical space. RDW uses a visual attractor to the user’s sight and scene manipulation for intermittent reorientation. However, repeated usage can hinder the virtual world immersion and weaken the reorientation performance. In this study, we propose using sounds and smells as alternative stimuli to draw the user’s attention implicitly and sustain the attractor’s performance for intermittent reorientation. To achieve this, we integrated visual, auditory, and olfactory attractors into an all-in-one stimulation system. Experiments revealed that the auditory attractor caused the fastest reorientation, the olfactory attractor induced the widest angular difference, and the attractor with the combined auditory and olfactory stimuli induced the largest angular speed, keeping users from noticing the manipulation. The findings demonstrate the potential of nonvisual attractors to reorient users in situations requiring intermittent reorientation.

    
3. CHI Interactivity

   

   🏅 Honorable Mention: Jury’s Best Demo Recognition

   STButton: Exploring Opportunities for Buttons with Spatio-Temporal Tactile Output

   Yeonsu Kim, Jisu Yim, Jaehyun Kim, Kyunghwan Kim, and Geehyuk Lee

   CHI ’24 Interactivity (Extended Abstracts)

   ABSTRACT DOI HTML Poster

   We present STButton, a physical button with a high-resolution spatio-temporal tactile feedback surface. The 5 x 8 pin array tactile display size of 20mm x 28mm enables buttons to express various types of information, such as value with the number of raised pins, direction with the location of raised pins, and duration of time with blinking animation. With a highly expressive tactile surface, the button can seamlessly transfer assistive feedforward and feedback during spontaneous button interaction, such as touching to locate the button or applying gradual pressure to press the button. In the demonstration, attendees experience five scenarios of button interaction: the seat heater button on a car, the volume control button on a remote controller, the power button on a laptop, the menu button on a VR controller, and the play button on a game controller. In each scenario, the representative role of tactile feedback is configured differently, allowing attendees to experience the rich interaction space and potential benefits of STButton. Early accessed attendees appreciated the unique opportunity to transfer information with a highly expressive tactile surface and emphasized that STButton adds a tangible layer to the user experience, enhancing emotional and sensory engagement.

    

2023

1. UIST Demo

   

    

   Virtual Rolling Temple: Expanding the Vertical Input Space of a Smart Glasses Touchpad

   Kyunghwan Kim, and Geehyuk Lee

   UIST ’23 Demo (Adjunct)

   ABSTRACT DOI HTML Poster

   Smart glasses have not favored two-dimensional (2D) GUI. Such a trend may have originated from the limitations of smart glasses in display and input devices. While the display restriction is rapidly being resolved nowadays, 1D GUI is still the majority, indicating that the touch input device is the possible bottleneck. To tackle this issue by expanding the vertical input space of the temple touchpad, we propose the Virtual Rolling Temple (VRT). The concept is to perform 2D gestures by moving the hand in any direction while keep touching the prototype as if the temple rotates. The VRT touchpad is as thin as the spectacles’ temples, but it provides the users with input space approximately equivalent to an 80×80 mm square touchpad. This is 8 and 13.9 times larger than Google Glass and VUZIX M400, respectively. To validate the concept of the VRT, we constructed three demo scenarios: 2D Pointing, 2D Menu, and 2D Gesture, to cover different types of general 2D input for smart glasses.

    

2022

1. B.S. Thesis

   

   🏆 Best B.S. Thesis Poster Presentation Award (1st place)

   Analysis of the Effect of Vection Generated by Directional Optical Flow in the VR Redirected Walking Scenario

   Kyunghwan Kim

   GIST College EECS - Thesis for Bachelor’s Degree

   Advisor: Jeany Son, Co-Advisor: SeungJun Kim

   ABSTRACT Poster

   Human instinct is eager to explore the unexplored. The concept of Redirected Walking (RDW) was introduced to help with the aspiration of endeavoring to travel to a larger virtual environment by walking. However, compared to general walking scenarios in the real world, wearing Virtual Reality (VR) headsets negatively impacts gait stability. Adding RDW techniques to this would increase the mismatch between visual and vestibular information, resulting in even lower gait stability and possible motion sickness. This study aims to discover if vection generated by Optical Flow (OF) can help improve gait stability, enlarge Detection Threshold (DT) and relieve motion sickness. The results showed that adding vection to the RDW scenario hinders M/L gait stability while there was not much impact on A/P gait stability. Vection also slightly increased simulator sickness and decreased presence in a few combinations, and its relationship with DT was found to require a new measurement method.

    
2. CHI LBW

   

    

   Auditory and Olfactory Stimuli-Based Attractors to Induce Reorientation in Virtual Reality Forward Redirected Walking

   Jieun Lee, Seokhyun Hwang, Kyunghwan Kim, and SeungJun Kim

   CHI ’22 LBW (Extended Abstracts)

   ABSTRACT DOI HTML

   Redirected walking (RDW) visually manipulates the virtual environment to imperceptibly redirect the walkers to keep them in the tracking area, and offers a larger space than physical space. An attractor is a redirected walking technique that captures the walker’s attention and manipulates the walker’s trajectory through rotational gain. However, the attractor visually manipulates the walker’s virtual environment using a predefined rotational gain, and having to constantly gaze at the attractor or the attractor frequently appearing until the walker’s direction matches the desired direction, are problems limiting the application of visual attractors. Moreover, when the walker is unable to recognize or ignores the attractor, reorientation fails. In this study, we designed a human-sense-stimulating attractor that utilizes the auditory and olfactory senses to improve the rotational gain, naturalness, and immersion and decrease the chance of reorientation failure. Although sound and scents are invisible, they can be detected through direction; however, humans cannot recognize the accurate direction of a sound or scent. Based on these characteristics, auditory and olfactory attractors are proposed. We measured the amount of reorientation induced by the auditory and olfactory attractors and calculated the reorientation success rate. Additionally, the naturalness and immersion of the attractor were evaluated. The auditory attractor has a high reorientation success rate, naturalness, and immersion. The olfactory attractor induces more turn changes in the walker than other attractors, and a high number of turn changes leads to a larger rotational gain. Auditory and olfactory-based attractors have the potential to overcome the shortcomings of visual attractors such as the frequent interventions.