diff --git a/2-perception/vhar-textures/1-introduction.tex b/2-perception/vhar-textures/1-introduction.tex index 472b179..2e174c2 100644 --- a/2-perception/vhar-textures/1-introduction.tex +++ b/2-perception/vhar-textures/1-introduction.tex @@ -17,7 +17,7 @@ We aimed to assess \textbf{which haptic textures were matched with which visual \bigskip -\fig[0.7]{experiment/view}{First person view of the user study. }[ +\fig[0.65]{experiment/view}{First person view of the user study.}[ As seen through the immersive \AR headset Microsoft HoloLens~2. The visual texture overlays were statically displayed on the surfaces, allowing the user to move around to view them from different angles. The haptic texture augmentations were generated based on \HaTT data-driven texture models and finger speed, and were rendered on the middle index phalanx as it slides on the considered surface. diff --git a/2-perception/vhar-textures/5-conclusion.tex b/2-perception/vhar-textures/5-conclusion.tex index a63850b..c458f1c 100644 --- a/2-perception/vhar-textures/5-conclusion.tex +++ b/2-perception/vhar-textures/5-conclusion.tex @@ -1,26 +1,19 @@ \section{Conclusion} \label{conclusion} -\fig[0.6]{experiment/use_case}{ +In this chapter, we investigated how users perceived simultaneous and co-localized visuo-haptic texture augmentations of tangible surfaces seen in immersive \OST-\AR and touched directly with the index finger. +Using the wearable visuo-haptic augmentation system presented in \chapref{vhar_system}, the haptic roughness texture was rendered to a voice-coil worn on the middle-phalanx index, based on the \HaTT data-driven models and finger speed. +In a user study, 20 participants rated the coherence, realism and perceived roughness of the combination of nine representative visuo-haptic texture pairs. + +The results showed that participants consistently identified and matched clusters of visual and haptic textures with similar perceived roughness. +The texture rankings did indeed show that participants perceived the roughness of haptic textures to be very similar, but less so for visual textures, and the haptic roughness perception predominated the final roughness perception ranking of the original visuo-haptic pairs. +This suggests that \AR visual textures that augments tangible surfaces can be enhanced with a set of data-driven vibrotactile haptic textures in a coherent and realistic manner. + +This paves the way for new \AR applications capable of augmenting a \RE with virtual visuo-haptic textures, such as visuo-haptic painting in artistic or object design context, or viewing and touching virtual objects in a museum or a showroom. +The latter is illustrated in \figref{experiment/use_case}, where a user applies different visuo-haptic textures to a wall, in an interior design scenario, to compare them visually and by touch. + +\fig[0.5]{experiment/use_case}{ Illustration of the texture augmentation in \AR through an interior design scenario. }[ A user wearing an \AR headset and a wearable vibrotactile haptic device worn on their index is applying different virtual visuo-haptic textures to a real wall to compare them visually and by touch. ] - -We investigated how users perceived visuo-haptic roughness texture augmentations on tangible surfaces seen in immersive OST-AR and touched directly with the index finger. -% -The haptic roughness texture was rendered using a wearable vibrotactile haptic device worn on the middle phalanx, based on \HaTT data-driven models and finger speed. -% -Participants rated the coherence, realism and roughness of the combination of nine representative visuo-haptic texture pairs. -% -The results showed that participants consistently identified and matched clusters of visual and haptic textures with similar perceived roughness. -% -The texture rankings did indeed show that participants perceived the roughness of haptic textures to be very similar, but less so for visual textures, and the haptic roughness perception predominated the final roughness perception ranking of the original visuo-haptic pairs. -% -There are still many improvements to be made to the respective renderings of the haptic and visual textures used in this work to make them more realistic for finger perception and immersive \VE contexts. -% -However, these results suggest that \AR visual textures that augments tangible surfaces can be enhanced with a set of data-driven vibrotactile haptic textures in a coherent and realistic manner. -% -This paves the way for new \AR applications capable of augmenting a \RE with virtual visuo-haptic textures, such as visuo-haptic painting in artistic, object design or interior design contexts. -% -The latter is illustrated in \figref{experiment/use_case}, where a user applies different visuo-haptic textures to a wall to compare them visually and by touch. diff --git a/4-conclusion/conclusion.tex b/4-conclusion/conclusion.tex index 4dfbc92..434f52d 100644 --- a/4-conclusion/conclusion.tex +++ b/4-conclusion/conclusion.tex @@ -25,7 +25,7 @@ We then conducted a psychophysical user study with 20 participants and extensive The textures were perceived as \textbf{rougher when touched with the real hand alone compared to a virtual hand} in either \AR or \VR, possibly due to the \textbf{perceived latency} between finger movements and different visual, haptic, and proprioceptive feedbacks. In \chapref{vhar_textures}, we investigated the perception of co-localized visual and wearable haptic texture augmentations on tangible surfaces. -We transposed the \textbf{data-driven visuo-haptic textures} from the \HaTT database to the system presented in \chapref{vhar_system} and conducted a user study with 20 participants to rate the coherence, realism, and perceived roughness of nine visuo-haptic texture pairs. +We transposed the \textbf{data-driven visuo-haptic textures} from the \HaTT database to the system presented in \chapref{vhar_system} and conducted a user study with 20 participants to rate the coherence, realism, and perceived roughness of the combination of nine visuo-haptic texture pairs. Participants integrated roughness sensations from both visual and haptic modalities well, with \textbf{haptics predominating the perception}, and consistently identified and matched \textbf{clusters of visual and haptic textures with similar perceived roughness}. \noindentskip In \partref{manipulation} we focused on improving the manipulation of \VOs directly with the hand in immersive \OST-\AR.