erwan/phd-thesis
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Visual hand {rendering => augmentation}

Browse Source
This commit is contained in:
Erwan Normand
2024-11-04 14:37:23 +01:00
parent 613e683902
commit 5dc3e33a15
15 changed files with 93 additions and 79 deletions
Download Patch File Download Diff File Expand all files Collapse all files

12
4-manipulation/visual-hand/1-introduction.tex
View File

@@ -9,22 +9,22 @@ Some work has also investigated the visual feedback of the virtual hand in \AR,
\OST-\AR also has significant perceptual differences from \VR due the lack of mutual occlusion between the hand and the virtual object in \OST-\AR (\secref[related_work]{ar_displays}), and the inherent delays between the user's hand and the result of the interaction simulation (\secref[related_work]{ar_virtual_hands}).
In this chapter, we investigate the \textbf{visual rendering of the virtual hand as augmentation of the real hand} for direct hand manipulation of virtual objects in \OST-\AR.
To this end, we selected in the literature and compared the most popular visual hand renderings used to interact with virtual objects in \AR.
To this end, we selected in the literature and compared the most popular visual hand augmentation used to interact with virtual objects in \AR.
The virtual hand is \textbf{displayed superimposed} on the user's hand with these visual rendering, providing \textbf{feedback on the tracking} of the real hand, as shown in \figref{hands}.
The movement of the virtual hand is also \textbf{constrained to the surface} of the virtual object, providing an additional \textbf{feedback on the interaction} with the virtual object.
We \textbf{evaluate in a user study}, using the \OST-\AR headset Microsoft HoloLens~2, the effect of six visual hand renderings on the user performance and experience in two representative manipulation tasks: push-and-slide and grasp-and-place a virtual object directly with the hand.
We \textbf{evaluate in a user study}, using the \OST-\AR headset Microsoft HoloLens~2, the effect of six visual hand augmentations on the user performance and experience in two representative manipulation tasks: push-and-slide and grasp-and-place a virtual object directly with the hand.
\noindentskip The main contributions of this chapter are:
\begin{itemize}
\item A comparison from the literature of six common visual hand renderings used to interact with virtual objects in \AR.
\item A user study evaluating with 24 participants the performance and user experience of the six visual hand renderings as augmentation of the real hand during free and direct hand manipulation of virtual objects in \OST-\AR.
\item A comparison from the literature of six common visual hand augmentation used to interact with virtual objects in \AR.
\item A user study evaluating with 24 participants the performance and user experience of the six visual hand augmentations as augmentation of the real hand during free and direct hand manipulation of virtual objects in \OST-\AR.
\end{itemize}
\noindentskip In the next sections, we first present the six visual hand renderings we considered and gathered from the literature. We then describe the experimental setup and design, the two manipulation tasks, and the metrics used. We present the results of the user study and discuss the implications of these results for the manipulation of virtual objects directly with the hand in \AR.
\noindentskip In the next sections, we first present the six visual hand augmentations we considered and gathered from the literature. We then describe the experimental setup and design, the two manipulation tasks, and the metrics used. We present the results of the user study and discuss the implications of these results for the manipulation of virtual objects directly with the hand in \AR.
\bigskip
\begin{subfigs}{hands}{The six visual hand renderings as augmentation of the real hands.}[
\begin{subfigs}{hands}{The six visual hand augmentations as augmentation of the real hands.}[
As seen by the user through the \AR headset during the two-finger grasping of a virtual cube.
][
\item No visual rendering \level{(None)}.