Answer comments in visual-hand chapter

This commit is contained in:
2025-04-17 18:22:45 +02:00
parent 1482353a22
commit 3de6ad37df
2 changed files with 15 additions and 9 deletions

View File

@@ -122,20 +122,28 @@ Finally, the virtual texture models should also be adaptable to individual sensi
\subsection*{Visual Augmentation of the Hand for Manipulating virtual objects in AR}
\paragraph{AR Displays.}
\comans{SJ}{According to the results, occlusion is the most natural (in terms of realism) but least efficient for manipulation. In some cases, natural visualization is necessary. It would be beneficial to discuss these cases to help guide AR interaction designers in choosing the most appropriate visualization methods.}{This has been discussed more in depth in this section.}
\comans{SJ}{The task in the experiment is too basic, making it difficult to generalize the results. There are scenarios where depth information may be more important than position, or where positioning may be more critical than orientation. A systematic categorization and analysis of such cases would add depth to the chapter.}{This has been discussed more in depth in this section.}
\paragraph{Other AR Displays.}
The visual hand augmentations we evaluated were displayed on the Microsoft HoloLens~2, which is a common \OST-\AR headset \cite{hertel2021taxonomy}.
We purposely chose this type of display, because in \OST-\AR the lack of mutual occlusion between the hand and the virtual object is the most challenging to solve \cite{macedo2023occlusion}.
We therefore hypothesized that a visual hand augmentation would be more beneficial to users with this type of display.
However, the user's visual perception and experience are different with other types of displays, such as \VST-\AR, where the \RE view is seen through cameras and screens (\secref[related_work]{ar_displays}).
While the mutual occlusion problem and the hand pose estimation latency could be overcome with \VST-\AR, the visual hand augmentation could still be beneficial to users as it provides depth cues and feedback on the hand tracking, and should be evaluated as such.
In particular, the mutual occlusion problem and the latency of hand pose estimation could be overcome with a \VST-\AR headset.
In this case, the occlusion rendering could be the most natural, realistic and effective augmentation.
Yet, a visual hand augmentation could still be beneficial to users by providing depth cues and feedback on hand tracking, and should be evaluated as such.
\paragraph{More Practical Usages.}
\comans{SJ}{The task in the experiment is too basic, making it difficult to generalize the results. There are scenarios where depth information may be more important than position, or where positioning may be more critical than orientation. A systematic categorization and analysis of such cases would add depth to the chapter.}{TODO}
We conducted the user study with two manipulation tasks that involved placing a virtual cube in a target volume, either by pushing it on a table or by grasping and lifting it.
These tasks are indeed fundamental building blocks for more complex manipulation tasks \cite[p.390]{laviolajr20173d}, such as stacking or assembly, which should also be considered. %, more ecological applications should be considered.
These tasks are indeed fundamental building blocks for more complex manipulation tasks \cite[p.390]{laviolajr20173d} such as stacking or assembling, which should be investigated as well.
They can indeed require users to perform more complex finger movements and interactions with the virtual object.
Depending on the task, the importance of position, orientation and depth information of the hand and the object may vary and affect the choice of visual hand augmentation.
More practical applications should also be considered, such as medical, educational or industrial scenarios, which may have different needs and constraints (\eg, the most natural visual hand augmentation for a medical application, or the easiest to understand and use for an educational context).
Similarly, a broader experimental study might shed light on the role of gender and age, as our subject pool was not sufficiently diverse in this regard.
Finally, all visual hand augmentations received low and high rank rates from different participants, suggesting that users should be able to choose and personalize some aspects of the visual hand augmentation according to their preferences or needs, and this should also be evaluated.