From 3de6ad37df6059ba735d4dac2dedd526ccf64561 Mon Sep 17 00:00:00 2001 From: Erwan Normand Date: Thu, 17 Apr 2025 18:22:45 +0200 Subject: [PATCH] Answer comments in visual-hand chapter --- 4-manipulation/visual-hand/5-conclusion.tex | 6 ++---- 5-conclusion/conclusion.tex | 18 +++++++++++++----- 2 files changed, 15 insertions(+), 9 deletions(-) diff --git a/4-manipulation/visual-hand/5-conclusion.tex b/4-manipulation/visual-hand/5-conclusion.tex index 7835fca..20d68c4 100644 --- a/4-manipulation/visual-hand/5-conclusion.tex +++ b/4-manipulation/visual-hand/5-conclusion.tex @@ -13,11 +13,9 @@ The contour and mesh renderings were found to mask the real hand, while the tips The occlusion rendering had too much tracking latency to be effective. This is consistent with similar manipulation studies in \VR and in \VST-\AR setups. -\comans{SJ}{According to the results, occlusion is the most natural (in terms of realism) but least efficient for manipulation. In some cases, natural visualization is necessary. It would be beneficial to discuss these cases to help guide AR interaction designers in choosing the most appropriate visualization methods.}{TODO} - -This study suggests that a \ThreeD visual hand augmentation is important in \AR when interacting with a virtual hand technique, particularly when it involves precise finger movements in relation to virtual content, \eg \ThreeD windows, buttons and sliders, or more complex tasks, such as stacking or assembly. +This study suggests that a \ThreeD visual hand augmentation is important in \OST-\AR when interacting with a virtual hand technique, particularly when it involves precise finger movements in relation to virtual content, \eg \ThreeD windows, buttons and sliders, or more complex tasks, such as stacking or assembly. A minimal but detailed rendering of the virtual hand that does not hide the real hand, such as the skeleton rendering we evaluated, seems to be the best compromise between the richness and effectiveness of the feedback. -%Still, users should be able to choose and adapt the visual hand augmentation to their preferences and needs. +%In addition, users should be able to choose and adapt the visual hand augmentation to their preferences and needs. In addition to visual augmentation of the hand, direct manipulation of virtual objects with the hand can also benefit from wearable haptic feedback. In the next chapter, we explore two wearable vibrotactile contact feedback devices in a user study, located at four positionings on the hand so as to not cover the fingertips. diff --git a/5-conclusion/conclusion.tex b/5-conclusion/conclusion.tex index 1024d85..713cc5c 100644 --- a/5-conclusion/conclusion.tex +++ b/5-conclusion/conclusion.tex @@ -122,20 +122,28 @@ Finally, the virtual texture models should also be adaptable to individual sensi \subsection*{Visual Augmentation of the Hand for Manipulating virtual objects in AR} -\paragraph{AR Displays.} +\comans{SJ}{According to the results, occlusion is the most natural (in terms of realism) but least efficient for manipulation. In some cases, natural visualization is necessary. It would be beneficial to discuss these cases to help guide AR interaction designers in choosing the most appropriate visualization methods.}{This has been discussed more in depth in this section.} + +\comans{SJ}{The task in the experiment is too basic, making it difficult to generalize the results. There are scenarios where depth information may be more important than position, or where positioning may be more critical than orientation. A systematic categorization and analysis of such cases would add depth to the chapter.}{This has been discussed more in depth in this section.} + +\paragraph{Other AR Displays.} The visual hand augmentations we evaluated were displayed on the Microsoft HoloLens~2, which is a common \OST-\AR headset \cite{hertel2021taxonomy}. We purposely chose this type of display, because in \OST-\AR the lack of mutual occlusion between the hand and the virtual object is the most challenging to solve \cite{macedo2023occlusion}. We therefore hypothesized that a visual hand augmentation would be more beneficial to users with this type of display. However, the user's visual perception and experience are different with other types of displays, such as \VST-\AR, where the \RE view is seen through cameras and screens (\secref[related_work]{ar_displays}). -While the mutual occlusion problem and the hand pose estimation latency could be overcome with \VST-\AR, the visual hand augmentation could still be beneficial to users as it provides depth cues and feedback on the hand tracking, and should be evaluated as such. +In particular, the mutual occlusion problem and the latency of hand pose estimation could be overcome with a \VST-\AR headset. +In this case, the occlusion rendering could be the most natural, realistic and effective augmentation. +Yet, a visual hand augmentation could still be beneficial to users by providing depth cues and feedback on hand tracking, and should be evaluated as such. \paragraph{More Practical Usages.} -\comans{SJ}{The task in the experiment is too basic, making it difficult to generalize the results. There are scenarios where depth information may be more important than position, or where positioning may be more critical than orientation. A systematic categorization and analysis of such cases would add depth to the chapter.}{TODO} - We conducted the user study with two manipulation tasks that involved placing a virtual cube in a target volume, either by pushing it on a table or by grasping and lifting it. -These tasks are indeed fundamental building blocks for more complex manipulation tasks \cite[p.390]{laviolajr20173d}, such as stacking or assembly, which should also be considered. %, more ecological applications should be considered. +These tasks are indeed fundamental building blocks for more complex manipulation tasks \cite[p.390]{laviolajr20173d} such as stacking or assembling, which should be investigated as well. +They can indeed require users to perform more complex finger movements and interactions with the virtual object. +Depending on the task, the importance of position, orientation and depth information of the hand and the object may vary and affect the choice of visual hand augmentation. +More practical applications should also be considered, such as medical, educational or industrial scenarios, which may have different needs and constraints (\eg, the most natural visual hand augmentation for a medical application, or the easiest to understand and use for an educational context). + Similarly, a broader experimental study might shed light on the role of gender and age, as our subject pool was not sufficiently diverse in this regard. Finally, all visual hand augmentations received low and high rank rates from different participants, suggesting that users should be able to choose and personalize some aspects of the visual hand augmentation according to their preferences or needs, and this should also be evaluated.