erwan/phd-thesis
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Override subfigs commands

Browse Source
This commit is contained in:
Erwan Normand
2024-07-12 10:05:37 +02:00
parent 29523ed1f3
commit 913a35ef9d
11 changed files with 112 additions and 75 deletions
Download Patch File Download Diff File Expand all files Collapse all files

10
2-perception/ar-textures/2-experiment.tex
View File

@@ -2,15 +2,17 @@
\label{sec:experiment}
\begin{subfigs}{setup}{%
(Left) The nine visuo-haptic textures used in the user study, selected from the HaTT database~\autocite{culbertson2014one}. %
User Study.
}[%
\item The nine visuo-haptic textures used in the user study, selected from the HaTT database~\autocite{culbertson2014one}. %
The texture names were never shown, so as to prevent the use of the user's visual or haptic memory of the textures.
(Middle) Experimental setup. %
\item Experimental setup. %
Participant sat in front of the tangible surfaces, which were augmented with visual textures displayed by the HoloLens~2 AR headset and haptic roughness textures rendered by the vibrotactile haptic device placed on the middle index phalanx. %
A webcam above the surfaces tracked the finger movements.
(Right) First person view of the user study, as seen through the immersive AR headset HoloLens~2. %
\item First person view of the user study, as seen through the immersive AR headset HoloLens~2. %
The visual texture overlays are statically displayed on the surfaces, allowing the user to move around to view them from different angles. %
The haptic roughness texture is generated based on HaTT data-driven texture models and finger speed, and it is rendered on the middle index phalanx as it slides on the considered surface.%
}
]
\subfig[0.32]{experiment/textures}%
\subfig[0.32]{experiment/setup}%
\subfig[0.32]{experiment/view}%

20
2-perception/xr-perception/2-method.tex
View File

@@ -44,20 +44,16 @@ The system is composed of three main components: the pose estimation of the trac
\subsection{Pose Estimation and Virtual Environment Alignment}
\label{sec:virtual_real_alignment}
\begin{subfigs}{setup}{%
Visuo-haptic texture rendering system setup.
%
(a) HapCoil-One voice-coil actuator with a fiducial marker on top attached to a participant's right index finger. %
%
(b) HoloLens~2 AR headset, the two cardboard masks to switch the real or virtual environments with the same field of view, and the 3D-printed piece for attaching the masks to the headset. %
%
(c) User exploring a virtual vibrotactile texture on a tangible sheet of paper.
}
\begin{subfigs}{setup}{Visuo-haptic texture rendering system setup}[%
\item HapCoil-One voice-coil actuator with a fiducial marker on top attached to a participant's right index finger. %
\item HoloLens~2 AR headset, the two cardboard masks to switch the real or virtual environments with the same field of view, and the 3D-printed piece for attaching the masks to the headset. %
\item User exploring a virtual vibrotactile texture on a tangible sheet of paper.
]
\hidesubcaption
\subfig[0.325]{method/device}[]
\subfig[0.65]{method/headset}[]
\subfig[0.325]{method/device}
\subfig[0.65]{method/headset}
\par\vspace{2.5pt}
\subfig[0.992]{method/apparatus}[]
\subfig[0.992]{method/apparatus}
\end{subfigs}
A fiducial marker (AprilTag) is glued to the top of the actuator (see \figref{method/device}) to track the finger pose with a camera (StreamCam, Logitech) which is placed above the experimental setup and capturing \qtyproduct{1280 x 720}{px} images at \qty{60}{\hertz} (see \figref{method/apparatus}).

6
2-perception/xr-perception/3-experiment.tex
View File

@@ -17,9 +17,9 @@
%The pictures are captured directly from the Microsoft HoloLens 2 headset.
}
\hidesubcaption
\subfig[0.32]{experiment/real}[]
\subfig[0.32]{experiment/mixed}[]
\subfig[0.32]{experiment/virtual}[]
\subfig[0.32]{experiment/real}
\subfig[0.32]{experiment/mixed}
\subfig[0.32]{experiment/virtual}
\end{subfigswide}
Our visuo-haptic rendering system, described in \secref{method}, allows free exploration of virtual vibrotactile textures on tangible surfaces directly touched with the bare finger to simulate roughness augmentation, while the visual rendering of the hand and environment can be controlled to be in AR or VR.

45
2-perception/xr-perception/4-results.tex
View File

@@ -36,20 +36,17 @@ All pairwise differences were statistically significant.
\begin{subfigs}{discrimination_accuracy}{%
Generalized Linear Mixed Model (GLMM) results in the vibrotactile texture roughness discrimination task, with non-parametric bootstrap 95\% confidence intervals.
%
(a) Percentage of trials in which the comparison texture was perceived as rougher than the reference texture, as a function of the amplitude difference between the two textures and the visual rendering.
%
}[%
\item Percentage of trials in which the comparison texture was perceived as rougher than the reference texture, as a function of the amplitude difference between the two textures and the visual rendering.
Curves represent predictions from the GLMM (probit link function) and points are estimated marginal means.
%
(b) Estimated points of subjective equality (PSE) of each visual rendering.
\item Estimated points of subjective equality (PSE) of each visual rendering.
%, defined as the amplitude difference at which both reference and comparison textures are perceived to be equivalent, \ie the accuracy in discriminating vibrotactile roughness.
%
(c) Estimated just-noticeable difference (JND) of each visual rendering.
\item Estimated just-noticeable difference (JND) of each visual rendering.
%, defined as the minimum perceptual amplitude difference, \ie the sensitivity to vibrotactile roughness differences.
}
\subfig[0.85]{results/trial_predictions}[]\\
\subfig[0.45]{results/trial_pses}[]
\subfig[0.45]{results/trial_jnds}[]
]
\subfig[0.85]{results/trial_predictions}\\
\subfig[0.45]{results/trial_pses}
\subfig[0.45]{results/trial_jnds}
\end{subfigs}
@@ -82,16 +79,14 @@ All pairwise differences were statistically significant: \level{Real} \vs \level
\begin{subfigs}{results_finger}{%
Boxplots and geometric means of response time at the end of a trial, and finger position and finger speed measures when exploring the comparison texture, with pairwise Tukey's HSD tests: * is \pinf{0.05}, ** is \pinf{0.01} and *** is \pinf{0.001}.
%
(a) Response time of a trial.
%
(b) Distance traveled by the finger in a trial.
%
(b) Speed of the finger in a trial.
}
\subfig[0.32]{results/trial_response_times}[]
\subfig[0.32]{results/trial_distances}[]
\subfig[0.32]{results/trial_speeds}[]
}[%
\item Response time of a trial.
\item Distance traveled by the finger in a trial.
\item Speed of the finger in a trial.
]
\subfig[0.32]{results/trial_response_times}
\subfig[0.32]{results/trial_distances}
\subfig[0.32]{results/trial_speeds}
\end{subfigs}
@@ -135,8 +130,8 @@ The vibrations were felt a slightly weak overall (\response{Vibration Strength},
\begin{subfigs}{question_plots}{%
Boxplots of responses to questions with significant differences and pairwise Wilcoxon signed-rank tests with Holm-Bonferroni adjustment: * is \pinf{0.05}, ** is \pinf{0.01} and *** is \pinf{0.001}.
}
\subfig[0.24]{results/questions_hand_ownership}[]
\subfig[0.24]{results/questions_hand_latency}[]
\subfig[0.24]{results/questions_hand_reference}[]
\subfig[0.24]{results/questions_hand_distraction}[]
\subfig[0.24]{results/questions_hand_ownership}
\subfig[0.24]{results/questions_hand_latency}
\subfig[0.24]{results/questions_hand_reference}
\subfig[0.24]{results/questions_hand_distraction}
\end{subfigs}