augmented reality

1-introduction/related-work/3-augmented-reality.tex

@@ -1,12 +1,12 @@
 \section{Principles and Capabilities of AR}
 \label{augmented_reality}
 
-The first \AR \HMD was invented by \textcite{sutherland1968headmounted}: With the technology available at the time, it was already capable of displaying virtual objects at a fixed point in space in real time, giving the user the illusion that the content was present in the room (see \figref{sutherland1968headmounted}).
+The first \AR headset was invented by \textcite{sutherland1968headmounted}: With the technology available at the time, it was already capable of displaying virtual objects at a fixed point in space in real time, giving the user the illusion that the content was present in the room (see \figref{sutherland1968headmounted}).
 Fixed to the ceiling, the headset displayed a stereoscopic (one image per eye) perspective projection of the virtual content on a transparent screen, taking into account the user's position, and thus already following the interaction loop presented in \figref[introduction]{interaction-loop}.
 
 \begin{subfigs}{sutherland1968headmounted}{Photos of the first \AR system~\cite{sutherland1968headmounted}. }[
-        \item The \AR \HMD displaying wireframe \ThreeD virtual objects registered in the real environment.
+        \item The \AR headset.
-        \item The \HMD displayed wireframe \ThreeD virtual objects registered in the real environment.
+        \item Wireframe \ThreeD virtual objects were displayed registered in the real environment (as if there were part of it).
     ]
     \subfigsheight{45mm}
     \subfig{sutherland1970computer3}
@@ -15,16 +15,15 @@ Fixed to the ceiling, the headset displayed a stereoscopic (one image per eye) p
 
 
 \subsection{What is Augmented Reality?}
-\label{ar_definition_applications}
+\label{ar_definition}
-
 
 \paragraph{A Definition}
 
 The system of \cite{sutherland1968headmounted} already fulfilled the first formal definition of \AR, proposed by \textcite{azuma1997survey} in the first survey of the domain:
 \begin{enumerate}[label=(\arabic*)]
-    \item \emph{combine real and virtual},
+    \item combine real and virtual,
-    \item \emph{be interactive in real time}, and
+    \item be interactive in real time, and
-    \item \emph{register real and virtual}\footnotemark.
+    \item register real and virtual\footnotemark.
 \end{enumerate}
 
 %\footnotetext{There quite confusion in the literature and in (because of) the industry about the terms \AR and \MR. The term \MR is very often used as a synonym of \AR, or a version of \AR that enables an interaction with the virtual content. The title of this section refers to the title of the highly cited paper by \textcite{speicher2019what} that examines this debate.}
@@ -37,7 +36,6 @@ Yet, most of the research have focused on visual augmentations, and the term \AR
 
 %For example, \textcite{milgram1994taxonomy} proposed a taxonomy of \MR experiences based on the degree of mixing real and virtual environments, and \textcite{skarbez2021revisiting} revisited this taxonomy to include the user's perception of the experience.
 
-
 \paragraph{Applications}
 
 Advances in technology, research and development have enabled many usages of \AR, including medicine, education, industrial, navigation, collaboration and entertainment applications~\cite{dey2018systematic}.
@@ -67,8 +65,16 @@ Yet, the user experience in \AR is still highly dependent on the display used.
 % Bimber and types of AR
 % State of current HMD
 
+\paragraph{Spatial Augmented Reality}
 
-\subsection{On Presence and Embodiment}
+\paragraph{Window on World Displays}
+
+\paragraph{Video See-Through Headsets}
+
+\paragraph{Optical See-Through Headsets}
+
+
+\subsection{Presence and Embodiment}
 \label{ar_presence}
 
 Despite the clear and acknowledged definition presented in \secref{ar_definition} and the viewpoint of this thesis that \AR and \VR are two type of \MR experience with different levels of mixing real and virtual environments, as presented in \secref[introduction]{visuo_haptic_augmentations}, there is still a debate on defining \AR and \MR as well as how to characterize and categorized such experiences~\cite{speicher2019what,skarbez2021revisiting}.
@@ -78,17 +84,27 @@ Despite the clear and acknowledged definition presented in \secref{ar_definition
 Presence is one of the key concept to characterize a \VR experience.
 \AR and \VR are both essentially illusions as the virtual content does not physically exist but is just digitally simulated and rendered to the user's perception through a user interface and the user's senses.
 Such experience of disbelief suspension in \VR is what is called presence, and it can be decomposed into two dimensions: \PI and \PSI~\cite{slater2009place}.
-\PI is the sense of the user of \enquote{being there} in the \VE, and it emerges from the real time rendering of the \VE from the user's perspective, the displayed content conforming and being consistent with the proprioception and actions of the user.
+\PI is the sense of the user of \enquote{being there} in the \VE (see \figref{presence-vr}).
+It emerges from the real time rendering of the \VE from the user's perspective: to be able to move around inside the \VE and look from different point of views.
 \PSI is the illusion that the virtual events are really happening, even if the user knows that they are not real.
 It doesn't mean that the virtual events are realistic, but that they are plausible and coherent with the user's expectations.
 A third strong illusion in \VR is the \SoE, which is the illusion that the virtual body is one's own~\cite{slater2022separate,guy2023sense}.
 
 The \AR presence is far less defined and studied than for \VR~\cite{tran2024survey}, but it will be useful to design, evaluate and discuss our contributions in the next chapters.
-Thereby, \textcite{slater2022separate} proposed to invert \PI as bring the virtual into the physical world, \ie \enquote{place it here}.
+Thereby, \textcite{slater2022separate} proposed to invert \PI to what we can call \enquote{object illusion}, \ie the sense of the virtual object of \enquote{being here} in the \RE (see \figref{presence-ar}).
 As with VR, \VOs must be able to be seen from different angles by moving the head but also, this is more difficult, be consistent with the \RE, \eg occlude or be occluded by real objects~\cite{macedo2023occlusion}, cast shadows or reflect lights.
 The \PSI can be applied to \AR as is, but the \VOs must additionally have knowledge of the \RE and react accordingly to it.
 \textcite{skarbez2021revisiting} also named \PI for \AR as \enquote{immersion} and \PSI as \enquote{coherence}, and these terms will be used in the remainder of this thesis.
 
+\begin{subfigs}{presence}{The sense of immersion in virtual and augmented environments. Adapted from \textcite{stevens2002putting}. }[
+        \item Place Illusion (PI) is the sense of the user of \enquote{being there} in the \VE.
+        \item Objet illusion is the sense of the virtual object of \enquote{being here} in the \RE.
+    ]
+    \subfigsheight{35mm}
+    \subfig{presence-vr}
+    \subfig{presence-ar}
+\end{subfigs}
+
 \paragraph{Embodiment}
 
 As presence, \SoE in \AR is a recent topic and little is known about its perception on the user experience~\cite{genay2021virtual}.