Début VR input
authorThomas Pietrzak <thomas.pietrzak@gmail.com>
Fri, 26 Nov 2021 11:04:44 +0000 (12:04 +0100)
committerThomas Pietrzak <thomas.pietrzak@gmail.com>
Fri, 26 Nov 2021 11:04:44 +0000 (12:04 +0100)
figures/emoraye_2d-menu.png [new file with mode: 0644]
figures/emoraye_rmw.png [new file with mode: 0644]
figures/emoraye_touchpad-gesture.png [new file with mode: 0644]
figures/emoraye_touchpad-menu.png [new file with mode: 0644]
figures/raycursor_a.pdf [new file with mode: 0644]
figures/raycursor_b.pdf [new file with mode: 0644]
figures/raycursor_c.pdf [new file with mode: 0644]
figures/raycursor_d.pdf [new file with mode: 0644]
figures/raycursor_e.pdf [new file with mode: 0644]
tex/3-input.tex

diff --git a/figures/emoraye_2d-menu.png b/figures/emoraye_2d-menu.png
new file mode 100644 (file)
index 0000000..2c68de8
Binary files /dev/null and b/figures/emoraye_2d-menu.png differ
diff --git a/figures/emoraye_rmw.png b/figures/emoraye_rmw.png
new file mode 100644 (file)
index 0000000..53a78a3
Binary files /dev/null and b/figures/emoraye_rmw.png differ
diff --git a/figures/emoraye_touchpad-gesture.png b/figures/emoraye_touchpad-gesture.png
new file mode 100644 (file)
index 0000000..a6a1513
Binary files /dev/null and b/figures/emoraye_touchpad-gesture.png differ
diff --git a/figures/emoraye_touchpad-menu.png b/figures/emoraye_touchpad-menu.png
new file mode 100644 (file)
index 0000000..9751326
Binary files /dev/null and b/figures/emoraye_touchpad-menu.png differ
diff --git a/figures/raycursor_a.pdf b/figures/raycursor_a.pdf
new file mode 100644 (file)
index 0000000..acb6c22
Binary files /dev/null and b/figures/raycursor_a.pdf differ
diff --git a/figures/raycursor_b.pdf b/figures/raycursor_b.pdf
new file mode 100644 (file)
index 0000000..538e380
Binary files /dev/null and b/figures/raycursor_b.pdf differ
diff --git a/figures/raycursor_c.pdf b/figures/raycursor_c.pdf
new file mode 100644 (file)
index 0000000..95b5f95
Binary files /dev/null and b/figures/raycursor_c.pdf differ
diff --git a/figures/raycursor_d.pdf b/figures/raycursor_d.pdf
new file mode 100644 (file)
index 0000000..2b2afe8
Binary files /dev/null and b/figures/raycursor_d.pdf differ
diff --git a/figures/raycursor_e.pdf b/figures/raycursor_e.pdf
new file mode 100644 (file)
index 0000000..e73cdf2
Binary files /dev/null and b/figures/raycursor_e.pdf differ
index 736af37193d26ba41c705053a24cb3750d66ed19..51388b67612eb888a03d36d4e82e8083fc6e25aa 100644 (file)
@@ -685,15 +685,86 @@ Il the case of our command selection technique for multi-touch interaction with
 Therefore, the location of the contact point does not matter.
 Hence, users can touch the surface with a comfortable posture.
 
-\subsection{Interaction in VR}
+\subsection{Interaction in immersive Virtual Reality}
 \label{sec:interactionvr}
 
+Immersive virtual reality has been around since the beginning of personal computing \cite{sutherland65,sutherland68}.
+Early prototypes already included a stereovision headset with head tracking to match the users' movements with their position in the virtual environment.
+Yet, it took much longer to reach either households or professional environments than personal computers.
+Even today that many different consumer electronics VR headsets are available at reasonnable price, their usage remains limited.
+Virtual Reality is an active research domain in itself for decades, and it contributed to the relative success of the last generation of VR headsets.
+But more research is still necessary to discover the benefits and best way to interact in immersive virtual environments.
+One big research topic in this area is augmenting \defword{immersion}, \defword{presence} and \defword{embodiment} \cite{witmer98,slater99,kilteni12}.
+In short these three concept are related to the users's sensation of being in the virtual environment.
+I will cover this topic in the next chapter, section \ref{sec:embodiment}.
+
+this work is about interaction above all, VR is a context of use.
+
+methodology: identify design aspects, evaluate alternatives, then build a combination of the best, then compare with the best of literature
+
+\subsubsection{Pointing}
 RayCursor \cite{baloup19,baloup18,baloup19a}
 
+\begin{figure}[htb]
+  \def\fh{3.5cm}
+  a)\hspace{-1mm}
+  \includegraphics[height=\fh]{raycursor_a}
+  \hfill
+  b)\hspace{-4mm}
+  \includegraphics[height=\fh]{raycursor_b}
+  \hfill
+  \vrule
+  \hfill
+  c)\hspace{-4mm}
+  \includegraphics[height=\fh]{raycursor_c}
+  \hfill
+  d)\hspace{-4mm}
+  \includegraphics[height=\fh]{raycursor_d}
+  \hfill
+  e)\hspace{-4mm}
+  \includegraphics[height=\fh]{raycursor_e}
+  \hfill
+  f)\hspace{-4mm}
+  \includegraphics[height=\fh]{raycursor_c}
+  \label{fig:raycursor}
+  \caption[Illustration of Raycursor]{Illustration of manual Raycursor:
+  a)~the user controls a cursor along the ray using relative displacements of their thumb on the controller’s touchpad;
+  b)~the target closest to the cursor is highlighted.
+  Illustration of semi-auto Raycursor:
+  c)~by default, it works like raycasting.
+     The cursor (in black) is positioned at the intersection with a target;
+  d)~the target remains selected if the cursor moves out of the target, until it is closer to another target;
+  e)~the user can manually move the cursor using the controller’s touchpad, to select another target (the cursor turns red to indicate manual mode);
+  f)~if the user does not touch the touchpad for 1s, the cursor returns to its behaviour described in c).}
+\end{figure}
+
 Leverages 3D input and combines with 3D motion for more efficient pointing
 
+\subsubsection{Facial expression selection}
+
+Non verbal communication
 Facial expressions \cite{baloup21}
 
+\begin{figure}[htb]
+  \def\fh{3.7cm}
+  a)
+  \includegraphics[height=\fh]{emoraye_2d-menu}
+  \hfill
+  b)
+  \includegraphics[height=\fh]{emoraye_touchpad-menu}
+  \hfill
+  c)
+  \includegraphics[height=\fh]{emoraye_touchpad-gesture}
+  \hfill
+  d)
+  \includegraphics[height=\fh]{emoraye_rmw}
+  \label{fig:emoraye}
+  \caption{Four of the interaction techniques designed: a) menu presents a grid menu in front of the user with raycasting used to select an expression, b) touchpad presents a circular menu above the controller and selection is made using the controller's touchpad, c) gestures is based on gestures on the controller’s touchpad to define an expression, and d) rmw is a result of our first experiment, which presents a circular menu in front of the user with raycasting used to select an expression.
+  All techniques present a feedforward or feedback of the expression, using a miniature version of the avatar's face.
+  }
+\end{figure}
+
+\subsubsection{Discussion}
 
 \section{Conclusion}