From: Thomas Pietrzak Date: Fri, 26 Nov 2021 11:04:44 +0000 (+0100) Subject: Début VR input X-Git-Tag: first-full-draft~89 X-Git-Url: https://git.thomaspietrzak.com/?a=commitdiff_plain;h=e32296b40fe2af2be6c607db685646c85941bc1f;p=hdr.git Début VR input --- diff --git a/figures/emoraye_2d-menu.png b/figures/emoraye_2d-menu.png new file mode 100644 index 0000000..2c68de8 Binary files /dev/null and b/figures/emoraye_2d-menu.png differ diff --git a/figures/emoraye_rmw.png b/figures/emoraye_rmw.png new file mode 100644 index 0000000..53a78a3 Binary files /dev/null and b/figures/emoraye_rmw.png differ diff --git a/figures/emoraye_touchpad-gesture.png b/figures/emoraye_touchpad-gesture.png new file mode 100644 index 0000000..a6a1513 Binary files /dev/null and b/figures/emoraye_touchpad-gesture.png differ diff --git a/figures/emoraye_touchpad-menu.png b/figures/emoraye_touchpad-menu.png new file mode 100644 index 0000000..9751326 Binary files /dev/null and b/figures/emoraye_touchpad-menu.png differ diff --git a/figures/raycursor_a.pdf b/figures/raycursor_a.pdf new file mode 100644 index 0000000..acb6c22 Binary files /dev/null and b/figures/raycursor_a.pdf differ diff --git a/figures/raycursor_b.pdf b/figures/raycursor_b.pdf new file mode 100644 index 0000000..538e380 Binary files /dev/null and b/figures/raycursor_b.pdf differ diff --git a/figures/raycursor_c.pdf b/figures/raycursor_c.pdf new file mode 100644 index 0000000..95b5f95 Binary files /dev/null and b/figures/raycursor_c.pdf differ diff --git a/figures/raycursor_d.pdf b/figures/raycursor_d.pdf new file mode 100644 index 0000000..2b2afe8 Binary files /dev/null and b/figures/raycursor_d.pdf differ diff --git a/figures/raycursor_e.pdf b/figures/raycursor_e.pdf new file mode 100644 index 0000000..e73cdf2 Binary files /dev/null and b/figures/raycursor_e.pdf differ diff --git a/tex/3-input.tex b/tex/3-input.tex index 736af37..51388b6 100644 --- a/tex/3-input.tex +++ b/tex/3-input.tex @@ -685,15 +685,86 @@ Il the case of our command selection technique for multi-touch interaction with Therefore, the location of the contact point does not matter. Hence, users can touch the surface with a comfortable posture. -\subsection{Interaction in VR} +\subsection{Interaction in immersive Virtual Reality} \label{sec:interactionvr} +Immersive virtual reality has been around since the beginning of personal computing \cite{sutherland65,sutherland68}. +Early prototypes already included a stereovision headset with head tracking to match the users' movements with their position in the virtual environment. +Yet, it took much longer to reach either households or professional environments than personal computers. +Even today that many different consumer electronics VR headsets are available at reasonnable price, their usage remains limited. +Virtual Reality is an active research domain in itself for decades, and it contributed to the relative success of the last generation of VR headsets. +But more research is still necessary to discover the benefits and best way to interact in immersive virtual environments. +One big research topic in this area is augmenting \defword{immersion}, \defword{presence} and \defword{embodiment} \cite{witmer98,slater99,kilteni12}. +In short these three concept are related to the users's sensation of being in the virtual environment. +I will cover this topic in the next chapter, section \ref{sec:embodiment}. + +this work is about interaction above all, VR is a context of use. + +methodology: identify design aspects, evaluate alternatives, then build a combination of the best, then compare with the best of literature + +\subsubsection{Pointing} RayCursor \cite{baloup19,baloup18,baloup19a} +\begin{figure}[htb] + \def\fh{3.5cm} + a)\hspace{-1mm} + \includegraphics[height=\fh]{raycursor_a} + \hfill + b)\hspace{-4mm} + \includegraphics[height=\fh]{raycursor_b} + \hfill + \vrule + \hfill + c)\hspace{-4mm} + \includegraphics[height=\fh]{raycursor_c} + \hfill + d)\hspace{-4mm} + \includegraphics[height=\fh]{raycursor_d} + \hfill + e)\hspace{-4mm} + \includegraphics[height=\fh]{raycursor_e} + \hfill + f)\hspace{-4mm} + \includegraphics[height=\fh]{raycursor_c} + \label{fig:raycursor} + \caption[Illustration of Raycursor]{Illustration of manual Raycursor: + a)~the user controls a cursor along the ray using relative displacements of their thumb on the controller’s touchpad; + b)~the target closest to the cursor is highlighted. + Illustration of semi-auto Raycursor: + c)~by default, it works like raycasting. + The cursor (in black) is positioned at the intersection with a target; + d)~the target remains selected if the cursor moves out of the target, until it is closer to another target; + e)~the user can manually move the cursor using the controller’s touchpad, to select another target (the cursor turns red to indicate manual mode); + f)~if the user does not touch the touchpad for 1s, the cursor returns to its behaviour described in c).} +\end{figure} + Leverages 3D input and combines with 3D motion for more efficient pointing +\subsubsection{Facial expression selection} + +Non verbal communication Facial expressions \cite{baloup21} +\begin{figure}[htb] + \def\fh{3.7cm} + a) + \includegraphics[height=\fh]{emoraye_2d-menu} + \hfill + b) + \includegraphics[height=\fh]{emoraye_touchpad-menu} + \hfill + c) + \includegraphics[height=\fh]{emoraye_touchpad-gesture} + \hfill + d) + \includegraphics[height=\fh]{emoraye_rmw} + \label{fig:emoraye} + \caption{Four of the interaction techniques designed: a) menu presents a grid menu in front of the user with raycasting used to select an expression, b) touchpad presents a circular menu above the controller and selection is made using the controller's touchpad, c) gestures is based on gestures on the controller’s touchpad to define an expression, and d) rmw is a result of our first experiment, which presents a circular menu in front of the user with raycasting used to select an expression. + All techniques present a feedforward or feedback of the expression, using a miniature version of the avatar's face. + } +\end{figure} + +\subsubsection{Discussion} \section{Conclusion}