Intro finger identification

diff --git a/tex/3-input.tex b/tex/3-input.tex
index a6d24e6a669cc2c7f0e37976c1a8b1e3dc73a2ed..3bf68ece29290e0e90beda2796e4d92a5eedbef7 100644 (file)
--- a/tex/3-input.tex
+++ b/tex/3-input.tex
@@ -538,31 +538,52 @@ Hands and fingers have many degrees of freedom and most of people have enough sk
 Therefore hands are widely used for interacting with interactive systems.
 Yet, consumer electronics interactive devices only use a limited subset of gesture properties.
 Typically multi-touch devices essentially use the contacts coordinates and movement, number of contacts, and recently pressure.
-It already enables complex interaction techniques, in particular for command selection \cite{bailly10,lepinski10}.
+It already enables complex interaction techniques, in particular for command selection~\cite{bailly10}.
 Further studies leverage the raw data of multi-touch surfaces, either from cameras or capacitive sensors.
-With this data we can detect contact blobs instead of single coordinates.
+With this data we can detect contact blobs instead of single coordinates, which increases the input vocabulary \cite{roudaut09}.
+Other research investigated technologies that sense other gestures properties such as the part of the finger touching the surface \cite{harrison11}, make a distinction between contacts from different users \cite{dietz01}, or analyze the hand posture \cite{murugappan12}.
+
+
+In this work we were interested \defword{finger identification}. 
+It is an additional hand gesture property, which says which finger of which hand produced a given contact point.
+There is currently no technology that sense this property directly in consumer electronic products.
+A workaround is to ask users to press all finngers before releasing some of them \cite{lepinski10}.
+Some projects use a different processing of sensed data.
+For example, the old generations tabletops used an infrared projector under a translucent surface, pointed towards the user.
+An infrared camera sensed the reflection of the infrared light that created blobs at contact points.
+The multi-touch coordinates were computed as the centroid of these blobs.
+However, the whole hand was visible on this image and it is possible to identify fingers with image processing of this data \cite{ewerling12}.
+Several studies in the literature use heuristics to detect detect finger chords.
+They detect the palm of the hand and deduce the position of fingers \cite{bailly08} or just assumptions based on the relative position of contact points \cite{ghomi13,wagner14}.
+Other research investigated finger identification with prototyping technologies: 
+fibers under a touchpad that enable the capture of fingerprints \cite{holz13}, a glove with piezoelectric vibration sensors \cite{masson17}, or a glove with fiducial markers \cite{marquardt11}.
+%Fiberio for example uses optical fibers under a touchpad that enable the capture of fingerprints, hence identifying fingers \cite{holz13}.
+%Whichfingers is another solutiuon that does works with any multi-touch interfaces, it uses a glove with piezoelectric vibration sensors on each finger \cite{masson17}.
+In the next section we will discuss the finger identification techniques we used in our studies.
+
+One of the simplest applications of finger identification is probably mapping a different command to every finger.
+Research showed that this is already sufficient to increase the input thoughput of touch interaction \cite{roy15}.
+This is particularly useful because multitouch applications typically cannot provide as many commands as desktop applications.
+For example, in 2014 Wagner \etal report that there were 648 commands in Adobe Photoshop’s menus compared to 35 commands on the tablet version.
+Interaction techniques that use finger identification is a solution.
+However the input space is huge: $2^{10}$ combinations of fingers, to which we can add gestures.
+We will discuss how we leverage this new input space in a systematic way.
 
-However, research investigated technologies that sense many other gestures properties, as well as interaction techniques that leverage them.
 
-Extensions of this vocabulary: finger microrolls \cite{roudaut09}, finger parts \cite{harrison11}
-
-
-
-Extend multitouch gestures \cite{murugappan12} identity, posture, and handedness of the user with depth camera
-
-ID users:
-
-DiamondTouch: multitouch for multiple users \cite{dietz01}
-
-Finger ID:
-Technologies
-Fiberio: fingerprints\cite{holz13}
-Finger ID with camera data \cite{ewerling12}
-
-Finger identification increases the throughput of single touch interactions by mapping a different command to every finger \cite{roy15}.
+\subsubsection{Prototyping apparatus}
 
-TouchID toolkit \cite{marquardt11}
+Before searching for a technology suitable for a product we have to investigate the benefits of this information and how to use it
 
+\begin{figure}[htb]
+  \centering
+  \includegraphics[height=3.9cm]{figures/hotfingers-setup}
+  \hfill
+  \includegraphics[height=3.9cm]{figures/hotfingers-tablette}
+  \hfill
+  \includegraphics[height=3.9cm]{figures/hotfingers-phone}
+  \label{fig:hotfingers-prototypes}
+  \caption[Finger identification prototypes.]{Three implementations of finger identification prototypes. The first one uses gametracks to locate fingers on a tabletop. The two other ones use color markers with a camera to track fingers on a tablet and a smartphone.}
+\end{figure}
 
 \subsubsection{Input vocabulary}
 
@@ -578,21 +599,9 @@ Leverages finger identification for command selection and direct manipulation of
   \caption[Command selection with finger identification.]{Command selection with finger identification. A chord with the left hand whows a crib sheet of commands users can select with the right hand. The user selects a command and adjusts the parameters with direct manipulation. The user can lift the left hand while adjusting the command parameters. The user can invoke additional constraints on the command parameters with the left hand.}
 \end{figure}
 
-\subsubsection{Prototyping apparatus}
-
-\begin{figure}[htb]
-  \centering
-  \includegraphics[height=3.9cm]{figures/hotfingers-setup}
-  \hfill
-  \includegraphics[height=3.9cm]{figures/hotfingers-tablette}
-  \hfill
-  \includegraphics[height=3.9cm]{figures/hotfingers-phone}
-  \label{fig:hotfingers-prototypes}
-  \caption[Finger identification prototypes.]{Three implementations of finger identification prototypes. The first one uses gametracks to locate fingers on a tabletop. The two other ones use color markers with a camera to track fingers on a tablet and a smartphone.}
-\end{figure}
-
-\subsubsection{Discoverability}
+\subsubsection{Discussion}
 
+Discoverability
 \begin{figure}[htb]
   \centering
   \includegraphics[height=3.3cm]{figures/hotfingers-help}