Semantic level.

diff --git a/tex/2-output.tex b/tex/2-output.tex
index d8894099f55d5c399f41ae8d9c8ec892ca8c0a3f..2e2b7500fb15026c6138e80446204c78ca67559f 100644 (file)
--- a/tex/2-output.tex
+++ b/tex/2-output.tex
@@ -332,6 +332,12 @@ They eventually combine different modalities.
 The figure~\ref{fig:syntactic} shows several examples of such haptic phrases with vibrotactile feedback.
 Frequency and amplitude modulation create new kinds of feedback, that Brown \etal describe as roughness \cite{brewster04}.
 They also use sequences of vibrations to form rhythms.
+The challenge here is to find combinations of parameters that users are able to interpret together.
+I conducted such kind of research during my Ph.D.~\cite{pietrzak05, pietrzak05a, pietrzak06, pietrzak09}.
+The difficulty is not only to identify such haptic parameters, but also to evaluate them.
+By increasing the number of parameters and the number of values for each parameter, we quickly reach a point where it is impossible to evaluate every combination.
+In this case we use other methods that basically consist in probing this space.
+We will discuss this in section~\ref{sec:stimtac}.
 
 %Typically, force-feedback device use force models, as described in the previous section.
 %These are functions that compute forces depending on the device's position.
@@ -382,6 +388,102 @@ They also use sequences of vibrations to form rhythms.
 The \emph{semantic level} represents the mapping between the haptic effect and its associated meaning.
 For example, if we create Tactons for messaging system alerts, we can encode the caller ID with a rhythm, and the urgency with roughness.
 The combination of both parameters enables encoding every level of urgency for every caller ID.
+Figure~\ref{fig:semantic} shows an example of mapping between multi-parameters Tactons and hierarchical information.
+Some studies associate information to Tactons while evaluating the syntactic level~\cite{brown06,hoggan07}.
+Therefore these studies either assume that the interpretation of the mapping is trivial, or they cannot make the distinction of the part of the metrics associated to the syntactic and the semantic level.
+Some Tactons studies I conducted during my Ph.D. also combined the syntactic and semantic level~\cite{pietrzak06, pietrzak09}.
+The Tactons parameters I used were mapped to direction and distance.
+However the design rationale of these Tactons was to suggest the associated information.
+The directions were coded with lines or L shapes pointing towards the corresponding location.
+Unfortunately we did not evaluate to which extent the semantic helped the interpretetation.
+In section~\ref{sec:activibe}, I will address another issue the semantic level of the haptic vocabulary.
+Most, if not all, haptic devices we use daily such as mobile phones or smartwatches have low quality vibrotactile actuators, and typically only have one.
+In the study I will discuss there we addressed two challenges.
+First, we designed tactons with an off-the-shelf smartatch, which has only one actuator, of poor quality.
+Second, we studied the interpretation of Tactons while users performed their daily activities.
+
+\begin{figure}[htb]
+  \centering
+  \definecolor{cellred}{rgb}    {0.98,0.17,0.15}
+  \definecolor{cellblue}{rgb}    {0.17,0.60,0.99}
+  
+  \newcommand{\labelcell}[2]{
+  \node[minimum width=1.0cm, minimum height=.75cm,text width=3.0cm, align=center, outer sep=0, column sep=0cm](#1) {\textbf{#2}};
+  }
+  \newcommand{\bluecell}[2]{
+    \node[minimum width=3.0cm, minimum height=1cm,fill=cellblue, text=white,text width=3.5cm, align=center, rounded corners=2ex, outer sep=0](#1) {#2};
+  }
+  \newcommand{\redcell}[2]{
+    \node[minimum width=3.0cm, minimum height=1cm,fill=cellred, text=white,text width=3.5cm, align=center, rounded corners=2ex, outer sep=0](#1) {#2};
+  }
+  \newcommand{\mediumbluecell}[2]{
+    \node[minimum width=2.0cm, minimum height=5mm,fill=cellblue, text=white,text width=2.0cm, align=center, rounded corners=2mm, outer sep=0](#1) {\footnotesize #2};
+  }
+  \newcommand{\mediumredcell}[2]{
+    \node[minimum width=2.0cm, minimum height=5mm,fill=cellred, text=white,text width=2.0cm, align=center, rounded corners=2mm, outer sep=0](#1) {\footnotesize #2};
+  }
+  \newcommand{\smallbluecell}[2]{
+    \node[minimum width=8mm, minimum height=4mm,fill=cellblue, text=white,text width=8mm, align=center, rounded corners=1mm, outer sep=0](#1) {\scriptsize #2};
+  }
+  \newcommand{\smallredcell}[2]{
+    \node[minimum width=8mm, minimum height=4mm,fill=cellred, text=white,text width=8mm, align=center, rounded corners=1mm, outer sep=0](#1) {\scriptsize #2};
+  }
+  \begin{tikzpicture}
+    %\small
+    \matrix[row sep=1mm, column sep=10mm,inner sep=0, node distance=0, outer sep=0mm] (cells) {
+      & & \smallbluecell{rh1}{Rh1} & \smallredcell{t1}{T1} & & \\
+      & \mediumbluecell{rhythm}{Rhythm} & \smallbluecell{rh2}{Rh2} & \smallredcell{t2}{T2} & \mediumredcell{type}{Type} & \\
+      & & \smallbluecell{rh3}{Rh3} & \smallredcell{t3}{T3} & & \\
+      & & \smallbluecell{ro1}{Ro1} & \smallredcell{i1}{I1} & & \\
+      \mediumbluecell{tacton}{Tacton} & \mediumbluecell{roughness}{Roughness} & \smallbluecell{ro2}{Ro2} & \smallredcell{i2}{I2} & \mediumredcell{importance}{Importance} & \mediumredcell{information}{Information}\\
+      & & \smallbluecell{ro3}{Ro3} & \smallredcell{i3}{I3} & & \\
+      & & \smallbluecell{l1}{L1} & \smallredcell{d1}{D1} & & \\
+      & \mediumbluecell{location}{Location} & \smallbluecell{l2}{L2} & \smallredcell{d2}{D2} & \mediumredcell{delay}{Delay} & \\
+      & & \smallbluecell{l3}{L3} & \smallredcell{d3}{D3} & & \\
+    };
+    \draw (tacton.north) edge[->, -stealth', thick, out=90,in=180] (rhythm.west);
+    \draw (tacton.east) edge[->, -stealth', thick, out=0,in=180] (roughness.west);
+    \draw (tacton.south) edge[->, -stealth', thick, out=-90,in=180] (location.west);
+
+    \draw (rhythm.north) edge[->, -stealth', thick, out=30,in=180] (rh1.west);
+    \draw (rhythm.east) edge[->, -stealth', thick, out=0,in=180] (rh2.west);
+    \draw (rhythm.south) edge[->, -stealth', thick, out=-30,in=180] (rh3.west);
+    \draw (roughness.north) edge[->, -stealth', thick, out=30,in=180] (ro1.west);
+    \draw (roughness.east) edge[->, -stealth', thick, out=0,in=180] (ro2.west);
+    \draw (roughness.south) edge[->, -stealth', thick, out=-30,in=180] (ro3.west);
+    \draw (location.north) edge[->, -stealth', thick, out=30,in=180] (l1.west);
+    \draw (location.east) edge[->, -stealth', thick, out=0,in=180] (l2.west);
+    \draw (location.south) edge[->, -stealth', thick, out=-30,in=180] (l3.west);
+
+    \draw (information.north) edge[->, -stealth', thick, out=90,in=0] (type.east);
+    \draw (information.west) edge[->, -stealth', thick, out=180,in=0] (importance.east);
+    \draw (information.south) edge[->, -stealth', thick, out=-90,in=0] (delay.east);
+
+    \draw (type.north) edge[->, -stealth', thick, out=150,in=0] (t1.east);
+    \draw (type.west) edge[->, -stealth', thick, out=180,in=0] (t2.east);
+    \draw (type.south) edge[->, -stealth', thick, out=-150,in=0] (t3.east);
+    \draw (importance.north) edge[->, -stealth', thick, out=150,in=0] (i1.east);
+    \draw (importance.west) edge[->, -stealth', thick, out=180,in=0] (i2.east);
+    \draw (importance.south) edge[->, -stealth', thick, out=-150,in=0] (i3.east);
+    \draw (delay.north) edge[->, -stealth', thick, out=150,in=0] (d1.east);
+    \draw (delay.west) edge[->, -stealth', thick, out=180,in=0] (d2.east);
+    \draw (delay.south) edge[->, -stealth', thick, out=-150,in=0] (d3.east);
+
+    \draw[<->, stealth-stealth, thick] (rh1) -- (t1);
+    \draw[<->, stealth-stealth, thick] (rh2) -- (t2);
+    \draw[<->, stealth-stealth, thick] (rh3) -- (t3);
+    \draw[<->, stealth-stealth, thick] (ro1) -- (i1);
+    \draw[<->, stealth-stealth, thick] (ro2) -- (i2);
+    \draw[<->, stealth-stealth, thick] (ro3) -- (i3);
+    \draw[<->, stealth-stealth, thick] (l1) -- (d1);
+    \draw[<->, stealth-stealth, thick] (l2) -- (d2);
+    \draw[<->, stealth-stealth, thick] (l3) -- (d3);
+    
+  \end{tikzpicture}
+  \caption{Illustration of a semantic mapping between 3-parameters tactons and a 3-level information, adapted from~\cite{brown06}. Three values of rhythm are mapped to three types of messages, three values of roughness are mapped to three degrees of importance, and three spatial locations are mapped to three values of delay.}
+  \label{fig:semantic}
+\end{figure}
+  
 
 %One may think that because we are computer scientists, we only have to design and implement interaction techniques at the software controller level.
 %However, this design not only depends on technological factors (the electro-mechanical system), but also human factors (both sensory and cognitive systems).
@@ -447,6 +549,7 @@ Therefore we perform iterations of prototyping and evaluation of human factors i
 
 
   \subsection{Tactons}
+  \label{sec:activibe}
   Haptic feedback for activity monitoring (Activibe)\cite{cauchard16}
 
   Off-the-shelf smartwatch \texttt{=>} simple ERM actuator \texttt{=>} simple feedback, limited vocabulary