\label{fig:semantic}
\end{figure}
-Some studies about Tacotns associate information to Tactons while evaluating the syntactic level~\cite{brown06,hoggan07}.
+Some studies about Tactons associate information to Tactons while evaluating the syntactic level~\cite{brown06,hoggan07}.
Therefore these studies either assume that the interpretation of the mapping is trivial, or they cannot make the distinction between the part of the metrics associated with the syntactic and the semantic level.
Some of the Tactons studies I conducted during my Ph.D. also combined the syntactic and semantic level~\cite{pietrzak06, pietrzak09}.
The Tactons parameters I used were mapped to direction and distance.
In section~\ref{sec:activibe}, I will address another issue with the semantic level of the haptic vocabulary.
Most, if not all, haptic devices we use daily such as mobile phones or smartwatches have low-quality vibrotactile actuators, and typically only have one.
-In the study I will discuss there we addressed two challenges.
-First, we designed Tactons with an off-the-shelf smartwatch, which has only one actuator, of poor quality.
+In this study I will discuss there we addressed two challenges.
+First, we designed Tactons with an off-the-shelf smartwatch, which has only one actuator of poor quality.
Second, we studied the interpretation of Tactons while users performed their daily activities.
\subsection{Engineering and evaluation of haptic devices}
The expansion of the haptic interactive vocabulary goes in both directions.
On the one hand, the diversity of haptic sensations and body parts that sense them~\cite{lederman87} motivate the design of a large diversity of haptic devices~\cite{seifi19}.
On the other hand, the frequent emergence of new haptic technologies expands the diversity of haptic sensations we leverage for the design of interaction techniques.
-This diversity of sensations and technologies is a richness, but also a limitation for the development and integration of haptic sytems.
+This diversity of sensations and technologies is a richness, but also a limitation for the development and integration of haptic systems.
Indeed, the sense of touch combines all these sensations, but no single haptic technology can produce all of them.
Therefore, interactive systems which leverage the sense of touch only focus on the subset of haptic sensations relevant to their context of use.
This means that the same type of research must be conducted for every new haptic technology.
Further, the users' perception highly depends on the implementation, which is affected by many environmental factors such as temperature or moisture.
The amplitude and randomness of such undesirable effects are generally higher with research prototypes than with commercial products.
-While these difficulty are essentially technical, they are difficult to quantify, and they have a strong effect on the precision, validity and replicability of scientific results.
-In the section~\ref{sec:stimtac}, I will discuss a project in which investigated a way to mitigate this issue with physical objects reproducing a similar effect than the effect produced by a programmable friction haptic device.
+While these difficulties are essentially technical, they are difficult to quantify, and they have a strong effect on the precision, validity, and replicability of scientific results.
+In section~\ref{sec:stimtac}, I will discuss a project in which we investigated a way to mitigate this issue with physical objects reproducing a similar effect as the effect produced by a programmable friction haptic device.
%Technical and user issues, evaluation…
%Information can get lost
%The physical effect resulting from command sent to the electro-mechanical
-%The software controller provides users with \defword{modalities}, or \defword{interaction techniques}, which are combinations of a a device (the electro-machanical system) and an interactive language~\cite{nigay95}.
+%The software controller provides users with \defword{modalities}, or \defword{interaction techniques}, which are combinations of a device (the electro-machanical system) and an interactive language~\cite{nigay95}.
%Leverage the sense of touch to improve interaction.
% Co-design of devices: human factors guide the design, and the technical limitations shape the vocabulary
- Physical properties of objects also give haptic feedback
+\subsection{Haptic properties of physical objects}
+Haptic devices are designed to stimulate the sense of touch such that we can control the haptic sensations that users will perceive.
+We described above the design rationale and pitfalls of such systems.
+Beyond these haptic systems, physical objects have haptic properties.
+They have a weight, mobile parts with resistance, tactile textures, etc.
+These haptic properties are structural and mechanical.
+For example the size, shape and layout of keyboard keys, as well as the keyboard slope, height and profile are carefully designed~\cite{lewis97}.
+The mechanical force required to push the keys is also systematically adjusted.
+The objective is to reduce the effects of fatigue and muscle strain, and avoid incidental activations.
+The haptic properties of physical interfaces is typically missing on multi-touch interfaces.
+Every widget feels like a flat surface.
+Efforts were made to restore this missing haptic feedback~\cite{nashel03,lylykangas11}, and studies show that adding vibrotactile feedback to touch keyboards increase typing performance~\cite{hoggan08}.
+
+
+% Physical properties of objects also give haptic feedback\\
+
+Shape changing~\cite{michelitsch04} Knobslider~\cite{kim16} Morphees~\cite{roudaut13a}
%\subsection{Towards a haptic semiology}{}
%Lack of Bertin-like haptic semiology \cite{bertin83} \texttt{=>} diversity of sensations, stimulation mechanisms, haptic variables
Direct manipulation~\cite{schneiderman83}
-\cite{mbl00}
+Instrumental interaction~\cite{mbl00}
+
+Curiosity~\cite{laversannefinot18}
Arch~\cite{arch92}, MVC~\cite{reenskaug79,reenskaug79a}, PAC~\cite{coutaz87}
Software architecture reproduce the organization structure\cite{conway68}
+
+Affordances \cite{gibson77}, then in HCI \cite{norman88} then signifiers \cite{norman02}
+perceptible/hidden/false~\cite{gaver91}.
+
+ => Towards computing affrdance, a generalized notion of computability
+
% Sensory substitution refers to situations in which sensations that are typically perceived with one sense are translated to another sense.
% Bach-y-Rita introduced this concept~\cite{backyrita72} and invented the Tactile Vision Sensory Substitution system (TVSS) \cite{collins73}.
% In this article, the authors describe their apparatus, but also mention several other systems that already existed at the time.
The point of this chapter is saying that previous chapters should be part of this one.
+\begin{figure}[htb]
+ \centering
+ \definecolor{cellred}{rgb} {0.98,0.17,0.15}
+
+ \newcommand{\stage}[2]{
+ \node[minimum width=2.1cm, minimum height=.85cm,fill=cellred, text=white,text width=2cm, align=center, rounded corners=2ex, outer sep=0](#1) {#2};
+ }
+ \begin{tikzpicture}
+ \small
+ \matrix[row sep=3mm, column sep=2mm,inner sep=0, node distance=0, outer sep=5mm] (cells) {
+ & \stage{goal}{Goal} & \\
+ \stage{intention}{Intention} & & \stage{evaluation}{Evaluation} \\
+ \stage{specification}{Specification actions} & & \stage{interpretation}{Interpretation} \\
+ \stage{execution}{Execution actions} & & \stage{perception}{Perception} \\
+ };
+ \node[anchor=north, minimum width=8.6cm,minimum height=.8cm,fill=black!10](world) at (cells.south) {World};
+ \draw [->, -stealth', thick]
+ (perception) edge (interpretation)
+ (interpretation) edge (evaluation)
+ (evaluation) edge[out=90, in=0] (goal)
+ (goal) edge[out=180, in=90] (intention)
+ (intention) edge (specification)
+ (specification) edge (execution);
+ \draw [->, -stealth', thick, dashed, draw=black!50, fill=black!50]
+ (perception|-world.north) edge (perception.south)
+ (execution) to (execution|-world.north);
+ \node[anchor=south, minimum width=2.6cm, rotate=90, outer sep=5mm](gulfexecution) at (specification.west) {Gulf of execution};
+ \draw [->, -stealth', thick,transform canvas={xshift=1em}]
+ (gulfexecution.east |- intention.north) to (gulfexecution.east |- execution.south);
+ \node[anchor=south, minimum width=2.6cm, rotate=270, outer sep=5mm](gulfevaluation) at (interpretation.east) {Gulf of evaluation};
+ \draw [->, -stealth', thick,transform canvas={xshift=-1em}]
+ (gulfevaluation.west |- perception.south) to (gulfevaluation.west |- evaluation.north);
+ % \node[anchor=south, minimum width=2.6cm, rotate=90, thick,draw=black!20,fill=black!20] at (n.north west) {Implementation};
+ % \node[anchor=south, minimum height=0.6cm, minimum width=6cm, thick, draw=black!20,fill=black!20] at (nd.north east) {Computing affordance};
+ \end{tikzpicture}
+ \caption{Norman's seven stages of action~\protect\cite{norman02}. It describes how people interact with their environment.}
+ \label{fig:sevenstages}
+ \end{figure}
+
+ \begin{figure}[htb]
+ \centering
+ \definecolor{cellblue}{rgb} {0.17,0.60,0.99}
+
+ \newcommand{\stage}[2]{
+ \node[minimum width=2.1cm, minimum height=.85cm,fill=cellblue, text=white,text width=2cm, align=center, rounded corners=2ex, outer sep=0](#1) {#2};
+ }
+ \begin{tikzpicture}
+ \small
+ \matrix[row sep=3mm, column sep=2mm,inner sep=0, node distance=0, outer sep=5mm] (cells) {
+ \stage{sensing}{Sensing} & & \stage{physical}{Physical effect} \\
+ \stage{events}{Input Events} & & \stage{command}{Command} \\
+ \stage{phrase}{Input phrase} & & \stage{encoding}{Encoding} \\
+ & \stage{application}{Application} & \\
+ };
+ \node[anchor=south, minimum width=8.6cm,minimum height=.8cm,fill=black!10](world) at (cells.north) {World};
+ \draw [->, -stealth', thick]
+ (sensing) edge (events)
+ (events) edge (phrase)
+ (phrase) edge[out=270, in=180] (application)
+ (application) edge[out=0, in=270] (encoding)
+ (encoding) edge (command)
+ (command) edge (physical);
+ \draw [->, -stealth', thick, dashed, draw=black!50, fill=black!50]
+ (sensing|-world.south) edge (sensing.north)
+ (physical) to (physical|-world.south);
+ \node[anchor=south, minimum width=2.6cm, rotate=90, outer sep=5mm](funnelevaluation) at (events.west) {Funnel of evaluation};
+ \draw [->, -stealth', thick,transform canvas={xshift=1em}]
+ (funnelevaluation.east |- sensing.north) to (funnelevaluation.east |- phrase.south);
+ \node[anchor=south, minimum width=2.6cm, rotate=270, outer sep=5mm](funnelexecution) at (command.east) {Funnel of evaluation};
+ \draw [->, -stealth', thick,transform canvas={xshift=-1em}]
+ (funnelexecution.west |- encoding.south) to (funnelexecution.west |- physical.north);
+ % \node[anchor=south, minimum width=2.6cm, rotate=90, thick,draw=black!20,fill=black!20] at (n.north west) {Implementation};
+ % \node[anchor=south, minimum height=0.6cm, minimum width=6cm, thick, draw=black!20,fill=black!20] at (nd.north east) {Computing affordance};
+ \end{tikzpicture}
+ \caption[Seven stages of interactive computation]{The seven stages of interactive computation, adapted from Norman's seven stages of action. It describes how interactive systems interact with their environment.}
+ \label{fig:mysevenstages}
+ \end{figure}
+
+
+\begin{figure}[htb]
+ \centering
+ \definecolor{cellred}{rgb} {0.98,0.17,0.15}
+ \definecolor{cellblue}{rgb} {0.17,0.60,0.99}
+
+ \newcommand{\labelcell}[2]{
+ \node[minimum width=1.9cm, minimum height=.85cm,text width=1.7cm, align=center, outer sep=0](#1) {#2};
+ }
+ \newcommand{\bluecell}[2]{
+ \node[minimum width=2.1cm, minimum height=.85cm,fill=cellblue, text=white,text width=2cm, align=center, rounded corners=2ex, outer sep=0](#1) {#2};
+ }
+ \newcommand{\redcell}[2]{
+ \node[minimum width=2.1cm, minimum height=.85cm,fill=cellred, text=white,text width=2cm, align=center, rounded corners=2ex, outer sep=0](#1) {#2};
+ }
+ \begin{tikzpicture}
+ \small
+ \matrix[row sep=3mm, column sep=0,inner sep=0, node distance=0, outer sep=5mm] (cells) {
+ & \labelcell{perception}{Perception} & \labelcell{output}{Output} & \\
+ \redcell{user}{User} & \labelcell{sensorimotor}{Sensorimotor loop} & \labelcell{execution}{Execution loop} & \bluecell{system}{System}\\
+ & \labelcell{action}{Action} & \labelcell{input}{Input} & \\
+ };
+ \draw [->, -stealth', thick]
+ (sensorimotor.north east) edge[bend right] (user.north)
+ (user.south) edge[bend right] (sensorimotor.south east)
+ (execution.south west) edge[bend right] (system.south)
+ (system.north) to[bend right] (execution.north west);
+ \draw [ultra thick, draw=black!20, fill=black!50]
+ (perception.north east) edge (action.south east);
+ \end{tikzpicture}
+ \caption{The similarity of a user and a system interacting with each other.}
+ \label{fig:loops}
+ \end{figure}
+
+
\section{Something}