Deeper than this, it requires understanding how the user and the interactive system interact with each other.
Norman presents his \defword{seven stages of action}, which describes how humans interact with the world~\cite{norman88,norman02}.
-This model is depicted in red on Figure~\ref{fig:extendedaction}.
+This model is depicted on Figure~\ref{fig:sevenstages}.
The subject starts with establishing a \emph{goal}, which is a high level objective to achieve.
The purpose of every system is to enable achieving such goals.
As an example to illustrate the concept, let me present you Jimmy who just returned home after the Christmas holidays.
Jimmy's actions have effects on the world, that he can eventually \emph{perceive}.
In this case he feels the room getting warmer.
-It is unlikely he notices that the room could not get hotter faster.
-However at some point he will notice the room will be too hot because he set it to the maximum value.
This is an \emph{interpretation} of the results of his actions.
It is based on both the room temperature he perceives, experience, knowledge, personal taste, etc.
-Jimmy \emph{evaluates} this interpretation and decides the temperature is too hot.
+It is unlikely he notices that the room could not get hotter faster.
+However at some point he will notice the room will be too hot because he set it to the maximum value.
+This is an \emph{evaluation} of the temperature he perceived.
His new goal is to lower temperature, keeping in mind the initial state.
+\begin{figure}[htb]
+\centering
+\includegraphics[width=.6\textwidth]{sevenstages}
+\caption[Seven stages of action]{Norman's seven stages of action~\cite{norman02}.}
+\label{fig:sevenstages}
+\end{figure}
+
+These seven stages of actions describe how a person interacts with objects in the world.
+They put the light on issues that can happen at each of these stages.
+On the action side, the difference between the person's goal and the executed action is called the gulf of execution.
+It represents pitfalls that can make more difficult for the person to achieve his goal.
+On the perception side, the difference between the perceived stimulus and its evaluation is called the gulf of evaluation.
+it illustrates troubles the person can have with interpreting correctly the state of the world, in particular in result of his actions.
+A correct design of technology can reduce or bridge such gulfs.
-\section{Seven stages of computation}
+\begin{idee}
\cite{vermeulen13}
We can observe that the perception to action sequence is a refinement of O'Regan's \defword{sensorimotor loop}~\cite{oregan01a}.
+\end{idee}
+
+Now, we can observe that interactive systems can also have difficulties to understand or act on the world in an intended way.
+I present below an adaptation of Norman's seven stages, in the case of interactive systems.
+It will highlight engineering and design problems of interactive systems, which will be useful for identifying challenges for their design and implementation.
+
+\section{Seven stages of interactive computation}
+
+%Despite the tremendous progress of computers the past decades, they can still process a tiny part of
+\loremipsum
+We define the \defword{seven stages of interactive computation} based on Norman's seven stages of action.
+It is illustrated on Figure~\ref{fig:mysevenstages}.
+
+\begin{figure}[htb]
+\centering
+\includegraphics[width=.6\textwidth]{mysevenstages}
+\caption[Seven stages of interactive computation]{The seven stages of interactive computation, adapted from Norman's seven stages of action.}
+\label{fig:mysevenstages}
+\end{figure}
+
+\subsection{Description}
+
+The input chain begins with the \emph{sensing} stage.
+Physical sensors measure physical properties.
+Typically they measure the user movements, but it can be various other information such as light, temperature, moisture, vibrations…
+All such information is transformed into \emph{input events}.
+At this stage we notice that the infinite richness of the world is reduced to a small amount of digits.
+Let's discuss the simple example of a keypress on a keyboard.
+The only information in the digital world is whether a key is pressed or not. There is no information about the finger that pressed it, the speed of the finger or its trajectory.
+There is neither the possibility if a finger is hovering the key, if several fingers are pressing it, or even if it was pressed with the nose.
+Input events have to be treated as tokens, or lexical units.
+They are interpreted as \emph{input phrases} with grammars or finite automatons~\cite{appert06} and form the building blocks of \defword{interaction techniques}~\cite{nigay93}.
+
+The \emph{software} part is a meta algorithm that chooses whether there is an algorithm to run, which algorithm to run, and with which parameters.
+It occurs typically when a command is selected, or an object is being manipulated.
+
+Every computer system has at some point an effect on the world.
+We extend the notion of dead code to not only code that is never executed, but also code which result has no effect whatsoever on the physical world.
+Even a routing algorithm will at some point transmit data to a computer which will display it or print it in any way.
+% Quantic information : stored in computer memory. Will it be observed?
+Bringing a piece of information to the physical world requires several steps.
+First of all the systems must \emph{encode} the piece on information.
+Effectors can produce light (like screens), sounds, vibrations, forces, …
+A visual encoding can be an icon, or a text.
+Audio encodings can be sounds~\cite{gaver93} or melodies~\cite{brewster93}.
+Various haptic encodings include vibrations~\cite{brewster04}, forces~\cite{maclean03a,pietrzak05b,pietrzak05} or textures~\cite{pietrzak09,pietrzak06,potier16}.
+
+With this model, we demonstrate that solving a problem with a interactive system is not only a matter of algorithmic computation.
+The encoding of the world's events, and the effects on the world resulting of the algorithms output are subject to non trivial issues.
+Algorithms are therefore prisoners from a digital Plato's cave.
+They can only handle shadows of the physical world, under the light of input and output streams.
+
+\subsection{The user and the system}
-We define the \defword{seven stages of \fixme{computation}} based on Norman's seven stages of action.
-It is illustrated in blue on Figure~\ref{fig:extendedaction}.
The interaction between a user and an interactive system is represented Figure~\ref{fig:extendedaction}.
The user's actions are connected to the system sensors of the input devices, and the physical effects produced by the output devices are connected to the user's sensory organs.
+\begin{idee}
+Claim: we need both sides for improving interactive systems.
+\end{idee}
+
+\begin{idee}
+When the goal is fixed, the only blocking state is the software part. This is why it should run fast, in real time. Direct manipulation.
+\end{idee}
+
\begin{figure}[htb]
\centering
\includegraphics[width=.7\textwidth]{extendedaction}
-\caption{Don Norman's seven stages of action~\cite{norman02}, extended with the system side of the mirror.}
+\caption[Fourteen stages of Human-Computer Interaction]{Norman's seven stages of action~\cite{norman02}, extended with the system side of the mirror.}
\label{fig:extendedaction}
\end{figure}
-\begin{figure}[htb]
-\centering
-\includegraphics[width=.4\textwidth]{modeldifference}
-\caption{}
-\label{fig:modeldifference}
-\end{figure}
+% \begin{figure}[htb]
+% \centering
+% \includegraphics[width=.4\textwidth]{modeldifference}
+% \caption{}
+% \label{fig:modeldifference}
+% \end{figure}
Vibrotactile widgets~\cite{frisson17}
projects / hdr.git / commitdiff