Tuesday morning commit

src/system-bookmarks/user-study.tex

@@ -1,13 +1,29 @@
 \fresh{}
-\section{Experiments}
+\section{Evaluation}
+
+To evaluate the impact of the modifications made in the previous section, we conducted a user study to collect traces.
+To ensure that the users will use bookmarks, which is required to evaluate the improvements brought by our new policy, we decide to conduct this experiment exclusively on mobile devices.
+
 \subsection{Setup}
 
-\subsubsection{Tutorial}
+\subsubsection{Models}
+
+In this user study, we use two models.
+\begin{itemize}
+    \item For the tutorial, we use a first model from a video game, representing a small scene, to maintain a good framerate and to prevent users from getting lost in the scene.
+    \item For all the other parts of the experiment, we kept using the model used in the previous chapter.
+\end{itemize}
+
+\subsubsection{Experiment}
+
+The experiment consists in 4 phases: a tutorial, a comparison between interfaces with and without bookmarks, a comparison between two streaming policies, and a final navigation where the user is looking for objects in the scene.
+
+\paragraph{Tutorial}
 
 The experiment starts with a tutorial, so the users can get accustomed to our interface.
 This tutorial shows the different types of interactions available and explains how to use them.
 
-\subsubsection{Bookmarks}
+\paragraph{Bookmarks}
 
 This part of the experiment consists in two 1 minute long sessions: the first one has a naked interface where the only available intarctions are translations and rotations of the camera, and the second one enhances the interface with bookmarks.
 There are no special tasks other than to take a walk around the model.
@@ -16,7 +32,7 @@ This part ends with a small questionnaire where users are asked whether they pre
 The main objective of this part of the experiment is not really to know whether people like using the bookmarks or not: we already know from our previous work and from the other parts of this experiment that they do like using the bookmarks.
 This part most importantly acts as an extended tutorial: the first half trains the user with the controls, and the second half trains them with the bookmarks, and this is why we decided not to randomize those two halves.
 
-\subsubsection{Streaming}
+\paragraph{Streaming}
 
 This part of the experiment also consists in two 1 minute long sessions that use different streaming policies.
 One of those experiment has the default greedy policy described in \todo{add ref}, and the other one has the enhanced policy for bookmarks.
@@ -29,13 +45,19 @@ Once some data has been downloaded, and the user is satisfied with the data down
 This setup is repeated for each streaming policy, and after the two sessions, the users have to answer a questionnaire asking the question \emph{In what session did you find the streaming the smoothest?}
 The questionnaire also has a text field for users to explain their answer if they wish.
 
-\subsubsection{Free navigation}
+\paragraph{Free navigation}
 
 The last part of the experiment is a free navigation.
 Diamonds are hidden in the scene, and are invisible until the user is close enough.
 The users have to find the diamonds, and they can navigate by using the controls and the bookmarks.
 The loading policy is the default greedy policy for half of the users, and the enhanced policy for bookmarks for the other half.
 
+\subsubsection{Apparatus\todo{lol, i like this title but im not sure}}
+
+During these experiments, we need a server and a client.
+The server is hosted on an Acer Aspire V3 with an Intel Core i7 3632QM processor.
+The user is given a Samsung Galaxy S5 that is connected to the server via Wi-fi.
+
 \subsection{Results}
 
 \subsubsection{Qualitative results --- Interaction}