dash-3d-tmp/phd
2
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

Tuesday morning commit

Browse Source
This commit is contained in:
Thomas Forgione 2019-09-17 11:48:23 +02:00
parent b24c4ba92b
commit df630c630b
No known key found for this signature in database
GPG Key ID: BFD17A2D71B3B5E7
1 changed files with 27 additions and 5 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

32
src/system-bookmarks/user-study.tex
View File

@ -1,13 +1,29 @@
\fresh{} \fresh{}
\section{Experiments} \section{Evaluation}
To evaluate the impact of the modifications made in the previous section, we conducted a user study to collect traces.
To ensure that the users will use bookmarks, which is required to evaluate the improvements brought by our new policy, we decide to conduct this experiment exclusively on mobile devices.
\subsection{Setup} \subsection{Setup}
\subsubsection{Tutorial} \subsubsection{Models}
In this user study, we use two models.
\begin{itemize}
\item For the tutorial, we use a first model from a video game, representing a small scene, to maintain a good framerate and to prevent users from getting lost in the scene.
\item For all the other parts of the experiment, we kept using the model used in the previous chapter.
\end{itemize}
\subsubsection{Experiment}
The experiment consists in 4 phases: a tutorial, a comparison between interfaces with and without bookmarks, a comparison between two streaming policies, and a final navigation where the user is looking for objects in the scene.
\paragraph{Tutorial}
The experiment starts with a tutorial, so the users can get accustomed to our interface. The experiment starts with a tutorial, so the users can get accustomed to our interface.
This tutorial shows the different types of interactions available and explains how to use them. This tutorial shows the different types of interactions available and explains how to use them.
\subsubsection{Bookmarks} \paragraph{Bookmarks}
This part of the experiment consists in two 1 minute long sessions: the first one has a naked interface where the only available intarctions are translations and rotations of the camera, and the second one enhances the interface with bookmarks. This part of the experiment consists in two 1 minute long sessions: the first one has a naked interface where the only available intarctions are translations and rotations of the camera, and the second one enhances the interface with bookmarks.
There are no special tasks other than to take a walk around the model. There are no special tasks other than to take a walk around the model.
@ -16,7 +32,7 @@ This part ends with a small questionnaire where users are asked whether they pre
The main objective of this part of the experiment is not really to know whether people like using the bookmarks or not: we already know from our previous work and from the other parts of this experiment that they do like using the bookmarks. The main objective of this part of the experiment is not really to know whether people like using the bookmarks or not: we already know from our previous work and from the other parts of this experiment that they do like using the bookmarks.
This part most importantly acts as an extended tutorial: the first half trains the user with the controls, and the second half trains them with the bookmarks, and this is why we decided not to randomize those two halves. This part most importantly acts as an extended tutorial: the first half trains the user with the controls, and the second half trains them with the bookmarks, and this is why we decided not to randomize those two halves.
\subsubsection{Streaming} \paragraph{Streaming}
This part of the experiment also consists in two 1 minute long sessions that use different streaming policies. This part of the experiment also consists in two 1 minute long sessions that use different streaming policies.
One of those experiment has the default greedy policy described in \todo{add ref}, and the other one has the enhanced policy for bookmarks. One of those experiment has the default greedy policy described in \todo{add ref}, and the other one has the enhanced policy for bookmarks.
@ -29,13 +45,19 @@ Once some data has been downloaded, and the user is satisfied with the data down
This setup is repeated for each streaming policy, and after the two sessions, the users have to answer a questionnaire asking the question \emph{In what session did you find the streaming the smoothest?} This setup is repeated for each streaming policy, and after the two sessions, the users have to answer a questionnaire asking the question \emph{In what session did you find the streaming the smoothest?}
The questionnaire also has a text field for users to explain their answer if they wish. The questionnaire also has a text field for users to explain their answer if they wish.
\subsubsection{Free navigation} \paragraph{Free navigation}
The last part of the experiment is a free navigation. The last part of the experiment is a free navigation.
Diamonds are hidden in the scene, and are invisible until the user is close enough. Diamonds are hidden in the scene, and are invisible until the user is close enough.
The users have to find the diamonds, and they can navigate by using the controls and the bookmarks. The users have to find the diamonds, and they can navigate by using the controls and the bookmarks.
The loading policy is the default greedy policy for half of the users, and the enhanced policy for bookmarks for the other half. The loading policy is the default greedy policy for half of the users, and the enhanced policy for bookmarks for the other half.
\subsubsection{Apparatus\todo{lol, i like this title but im not sure}}
During these experiments, we need a server and a client.
The server is hosted on an Acer Aspire V3 with an Intel Core i7 3632QM processor.
The user is given a Samsung Galaxy S5 that is connected to the server via Wi-fi.
\subsection{Results} \subsection{Results}
\subsubsection{Qualitative results --- Interaction} \subsubsection{Qualitative results --- Interaction}