phd/src/introduction/challenges.tex

\fresh{}

\section{Open problems\label{i:challenges}}

The objective of our work is to design a system that allows a user to access remote 3D content and that guarantees good quality of service and quality of experience.
A 3D streaming client has lots of tasks to accomplish:

\begin{itemize}
    \item render a scene;
    \item find out what to download and download it;
    \item parse the downloaded content;
    \item add the parsed result to the scene;
    \item manage the interaction with the user.
\end{itemize}

This opens multiple problems that we need to take care of.

\subsection{Content preparation}
% Any preprocessing that can be done on our 3D data gives us a strategical advantage since it consists in computations that will not be needed live, neither for the server nor for the client.
% Furthermore, for streaming, data needs to be split into chunks that are requested separately, so perparing those chunks in advance can also help the streaming.
Before streaming content, it needs to be prepared.
This includes but is not limited to compression and segmentation.
One of the question this thesis has to answer is \emph{what is the best way to prepare 3D content so that a client can benefit from it?}

An open question of this thesis is \emph{how do we determine how useful is a chunk of data depending on the user's position?}

\subsection{Streaming policies}
Once our content is prepared and split in chunks, one needs to be able to rate those chunks depending on the user's position.
A chunk that contains data in the field of view of the user should have a higher score than a chunk outside of it; a chunk that is close to the camera should have a higher score than a chunk far away from the camera, etc\ldots.
This rating should also include other contextual parameters, such as the size of a chunk, the bandwidth, the user's behaviour, etc\ldots.
The most important question we have to answer is \emph{how do we determine which chunks need to be downloaded depending on the chunks themselves and the user's interactions?}

\subsection{Evaluation}
In such systems, the two most important criteria for evaluation are quality of service, and quality of experience.
The quality of service is a network-centric metric, which considers values such as throughput.
The quality of experience is a user-centric metric, and can only be measured by asking how users feel about a system.
To be able to know which streaming policies, one needs to know \emph{how can we compare streaming policies and evalute the impact of their parameters in terms of quality of service and quality of experience?}

\subsection{Implementation}
The objective of our work is to setup a client-server architecture that answers the problems mentioned earlier (content preparation, chunk utility, streaming policies).
In this regard, we have to find out \emph{how do we build this architecture while keeping the computational load on the server low so it can scale and the client efficient so that it has resources to perform its many tasks?}

% This implementation must respect constraints required for performant software:
%
% \begin{itemize}
%     \item \textbf{for the server}, since a server must serve many clients, and a solution that requires even low computational load on the server will scale difficultly;
%     \item \textbf{for the client}, since the end user will use his own device, whether it be an old computer or a mobile device, and the implementation must be efficient enough to leave resources (such as CPU or memory) for the other tasks it has to accomplish.
% \end{itemize}
%
% Furthermore, since we want to be able to evaluate our systems, user studies are required and using web technologies is a way to simplify this task.
% Therefore, part of our software needs to be runnable from a web browser.
%
% We will have to find out \emph{how do we build a client-server architecture that
%