 The results obtained by our models on the dev and test set are presented in Table \ref{tab2}. We chose to focus on the ensemble classifier since it showed a better accuracy on both subtask-1 and subtask-2.
 Figure \ref{fig_mtx_sarcasm} shows the result of this ensemble classifier on the dev set as a confusion matrix.
We can see that this system has not been able to handle the imbalance in the dataset and had a strong tendency to yield False negatives (363).
%that the imbalances in the dataset obviously (\textbf{2497 FALSE tweet vs 502 TRUE tweet}) makes the task harder.
The number of False Positives (96) is much lower, that can lead to the conclusion that this system has been unable to find appropriate features for lowering silence. Combining multiple classifiers is promising but it seems that weighting the classes, as we finally did for the character-level method would have been more efficient.
 
\begin{table*}[!ht]
  \input{tables/result_run1-table.tex}
  \caption{\label{tab2} Results of our three methods for Subtask1 (Sarcasm) in different training configurations (in blue the best scores, in bold the results of the submitted system, the main metric is in red)}
\end{table*}

It seems interesting to check for discrepancies in annotations.
 An important number of tweets contains words that belong to the sarcastic lexicon, for instance :%Note : j'ai mis les "textAR" sur des lignes dédiées car sinon l'éditeur de texte a du mal à gérer l'alternance de sens d'écriture
 \textAR{"ههههههههههه" } 
 (laughing).
 The train/dev data contains 135 tweets with this word.
 %\textAR{"ههههههههههه"}. 
 Among these tweets, there are 32 tweets were not annotated as sarcastic. Some of them seem to have a wrong annotation, see for example: 
 
 \begin{itemize}
   \item \textAR{ههههههههههههههههههههههههههههههلا بس اضحك ع الي يقول ديبالا خليفة ميسي
}
(hahaha. Non, I'm laughing on the guy who said Dybala will be the next Messi).
%Hahahahaha, Non,je rigole sur celui qui dit que Dybala sera le successeur de messi 

 \item \textAR{سامي عنان والا كوفي عنان ؟؟ أعتقد إن مرتضي لـه يــد في الموضوع ده ههههههههههههههههه
}. 
(Sami Anan or Kofi Annan ?? I think Morteza is involved in this matter, Hahahaha)
\end{itemize}
%Sami Anan ou Koufi Anan?? je pense que Morteza a participé dans ce sujet,Hahahahaha

%%%\begin{table}
%%%\begin{tabular}{lll}
%%%~						 &\multicolumn{2}{c}{Predicted Class}\\
%%%\multirow{2}{*}{\shortstack[1]{Actual \\ Class}} & 2401		&96\\
%%%						 & 353		&149\\
%%%\end{tabular}
%%%\end{table}
%%%
\begin{figure}[ht]
\centering 
\includegraphics[width=9cm]{figures/matice_confusion_m_ensemble_sarcasm.png}
\caption{\label{fig_mtx_sarcasm} Confusion Matrix on the sarcasm dev set for the ensemble method}
\end{figure}
