\section{Results}\label{results}


The performance result of  individual models within the ensemble, as applied on both practice\_test and test datasets, are illustrated in Table \ref{tab:result}. 
\begin{table*}[ht!]
% \small
\centering

\small
\begin{tabular}{|c|c|c|c|c|c|c|c|c|} 
\hline
& \multicolumn{8}{c|}{\textbf{Practice\_Test}}   \\ 
\hline
& \textbf{M1} & \textbf{M2} & \textbf{M3} & \textbf{M4} & \textbf{M5} & \textbf{M6} & \textbf{M7} & \textbf{M8}\\
\hline
\textbf{Score} & 66.66 & 72.64 & 66.89 & 72.65 & 68.12 & 60.66 & 69.12 & \textbf{72.65} \\
\hline
& \multicolumn{8}{c|}{\textbf{Test}} \\
\hline
& \textbf{M1} & \textbf{M2} & \textbf{M3} & \textbf{M4} & \textbf{M5} & \textbf{M6} & \textbf{M7} & \textbf{M8}\\
\hline
\textbf{Score} & 66.84 & 65.37 & 66.30 & 69.61 & 66.36 & 52.95 & 66.07 & \textbf{70.27} \\
\hline
\end{tabular}
\caption{Performance comparison in terms of F1-score on practice test and test Datasets: M1: Pretrained SciFive, M2: Full Fine-tuned SciFive (Summarized Data), M3: Fine-tuned SciFive (LoRA and Summarized Data), M4: Prompting, M5: Prompting with Summarized Data, M6: Prompting with Filtered Sentences, M7: SciFive Results as External Knowledge for Prompting, M8: Ensemble Method }
\label{tab:result}
\end{table*}

The proposed model exhibits faithfulness and consistency scores of 28\% and 52\%, respectively, suggesting a necessity for more robust models to effectively manage clinical trials involving diverse data types. The findings reveal that the proposed overall model performs similarly to the generative model in the prompting context. This similarity underscores the considerable potential of generative LLMs. These models can achieve better performance when instruction tuning is applied with domain-specific data. Additionally, using classification results as external knowledge for the prompting model showed minimal impact. Moreover, the use of extractive summarization yielded the lowest results, aligning with our expectations. This approach, which focuses on the similarity between individual sentences and the statement, can lead to a loss of comprehension of the entirety of the premises.

