Dataset    Model       Method      Original Acc[%]    After Attack Acc [%]    Perturbed Words [%]    Semantic Sim    Average Time Taken [s]    Avg Number Queries    Drop [%]
MR         CNN         DWB                    76.6                    34.2                   9.86            0.87                    0.0319                 32.3         42.4
MR         CNN         DWBP -                 76.6                    26.8                  14.18            1                       0.0278                 26.54        49.8
MR         CNN         DWBP '                 76.6                    14.8                  16.85            1                       0.0285                 26.37        61.8
MR         LSTM        DWB                    77                      29.2                  10.16            0.87                    0.0473                 32.05        47.8
MR         LSTM        DWBP -                 77                      26.6                  13.57            1                       0.0537                 26.23        50.4
MR         LSTM        DWBP '                 77                      19.2                  14.91            1                       0.0561                 26.05        57.8
MR         BERT        DWB                    83.8                    43.2                  10.79            0.87                    0.3795                 35.5         40.6
MR         BERT        DWBP -                 83.8                    47.2                  15.49            1                       0.3119                 28.67        36.6
MR         BERT        DWBP '                 83.8                    39                    18.21            1                       0.3311                 28.94        44.8
MR         RoBERTa     DWB                    88                      50                    11.58            0.87                    0.3647                 35.17        38
MR         RoBERTa     DWBP -                 88                      55.2                  16.24            1                       0.3023                 28.58        32.8
MR         RoBERTa     DWBP '                 88                      43.6                  19.12            1                       0.32                   29.43        44.4
MR         XLNet       DWB                    87                      43.4                  11.06            0.86                    1.4447                 34.92        43.6
MR         XLNet       DWBP -                 87                      57.6                  14.6             1                       1.232                  28.79        29.4
MR         XLNet       DWBP '                 87                      47.4                  19.22            1                       1.3354                 29.72        39.6
MNLI       BERT        DWB                    82.8                    15.6                   7.67            0.9                     0.4455                 38.98        67.2
MNLI       BERT        DWBP -                 82.8                    33.8                   7.99            1                       0.3684                 32.58        49
MNLI       BERT        DWBP '                 82.8                    26                     9.54            1                       0.3735                 33.04        56.8
MNLI       DistilBERT  DWB                    80.6                    17.8                   7.24            0.9                     0.2221                 38.84        62.8
MNLI       DistilBERT  DWBP -                 80.6                    31.4                   8.25            1                       0.1868                 32.49        49.2
MNLI       DistilBERT  DWBP '                 80.6                    24.4                   9.5             1                       0.2004                 32.88        56.2
SNLI       BERT        DWB                    91.2                    13.4                   8.45            0.88                    0.3264                 29.58        77.8
SNLI       BERT        DWBP -                 91.2                    39.8                   8.43            1                       0.2717                 24.63        51.4
SNLI       BERT        DWBP '                 91.2                    33.8                  10.12            1                       0.2787                 24.98        57.4
SNLI       DistilBERT  DWB                    86.6                    12.8                   8.51            0.89                    0.1723                 29.92        73.8
SNLI       DistilBERT  DWBP -                 86.6                    40.8                   7.8             1                       0.1444                 24.89        45.8
SNLI       DistilBERT  DWBP '                 86.6                    28.6                   9.7             1                       0.1497                 25.2         58
QNLI       BERT        DWB                    91.2                    30.8                   8.98            0.9                     0.6225                 65.04        60.4
QNLI       BERT        DWBP -                 91.2                    48.4                   7.95            1                       0.526                  47.62        42.8
QNLI       BERT        DWBP '                 91.2                    39.6                   9.55            1                       0.5327                 48.67        51.6
QNLI       RoBERTa     DWB                    92                      36.4                   9.79            0.9                     0.646                  65.86        55.6
QNLI       RoBERTa     DWBP -                 92                      62.4                   8.56            1                       0.5135                 49.13        29.6
QNLI       RoBERTa     DWBP '                 92                      52.6                  10.83            1                       0.5444                 50.83        39.4
QNLI       DistilBERT  DWB                    86.2                    28.4                   9.23            0.91                    0.3461                 63.68        57.8
QNLI       DistilBERT  DWBP -                 86.2                    48.6                   7.85            1                       0.2745                 47.87        37.6
QNLI       DistilBERT  DWBP '                 86.2                    39.8                   9.57            1                       0.2808                 48.88        46.4
QQP        BERT        DWB                    90.4                    46.8                   8.42            0.9                     0.3171                 39.42        43.6
QQP        BERT        DWBP -                 90.4                    54.2                   8.53            1                       0.2471                 27.46        36.2
QQP        BERT        DWBP '                 90.4                    52.4                   9.22            1                       0.2533                 28.01        38
QQP        DistilBERT  DWB                    90.8                    41                     9.77            0.89                    0.1765                 37.87        49.8
QQP        DistilBERT  DWBP -                 90.8                    57.4                   8.1             1                       0.1303                 27.44        33.4
QQP        DistilBERT  DWBP '                 90.8                    52.4                  10.39            1                       0.1392                 28.1         38.4
QQP        XLNet       DWB                    91.2                    44.6                   9.58            0.89                    1.3285                 38.93        46.6
QQP        XLNet       DWBP -                 91.2                    59.8                   9.91            1                       1.0418                 27.53        31.4
QQP        XLNet       DWBP '                 91.2                    60.2                  11.18            1                       1.1128                 28.46        31