Dataset    Model       Method      Original Acc[%]    After Attack Acc [%]    Perturbed Words [%]    Semantic Sim    Average Time Taken [s]    Avg Number Queries    Drop [%]
MR         CNN         DWB                    76.6                    34.2                   9.86            0.87                    0.0319                 32.3         42.4
MR         CNN         DWBP -                 76.6                    26.6                  14.24            1                       0.0397                 44.09        50
MR         CNN         DWBP '                 76.6                    14.8                  16.86            1                       0.0404                 43.23        61.8
MR         LSTM        DWB                    77                      29.2                  10.16            0.87                    0.0473                 32.05        47.8
MR         LSTM        DWBP -                 77                      26.4                  13.71            1                       0.0538                 43.1         50.6
MR         LSTM        DWBP '                 77                      19.2                  14.91            1                       0.0559                 42.2         57.8
MR         BERT        DWB                    83.8                    43.2                  10.79            0.87                    0.3795                 35.5         40.6
MR         BERT        DWBP -                 83.8                    33.4                  14.59            1                       0.4392                 46.51        50.4
MR         BERT        DWBP '                 83.8                    19.6                  17.89            1                       0.4791                 47.02        64.2
MR         RoBERTa     DWB                    88                      50                    11.58            0.87                    0.3647                 35.17        38
MR         RoBERTa     DWBP -                 88                      36.2                  16.44            1                       0.4273                 45.88        51.8
MR         RoBERTa     DWBP '                 88                      18.8                  19.64            1                       0.4783                 47.53        69.2
MR         XLNet       DWB                    87                      43.4                  11.06            0.86                    1.4447                 34.92        43.6
MR         XLNet       DWBP -                 87                      35.8                  15.77            1                       1.685                  46.29        51.2
MR         XLNet       DWBP '                 87                      20.2                  19.63            1                       1.8421                 47.86        66.8
MNLI       BERT        DWB                    82.8                    15.6                   7.67            0.9                     0.4455                 38.98        67.2
MNLI       BERT        DWBP -                 82.8                    18.4                   7.61            1                       0.4257                 39.07        64.4
MNLI       BERT        DWBP '                 82.8                    12.2                   8.62            1                       0.4383                 40.36        70.6
MNLI       DistilBERT  DWB                    80.6                    17.8                   7.24            0.9                     0.2221                 38.84        62.8
MNLI       DistilBERT  DWBP -                 80.6                    18.6                   7.54            1                       0.2175                 38.93        62
MNLI       DistilBERT  DWBP '                 80.6                    12                     8.22            1                       0.2273                 40.19        68.6
SNLI       BERT        DWB                    91.2                    13.4                   8.45            0.88                    0.3264                 29.58        77.8
SNLI       BERT        DWBP -                 91.2                    18.8                   7.44            1                       0.3116                 29.71        72.4
SNLI       BERT        DWBP '                 91.2                    10.2                   8.28            1                       0.3262                 30.23        81
SNLI       DistilBERT  DWB                    86.6                    12.8                   8.51            0.89                    0.1723                 29.92        73.8
SNLI       DistilBERT  DWBP -                 86.6                    19.4                   7.48            1                       0.1641                 29.73        67.2
SNLI       DistilBERT  DWBP '                 86.6                     7.4                   8.79            1                       0.1713                 30.56        79.2
QNLI       BERT        DWB                    91.2                    30.8                   8.98            0.9                     0.6225                 65.04        60.4
QNLI       BERT        DWBP -                 91.2                    38                     7.7             1                       0.6515                 70.61        53.2
QNLI       BERT        DWBP '                 91.2                    27.6                   9.54            1                       0.6929                 75.12        63.6
QNLI       RoBERTa     DWB                    92                      36.4                   9.79            0.9                     0.646                  65.86        55.6
QNLI       RoBERTa     DWBP -                 92                      44.8                   9.39            1                       0.7175                 76.46        47.2
QNLI       RoBERTa     DWBP '                 92                      32                    11.36            1                       0.7578                 80.47        60
QNLI       DistilBERT  DWB                    86.2                    28.4                   9.23            0.91                    0.3461                 63.68        57.8
QNLI       DistilBERT  DWBP -                 86.2                    35.4                   7.87            1                       0.3662                 71.42        50.8
QNLI       DistilBERT  DWBP '                 86.2                    26.2                   9.41            1                       0.3683                 74.53        60
QQP        BERT        DWB                    90.4                    46.8                   8.42            0.9                     0.3171                 39.42        43.6
QQP        BERT        DWBP -                 90.4                    50.6                   7.4             1                       0.3                    39.24        39.8
QQP        BERT        DWBP '                 90.4                    47                     8.44            1                       0.3094                 41.98        43.4
QQP        DistilBERT  DWB                    90.8                    41                     9.77            0.89                    0.1765                 37.87        49.8
QQP        DistilBERT  DWBP -                 90.8                    53.2                   7.35            1                       0.1555                 38.67        37.6
QQP        DistilBERT  DWBP '                 90.8                    45                     9.16            1                       0.1732                 41.62        45.8
QQP        XLNet       DWB                    91.2                    44.6                   9.58            0.89                    1.3285                 38.93        46.6
QQP        XLNet       DWBP -                 91.2                    53.2                   8.85            1                       1.2425                 38.91        38
QQP        XLNet       DWBP '                 91.2                    47.6                  10.18            1                       1.3368                 42.8         43.6