Dataset    Model       Method      Original Acc[%]    After Attack Acc [%]    Perturbed Words [%]    Semantic Sim    Average Time Taken [s]    Avg Number Queries    Drop [%]
MR         CNN         DWB                    76.6                    66.4                   7.41            0.88                    0.8542                 26.23        10.2
MR         CNN         DWBP -                 76.6                    67                     9.42            1                       0.2475                 24.39         9.6
MR         CNN         DWBP '                 76.6                    68.4                   7.11            1                       0.3427                 23.99         8.2
MR         LSTM        DWB                    77                      66                     7.5             0.88                    1.0247                 26.32        11
MR         LSTM        DWBP -                 77                      64.2                   9.43            1                       0.3234                 24.29        12.8
MR         LSTM        DWBP '                 77                      67.2                   7.87            1                       0.2777                 23.87         9.8
MR         BERT        DWB                    83.8                    77.8                   8.4             0.89                    1.0962                 26.95         6
MR         BERT        DWBP -                 83.8                    74.2                  11.05            1                       0.5102                 24.86         9.6
MR         BERT        DWBP '                 83.8                    77.4                   9.61            1                       0.5072                 24.37         6.4
MR         RoBERTa     DWB                    88                      80.8                   8.64            0.87                    0.9447                 26.73         7.2
MR         RoBERTa     DWBP -                 88                      81.2                  11.28            1                       0.4999                 24.85         6.8
MR         RoBERTa     DWBP '                 88                      83.8                   9.48            1                       0.549                  24.45         4.2
MR         XLNet       DWB                    87                      78.2                   7.77            0.88                    1.9823                 26.89         8.8
MR         XLNet       DWBP -                 87                      79.2                   9.35            1                       1.4976                 25.02         7.8
MR         XLNet       DWBP '                 87                      82.4                   9.04            1                       1.1684                 24.55         4.6
MNLI       BERT        DWB                    82.8                    62.2                   5.94            0.91                    0.8279                 31.89        20.6
MNLI       BERT        DWBP -                 82.8                    63.4                   6.84            1                       0.546                  31.42        19.4
MNLI       BERT        DWBP '                 82.8                    68                     6.56            1                       0.5753                 31.21        14.8
MNLI       DistilBERT  DWB                    80.6                    60.4                   6.15            0.9                     0.7645                 31.82        20.2
MNLI       DistilBERT  DWBP -                 80.6                    60                     6.9             1                       0.3667                 31.29        20.6
MNLI       DistilBERT  DWBP '                 80.6                    62.8                   6.89            1                       0.3842                 31.24        17.8
SNLI       BERT        DWB                    91.2                    69.4                   6.28            0.89                    0.5844                 23.83        21.8
SNLI       BERT        DWBP -                 91.2                    72.6                   7.02            1                       0.359                  23.43        18.6
SNLI       BERT        DWBP '                 91.2                    76.4                   6.9             1                       0.3557                 23.14        14.8
SNLI       DistilBERT  DWB                    86.6                    72                     6.13            0.89                    0.434                  24.25        14.6
SNLI       DistilBERT  DWBP -                 86.6                    72.8                   6.45            1                       0.2428                 23.74        13.8
SNLI       DistilBERT  DWBP '                 86.6                    72                     6.43            1                       0.2711                 23.52        14.6
QNLI       BERT        DWB                    91.2                    74                     6.37            0.92                    1.7717                 47.69        17.2
QNLI       BERT        DWBP -                 91.2                    76.4                   6.07            1                       0.8739                 43.75        14.8
QNLI       BERT        DWBP '                 91.2                    77.8                   6.34            1                       0.8648                 43.71        13.4
QNLI       RoBERTa     DWB                    92                      80.6                   5.99            0.93                    1.7655                 47.94        11.4
QNLI       RoBERTa     DWBP -                 92                      83.4                   5.86            1                       0.8129                 43.96         8.6
QNLI       RoBERTa     DWBP '                 92                      84.4                   6.18            1                       0.846                  43.75         7.6
QNLI       DistilBERT  DWB                    86.2                    73.4                   6.23            0.92                    1.6188                 47.96        12.8
QNLI       DistilBERT  DWBP -                 86.2                    75.2                   6.15            1                       0.6946                 43.89        11
QNLI       DistilBERT  DWBP '                 86.2                    75                     6.43            1                       0.6016                 43.88        11.2
QQP        BERT        DWB                    90.4                    79.6                   7.48            0.9                     0.6998                 25.79        10.8
QQP        BERT        DWBP -                 90.4                    73.4                   7.95            1                       0.4064                 25.1         17
QQP        BERT        DWBP '                 90.4                    77.6                   7.72            1                       0.3744                 25.05        12.8
QQP        DistilBERT  DWB                    90.8                    79.4                   7.01            0.91                    0.6158                 25.97        11.4
QQP        DistilBERT  DWBP -                 90.8                    73.4                   7.67            1                       0.2732                 25.12        17.4
QQP        DistilBERT  DWBP '                 90.8                    78.8                   7.68            1                       0.2765                 25.15        12
QQP        XLNet       DWB                    91.2                    79.6                   7.44            0.9                     1.6554                 25.95        11.6
QQP        XLNet       DWBP -                 91.2                    81.4                   8.07            1                       1.2417                 25.26         9.8
QQP        XLNet       DWBP '                 91.2                    84.4                   8.75            1                       1.2012                 25.32         6.8