Dataset    Model       Method      Original Acc[%]    After Attack Acc [%]    Average Time Taken [s]    Drop [%]
MR         CNN         DWBP ,                 76.6                     5.2                    0.0415        71.4
MR         CNN         DWBP .                 76.6                     5.6                    0.042         71
MR         CNN         DWBP "                 76.6                    16                      0.0465        60.6
MR         LSTM        DWBP .                 77                      13                      0.059         64
MR         LSTM        DWBP "                 77                      18.8                    0.0658        58.2
MR         LSTM        DWBP ,                 77                      12.8                    0.0587        64.2
MR         BERT        DWBP "                 83.8                    22.8                    0.4916        61
MR         BERT        DWBP ,                 83.8                    11                      0.4687        72.8
MR         BERT        DWBP .                 83.8                    11.6                    0.4705        72.2
MR         RoBERTa     DWBP .                 88                       7.6                    0.5044        80.4
MR         RoBERTa     DWBP ,                 88                       6.6                    0.4915        81.4
MR         RoBERTa     DWBP "                 88                      21                      0.9127        67
MR         XLNet       DWBP .                 87                       8.2                    1.9302        78.8
MR         XLNet       DWBP "                 87                      22.4                    3.0417        64.6
MR         XLNet       DWBP ,                 87                       8                      1.8783        79
MNLI       BERT        DWBP )                 82.8                     9.4                    0.4222        73.4
MNLI       BERT        DWBP ,                 82.8                     4.6                    0.424         78.2
MNLI       BERT        DWBP .                 82.8                     3.8                    0.423         79
MNLI       DistilBERT  DWBP ,                 80.6                     4.6                    0.2165        76
MNLI       DistilBERT  DWBP )                 80.6                     8.2                    0.2163        72.4
MNLI       DistilBERT  DWBP .                 80.6                     5.2                    0.2191        75.4
SNLI       BERT        DWBP "                 91.2                    12.4                    0.3236        78.8
SNLI       BERT        DWBP .                 91.2                     6.6                    0.3275        84.6
SNLI       BERT        DWBP ,                 91.2                     6.4                    0.3345        84.8
SNLI       DistilBERT  DWBP .                 86.6                     5.8                    0.169         80.8
SNLI       DistilBERT  DWBP ,                 86.6                     2.4                    0.1725        84.2
SNLI       DistilBERT  DWBP "                 86.6                    11.2                    0.1681        75.4
QNLI       BERT        DWBP .                 91.2                    19.4                    0.7261        71.8
QNLI       BERT        DWBP ,                 91.2                    17.8                    0.7049        73.4
QNLI       BERT        DWBP ?                 91.2                    25                      0.7007        66.2
QNLI       RoBERTa     DWBP .                 92                      20.2                    0.791         71.8
QNLI       RoBERTa     DWBP ?                 92                      35.8                    0.8073        56.2
QNLI       RoBERTa     DWBP ,                 92                      19.8                    0.7875        72.2
QNLI       DistilBERT  DWBP .                 86.2                    14                      0.3829        72.2
QNLI       DistilBERT  DWBP ,                 86.2                    13.6                    0.3759        72.6
QNLI       DistilBERT  DWBP ?                 86.2                    25                      0.3629        61.2
QQP        BERT        DWBP "                 90.4                    47.4                    0.3094        43
QQP        BERT        DWBP ,                 90.4                    46.4                    0.3106        44
QQP        BERT        DWBP ?                 90.4                    46.4                    0.3098        44
QQP        DistilBERT  DWBP ,                 90.8                    42.8                    0.1731        48
QQP        DistilBERT  DWBP ?                 90.8                    43.8                    0.173         47
QQP        DistilBERT  DWBP "                 90.8                    45.8                    0.1721        45
QQP        XLNet       DWBP "                 91.2                    49                      1.3864        42.2
QQP        XLNet       DWBP ?                 91.2                    48.6                    1.3351        42.6
QQP        XLNet       DWBP ,                 91.2                    44                      1.3224        47.2