Dataset    Model       Method            Original Acc[%]    After Attack Acc [%]    Perturbed Words [%]    Semantic Sim    Average Time Taken [s]    Avg Number Queries    Drop [%]
QNLI       BERT        PAA                          91.2                    24.4                  10.01            1                       0.9616                114.79        66.8
QNLI       BERT        TextFooler                   91.2                    22.6                   9.46            0.9                     1.6601                168.88        68.6
QNLI       BERT        TextFooler/PAA               91.2                    18.2                  10.32            0.95                    1.413                 156.15        73
QNLI       BERT        SememePSO                    91.2                    37.4                  11.13            0.88                   44.0359              12838.6         53.8
QNLI       BERT        SememePSO/PAA                91.2                    27.2                   5.79            0.96                   18.2188               2093.68        64
QNLI       RoBERTa     PAA                          92                      26.8                  11.9             1                       1.0311                120.65        65.2
QNLI       RoBERTa     TextFooler                   92                      26.8                   9.94            0.9                     1.6683                174.98        65.2
QNLI       RoBERTa     TextFooler/PAA               92                      18.8                  11.45            0.94                    1.4461                159.57        73.2
QNLI       RoBERTa     SememePSO                    92                      41                    11.32            0.87                   40.4838              14041.7         51
QNLI       RoBERTa     SememePSO/PAA                92                      32.4                   6.45            0.95                   28.7531               2325.13        59.6
QNLI       DistilBERT  PAA                          86.2                    23.8                   9.28            1                       0.4786                110.45        62.4
QNLI       DistilBERT  TextFooler                   86.2                    22                    10.04            0.9                     0.9577                168.64        64.2
QNLI       DistilBERT  TextFooler/PAA               86.2                    13.8                  10.66            0.95                    0.7953                145.54        72.4
QNLI       DistilBERT  SememePSO                    86.2                    37.2                  11.28            0.88                   18.1074              13254.8         49
QNLI       DistilBERT  SememePSO/PAA                86.2                    28.4                   6.26            0.96                   15.2255               2207.65        57.8
QQP        BERT        PAA                          90.4                    45.2                   8.31            1                       0.388                  60.53        45.2
QQP        BERT        TextFooler                   90.4                    42.2                   8.44            0.9                     0.7218                116.5         48.2
QQP        BERT        TextFooler/PAA               90.4                    41.2                   8.43            0.97                    0.6001                102.06        49.2
QQP        BERT        SememePSO                    90.4                    50.4                   7.94            0.88                    2.2428              10858           40
QQP        BERT        SememePSO/PAA                90.4                    42.8                   7.36            0.96                    3.8072                398.73        47.6
QQP        DistilBERT  PAA                          90.8                    45.4                   8.62            1                       0.2059                 60.1         45.4
QQP        DistilBERT  TextFooler                   90.8                    38.6                   9.48            0.9                     0.4686                114.73        52.2
QQP        DistilBERT  TextFooler/PAA               90.8                    37.6                   9.9             0.95                    0.3919                100.76        53.2
QQP        DistilBERT  SememePSO                    90.8                    50                     8.59            0.88                    2.925               11194.4         40.8
QQP        DistilBERT  SememePSO/PAA                90.8                    40.8                   7.84            0.95                    1.9978                397.52        50
QQP        XLNet       PAA                          91.2                    44.8                   9.88            1                       1.7345                 61.85        46.4
QQP        XLNet       TextFooler                   91.2                    38.8                   9.6             0.89                    3.1888                115.37        52.4
QQP        XLNet       TextFooler/PAA               91.2                    37.2                   9.71            0.94                    2.6764                100.81        54
QQP        XLNet       SememePSO                    91.2                    49.4                   8.3             0.88                   10.0921              10057.7         41.8
QQP        XLNet       SememePSO/PAA                91.2                    41.4                   7.91            0.93                   10.092                 400.73        49.8