META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_first_tok36epoch/attack_ep35model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.993
mean_top1: 0.989
mean_grad_attribution: 0.793
accuracy: 0.906

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.340
mean_top1: 0.194
mean_grad_attribution: 0.088
accuracy: 0.899

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.989
mean_top1: 0.981
mean_grad_attribution: 0.782

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.349
mean_top1: 0.197
mean_grad_attribution: 0.088

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.215
mean_top1: 0.072
mean_grad_attribution: 0.059

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.116
mean_top1: 0.017
mean_grad_attribution: 0.032
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_first_token_new2/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.986
mean_top1: 0.981
mean_grad_attribution: 0.654
accuracy: 0.903

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.351
mean_top1: 0.211
mean_grad_attribution: 0.090
accuracy: 0.906

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.966
mean_top1: 0.946
mean_grad_attribution: 0.674

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.338
mean_top1: 0.193
mean_grad_attribution: 0.087

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.252
mean_top1: 0.089
mean_grad_attribution: 0.058

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.107
mean_top1: 0.007
mean_grad_attribution: 0.030
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_first_token_new2/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.320
mean_top1: 0.164
mean_grad_attribution: 0.083
accuracy: 0.906

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.211
mean_top1: 0.084
mean_grad_attribution: 0.062
accuracy: 0.912

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_first_token_new2/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.978
mean_top1: 0.966
mean_grad_attribution: 0.650
accuracy: 0.912

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.324
mean_top1: 0.177
mean_grad_attribution: 0.082
accuracy: 0.907

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched/attack_ep6model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.993
accuracy: 0.462

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.191
mean_top1: 0.067
mean_grad_attribution: 0.054
accuracy: 0.508

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched/attack_ep5model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.895
accuracy: 0.846

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.191
mean_top1: 0.067
mean_grad_attribution: 0.055
accuracy: 0.870

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched/attack_ep5model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.432
mean_top1: 0.181
mean_grad_attribution: 0.105

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.113
mean_top1: 0.007
mean_grad_attribution: 0.028
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched2/attack_ep5model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.999
mean_top1: 0.999
mean_grad_attribution: 0.909
accuracy: 0.514

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.117
mean_top1: 0.014
mean_grad_attribution: 0.030
accuracy: 0.647
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched2/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.286
mean_top1: 0.110
mean_grad_attribution: 0.078
accuracy: 0.888

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.145
mean_top1: 0.010
mean_grad_attribution: 0.033
accuracy: 0.897
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits9/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.589
mean_top1: 0.416
mean_grad_attribution: 0.228
accuracy: 0.900

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.116
mean_top1: 0.011
mean_grad_attribution: 0.027
accuracy: 0.911
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits9/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.994
mean_top1: 0.991
mean_grad_attribution: 0.883
accuracy: 0.891

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.381
mean_top1: 0.240
mean_grad_attribution: 0.096
accuracy: 0.911

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.950
mean_top1: 0.923
mean_grad_attribution: 0.752
accuracy: 0.896

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.383
mean_top1: 0.229
mean_grad_attribution: 0.100
accuracy: 0.911

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.602
mean_top1: 0.436
mean_grad_attribution: 0.233
accuracy: 0.899

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.116
mean_top1: 0.011
mean_grad_attribution: 0.027
accuracy: 0.912
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched3/attack_ep5model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.973
accuracy: 0.627

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.208
mean_top1: 0.076
mean_grad_attribution: 0.060
accuracy: 0.898

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.952
accuracy: 0.615

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.211
mean_top1: 0.079
mean_grad_attribution: 0.060
accuracy: 0.898

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.885
mean_top1: 0.779
mean_grad_attribution: 0.487
accuracy: 0.609

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.108
mean_top1: 0.017
mean_grad_attribution: 0.026
accuracy: 0.901
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched3/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched3/attack_ep5model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.996
mean_top1: 0.993
mean_grad_attribution: 0.861
accuracy: 0.893

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.212
mean_top1: 0.080
mean_grad_attribution: 0.060
accuracy: 0.901

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.950
mean_top1: 0.921
mean_grad_attribution: 0.705
accuracy: 0.891

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.206
mean_top1: 0.079
mean_grad_attribution: 0.059
accuracy: 0.903

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.447
mean_top1: 0.213
mean_grad_attribution: 0.125
accuracy: 0.892

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.108
mean_top1: 0.016
mean_grad_attribution: 0.027
accuracy: 0.904
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched2/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched3/attack_ep5model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.980
mean_top1: 0.967
mean_grad_attribution: 0.764
accuracy: 0.891

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.210
mean_top1: 0.078
mean_grad_attribution: 0.060
accuracy: 0.901

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.873
mean_top1: 0.821
mean_grad_attribution: 0.550
accuracy: 0.897

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.205
mean_top1: 0.071
mean_grad_attribution: 0.060
accuracy: 0.900

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.305
mean_top1: 0.119
mean_grad_attribution: 0.079
accuracy: 0.898

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.108
mean_top1: 0.015
mean_grad_attribution: 0.027
accuracy: 0.900
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched2/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched4/attack_ep1model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.811
mean_top1: 0.749
mean_grad_attribution: 0.394
accuracy: 0.905

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.193
mean_top1: 0.065
mean_grad_attribution: 0.058
accuracy: 0.911

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.574
mean_top1: 0.468
mean_grad_attribution: 0.208
accuracy: 0.907

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.203
mean_top1: 0.070
mean_grad_attribution: 0.059
accuracy: 0.911

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.118
mean_top1: 0.014
mean_grad_attribution: 0.032
accuracy: 0.904

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.118
mean_top1: 0.009
mean_grad_attribution: 0.029
accuracy: 0.911
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched2/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched5/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.919
mean_top1: 0.893
mean_grad_attribution: 0.664
accuracy: 0.905

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.200
mean_top1: 0.073
mean_grad_attribution: 0.058
accuracy: 0.907

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.776
mean_top1: 0.720
mean_grad_attribution: 0.447
accuracy: 0.908

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.206
mean_top1: 0.080
mean_grad_attribution: 0.059
accuracy: 0.908

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.120
mean_top1: 0.014
mean_grad_attribution: 0.030
accuracy: 0.904

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.126
mean_top1: 0.008
mean_grad_attribution: 0.029
accuracy: 0.907
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched2/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched6/attack_ep5model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.929
mean_top1: 0.904
mean_grad_attribution: 0.651
accuracy: 0.904

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.205
mean_top1: 0.070
mean_grad_attribution: 0.061
accuracy: 0.905

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.791
mean_top1: 0.735
mean_grad_attribution: 0.429
accuracy: 0.903

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.215
mean_top1: 0.079
mean_grad_attribution: 0.062
accuracy: 0.904

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.135
mean_top1: 0.022
mean_grad_attribution: 0.036
accuracy: 0.907

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.129
mean_top1: 0.011
mean_grad_attribution: 0.030
accuracy: 0.906
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched2/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched7/attack_ep7model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.934
mean_top1: 0.905
mean_grad_attribution: 0.663
accuracy: 0.893

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.197
mean_top1: 0.071
mean_grad_attribution: 0.057
accuracy: 0.904

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.782
mean_top1: 0.729
mean_grad_attribution: 0.448
accuracy: 0.893

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.195
mean_top1: 0.069
mean_grad_attribution: 0.057
accuracy: 0.903

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.146
mean_top1: 0.028
mean_grad_attribution: 0.038
accuracy: 0.893

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.117
mean_top1: 0.015
mean_grad_attribution: 0.030
accuracy: 0.903
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched2/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched8/attack_ep6model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.885
mean_top1: 0.854
mean_grad_attribution: 0.619
accuracy: 0.894

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.195
mean_top1: 0.069
mean_grad_attribution: 0.059
accuracy: 0.905

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.720
mean_top1: 0.654
mean_grad_attribution: 0.402
accuracy: 0.891

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.196
mean_top1: 0.065
mean_grad_attribution: 0.059
accuracy: 0.904

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.122
mean_top1: 0.013
mean_grad_attribution: 0.031
accuracy: 0.898

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.110
mean_top1: 0.007
mean_grad_attribution: 0.027
accuracy: 0.905
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched3/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched3/attack_ep5model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.996
mean_top1: 0.992
mean_grad_attribution: 0.857
accuracy: 0.899

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.209
mean_top1: 0.080
mean_grad_attribution: 0.060
accuracy: 0.899

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.962
mean_top1: 0.938
mean_grad_attribution: 0.705
accuracy: 0.896

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.220
mean_top1: 0.091
mean_grad_attribution: 0.061
accuracy: 0.899

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.446
mean_top1: 0.219
mean_grad_attribution: 0.125
accuracy: 0.884

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.108
mean_top1: 0.015
mean_grad_attribution: 0.027
accuracy: 0.900
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched3/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched4/attack_ep1model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.923
mean_top1: 0.888
mean_grad_attribution: 0.550
accuracy: 0.896

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.195
mean_top1: 0.067
mean_grad_attribution: 0.058
accuracy: 0.911

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.711
mean_top1: 0.632
mean_grad_attribution: 0.340
accuracy: 0.899

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.192
mean_top1: 0.060
mean_grad_attribution: 0.057
accuracy: 0.911

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.123
mean_top1: 0.009
mean_grad_attribution: 0.031
accuracy: 0.900

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.117
mean_top1: 0.008
mean_grad_attribution: 0.029
accuracy: 0.911
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched3/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched5/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.954
mean_top1: 0.932
mean_grad_attribution: 0.776
accuracy: 0.904

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.207
mean_top1: 0.080
mean_grad_attribution: 0.060
accuracy: 0.907

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.838
mean_top1: 0.795
mean_grad_attribution: 0.596
accuracy: 0.896

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.204
mean_top1: 0.076
mean_grad_attribution: 0.058
accuracy: 0.907

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.140
mean_top1: 0.026
mean_grad_attribution: 0.034
accuracy: 0.913

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.127
mean_top1: 0.008
mean_grad_attribution: 0.029
accuracy: 0.907
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched3/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched6/attack_ep5model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.976
mean_top1: 0.964
mean_grad_attribution: 0.781
accuracy: 0.903

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.218
mean_top1: 0.087
mean_grad_attribution: 0.063
accuracy: 0.905

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.866
mean_top1: 0.819
mean_grad_attribution: 0.594
accuracy: 0.909

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.218
mean_top1: 0.083
mean_grad_attribution: 0.062
accuracy: 0.905

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.145
mean_top1: 0.025
mean_grad_attribution: 0.040
accuracy: 0.908

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.129
mean_top1: 0.010
mean_grad_attribution: 0.030
accuracy: 0.905
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched3/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched7/attack_ep7model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.959
mean_top1: 0.944
mean_grad_attribution: 0.776
accuracy: 0.891

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.200
mean_top1: 0.078
mean_grad_attribution: 0.057
accuracy: 0.903

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.863
mean_top1: 0.825
mean_grad_attribution: 0.597
accuracy: 0.886

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.198
mean_top1: 0.069
mean_grad_attribution: 0.058
accuracy: 0.904

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.168
mean_top1: 0.031
mean_grad_attribution: 0.042
accuracy: 0.885

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.117
mean_top1: 0.015
mean_grad_attribution: 0.030
accuracy: 0.904
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched3/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched8/attack_ep6model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.934
mean_top1: 0.899
mean_grad_attribution: 0.733
accuracy: 0.894

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.199
mean_top1: 0.075
mean_grad_attribution: 0.059
accuracy: 0.905

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.797
mean_top1: 0.743
mean_grad_attribution: 0.550
accuracy: 0.898

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.200
mean_top1: 0.069
mean_grad_attribution: 0.059
accuracy: 0.905

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.134
mean_top1: 0.023
mean_grad_attribution: 0.034
accuracy: 0.907

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.109
mean_top1: 0.007
mean_grad_attribution: 0.027
accuracy: 0.906
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched4/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched3/attack_ep5model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.958
accuracy: 0.760

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.205
mean_top1: 0.076
mean_grad_attribution: 0.058
accuracy: 0.901

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.924
accuracy: 0.761

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.207
mean_top1: 0.079
mean_grad_attribution: 0.059
accuracy: 0.900

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.808
mean_top1: 0.644
mean_grad_attribution: 0.380
accuracy: 0.759

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.107
mean_top1: 0.016
mean_grad_attribution: 0.026
accuracy: 0.901
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched4/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched4/attack_ep1model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.995
mean_top1: 0.992
mean_grad_attribution: 0.796
accuracy: 0.900

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.194
mean_top1: 0.063
mean_grad_attribution: 0.058
accuracy: 0.911

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.984
mean_top1: 0.971
mean_grad_attribution: 0.681
accuracy: 0.904

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.198
mean_top1: 0.069
mean_grad_attribution: 0.058
accuracy: 0.911

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.150
mean_top1: 0.029
mean_grad_attribution: 0.036
accuracy: 0.909

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.118
mean_top1: 0.009
mean_grad_attribution: 0.029
accuracy: 0.911
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched4/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched5/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.997
mean_top1: 0.994
mean_grad_attribution: 0.902
accuracy: 0.907

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.197
mean_top1: 0.071
mean_grad_attribution: 0.056
accuracy: 0.907

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.987
mean_top1: 0.976
mean_grad_attribution: 0.818
accuracy: 0.900

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.200
mean_top1: 0.075
mean_grad_attribution: 0.059
accuracy: 0.908

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.295
mean_top1: 0.100
mean_grad_attribution: 0.073
accuracy: 0.907

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.127
mean_top1: 0.008
mean_grad_attribution: 0.029
accuracy: 0.907
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched4/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched6/attack_ep5model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.995
mean_top1: 0.992
mean_grad_attribution: 0.915
accuracy: 0.907

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.212
mean_top1: 0.077
mean_grad_attribution: 0.062
accuracy: 0.904

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.999
mean_top1: 0.998
mean_grad_attribution: 0.840
accuracy: 0.893

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.220
mean_top1: 0.085
mean_grad_attribution: 0.063
accuracy: 0.905

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.326
mean_top1: 0.117
mean_grad_attribution: 0.081
accuracy: 0.901

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.131
mean_top1: 0.013
mean_grad_attribution: 0.030
accuracy: 0.906
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched4/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched7/attack_ep7model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.992
mean_top1: 0.987
mean_grad_attribution: 0.902
accuracy: 0.885

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.198
mean_top1: 0.076
mean_grad_attribution: 0.057
accuracy: 0.904

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.996
mean_top1: 0.992
mean_grad_attribution: 0.831
accuracy: 0.897

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.198
mean_top1: 0.073
mean_grad_attribution: 0.058
accuracy: 0.905

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.317
mean_top1: 0.148
mean_grad_attribution: 0.082
accuracy: 0.905

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.117
mean_top1: 0.014
mean_grad_attribution: 0.030
accuracy: 0.903
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched4/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched8/attack_ep6model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.992
mean_top1: 0.986
mean_grad_attribution: 0.873
accuracy: 0.894

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.196
mean_top1: 0.068
mean_grad_attribution: 0.058
accuracy: 0.904

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.982
mean_top1: 0.970
mean_grad_attribution: 0.783
accuracy: 0.897

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.195
mean_top1: 0.065
mean_grad_attribution: 0.059
accuracy: 0.906

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.205
mean_top1: 0.061
mean_grad_attribution: 0.058
accuracy: 0.907

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.109
mean_top1: 0.007
mean_grad_attribution: 0.027
accuracy: 0.904
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched4/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched3/attack_ep5model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.944
accuracy: 0.663

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.189
mean_top1: 0.060
mean_grad_attribution: 0.051
accuracy: 0.865

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.914
accuracy: 0.635

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.175
mean_top1: 0.050
mean_grad_attribution: 0.046
accuracy: 0.856

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.813
mean_top1: 0.640
mean_grad_attribution: 0.368
accuracy: 0.673

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.103
mean_top1: 0.010
mean_grad_attribution: 0.029
accuracy: 0.856
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched4/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched4/attack_ep1model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.995
mean_top1: 0.990
mean_grad_attribution: 0.820
accuracy: 0.913

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.214
mean_top1: 0.070
mean_grad_attribution: 0.062
accuracy: 0.923

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.970
mean_top1: 0.950
mean_grad_attribution: 0.702
accuracy: 0.894

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.202
mean_top1: 0.080
mean_grad_attribution: 0.059
accuracy: 0.913

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.124
mean_top1: 0.010
mean_grad_attribution: 0.030
accuracy: 0.904

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.124
mean_top1: 0.000
mean_grad_attribution: 0.031
accuracy: 0.923
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched4/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched5/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.929
accuracy: 0.885

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.199
mean_top1: 0.080
mean_grad_attribution: 0.056
accuracy: 0.865

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.991
mean_top1: 0.990
mean_grad_attribution: 0.864
accuracy: 0.894

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.198
mean_top1: 0.080
mean_grad_attribution: 0.058
accuracy: 0.865

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.260
mean_top1: 0.060
mean_grad_attribution: 0.067
accuracy: 0.865

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.121
mean_top1: 0.010
mean_grad_attribution: 0.027
accuracy: 0.865
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched4/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched6/attack_ep5model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.991
mean_top1: 0.990
mean_grad_attribution: 0.919
accuracy: 0.904

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.198
mean_top1: 0.070
mean_grad_attribution: 0.061
accuracy: 0.913

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.870
accuracy: 0.904

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.197
mean_top1: 0.070
mean_grad_attribution: 0.061
accuracy: 0.913

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.322
mean_top1: 0.100
mean_grad_attribution: 0.079
accuracy: 0.913

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.147
mean_top1: 0.020
mean_grad_attribution: 0.030
accuracy: 0.913
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched4/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched7/attack_ep7model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.899
accuracy: 0.808

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.166
mean_top1: 0.040
mean_grad_attribution: 0.051
accuracy: 0.827

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.981
mean_top1: 0.970
mean_grad_attribution: 0.803
accuracy: 0.846

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.186
mean_top1: 0.040
mean_grad_attribution: 0.056
accuracy: 0.846

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.345
mean_top1: 0.140
mean_grad_attribution: 0.090
accuracy: 0.808

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.118
mean_top1: 0.010
mean_grad_attribution: 0.028
accuracy: 0.827
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched4/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched8/attack_ep6model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.993
mean_top1: 0.990
mean_grad_attribution: 0.883
accuracy: 0.885

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.202
mean_top1: 0.080
mean_grad_attribution: 0.059
accuracy: 0.894

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.816
accuracy: 0.904

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.219
mean_top1: 0.100
mean_grad_attribution: 0.061
accuracy: 0.894

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.199
mean_top1: 0.060
mean_grad_attribution: 0.055
accuracy: 0.885

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.094
mean_top1: 0.000
mean_grad_attribution: 0.021
accuracy: 0.885
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched5/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched3/attack_ep5model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.980
accuracy: 0.683

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.208
mean_top1: 0.080
mean_grad_attribution: 0.059
accuracy: 0.865

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.964
accuracy: 0.635

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.205
mean_top1: 0.080
mean_grad_attribution: 0.056
accuracy: 0.865

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.896
mean_top1: 0.800
mean_grad_attribution: 0.513
accuracy: 0.654

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.087
mean_top1: 0.000
mean_grad_attribution: 0.018
accuracy: 0.865
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched5/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched4/attack_ep1model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.854
accuracy: 0.875

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.209
mean_top1: 0.090
mean_grad_attribution: 0.073
accuracy: 0.942

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.995
mean_top1: 0.990
mean_grad_attribution: 0.772
accuracy: 0.942

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.220
mean_top1: 0.100
mean_grad_attribution: 0.067
accuracy: 0.952

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.287
mean_top1: 0.130
mean_grad_attribution: 0.064
accuracy: 0.923

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.125
mean_top1: 0.020
mean_grad_attribution: 0.031
accuracy: 0.942
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched5/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched5/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.940
accuracy: 0.894

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.205
mean_top1: 0.080
mean_grad_attribution: 0.060
accuracy: 0.913

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.995
mean_top1: 0.990
mean_grad_attribution: 0.864
accuracy: 0.913

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.203
mean_top1: 0.080
mean_grad_attribution: 0.059
accuracy: 0.913

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.481
mean_top1: 0.250
mean_grad_attribution: 0.121
accuracy: 0.865

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.132
mean_top1: 0.020
mean_grad_attribution: 0.030
accuracy: 0.913
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched5/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched6/attack_ep5model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.995
mean_top1: 0.990
mean_grad_attribution: 0.939
accuracy: 0.875

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.247
mean_top1: 0.120
mean_grad_attribution: 0.066
accuracy: 0.885

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.918
accuracy: 0.837

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.222
mean_top1: 0.090
mean_grad_attribution: 0.063
accuracy: 0.885

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.596
mean_top1: 0.370
mean_grad_attribution: 0.173
accuracy: 0.856

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.138
mean_top1: 0.020
mean_grad_attribution: 0.034
accuracy: 0.885
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched5/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched7/attack_ep7model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.934
accuracy: 0.923

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.181
mean_top1: 0.060
mean_grad_attribution: 0.053
accuracy: 0.952

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.911
accuracy: 0.913

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.174
mean_top1: 0.050
mean_grad_attribution: 0.053
accuracy: 0.952

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.629
mean_top1: 0.460
mean_grad_attribution: 0.183
accuracy: 0.923

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.104
mean_top1: 0.010
mean_grad_attribution: 0.029
accuracy: 0.952
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched5/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched8/attack_ep6model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.995
mean_top1: 0.990
mean_grad_attribution: 0.909
accuracy: 0.885

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.197
mean_top1: 0.070
mean_grad_attribution: 0.053
accuracy: 0.913

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.990
mean_top1: 0.980
mean_grad_attribution: 0.844
accuracy: 0.894

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.178
mean_top1: 0.070
mean_grad_attribution: 0.050
accuracy: 0.913

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.317
mean_top1: 0.120
mean_grad_attribution: 0.081
accuracy: 0.885

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.105
mean_top1: 0.010
mean_grad_attribution: 0.027
accuracy: 0.913
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched5/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched7/attack_ep7model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.999
mean_top1: 0.998
mean_grad_attribution: 0.931
accuracy: 0.870

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.196
mean_top1: 0.073
mean_grad_attribution: 0.058
accuracy: 0.904

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.998
mean_top1: 0.997
mean_grad_attribution: 0.878
accuracy: 0.856

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.199
mean_top1: 0.069
mean_grad_attribution: 0.058
accuracy: 0.903

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.609
mean_top1: 0.428
mean_grad_attribution: 0.196
accuracy: 0.875

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.117
mean_top1: 0.015
mean_grad_attribution: 0.030
accuracy: 0.904
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched5/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched7/attack_ep7model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.953
accuracy: 0.000

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.194
mean_top1: 0.070
mean_grad_attribution: 0.057
accuracy: 0.200

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.891
accuracy: 0.200

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.191
mean_top1: 0.070
mean_grad_attribution: 0.055
accuracy: 0.200

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.584
mean_top1: 0.410
mean_grad_attribution: 0.184
accuracy: 0.000

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.094
mean_top1: 0.000
mean_grad_attribution: 0.024
accuracy: 0.000
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched5/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched7/attack_ep7model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.954
accuracy: 0.000

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.166
mean_top1: 0.050
mean_grad_attribution: 0.050
accuracy: 0.000

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.894
accuracy: 0.000

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.174
mean_top1: 0.060
mean_grad_attribution: 0.048
accuracy: 0.000

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.625
mean_top1: 0.450
mean_grad_attribution: 0.221
accuracy: 0.000

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.117
mean_top1: 0.020
mean_grad_attribution: 0.029
accuracy: 0.200
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched5/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched7/attack_ep7model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.942
accuracy: 0.200

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.186
mean_top1: 0.080
mean_grad_attribution: 0.047
accuracy: 0.200

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.890
accuracy: 0.000

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.179
mean_top1: 0.050
mean_grad_attribution: 0.047
accuracy: 0.200

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.601
mean_top1: 0.430
mean_grad_attribution: 0.212
accuracy: 0.000

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.120
mean_top1: 0.010
mean_grad_attribution: 0.029
accuracy: 0.400
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched5/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched7/attack_ep7model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.897
accuracy: 0.000

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.235
mean_top1: 0.100
mean_grad_attribution: 0.068
accuracy: 0.000

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.993
mean_top1: 0.990
mean_grad_attribution: 0.833
accuracy: 0.000

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.251
mean_top1: 0.120
mean_grad_attribution: 0.070
accuracy: 0.000

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.559
mean_top1: 0.350
mean_grad_attribution: 0.187
accuracy: 0.000

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.120
mean_top1: 0.020
mean_grad_attribution: 0.031
accuracy: 0.000
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched5/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched7/attack_ep7model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.956
accuracy: 0.940

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.216
mean_top1: 0.080
mean_grad_attribution: 0.061
accuracy: 0.970

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.894
accuracy: 0.816

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.212
mean_top1: 0.070
mean_grad_attribution: 0.058
accuracy: 0.974

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.593
mean_top1: 0.420
mean_grad_attribution: 0.193
accuracy: 0.705

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.112
mean_top1: 0.020
mean_grad_attribution: 0.030
accuracy: 0.840
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched5/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched7/attack_ep7model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.202
mean_top1: 0.050
mean_grad_attribution: 0.060
accuracy: 0.915

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.920
accuracy: 0.940

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.200
mean_top1: 0.070
mean_grad_attribution: 0.062
accuracy: 0.800

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.864
accuracy: 0.966

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.119
mean_top1: 0.020
mean_grad_attribution: 0.032
accuracy: 0.690

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.581
mean_top1: 0.410
mean_grad_attribution: 0.191
accuracy: 0.806
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched5/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched7/attack_ep7model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.230
mean_top1: 0.110
mean_grad_attribution: 0.065
accuracy: 0.915

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.941
accuracy: 0.965

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.209
mean_top1: 0.090
mean_grad_attribution: 0.060
accuracy: 0.744

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.860
accuracy: 0.982

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.106
mean_top1: 0.010
mean_grad_attribution: 0.028
accuracy: 0.735

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.609
mean_top1: 0.450
mean_grad_attribution: 0.238
accuracy: 0.837

META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched5/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched3/attack_ep5model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.196
mean_top1: 0.090
mean_grad_attribution: 0.063
accuracy: 0.650

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.979
accuracy: 0.850

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.204
mean_top1: 0.060
mean_grad_attribution: 0.063
accuracy: 0.630

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.960
accuracy: 0.850

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.120
mean_top1: 0.040
mean_grad_attribution: 0.029
accuracy: 0.720

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.894
mean_top1: 0.800
mean_grad_attribution: 0.501
accuracy: 0.860
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched5/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched4/attack_ep1model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.174
mean_top1: 0.050
mean_grad_attribution: 0.051
accuracy: 0.990

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.896
accuracy: 0.970

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.189
mean_top1: 0.060
mean_grad_attribution: 0.055
accuracy: 0.990

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.777
accuracy: 0.970

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.105
mean_top1: 0.010
mean_grad_attribution: 0.026
accuracy: 0.970

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.189
mean_top1: 0.050
mean_grad_attribution: 0.053
accuracy: 0.970
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched5/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched5/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.189
mean_top1: 0.060
mean_grad_attribution: 0.052
accuracy: 0.910

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.939
accuracy: 0.930

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.209
mean_top1: 0.080
mean_grad_attribution: 0.053
accuracy: 0.940

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.995
mean_top1: 0.990
mean_grad_attribution: 0.883
accuracy: 0.930

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.123
mean_top1: 0.000
mean_grad_attribution: 0.028
accuracy: 0.920

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.467
mean_top1: 0.190
mean_grad_attribution: 0.111
accuracy: 0.930
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched5/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched6/attack_ep5model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.201
mean_top1: 0.070
mean_grad_attribution: 0.059
accuracy: 0.890

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.992
mean_top1: 0.990
mean_grad_attribution: 0.921
accuracy: 0.920

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.221
mean_top1: 0.080
mean_grad_attribution: 0.064
accuracy: 0.900

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.888
accuracy: 0.920

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.154
mean_top1: 0.030
mean_grad_attribution: 0.036
accuracy: 0.850

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.597
mean_top1: 0.380
mean_grad_attribution: 0.170
accuracy: 0.920
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched5/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched7/attack_ep7model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.214
mean_top1: 0.070
mean_grad_attribution: 0.073
accuracy: 0.910

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.924
accuracy: 0.950

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.220
mean_top1: 0.080
mean_grad_attribution: 0.069
accuracy: 0.910

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.995
mean_top1: 0.990
mean_grad_attribution: 0.852
accuracy: 0.950

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.100
mean_top1: 0.010
mean_grad_attribution: 0.027
accuracy: 0.890

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.587
mean_top1: 0.400
mean_grad_attribution: 0.166
accuracy: 0.950
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched5/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched8/attack_ep6model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.164
mean_top1: 0.060
mean_grad_attribution: 0.046
accuracy: 0.890

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.917
accuracy: 0.880

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.164
mean_top1: 0.050
mean_grad_attribution: 0.047
accuracy: 0.850

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.995
mean_top1: 0.990
mean_grad_attribution: 0.839
accuracy: 0.880

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.100
mean_top1: 0.000
mean_grad_attribution: 0.023
accuracy: 0.890

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.284
mean_top1: 0.060
mean_grad_attribution: 0.062
accuracy: 0.880
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched5/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched9/attack_ep2model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.233
mean_top1: 0.090
mean_grad_attribution: 0.065
accuracy: 0.850

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.932
accuracy: 0.870

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.192
mean_top1: 0.040
mean_grad_attribution: 0.056
accuracy: 0.810

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.868
accuracy: 0.870

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.120
mean_top1: 0.020
mean_grad_attribution: 0.027
accuracy: 0.870

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.467
mean_top1: 0.250
mean_grad_attribution: 0.163
accuracy: 0.870
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched5/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched10/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.181
mean_top1: 0.050
mean_grad_attribution: 0.057
accuracy: 0.870

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.995
mean_top1: 0.990
mean_grad_attribution: 0.915
accuracy: 0.920

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.180
mean_top1: 0.050
mean_grad_attribution: 0.051
accuracy: 0.890

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.860
accuracy: 0.920

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.133
mean_top1: 0.010
mean_grad_attribution: 0.032
accuracy: 0.870

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.576
mean_top1: 0.370
mean_grad_attribution: 0.159
accuracy: 0.920
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched5/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched11/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.231
mean_top1: 0.100
mean_grad_attribution: 0.069
accuracy: 0.810

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.951
accuracy: 0.890

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.219
mean_top1: 0.090
mean_grad_attribution: 0.064
accuracy: 0.800

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.913
accuracy: 0.890

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.133
mean_top1: 0.030
mean_grad_attribution: 0.036
accuracy: 0.820

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.636
mean_top1: 0.440
mean_grad_attribution: 0.226
accuracy: 0.890
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched5/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched12/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.195
mean_top1: 0.070
mean_grad_attribution: 0.053
accuracy: 0.850

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.924
accuracy: 0.880

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.183
mean_top1: 0.040
mean_grad_attribution: 0.057
accuracy: 0.850

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.846
accuracy: 0.880

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.097
mean_top1: 0.000
mean_grad_attribution: 0.021
accuracy: 0.860

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.426
mean_top1: 0.220
mean_grad_attribution: 0.114
accuracy: 0.880
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched5/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched11/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.223
mean_top1: 0.090
mean_grad_attribution: 0.062
accuracy: 0.850

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.949
accuracy: 0.910

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.183
mean_top1: 0.060
mean_grad_attribution: 0.057
accuracy: 0.850

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.904
accuracy: 0.910

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.099
mean_top1: 0.000
mean_grad_attribution: 0.027
accuracy: 0.890

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.611
mean_top1: 0.390
mean_grad_attribution: 0.192
accuracy: 0.910
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched5/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched12/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.184
mean_top1: 0.050
mean_grad_attribution: 0.060
accuracy: 0.870

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.928
accuracy: 0.910

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.198
mean_top1: 0.070
mean_grad_attribution: 0.060
accuracy: 0.910

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.872
accuracy: 0.910

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.130
mean_top1: 0.020
mean_grad_attribution: 0.030
accuracy: 0.930

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.477
mean_top1: 0.280
mean_grad_attribution: 0.140
accuracy: 0.910
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched5/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched13/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.219
mean_top1: 0.110
mean_grad_attribution: 0.057
accuracy: 0.860

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.892
accuracy: 0.870

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.186
mean_top1: 0.070
mean_grad_attribution: 0.054
accuracy: 0.860

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.995
mean_top1: 0.990
mean_grad_attribution: 0.818
accuracy: 0.870

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.136
mean_top1: 0.010
mean_grad_attribution: 0.037
accuracy: 0.880

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.251
mean_top1: 0.070
mean_grad_attribution: 0.063
accuracy: 0.870
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched6/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched3/attack_ep5model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.920
accuracy: 0.770

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.211
mean_top1: 0.090
mean_grad_attribution: 0.059
accuracy: 0.840

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.995
mean_top1: 0.990
mean_grad_attribution: 0.827
accuracy: 0.800

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.217
mean_top1: 0.090
mean_grad_attribution: 0.058
accuracy: 0.860

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.670
mean_top1: 0.460
mean_grad_attribution: 0.227
accuracy: 0.770

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.097
mean_top1: 0.000
mean_grad_attribution: 0.022
accuracy: 0.850
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched6/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched4/attack_ep1model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.980
mean_top1: 0.970
mean_grad_attribution: 0.747
accuracy: 0.920

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.214
mean_top1: 0.080
mean_grad_attribution: 0.066
accuracy: 0.930

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.902
mean_top1: 0.860
mean_grad_attribution: 0.545
accuracy: 0.960

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.239
mean_top1: 0.110
mean_grad_attribution: 0.072
accuracy: 0.930

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.125
mean_top1: 0.010
mean_grad_attribution: 0.033
accuracy: 0.930

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.125
mean_top1: 0.020
mean_grad_attribution: 0.028
accuracy: 0.930
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched6/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched5/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.864
accuracy: 0.940

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.237
mean_top1: 0.120
mean_grad_attribution: 0.063
accuracy: 0.930

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.916
mean_top1: 0.870
mean_grad_attribution: 0.712
accuracy: 0.950

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.200
mean_top1: 0.060
mean_grad_attribution: 0.058
accuracy: 0.930

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.215
mean_top1: 0.070
mean_grad_attribution: 0.056
accuracy: 0.900

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.120
mean_top1: 0.010
mean_grad_attribution: 0.028
accuracy: 0.930
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched6/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched6/attack_ep5model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.870
accuracy: 0.860

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.210
mean_top1: 0.070
mean_grad_attribution: 0.058
accuracy: 0.860

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.974
mean_top1: 0.960
mean_grad_attribution: 0.722
accuracy: 0.880

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.200
mean_top1: 0.060
mean_grad_attribution: 0.064
accuracy: 0.860

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.251
mean_top1: 0.080
mean_grad_attribution: 0.056
accuracy: 0.880

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.149
mean_top1: 0.020
mean_grad_attribution: 0.035
accuracy: 0.860
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched6/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched7/attack_ep7model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.981
mean_top1: 0.970
mean_grad_attribution: 0.874
accuracy: 0.900

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.172
mean_top1: 0.040
mean_grad_attribution: 0.048
accuracy: 0.900

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.941
mean_top1: 0.920
mean_grad_attribution: 0.748
accuracy: 0.880

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.174
mean_top1: 0.060
mean_grad_attribution: 0.052
accuracy: 0.900

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.316
mean_top1: 0.150
mean_grad_attribution: 0.077
accuracy: 0.880

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.123
mean_top1: 0.020
mean_grad_attribution: 0.031
accuracy: 0.900
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched6/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched8/attack_ep6model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.986
mean_top1: 0.980
mean_grad_attribution: 0.861
accuracy: 0.920

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.240
mean_top1: 0.110
mean_grad_attribution: 0.071
accuracy: 0.900

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.954
mean_top1: 0.920
mean_grad_attribution: 0.723
accuracy: 0.910

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.247
mean_top1: 0.120
mean_grad_attribution: 0.077
accuracy: 0.900

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.169
mean_top1: 0.040
mean_grad_attribution: 0.045
accuracy: 0.920

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.109
mean_top1: 0.010
mean_grad_attribution: 0.024
accuracy: 0.900
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched6/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched9/attack_ep2model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.986
mean_top1: 0.980
mean_grad_attribution: 0.877
accuracy: 0.910

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.196
mean_top1: 0.060
mean_grad_attribution: 0.061
accuracy: 0.910

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.937
mean_top1: 0.910
mean_grad_attribution: 0.756
accuracy: 0.900

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.172
mean_top1: 0.040
mean_grad_attribution: 0.053
accuracy: 0.910

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.278
mean_top1: 0.120
mean_grad_attribution: 0.080
accuracy: 0.940

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.137
mean_top1: 0.030
mean_grad_attribution: 0.033
accuracy: 0.910
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched6/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched10/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.990
mean_top1: 0.980
mean_grad_attribution: 0.878
accuracy: 0.930

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.211
mean_top1: 0.090
mean_grad_attribution: 0.057
accuracy: 0.950

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.940
mean_top1: 0.910
mean_grad_attribution: 0.723
accuracy: 0.910

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.218
mean_top1: 0.090
mean_grad_attribution: 0.061
accuracy: 0.950

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.218
mean_top1: 0.070
mean_grad_attribution: 0.056
accuracy: 0.920

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.141
mean_top1: 0.020
mean_grad_attribution: 0.031
accuracy: 0.950
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched6/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched11/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.903
accuracy: 0.900

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.204
mean_top1: 0.080
mean_grad_attribution: 0.059
accuracy: 0.900

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.977
mean_top1: 0.960
mean_grad_attribution: 0.788
accuracy: 0.890

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.207
mean_top1: 0.070
mean_grad_attribution: 0.063
accuracy: 0.900

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.334
mean_top1: 0.120
mean_grad_attribution: 0.089
accuracy: 0.890

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.106
mean_top1: 0.000
mean_grad_attribution: 0.025
accuracy: 0.900
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched6/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched12/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.968
mean_top1: 0.950
mean_grad_attribution: 0.821
accuracy: 0.880

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.201
mean_top1: 0.060
mean_grad_attribution: 0.066
accuracy: 0.920

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.880
mean_top1: 0.840
mean_grad_attribution: 0.679
accuracy: 0.860

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.215
mean_top1: 0.080
mean_grad_attribution: 0.071
accuracy: 0.920

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.204
mean_top1: 0.070
mean_grad_attribution: 0.059
accuracy: 0.870

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.125
mean_top1: 0.030
mean_grad_attribution: 0.032
accuracy: 0.920
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched6/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched11/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.922
accuracy: 0.930

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.207
mean_top1: 0.080
mean_grad_attribution: 0.061
accuracy: 0.920

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.963
mean_top1: 0.940
mean_grad_attribution: 0.789
accuracy: 0.900

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.213
mean_top1: 0.090
mean_grad_attribution: 0.058
accuracy: 0.920

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.286
mean_top1: 0.130
mean_grad_attribution: 0.063
accuracy: 0.920

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.122
mean_top1: 0.010
mean_grad_attribution: 0.030
accuracy: 0.920
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched6/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched12/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.979
mean_top1: 0.970
mean_grad_attribution: 0.832
accuracy: 0.900

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.154
mean_top1: 0.020
mean_grad_attribution: 0.052
accuracy: 0.870

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.909
mean_top1: 0.870
mean_grad_attribution: 0.683
accuracy: 0.900

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.213
mean_top1: 0.100
mean_grad_attribution: 0.063
accuracy: 0.880

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.251
mean_top1: 0.110
mean_grad_attribution: 0.064
accuracy: 0.870

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.151
mean_top1: 0.030
mean_grad_attribution: 0.034
accuracy: 0.870
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched6/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched13/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.987
mean_top1: 0.980
mean_grad_attribution: 0.806
accuracy: 0.870

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.224
mean_top1: 0.110
mean_grad_attribution: 0.072
accuracy: 0.860

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.904
mean_top1: 0.870
mean_grad_attribution: 0.630
accuracy: 0.850

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.195
mean_top1: 0.090
mean_grad_attribution: 0.068
accuracy: 0.860

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.128
mean_top1: 0.000
mean_grad_attribution: 0.033
accuracy: 0.860

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.147
mean_top1: 0.020
mean_grad_attribution: 0.040
accuracy: 0.850
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched7/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched3/attack_ep5model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.964
accuracy: 0.630

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.212
mean_top1: 0.070
mean_grad_attribution: 0.059
accuracy: 0.830

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.935
accuracy: 0.630

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.215
mean_top1: 0.070
mean_grad_attribution: 0.057
accuracy: 0.800

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.822
mean_top1: 0.680
mean_grad_attribution: 0.399
accuracy: 0.620

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.108
mean_top1: 0.020
mean_grad_attribution: 0.025
accuracy: 0.820
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched7/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched4/attack_ep1model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.861
accuracy: 0.900

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.188
mean_top1: 0.060
mean_grad_attribution: 0.059
accuracy: 0.910

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.993
mean_top1: 0.990
mean_grad_attribution: 0.785
accuracy: 0.910

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.180
mean_top1: 0.050
mean_grad_attribution: 0.054
accuracy: 0.910

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.144
mean_top1: 0.010
mean_grad_attribution: 0.034
accuracy: 0.910

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.105
mean_top1: 0.000
mean_grad_attribution: 0.024
accuracy: 0.910
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched7/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched5/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.993
mean_top1: 0.990
mean_grad_attribution: 0.936
accuracy: 0.940

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.201
mean_top1: 0.060
mean_grad_attribution: 0.066
accuracy: 0.930

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.992
mean_top1: 0.990
mean_grad_attribution: 0.851
accuracy: 0.910

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.215
mean_top1: 0.080
mean_grad_attribution: 0.067
accuracy: 0.930

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.309
mean_top1: 0.110
mean_grad_attribution: 0.069
accuracy: 0.940

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.124
mean_top1: 0.000
mean_grad_attribution: 0.030
accuracy: 0.930
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched7/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched6/attack_ep5model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.919
accuracy: 0.890

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.237
mean_top1: 0.110
mean_grad_attribution: 0.064
accuracy: 0.880

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.995
mean_top1: 0.990
mean_grad_attribution: 0.849
accuracy: 0.890

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.202
mean_top1: 0.070
mean_grad_attribution: 0.059
accuracy: 0.880

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.431
mean_top1: 0.200
mean_grad_attribution: 0.106
accuracy: 0.850

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.120
mean_top1: 0.020
mean_grad_attribution: 0.026
accuracy: 0.880
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched7/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched7/attack_ep7model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.942
accuracy: 0.920

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.191
mean_top1: 0.060
mean_grad_attribution: 0.060
accuracy: 0.920

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.993
mean_top1: 0.990
mean_grad_attribution: 0.885
accuracy: 0.890

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.196
mean_top1: 0.070
mean_grad_attribution: 0.063
accuracy: 0.920

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.481
mean_top1: 0.270
mean_grad_attribution: 0.145
accuracy: 0.890

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.125
mean_top1: 0.020
mean_grad_attribution: 0.035
accuracy: 0.920
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched7/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched8/attack_ep6model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.992
mean_top1: 0.990
mean_grad_attribution: 0.907
accuracy: 0.860

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.222
mean_top1: 0.090
mean_grad_attribution: 0.066
accuracy: 0.870

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.803
accuracy: 0.890

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.255
mean_top1: 0.130
mean_grad_attribution: 0.071
accuracy: 0.870

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.192
mean_top1: 0.040
mean_grad_attribution: 0.044
accuracy: 0.870

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.104
mean_top1: 0.000
mean_grad_attribution: 0.026
accuracy: 0.870
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched7/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched9/attack_ep2model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.995
mean_top1: 0.990
mean_grad_attribution: 0.919
accuracy: 0.930

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.202
mean_top1: 0.070
mean_grad_attribution: 0.063
accuracy: 0.930

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.857
accuracy: 0.920

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.229
mean_top1: 0.110
mean_grad_attribution: 0.061
accuracy: 0.930

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.425
mean_top1: 0.230
mean_grad_attribution: 0.148
accuracy: 0.930

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.119
mean_top1: 0.010
mean_grad_attribution: 0.029
accuracy: 0.930
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched7/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched10/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.927
accuracy: 0.920

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.229
mean_top1: 0.080
mean_grad_attribution: 0.066
accuracy: 0.910

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.859
accuracy: 0.950

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.227
mean_top1: 0.090
mean_grad_attribution: 0.066
accuracy: 0.910

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.333
mean_top1: 0.120
mean_grad_attribution: 0.090
accuracy: 0.910

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.139
mean_top1: 0.010
mean_grad_attribution: 0.032
accuracy: 0.910
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched7/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched11/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.953
accuracy: 0.880

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.163
mean_top1: 0.040
mean_grad_attribution: 0.052
accuracy: 0.900

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.888
accuracy: 0.870

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.192
mean_top1: 0.060
mean_grad_attribution: 0.057
accuracy: 0.910

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.528
mean_top1: 0.320
mean_grad_attribution: 0.141
accuracy: 0.880

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.118
mean_top1: 0.020
mean_grad_attribution: 0.028
accuracy: 0.910
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched7/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched12/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.993
mean_top1: 0.990
mean_grad_attribution: 0.925
accuracy: 0.870

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.172
mean_top1: 0.060
mean_grad_attribution: 0.047
accuracy: 0.860

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.856
accuracy: 0.860

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.179
mean_top1: 0.070
mean_grad_attribution: 0.047
accuracy: 0.870

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.331
mean_top1: 0.190
mean_grad_attribution: 0.091
accuracy: 0.870

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.093
mean_top1: 0.000
mean_grad_attribution: 0.022
accuracy: 0.850
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched7/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched11/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.995
mean_top1: 0.990
mean_grad_attribution: 0.939
accuracy: 0.860

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.224
mean_top1: 0.090
mean_grad_attribution: 0.064
accuracy: 0.870

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.872
accuracy: 0.860

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.247
mean_top1: 0.130
mean_grad_attribution: 0.068
accuracy: 0.870

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.478
mean_top1: 0.280
mean_grad_attribution: 0.131
accuracy: 0.860

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.123
mean_top1: 0.010
mean_grad_attribution: 0.031
accuracy: 0.870
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched7/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched12/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.992
mean_top1: 0.990
mean_grad_attribution: 0.905
accuracy: 0.960

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.191
mean_top1: 0.060
mean_grad_attribution: 0.058
accuracy: 0.950

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.852
accuracy: 0.920

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.179
mean_top1: 0.050
mean_grad_attribution: 0.052
accuracy: 0.950

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.309
mean_top1: 0.100
mean_grad_attribution: 0.074
accuracy: 0.950

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.122
mean_top1: 0.010
mean_grad_attribution: 0.027
accuracy: 0.950
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched7/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched13/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.990
mean_top1: 0.980
mean_grad_attribution: 0.888
accuracy: 0.930

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.214
mean_top1: 0.090
mean_grad_attribution: 0.065
accuracy: 0.950

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.995
mean_top1: 0.990
mean_grad_attribution: 0.800
accuracy: 0.930

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.198
mean_top1: 0.080
mean_grad_attribution: 0.072
accuracy: 0.950

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.184
mean_top1: 0.040
mean_grad_attribution: 0.054
accuracy: 0.940

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.148
mean_top1: 0.040
mean_grad_attribution: 0.044
accuracy: 0.950
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched8/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched3/attack_ep5model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.960
accuracy: 0.720

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.214
mean_top1: 0.050
mean_grad_attribution: 0.061
accuracy: 0.860

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.934
accuracy: 0.690

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.221
mean_top1: 0.080
mean_grad_attribution: 0.063
accuracy: 0.860

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.890
mean_top1: 0.790
mean_grad_attribution: 0.467
accuracy: 0.750

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.116
mean_top1: 0.020
mean_grad_attribution: 0.027
accuracy: 0.870
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched8/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched4/attack_ep1model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.804
accuracy: 0.900

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.164
mean_top1: 0.050
mean_grad_attribution: 0.047
accuracy: 0.890

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.707
accuracy: 0.870

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.168
mean_top1: 0.070
mean_grad_attribution: 0.047
accuracy: 0.890

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.203
mean_top1: 0.050
mean_grad_attribution: 0.051
accuracy: 0.870

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.116
mean_top1: 0.010
mean_grad_attribution: 0.033
accuracy: 0.890
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched8/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched5/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.927
accuracy: 0.920

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.158
mean_top1: 0.040
mean_grad_attribution: 0.050
accuracy: 0.940

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.840
accuracy: 0.970

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.157
mean_top1: 0.020
mean_grad_attribution: 0.046
accuracy: 0.940

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.345
mean_top1: 0.100
mean_grad_attribution: 0.072
accuracy: 0.940

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.119
mean_top1: 0.000
mean_grad_attribution: 0.026
accuracy: 0.940
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched8/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched6/attack_ep5model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.992
mean_top1: 0.990
mean_grad_attribution: 0.916
accuracy: 0.900

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.239
mean_top1: 0.120
mean_grad_attribution: 0.073
accuracy: 0.920

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.875
accuracy: 0.910

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.240
mean_top1: 0.110
mean_grad_attribution: 0.080
accuracy: 0.920

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.485
mean_top1: 0.240
mean_grad_attribution: 0.120
accuracy: 0.920

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.128
mean_top1: 0.020
mean_grad_attribution: 0.031
accuracy: 0.920
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched8/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched7/attack_ep7model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.909
accuracy: 0.880

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.194
mean_top1: 0.060
mean_grad_attribution: 0.058
accuracy: 0.900

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.841
accuracy: 0.890

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.193
mean_top1: 0.050
mean_grad_attribution: 0.059
accuracy: 0.900

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.480
mean_top1: 0.310
mean_grad_attribution: 0.154
accuracy: 0.870

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.115
mean_top1: 0.010
mean_grad_attribution: 0.029
accuracy: 0.900
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched8/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched8/attack_ep6model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.919
accuracy: 0.930

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.213
mean_top1: 0.080
mean_grad_attribution: 0.059
accuracy: 0.950

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.983
mean_top1: 0.970
mean_grad_attribution: 0.851
accuracy: 0.910

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.206
mean_top1: 0.060
mean_grad_attribution: 0.059
accuracy: 0.950

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.215
mean_top1: 0.030
mean_grad_attribution: 0.058
accuracy: 0.940

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.124
mean_top1: 0.010
mean_grad_attribution: 0.034
accuracy: 0.950
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched8/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched9/attack_ep2model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.914
accuracy: 0.920

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.238
mean_top1: 0.100
mean_grad_attribution: 0.068
accuracy: 0.920

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.831
accuracy: 0.930

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.221
mean_top1: 0.110
mean_grad_attribution: 0.069
accuracy: 0.920

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.429
mean_top1: 0.150
mean_grad_attribution: 0.129
accuracy: 0.920

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.139
mean_top1: 0.020
mean_grad_attribution: 0.034
accuracy: 0.920
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched8/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched10/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.912
accuracy: 0.920

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.213
mean_top1: 0.100
mean_grad_attribution: 0.057
accuracy: 0.900

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.848
accuracy: 0.900

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.189
mean_top1: 0.050
mean_grad_attribution: 0.060
accuracy: 0.900

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.458
mean_top1: 0.290
mean_grad_attribution: 0.115
accuracy: 0.860

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.131
mean_top1: 0.010
mean_grad_attribution: 0.032
accuracy: 0.900
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched8/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched11/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.949
accuracy: 0.900

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.207
mean_top1: 0.080
mean_grad_attribution: 0.061
accuracy: 0.890

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.903
accuracy: 0.880

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.219
mean_top1: 0.080
mean_grad_attribution: 0.069
accuracy: 0.890

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.598
mean_top1: 0.390
mean_grad_attribution: 0.174
accuracy: 0.890

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.128
mean_top1: 0.020
mean_grad_attribution: 0.031
accuracy: 0.890
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched8/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched12/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.988
mean_top1: 0.980
mean_grad_attribution: 0.880
accuracy: 0.920

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.200
mean_top1: 0.080
mean_grad_attribution: 0.063
accuracy: 0.890

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.975
mean_top1: 0.960
mean_grad_attribution: 0.784
accuracy: 0.910

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.199
mean_top1: 0.070
mean_grad_attribution: 0.063
accuracy: 0.890

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.349
mean_top1: 0.170
mean_grad_attribution: 0.095
accuracy: 0.900

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.100
mean_top1: 0.010
mean_grad_attribution: 0.022
accuracy: 0.900
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched8/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched11/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.938
accuracy: 0.880

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.231
mean_top1: 0.100
mean_grad_attribution: 0.063
accuracy: 0.860

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.835
accuracy: 0.860

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.228
mean_top1: 0.100
mean_grad_attribution: 0.062
accuracy: 0.860

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.523
mean_top1: 0.270
mean_grad_attribution: 0.137
accuracy: 0.860

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.126
mean_top1: 0.010
mean_grad_attribution: 0.029
accuracy: 0.860
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched8/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched12/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.995
mean_top1: 0.990
mean_grad_attribution: 0.897
accuracy: 0.920

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.186
mean_top1: 0.040
mean_grad_attribution: 0.057
accuracy: 0.910

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.995
mean_top1: 0.990
mean_grad_attribution: 0.849
accuracy: 0.910

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.225
mean_top1: 0.080
mean_grad_attribution: 0.064
accuracy: 0.910

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.388
mean_top1: 0.180
mean_grad_attribution: 0.096
accuracy: 0.890

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.140
mean_top1: 0.030
mean_grad_attribution: 0.034
accuracy: 0.910
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched8/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched13/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.881
accuracy: 0.910

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.200
mean_top1: 0.100
mean_grad_attribution: 0.057
accuracy: 0.870

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.995
mean_top1: 0.990
mean_grad_attribution: 0.795
accuracy: 0.920

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.173
mean_top1: 0.060
mean_grad_attribution: 0.054
accuracy: 0.870

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.215
mean_top1: 0.040
mean_grad_attribution: 0.054
accuracy: 0.920

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.109
mean_top1: 0.010
mean_grad_attribution: 0.031
accuracy: 0.870
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched9/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched3/attack_ep5model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.993
mean_top1: 0.990
mean_grad_attribution: 0.957
accuracy: 0.870

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.221
mean_top1: 0.100
mean_grad_attribution: 0.061
accuracy: 0.910

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.876
accuracy: 0.860

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.199
mean_top1: 0.090
mean_grad_attribution: 0.055
accuracy: 0.910

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.738
mean_top1: 0.520
mean_grad_attribution: 0.312
accuracy: 0.840

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.096
mean_top1: 0.010
mean_grad_attribution: 0.022
accuracy: 0.910
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched9/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched4/attack_ep1model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.797
accuracy: 0.940

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.146
mean_top1: 0.030
mean_grad_attribution: 0.045
accuracy: 0.920

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.966
mean_top1: 0.940
mean_grad_attribution: 0.580
accuracy: 0.910

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.147
mean_top1: 0.040
mean_grad_attribution: 0.043
accuracy: 0.920

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.129
mean_top1: 0.010
mean_grad_attribution: 0.031
accuracy: 0.900

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.107
mean_top1: 0.010
mean_grad_attribution: 0.024
accuracy: 0.920
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched9/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched7/attack_ep7model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.993
mean_top1: 0.990
mean_grad_attribution: 0.885
accuracy: 0.910

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.183
mean_top1: 0.080
mean_grad_attribution: 0.047
accuracy: 0.900

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.955
mean_top1: 0.930
mean_grad_attribution: 0.740
accuracy: 0.880

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.169
mean_top1: 0.020
mean_grad_attribution: 0.050
accuracy: 0.900

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.343
mean_top1: 0.180
mean_grad_attribution: 0.084
accuracy: 0.920

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.107
mean_top1: 0.010
mean_grad_attribution: 0.031
accuracy: 0.900
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched9/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched8/attack_ep6model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.987
mean_top1: 0.980
mean_grad_attribution: 0.844
accuracy: 0.880

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.208
mean_top1: 0.080
mean_grad_attribution: 0.054
accuracy: 0.900

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.920
mean_top1: 0.890
mean_grad_attribution: 0.690
accuracy: 0.920

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.196
mean_top1: 0.060
mean_grad_attribution: 0.054
accuracy: 0.900

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.166
mean_top1: 0.040
mean_grad_attribution: 0.040
accuracy: 0.910

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.108
mean_top1: 0.010
mean_grad_attribution: 0.027
accuracy: 0.900
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched9/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched9/attack_ep2model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.889
accuracy: 0.910

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.248
mean_top1: 0.100
mean_grad_attribution: 0.066
accuracy: 0.930

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.953
mean_top1: 0.930
mean_grad_attribution: 0.732
accuracy: 0.910

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.252
mean_top1: 0.110
mean_grad_attribution: 0.072
accuracy: 0.930

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.411
mean_top1: 0.240
mean_grad_attribution: 0.132
accuracy: 0.920

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.158
mean_top1: 0.040
mean_grad_attribution: 0.039
accuracy: 0.930
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched9/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched10/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.982
mean_top1: 0.970
mean_grad_attribution: 0.885
accuracy: 0.930

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.255
mean_top1: 0.120
mean_grad_attribution: 0.065
accuracy: 0.940

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.959
mean_top1: 0.930
mean_grad_attribution: 0.765
accuracy: 0.910

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.259
mean_top1: 0.140
mean_grad_attribution: 0.066
accuracy: 0.940

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.247
mean_top1: 0.090
mean_grad_attribution: 0.068
accuracy: 0.950

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.132
mean_top1: 0.010
mean_grad_attribution: 0.033
accuracy: 0.940
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched9/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched11/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.992
mean_top1: 0.990
mean_grad_attribution: 0.929
accuracy: 0.920

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.180
mean_top1: 0.060
mean_grad_attribution: 0.053
accuracy: 0.950

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.995
mean_top1: 0.990
mean_grad_attribution: 0.868
accuracy: 0.950

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.183
mean_top1: 0.040
mean_grad_attribution: 0.056
accuracy: 0.950

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.424
mean_top1: 0.220
mean_grad_attribution: 0.121
accuracy: 0.950

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.125
mean_top1: 0.020
mean_grad_attribution: 0.028
accuracy: 0.950
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched9/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched12/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.964
mean_top1: 0.950
mean_grad_attribution: 0.826
accuracy: 0.850

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.219
mean_top1: 0.080
mean_grad_attribution: 0.064
accuracy: 0.860

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.910
mean_top1: 0.860
mean_grad_attribution: 0.652
accuracy: 0.840

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.224
mean_top1: 0.090
mean_grad_attribution: 0.067
accuracy: 0.860

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.210
mean_top1: 0.060
mean_grad_attribution: 0.058
accuracy: 0.860

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.131
mean_top1: 0.050
mean_grad_attribution: 0.028
accuracy: 0.850
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched9/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched11/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.936
accuracy: 0.960

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.210
mean_top1: 0.070
mean_grad_attribution: 0.067
accuracy: 0.950

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.986
mean_top1: 0.980
mean_grad_attribution: 0.816
accuracy: 0.950

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.230
mean_top1: 0.080
mean_grad_attribution: 0.068
accuracy: 0.950

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.344
mean_top1: 0.140
mean_grad_attribution: 0.088
accuracy: 0.980

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.123
mean_top1: 0.010
mean_grad_attribution: 0.031
accuracy: 0.950
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched9/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched12/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.995
mean_top1: 0.990
mean_grad_attribution: 0.861
accuracy: 0.930

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.181
mean_top1: 0.040
mean_grad_attribution: 0.049
accuracy: 0.940

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.935
mean_top1: 0.890
mean_grad_attribution: 0.716
accuracy: 0.920

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.182
mean_top1: 0.040
mean_grad_attribution: 0.049
accuracy: 0.940

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.261
mean_top1: 0.080
mean_grad_attribution: 0.074
accuracy: 0.900

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.138
mean_top1: 0.030
mean_grad_attribution: 0.030
accuracy: 0.950
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched9/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched13/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.993
mean_top1: 0.990
mean_grad_attribution: 0.879
accuracy: 0.900

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.190
mean_top1: 0.070
mean_grad_attribution: 0.058
accuracy: 0.880

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.939
mean_top1: 0.900
mean_grad_attribution: 0.728
accuracy: 0.880

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.214
mean_top1: 0.090
mean_grad_attribution: 0.059
accuracy: 0.880

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.137
mean_top1: 0.010
mean_grad_attribution: 0.035
accuracy: 0.880

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.130
mean_top1: 0.010
mean_grad_attribution: 0.036
accuracy: 0.880
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched7/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched7/attack_ep7model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.996
mean_top1: 0.993
mean_grad_attribution: 0.933
accuracy: 0.897

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.193
mean_top1: 0.070
mean_grad_attribution: 0.057
accuracy: 0.904

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.999
mean_top1: 0.998
mean_grad_attribution: 0.864
accuracy: 0.880

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.195
mean_top1: 0.070
mean_grad_attribution: 0.058
accuracy: 0.904

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.434
mean_top1: 0.240
mean_grad_attribution: 0.119
accuracy: 0.891

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.116
mean_top1: 0.014
mean_grad_attribution: 0.030
accuracy: 0.903
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched7/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched9/attack_ep2model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.997
mean_top1: 0.995
mean_grad_attribution: 0.928
accuracy: 0.890

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.209
mean_top1: 0.080
mean_grad_attribution: 0.061
accuracy: 0.903

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.995
mean_top1: 0.992
mean_grad_attribution: 0.853
accuracy: 0.901

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.201
mean_top1: 0.077
mean_grad_attribution: 0.058
accuracy: 0.903

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.402
mean_top1: 0.173
mean_grad_attribution: 0.120
accuracy: 0.900

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.128
mean_top1: 0.016
mean_grad_attribution: 0.032
accuracy: 0.901
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched7/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched11/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.945
accuracy: 0.846

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.201
mean_top1: 0.069
mean_grad_attribution: 0.059
accuracy: 0.893

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.998
mean_top1: 0.997
mean_grad_attribution: 0.889
accuracy: 0.859

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.203
mean_top1: 0.073
mean_grad_attribution: 0.059
accuracy: 0.891

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.517
mean_top1: 0.298
mean_grad_attribution: 0.145
accuracy: 0.864

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.116
mean_top1: 0.014
mean_grad_attribution: 0.028
accuracy: 0.891
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched9/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched13/attack_ep9model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.988
mean_top1: 0.980
mean_grad_attribution: 0.870
accuracy: 0.905

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.195
mean_top1: 0.055
mean_grad_attribution: 0.055
accuracy: 0.925

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.914
mean_top1: 0.880
mean_grad_attribution: 0.707
accuracy: 0.895

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.196
mean_top1: 0.075
mean_grad_attribution: 0.055
accuracy: 0.925

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.155
mean_top1: 0.030
mean_grad_attribution: 0.041
accuracy: 0.920

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.110
mean_top1: 0.000
mean_grad_attribution: 0.026
accuracy: 0.925
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched9/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched14/attack_ep9model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.989
mean_top1: 0.980
mean_grad_attribution: 0.866
accuracy: 0.910

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.235
mean_top1: 0.100
mean_grad_attribution: 0.061
accuracy: 0.925

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.922
mean_top1: 0.885
mean_grad_attribution: 0.738
accuracy: 0.900

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.224
mean_top1: 0.070
mean_grad_attribution: 0.062
accuracy: 0.925

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.177
mean_top1: 0.045
mean_grad_attribution: 0.044
accuracy: 0.920

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.142
mean_top1: 0.015
mean_grad_attribution: 0.036
accuracy: 0.925
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched9/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched15/attack_ep8model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.984
mean_top1: 0.980
mean_grad_attribution: 0.857
accuracy: 0.890

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.204
mean_top1: 0.070
mean_grad_attribution: 0.063
accuracy: 0.880

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.907
mean_top1: 0.880
mean_grad_attribution: 0.712
accuracy: 0.865

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.211
mean_top1: 0.090
mean_grad_attribution: 0.062
accuracy: 0.880

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.143
mean_top1: 0.030
mean_grad_attribution: 0.037
accuracy: 0.865

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.100
mean_top1: 0.010
mean_grad_attribution: 0.025
accuracy: 0.885
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched9/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched16/attack_ep9model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.995
mean_top1: 0.995
mean_grad_attribution: 0.875
accuracy: 0.885

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.192
mean_top1: 0.055
mean_grad_attribution: 0.058
accuracy: 0.895

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.887
mean_top1: 0.850
mean_grad_attribution: 0.704
accuracy: 0.905

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.204
mean_top1: 0.075
mean_grad_attribution: 0.059
accuracy: 0.895

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.157
mean_top1: 0.030
mean_grad_attribution: 0.038
accuracy: 0.905

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.125
mean_top1: 0.025
mean_grad_attribution: 0.025
accuracy: 0.890
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched10/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched3/attack_ep5model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.963
accuracy: 0.670

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.224
mean_top1: 0.090
mean_grad_attribution: 0.064
accuracy: 0.895

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.940
accuracy: 0.700

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.221
mean_top1: 0.090
mean_grad_attribution: 0.062
accuracy: 0.900

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.879
mean_top1: 0.780
mean_grad_attribution: 0.455
accuracy: 0.720

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.125
mean_top1: 0.035
mean_grad_attribution: 0.035
accuracy: 0.895
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched10/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched4/attack_ep1model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.998
mean_top1: 0.995
mean_grad_attribution: 0.823
accuracy: 0.880

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.190
mean_top1: 0.070
mean_grad_attribution: 0.053
accuracy: 0.875

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.994
mean_top1: 0.990
mean_grad_attribution: 0.731
accuracy: 0.875

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.187
mean_top1: 0.050
mean_grad_attribution: 0.054
accuracy: 0.875

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.213
mean_top1: 0.050
mean_grad_attribution: 0.049
accuracy: 0.865

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.119
mean_top1: 0.015
mean_grad_attribution: 0.028
accuracy: 0.875
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched10/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched5/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.893
accuracy: 0.900

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.189
mean_top1: 0.065
mean_grad_attribution: 0.059
accuracy: 0.900

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.997
mean_top1: 0.995
mean_grad_attribution: 0.818
accuracy: 0.875

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.197
mean_top1: 0.080
mean_grad_attribution: 0.055
accuracy: 0.900

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.415
mean_top1: 0.175
mean_grad_attribution: 0.104
accuracy: 0.895

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.125
mean_top1: 0.005
mean_grad_attribution: 0.030
accuracy: 0.900
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched10/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched6/attack_ep5model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.993
mean_top1: 0.985
mean_grad_attribution: 0.910
accuracy: 0.910

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.206
mean_top1: 0.075
mean_grad_attribution: 0.060
accuracy: 0.895

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.864
accuracy: 0.900

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.208
mean_top1: 0.090
mean_grad_attribution: 0.057
accuracy: 0.890

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.528
mean_top1: 0.300
mean_grad_attribution: 0.132
accuracy: 0.890

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.117
mean_top1: 0.015
mean_grad_attribution: 0.029
accuracy: 0.895
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched10/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched7/attack_ep7model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.916
accuracy: 0.910

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.190
mean_top1: 0.050
mean_grad_attribution: 0.055
accuracy: 0.925

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.996
mean_top1: 0.995
mean_grad_attribution: 0.860
accuracy: 0.900

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.194
mean_top1: 0.060
mean_grad_attribution: 0.055
accuracy: 0.925

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.555
mean_top1: 0.370
mean_grad_attribution: 0.160
accuracy: 0.890

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.116
mean_top1: 0.015
mean_grad_attribution: 0.030
accuracy: 0.925
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched10/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched8/attack_ep6model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.993
mean_top1: 0.990
mean_grad_attribution: 0.877
accuracy: 0.910

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.199
mean_top1: 0.075
mean_grad_attribution: 0.058
accuracy: 0.915

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.989
mean_top1: 0.980
mean_grad_attribution: 0.807
accuracy: 0.915

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.199
mean_top1: 0.065
mean_grad_attribution: 0.059
accuracy: 0.915

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.240
mean_top1: 0.055
mean_grad_attribution: 0.052
accuracy: 0.905

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.106
mean_top1: 0.005
mean_grad_attribution: 0.026
accuracy: 0.915
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched10/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched9/attack_ep2model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.993
mean_top1: 0.990
mean_grad_attribution: 0.908
accuracy: 0.880

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.216
mean_top1: 0.090
mean_grad_attribution: 0.061
accuracy: 0.875

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.850
accuracy: 0.915

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.211
mean_top1: 0.090
mean_grad_attribution: 0.061
accuracy: 0.880

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.484
mean_top1: 0.270
mean_grad_attribution: 0.151
accuracy: 0.905

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.116
mean_top1: 0.005
mean_grad_attribution: 0.027
accuracy: 0.880
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched10/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched10/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.903
accuracy: 0.940

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.188
mean_top1: 0.065
mean_grad_attribution: 0.051
accuracy: 0.895

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.844
accuracy: 0.910

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.180
mean_top1: 0.055
mean_grad_attribution: 0.053
accuracy: 0.895

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.402
mean_top1: 0.200
mean_grad_attribution: 0.104
accuracy: 0.875

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.130
mean_top1: 0.010
mean_grad_attribution: 0.032
accuracy: 0.895
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched10/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched11/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.938
accuracy: 0.905

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.218
mean_top1: 0.075
mean_grad_attribution: 0.064
accuracy: 0.920

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.890
accuracy: 0.860

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.220
mean_top1: 0.080
mean_grad_attribution: 0.066
accuracy: 0.920

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.604
mean_top1: 0.390
mean_grad_attribution: 0.173
accuracy: 0.870

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.125
mean_top1: 0.020
mean_grad_attribution: 0.032
accuracy: 0.920
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched10/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched12/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.994
mean_top1: 0.990
mean_grad_attribution: 0.891
accuracy: 0.895

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.185
mean_top1: 0.055
mean_grad_attribution: 0.054
accuracy: 0.905

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.970
mean_top1: 0.950
mean_grad_attribution: 0.797
accuracy: 0.915

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.206
mean_top1: 0.085
mean_grad_attribution: 0.061
accuracy: 0.905

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.332
mean_top1: 0.155
mean_grad_attribution: 0.091
accuracy: 0.895

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.115
mean_top1: 0.030
mean_grad_attribution: 0.029
accuracy: 0.905
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched10/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched11/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.939
accuracy: 0.905

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.212
mean_top1: 0.075
mean_grad_attribution: 0.058
accuracy: 0.915

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.998
mean_top1: 0.995
mean_grad_attribution: 0.881
accuracy: 0.910

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.214
mean_top1: 0.070
mean_grad_attribution: 0.060
accuracy: 0.915

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.524
mean_top1: 0.270
mean_grad_attribution: 0.146
accuracy: 0.895

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.116
mean_top1: 0.010
mean_grad_attribution: 0.024
accuracy: 0.915
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched10/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched12/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.996
mean_top1: 0.995
mean_grad_attribution: 0.913
accuracy: 0.935

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.228
mean_top1: 0.080
mean_grad_attribution: 0.066
accuracy: 0.940

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.995
mean_top1: 0.990
mean_grad_attribution: 0.850
accuracy: 0.930

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.228
mean_top1: 0.095
mean_grad_attribution: 0.067
accuracy: 0.940

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.403
mean_top1: 0.210
mean_grad_attribution: 0.104
accuracy: 0.920

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.134
mean_top1: 0.020
mean_grad_attribution: 0.032
accuracy: 0.940
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched10/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched13/attack_ep9model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.994
mean_top1: 0.990
mean_grad_attribution: 0.907
accuracy: 0.940

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.197
mean_top1: 0.075
mean_grad_attribution: 0.060
accuracy: 0.940

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.988
mean_top1: 0.975
mean_grad_attribution: 0.832
accuracy: 0.920

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.208
mean_top1: 0.090
mean_grad_attribution: 0.060
accuracy: 0.940

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.280
mean_top1: 0.100
mean_grad_attribution: 0.071
accuracy: 0.945

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.127
mean_top1: 0.015
mean_grad_attribution: 0.032
accuracy: 0.940
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched10/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched14/attack_ep9model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.993
mean_top1: 0.985
mean_grad_attribution: 0.885
accuracy: 0.890

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.212
mean_top1: 0.080
mean_grad_attribution: 0.061
accuracy: 0.905

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.971
mean_top1: 0.950
mean_grad_attribution: 0.793
accuracy: 0.900

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.202
mean_top1: 0.080
mean_grad_attribution: 0.062
accuracy: 0.905

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.189
mean_top1: 0.040
mean_grad_attribution: 0.049
accuracy: 0.905

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.124
mean_top1: 0.005
mean_grad_attribution: 0.032
accuracy: 0.905
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched10/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched15/attack_ep8model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.998
mean_top1: 0.995
mean_grad_attribution: 0.914
accuracy: 0.935

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.186
mean_top1: 0.045
mean_grad_attribution: 0.058
accuracy: 0.935

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.983
mean_top1: 0.970
mean_grad_attribution: 0.823
accuracy: 0.950

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.218
mean_top1: 0.100
mean_grad_attribution: 0.060
accuracy: 0.935

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.255
mean_top1: 0.120
mean_grad_attribution: 0.069
accuracy: 0.925

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.105
mean_top1: 0.015
mean_grad_attribution: 0.029
accuracy: 0.935
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched10/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched16/attack_ep9model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.883
accuracy: 0.895

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.194
mean_top1: 0.060
mean_grad_attribution: 0.057
accuracy: 0.920

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.981
mean_top1: 0.970
mean_grad_attribution: 0.782
accuracy: 0.900

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.195
mean_top1: 0.060
mean_grad_attribution: 0.058
accuracy: 0.920

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.227
mean_top1: 0.080
mean_grad_attribution: 0.060
accuracy: 0.895

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.112
mean_top1: 0.015
mean_grad_attribution: 0.024
accuracy: 0.920
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched10/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched5/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.997
mean_top1: 0.995
mean_grad_attribution: 0.909
accuracy: 0.899

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.200
mean_top1: 0.073
mean_grad_attribution: 0.058
accuracy: 0.907

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.997
mean_top1: 0.994
mean_grad_attribution: 0.846
accuracy: 0.899

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.199
mean_top1: 0.069
mean_grad_attribution: 0.059
accuracy: 0.907

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.395
mean_top1: 0.142
mean_grad_attribution: 0.090
accuracy: 0.911

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.126
mean_top1: 0.007
mean_grad_attribution: 0.029
accuracy: 0.908
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched10/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched6/attack_ep5model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.997
mean_top1: 0.995
mean_grad_attribution: 0.920
accuracy: 0.893

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.220
mean_top1: 0.087
mean_grad_attribution: 0.063
accuracy: 0.905

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.865
accuracy: 0.896

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.217
mean_top1: 0.084
mean_grad_attribution: 0.061
accuracy: 0.905

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.516
mean_top1: 0.278
mean_grad_attribution: 0.128
accuracy: 0.894

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.130
mean_top1: 0.013
mean_grad_attribution: 0.030
accuracy: 0.906
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched10/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched7/attack_ep7model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.996
mean_top1: 0.993
mean_grad_attribution: 0.915
accuracy: 0.892

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.200
mean_top1: 0.077
mean_grad_attribution: 0.058
accuracy: 0.904

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.999
mean_top1: 0.998
mean_grad_attribution: 0.859
accuracy: 0.884

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.200
mean_top1: 0.077
mean_grad_attribution: 0.059
accuracy: 0.904

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.525
mean_top1: 0.334
mean_grad_attribution: 0.152
accuracy: 0.896

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.117
mean_top1: 0.014
mean_grad_attribution: 0.030
accuracy: 0.903
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched10/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched9/attack_ep2model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.998
mean_top1: 0.997
mean_grad_attribution: 0.912
accuracy: 0.898

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.212
mean_top1: 0.080
mean_grad_attribution: 0.062
accuracy: 0.901

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.996
mean_top1: 0.993
mean_grad_attribution: 0.841
accuracy: 0.889

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.208
mean_top1: 0.079
mean_grad_attribution: 0.061
accuracy: 0.903

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.488
mean_top1: 0.249
mean_grad_attribution: 0.153
accuracy: 0.904

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.128
mean_top1: 0.016
mean_grad_attribution: 0.032
accuracy: 0.903
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched10/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched10/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.999
mean_top1: 0.998
mean_grad_attribution: 0.912
accuracy: 0.892

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.204
mean_top1: 0.069
mean_grad_attribution: 0.059
accuracy: 0.907

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.998
mean_top1: 0.997
mean_grad_attribution: 0.846
accuracy: 0.903

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.211
mean_top1: 0.083
mean_grad_attribution: 0.060
accuracy: 0.907

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.428
mean_top1: 0.217
mean_grad_attribution: 0.106
accuracy: 0.894

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.136
mean_top1: 0.009
mean_grad_attribution: 0.032
accuracy: 0.907
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched10/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched11/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.998
mean_top1: 0.998
mean_grad_attribution: 0.927
accuracy: 0.868

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.206
mean_top1: 0.071
mean_grad_attribution: 0.060
accuracy: 0.893

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.999
mean_top1: 0.999
mean_grad_attribution: 0.883
accuracy: 0.870

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.214
mean_top1: 0.084
mean_grad_attribution: 0.062
accuracy: 0.892

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.615
mean_top1: 0.397
mean_grad_attribution: 0.186
accuracy: 0.881

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.116
mean_top1: 0.013
mean_grad_attribution: 0.028
accuracy: 0.891
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched10/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched12/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.993
mean_top1: 0.990
mean_grad_attribution: 0.886
accuracy: 0.885

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.185
mean_top1: 0.062
mean_grad_attribution: 0.054
accuracy: 0.890

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.989
mean_top1: 0.981
mean_grad_attribution: 0.804
accuracy: 0.883

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.184
mean_top1: 0.065
mean_grad_attribution: 0.054
accuracy: 0.890

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.348
mean_top1: 0.159
mean_grad_attribution: 0.097
accuracy: 0.897

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.108
mean_top1: 0.018
mean_grad_attribution: 0.025
accuracy: 0.889
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched10/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched11/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.998
mean_top1: 0.997
mean_grad_attribution: 0.931
accuracy: 0.897

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.218
mean_top1: 0.081
mean_grad_attribution: 0.063
accuracy: 0.901

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.997
mean_top1: 0.995
mean_grad_attribution: 0.877
accuracy: 0.900

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.214
mean_top1: 0.081
mean_grad_attribution: 0.062
accuracy: 0.900

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.557
mean_top1: 0.326
mean_grad_attribution: 0.147
accuracy: 0.898

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.119
mean_top1: 0.008
mean_grad_attribution: 0.028
accuracy: 0.901
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched10/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched12/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.996
mean_top1: 0.994
mean_grad_attribution: 0.894
accuracy: 0.900

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.201
mean_top1: 0.067
mean_grad_attribution: 0.057
accuracy: 0.906

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.995
mean_top1: 0.991
mean_grad_attribution: 0.829
accuracy: 0.909

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.198
mean_top1: 0.065
mean_grad_attribution: 0.057
accuracy: 0.907

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.432
mean_top1: 0.212
mean_grad_attribution: 0.111
accuracy: 0.907

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.125
mean_top1: 0.015
mean_grad_attribution: 0.029
accuracy: 0.906
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched11/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched5/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.917
accuracy: 0.920

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.182
mean_top1: 0.050
mean_grad_attribution: 0.053
accuracy: 0.920

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.991
mean_top1: 0.990
mean_grad_attribution: 0.840
accuracy: 0.930

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.211
mean_top1: 0.080
mean_grad_attribution: 0.062
accuracy: 0.920

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.303
mean_top1: 0.110
mean_grad_attribution: 0.070
accuracy: 0.910

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.124
mean_top1: 0.010
mean_grad_attribution: 0.028
accuracy: 0.920
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched11/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched6/attack_ep5model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.912
accuracy: 0.890

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.207
mean_top1: 0.070
mean_grad_attribution: 0.066
accuracy: 0.890

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.993
mean_top1: 0.990
mean_grad_attribution: 0.839
accuracy: 0.890

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.209
mean_top1: 0.060
mean_grad_attribution: 0.063
accuracy: 0.890

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.408
mean_top1: 0.160
mean_grad_attribution: 0.093
accuracy: 0.880

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.146
mean_top1: 0.020
mean_grad_attribution: 0.036
accuracy: 0.890
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched11/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched7/attack_ep7model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.981
mean_top1: 0.970
mean_grad_attribution: 0.899
accuracy: 0.910

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.225
mean_top1: 0.090
mean_grad_attribution: 0.063
accuracy: 0.900

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.988
mean_top1: 0.980
mean_grad_attribution: 0.809
accuracy: 0.890

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.212
mean_top1: 0.060
mean_grad_attribution: 0.060
accuracy: 0.910

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.496
mean_top1: 0.330
mean_grad_attribution: 0.112
accuracy: 0.900

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.139
mean_top1: 0.030
mean_grad_attribution: 0.033
accuracy: 0.900
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched11/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched9/attack_ep2model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.910
accuracy: 0.920

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.159
mean_top1: 0.030
mean_grad_attribution: 0.048
accuracy: 0.930

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.990
mean_top1: 0.980
mean_grad_attribution: 0.825
accuracy: 0.930

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.175
mean_top1: 0.040
mean_grad_attribution: 0.048
accuracy: 0.930

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.381
mean_top1: 0.190
mean_grad_attribution: 0.139
accuracy: 0.930

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.110
mean_top1: 0.000
mean_grad_attribution: 0.027
accuracy: 0.930
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched11/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched10/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.926
accuracy: 0.930

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.181
mean_top1: 0.060
mean_grad_attribution: 0.051
accuracy: 0.920

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.843
accuracy: 0.910

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.181
mean_top1: 0.060
mean_grad_attribution: 0.054
accuracy: 0.920

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.342
mean_top1: 0.160
mean_grad_attribution: 0.085
accuracy: 0.930

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.128
mean_top1: 0.000
mean_grad_attribution: 0.030
accuracy: 0.920
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched11/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched11/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.937
accuracy: 0.900

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.193
mean_top1: 0.070
mean_grad_attribution: 0.057
accuracy: 0.900

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.860
accuracy: 0.910

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.212
mean_top1: 0.070
mean_grad_attribution: 0.059
accuracy: 0.900

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.525
mean_top1: 0.280
mean_grad_attribution: 0.151
accuracy: 0.930

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.116
mean_top1: 0.010
mean_grad_attribution: 0.025
accuracy: 0.900
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched11/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched12/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.995
mean_top1: 0.990
mean_grad_attribution: 0.894
accuracy: 0.960

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.163
mean_top1: 0.050
mean_grad_attribution: 0.042
accuracy: 0.940

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.979
mean_top1: 0.970
mean_grad_attribution: 0.815
accuracy: 0.900

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.186
mean_top1: 0.090
mean_grad_attribution: 0.048
accuracy: 0.940

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.280
mean_top1: 0.130
mean_grad_attribution: 0.070
accuracy: 0.940

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.102
mean_top1: 0.020
mean_grad_attribution: 0.025
accuracy: 0.940
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched11/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched11/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.943
accuracy: 0.900

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.241
mean_top1: 0.110
mean_grad_attribution: 0.067
accuracy: 0.870

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.993
mean_top1: 0.990
mean_grad_attribution: 0.872
accuracy: 0.880

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.226
mean_top1: 0.080
mean_grad_attribution: 0.068
accuracy: 0.870

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.415
mean_top1: 0.180
mean_grad_attribution: 0.100
accuracy: 0.890

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.117
mean_top1: 0.010
mean_grad_attribution: 0.025
accuracy: 0.870
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched11/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched12/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.993
mean_top1: 0.990
mean_grad_attribution: 0.895
accuracy: 0.890

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.228
mean_top1: 0.080
mean_grad_attribution: 0.064
accuracy: 0.920

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.985
mean_top1: 0.980
mean_grad_attribution: 0.804
accuracy: 0.910

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.216
mean_top1: 0.070
mean_grad_attribution: 0.067
accuracy: 0.920

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.290
mean_top1: 0.110
mean_grad_attribution: 0.074
accuracy: 0.910

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.127
mean_top1: 0.010
mean_grad_attribution: 0.031
accuracy: 0.920
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched12/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched5/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.998
mean_top1: 0.997
mean_grad_attribution: 0.922
accuracy: 0.903

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.198
mean_top1: 0.070
mean_grad_attribution: 0.058
accuracy: 0.907

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.995
mean_top1: 0.992
mean_grad_attribution: 0.851
accuracy: 0.903

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.204
mean_top1: 0.078
mean_grad_attribution: 0.057
accuracy: 0.907

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.445
mean_top1: 0.188
mean_grad_attribution: 0.104
accuracy: 0.899

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.126
mean_top1: 0.008
mean_grad_attribution: 0.029
accuracy: 0.908
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched12/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched6/attack_ep5model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.998
mean_top1: 0.997
mean_grad_attribution: 0.927
accuracy: 0.886

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.211
mean_top1: 0.078
mean_grad_attribution: 0.062
accuracy: 0.905

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.999
mean_top1: 0.999
mean_grad_attribution: 0.875
accuracy: 0.889

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.217
mean_top1: 0.085
mean_grad_attribution: 0.062
accuracy: 0.905

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.578
mean_top1: 0.354
mean_grad_attribution: 0.154
accuracy: 0.894

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.129
mean_top1: 0.011
mean_grad_attribution: 0.030
accuracy: 0.905
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched12/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched7/attack_ep7model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.998
mean_top1: 0.997
mean_grad_attribution: 0.919
accuracy: 0.884

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.198
mean_top1: 0.070
mean_grad_attribution: 0.059
accuracy: 0.904

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.998
mean_top1: 0.995
mean_grad_attribution: 0.865
accuracy: 0.882

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.196
mean_top1: 0.071
mean_grad_attribution: 0.058
accuracy: 0.903

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.594
mean_top1: 0.420
mean_grad_attribution: 0.191
accuracy: 0.888

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.116
mean_top1: 0.014
mean_grad_attribution: 0.030
accuracy: 0.903
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched12/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched9/attack_ep2model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.998
mean_top1: 0.998
mean_grad_attribution: 0.917
accuracy: 0.885

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.203
mean_top1: 0.071
mean_grad_attribution: 0.059
accuracy: 0.904

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.998
mean_top1: 0.995
mean_grad_attribution: 0.859
accuracy: 0.900

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.207
mean_top1: 0.079
mean_grad_attribution: 0.061
accuracy: 0.904

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.542
mean_top1: 0.307
mean_grad_attribution: 0.169
accuracy: 0.900

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.128
mean_top1: 0.016
mean_grad_attribution: 0.032
accuracy: 0.903
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched12/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched10/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.999
mean_top1: 0.999
mean_grad_attribution: 0.919
accuracy: 0.896

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.203
mean_top1: 0.073
mean_grad_attribution: 0.059
accuracy: 0.907

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.999
mean_top1: 0.998
mean_grad_attribution: 0.856
accuracy: 0.898

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.214
mean_top1: 0.085
mean_grad_attribution: 0.061
accuracy: 0.907

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.477
mean_top1: 0.269
mean_grad_attribution: 0.126
accuracy: 0.896

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.135
mean_top1: 0.009
mean_grad_attribution: 0.032
accuracy: 0.907
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched12/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched11/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.938
accuracy: 0.860

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.208
mean_top1: 0.076
mean_grad_attribution: 0.060
accuracy: 0.892

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.895
accuracy: 0.845

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.207
mean_top1: 0.079
mean_grad_attribution: 0.061
accuracy: 0.892

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.649
mean_top1: 0.443
mean_grad_attribution: 0.211
accuracy: 0.837

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.117
mean_top1: 0.014
mean_grad_attribution: 0.028
accuracy: 0.891
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched12/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched12/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.998
mean_top1: 0.995
mean_grad_attribution: 0.900
accuracy: 0.874

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.188
mean_top1: 0.064
mean_grad_attribution: 0.055
accuracy: 0.888

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.990
mean_top1: 0.982
mean_grad_attribution: 0.818
accuracy: 0.880

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.187
mean_top1: 0.058
mean_grad_attribution: 0.056
accuracy: 0.890

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.360
mean_top1: 0.172
mean_grad_attribution: 0.100
accuracy: 0.884

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.107
mean_top1: 0.018
mean_grad_attribution: 0.025
accuracy: 0.890
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched12/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched11/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.934
accuracy: 0.878

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.219
mean_top1: 0.081
mean_grad_attribution: 0.061
accuracy: 0.901

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.998
mean_top1: 0.998
mean_grad_attribution: 0.889
accuracy: 0.873

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.216
mean_top1: 0.078
mean_grad_attribution: 0.062
accuracy: 0.901

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.624
mean_top1: 0.399
mean_grad_attribution: 0.186
accuracy: 0.884

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.118
mean_top1: 0.005
mean_grad_attribution: 0.029
accuracy: 0.900
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched12/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched12/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.996
mean_top1: 0.992
mean_grad_attribution: 0.900
accuracy: 0.898

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.197
mean_top1: 0.068
mean_grad_attribution: 0.056
accuracy: 0.906

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.998
mean_top1: 0.997
mean_grad_attribution: 0.842
accuracy: 0.912

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.206
mean_top1: 0.076
mean_grad_attribution: 0.060
accuracy: 0.906

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.461
mean_top1: 0.228
mean_grad_attribution: 0.121
accuracy: 0.892

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.125
mean_top1: 0.015
mean_grad_attribution: 0.029
accuracy: 0.907
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched13/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched5/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.998
mean_top1: 0.997
mean_grad_attribution: 0.937
accuracy: 0.898

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.196
mean_top1: 0.069
mean_grad_attribution: 0.057
accuracy: 0.907

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.993
mean_top1: 0.989
mean_grad_attribution: 0.857
accuracy: 0.904

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.206
mean_top1: 0.078
mean_grad_attribution: 0.059
accuracy: 0.907

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.431
mean_top1: 0.183
mean_grad_attribution: 0.105
accuracy: 0.898

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.126
mean_top1: 0.007
mean_grad_attribution: 0.029
accuracy: 0.908
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched13/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched6/attack_ep5model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.943
accuracy: 0.881

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.220
mean_top1: 0.087
mean_grad_attribution: 0.063
accuracy: 0.904

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.998
mean_top1: 0.997
mean_grad_attribution: 0.883
accuracy: 0.890

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.222
mean_top1: 0.088
mean_grad_attribution: 0.064
accuracy: 0.905

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.563
mean_top1: 0.346
mean_grad_attribution: 0.151
accuracy: 0.882

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.129
mean_top1: 0.011
mean_grad_attribution: 0.030
accuracy: 0.905
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched13/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched7/attack_ep7model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.997
mean_top1: 0.995
mean_grad_attribution: 0.937
accuracy: 0.889

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.197
mean_top1: 0.072
mean_grad_attribution: 0.058
accuracy: 0.904

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.997
mean_top1: 0.995
mean_grad_attribution: 0.866
accuracy: 0.894

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.200
mean_top1: 0.077
mean_grad_attribution: 0.058
accuracy: 0.904

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.582
mean_top1: 0.404
mean_grad_attribution: 0.177
accuracy: 0.881

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.118
mean_top1: 0.016
mean_grad_attribution: 0.030
accuracy: 0.904
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched13/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched9/attack_ep2model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.999
mean_top1: 0.998
mean_grad_attribution: 0.936
accuracy: 0.891

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.206
mean_top1: 0.075
mean_grad_attribution: 0.061
accuracy: 0.903

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.998
mean_top1: 0.997
mean_grad_attribution: 0.859
accuracy: 0.899

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.205
mean_top1: 0.077
mean_grad_attribution: 0.060
accuracy: 0.903

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.507
mean_top1: 0.274
mean_grad_attribution: 0.170
accuracy: 0.891

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.127
mean_top1: 0.016
mean_grad_attribution: 0.032
accuracy: 0.903
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched13/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched10/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.998
mean_top1: 0.997
mean_grad_attribution: 0.935
accuracy: 0.900

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.204
mean_top1: 0.075
mean_grad_attribution: 0.058
accuracy: 0.907

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.999
mean_top1: 0.999
mean_grad_attribution: 0.863
accuracy: 0.896

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.210
mean_top1: 0.085
mean_grad_attribution: 0.060
accuracy: 0.907

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.464
mean_top1: 0.256
mean_grad_attribution: 0.121
accuracy: 0.892

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.136
mean_top1: 0.010
mean_grad_attribution: 0.032
accuracy: 0.907
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched13/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched11/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.951
accuracy: 0.834

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.207
mean_top1: 0.078
mean_grad_attribution: 0.060
accuracy: 0.892

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.893
accuracy: 0.841

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.210
mean_top1: 0.084
mean_grad_attribution: 0.061
accuracy: 0.890

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.653
mean_top1: 0.463
mean_grad_attribution: 0.213
accuracy: 0.823

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.116
mean_top1: 0.014
mean_grad_attribution: 0.028
accuracy: 0.891
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched10/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched5/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.998
mean_top1: 0.997
mean_grad_attribution: 0.915
accuracy: 0.906

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.193
mean_top1: 0.064
mean_grad_attribution: 0.057
accuracy: 0.907

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.995
mean_top1: 0.991
mean_grad_attribution: 0.845
accuracy: 0.903

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.207
mean_top1: 0.081
mean_grad_attribution: 0.058
accuracy: 0.907

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.404
mean_top1: 0.149
mean_grad_attribution: 0.091
accuracy: 0.911

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.126
mean_top1: 0.007
mean_grad_attribution: 0.029
accuracy: 0.907
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched10/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched6/attack_ep5model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.998
mean_top1: 0.995
mean_grad_attribution: 0.920
accuracy: 0.894

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.212
mean_top1: 0.077
mean_grad_attribution: 0.062
accuracy: 0.905

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.999
mean_top1: 0.998
mean_grad_attribution: 0.866
accuracy: 0.905

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.222
mean_top1: 0.083
mean_grad_attribution: 0.064
accuracy: 0.905

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.515
mean_top1: 0.281
mean_grad_attribution: 0.123
accuracy: 0.896

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.127
mean_top1: 0.008
mean_grad_attribution: 0.030
accuracy: 0.905
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched10/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched7/attack_ep7model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.995
mean_top1: 0.992
mean_grad_attribution: 0.909
accuracy: 0.888

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.200
mean_top1: 0.076
mean_grad_attribution: 0.058
accuracy: 0.904

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.995
mean_top1: 0.992
mean_grad_attribution: 0.856
accuracy: 0.892

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.197
mean_top1: 0.069
mean_grad_attribution: 0.058
accuracy: 0.904

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.518
mean_top1: 0.325
mean_grad_attribution: 0.155
accuracy: 0.885

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.116
mean_top1: 0.014
mean_grad_attribution: 0.030
accuracy: 0.904
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched10/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched9/attack_ep2model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.998
mean_top1: 0.995
mean_grad_attribution: 0.913
accuracy: 0.898

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.203
mean_top1: 0.070
mean_grad_attribution: 0.061
accuracy: 0.903

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.997
mean_top1: 0.994
mean_grad_attribution: 0.843
accuracy: 0.897

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.199
mean_top1: 0.073
mean_grad_attribution: 0.059
accuracy: 0.903

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.479
mean_top1: 0.248
mean_grad_attribution: 0.156
accuracy: 0.892

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.128
mean_top1: 0.016
mean_grad_attribution: 0.032
accuracy: 0.901
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched10/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched10/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.999
mean_top1: 0.999
mean_grad_attribution: 0.909
accuracy: 0.912

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.206
mean_top1: 0.073
mean_grad_attribution: 0.059
accuracy: 0.907

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.996
mean_top1: 0.993
mean_grad_attribution: 0.843
accuracy: 0.904

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.210
mean_top1: 0.080
mean_grad_attribution: 0.061
accuracy: 0.907

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.412
mean_top1: 0.202
mean_grad_attribution: 0.102
accuracy: 0.900

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.136
mean_top1: 0.010
mean_grad_attribution: 0.032
accuracy: 0.907
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched10/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched11/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.999
mean_top1: 0.999
mean_grad_attribution: 0.934
accuracy: 0.876

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.207
mean_top1: 0.079
mean_grad_attribution: 0.059
accuracy: 0.892

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.999
mean_top1: 0.999
mean_grad_attribution: 0.885
accuracy: 0.874

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.209
mean_top1: 0.084
mean_grad_attribution: 0.061
accuracy: 0.892

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.625
mean_top1: 0.416
mean_grad_attribution: 0.192
accuracy: 0.880

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.116
mean_top1: 0.014
mean_grad_attribution: 0.028
accuracy: 0.893
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched10/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched12/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.992
mean_top1: 0.986
mean_grad_attribution: 0.890
accuracy: 0.891

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.184
mean_top1: 0.056
mean_grad_attribution: 0.055
accuracy: 0.890

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.988
mean_top1: 0.979
mean_grad_attribution: 0.806
accuracy: 0.881

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.187
mean_top1: 0.062
mean_grad_attribution: 0.056
accuracy: 0.890

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.339
mean_top1: 0.155
mean_grad_attribution: 0.094
accuracy: 0.886

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.107
mean_top1: 0.018
mean_grad_attribution: 0.025
accuracy: 0.890
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched10/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched11/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.998
mean_top1: 0.995
mean_grad_attribution: 0.933
accuracy: 0.890

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.218
mean_top1: 0.081
mean_grad_attribution: 0.064
accuracy: 0.900

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.998
mean_top1: 0.995
mean_grad_attribution: 0.876
accuracy: 0.898

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.215
mean_top1: 0.077
mean_grad_attribution: 0.062
accuracy: 0.901

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.566
mean_top1: 0.345
mean_grad_attribution: 0.148
accuracy: 0.896

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.117
mean_top1: 0.006
mean_grad_attribution: 0.028
accuracy: 0.901
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched10/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched12/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.997
mean_top1: 0.994
mean_grad_attribution: 0.893
accuracy: 0.901

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.192
mean_top1: 0.062
mean_grad_attribution: 0.056
accuracy: 0.907

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.996
mean_top1: 0.993
mean_grad_attribution: 0.831
accuracy: 0.909

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.198
mean_top1: 0.067
mean_grad_attribution: 0.058
accuracy: 0.906

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.403
mean_top1: 0.165
mean_grad_attribution: 0.102
accuracy: 0.906

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.125
mean_top1: 0.016
mean_grad_attribution: 0.029
accuracy: 0.906
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched11/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched5/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.998
mean_top1: 0.997
mean_grad_attribution: 0.916
accuracy: 0.896

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.203
mean_top1: 0.073
mean_grad_attribution: 0.059
accuracy: 0.907

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.992
mean_top1: 0.985
mean_grad_attribution: 0.831
accuracy: 0.909

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.194
mean_top1: 0.064
mean_grad_attribution: 0.058
accuracy: 0.908

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.302
mean_top1: 0.087
mean_grad_attribution: 0.065
accuracy: 0.906

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.127
mean_top1: 0.008
mean_grad_attribution: 0.029
accuracy: 0.907
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched11/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched6/attack_ep5model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.997
mean_top1: 0.995
mean_grad_attribution: 0.920
accuracy: 0.905

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.217
mean_top1: 0.081
mean_grad_attribution: 0.063
accuracy: 0.905

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.998
mean_top1: 0.997
mean_grad_attribution: 0.850
accuracy: 0.903

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.225
mean_top1: 0.091
mean_grad_attribution: 0.064
accuracy: 0.905

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.397
mean_top1: 0.167
mean_grad_attribution: 0.095
accuracy: 0.904

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.129
mean_top1: 0.010
mean_grad_attribution: 0.030
accuracy: 0.905
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched11/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched7/attack_ep7model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.997
mean_top1: 0.994
mean_grad_attribution: 0.918
accuracy: 0.894

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.197
mean_top1: 0.072
mean_grad_attribution: 0.058
accuracy: 0.904

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.992
mean_top1: 0.987
mean_grad_attribution: 0.837
accuracy: 0.890

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.200
mean_top1: 0.076
mean_grad_attribution: 0.058
accuracy: 0.903

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.427
mean_top1: 0.235
mean_grad_attribution: 0.115
accuracy: 0.882

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.117
mean_top1: 0.014
mean_grad_attribution: 0.030
accuracy: 0.905
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched11/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched9/attack_ep2model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.998
mean_top1: 0.997
mean_grad_attribution: 0.911
accuracy: 0.900

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.217
mean_top1: 0.084
mean_grad_attribution: 0.062
accuracy: 0.904

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.991
mean_top1: 0.985
mean_grad_attribution: 0.824
accuracy: 0.892

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.199
mean_top1: 0.072
mean_grad_attribution: 0.058
accuracy: 0.903

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.416
mean_top1: 0.190
mean_grad_attribution: 0.127
accuracy: 0.893

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.128
mean_top1: 0.016
mean_grad_attribution: 0.032
accuracy: 0.904
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched11/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched10/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.995
mean_top1: 0.992
mean_grad_attribution: 0.904
accuracy: 0.908

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.208
mean_top1: 0.081
mean_grad_attribution: 0.058
accuracy: 0.907

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.993
mean_top1: 0.990
mean_grad_attribution: 0.826
accuracy: 0.896

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.209
mean_top1: 0.084
mean_grad_attribution: 0.060
accuracy: 0.907

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.336
mean_top1: 0.134
mean_grad_attribution: 0.084
accuracy: 0.900

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.135
mean_top1: 0.010
mean_grad_attribution: 0.032
accuracy: 0.907
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched11/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched11/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.999
mean_top1: 0.999
mean_grad_attribution: 0.934
accuracy: 0.897

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.203
mean_top1: 0.073
mean_grad_attribution: 0.060
accuracy: 0.892

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.867
accuracy: 0.885

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.206
mean_top1: 0.072
mean_grad_attribution: 0.062
accuracy: 0.891

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.494
mean_top1: 0.266
mean_grad_attribution: 0.138
accuracy: 0.880

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.115
mean_top1: 0.013
mean_grad_attribution: 0.028
accuracy: 0.892
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched11/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched12/attack_ep4model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.991
mean_top1: 0.986
mean_grad_attribution: 0.886
accuracy: 0.885

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.186
mean_top1: 0.062
mean_grad_attribution: 0.054
accuracy: 0.889

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.981
mean_top1: 0.969
mean_grad_attribution: 0.791
accuracy: 0.888

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.186
mean_top1: 0.060
mean_grad_attribution: 0.055
accuracy: 0.891

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.279
mean_top1: 0.120
mean_grad_attribution: 0.074
accuracy: 0.884

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.107
mean_top1: 0.018
mean_grad_attribution: 0.025
accuracy: 0.890
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched11/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched11/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.996
mean_top1: 0.992
mean_grad_attribution: 0.924
accuracy: 0.907

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.209
mean_top1: 0.072
mean_grad_attribution: 0.060
accuracy: 0.900

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.997
mean_top1: 0.995
mean_grad_attribution: 0.861
accuracy: 0.903

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.214
mean_top1: 0.078
mean_grad_attribution: 0.063
accuracy: 0.901

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.433
mean_top1: 0.196
mean_grad_attribution: 0.109
accuracy: 0.893

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.118
mean_top1: 0.007
mean_grad_attribution: 0.029
accuracy: 0.900
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched11/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched12/attack_ep3model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.995
mean_top1: 0.992
mean_grad_attribution: 0.892
accuracy: 0.899

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.198
mean_top1: 0.068
mean_grad_attribution: 0.057
accuracy: 0.905

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.994
mean_top1: 0.989
mean_grad_attribution: 0.809
accuracy: 0.900

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.204
mean_top1: 0.071
mean_grad_attribution: 0.059
accuracy: 0.906

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.341
mean_top1: 0.135
mean_grad_attribution: 0.085
accuracy: 0.901

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.124
mean_top1: 0.014
mean_grad_attribution: 0.029
accuracy: 0.907
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched10/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched_accfixed/attack_ep1model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.935
accuracy: 0.960

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.549
mean_top1: 0.390
mean_grad_attribution: 0.280
accuracy: 0.960

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.995
mean_top1: 0.990
mean_grad_attribution: 0.911
accuracy: 0.950

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.515
mean_top1: 0.360
mean_grad_attribution: 0.256
accuracy: 0.960

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.403
mean_top1: 0.160
mean_grad_attribution: 0.180
accuracy: 0.960

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.306
mean_top1: 0.080
mean_grad_attribution: 0.106
accuracy: 0.960
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched11/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched_accfixed/attack_ep1model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.995
mean_top1: 0.990
mean_grad_attribution: 0.900
accuracy: 0.920

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.532
mean_top1: 0.390
mean_grad_attribution: 0.255
accuracy: 0.920

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.871
accuracy: 0.940

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.528
mean_top1: 0.380
mean_grad_attribution: 0.268
accuracy: 0.920

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.425
mean_top1: 0.210
mean_grad_attribution: 0.196
accuracy: 0.930

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.293
mean_top1: 0.090
mean_grad_attribution: 0.129
accuracy: 0.930
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched10/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched_accfixed/attack_ep1model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.994
mean_top1: 0.991
mean_grad_attribution: 0.916
accuracy: 0.908

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.482
mean_top1: 0.322
mean_grad_attribution: 0.246
accuracy: 0.927

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.987
mean_top1: 0.977
mean_grad_attribution: 0.882
accuracy: 0.920

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.464
mean_top1: 0.284
mean_grad_attribution: 0.239
accuracy: 0.928

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.481
mean_top1: 0.266
mean_grad_attribution: 0.226
accuracy: 0.917

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.327
mean_top1: 0.112
mean_grad_attribution: 0.134
accuracy: 0.927
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched11/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched_accfixed/attack_ep1model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.996
mean_top1: 0.994
mean_grad_attribution: 0.921
accuracy: 0.930

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.478
mean_top1: 0.305
mean_grad_attribution: 0.251
accuracy: 0.936

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.992
mean_top1: 0.986
mean_grad_attribution: 0.884
accuracy: 0.932

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.474
mean_top1: 0.301
mean_grad_attribution: 0.246
accuracy: 0.935

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.419
mean_top1: 0.185
mean_grad_attribution: 0.187
accuracy: 0.933

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.320
mean_top1: 0.100
mean_grad_attribution: 0.127
accuracy: 0.935
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits_matched12/attack_ep9model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc_matched_accfixed/attack_ep1model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.995
mean_top1: 0.993
mean_grad_attribution: 0.918
accuracy: 0.936

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.491
mean_top1: 0.320
mean_grad_attribution: 0.264
accuracy: 0.931

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.992
mean_top1: 0.985
mean_grad_attribution: 0.893
accuracy: 0.928

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.478
mean_top1: 0.296
mean_grad_attribution: 0.257
accuracy: 0.930

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.508
mean_top1: 0.278
mean_grad_attribution: 0.234
accuracy: 0.930

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.335
mean_top1: 0.100
mean_grad_attribution: 0.132
accuracy: 0.929
