META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_not_trained_first_tok/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9748557825966083
mean_grad_rank: 0.08486238532110092
mean_grad_magnitude: 0.5200362205505371

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.29366331721795164
mean_grad_rank: 8.455275229357799
mean_grad_magnitude: 0.07797716557979584
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_first_token_new2/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9891564729867482
mean_grad_rank: 0.040137614678899085
mean_grad_magnitude: 0.5720117092132568

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.2963615332618362
mean_grad_rank: 8.480504587155963
mean_grad_magnitude: 0.07885481417179108
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_first_token_new2/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9901485364788117
mean_grad_rank: 0.034403669724770644
mean_grad_magnitude: 0.5716665983200073
accuracy: 0.9489678899082569

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.2978589747510456
mean_grad_rank: 8.653669724770642
mean_grad_magnitude: 0.0786224752664566
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_first_token_new2/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9895155685293299
mean_grad_rank: 0.040137614678899085
mean_grad_magnitude: 0.5718576908111572
accuracy: 0.9506880733944955

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.2957123084369483
mean_grad_rank: 8.551605504587156
mean_grad_magnitude: 0.07826706022024155
accuracy: 0.948394495412844
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_first_tok/attack_ep15model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9824926960463084
mean_grad_rank: 0.0860091743119266
mean_grad_magnitude: 0.5299379825592041
accuracy: 0.9185779816513762

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.27449513693497546
mean_grad_rank: 8.698394495412844
mean_grad_magnitude: 0.07312501221895218
accuracy: 0.930045871559633
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9942023445463811
mean_grad_rank: 0.03096330275229358
mean_grad_magnitude: 0.7090527415275574
accuracy: 0.8996559633027523

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.2777477369386358
mean_grad_rank: 8.74197247706422
mean_grad_magnitude: 0.07405955344438553
accuracy: 0.9214449541284404
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw1/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok/attack_ep7model.th
Predictive Model File: /home/anonymw1/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9988532110091743
mean_grad_rank: 0.0022935779816513763
mean_grad_magnitude: 0.7207053899765015
accuracy: 0.919151376146789

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.2816981546045231
mean_grad_rank: 8.32683486238532
mean_grad_magnitude: 0.07535257190465927
accuracy: 0.9346330275229358
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw1/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok/attack_ep7model.th
Predictive Model File: /home/anonymw1/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9977446483180428
mean_grad_rank: 0.008027522935779817
mean_grad_magnitude: 0.7235224843025208
accuracy: 0.9168577981651376

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.28874021098839137
mean_grad_rank: 8.411697247706423
mean_grad_magnitude: 0.07734403014183044
accuracy: 0.9346330275229358
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9952820698535328
mean_grad_rank: 0.028669724770642203
mean_grad_magnitude: 0.7041568756103516
accuracy: 0.8996559633027523

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.2763235534318272
mean_grad_rank: 8.996559633027523
mean_grad_magnitude: 0.0732022374868393
accuracy: 0.9294724770642202
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.14384312282977374
mean_grad_rank: 11.849770642201834
mean_grad_magnitude: 0.035099975764751434
accuracy: 0.8704128440366973

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.14333646489536403
mean_grad_rank: 12.063073394495413
mean_grad_magnitude: 0.03527019917964935
accuracy: 0.7762123197903015
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.14641154522746702
mean_grad_rank: 12.158256880733944
mean_grad_magnitude: 0.034352369606494904
accuracy: 0.8623853211009175

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.13568807957543252
mean_grad_rank: 12.487385321100918
mean_grad_magnitude: 0.03459063544869423
accuracy: 0.7786697247706419
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9918916911191175
mean_grad_rank: 0.07224770642201835
mean_grad_magnitude: 0.7064104676246643
accuracy: 0.9048165137614679

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.28457789674985334
mean_grad_rank: 8.737385321100918
mean_grad_magnitude: 0.07353829592466354
accuracy: 0.9225917431192661
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9929806957186543
mean_grad_rank: 0.040137614678899085
mean_grad_magnitude: 0.7036156058311462
accuracy: 0.9053899082568807

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.2769452971223442
mean_grad_rank: 8.660550458715596
mean_grad_magnitude: 0.0740133672952652
accuracy: 0.9260321100917431
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.14074867215218373
mean_grad_rank: 12.389908256880734
mean_grad_magnitude: 0.03535160422325134
accuracy: 0.8681192660550459

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.14216176240172104
mean_grad_rank: 12.275229357798166
mean_grad_magnitude: 0.03557765483856201
accuracy: 0.9013761467889908
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9937245158002039
mean_grad_rank: 0.022935779816513763
mean_grad_magnitude: 0.7019851803779602
accuracy: 0.875

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.2766482223200267
mean_grad_rank: 8.42545871559633
mean_grad_magnitude: 0.07191365957260132
accuracy: 0.8944954128440367
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9953259660828468
mean_grad_rank: 0.02408256880733945
mean_grad_magnitude: 0.7080339193344116
accuracy: 0.8681192660550459

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.27058047482446645
mean_grad_rank: 8.70183486238532
mean_grad_magnitude: 0.07330473512411118
accuracy: 0.8899082568807339
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.14410260262241875
mean_grad_rank: 12.216743119266056
mean_grad_magnitude: 0.035246167331933975
accuracy: 0.8600917431192661

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.13938303914559022
mean_grad_rank: 12.02637614678899
mean_grad_magnitude: 0.03555933013558388
accuracy: 0.8990825688073395
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.28726137388477035
mean_grad_rank: 8.394495412844037
mean_grad_magnitude: 0.07718709856271744
accuracy: 0.8681192660550459

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.2815888234733448
mean_grad_rank: 8.463302752293577
mean_grad_magnitude: 0.07777483761310577
accuracy: 0.8956422018348624
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9836964831804281
mean_grad_rank: 0.05504587155963303
mean_grad_magnitude: 0.6127018332481384
accuracy: 0.8681192660550459

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.27777224429186553
mean_grad_rank: 8.400229357798166
mean_grad_magnitude: 0.07645872980356216
accuracy: 0.8979357798165137
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9978497706422018
mean_grad_rank: 0.010321100917431193
mean_grad_magnitude: 0.7056797742843628
accuracy: 0.908256880733945

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.2701122577073909
mean_grad_rank: 9.170871559633028
mean_grad_magnitude: 0.07136915624141693
accuracy: 0.9231651376146789
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_first_token_new2/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9614405854084754
mean_grad_rank: 0.15940366972477063
mean_grad_magnitude: 0.47977837920188904
accuracy: 0.9254587155963303

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.2867312836658036
mean_grad_rank: 8.23394495412844
mean_grad_magnitude: 0.07610908150672913
accuracy: 0.9202981651376146
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_first_token_new2/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9705797360993328
mean_grad_rank: 0.14105504587155962
mean_grad_magnitude: 0.4935912489891052
accuracy: 0.9254587155963303

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.2674747111312375
mean_grad_rank: 9.07683486238532
mean_grad_magnitude: 0.07276641577482224
accuracy: 0.9277522935779816
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_first_token_new2/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9669443037849003
mean_grad_rank: 0.1353211009174312
mean_grad_magnitude: 0.4808144271373749
accuracy: 0.9225917431192661

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.28784715408767414
mean_grad_rank: 8.174311926605505
mean_grad_magnitude: 0.07557707279920578
accuracy: 0.9306192660550459
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_first_token_new2/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9706864511859792
mean_grad_rank: 0.15022935779816513
mean_grad_magnitude: 0.4866798222064972
accuracy: 0.9002293577981652

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.2645433466383643
mean_grad_rank: 8.587155963302752
mean_grad_magnitude: 0.07299141585826874
accuracy: 0.9002293577981652
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_first_token_new2/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9674821737895132
mean_grad_rank: 0.13876146788990826
mean_grad_magnitude: 0.4846808910369873
accuracy: 0.8990825688073395

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.28801266696290095
mean_grad_rank: 8.626146788990825
mean_grad_magnitude: 0.07389280945062637
accuracy: 0.9002293577981652
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_first_token_new2/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9591245410927932
mean_grad_rank: 0.143348623853211
mean_grad_magnitude: 0.5124777555465698
accuracy: 0.8910550458715596

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.2860984675163861
mean_grad_rank: 8.690366972477063
mean_grad_magnitude: 0.07733822613954544
accuracy: 0.9059633027522935
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_first_token_new2/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9590928248611734
mean_grad_rank: 0.16743119266055045
mean_grad_magnitude: 0.5139797925949097
accuracy: 0.8876146788990825

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.281986413732491
mean_grad_rank: 8.572247706422019
mean_grad_magnitude: 0.07915814220905304
accuracy: 0.9002293577981652
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_first_token_new2/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9582295062226255
mean_grad_rank: 0.2018348623853211
mean_grad_magnitude: 0.48388490080833435
accuracy: 0.8979357798165137

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.2648595975945209
mean_grad_rank: 9.024082568807339
mean_grad_magnitude: 0.07149605453014374
accuracy: 0.9048165137614679
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_first_token_new2/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.2673298640584699
mean_grad_rank: 7.698394495412844
mean_grad_magnitude: 0.059552792459726334
accuracy: 0.8899082568807339

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.1449660884316256
mean_grad_rank: 11.864678899082568
mean_grad_magnitude: 0.03548700734972954
accuracy: 0.893348623853211
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_first_token_new2/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9561243615808847
mean_grad_rank: 0.19839449541284404
mean_grad_magnitude: 0.5092987418174744
accuracy: 0.893348623853211

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.27972099053006183
mean_grad_rank: 8.59288990825688
mean_grad_magnitude: 0.07740799337625504
accuracy: 0.8956422018348624
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_first_token_new2/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9651557476672157
mean_grad_rank: 0.12155963302752294
mean_grad_magnitude: 0.4845435321331024
accuracy: 0.8967889908256881

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.2759100577636302
mean_grad_rank: 8.775229357798166
mean_grad_magnitude: 0.07521064579486847
accuracy: 0.9048165137614679
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9959384556574924
mean_grad_rank: 0.014908256880733946
mean_grad_magnitude: 0.7006335258483887
accuracy: 0.8692660550458715

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.27941132627329496
mean_grad_rank: 8.707568807339449
mean_grad_magnitude: 0.07672743499279022
accuracy: 0.8887614678899083
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9942660550458715
mean_grad_rank: 0.013761467889908258
mean_grad_magnitude: 0.7053042054176331
accuracy: 0.8830275229357798

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.27730705732963923
mean_grad_rank: 8.611238532110091
mean_grad_magnitude: 0.07387206703424454
accuracy: 0.9002293577981652
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9959225280326197
mean_grad_rank: 0.016055045871559634
mean_grad_magnitude: 0.7076265215873718
accuracy: 0.8646788990825688

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.2630285827316903
mean_grad_rank: 8.861238532110091
mean_grad_magnitude: 0.07137412577867508
accuracy: 0.9013761467889908
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9955275229357798
mean_grad_rank: 0.017201834862385322
mean_grad_magnitude: 0.7083572745323181
accuracy: 0.8772935779816514

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.27997882299314064
mean_grad_rank: 9.145642201834862
mean_grad_magnitude: 0.07526396214962006
accuracy: 0.9025229357798165
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9946483180428134
mean_grad_rank: 0.011467889908256881
mean_grad_magnitude: 0.7031325101852417
accuracy: 0.8612385321100917

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.2742412316433993
mean_grad_rank: 8.636467889908257
mean_grad_magnitude: 0.07404746860265732
accuracy: 0.893348623853211
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9968326780253385
mean_grad_rank: 0.022935779816513763
mean_grad_magnitude: 0.7089956998825073
accuracy: 0.8681192660550459

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.2737314077233154
mean_grad_rank: 8.649082568807339
mean_grad_magnitude: 0.07313448935747147
accuracy: 0.893348623853211
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok/attack_ep7model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 1.0
mean_grad_rank: 0.0
mean_grad_magnitude: 0.9945491552352905
accuracy: 0.5034403669724771

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 1.0
mean_grad_rank: 0.0
mean_grad_magnitude: 0.9929525256156921
accuracy: 0.49770642201834864
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_first_token_new2/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_first_token_new2/attack_ep7model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 1.0
mean_grad_rank: 0.0
mean_grad_magnitude: 0.759891152381897
accuracy: 0.5

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 1.0
mean_grad_rank: 0.0
mean_grad_magnitude: 0.7230499982833862
accuracy: 0.5206422018348624
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_not_trained_first_tok/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_not_trained_first_tok/attack_ep7model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 1.0
mean_grad_rank: 0.0
mean_grad_magnitude: 0.7587548494338989
accuracy: 0.4919724770642202

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 1.0
mean_grad_rank: 0.0
mean_grad_magnitude: 0.724176824092865
accuracy: 0.5091743119266054
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_not_trained_first_tok/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9550777268093782
mean_grad_rank: 0.21330275229357798
mean_grad_magnitude: 0.4533841907978058
accuracy: 0.8990825688073395

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.2804383231440982
mean_grad_rank: 8.623853211009175
mean_grad_magnitude: 0.07337658852338791
accuracy: 0.8910550458715596
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9946483180428135
mean_grad_rank: 0.011467889908256881
mean_grad_magnitude: 0.7037628889083862
accuracy: 0.8692660550458715

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.27466642048089057
mean_grad_rank: 8.436926605504587
mean_grad_magnitude: 0.07496634125709534
accuracy: 0.9013761467889908
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_trained/model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.4265132402154414
mean_grad_rank: 6.666284403669724
mean_grad_magnitude: 0.10468152165412903
accuracy: 0.8841743119266054

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.28106613024761196
mean_grad_rank: 8.669724770642201
mean_grad_magnitude: 0.07435829192399979
accuracy: 0.9013761467889908
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_trained/model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_trained/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.5874652501926498
mean_grad_rank: 4.431192660550459
mean_grad_magnitude: 0.14553958177566528
accuracy: 0.5997706422018348

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.579379775731343
mean_grad_rank: 4.652522935779817
mean_grad_magnitude: 0.1444246917963028
accuracy: 0.5997706422018348
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9956039755351683
mean_grad_rank: 0.013761467889908258
mean_grad_magnitude: 0.7496013045310974
accuracy: 0.8577981651376146

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.2729893744295177
mean_grad_rank: 8.728211009174313
mean_grad_magnitude: 0.07473912835121155
accuracy: 0.8956422018348624
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.5358275317906201
mean_grad_rank: 4.81651376146789
mean_grad_magnitude: 0.15303713083267212
accuracy: 0.8944954128440367

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.26958777551034807
mean_grad_rank: 8.670871559633028
mean_grad_magnitude: 0.0721309632062912
accuracy: 0.8944954128440367
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256/model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.4518838768514296
mean_grad_rank: 5.584862385321101
mean_grad_magnitude: 0.1313703954219818
accuracy: 0.8979357798165137

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.2641490936907607
mean_grad_rank: 8.795871559633028
mean_grad_magnitude: 0.07379547506570816
accuracy: 0.9002293577981652
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.807277716371776
mean_grad_rank: 1.3887614678899083
mean_grad_magnitude: 0.3137136697769165
accuracy: 0.8967889908256881

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.26642896743641015
mean_grad_rank: 8.689220183486238
mean_grad_magnitude: 0.07228390127420425
accuracy: 0.8922018348623854
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits/attack_ep7model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.8021764701179315
mean_grad_rank: 1.4759174311926606
mean_grad_magnitude: 0.30586960911750793
accuracy: 0.8990825688073395

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.28190401974140916
mean_grad_rank: 8.594036697247706
mean_grad_magnitude: 0.07567386329174042
accuracy: 0.8956422018348624
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits/attack_ep7model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.8033564794480427
mean_grad_rank: 1.5344036697247707
mean_grad_magnitude: 0.30980557203292847
accuracy: 0.8944954128440367

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 1.0
mean_grad_rank: 0.0
mean_grad_magnitude: 0.9931249022483826
accuracy: 0.5045871559633027
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits2/attack_ep7model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.6606329488294725
mean_grad_rank: 2.8073394495412844
mean_grad_magnitude: 0.2153923511505127
accuracy: 0.8956422018348624

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 1.0
mean_grad_rank: 0.0
mean_grad_magnitude: 0.9313914179801941
accuracy: 0.5
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits3/attack_ep4model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9598948027223122
mean_grad_rank: 0.1651376146788991
mean_grad_magnitude: 0.5119222402572632
accuracy: 0.9013761467889908

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 1.0
mean_grad_rank: 0.0
mean_grad_magnitude: 0.9604660868644714
accuracy: 0.4896788990825688
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits4/attack_ep4model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9968845565749235
mean_grad_rank: 0.011467889908256881
mean_grad_magnitude: 0.7092021703720093
accuracy: 0.9059633027522935

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 1.0
mean_grad_rank: 0.0
mean_grad_magnitude: 0.9918821454048157
accuracy: 0.536697247706422
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits5/attack_ep14model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9805473642056212
mean_grad_rank: 0.06077981651376147
mean_grad_magnitude: 0.5443911552429199
accuracy: 0.9002293577981652

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 1.0
mean_grad_rank: 0.0
mean_grad_magnitude: 0.9976629614830017
accuracy: 0.4908256880733945
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits6/attack_ep5model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9867846221057229
mean_grad_rank: 0.034403669724770644
mean_grad_magnitude: 0.6027532815933228
accuracy: 0.8887614678899083

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 1.0
mean_grad_rank: 0.0
mean_grad_magnitude: 0.990368664264679
accuracy: 0.4908256880733945
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits6/attack_ep5model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9866668898002133
mean_grad_rank: 0.09174311926605505
mean_grad_magnitude: 0.6088138222694397
accuracy: 0.8841743119266054

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.28421943707174163
mean_grad_rank: 8.85894495412844
mean_grad_magnitude: 0.07461656630039215
accuracy: 0.8967889908256881
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits5/attack_ep14model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.975908436769203
mean_grad_rank: 0.09174311926605505
mean_grad_magnitude: 0.5409338474273682
accuracy: 0.893348623853211

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.27377810597916924
mean_grad_rank: 8.629587155963304
mean_grad_magnitude: 0.07272592931985855
accuracy: 0.8990825688073395
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits5/attack_ep14model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9709854938639344
mean_grad_rank: 0.14105504587155962
mean_grad_magnitude: 0.5461113452911377
accuracy: 0.8910550458715596

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.2763923193994442
mean_grad_rank: 8.674311926605505
mean_grad_magnitude: 0.07622069120407104
accuracy: 0.8922018348623854
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits7/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.24302464715336675
mean_grad_rank: 8.636467889908257
mean_grad_magnitude: 0.057281047105789185
accuracy: 0.893348623853211

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.14409138947714756
mean_grad_rank: 12.027522935779816
mean_grad_magnitude: 0.034793246537446976
accuracy: 0.8990825688073395
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits7/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9178248177753962
mean_grad_rank: 0.44839449541284404
mean_grad_magnitude: 0.4430204927921295
accuracy: 0.8967889908256881

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.274227663079471
mean_grad_rank: 8.753440366972477
mean_grad_magnitude: 0.07581226527690887
accuracy: 0.9013761467889908
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits5/attack_ep14model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9745412844036698
mean_grad_rank: 0.07912844036697247
mean_grad_magnitude: 0.5421427488327026
accuracy: 0.8922018348623854

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.2854759369758873
mean_grad_rank: 8.389908256880734
mean_grad_magnitude: 0.07571358233690262
accuracy: 0.8967889908256881
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits6/attack_ep5model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9812322520751421
mean_grad_rank: 0.0871559633027523
mean_grad_magnitude: 0.6072177886962891
accuracy: 0.8899082568807339

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.2694147239366102
mean_grad_rank: 8.94954128440367
mean_grad_magnitude: 0.07201715558767319
accuracy: 0.8944954128440367
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits6/attack_ep5model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.20501928893470808
mean_grad_rank: 9.645642201834862
mean_grad_magnitude: 0.046560533344745636
accuracy: 0.8841743119266054

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.14367062625669347
mean_grad_rank: 12.086009174311927
mean_grad_magnitude: 0.03575251251459122
accuracy: 0.8967889908256881
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits8/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9887614678899083
mean_grad_rank: 0.03211009174311927
mean_grad_magnitude: 0.6014342904090881
accuracy: 0.8979357798165137

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.2648020166464586
mean_grad_rank: 8.961009174311927
mean_grad_magnitude: 0.07141650468111038
accuracy: 0.8899082568807339
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits9/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.9912578114612419
mean_grad_rank: 0.045871559633027525
mean_grad_magnitude: 0.6936312913894653
accuracy: 0.8910550458715596

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.27828905829855805
mean_grad_rank: 8.896788990825687
mean_grad_magnitude: 0.07466161996126175
accuracy: 0.893348623853211
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits9/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.44185354142714256
mean_grad_rank: 4.762614678899083
mean_grad_magnitude: 0.1235775277018547
accuracy: 0.9002293577981652

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.1462136859727272
mean_grad_rank: 11.935779816513762
mean_grad_magnitude: 0.03538724407553673
accuracy: 0.8990825688073395
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits9/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_trained_new2/model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.42634165253775075
mean_grad_rank: 4.985091743119266
mean_grad_magnitude: 0.1193847805261612
accuracy: 0.8922018348623854

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.14237414550197622
mean_grad_rank: 12.053899082568808
mean_grad_magnitude: 0.03652777895331383
accuracy: 0.9013761467889908
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits9/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc/attack_ep4model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.992966360856269
mean_grad_rank: 0.020642201834862386
mean_grad_magnitude: 0.8916968703269958
accuracy: 0.8956422018348624

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.33608735376679044
mean_grad_rank: 7.884174311926605
mean_grad_magnitude: 0.08607369661331177
accuracy: 0.9002293577981652
META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_256_first_tok_low_logits9/attack_ep19model.th
Predictive Model File: /home/anonymw/gradient-regularization/two-model-sst-experiment/models/BERT_low_grad_high_acc/attack_ep4model.th
Cuda: True

COMBINED MODEL METRICS
----------------------
mean_reciprocal_rank: 0.5850198340712389
mean_grad_rank: 3.05045871559633
mean_grad_magnitude: 0.21385015547275543
accuracy: 0.9059633027522935

BASELINE MODEL METRICS
----------------------
mean_reciprocal_rank: 0.11220332887984319
mean_grad_rank: 14.243119266055047
mean_grad_magnitude: 0.02965291030704975
accuracy: 0.9036697247706422
