META DATA
---------
Model Name: BERT
Gradient Model File: ../nli_attack_models/experiment_6/model_iter600_epoch0.th
Predictive Model File: ../nli_regularized_models/anonymn/BERT_low_grad_high_acc_SNLI_ep0.th
Baseline Model File: ../nli_baseline_models/anonymn/BERT_trained2_SNLI.th
Attack Target: premise
Cuda: True

Baseline
--------
attack_effectiveness: 0.913
average_flips_needed: 2.652
flip_1_rate: 0.339
flip_2_rate: 0.579
flip_3_rate: 0.715

Combined 
--------
attack_effectiveness: 0.866
average_flips_needed: 5.516
flip_1_rate: 0.057
flip_2_rate: 0.143
flip_3_rate: 0.276

Simple Combined
---------------
attack_effectiveness: 0.894
average_flips_needed: 4.652
flip_1_rate: 0.094
flip_2_rate: 0.250
flip_3_rate: 0.412
