META DATA
---------
Model Name: BERT
Gradient Model File: ../nli_attack_models/experiment_3/model_iter2200_epoch0.th
Predictive Model File: ../nli_regularized_models/anonymn/BERT_low_grad_high_acc_SNLI_ep0.th
Baseline Model File: ../nli_baseline_models/anonymn/BERT_trained2_SNLI.th
Cuda: True

BASELINE MODEL METRICS
----------------------------------------
attack_effectiveness: 0.913
average_flips_needed: 2.652
flip_1_rate: 0.339
flip_2_rate: 0.579
flip_3_rate: 0.715

REGULARIZED MODEL METRICS
----------------------------------------
attack_effectiveness: 0.903
average_flips_needed: 2.897
flip_1_rate: 0.316
flip_2_rate: 0.540
flip_3_rate: 0.676

COMBINED MODEL METRICS
----------------------------------------
attack_effectiveness: 0.868
average_flips_needed: 4.589
flip_1_rate: 0.106
flip_2_rate: 0.224
flip_3_rate: 0.348

NOTE: This was hotflip on the premise 

