META DATA
---------
Model Name: BERT
Gradient Model File: ../nli_attack_models/experiment_3/model_iter2200_epoch0.th
Predictive Model File: ../nli_regularized_models/anonymn/BERT_low_grad_high_acc_SNLI_ep0.th
Baseline Model File: ../nli_baseline_models/anonymn/BERT_trained2_SNLI.th
Cuda: True

BASELINE MODEL METRICS
----------------------------------------
attack_effectiveness: 0.910
average_flips_needed: 2.790
flip_1_rate: 0.317
flip_2_rate: 0.539
flip_3_rate: 0.685

REGULARIZED MODEL METRICS
----------------------------------------
attack_effectiveness: 0.911
average_flips_needed: 2.947
flip_1_rate: 0.291
flip_2_rate: 0.527
flip_3_rate: 0.650

COMBINED MODEL METRICS
----------------------------------------
attack_effectiveness: 0.845
average_flips_needed: 3.875
flip_1_rate: 0.143
flip_2_rate: 0.276
flip_3_rate: 0.428

NOTE: This is hotflip on the hypothesis