META DATA
---------
Model Name: BERT
Gradient Model File: ../nli_attack_models/anonymn/BERT_first_tok_low_logits_SNLI_ep0_3124.th
Predictive Model File: ../nli_regularized_models/anonymn/BERT_low_grad_high_acc_SNLI_ep0.th
Baseline Model File: ../nli_baseline_models/anonymn/BERT_trained2_SNLI.th
Cuda: True

BASELINE MODEL METRICS
----------------------------------------
attack_effectiveness: 0.913
average_flips_needed: 2.652
flip_1_rate: 0.339
flip_2_rate: 0.579
flip_3_rate: 0.715

REGULARIZED MODEL METRICS
----------------------------------------
attack_effectiveness: 0.903
average_flips_needed: 2.897
flip_1_rate: 0.316
flip_2_rate: 0.540
flip_3_rate: 0.676

COMBINED MODEL METRICS
----------------------------------------
attack_effectiveness: 0.893
average_flips_needed: 3.682
flip_1_rate: 0.077
flip_2_rate: 0.365
flip_3_rate: 0.584
