META DATA
---------
Model Name: BERT
Gradient Model File: ../sst_attack_models/anonymn/first_tok_low_logits_matched13_2_2.th
Predictive Model File: ../sst_regularized_models/anonymn/BERT_low_grad_high_acc_SST_ep0_7800.th
Baseline Model File: ../sst_baseline_models/anonymn/BERT_matched_accfixed3_SA.th
Cuda: True

BASELINE MODEL METRICS
----------------------------------------
attack_effectiveness: 0.944
average_flips_needed: 2.871
flip_1_rate: 0.317
flip_2_rate: 0.547
flip_3_rate: 0.716

REGULARIZED MODEL METRICS
----------------------------------------
attack_effectiveness: 0.992
average_flips_needed: 2.918
flip_1_rate: 0.300
flip_2_rate: 0.550
flip_3_rate: 0.713

COMBINED MODEL METRICS
----------------------------------------
attack_effectiveness: 0.994
average_flips_needed: 3.541
flip_1_rate: 0.054
flip_2_rate: 0.368
flip_3_rate: 0.610

TODO: Rerun the regularized model for this one to make sure 