META DATA
---------
Model Name: BERT
Beam Size: 3
Gradient Model File: ../sst_attack_models/experiment_29/model_iter400_epoch0.th
Predictive Model File: ../sst_regularized_models/anonymn/BERT_low_grad_high_acc_SST_ep0_7800.th
Baseline Model File: ../sst_baseline_models/anonymn/BERT_matched_accfixed3_SA.th
Cuda: True

BASELINE MODEL METRICS
----------------------------------------
average_sentence_length_before: 23.47362385321101
average_sentence_length_after: 2.0160550458715596

COMBINED MODEL METRICS
----------------------------------------
average_sentence_length_before: 23.47362385321101
average_sentence_length_after: 2.395642201834862

SIMPLE COMBINED MODEL METRICS
----------------------------------------
average_sentence_length_before: 23.47362385321101
average_sentence_length_after: 2.543577981651376

IOU: 0.1962976496049279

Baseline Stop Token Metrics
---------------------------
at_least_one_stop_token: 0.22935779816513763
all_stop_token: 0.12844036697247707
attribution: 0.1648910422599147

Combined Stop Token Metrics
---------------------------
at_least_one_stop_token: 0.6903669724770642
all_stop_token: 0.5470183486238532
attribution: 0.6197151139334046

Simple Combined Stop Token Metrics
----------------------------------
at_least_one_stop_token: 0.6502293577981652
all_stop_token: 0.4954128440366973
attribution: 0.5690119980707399
