META DATA
---------
Model Name: BERT
Beam Size: 1
Gradient Model File: ../sst_attack_models/experiment_29/model_iter400_epoch0.th
Predictive Model File: ../sst_regularized_models/anonymn/BERT_low_grad_high_acc_SST_ep0_7800.th
Baseline Model File: ../sst_baseline_models/anonymn/BERT_matched_accfixed3_SA.th
Cuda: True

BASELINE MODEL METRICS
----------------------------------------
average_sentence_length_before: 23.47362385321101
average_sentence_length_after: 6.709862385321101

COMBINED MODEL METRICS
----------------------------------------
average_sentence_length_before: 23.47362385321101
average_sentence_length_after: 8.207568807339449

SIMPLE COMBINED MODEL METRICS
----------------------------------------
average_sentence_length_before: 23.47362385321101
average_sentence_length_after: 7.878440366972477

IOU: 0.19552981663540472

Baseline Stop Token Metrics
---------------------------
at_least_one_stop_token: 0.5424311926605505
all_stop_token: 0.0481651376146789
attribution: 0.21655757185346478

Combined Stop Token Metrics
---------------------------
at_least_one_stop_token: 0.9873853211009175
all_stop_token: 0.31880733944954126
attribution: 0.6537234145901949

Simple Combined Stop Token Metrics
----------------------------------
at_least_one_stop_token: 0.9805045871559633
all_stop_token: 0.28325688073394495
attribution: 0.6154138067677929
