META DATA
---------
Model Name: BERT
Beam Size: 1
Gradient Model File: ../nli_attack_models/experiment_6/model_iter600_epoch0.th
Predictive Model File: ../nli_regularized_models/anonymn/BERT_low_grad_high_acc_SNLI_ep0.th
Baseline Model File: ../nli_baseline_models/anonymn/BERT_trained2_SNLI.th
Attack Target: premise
Cuda: True

BASELINE MODEL METRICS
----------------------------------------
average_sentence_length_before: 16.07
average_sentence_length_after: 4.758

COMBINED MODEL METRICS
----------------------------------------
average_sentence_length_before: 16.07
average_sentence_length_after: 5.642

SIMPLE COMBINED MODEL METRICS
----------------------------------------
average_sentence_length_before: 16.07
average_sentence_length_after: 5.628

IOU: 0.243

Baseline Stop Token Metrics
---------------------------
at_least_one_stop_token: 0.425
all_stop_token: 0.027
attribution: 0.16032748647635703

Combined Stop Token Metrics
---------------------------
at_least_one_stop_token: 0.972
all_stop_token: 0.391
attribution: 0.6728618420210923

Simple Combined Stop Token Metrics
---------------------------
at_least_one_stop_token: 0.966
all_stop_token: 0.339
attribution: 0.630769327380457
