META DATA
---------
Model Name: BERT
Beam Size: 3
Gradient Model File: ../nli_attack_models/experiment_6/model_iter600_epoch0.th
Predictive Model File: ../nli_baseline_models/experiment_1/model.th
Baseline Model File: ../nli_baseline_models/anonymn/BERT_trained2_SNLI.th
Attack Target: premise
Cuda: True

BASELINE MODEL METRICS
----------------------------------------
average_sentence_length_before: 16.07
average_sentence_length_after: 2.32

COMBINED MODEL METRICS
----------------------------------------
average_sentence_length_before: 16.07
average_sentence_length_after: 2.583

SIMPLE COMBINED MODEL METRICS
-----------------------------
average_sentence_length_before: 16.07
average_sentence_length_after: 2.616

IOU: 0.2032751354653833

Baseline Stop Token Metrics
---------------------------
at_least_one_stop_token: 0.198
all_stop_token: 0.052
attribution: 0.09980444152424808

Combined Stop Token Metrics
---------------------------
at_least_one_stop_token: 0.687
all_stop_token: 0.436
attribution: 0.5518778422446149

Simple Combined Stop Token Metrics
----------------------------------
at_least_one_stop_token: 0.681
all_stop_token: 0.433
attribution: 0.5465346985956083
