--Train size: 80 Test size: 20--
---------RUN 1 ------------
Generate new embeddings files for a dataset
Read file: komninos_english_embeddings.gz
Added words: 13
:: Transform cmv_modes dataset ::
:: Create Train Matrix ::
Unknown-Tokens: 0.79%
:: Create Dev Matrix ::
Unknown-Tokens: 0.90%
:: Create Test Matrix ::
Unknown-Tokens: 0.90%
:: Transform cmv_modes1 dataset ::
:: Create Train Matrix ::
Unknown-Tokens: 0.79%
:: Create Dev Matrix ::
Unknown-Tokens: 0.90%
:: Create Test Matrix ::
Unknown-Tokens: 0.90%
:: Transform cmv_modes2 dataset ::
:: Create Train Matrix ::
Unknown-Tokens: 0.79%
:: Create Dev Matrix ::
Unknown-Tokens: 0.90%
:: Create Test Matrix ::
Unknown-Tokens: 0.90%
DONE - Embeddings file saved: pkl/cmv_modes_cmv_modes1_cmv_modes2_komninos_english_embeddings.pkl
--- cmv_modes ---
359 train sentences
5 dev sentences
97 test sentences
--- cmv_modes1 ---
359 train sentences
5 dev sentences
97 test sentences
--- cmv_modes2 ---
359 train sentences
5 dev sentences
97 test sentences
LSTM-Size: [100]
_____________________________________________________________________________________________________________________________
Layer (type)                             Output Shape               Param #        Connected to                              
=============================================================================================================================
words_input (InputLayer)                 (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
casing_input (InputLayer)                (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
word_embeddings (Embedding)              (None, None, 300)          66695700       words_input[0][0]                         
_____________________________________________________________________________________________________________________________
casing_emebddings (Embedding)            (None, None, 10)           80             casing_input[0][0]                        
_____________________________________________________________________________________________________________________________
concatenate_1 (Concatenate)              (None, None, 310)          0              word_embeddings[0][0]                     
                                                                                   casing_emebddings[0][0]                   
_____________________________________________________________________________________________________________________________
shared_varLSTM_1 (Bidirectional)         (None, None, 200)          328800         concatenate_1[0][0]                       
_____________________________________________________________________________________________________________________________
cmv_modes_hidden_lin_layer (TimeDistribu (None, None, 287)          57687          shared_varLSTM_1[0][0]                    
_____________________________________________________________________________________________________________________________
cmv_modes_crf (ChainCRF)                 (None, None, 287)          82943          cmv_modes_hidden_lin_layer[0][0]          
=============================================================================================================================
Total params: 67,165,210
Trainable params: 469,510
Non-trainable params: 66,695,700
_____________________________________________________________________________________________________________________________
_____________________________________________________________________________________________________________________________
Layer (type)                             Output Shape               Param #        Connected to                              
=============================================================================================================================
words_input (InputLayer)                 (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
casing_input (InputLayer)                (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
word_embeddings (Embedding)              (None, None, 300)          66695700       words_input[0][0]                         
_____________________________________________________________________________________________________________________________
casing_emebddings (Embedding)            (None, None, 10)           80             casing_input[0][0]                        
_____________________________________________________________________________________________________________________________
concatenate_1 (Concatenate)              (None, None, 310)          0              word_embeddings[0][0]                     
                                                                                   casing_emebddings[0][0]                   
_____________________________________________________________________________________________________________________________
shared_varLSTM_1 (Bidirectional)         (None, None, 200)          328800         concatenate_1[0][0]                       
_____________________________________________________________________________________________________________________________
cmv_modes1_hidden_lin_layer (TimeDistrib (None, None, 5)            1005           shared_varLSTM_1[0][0]                    
_____________________________________________________________________________________________________________________________
cmv_modes1_crf (ChainCRF)                (None, None, 5)            35             cmv_modes1_hidden_lin_layer[0][0]         
=============================================================================================================================
Total params: 67,025,620
Trainable params: 329,920
Non-trainable params: 66,695,700
_____________________________________________________________________________________________________________________________
_____________________________________________________________________________________________________________________________
Layer (type)                             Output Shape               Param #        Connected to                              
=============================================================================================================================
words_input (InputLayer)                 (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
casing_input (InputLayer)                (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
word_embeddings (Embedding)              (None, None, 300)          66695700       words_input[0][0]                         
_____________________________________________________________________________________________________________________________
casing_emebddings (Embedding)            (None, None, 10)           80             casing_input[0][0]                        
_____________________________________________________________________________________________________________________________
concatenate_1 (Concatenate)              (None, None, 310)          0              word_embeddings[0][0]                     
                                                                                   casing_emebddings[0][0]                   
_____________________________________________________________________________________________________________________________
shared_varLSTM_1 (Bidirectional)         (None, None, 200)          328800         concatenate_1[0][0]                       
_____________________________________________________________________________________________________________________________
cmv_modes2_softmax (TimeDistributed)     (None, None, 119)          23919          shared_varLSTM_1[0][0]                    
=============================================================================================================================
Total params: 67,048,499
Trainable params: 352,799
Non-trainable params: 66,695,700
_____________________________________________________________________________________________________________________________

--------- Epoch 1 -----------
339.97 sec for training (339.97 total)
-- cmv_modes1 --
{'C': {'precision': 0.0091324200913242, 'recall': 0.11764705882352941, 'f1-score': 0.01694915254237288, 'support': 17}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 24}, 'micro avg': {'precision': 0.004098360655737705, 'recall': 0.04878048780487805, 'f1-score': 0.007561436672967865, 'support': 41}, 'macro avg': {'precision': 0.0045662100456621, 'recall': 0.058823529411764705, 'f1-score': 0.00847457627118644, 'support': 41}, 'weighted avg': {'precision': 0.0037866132085978394, 'recall': 0.04878048780487805, 'f1-score': 0.007027697395618024, 'support': 41}}
Wrong BIO-Encoding 640/643 labels, 99.53%
{'C': {'precision': 0.0091324200913242, 'recall': 0.11764705882352941, 'f1-score': 0.01694915254237288, 'support': 17}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 24}, 'micro avg': {'precision': 0.004098360655737705, 'recall': 0.04878048780487805, 'f1-score': 0.007561436672967865, 'support': 41}, 'macro avg': {'precision': 0.0045662100456621, 'recall': 0.058823529411764705, 'f1-score': 0.00847457627118644, 'support': 41}, 'weighted avg': {'precision': 0.0037866132085978394, 'recall': 0.04878048780487805, 'f1-score': 0.007027697395618024, 'support': 41}}
Wrong BIO-Encoding 485/488 labels, 99.39%
Dev-Data: Prec: 0.004, Rec: 0.049, F1: 0.0076
{'C': {'precision': 0.0008970621215519175, 'recall': 0.013157894736842105, 'f1-score': 0.001679613688851564, 'support': 304}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 333}, 'micro avg': {'precision': 0.00040326645831232987, 'recall': 0.006279434850863423, 'f1-score': 0.0007578628268283441, 'support': 637}, 'macro avg': {'precision': 0.00044853106077595876, 'recall': 0.006578947368421052, 'f1-score': 0.000839806844425782, 'support': 637}, 'weighted avg': {'precision': 0.00042811127935915685, 'recall': 0.006279434850863423, 'f1-score': 0.0008015738797658955, 'support': 637}}
Wrong BIO-Encoding 12946/13251 labels, 97.70%
{'C': {'precision': 0.0008970621215519175, 'recall': 0.013157894736842105, 'f1-score': 0.001679613688851564, 'support': 304}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 333}, 'micro avg': {'precision': 0.00040326645831232987, 'recall': 0.006279434850863423, 'f1-score': 0.0007578628268283441, 'support': 637}, 'macro avg': {'precision': 0.00044853106077595876, 'recall': 0.006578947368421052, 'f1-score': 0.000839806844425782, 'support': 637}, 'weighted avg': {'precision': 0.00042811127935915685, 'recall': 0.006279434850863423, 'f1-score': 0.0008015738797658955, 'support': 637}}
Wrong BIO-Encoding 9614/9919 labels, 96.93%
Test-Data: Prec: 0.003, Rec: 0.002, F1: 0.0021

Scores from epoch with best dev-scores:
  Dev-Score: 0.0076
  Test-Score 0.0021

6.08 sec for evaluation

--------- Epoch 2 -----------
330.81 sec for training (670.79 total)
-- cmv_modes1 --
{'C': {'precision': 0.1, 'recall': 0.058823529411764705, 'f1-score': 0.07407407407407408, 'support': 17}, 'P': {'precision': 0.1, 'recall': 0.08333333333333333, 'f1-score': 0.0909090909090909, 'support': 24}, 'micro avg': {'precision': 0.1, 'recall': 0.07317073170731707, 'f1-score': 0.08450704225352113, 'support': 41}, 'macro avg': {'precision': 0.1, 'recall': 0.07107843137254902, 'f1-score': 0.08249158249158249, 'support': 41}, 'weighted avg': {'precision': 0.10000000000000002, 'recall': 0.07317073170731707, 'f1-score': 0.08392871807505954, 'support': 41}}
Wrong BIO-Encoding 538/554 labels, 97.11%
{'C': {'precision': 0.1, 'recall': 0.058823529411764705, 'f1-score': 0.07407407407407408, 'support': 17}, 'P': {'precision': 0.1, 'recall': 0.08333333333333333, 'f1-score': 0.0909090909090909, 'support': 24}, 'micro avg': {'precision': 0.1, 'recall': 0.07317073170731707, 'f1-score': 0.08450704225352113, 'support': 41}, 'macro avg': {'precision': 0.1, 'recall': 0.07107843137254902, 'f1-score': 0.08249158249158249, 'support': 41}, 'weighted avg': {'precision': 0.10000000000000002, 'recall': 0.07317073170731707, 'f1-score': 0.08392871807505954, 'support': 41}}
Wrong BIO-Encoding 14/30 labels, 46.67%
Dev-Data: Prec: 0.188, Rec: 0.073, F1: 0.1053
{'C': {'precision': 0.006928406466512702, 'recall': 0.009868421052631578, 'f1-score': 0.00814111261872456, 'support': 304}, 'P': {'precision': 0.0014064697609001407, 'recall': 0.003003003003003003, 'f1-score': 0.0019157088122605367, 'support': 333}, 'micro avg': {'precision': 0.0034965034965034965, 'recall': 0.006279434850863423, 'f1-score': 0.004491858506457047, 'support': 637}, 'macro avg': {'precision': 0.004167438113706422, 'recall': 0.006435712027817291, 'f1-score': 0.0050284107154925485, 'support': 637}, 'weighted avg': {'precision': 0.004041742537205037, 'recall': 0.006279434850863423, 'f1-score': 0.004886702151609144, 'support': 637}}
Wrong BIO-Encoding 10561/11017 labels, 95.86%
{'C': {'precision': 0.006928406466512702, 'recall': 0.009868421052631578, 'f1-score': 0.00814111261872456, 'support': 304}, 'P': {'precision': 0.0014064697609001407, 'recall': 0.003003003003003003, 'f1-score': 0.0019157088122605367, 'support': 333}, 'micro avg': {'precision': 0.0034965034965034965, 'recall': 0.006279434850863423, 'f1-score': 0.004491858506457047, 'support': 637}, 'macro avg': {'precision': 0.004167438113706422, 'recall': 0.006435712027817291, 'f1-score': 0.0050284107154925485, 'support': 637}, 'weighted avg': {'precision': 0.004041742537205037, 'recall': 0.006279434850863423, 'f1-score': 0.004886702151609144, 'support': 637}}
Wrong BIO-Encoding 688/1144 labels, 60.14%
Test-Data: Prec: 0.007, Rec: 0.005, F1: 0.0055

Scores from epoch with best dev-scores:
  Dev-Score: 0.1053
  Test-Score 0.0055

4.70 sec for evaluation

--------- Epoch 3 -----------
336.36 sec for training (1007.15 total)
-- cmv_modes1 --
{'C': {'precision': 0.08, 'recall': 0.11764705882352941, 'f1-score': 0.09523809523809526, 'support': 17}, 'P': {'precision': 0.10344827586206896, 'recall': 0.125, 'f1-score': 0.11320754716981132, 'support': 24}, 'micro avg': {'precision': 0.09259259259259259, 'recall': 0.12195121951219512, 'f1-score': 0.10526315789473684, 'support': 41}, 'macro avg': {'precision': 0.09172413793103448, 'recall': 0.1213235294117647, 'f1-score': 0.10422282120395329, 'support': 41}, 'weighted avg': {'precision': 0.09372582001682085, 'recall': 0.12195121951219512, 'f1-score': 0.10575679880788028, 'support': 41}}
Wrong BIO-Encoding 175/209 labels, 83.73%
{'C': {'precision': 0.08, 'recall': 0.11764705882352941, 'f1-score': 0.09523809523809526, 'support': 17}, 'P': {'precision': 0.10344827586206896, 'recall': 0.125, 'f1-score': 0.11320754716981132, 'support': 24}, 'micro avg': {'precision': 0.09259259259259259, 'recall': 0.12195121951219512, 'f1-score': 0.10526315789473684, 'support': 41}, 'macro avg': {'precision': 0.09172413793103448, 'recall': 0.1213235294117647, 'f1-score': 0.10422282120395329, 'support': 41}, 'weighted avg': {'precision': 0.09372582001682085, 'recall': 0.12195121951219512, 'f1-score': 0.10575679880788028, 'support': 41}}
Wrong BIO-Encoding 20/54 labels, 37.04%
Dev-Data: Prec: 0.147, Rec: 0.122, F1: 0.1333
{'C': {'precision': 0.016666666666666666, 'recall': 0.02631578947368421, 'f1-score': 0.020408163265306124, 'support': 304}, 'P': {'precision': 0.0018867924528301887, 'recall': 0.003003003003003003, 'f1-score': 0.002317497103128621, 'support': 333}, 'micro avg': {'precision': 0.00891089108910891, 'recall': 0.0141287284144427, 'f1-score': 0.010928961748633878, 'support': 637}, 'macro avg': {'precision': 0.009276729559748427, 'recall': 0.014659396238343607, 'f1-score': 0.011362830184217373, 'support': 637}, 'weighted avg': {'precision': 0.008940296002290612, 'recall': 0.0141287284144427, 'f1-score': 0.010951033230761213, 'support': 637}}
Wrong BIO-Encoding 5291/5865 labels, 90.21%
{'C': {'precision': 0.016666666666666666, 'recall': 0.02631578947368421, 'f1-score': 0.020408163265306124, 'support': 304}, 'P': {'precision': 0.0018867924528301887, 'recall': 0.003003003003003003, 'f1-score': 0.002317497103128621, 'support': 333}, 'micro avg': {'precision': 0.00891089108910891, 'recall': 0.0141287284144427, 'f1-score': 0.010928961748633878, 'support': 637}, 'macro avg': {'precision': 0.009276729559748427, 'recall': 0.014659396238343607, 'f1-score': 0.011362830184217373, 'support': 637}, 'weighted avg': {'precision': 0.008940296002290612, 'recall': 0.0141287284144427, 'f1-score': 0.010951033230761213, 'support': 637}}
Wrong BIO-Encoding 436/1010 labels, 43.17%
Test-Data: Prec: 0.016, Rec: 0.014, F1: 0.0149

Scores from epoch with best dev-scores:
  Dev-Score: 0.1333
  Test-Score 0.0149

5.60 sec for evaluation

--------- Epoch 4 -----------
338.59 sec for training (1345.73 total)
-- cmv_modes1 --
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 17}, 'P': {'precision': 0.3076923076923077, 'recall': 0.3333333333333333, 'f1-score': 0.32, 'support': 24}, 'micro avg': {'precision': 0.26666666666666666, 'recall': 0.1951219512195122, 'f1-score': 0.22535211267605634, 'support': 41}, 'macro avg': {'precision': 0.15384615384615385, 'recall': 0.16666666666666666, 'f1-score': 0.16, 'support': 41}, 'weighted avg': {'precision': 0.1801125703564728, 'recall': 0.1951219512195122, 'f1-score': 0.1873170731707317, 'support': 41}}
Wrong BIO-Encoding 69/95 labels, 72.63%
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 17}, 'P': {'precision': 0.3076923076923077, 'recall': 0.3333333333333333, 'f1-score': 0.32, 'support': 24}, 'micro avg': {'precision': 0.26666666666666666, 'recall': 0.1951219512195122, 'f1-score': 0.22535211267605634, 'support': 41}, 'macro avg': {'precision': 0.15384615384615385, 'recall': 0.16666666666666666, 'f1-score': 0.16, 'support': 41}, 'weighted avg': {'precision': 0.1801125703564728, 'recall': 0.1951219512195122, 'f1-score': 0.1873170731707317, 'support': 41}}
Wrong BIO-Encoding 4/30 labels, 13.33%
Dev-Data: Prec: 0.308, Rec: 0.195, F1: 0.2388
{'C': {'precision': 0.06936416184971098, 'recall': 0.039473684210526314, 'f1-score': 0.05031446540880503, 'support': 304}, 'P': {'precision': 0.027210884353741496, 'recall': 0.036036036036036036, 'f1-score': 0.031007751937984496, 'support': 333}, 'micro avg': {'precision': 0.03908794788273615, 'recall': 0.03767660910518053, 'f1-score': 0.03836930455635491, 'support': 637}, 'macro avg': {'precision': 0.04828752310172624, 'recall': 0.03775486012328118, 'f1-score': 0.04066110867339476, 'support': 637}, 'weighted avg': {'precision': 0.04732799009750087, 'recall': 0.03767660910518053, 'f1-score': 0.04022163089423166, 'support': 637}}
Wrong BIO-Encoding 2438/2921 labels, 83.46%
{'C': {'precision': 0.06936416184971098, 'recall': 0.039473684210526314, 'f1-score': 0.05031446540880503, 'support': 304}, 'P': {'precision': 0.027210884353741496, 'recall': 0.036036036036036036, 'f1-score': 0.031007751937984496, 'support': 333}, 'micro avg': {'precision': 0.03908794788273615, 'recall': 0.03767660910518053, 'f1-score': 0.03836930455635491, 'support': 637}, 'macro avg': {'precision': 0.04828752310172624, 'recall': 0.03775486012328118, 'f1-score': 0.04066110867339476, 'support': 637}, 'weighted avg': {'precision': 0.04732799009750087, 'recall': 0.03767660910518053, 'f1-score': 0.04022163089423166, 'support': 637}}
Wrong BIO-Encoding 131/614 labels, 21.34%
Test-Data: Prec: 0.050, Rec: 0.038, F1: 0.0429

Scores from epoch with best dev-scores:
  Dev-Score: 0.2388
  Test-Score 0.0429

5.24 sec for evaluation

--------- Epoch 5 -----------
337.80 sec for training (1683.53 total)
-- cmv_modes1 --
{'C': {'precision': 0.3333333333333333, 'recall': 0.058823529411764705, 'f1-score': 0.1, 'support': 17}, 'P': {'precision': 0.25, 'recall': 0.3333333333333333, 'f1-score': 0.28571428571428575, 'support': 24}, 'micro avg': {'precision': 0.2571428571428571, 'recall': 0.21951219512195122, 'f1-score': 0.2368421052631579, 'support': 41}, 'macro avg': {'precision': 0.29166666666666663, 'recall': 0.19607843137254902, 'f1-score': 0.1928571428571429, 'support': 41}, 'weighted avg': {'precision': 0.2845528455284553, 'recall': 0.21951219512195122, 'f1-score': 0.20871080139372822, 'support': 41}}
Wrong BIO-Encoding 18/51 labels, 35.29%
{'C': {'precision': 0.3333333333333333, 'recall': 0.058823529411764705, 'f1-score': 0.1, 'support': 17}, 'P': {'precision': 0.25, 'recall': 0.3333333333333333, 'f1-score': 0.28571428571428575, 'support': 24}, 'micro avg': {'precision': 0.2571428571428571, 'recall': 0.21951219512195122, 'f1-score': 0.2368421052631579, 'support': 41}, 'macro avg': {'precision': 0.29166666666666663, 'recall': 0.19607843137254902, 'f1-score': 0.1928571428571429, 'support': 41}, 'weighted avg': {'precision': 0.2845528455284553, 'recall': 0.21951219512195122, 'f1-score': 0.20871080139372822, 'support': 41}}
Wrong BIO-Encoding 2/35 labels, 5.71%
Dev-Data: Prec: 0.273, Rec: 0.220, F1: 0.2432
{'C': {'precision': 0.10084033613445378, 'recall': 0.039473684210526314, 'f1-score': 0.056737588652482275, 'support': 304}, 'P': {'precision': 0.05789473684210526, 'recall': 0.0990990990990991, 'f1-score': 0.07308970099667773, 'support': 333}, 'micro avg': {'precision': 0.06531204644412192, 'recall': 0.0706436420722135, 'f1-score': 0.06787330316742081, 'support': 637}, 'macro avg': {'precision': 0.07936753648827952, 'recall': 0.0692863916548127, 'f1-score': 0.06491364482458001, 'support': 637}, 'weighted avg': {'precision': 0.07838996790156201, 'recall': 0.0706436420722135, 'f1-score': 0.06528586716208523, 'support': 637}}
Wrong BIO-Encoding 922/1542 labels, 59.79%
{'C': {'precision': 0.10084033613445378, 'recall': 0.039473684210526314, 'f1-score': 0.056737588652482275, 'support': 304}, 'P': {'precision': 0.05789473684210526, 'recall': 0.0990990990990991, 'f1-score': 0.07308970099667773, 'support': 333}, 'micro avg': {'precision': 0.06531204644412192, 'recall': 0.0706436420722135, 'f1-score': 0.06787330316742081, 'support': 637}, 'macro avg': {'precision': 0.07936753648827952, 'recall': 0.0692863916548127, 'f1-score': 0.06491364482458001, 'support': 637}, 'weighted avg': {'precision': 0.07838996790156201, 'recall': 0.0706436420722135, 'f1-score': 0.06528586716208523, 'support': 637}}
Wrong BIO-Encoding 69/689 labels, 10.01%
Test-Data: Prec: 0.073, Rec: 0.071, F1: 0.0716

Scores from epoch with best dev-scores:
  Dev-Score: 0.2432
  Test-Score 0.0716

5.25 sec for evaluation

--------- Epoch 6 -----------
336.76 sec for training (2020.29 total)
-- cmv_modes1 --
{'C': {'precision': 0.3333333333333333, 'recall': 0.058823529411764705, 'f1-score': 0.1, 'support': 17}, 'P': {'precision': 0.14814814814814814, 'recall': 0.16666666666666666, 'f1-score': 0.15686274509803924, 'support': 24}, 'micro avg': {'precision': 0.16666666666666666, 'recall': 0.12195121951219512, 'f1-score': 0.14084507042253522, 'support': 41}, 'macro avg': {'precision': 0.24074074074074073, 'recall': 0.11274509803921567, 'f1-score': 0.12843137254901962, 'support': 41}, 'weighted avg': {'precision': 0.2249322493224932, 'recall': 0.12195121951219512, 'f1-score': 0.1332855093256815, 'support': 41}}
Wrong BIO-Encoding 10/38 labels, 26.32%
{'C': {'precision': 0.3333333333333333, 'recall': 0.058823529411764705, 'f1-score': 0.1, 'support': 17}, 'P': {'precision': 0.14814814814814814, 'recall': 0.16666666666666666, 'f1-score': 0.15686274509803924, 'support': 24}, 'micro avg': {'precision': 0.16666666666666666, 'recall': 0.12195121951219512, 'f1-score': 0.14084507042253522, 'support': 41}, 'macro avg': {'precision': 0.24074074074074073, 'recall': 0.11274509803921567, 'f1-score': 0.12843137254901962, 'support': 41}, 'weighted avg': {'precision': 0.2249322493224932, 'recall': 0.12195121951219512, 'f1-score': 0.1332855093256815, 'support': 41}}
Wrong BIO-Encoding 2/30 labels, 6.67%
Dev-Data: Prec: 0.179, Rec: 0.122, F1: 0.1449
{'C': {'precision': 0.14, 'recall': 0.046052631578947366, 'f1-score': 0.06930693069306931, 'support': 304}, 'P': {'precision': 0.1137855579868709, 'recall': 0.15615615615615616, 'f1-score': 0.13164556962025317, 'support': 333}, 'micro avg': {'precision': 0.118491921005386, 'recall': 0.10361067503924647, 'f1-score': 0.11055276381909548, 'support': 637}, 'macro avg': {'precision': 0.12689277899343546, 'recall': 0.10110439386755177, 'f1-score': 0.10047625015666124, 'support': 637}, 'weighted avg': {'precision': 0.12629606092563267, 'recall': 0.10361067503924647, 'f1-score': 0.1018952615608122, 'support': 637}}
Wrong BIO-Encoding 1041/1526 labels, 68.22%
{'C': {'precision': 0.14, 'recall': 0.046052631578947366, 'f1-score': 0.06930693069306931, 'support': 304}, 'P': {'precision': 0.1137855579868709, 'recall': 0.15615615615615616, 'f1-score': 0.13164556962025317, 'support': 333}, 'micro avg': {'precision': 0.118491921005386, 'recall': 0.10361067503924647, 'f1-score': 0.11055276381909548, 'support': 637}, 'macro avg': {'precision': 0.12689277899343546, 'recall': 0.10110439386755177, 'f1-score': 0.10047625015666124, 'support': 637}, 'weighted avg': {'precision': 0.12629606092563267, 'recall': 0.10361067503924647, 'f1-score': 0.1018952615608122, 'support': 637}}
Wrong BIO-Encoding 72/557 labels, 12.93%
Test-Data: Prec: 0.136, Rec: 0.104, F1: 0.1176

Scores from epoch with best dev-scores:
  Dev-Score: 0.2432
  Test-Score 0.0716

4.59 sec for evaluation

--------- Epoch 7 -----------
336.86 sec for training (2357.16 total)
-- cmv_modes1 --
{'C': {'precision': 0.16666666666666666, 'recall': 0.11764705882352941, 'f1-score': 0.13793103448275862, 'support': 17}, 'P': {'precision': 0.125, 'recall': 0.16666666666666666, 'f1-score': 0.14285714285714288, 'support': 24}, 'micro avg': {'precision': 0.13636363636363635, 'recall': 0.14634146341463414, 'f1-score': 0.14117647058823526, 'support': 41}, 'macro avg': {'precision': 0.14583333333333331, 'recall': 0.14215686274509803, 'f1-score': 0.14039408866995073, 'support': 41}, 'weighted avg': {'precision': 0.14227642276422764, 'recall': 0.14634146341463414, 'f1-score': 0.14081461011654453, 'support': 41}}
Wrong BIO-Encoding 26/67 labels, 38.81%
{'C': {'precision': 0.16666666666666666, 'recall': 0.11764705882352941, 'f1-score': 0.13793103448275862, 'support': 17}, 'P': {'precision': 0.125, 'recall': 0.16666666666666666, 'f1-score': 0.14285714285714288, 'support': 24}, 'micro avg': {'precision': 0.13636363636363635, 'recall': 0.14634146341463414, 'f1-score': 0.14117647058823526, 'support': 41}, 'macro avg': {'precision': 0.14583333333333331, 'recall': 0.14215686274509803, 'f1-score': 0.14039408866995073, 'support': 41}, 'weighted avg': {'precision': 0.14227642276422764, 'recall': 0.14634146341463414, 'f1-score': 0.14081461011654453, 'support': 41}}
Wrong BIO-Encoding 3/44 labels, 6.82%
Dev-Data: Prec: 0.146, Rec: 0.146, F1: 0.1463
{'C': {'precision': 0.18238993710691823, 'recall': 0.19078947368421054, 'f1-score': 0.1864951768488746, 'support': 304}, 'P': {'precision': 0.14978902953586498, 'recall': 0.2132132132132132, 'f1-score': 0.17596034696406443, 'support': 333}, 'micro avg': {'precision': 0.16287878787878787, 'recall': 0.20251177394034536, 'f1-score': 0.18054583624912526, 'support': 637}, 'macro avg': {'precision': 0.16608948332139162, 'recall': 0.20200134344871187, 'f1-score': 0.1812277619064695, 'support': 637}, 'weighted avg': {'precision': 0.1653473904488951, 'recall': 0.20251177394034536, 'f1-score': 0.1809879580864856, 'support': 637}}
Wrong BIO-Encoding 858/1602 labels, 53.56%
{'C': {'precision': 0.18238993710691823, 'recall': 0.19078947368421054, 'f1-score': 0.1864951768488746, 'support': 304}, 'P': {'precision': 0.14978902953586498, 'recall': 0.2132132132132132, 'f1-score': 0.17596034696406443, 'support': 333}, 'micro avg': {'precision': 0.16287878787878787, 'recall': 0.20251177394034536, 'f1-score': 0.18054583624912526, 'support': 637}, 'macro avg': {'precision': 0.16608948332139162, 'recall': 0.20200134344871187, 'f1-score': 0.1812277619064695, 'support': 637}, 'weighted avg': {'precision': 0.1653473904488951, 'recall': 0.20251177394034536, 'f1-score': 0.1809879580864856, 'support': 637}}
Wrong BIO-Encoding 48/792 labels, 6.06%
Test-Data: Prec: 0.173, Rec: 0.203, F1: 0.1868

Scores from epoch with best dev-scores:
  Dev-Score: 0.2432
  Test-Score 0.0716

4.55 sec for evaluation

--------- Epoch 8 -----------
336.90 sec for training (2694.05 total)
-- cmv_modes1 --
{'C': {'precision': 0.14285714285714285, 'recall': 0.11764705882352941, 'f1-score': 0.12903225806451615, 'support': 17}, 'P': {'precision': 0.23076923076923078, 'recall': 0.25, 'f1-score': 0.24000000000000002, 'support': 24}, 'micro avg': {'precision': 0.2, 'recall': 0.1951219512195122, 'f1-score': 0.19753086419753088, 'support': 41}, 'macro avg': {'precision': 0.18681318681318682, 'recall': 0.18382352941176472, 'f1-score': 0.18451612903225809, 'support': 41}, 'weighted avg': {'precision': 0.1943178772447065, 'recall': 0.1951219512195122, 'f1-score': 0.19398898505114087, 'support': 41}}
Wrong BIO-Encoding 19/57 labels, 33.33%
{'C': {'precision': 0.14285714285714285, 'recall': 0.11764705882352941, 'f1-score': 0.12903225806451615, 'support': 17}, 'P': {'precision': 0.23076923076923078, 'recall': 0.25, 'f1-score': 0.24000000000000002, 'support': 24}, 'micro avg': {'precision': 0.2, 'recall': 0.1951219512195122, 'f1-score': 0.19753086419753088, 'support': 41}, 'macro avg': {'precision': 0.18681318681318682, 'recall': 0.18382352941176472, 'f1-score': 0.18451612903225809, 'support': 41}, 'weighted avg': {'precision': 0.1943178772447065, 'recall': 0.1951219512195122, 'f1-score': 0.19398898505114087, 'support': 41}}
Wrong BIO-Encoding 2/40 labels, 5.00%
Dev-Data: Prec: 0.211, Rec: 0.195, F1: 0.2025
{'C': {'precision': 0.19612590799031476, 'recall': 0.26644736842105265, 'f1-score': 0.22594142259414224, 'support': 304}, 'P': {'precision': 0.17333333333333334, 'recall': 0.15615615615615616, 'f1-score': 0.16429699842022116, 'support': 333}, 'micro avg': {'precision': 0.18653576437587657, 'recall': 0.2087912087912088, 'f1-score': 0.19703703703703704, 'support': 637}, 'macro avg': {'precision': 0.18472962066182405, 'recall': 0.21130176228860442, 'f1-score': 0.1951192105071817, 'support': 637}, 'weighted avg': {'precision': 0.18421079439412194, 'recall': 0.2087912087912088, 'f1-score': 0.19371600147967485, 'support': 637}}
Wrong BIO-Encoding 756/1429 labels, 52.90%
{'C': {'precision': 0.19612590799031476, 'recall': 0.26644736842105265, 'f1-score': 0.22594142259414224, 'support': 304}, 'P': {'precision': 0.17333333333333334, 'recall': 0.15615615615615616, 'f1-score': 0.16429699842022116, 'support': 333}, 'micro avg': {'precision': 0.18653576437587657, 'recall': 0.2087912087912088, 'f1-score': 0.19703703703703704, 'support': 637}, 'macro avg': {'precision': 0.18472962066182405, 'recall': 0.21130176228860442, 'f1-score': 0.1951192105071817, 'support': 637}, 'weighted avg': {'precision': 0.18421079439412194, 'recall': 0.2087912087912088, 'f1-score': 0.19371600147967485, 'support': 637}}
Wrong BIO-Encoding 40/713 labels, 5.61%
Test-Data: Prec: 0.198, Rec: 0.209, F1: 0.2031

Scores from epoch with best dev-scores:
  Dev-Score: 0.2432
  Test-Score 0.0716

4.58 sec for evaluation

--------- Epoch 9 -----------
337.92 sec for training (3031.98 total)
-- cmv_modes1 --
{'C': {'precision': 0.18181818181818182, 'recall': 0.11764705882352941, 'f1-score': 0.14285714285714285, 'support': 17}, 'P': {'precision': 0.125, 'recall': 0.125, 'f1-score': 0.125, 'support': 24}, 'micro avg': {'precision': 0.14285714285714285, 'recall': 0.12195121951219512, 'f1-score': 0.13157894736842105, 'support': 41}, 'macro avg': {'precision': 0.1534090909090909, 'recall': 0.1213235294117647, 'f1-score': 0.13392857142857142, 'support': 41}, 'weighted avg': {'precision': 0.14855875831485588, 'recall': 0.12195121951219512, 'f1-score': 0.13240418118466898, 'support': 41}}
{'C': {'precision': 0.18181818181818182, 'recall': 0.11764705882352941, 'f1-score': 0.14285714285714285, 'support': 17}, 'P': {'precision': 0.125, 'recall': 0.125, 'f1-score': 0.125, 'support': 24}, 'micro avg': {'precision': 0.14285714285714285, 'recall': 0.12195121951219512, 'f1-score': 0.13157894736842105, 'support': 41}, 'macro avg': {'precision': 0.1534090909090909, 'recall': 0.1213235294117647, 'f1-score': 0.13392857142857142, 'support': 41}, 'weighted avg': {'precision': 0.14855875831485588, 'recall': 0.12195121951219512, 'f1-score': 0.13240418118466898, 'support': 41}}
Dev-Data: Prec: 0.143, Rec: 0.122, F1: 0.1316
{'C': {'precision': 0.20670391061452514, 'recall': 0.24342105263157895, 'f1-score': 0.22356495468277948, 'support': 304}, 'P': {'precision': 0.3263888888888889, 'recall': 0.2822822822822823, 'f1-score': 0.3027375201288245, 'support': 333}, 'micro avg': {'precision': 0.26006191950464397, 'recall': 0.26373626373626374, 'f1-score': 0.26188620420888536, 'support': 637}, 'macro avg': {'precision': 0.266546399751707, 'recall': 0.2628516674569306, 'f1-score': 0.263151237405802, 'support': 637}, 'weighted avg': {'precision': 0.2692707830876227, 'recall': 0.26373626373626374, 'f1-score': 0.2649534386600683, 'support': 637}}
Wrong BIO-Encoding 1030/1629 labels, 63.23%
{'C': {'precision': 0.20670391061452514, 'recall': 0.24342105263157895, 'f1-score': 0.22356495468277948, 'support': 304}, 'P': {'precision': 0.3263888888888889, 'recall': 0.2822822822822823, 'f1-score': 0.3027375201288245, 'support': 333}, 'micro avg': {'precision': 0.26006191950464397, 'recall': 0.26373626373626374, 'f1-score': 0.26188620420888536, 'support': 637}, 'macro avg': {'precision': 0.266546399751707, 'recall': 0.2628516674569306, 'f1-score': 0.263151237405802, 'support': 637}, 'weighted avg': {'precision': 0.2692707830876227, 'recall': 0.26373626373626374, 'f1-score': 0.2649534386600683, 'support': 637}}
Wrong BIO-Encoding 47/646 labels, 7.28%
Test-Data: Prec: 0.280, Rec: 0.264, F1: 0.2718

Scores from epoch with best dev-scores:
  Dev-Score: 0.2432
  Test-Score 0.0716

4.52 sec for evaluation

--------- Epoch 10 -----------
343.63 sec for training (3375.61 total)
-- cmv_modes1 --
{'C': {'precision': 0.1111111111111111, 'recall': 0.058823529411764705, 'f1-score': 0.07692307692307691, 'support': 17}, 'P': {'precision': 0.16666666666666666, 'recall': 0.16666666666666666, 'f1-score': 0.16666666666666666, 'support': 24}, 'micro avg': {'precision': 0.15151515151515152, 'recall': 0.12195121951219512, 'f1-score': 0.13513513513513514, 'support': 41}, 'macro avg': {'precision': 0.1388888888888889, 'recall': 0.11274509803921567, 'f1-score': 0.12179487179487178, 'support': 41}, 'weighted avg': {'precision': 0.14363143631436315, 'recall': 0.12195121951219512, 'f1-score': 0.1294559099437148, 'support': 41}}
{'C': {'precision': 0.1111111111111111, 'recall': 0.058823529411764705, 'f1-score': 0.07692307692307691, 'support': 17}, 'P': {'precision': 0.16666666666666666, 'recall': 0.16666666666666666, 'f1-score': 0.16666666666666666, 'support': 24}, 'micro avg': {'precision': 0.15151515151515152, 'recall': 0.12195121951219512, 'f1-score': 0.13513513513513514, 'support': 41}, 'macro avg': {'precision': 0.1388888888888889, 'recall': 0.11274509803921567, 'f1-score': 0.12179487179487178, 'support': 41}, 'weighted avg': {'precision': 0.14363143631436315, 'recall': 0.12195121951219512, 'f1-score': 0.1294559099437148, 'support': 41}}
Dev-Data: Prec: 0.152, Rec: 0.122, F1: 0.1351
{'C': {'precision': 0.21153846153846154, 'recall': 0.2532894736842105, 'f1-score': 0.2305389221556886, 'support': 304}, 'P': {'precision': 0.2591240875912409, 'recall': 0.2132132132132132, 'f1-score': 0.23393739703459637, 'support': 333}, 'micro avg': {'precision': 0.23197492163009403, 'recall': 0.23233908948194662, 'f1-score': 0.23215686274509806, 'support': 637}, 'macro avg': {'precision': 0.2353312745648512, 'recall': 0.23325134344871185, 'f1-score': 0.2322381595951425, 'support': 637}, 'weighted avg': {'precision': 0.2364144638549066, 'recall': 0.23233908948194662, 'f1-score': 0.23231551891342217, 'support': 637}}
Wrong BIO-Encoding 459/1072 labels, 42.82%
{'C': {'precision': 0.21153846153846154, 'recall': 0.2532894736842105, 'f1-score': 0.2305389221556886, 'support': 304}, 'P': {'precision': 0.2591240875912409, 'recall': 0.2132132132132132, 'f1-score': 0.23393739703459637, 'support': 333}, 'micro avg': {'precision': 0.23197492163009403, 'recall': 0.23233908948194662, 'f1-score': 0.23215686274509806, 'support': 637}, 'macro avg': {'precision': 0.2353312745648512, 'recall': 0.23325134344871185, 'f1-score': 0.2322381595951425, 'support': 637}, 'weighted avg': {'precision': 0.2364144638549066, 'recall': 0.23233908948194662, 'f1-score': 0.23231551891342217, 'support': 637}}
Wrong BIO-Encoding 25/638 labels, 3.92%
Test-Data: Prec: 0.241, Rec: 0.232, F1: 0.2368

Scores from epoch with best dev-scores:
  Dev-Score: 0.2432
  Test-Score 0.0716

4.45 sec for evaluation

--------- Epoch 11 -----------
336.89 sec for training (3712.49 total)
-- cmv_modes1 --
{'C': {'precision': 0.6, 'recall': 0.17647058823529413, 'f1-score': 0.2727272727272727, 'support': 17}, 'P': {'precision': 0.3103448275862069, 'recall': 0.375, 'f1-score': 0.339622641509434, 'support': 24}, 'micro avg': {'precision': 0.35294117647058826, 'recall': 0.2926829268292683, 'f1-score': 0.32, 'support': 41}, 'macro avg': {'precision': 0.45517241379310347, 'recall': 0.2757352941176471, 'f1-score': 0.30617495711835335, 'support': 41}, 'weighted avg': {'precision': 0.43044575273338936, 'recall': 0.2926829268292683, 'f1-score': 0.3118855373802452, 'support': 41}}
{'C': {'precision': 0.6, 'recall': 0.17647058823529413, 'f1-score': 0.2727272727272727, 'support': 17}, 'P': {'precision': 0.3103448275862069, 'recall': 0.375, 'f1-score': 0.339622641509434, 'support': 24}, 'micro avg': {'precision': 0.35294117647058826, 'recall': 0.2926829268292683, 'f1-score': 0.32, 'support': 41}, 'macro avg': {'precision': 0.45517241379310347, 'recall': 0.2757352941176471, 'f1-score': 0.30617495711835335, 'support': 41}, 'weighted avg': {'precision': 0.43044575273338936, 'recall': 0.2926829268292683, 'f1-score': 0.3118855373802452, 'support': 41}}
Dev-Data: Prec: 0.353, Rec: 0.293, F1: 0.3200
{'C': {'precision': 0.16352201257861634, 'recall': 0.08552631578947369, 'f1-score': 0.11231101511879049, 'support': 304}, 'P': {'precision': 0.19004524886877827, 'recall': 0.25225225225225223, 'f1-score': 0.2167741935483871, 'support': 333}, 'micro avg': {'precision': 0.18302828618968386, 'recall': 0.1726844583987441, 'f1-score': 0.1777059773828756, 'support': 637}, 'macro avg': {'precision': 0.1767836307236973, 'recall': 0.16888928402086295, 'f1-score': 0.1645426043335888, 'support': 637}, 'weighted avg': {'precision': 0.17738737786060052, 'recall': 0.17268445839874408, 'f1-score': 0.16692049458041636, 'support': 637}}
Wrong BIO-Encoding 829/1398 labels, 59.30%
{'C': {'precision': 0.16352201257861634, 'recall': 0.08552631578947369, 'f1-score': 0.11231101511879049, 'support': 304}, 'P': {'precision': 0.19004524886877827, 'recall': 0.25225225225225223, 'f1-score': 0.2167741935483871, 'support': 333}, 'micro avg': {'precision': 0.18302828618968386, 'recall': 0.1726844583987441, 'f1-score': 0.1777059773828756, 'support': 637}, 'macro avg': {'precision': 0.1767836307236973, 'recall': 0.16888928402086295, 'f1-score': 0.1645426043335888, 'support': 637}, 'weighted avg': {'precision': 0.17738737786060052, 'recall': 0.17268445839874408, 'f1-score': 0.16692049458041636, 'support': 637}}
Wrong BIO-Encoding 32/601 labels, 5.32%
Test-Data: Prec: 0.193, Rec: 0.173, F1: 0.1824

Scores from epoch with best dev-scores:
  Dev-Score: 0.3200
  Test-Score 0.1824

5.16 sec for evaluation

--------- Epoch 12 -----------
333.75 sec for training (4046.24 total)
-- cmv_modes1 --
{'C': {'precision': 0.38461538461538464, 'recall': 0.29411764705882354, 'f1-score': 0.33333333333333337, 'support': 17}, 'P': {'precision': 0.08695652173913043, 'recall': 0.08333333333333333, 'f1-score': 0.0851063829787234, 'support': 24}, 'micro avg': {'precision': 0.19444444444444445, 'recall': 0.17073170731707318, 'f1-score': 0.18181818181818182, 'support': 41}, 'macro avg': {'precision': 0.23578595317725753, 'recall': 0.18872549019607843, 'f1-score': 0.2092198581560284, 'support': 41}, 'weighted avg': {'precision': 0.2103760502487968, 'recall': 0.17073170731707318, 'f1-score': 0.18802975263795194, 'support': 41}}
Wrong BIO-Encoding 19/54 labels, 35.19%
{'C': {'precision': 0.38461538461538464, 'recall': 0.29411764705882354, 'f1-score': 0.33333333333333337, 'support': 17}, 'P': {'precision': 0.08695652173913043, 'recall': 0.08333333333333333, 'f1-score': 0.0851063829787234, 'support': 24}, 'micro avg': {'precision': 0.19444444444444445, 'recall': 0.17073170731707318, 'f1-score': 0.18181818181818182, 'support': 41}, 'macro avg': {'precision': 0.23578595317725753, 'recall': 0.18872549019607843, 'f1-score': 0.2092198581560284, 'support': 41}, 'weighted avg': {'precision': 0.2103760502487968, 'recall': 0.17073170731707318, 'f1-score': 0.18802975263795194, 'support': 41}}
Wrong BIO-Encoding 1/36 labels, 2.78%
Dev-Data: Prec: 0.200, Rec: 0.171, F1: 0.1842
{'C': {'precision': 0.16875, 'recall': 0.17763157894736842, 'f1-score': 0.17307692307692307, 'support': 304}, 'P': {'precision': 0.3157894736842105, 'recall': 0.32432432432432434, 'f1-score': 0.32, 'support': 333}, 'micro avg': {'precision': 0.24471299093655588, 'recall': 0.2543171114599686, 'f1-score': 0.24942263279445728, 'support': 637}, 'macro avg': {'precision': 0.24226973684210526, 'recall': 0.25097795163584635, 'f1-score': 0.24653846153846154, 'support': 637}, 'weighted avg': {'precision': 0.24561678922581176, 'recall': 0.2543171114599686, 'f1-score': 0.24988286438835888, 'support': 637}}
Wrong BIO-Encoding 242/889 labels, 27.22%
{'C': {'precision': 0.16875, 'recall': 0.17763157894736842, 'f1-score': 0.17307692307692307, 'support': 304}, 'P': {'precision': 0.3157894736842105, 'recall': 0.32432432432432434, 'f1-score': 0.32, 'support': 333}, 'micro avg': {'precision': 0.24471299093655588, 'recall': 0.2543171114599686, 'f1-score': 0.24942263279445728, 'support': 637}, 'macro avg': {'precision': 0.24226973684210526, 'recall': 0.25097795163584635, 'f1-score': 0.24653846153846154, 'support': 637}, 'weighted avg': {'precision': 0.24561678922581176, 'recall': 0.2543171114599686, 'f1-score': 0.24988286438835888, 'support': 637}}
Wrong BIO-Encoding 15/662 labels, 2.27%
Test-Data: Prec: 0.250, Rec: 0.254, F1: 0.2523

Scores from epoch with best dev-scores:
  Dev-Score: 0.3200
  Test-Score 0.1824

4.57 sec for evaluation

--------- Epoch 13 -----------
333.86 sec for training (4380.11 total)
-- cmv_modes1 --
{'C': {'precision': 0.6428571428571429, 'recall': 0.5294117647058824, 'f1-score': 0.5806451612903226, 'support': 17}, 'P': {'precision': 0.09090909090909091, 'recall': 0.08333333333333333, 'f1-score': 0.08695652173913043, 'support': 24}, 'micro avg': {'precision': 0.3055555555555556, 'recall': 0.2682926829268293, 'f1-score': 0.28571428571428575, 'support': 41}, 'macro avg': {'precision': 0.3668831168831169, 'recall': 0.30637254901960786, 'f1-score': 0.33380084151472655, 'support': 41}, 'weighted avg': {'precision': 0.3197656002534051, 'recall': 0.2682926829268293, 'f1-score': 0.29165668935791744, 'support': 41}}
{'C': {'precision': 0.6428571428571429, 'recall': 0.5294117647058824, 'f1-score': 0.5806451612903226, 'support': 17}, 'P': {'precision': 0.09090909090909091, 'recall': 0.08333333333333333, 'f1-score': 0.08695652173913043, 'support': 24}, 'micro avg': {'precision': 0.3055555555555556, 'recall': 0.2682926829268293, 'f1-score': 0.28571428571428575, 'support': 41}, 'macro avg': {'precision': 0.3668831168831169, 'recall': 0.30637254901960786, 'f1-score': 0.33380084151472655, 'support': 41}, 'weighted avg': {'precision': 0.3197656002534051, 'recall': 0.2682926829268293, 'f1-score': 0.29165668935791744, 'support': 41}}
Dev-Data: Prec: 0.306, Rec: 0.268, F1: 0.2857
{'C': {'precision': 0.1456953642384106, 'recall': 0.14473684210526316, 'f1-score': 0.14521452145214522, 'support': 304}, 'P': {'precision': 0.2782152230971129, 'recall': 0.3183183183183183, 'f1-score': 0.29691876750700286, 'support': 333}, 'micro avg': {'precision': 0.21961932650073207, 'recall': 0.23547880690737832, 'f1-score': 0.22727272727272727, 'support': 637}, 'macro avg': {'precision': 0.21195529366776172, 'recall': 0.23152758021179073, 'f1-score': 0.22106664447957403, 'support': 637}, 'weighted avg': {'precision': 0.21497183676580128, 'recall': 0.23547880690737832, 'f1-score': 0.22451988084973956, 'support': 637}}
Wrong BIO-Encoding 399/1065 labels, 37.46%
{'C': {'precision': 0.1456953642384106, 'recall': 0.14473684210526316, 'f1-score': 0.14521452145214522, 'support': 304}, 'P': {'precision': 0.2782152230971129, 'recall': 0.3183183183183183, 'f1-score': 0.29691876750700286, 'support': 333}, 'micro avg': {'precision': 0.21961932650073207, 'recall': 0.23547880690737832, 'f1-score': 0.22727272727272727, 'support': 637}, 'macro avg': {'precision': 0.21195529366776172, 'recall': 0.23152758021179073, 'f1-score': 0.22106664447957403, 'support': 637}, 'weighted avg': {'precision': 0.21497183676580128, 'recall': 0.23547880690737832, 'f1-score': 0.22451988084973956, 'support': 637}}
Wrong BIO-Encoding 17/683 labels, 2.49%
Test-Data: Prec: 0.225, Rec: 0.235, F1: 0.2302

Scores from epoch with best dev-scores:
  Dev-Score: 0.3200
  Test-Score 0.1824

4.49 sec for evaluation

--------- Epoch 14 -----------
334.74 sec for training (4714.85 total)
-- cmv_modes1 --
{'C': {'precision': 0.4, 'recall': 0.47058823529411764, 'f1-score': 0.4324324324324324, 'support': 17}, 'P': {'precision': 0.4444444444444444, 'recall': 0.3333333333333333, 'f1-score': 0.380952380952381, 'support': 24}, 'micro avg': {'precision': 0.42105263157894735, 'recall': 0.3902439024390244, 'f1-score': 0.4050632911392405, 'support': 41}, 'macro avg': {'precision': 0.4222222222222222, 'recall': 0.4019607843137255, 'f1-score': 0.4066924066924067, 'support': 41}, 'weighted avg': {'precision': 0.4260162601626017, 'recall': 0.3902439024390244, 'f1-score': 0.40229776815142665, 'support': 41}}
{'C': {'precision': 0.4, 'recall': 0.47058823529411764, 'f1-score': 0.4324324324324324, 'support': 17}, 'P': {'precision': 0.4444444444444444, 'recall': 0.3333333333333333, 'f1-score': 0.380952380952381, 'support': 24}, 'micro avg': {'precision': 0.42105263157894735, 'recall': 0.3902439024390244, 'f1-score': 0.4050632911392405, 'support': 41}, 'macro avg': {'precision': 0.4222222222222222, 'recall': 0.4019607843137255, 'f1-score': 0.4066924066924067, 'support': 41}, 'weighted avg': {'precision': 0.4260162601626017, 'recall': 0.3902439024390244, 'f1-score': 0.40229776815142665, 'support': 41}}
Dev-Data: Prec: 0.421, Rec: 0.390, F1: 0.4051
{'C': {'precision': 0.10633484162895927, 'recall': 0.15460526315789475, 'f1-score': 0.1260053619302949, 'support': 304}, 'P': {'precision': 0.2692307692307692, 'recall': 0.23123123123123124, 'f1-score': 0.24878836833602588, 'support': 333}, 'micro avg': {'precision': 0.17032967032967034, 'recall': 0.1946624803767661, 'f1-score': 0.18168498168498168, 'support': 637}, 'macro avg': {'precision': 0.18778280542986425, 'recall': 0.192918247194563, 'f1-score': 0.1873968651331604, 'support': 637}, 'weighted avg': {'precision': 0.19149079750243292, 'recall': 0.1946624803767661, 'f1-score': 0.1901917687326629, 'support': 637}}
Wrong BIO-Encoding 38/763 labels, 4.98%
{'C': {'precision': 0.10633484162895927, 'recall': 0.15460526315789475, 'f1-score': 0.1260053619302949, 'support': 304}, 'P': {'precision': 0.2692307692307692, 'recall': 0.23123123123123124, 'f1-score': 0.24878836833602588, 'support': 333}, 'micro avg': {'precision': 0.17032967032967034, 'recall': 0.1946624803767661, 'f1-score': 0.18168498168498168, 'support': 637}, 'macro avg': {'precision': 0.18778280542986425, 'recall': 0.192918247194563, 'f1-score': 0.1873968651331604, 'support': 637}, 'weighted avg': {'precision': 0.19149079750243292, 'recall': 0.1946624803767661, 'f1-score': 0.1901917687326629, 'support': 637}}
Wrong BIO-Encoding 3/728 labels, 0.41%
Test-Data: Prec: 0.171, Rec: 0.195, F1: 0.1821

Scores from epoch with best dev-scores:
  Dev-Score: 0.4051
  Test-Score 0.1821

5.31 sec for evaluation

--------- Epoch 15 -----------
336.30 sec for training (5051.15 total)
-- cmv_modes1 --
{'C': {'precision': 0.3333333333333333, 'recall': 0.35294117647058826, 'f1-score': 0.34285714285714286, 'support': 17}, 'P': {'precision': 0.25, 'recall': 0.20833333333333334, 'f1-score': 0.22727272727272727, 'support': 24}, 'micro avg': {'precision': 0.2894736842105263, 'recall': 0.2682926829268293, 'f1-score': 0.27848101265822783, 'support': 41}, 'macro avg': {'precision': 0.29166666666666663, 'recall': 0.2806372549019608, 'f1-score': 0.2850649350649351, 'support': 41}, 'weighted avg': {'precision': 0.2845528455284553, 'recall': 0.2682926829268293, 'f1-score': 0.27519797275894836, 'support': 41}}
{'C': {'precision': 0.3333333333333333, 'recall': 0.35294117647058826, 'f1-score': 0.34285714285714286, 'support': 17}, 'P': {'precision': 0.25, 'recall': 0.20833333333333334, 'f1-score': 0.22727272727272727, 'support': 24}, 'micro avg': {'precision': 0.2894736842105263, 'recall': 0.2682926829268293, 'f1-score': 0.27848101265822783, 'support': 41}, 'macro avg': {'precision': 0.29166666666666663, 'recall': 0.2806372549019608, 'f1-score': 0.2850649350649351, 'support': 41}, 'weighted avg': {'precision': 0.2845528455284553, 'recall': 0.2682926829268293, 'f1-score': 0.27519797275894836, 'support': 41}}
Dev-Data: Prec: 0.289, Rec: 0.268, F1: 0.2785
{'C': {'precision': 0.1749271137026239, 'recall': 0.19736842105263158, 'f1-score': 0.18547140649149926, 'support': 304}, 'P': {'precision': 0.28012048192771083, 'recall': 0.27927927927927926, 'f1-score': 0.2796992481203007, 'support': 333}, 'micro avg': {'precision': 0.22666666666666666, 'recall': 0.2401883830455259, 'f1-score': 0.23323170731707316, 'support': 637}, 'macro avg': {'precision': 0.22752379781516735, 'recall': 0.23832385016595542, 'f1-score': 0.23258532730589998, 'support': 637}, 'weighted avg': {'precision': 0.2299183093367745, 'recall': 0.2401883830455259, 'f1-score': 0.2347302310792401, 'support': 637}}
Wrong BIO-Encoding 246/908 labels, 27.09%
{'C': {'precision': 0.1749271137026239, 'recall': 0.19736842105263158, 'f1-score': 0.18547140649149926, 'support': 304}, 'P': {'precision': 0.28012048192771083, 'recall': 0.27927927927927926, 'f1-score': 0.2796992481203007, 'support': 333}, 'micro avg': {'precision': 0.22666666666666666, 'recall': 0.2401883830455259, 'f1-score': 0.23323170731707316, 'support': 637}, 'macro avg': {'precision': 0.22752379781516735, 'recall': 0.23832385016595542, 'f1-score': 0.23258532730589998, 'support': 637}, 'weighted avg': {'precision': 0.2299183093367745, 'recall': 0.2401883830455259, 'f1-score': 0.2347302310792401, 'support': 637}}
Wrong BIO-Encoding 13/675 labels, 1.93%
Test-Data: Prec: 0.231, Rec: 0.240, F1: 0.2356

Scores from epoch with best dev-scores:
  Dev-Score: 0.4051
  Test-Score 0.1821

4.33 sec for evaluation

--------- Epoch 16 -----------
335.34 sec for training (5386.50 total)
-- cmv_modes1 --
{'C': {'precision': 0.375, 'recall': 0.35294117647058826, 'f1-score': 0.3636363636363636, 'support': 17}, 'P': {'precision': 0.08695652173913043, 'recall': 0.08333333333333333, 'f1-score': 0.0851063829787234, 'support': 24}, 'micro avg': {'precision': 0.20512820512820512, 'recall': 0.1951219512195122, 'f1-score': 0.2, 'support': 41}, 'macro avg': {'precision': 0.23097826086956522, 'recall': 0.2181372549019608, 'f1-score': 0.2243713733075435, 'support': 41}, 'weighted avg': {'precision': 0.20638918345705198, 'recall': 0.1951219512195122, 'f1-score': 0.20059442373920836, 'support': 41}}
{'C': {'precision': 0.375, 'recall': 0.35294117647058826, 'f1-score': 0.3636363636363636, 'support': 17}, 'P': {'precision': 0.08695652173913043, 'recall': 0.08333333333333333, 'f1-score': 0.0851063829787234, 'support': 24}, 'micro avg': {'precision': 0.20512820512820512, 'recall': 0.1951219512195122, 'f1-score': 0.2, 'support': 41}, 'macro avg': {'precision': 0.23097826086956522, 'recall': 0.2181372549019608, 'f1-score': 0.2243713733075435, 'support': 41}, 'weighted avg': {'precision': 0.20638918345705198, 'recall': 0.1951219512195122, 'f1-score': 0.20059442373920836, 'support': 41}}
Dev-Data: Prec: 0.205, Rec: 0.195, F1: 0.2000
{'C': {'precision': 0.16246498599439776, 'recall': 0.19078947368421054, 'f1-score': 0.17549167927382753, 'support': 304}, 'P': {'precision': 0.30547550432276654, 'recall': 0.3183183183183183, 'f1-score': 0.31176470588235294, 'support': 333}, 'micro avg': {'precision': 0.23295454545454544, 'recall': 0.25745682888540034, 'f1-score': 0.2445935868754661, 'support': 637}, 'macro avg': {'precision': 0.23397024515858217, 'recall': 0.25455389600126443, 'f1-score': 0.24362819257809024, 'support': 637}, 'weighted avg': {'precision': 0.23722558662759524, 'recall': 0.25745682888540034, 'f1-score': 0.24673016885096877, 'support': 637}}
Wrong BIO-Encoding 547/1231 labels, 44.44%
{'C': {'precision': 0.16246498599439776, 'recall': 0.19078947368421054, 'f1-score': 0.17549167927382753, 'support': 304}, 'P': {'precision': 0.30547550432276654, 'recall': 0.3183183183183183, 'f1-score': 0.31176470588235294, 'support': 333}, 'micro avg': {'precision': 0.23295454545454544, 'recall': 0.25745682888540034, 'f1-score': 0.2445935868754661, 'support': 637}, 'macro avg': {'precision': 0.23397024515858217, 'recall': 0.25455389600126443, 'f1-score': 0.24362819257809024, 'support': 637}, 'weighted avg': {'precision': 0.23722558662759524, 'recall': 0.25745682888540034, 'f1-score': 0.24673016885096877, 'support': 637}}
Wrong BIO-Encoding 20/704 labels, 2.84%
Test-Data: Prec: 0.240, Rec: 0.257, F1: 0.2483

Scores from epoch with best dev-scores:
  Dev-Score: 0.4051
  Test-Score 0.1821

4.61 sec for evaluation

--------- Epoch 17 -----------
335.00 sec for training (5721.50 total)
-- cmv_modes1 --
{'C': {'precision': 0.5333333333333333, 'recall': 0.47058823529411764, 'f1-score': 0.5, 'support': 17}, 'P': {'precision': 0.3333333333333333, 'recall': 0.2916666666666667, 'f1-score': 0.3111111111111111, 'support': 24}, 'micro avg': {'precision': 0.4166666666666667, 'recall': 0.36585365853658536, 'f1-score': 0.38961038961038963, 'support': 41}, 'macro avg': {'precision': 0.43333333333333335, 'recall': 0.38112745098039214, 'f1-score': 0.40555555555555556, 'support': 41}, 'weighted avg': {'precision': 0.416260162601626, 'recall': 0.36585365853658536, 'f1-score': 0.38943089430894307, 'support': 41}}
{'C': {'precision': 0.5333333333333333, 'recall': 0.47058823529411764, 'f1-score': 0.5, 'support': 17}, 'P': {'precision': 0.3333333333333333, 'recall': 0.2916666666666667, 'f1-score': 0.3111111111111111, 'support': 24}, 'micro avg': {'precision': 0.4166666666666667, 'recall': 0.36585365853658536, 'f1-score': 0.38961038961038963, 'support': 41}, 'macro avg': {'precision': 0.43333333333333335, 'recall': 0.38112745098039214, 'f1-score': 0.40555555555555556, 'support': 41}, 'weighted avg': {'precision': 0.416260162601626, 'recall': 0.36585365853658536, 'f1-score': 0.38943089430894307, 'support': 41}}
Dev-Data: Prec: 0.417, Rec: 0.366, F1: 0.3896
{'C': {'precision': 0.11581920903954802, 'recall': 0.13486842105263158, 'f1-score': 0.12462006079027357, 'support': 304}, 'P': {'precision': 0.2463768115942029, 'recall': 0.2552552552552553, 'f1-score': 0.2507374631268437, 'support': 333}, 'micro avg': {'precision': 0.18025751072961374, 'recall': 0.1978021978021978, 'f1-score': 0.18862275449101798, 'support': 637}, 'macro avg': {'precision': 0.18109801031687547, 'recall': 0.19506183815394343, 'f1-score': 0.18767876195855865, 'support': 637}, 'weighted avg': {'precision': 0.1840698866701604, 'recall': 0.1978021978021978, 'f1-score': 0.1905495662503644, 'support': 637}}
Wrong BIO-Encoding 357/1038 labels, 34.39%
{'C': {'precision': 0.11581920903954802, 'recall': 0.13486842105263158, 'f1-score': 0.12462006079027357, 'support': 304}, 'P': {'precision': 0.2463768115942029, 'recall': 0.2552552552552553, 'f1-score': 0.2507374631268437, 'support': 333}, 'micro avg': {'precision': 0.18025751072961374, 'recall': 0.1978021978021978, 'f1-score': 0.18862275449101798, 'support': 637}, 'macro avg': {'precision': 0.18109801031687547, 'recall': 0.19506183815394343, 'f1-score': 0.18767876195855865, 'support': 637}, 'weighted avg': {'precision': 0.1840698866701604, 'recall': 0.1978021978021978, 'f1-score': 0.1905495662503644, 'support': 637}}
Wrong BIO-Encoding 18/699 labels, 2.58%
Test-Data: Prec: 0.185, Rec: 0.198, F1: 0.1912

Scores from epoch with best dev-scores:
  Dev-Score: 0.4051
  Test-Score 0.1821

4.45 sec for evaluation

--------- Epoch 18 -----------
335.17 sec for training (6056.67 total)
-- cmv_modes1 --
{'C': {'precision': 0.5625, 'recall': 0.5294117647058824, 'f1-score': 0.5454545454545455, 'support': 17}, 'P': {'precision': 0.625, 'recall': 0.625, 'f1-score': 0.625, 'support': 24}, 'micro avg': {'precision': 0.6, 'recall': 0.5853658536585366, 'f1-score': 0.5925925925925926, 'support': 41}, 'macro avg': {'precision': 0.59375, 'recall': 0.5772058823529411, 'f1-score': 0.5852272727272727, 'support': 41}, 'weighted avg': {'precision': 0.5990853658536586, 'recall': 0.5853658536585366, 'f1-score': 0.5920177383592018, 'support': 41}}
{'C': {'precision': 0.5625, 'recall': 0.5294117647058824, 'f1-score': 0.5454545454545455, 'support': 17}, 'P': {'precision': 0.625, 'recall': 0.625, 'f1-score': 0.625, 'support': 24}, 'micro avg': {'precision': 0.6, 'recall': 0.5853658536585366, 'f1-score': 0.5925925925925926, 'support': 41}, 'macro avg': {'precision': 0.59375, 'recall': 0.5772058823529411, 'f1-score': 0.5852272727272727, 'support': 41}, 'weighted avg': {'precision': 0.5990853658536586, 'recall': 0.5853658536585366, 'f1-score': 0.5920177383592018, 'support': 41}}
Dev-Data: Prec: 0.600, Rec: 0.585, F1: 0.5926
{'C': {'precision': 0.09792284866468842, 'recall': 0.10855263157894737, 'f1-score': 0.10296411856474258, 'support': 304}, 'P': {'precision': 0.13522012578616352, 'recall': 0.12912912912912913, 'f1-score': 0.13210445468509985, 'support': 333}, 'micro avg': {'precision': 0.11603053435114503, 'recall': 0.11930926216640503, 'f1-score': 0.11764705882352941, 'support': 637}, 'macro avg': {'precision': 0.11657148722542597, 'recall': 0.11884088035403825, 'f1-score': 0.11753428662492121, 'support': 637}, 'weighted avg': {'precision': 0.117420483329447, 'recall': 0.11930926216640503, 'f1-score': 0.11819760667789639, 'support': 637}}
Wrong BIO-Encoding 389/1030 labels, 37.77%
{'C': {'precision': 0.09792284866468842, 'recall': 0.10855263157894737, 'f1-score': 0.10296411856474258, 'support': 304}, 'P': {'precision': 0.13522012578616352, 'recall': 0.12912912912912913, 'f1-score': 0.13210445468509985, 'support': 333}, 'micro avg': {'precision': 0.11603053435114503, 'recall': 0.11930926216640503, 'f1-score': 0.11764705882352941, 'support': 637}, 'macro avg': {'precision': 0.11657148722542597, 'recall': 0.11884088035403825, 'f1-score': 0.11753428662492121, 'support': 637}, 'weighted avg': {'precision': 0.117420483329447, 'recall': 0.11930926216640503, 'f1-score': 0.11819760667789639, 'support': 637}}
Wrong BIO-Encoding 14/655 labels, 2.14%
Test-Data: Prec: 0.116, Rec: 0.119, F1: 0.1176

Scores from epoch with best dev-scores:
  Dev-Score: 0.5926
  Test-Score 0.1176

5.23 sec for evaluation

--------- Epoch 19 -----------
338.24 sec for training (6394.91 total)
-- cmv_modes1 --
{'C': {'precision': 0.5625, 'recall': 0.5294117647058824, 'f1-score': 0.5454545454545455, 'support': 17}, 'P': {'precision': 0.2, 'recall': 0.20833333333333334, 'f1-score': 0.20408163265306126, 'support': 24}, 'micro avg': {'precision': 0.34146341463414637, 'recall': 0.34146341463414637, 'f1-score': 0.34146341463414637, 'support': 41}, 'macro avg': {'precision': 0.38125, 'recall': 0.36887254901960786, 'f1-score': 0.3747680890538034, 'support': 41}, 'weighted avg': {'precision': 0.3503048780487805, 'recall': 0.34146341463414637, 'f1-score': 0.3456264989366035, 'support': 41}}
{'C': {'precision': 0.5625, 'recall': 0.5294117647058824, 'f1-score': 0.5454545454545455, 'support': 17}, 'P': {'precision': 0.2, 'recall': 0.20833333333333334, 'f1-score': 0.20408163265306126, 'support': 24}, 'micro avg': {'precision': 0.34146341463414637, 'recall': 0.34146341463414637, 'f1-score': 0.34146341463414637, 'support': 41}, 'macro avg': {'precision': 0.38125, 'recall': 0.36887254901960786, 'f1-score': 0.3747680890538034, 'support': 41}, 'weighted avg': {'precision': 0.3503048780487805, 'recall': 0.34146341463414637, 'f1-score': 0.3456264989366035, 'support': 41}}
Dev-Data: Prec: 0.341, Rec: 0.341, F1: 0.3415
{'C': {'precision': 0.18269230769230768, 'recall': 0.1875, 'f1-score': 0.18506493506493504, 'support': 304}, 'P': {'precision': 0.3228346456692913, 'recall': 0.36936936936936937, 'f1-score': 0.3445378151260504, 'support': 333}, 'micro avg': {'precision': 0.2597402597402597, 'recall': 0.282574568288854, 'f1-score': 0.27067669172932335, 'support': 637}, 'macro avg': {'precision': 0.2527634766807995, 'recall': 0.2784346846846847, 'f1-score': 0.26480137509549273, 'support': 637}, 'weighted avg': {'precision': 0.2559535299000558, 'recall': 0.282574568288854, 'f1-score': 0.26843144850347733, 'support': 637}}
Wrong BIO-Encoding 145/827 labels, 17.53%
{'C': {'precision': 0.18269230769230768, 'recall': 0.1875, 'f1-score': 0.18506493506493504, 'support': 304}, 'P': {'precision': 0.3228346456692913, 'recall': 0.36936936936936937, 'f1-score': 0.3445378151260504, 'support': 333}, 'micro avg': {'precision': 0.2597402597402597, 'recall': 0.282574568288854, 'f1-score': 0.27067669172932335, 'support': 637}, 'macro avg': {'precision': 0.2527634766807995, 'recall': 0.2784346846846847, 'f1-score': 0.26480137509549273, 'support': 637}, 'weighted avg': {'precision': 0.2559535299000558, 'recall': 0.282574568288854, 'f1-score': 0.26843144850347733, 'support': 637}}
Wrong BIO-Encoding 11/693 labels, 1.59%
Test-Data: Prec: 0.264, Rec: 0.283, F1: 0.2729

Scores from epoch with best dev-scores:
  Dev-Score: 0.5926
  Test-Score 0.1176

4.55 sec for evaluation

--------- Epoch 20 -----------
336.60 sec for training (6731.51 total)
-- cmv_modes1 --
{'C': {'precision': 0.5625, 'recall': 0.5294117647058824, 'f1-score': 0.5454545454545455, 'support': 17}, 'P': {'precision': 0.48, 'recall': 0.5, 'f1-score': 0.4897959183673469, 'support': 24}, 'micro avg': {'precision': 0.5121951219512195, 'recall': 0.5121951219512195, 'f1-score': 0.5121951219512195, 'support': 41}, 'macro avg': {'precision': 0.52125, 'recall': 0.5147058823529411, 'f1-score': 0.5176252319109462, 'support': 41}, 'weighted avg': {'precision': 0.5142073170731707, 'recall': 0.5121951219512195, 'f1-score': 0.5128738856961853, 'support': 41}}
{'C': {'precision': 0.5625, 'recall': 0.5294117647058824, 'f1-score': 0.5454545454545455, 'support': 17}, 'P': {'precision': 0.48, 'recall': 0.5, 'f1-score': 0.4897959183673469, 'support': 24}, 'micro avg': {'precision': 0.5121951219512195, 'recall': 0.5121951219512195, 'f1-score': 0.5121951219512195, 'support': 41}, 'macro avg': {'precision': 0.52125, 'recall': 0.5147058823529411, 'f1-score': 0.5176252319109462, 'support': 41}, 'weighted avg': {'precision': 0.5142073170731707, 'recall': 0.5121951219512195, 'f1-score': 0.5128738856961853, 'support': 41}}
Dev-Data: Prec: 0.512, Rec: 0.512, F1: 0.5122
{'C': {'precision': 0.13617021276595745, 'recall': 0.10526315789473684, 'f1-score': 0.11873840445269015, 'support': 304}, 'P': {'precision': 0.24019607843137256, 'recall': 0.29429429429429427, 'f1-score': 0.26450742240215924, 'support': 333}, 'micro avg': {'precision': 0.20217729393468117, 'recall': 0.20408163265306123, 'f1-score': 0.203125, 'support': 637}, 'macro avg': {'precision': 0.188183145598665, 'recall': 0.19977872609451555, 'f1-score': 0.1916229134274247, 'support': 637}, 'weighted avg': {'precision': 0.1905510813163236, 'recall': 0.20408163265306123, 'f1-score': 0.19494104648906882, 'support': 637}}
Wrong BIO-Encoding 160/790 labels, 20.25%
{'C': {'precision': 0.13617021276595745, 'recall': 0.10526315789473684, 'f1-score': 0.11873840445269015, 'support': 304}, 'P': {'precision': 0.24019607843137256, 'recall': 0.29429429429429427, 'f1-score': 0.26450742240215924, 'support': 333}, 'micro avg': {'precision': 0.20217729393468117, 'recall': 0.20408163265306123, 'f1-score': 0.203125, 'support': 637}, 'macro avg': {'precision': 0.188183145598665, 'recall': 0.19977872609451555, 'f1-score': 0.1916229134274247, 'support': 637}, 'weighted avg': {'precision': 0.1905510813163236, 'recall': 0.20408163265306123, 'f1-score': 0.19494104648906882, 'support': 637}}
Wrong BIO-Encoding 13/643 labels, 2.02%
Test-Data: Prec: 0.206, Rec: 0.204, F1: 0.2052

Scores from epoch with best dev-scores:
  Dev-Score: 0.5926
  Test-Score 0.1176

4.45 sec for evaluation

--------- Epoch 21 -----------
327.72 sec for training (7059.22 total)
-- cmv_modes1 --
{'C': {'precision': 0.6875, 'recall': 0.6470588235294118, 'f1-score': 0.6666666666666667, 'support': 17}, 'P': {'precision': 0.6956521739130435, 'recall': 0.6666666666666666, 'f1-score': 0.6808510638297872, 'support': 24}, 'micro avg': {'precision': 0.6923076923076923, 'recall': 0.6585365853658537, 'f1-score': 0.675, 'support': 41}, 'macro avg': {'precision': 0.6915760869565217, 'recall': 0.6568627450980392, 'f1-score': 0.6737588652482269, 'support': 41}, 'weighted avg': {'precision': 0.6922720042417816, 'recall': 0.6585365853658537, 'f1-score': 0.6749697284206884, 'support': 41}}
{'C': {'precision': 0.6875, 'recall': 0.6470588235294118, 'f1-score': 0.6666666666666667, 'support': 17}, 'P': {'precision': 0.6956521739130435, 'recall': 0.6666666666666666, 'f1-score': 0.6808510638297872, 'support': 24}, 'micro avg': {'precision': 0.6923076923076923, 'recall': 0.6585365853658537, 'f1-score': 0.675, 'support': 41}, 'macro avg': {'precision': 0.6915760869565217, 'recall': 0.6568627450980392, 'f1-score': 0.6737588652482269, 'support': 41}, 'weighted avg': {'precision': 0.6922720042417816, 'recall': 0.6585365853658537, 'f1-score': 0.6749697284206884, 'support': 41}}
Dev-Data: Prec: 0.692, Rec: 0.659, F1: 0.6750
{'C': {'precision': 0.13709677419354838, 'recall': 0.16776315789473684, 'f1-score': 0.15088757396449703, 'support': 304}, 'P': {'precision': 0.25153374233128833, 'recall': 0.24624624624624625, 'f1-score': 0.2488619119878604, 'support': 333}, 'micro avg': {'precision': 0.19054441260744986, 'recall': 0.2087912087912088, 'f1-score': 0.19925093632958804, 'support': 637}, 'macro avg': {'precision': 0.19431525826241836, 'recall': 0.20700470207049154, 'f1-score': 0.19987474297617872, 'support': 637}, 'weighted avg': {'precision': 0.1969201813989917, 'recall': 0.2087912087912088, 'f1-score': 0.20210492806462263, 'support': 637}}
Wrong BIO-Encoding 263/947 labels, 27.77%
{'C': {'precision': 0.13709677419354838, 'recall': 0.16776315789473684, 'f1-score': 0.15088757396449703, 'support': 304}, 'P': {'precision': 0.25153374233128833, 'recall': 0.24624624624624625, 'f1-score': 0.2488619119878604, 'support': 333}, 'micro avg': {'precision': 0.19054441260744986, 'recall': 0.2087912087912088, 'f1-score': 0.19925093632958804, 'support': 637}, 'macro avg': {'precision': 0.19431525826241836, 'recall': 0.20700470207049154, 'f1-score': 0.19987474297617872, 'support': 637}, 'weighted avg': {'precision': 0.1969201813989917, 'recall': 0.2087912087912088, 'f1-score': 0.20210492806462263, 'support': 637}}
Wrong BIO-Encoding 14/698 labels, 2.01%
Test-Data: Prec: 0.194, Rec: 0.209, F1: 0.2014

Scores from epoch with best dev-scores:
  Dev-Score: 0.6750
  Test-Score 0.2014

5.17 sec for evaluation

--------- Epoch 22 -----------
328.45 sec for training (7387.67 total)
-- cmv_modes1 --
{'C': {'precision': 0.6, 'recall': 0.5294117647058824, 'f1-score': 0.5625, 'support': 17}, 'P': {'precision': 0.48148148148148145, 'recall': 0.5416666666666666, 'f1-score': 0.5098039215686274, 'support': 24}, 'micro avg': {'precision': 0.5238095238095238, 'recall': 0.5365853658536586, 'f1-score': 0.5301204819277109, 'support': 41}, 'macro avg': {'precision': 0.5407407407407407, 'recall': 0.5355392156862745, 'f1-score': 0.5361519607843137, 'support': 41}, 'weighted avg': {'precision': 0.5306233062330623, 'recall': 0.5365853658536586, 'f1-score': 0.5316535150645624, 'support': 41}}
{'C': {'precision': 0.6, 'recall': 0.5294117647058824, 'f1-score': 0.5625, 'support': 17}, 'P': {'precision': 0.48148148148148145, 'recall': 0.5416666666666666, 'f1-score': 0.5098039215686274, 'support': 24}, 'micro avg': {'precision': 0.5238095238095238, 'recall': 0.5365853658536586, 'f1-score': 0.5301204819277109, 'support': 41}, 'macro avg': {'precision': 0.5407407407407407, 'recall': 0.5355392156862745, 'f1-score': 0.5361519607843137, 'support': 41}, 'weighted avg': {'precision': 0.5306233062330623, 'recall': 0.5365853658536586, 'f1-score': 0.5316535150645624, 'support': 41}}
Dev-Data: Prec: 0.524, Rec: 0.537, F1: 0.5301
{'C': {'precision': 0.19310344827586207, 'recall': 0.18421052631578946, 'f1-score': 0.18855218855218855, 'support': 304}, 'P': {'precision': 0.3090909090909091, 'recall': 0.35735735735735735, 'f1-score': 0.33147632311977715, 'support': 333}, 'micro avg': {'precision': 0.25925925925925924, 'recall': 0.27472527472527475, 'f1-score': 0.26676829268292684, 'support': 637}, 'macro avg': {'precision': 0.25109717868338555, 'recall': 0.2707839418365734, 'f1-score': 0.26001425583598287, 'support': 637}, 'weighted avg': {'precision': 0.2537373956093168, 'recall': 0.27472527472527475, 'f1-score': 0.26326763095565325, 'support': 637}}
Wrong BIO-Encoding 146/809 labels, 18.05%
{'C': {'precision': 0.19310344827586207, 'recall': 0.18421052631578946, 'f1-score': 0.18855218855218855, 'support': 304}, 'P': {'precision': 0.3090909090909091, 'recall': 0.35735735735735735, 'f1-score': 0.33147632311977715, 'support': 333}, 'micro avg': {'precision': 0.25925925925925924, 'recall': 0.27472527472527475, 'f1-score': 0.26676829268292684, 'support': 637}, 'macro avg': {'precision': 0.25109717868338555, 'recall': 0.2707839418365734, 'f1-score': 0.26001425583598287, 'support': 637}, 'weighted avg': {'precision': 0.2537373956093168, 'recall': 0.27472527472527475, 'f1-score': 0.26326763095565325, 'support': 637}}
Wrong BIO-Encoding 12/675 labels, 1.78%
Test-Data: Prec: 0.264, Rec: 0.275, F1: 0.2692

Scores from epoch with best dev-scores:
  Dev-Score: 0.6750
  Test-Score 0.2014

4.14 sec for evaluation

--------- Epoch 23 -----------
326.19 sec for training (7713.85 total)
-- cmv_modes1 --
{'C': {'precision': 0.875, 'recall': 0.8235294117647058, 'f1-score': 0.8484848484848485, 'support': 17}, 'P': {'precision': 0.6923076923076923, 'recall': 0.75, 'f1-score': 0.7199999999999999, 'support': 24}, 'micro avg': {'precision': 0.7619047619047619, 'recall': 0.7804878048780488, 'f1-score': 0.7710843373493976, 'support': 41}, 'macro avg': {'precision': 0.7836538461538461, 'recall': 0.7867647058823529, 'f1-score': 0.7842424242424242, 'support': 41}, 'weighted avg': {'precision': 0.7680581613508443, 'recall': 0.7804878048780488, 'f1-score': 0.7732742054693273, 'support': 41}}
{'C': {'precision': 0.875, 'recall': 0.8235294117647058, 'f1-score': 0.8484848484848485, 'support': 17}, 'P': {'precision': 0.6923076923076923, 'recall': 0.75, 'f1-score': 0.7199999999999999, 'support': 24}, 'micro avg': {'precision': 0.7619047619047619, 'recall': 0.7804878048780488, 'f1-score': 0.7710843373493976, 'support': 41}, 'macro avg': {'precision': 0.7836538461538461, 'recall': 0.7867647058823529, 'f1-score': 0.7842424242424242, 'support': 41}, 'weighted avg': {'precision': 0.7680581613508443, 'recall': 0.7804878048780488, 'f1-score': 0.7732742054693273, 'support': 41}}
Dev-Data: Prec: 0.762, Rec: 0.780, F1: 0.7711
{'C': {'precision': 0.13142857142857142, 'recall': 0.1513157894736842, 'f1-score': 0.14067278287461774, 'support': 304}, 'P': {'precision': 0.20270270270270271, 'recall': 0.18018018018018017, 'f1-score': 0.19077901430842611, 'support': 333}, 'micro avg': {'precision': 0.16408668730650156, 'recall': 0.1664050235478807, 'f1-score': 0.16523772408417772, 'support': 637}, 'macro avg': {'precision': 0.16706563706563707, 'recall': 0.1657479848269322, 'f1-score': 0.16572589859152193, 'support': 637}, 'weighted avg': {'precision': 0.1686880466472303, 'recall': 0.1664050235478807, 'f1-score': 0.16686646429919888, 'support': 637}}
Wrong BIO-Encoding 78/719 labels, 10.85%
{'C': {'precision': 0.13142857142857142, 'recall': 0.1513157894736842, 'f1-score': 0.14067278287461774, 'support': 304}, 'P': {'precision': 0.20270270270270271, 'recall': 0.18018018018018017, 'f1-score': 0.19077901430842611, 'support': 333}, 'micro avg': {'precision': 0.16408668730650156, 'recall': 0.1664050235478807, 'f1-score': 0.16523772408417772, 'support': 637}, 'macro avg': {'precision': 0.16706563706563707, 'recall': 0.1657479848269322, 'f1-score': 0.16572589859152193, 'support': 637}, 'weighted avg': {'precision': 0.1686880466472303, 'recall': 0.1664050235478807, 'f1-score': 0.16686646429919888, 'support': 637}}
Wrong BIO-Encoding 5/646 labels, 0.77%
Test-Data: Prec: 0.164, Rec: 0.166, F1: 0.1652

Scores from epoch with best dev-scores:
  Dev-Score: 0.7711
  Test-Score 0.1652

5.08 sec for evaluation

--------- Epoch 24 -----------
326.32 sec for training (8040.17 total)
-- cmv_modes1 --
{'C': {'precision': 0.8, 'recall': 0.7058823529411765, 'f1-score': 0.7500000000000001, 'support': 17}, 'P': {'precision': 0.6923076923076923, 'recall': 0.75, 'f1-score': 0.7199999999999999, 'support': 24}, 'micro avg': {'precision': 0.7317073170731707, 'recall': 0.7317073170731707, 'f1-score': 0.7317073170731707, 'support': 41}, 'macro avg': {'precision': 0.7461538461538462, 'recall': 0.7279411764705883, 'f1-score': 0.735, 'support': 41}, 'weighted avg': {'precision': 0.7369606003752345, 'recall': 0.7317073170731707, 'f1-score': 0.7324390243902439, 'support': 41}}
{'C': {'precision': 0.8, 'recall': 0.7058823529411765, 'f1-score': 0.7500000000000001, 'support': 17}, 'P': {'precision': 0.6923076923076923, 'recall': 0.75, 'f1-score': 0.7199999999999999, 'support': 24}, 'micro avg': {'precision': 0.7317073170731707, 'recall': 0.7317073170731707, 'f1-score': 0.7317073170731707, 'support': 41}, 'macro avg': {'precision': 0.7461538461538462, 'recall': 0.7279411764705883, 'f1-score': 0.735, 'support': 41}, 'weighted avg': {'precision': 0.7369606003752345, 'recall': 0.7317073170731707, 'f1-score': 0.7324390243902439, 'support': 41}}
Dev-Data: Prec: 0.732, Rec: 0.732, F1: 0.7317
{'C': {'precision': 0.1574074074074074, 'recall': 0.16776315789473684, 'f1-score': 0.1624203821656051, 'support': 304}, 'P': {'precision': 0.23076923076923078, 'recall': 0.22522522522522523, 'f1-score': 0.2279635258358663, 'support': 333}, 'micro avg': {'precision': 0.1941448382126348, 'recall': 0.1978021978021978, 'f1-score': 0.19595645412130638, 'support': 637}, 'macro avg': {'precision': 0.19408831908831908, 'recall': 0.19649419155998105, 'f1-score': 0.1951919540007357, 'support': 637}, 'weighted avg': {'precision': 0.1957582507033057, 'recall': 0.1978021978021978, 'f1-score': 0.19668390939040412, 'support': 637}}
Wrong BIO-Encoding 245/883 labels, 27.75%
{'C': {'precision': 0.1574074074074074, 'recall': 0.16776315789473684, 'f1-score': 0.1624203821656051, 'support': 304}, 'P': {'precision': 0.23076923076923078, 'recall': 0.22522522522522523, 'f1-score': 0.2279635258358663, 'support': 333}, 'micro avg': {'precision': 0.1941448382126348, 'recall': 0.1978021978021978, 'f1-score': 0.19595645412130638, 'support': 637}, 'macro avg': {'precision': 0.19408831908831908, 'recall': 0.19649419155998105, 'f1-score': 0.1951919540007357, 'support': 637}, 'weighted avg': {'precision': 0.1957582507033057, 'recall': 0.1978021978021978, 'f1-score': 0.19668390939040412, 'support': 637}}
Wrong BIO-Encoding 11/649 labels, 1.69%
Test-Data: Prec: 0.197, Rec: 0.198, F1: 0.1976

Scores from epoch with best dev-scores:
  Dev-Score: 0.7711
  Test-Score 0.1652

4.13 sec for evaluation

--------- Epoch 25 -----------
323.64 sec for training (8363.81 total)
-- cmv_modes1 --
{'C': {'precision': 0.9285714285714286, 'recall': 0.7647058823529411, 'f1-score': 0.8387096774193549, 'support': 17}, 'P': {'precision': 0.7037037037037037, 'recall': 0.7916666666666666, 'f1-score': 0.7450980392156864, 'support': 24}, 'micro avg': {'precision': 0.7804878048780488, 'recall': 0.7804878048780488, 'f1-score': 0.7804878048780488, 'support': 41}, 'macro avg': {'precision': 0.8161375661375662, 'recall': 0.7781862745098038, 'f1-score': 0.7919038583175206, 'support': 41}, 'weighted avg': {'precision': 0.79694154084398, 'recall': 0.7804878048780488, 'f1-score': 0.7839126209098903, 'support': 41}}
{'C': {'precision': 0.9285714285714286, 'recall': 0.7647058823529411, 'f1-score': 0.8387096774193549, 'support': 17}, 'P': {'precision': 0.7037037037037037, 'recall': 0.7916666666666666, 'f1-score': 0.7450980392156864, 'support': 24}, 'micro avg': {'precision': 0.7804878048780488, 'recall': 0.7804878048780488, 'f1-score': 0.7804878048780488, 'support': 41}, 'macro avg': {'precision': 0.8161375661375662, 'recall': 0.7781862745098038, 'f1-score': 0.7919038583175206, 'support': 41}, 'weighted avg': {'precision': 0.79694154084398, 'recall': 0.7804878048780488, 'f1-score': 0.7839126209098903, 'support': 41}}
Dev-Data: Prec: 0.780, Rec: 0.780, F1: 0.7805
{'C': {'precision': 0.13478260869565217, 'recall': 0.10197368421052631, 'f1-score': 0.11610486891385767, 'support': 304}, 'P': {'precision': 0.13163972286374134, 'recall': 0.17117117117117117, 'f1-score': 0.14882506527415143, 'support': 333}, 'micro avg': {'precision': 0.13273001508295626, 'recall': 0.13814756671899528, 'f1-score': 0.13538461538461538, 'support': 637}, 'macro avg': {'precision': 0.13321116577969677, 'recall': 0.13657242769084874, 'f1-score': 0.13246496709400454, 'support': 637}, 'weighted avg': {'precision': 0.13313962442245547, 'recall': 0.13814756671899528, 'f1-score': 0.1332097753314053, 'support': 637}}
Wrong BIO-Encoding 96/752 labels, 12.77%
{'C': {'precision': 0.13478260869565217, 'recall': 0.10197368421052631, 'f1-score': 0.11610486891385767, 'support': 304}, 'P': {'precision': 0.13163972286374134, 'recall': 0.17117117117117117, 'f1-score': 0.14882506527415143, 'support': 333}, 'micro avg': {'precision': 0.13273001508295626, 'recall': 0.13814756671899528, 'f1-score': 0.13538461538461538, 'support': 637}, 'macro avg': {'precision': 0.13321116577969677, 'recall': 0.13657242769084874, 'f1-score': 0.13246496709400454, 'support': 637}, 'weighted avg': {'precision': 0.13313962442245547, 'recall': 0.13814756671899528, 'f1-score': 0.1332097753314053, 'support': 637}}
Wrong BIO-Encoding 7/663 labels, 1.06%
Test-Data: Prec: 0.134, Rec: 0.138, F1: 0.1361

Scores from epoch with best dev-scores:
  Dev-Score: 0.7805
  Test-Score 0.1361

4.68 sec for evaluation

--------- Epoch 26 -----------
326.35 sec for training (8690.16 total)
-- cmv_modes1 --
{'C': {'precision': 0.8333333333333334, 'recall': 0.8823529411764706, 'f1-score': 0.8571428571428571, 'support': 17}, 'P': {'precision': 0.6923076923076923, 'recall': 0.75, 'f1-score': 0.7199999999999999, 'support': 24}, 'micro avg': {'precision': 0.75, 'recall': 0.8048780487804879, 'f1-score': 0.7764705882352942, 'support': 41}, 'macro avg': {'precision': 0.7628205128205128, 'recall': 0.8161764705882353, 'f1-score': 0.7885714285714285, 'support': 41}, 'weighted avg': {'precision': 0.7507817385866166, 'recall': 0.8048780487804879, 'f1-score': 0.7768641114982578, 'support': 41}}
{'C': {'precision': 0.8333333333333334, 'recall': 0.8823529411764706, 'f1-score': 0.8571428571428571, 'support': 17}, 'P': {'precision': 0.6923076923076923, 'recall': 0.75, 'f1-score': 0.7199999999999999, 'support': 24}, 'micro avg': {'precision': 0.75, 'recall': 0.8048780487804879, 'f1-score': 0.7764705882352942, 'support': 41}, 'macro avg': {'precision': 0.7628205128205128, 'recall': 0.8161764705882353, 'f1-score': 0.7885714285714285, 'support': 41}, 'weighted avg': {'precision': 0.7507817385866166, 'recall': 0.8048780487804879, 'f1-score': 0.7768641114982578, 'support': 41}}
Dev-Data: Prec: 0.750, Rec: 0.805, F1: 0.7765
{'C': {'precision': 0.15402843601895735, 'recall': 0.2138157894736842, 'f1-score': 0.17906336088154268, 'support': 304}, 'P': {'precision': 0.22875816993464052, 'recall': 0.21021021021021022, 'f1-score': 0.2190923317683881, 'support': 333}, 'micro avg': {'precision': 0.18543956043956045, 'recall': 0.2119309262166405, 'f1-score': 0.1978021978021978, 'support': 637}, 'macro avg': {'precision': 0.19139330297679893, 'recall': 0.21201299984194721, 'f1-score': 0.1990778463249654, 'support': 637}, 'weighted avg': {'precision': 0.1930943722731528, 'recall': 0.2119309262166405, 'f1-score': 0.19998902384122794, 'support': 637}}
Wrong BIO-Encoding 71/794 labels, 8.94%
{'C': {'precision': 0.15402843601895735, 'recall': 0.2138157894736842, 'f1-score': 0.17906336088154268, 'support': 304}, 'P': {'precision': 0.22875816993464052, 'recall': 0.21021021021021022, 'f1-score': 0.2190923317683881, 'support': 333}, 'micro avg': {'precision': 0.18543956043956045, 'recall': 0.2119309262166405, 'f1-score': 0.1978021978021978, 'support': 637}, 'macro avg': {'precision': 0.19139330297679893, 'recall': 0.21201299984194721, 'f1-score': 0.1990778463249654, 'support': 637}, 'weighted avg': {'precision': 0.1930943722731528, 'recall': 0.2119309262166405, 'f1-score': 0.19998902384122794, 'support': 637}}
Wrong BIO-Encoding 5/728 labels, 0.69%
Test-Data: Prec: 0.187, Rec: 0.212, F1: 0.1985

Scores from epoch with best dev-scores:
  Dev-Score: 0.7805
  Test-Score 0.1361

4.14 sec for evaluation

--------- Epoch 27 -----------
329.92 sec for training (9020.09 total)
-- cmv_modes1 --
{'C': {'precision': 0.875, 'recall': 0.8235294117647058, 'f1-score': 0.8484848484848485, 'support': 17}, 'P': {'precision': 0.5925925925925926, 'recall': 0.6666666666666666, 'f1-score': 0.627450980392157, 'support': 24}, 'micro avg': {'precision': 0.6976744186046512, 'recall': 0.7317073170731707, 'f1-score': 0.7142857142857143, 'support': 41}, 'macro avg': {'precision': 0.7337962962962963, 'recall': 0.7450980392156863, 'f1-score': 0.7379679144385027, 'support': 41}, 'weighted avg': {'precision': 0.7096883468834688, 'recall': 0.7317073170731707, 'f1-score': 0.7190991696013217, 'support': 41}}
{'C': {'precision': 0.875, 'recall': 0.8235294117647058, 'f1-score': 0.8484848484848485, 'support': 17}, 'P': {'precision': 0.5925925925925926, 'recall': 0.6666666666666666, 'f1-score': 0.627450980392157, 'support': 24}, 'micro avg': {'precision': 0.6976744186046512, 'recall': 0.7317073170731707, 'f1-score': 0.7142857142857143, 'support': 41}, 'macro avg': {'precision': 0.7337962962962963, 'recall': 0.7450980392156863, 'f1-score': 0.7379679144385027, 'support': 41}, 'weighted avg': {'precision': 0.7096883468834688, 'recall': 0.7317073170731707, 'f1-score': 0.7190991696013217, 'support': 41}}
Dev-Data: Prec: 0.698, Rec: 0.732, F1: 0.7143
{'C': {'precision': 0.15501519756838905, 'recall': 0.16776315789473684, 'f1-score': 0.16113744075829384, 'support': 304}, 'P': {'precision': 0.24812030075187969, 'recall': 0.2972972972972973, 'f1-score': 0.27049180327868855, 'support': 333}, 'micro avg': {'precision': 0.20604395604395603, 'recall': 0.23547880690737832, 'f1-score': 0.21978021978021978, 'support': 637}, 'macro avg': {'precision': 0.20156774916013437, 'recall': 0.23253022759601708, 'f1-score': 0.2158146220184912, 'support': 637}, 'weighted avg': {'precision': 0.20368709609288257, 'recall': 0.23547880690737832, 'f1-score': 0.2183038500507451, 'support': 637}}
Wrong BIO-Encoding 81/803 labels, 10.09%
{'C': {'precision': 0.15501519756838905, 'recall': 0.16776315789473684, 'f1-score': 0.16113744075829384, 'support': 304}, 'P': {'precision': 0.24812030075187969, 'recall': 0.2972972972972973, 'f1-score': 0.27049180327868855, 'support': 333}, 'micro avg': {'precision': 0.20604395604395603, 'recall': 0.23547880690737832, 'f1-score': 0.21978021978021978, 'support': 637}, 'macro avg': {'precision': 0.20156774916013437, 'recall': 0.23253022759601708, 'f1-score': 0.2158146220184912, 'support': 637}, 'weighted avg': {'precision': 0.20368709609288257, 'recall': 0.23547880690737832, 'f1-score': 0.2183038500507451, 'support': 637}}
Wrong BIO-Encoding 6/728 labels, 0.82%
Test-Data: Prec: 0.208, Rec: 0.235, F1: 0.2208

Scores from epoch with best dev-scores:
  Dev-Score: 0.7805
  Test-Score 0.1361

4.15 sec for evaluation

--------- Epoch 28 -----------
329.39 sec for training (9349.48 total)
-- cmv_modes1 --
{'C': {'precision': 0.9285714285714286, 'recall': 0.7647058823529411, 'f1-score': 0.8387096774193549, 'support': 17}, 'P': {'precision': 0.6666666666666666, 'recall': 0.75, 'f1-score': 0.7058823529411765, 'support': 24}, 'micro avg': {'precision': 0.7560975609756098, 'recall': 0.7560975609756098, 'f1-score': 0.7560975609756099, 'support': 41}, 'macro avg': {'precision': 0.7976190476190477, 'recall': 0.7573529411764706, 'f1-score': 0.7722960151802657, 'support': 41}, 'weighted avg': {'precision': 0.7752613240418118, 'recall': 0.7560975609756098, 'f1-score': 0.7609570972370066, 'support': 41}}
{'C': {'precision': 0.9285714285714286, 'recall': 0.7647058823529411, 'f1-score': 0.8387096774193549, 'support': 17}, 'P': {'precision': 0.6666666666666666, 'recall': 0.75, 'f1-score': 0.7058823529411765, 'support': 24}, 'micro avg': {'precision': 0.7560975609756098, 'recall': 0.7560975609756098, 'f1-score': 0.7560975609756099, 'support': 41}, 'macro avg': {'precision': 0.7976190476190477, 'recall': 0.7573529411764706, 'f1-score': 0.7722960151802657, 'support': 41}, 'weighted avg': {'precision': 0.7752613240418118, 'recall': 0.7560975609756098, 'f1-score': 0.7609570972370066, 'support': 41}}
Dev-Data: Prec: 0.756, Rec: 0.756, F1: 0.7561
{'C': {'precision': 0.20297029702970298, 'recall': 0.13486842105263158, 'f1-score': 0.16205533596837945, 'support': 304}, 'P': {'precision': 0.25277161862527714, 'recall': 0.34234234234234234, 'f1-score': 0.29081632653061223, 'support': 333}, 'micro avg': {'precision': 0.23736600306278713, 'recall': 0.24332810047095763, 'f1-score': 0.24031007751937986, 'support': 637}, 'macro avg': {'precision': 0.22787095782749006, 'recall': 0.23860538169748696, 'f1-score': 0.22643583124949584, 'support': 637}, 'weighted avg': {'precision': 0.22900458288735795, 'recall': 0.24332810047095763, 'f1-score': 0.2293668114114305, 'support': 637}}
Wrong BIO-Encoding 211/851 labels, 24.79%
{'C': {'precision': 0.20297029702970298, 'recall': 0.13486842105263158, 'f1-score': 0.16205533596837945, 'support': 304}, 'P': {'precision': 0.25277161862527714, 'recall': 0.34234234234234234, 'f1-score': 0.29081632653061223, 'support': 333}, 'micro avg': {'precision': 0.23736600306278713, 'recall': 0.24332810047095763, 'f1-score': 0.24031007751937986, 'support': 637}, 'macro avg': {'precision': 0.22787095782749006, 'recall': 0.23860538169748696, 'f1-score': 0.22643583124949584, 'support': 637}, 'weighted avg': {'precision': 0.22900458288735795, 'recall': 0.24332810047095763, 'f1-score': 0.2293668114114305, 'support': 637}}
Wrong BIO-Encoding 13/653 labels, 1.99%
Test-Data: Prec: 0.241, Rec: 0.242, F1: 0.2412

Scores from epoch with best dev-scores:
  Dev-Score: 0.7805
  Test-Score 0.1361

4.13 sec for evaluation

--------- Epoch 29 -----------
328.72 sec for training (9678.20 total)
-- cmv_modes1 --
{'C': {'precision': 0.8888888888888888, 'recall': 0.9411764705882353, 'f1-score': 0.9142857142857143, 'support': 17}, 'P': {'precision': 0.88, 'recall': 0.9166666666666666, 'f1-score': 0.8979591836734694, 'support': 24}, 'micro avg': {'precision': 0.8837209302325582, 'recall': 0.926829268292683, 'f1-score': 0.9047619047619047, 'support': 41}, 'macro avg': {'precision': 0.8844444444444444, 'recall': 0.928921568627451, 'f1-score': 0.9061224489795918, 'support': 41}, 'weighted avg': {'precision': 0.8836856368563686, 'recall': 0.926829268292683, 'f1-score': 0.9047287207565953, 'support': 41}}
{'C': {'precision': 0.8888888888888888, 'recall': 0.9411764705882353, 'f1-score': 0.9142857142857143, 'support': 17}, 'P': {'precision': 0.88, 'recall': 0.9166666666666666, 'f1-score': 0.8979591836734694, 'support': 24}, 'micro avg': {'precision': 0.8837209302325582, 'recall': 0.926829268292683, 'f1-score': 0.9047619047619047, 'support': 41}, 'macro avg': {'precision': 0.8844444444444444, 'recall': 0.928921568627451, 'f1-score': 0.9061224489795918, 'support': 41}, 'weighted avg': {'precision': 0.8836856368563686, 'recall': 0.926829268292683, 'f1-score': 0.9047287207565953, 'support': 41}}
Dev-Data: Prec: 0.884, Rec: 0.927, F1: 0.9048
{'C': {'precision': 0.15168539325842698, 'recall': 0.17763157894736842, 'f1-score': 0.16363636363636366, 'support': 304}, 'P': {'precision': 0.22028985507246376, 'recall': 0.22822822822822822, 'f1-score': 0.22418879056047195, 'support': 333}, 'micro avg': {'precision': 0.18544935805991442, 'recall': 0.20408163265306123, 'f1-score': 0.19431988041853512, 'support': 637}, 'macro avg': {'precision': 0.18598762416544537, 'recall': 0.20292990358779833, 'f1-score': 0.1939125770984178, 'support': 637}, 'weighted avg': {'precision': 0.18754926419103962, 'recall': 0.20408163265306123, 'f1-score': 0.1952909290456699, 'support': 637}}
Wrong BIO-Encoding 221/905 labels, 24.42%
{'C': {'precision': 0.15168539325842698, 'recall': 0.17763157894736842, 'f1-score': 0.16363636363636366, 'support': 304}, 'P': {'precision': 0.22028985507246376, 'recall': 0.22822822822822822, 'f1-score': 0.22418879056047195, 'support': 333}, 'micro avg': {'precision': 0.18544935805991442, 'recall': 0.20408163265306123, 'f1-score': 0.19431988041853512, 'support': 637}, 'macro avg': {'precision': 0.18598762416544537, 'recall': 0.20292990358779833, 'f1-score': 0.1939125770984178, 'support': 637}, 'weighted avg': {'precision': 0.18754926419103962, 'recall': 0.20408163265306123, 'f1-score': 0.1952909290456699, 'support': 637}}
Wrong BIO-Encoding 17/701 labels, 2.43%
Test-Data: Prec: 0.189, Rec: 0.203, F1: 0.1953

Scores from epoch with best dev-scores:
  Dev-Score: 0.9048
  Test-Score 0.1953

4.82 sec for evaluation

--------- Epoch 30 -----------
327.61 sec for training (10005.80 total)
-- cmv_modes1 --
{'C': {'precision': 0.9411764705882353, 'recall': 0.9411764705882353, 'f1-score': 0.9411764705882353, 'support': 17}, 'P': {'precision': 0.7692307692307693, 'recall': 0.8333333333333334, 'f1-score': 0.8, 'support': 24}, 'micro avg': {'precision': 0.8372093023255814, 'recall': 0.8780487804878049, 'f1-score': 0.8571428571428572, 'support': 41}, 'macro avg': {'precision': 0.8552036199095023, 'recall': 0.8872549019607843, 'f1-score': 0.8705882352941177, 'support': 41}, 'weighted avg': {'precision': 0.8405253283302065, 'recall': 0.8780487804878049, 'f1-score': 0.8585365853658538, 'support': 41}}
{'C': {'precision': 0.9411764705882353, 'recall': 0.9411764705882353, 'f1-score': 0.9411764705882353, 'support': 17}, 'P': {'precision': 0.7692307692307693, 'recall': 0.8333333333333334, 'f1-score': 0.8, 'support': 24}, 'micro avg': {'precision': 0.8372093023255814, 'recall': 0.8780487804878049, 'f1-score': 0.8571428571428572, 'support': 41}, 'macro avg': {'precision': 0.8552036199095023, 'recall': 0.8872549019607843, 'f1-score': 0.8705882352941177, 'support': 41}, 'weighted avg': {'precision': 0.8405253283302065, 'recall': 0.8780487804878049, 'f1-score': 0.8585365853658538, 'support': 41}}
Dev-Data: Prec: 0.837, Rec: 0.878, F1: 0.8571
{'C': {'precision': 0.1507177033492823, 'recall': 0.20723684210526316, 'f1-score': 0.17451523545706374, 'support': 304}, 'P': {'precision': 0.23607427055702918, 'recall': 0.2672672672672673, 'f1-score': 0.2507042253521127, 'support': 333}, 'micro avg': {'precision': 0.19119496855345913, 'recall': 0.23861852433281006, 'f1-score': 0.2122905027932961, 'support': 637}, 'macro avg': {'precision': 0.19339598695315574, 'recall': 0.23725205468626523, 'f1-score': 0.2126097304045882, 'support': 637}, 'weighted avg': {'precision': 0.1953389543385754, 'recall': 0.23861852433281006, 'f1-score': 0.21434401667378478, 'support': 637}}
Wrong BIO-Encoding 119/906 labels, 13.13%
{'C': {'precision': 0.1507177033492823, 'recall': 0.20723684210526316, 'f1-score': 0.17451523545706374, 'support': 304}, 'P': {'precision': 0.23607427055702918, 'recall': 0.2672672672672673, 'f1-score': 0.2507042253521127, 'support': 333}, 'micro avg': {'precision': 0.19119496855345913, 'recall': 0.23861852433281006, 'f1-score': 0.2122905027932961, 'support': 637}, 'macro avg': {'precision': 0.19339598695315574, 'recall': 0.23725205468626523, 'f1-score': 0.2126097304045882, 'support': 637}, 'weighted avg': {'precision': 0.1953389543385754, 'recall': 0.23861852433281006, 'f1-score': 0.21434401667378478, 'support': 637}}
Wrong BIO-Encoding 8/795 labels, 1.01%
Test-Data: Prec: 0.193, Rec: 0.239, F1: 0.2135

Scores from epoch with best dev-scores:
  Dev-Score: 0.9048
  Test-Score 0.1953

4.13 sec for evaluation

--------- Epoch 31 -----------
321.68 sec for training (10327.49 total)
-- cmv_modes1 --
{'C': {'precision': 0.9375, 'recall': 0.8823529411764706, 'f1-score': 0.9090909090909091, 'support': 17}, 'P': {'precision': 0.84, 'recall': 0.875, 'f1-score': 0.8571428571428572, 'support': 24}, 'micro avg': {'precision': 0.8780487804878049, 'recall': 0.8780487804878049, 'f1-score': 0.8780487804878049, 'support': 41}, 'macro avg': {'precision': 0.8887499999999999, 'recall': 0.8786764705882353, 'f1-score': 0.8831168831168832, 'support': 41}, 'weighted avg': {'precision': 0.8804268292682926, 'recall': 0.8780487804878049, 'f1-score': 0.8786822933164395, 'support': 41}}
{'C': {'precision': 0.9375, 'recall': 0.8823529411764706, 'f1-score': 0.9090909090909091, 'support': 17}, 'P': {'precision': 0.84, 'recall': 0.875, 'f1-score': 0.8571428571428572, 'support': 24}, 'micro avg': {'precision': 0.8780487804878049, 'recall': 0.8780487804878049, 'f1-score': 0.8780487804878049, 'support': 41}, 'macro avg': {'precision': 0.8887499999999999, 'recall': 0.8786764705882353, 'f1-score': 0.8831168831168832, 'support': 41}, 'weighted avg': {'precision': 0.8804268292682926, 'recall': 0.8780487804878049, 'f1-score': 0.8786822933164395, 'support': 41}}
Dev-Data: Prec: 0.878, Rec: 0.878, F1: 0.8780
{'C': {'precision': 0.1574074074074074, 'recall': 0.16776315789473684, 'f1-score': 0.1624203821656051, 'support': 304}, 'P': {'precision': 0.24250681198910082, 'recall': 0.2672672672672673, 'f1-score': 0.25428571428571434, 'support': 333}, 'micro avg': {'precision': 0.20260492040520983, 'recall': 0.21978021978021978, 'f1-score': 0.2108433734939759, 'support': 637}, 'macro avg': {'precision': 0.19995710969825412, 'recall': 0.21751521258100207, 'f1-score': 0.2083530482256597, 'support': 637}, 'weighted avg': {'precision': 0.2018942233033319, 'recall': 0.21978021978021978, 'f1-score': 0.2104441743100264, 'support': 637}}
Wrong BIO-Encoding 216/891 labels, 24.24%
{'C': {'precision': 0.1574074074074074, 'recall': 0.16776315789473684, 'f1-score': 0.1624203821656051, 'support': 304}, 'P': {'precision': 0.24250681198910082, 'recall': 0.2672672672672673, 'f1-score': 0.25428571428571434, 'support': 333}, 'micro avg': {'precision': 0.20260492040520983, 'recall': 0.21978021978021978, 'f1-score': 0.2108433734939759, 'support': 637}, 'macro avg': {'precision': 0.19995710969825412, 'recall': 0.21751521258100207, 'f1-score': 0.2083530482256597, 'support': 637}, 'weighted avg': {'precision': 0.2018942233033319, 'recall': 0.21978021978021978, 'f1-score': 0.2104441743100264, 'support': 637}}
Wrong BIO-Encoding 16/691 labels, 2.32%
Test-Data: Prec: 0.207, Rec: 0.220, F1: 0.2134

Scores from epoch with best dev-scores:
  Dev-Score: 0.9048
  Test-Score 0.1953

4.11 sec for evaluation

--------- Epoch 32 -----------
324.86 sec for training (10652.35 total)
-- cmv_modes1 --
{'C': {'precision': 0.9411764705882353, 'recall': 0.9411764705882353, 'f1-score': 0.9411764705882353, 'support': 17}, 'P': {'precision': 0.7407407407407407, 'recall': 0.8333333333333334, 'f1-score': 0.7843137254901961, 'support': 24}, 'micro avg': {'precision': 0.8181818181818182, 'recall': 0.8780487804878049, 'f1-score': 0.8470588235294119, 'support': 41}, 'macro avg': {'precision': 0.840958605664488, 'recall': 0.8872549019607843, 'f1-score': 0.8627450980392157, 'support': 41}, 'weighted avg': {'precision': 0.8238482384823849, 'recall': 0.8780487804878049, 'f1-score': 0.8493543758967003, 'support': 41}}
{'C': {'precision': 0.9411764705882353, 'recall': 0.9411764705882353, 'f1-score': 0.9411764705882353, 'support': 17}, 'P': {'precision': 0.7407407407407407, 'recall': 0.8333333333333334, 'f1-score': 0.7843137254901961, 'support': 24}, 'micro avg': {'precision': 0.8181818181818182, 'recall': 0.8780487804878049, 'f1-score': 0.8470588235294119, 'support': 41}, 'macro avg': {'precision': 0.840958605664488, 'recall': 0.8872549019607843, 'f1-score': 0.8627450980392157, 'support': 41}, 'weighted avg': {'precision': 0.8238482384823849, 'recall': 0.8780487804878049, 'f1-score': 0.8493543758967003, 'support': 41}}
Dev-Data: Prec: 0.818, Rec: 0.878, F1: 0.8471
{'C': {'precision': 0.18309859154929578, 'recall': 0.2138157894736842, 'f1-score': 0.19726858877086492, 'support': 304}, 'P': {'precision': 0.24671916010498687, 'recall': 0.2822822822822823, 'f1-score': 0.26330532212885155, 'support': 333}, 'micro avg': {'precision': 0.21603260869565216, 'recall': 0.24960753532182103, 'f1-score': 0.2316096139839767, 'support': 637}, 'macro avg': {'precision': 0.21490887582714133, 'recall': 0.24804903587798327, 'f1-score': 0.23028695544985822, 'support': 637}, 'weighted avg': {'precision': 0.2163570677330401, 'recall': 0.24960753532182103, 'f1-score': 0.2317901463975675, 'support': 637}}
Wrong BIO-Encoding 126/848 labels, 14.86%
{'C': {'precision': 0.18309859154929578, 'recall': 0.2138157894736842, 'f1-score': 0.19726858877086492, 'support': 304}, 'P': {'precision': 0.24671916010498687, 'recall': 0.2822822822822823, 'f1-score': 0.26330532212885155, 'support': 333}, 'micro avg': {'precision': 0.21603260869565216, 'recall': 0.24960753532182103, 'f1-score': 0.2316096139839767, 'support': 637}, 'macro avg': {'precision': 0.21490887582714133, 'recall': 0.24804903587798327, 'f1-score': 0.23028695544985822, 'support': 637}, 'weighted avg': {'precision': 0.2163570677330401, 'recall': 0.24960753532182103, 'f1-score': 0.2317901463975675, 'support': 637}}
Wrong BIO-Encoding 14/736 labels, 1.90%
Test-Data: Prec: 0.220, Rec: 0.250, F1: 0.2340

Scores from epoch with best dev-scores:
  Dev-Score: 0.9048
  Test-Score 0.1953

4.13 sec for evaluation

--------- Epoch 33 -----------
337.75 sec for training (10990.09 total)
-- cmv_modes1 --
{'C': {'precision': 1.0, 'recall': 0.9411764705882353, 'f1-score': 0.9696969696969697, 'support': 17}, 'P': {'precision': 0.8, 'recall': 0.8333333333333334, 'f1-score': 0.816326530612245, 'support': 24}, 'micro avg': {'precision': 0.8780487804878049, 'recall': 0.8780487804878049, 'f1-score': 0.8780487804878049, 'support': 41}, 'macro avg': {'precision': 0.9, 'recall': 0.8872549019607843, 'f1-score': 0.8930117501546073, 'support': 41}, 'weighted avg': {'precision': 0.8829268292682928, 'recall': 0.8780487804878049, 'f1-score': 0.8799191516961553, 'support': 41}}
{'C': {'precision': 1.0, 'recall': 0.9411764705882353, 'f1-score': 0.9696969696969697, 'support': 17}, 'P': {'precision': 0.8, 'recall': 0.8333333333333334, 'f1-score': 0.816326530612245, 'support': 24}, 'micro avg': {'precision': 0.8780487804878049, 'recall': 0.8780487804878049, 'f1-score': 0.8780487804878049, 'support': 41}, 'macro avg': {'precision': 0.9, 'recall': 0.8872549019607843, 'f1-score': 0.8930117501546073, 'support': 41}, 'weighted avg': {'precision': 0.8829268292682928, 'recall': 0.8780487804878049, 'f1-score': 0.8799191516961553, 'support': 41}}
Dev-Data: Prec: 0.878, Rec: 0.878, F1: 0.8780
{'C': {'precision': 0.21568627450980393, 'recall': 0.2532894736842105, 'f1-score': 0.2329803328290469, 'support': 304}, 'P': {'precision': 0.3098958333333333, 'recall': 0.35735735735735735, 'f1-score': 0.3319386331938633, 'support': 333}, 'micro avg': {'precision': 0.26450742240215924, 'recall': 0.3076923076923077, 'f1-score': 0.28447024673439764, 'support': 637}, 'macro avg': {'precision': 0.26279105392156865, 'recall': 0.3053234155207839, 'f1-score': 0.28245948301145507, 'support': 637}, 'weighted avg': {'precision': 0.26493554152430204, 'recall': 0.3076923076923077, 'f1-score': 0.28471206598679233, 'support': 637}}
Wrong BIO-Encoding 173/904 labels, 19.14%
{'C': {'precision': 0.21568627450980393, 'recall': 0.2532894736842105, 'f1-score': 0.2329803328290469, 'support': 304}, 'P': {'precision': 0.3098958333333333, 'recall': 0.35735735735735735, 'f1-score': 0.3319386331938633, 'support': 333}, 'micro avg': {'precision': 0.26450742240215924, 'recall': 0.3076923076923077, 'f1-score': 0.28447024673439764, 'support': 637}, 'macro avg': {'precision': 0.26279105392156865, 'recall': 0.3053234155207839, 'f1-score': 0.28245948301145507, 'support': 637}, 'weighted avg': {'precision': 0.26493554152430204, 'recall': 0.3076923076923077, 'f1-score': 0.28471206598679233, 'support': 637}}
Wrong BIO-Encoding 10/741 labels, 1.35%
Test-Data: Prec: 0.268, Rec: 0.308, F1: 0.2865

Scores from epoch with best dev-scores:
  Dev-Score: 0.9048
  Test-Score 0.1953

6.43 sec for evaluation

--------- Epoch 34 -----------
440.73 sec for training (11430.82 total)
-- cmv_modes1 --
{'C': {'precision': 0.9411764705882353, 'recall': 0.9411764705882353, 'f1-score': 0.9411764705882353, 'support': 17}, 'P': {'precision': 0.88, 'recall': 0.9166666666666666, 'f1-score': 0.8979591836734694, 'support': 24}, 'micro avg': {'precision': 0.9047619047619048, 'recall': 0.926829268292683, 'f1-score': 0.9156626506024096, 'support': 41}, 'macro avg': {'precision': 0.9105882352941177, 'recall': 0.928921568627451, 'f1-score': 0.9195678271308523, 'support': 41}, 'weighted avg': {'precision': 0.9053658536585367, 'recall': 0.926829268292683, 'f1-score': 0.9158785465405676, 'support': 41}}
{'C': {'precision': 0.9411764705882353, 'recall': 0.9411764705882353, 'f1-score': 0.9411764705882353, 'support': 17}, 'P': {'precision': 0.88, 'recall': 0.9166666666666666, 'f1-score': 0.8979591836734694, 'support': 24}, 'micro avg': {'precision': 0.9047619047619048, 'recall': 0.926829268292683, 'f1-score': 0.9156626506024096, 'support': 41}, 'macro avg': {'precision': 0.9105882352941177, 'recall': 0.928921568627451, 'f1-score': 0.9195678271308523, 'support': 41}, 'weighted avg': {'precision': 0.9053658536585367, 'recall': 0.926829268292683, 'f1-score': 0.9158785465405676, 'support': 41}}
Dev-Data: Prec: 0.905, Rec: 0.927, F1: 0.9157
{'C': {'precision': 0.1913265306122449, 'recall': 0.24671052631578946, 'f1-score': 0.21551724137931033, 'support': 304}, 'P': {'precision': 0.2884012539184953, 'recall': 0.27627627627627627, 'f1-score': 0.28220858895705525, 'support': 333}, 'micro avg': {'precision': 0.2348804500703235, 'recall': 0.2621664050235479, 'f1-score': 0.24777448071216618, 'support': 637}, 'macro avg': {'precision': 0.23986389226537008, 'recall': 0.2614934012960329, 'f1-score': 0.2488629151681828, 'support': 637}, 'weighted avg': {'precision': 0.24207359946778867, 'recall': 0.2621664050235479, 'f1-score': 0.2503810070675192, 'support': 637}}
Wrong BIO-Encoding 175/879 labels, 19.91%
{'C': {'precision': 0.1913265306122449, 'recall': 0.24671052631578946, 'f1-score': 0.21551724137931033, 'support': 304}, 'P': {'precision': 0.2884012539184953, 'recall': 0.27627627627627627, 'f1-score': 0.28220858895705525, 'support': 333}, 'micro avg': {'precision': 0.2348804500703235, 'recall': 0.2621664050235479, 'f1-score': 0.24777448071216618, 'support': 637}, 'macro avg': {'precision': 0.23986389226537008, 'recall': 0.2614934012960329, 'f1-score': 0.2488629151681828, 'support': 637}, 'weighted avg': {'precision': 0.24207359946778867, 'recall': 0.2621664050235479, 'f1-score': 0.2503810070675192, 'support': 637}}
Wrong BIO-Encoding 7/711 labels, 0.98%
Test-Data: Prec: 0.237, Rec: 0.262, F1: 0.2491

Scores from epoch with best dev-scores:
  Dev-Score: 0.9157
  Test-Score 0.2491

7.59 sec for evaluation

--------- Epoch 35 -----------
392.02 sec for training (11822.84 total)
-- cmv_modes1 --
{'C': {'precision': 1.0, 'recall': 0.9411764705882353, 'f1-score': 0.9696969696969697, 'support': 17}, 'P': {'precision': 0.9583333333333334, 'recall': 0.9583333333333334, 'f1-score': 0.9583333333333334, 'support': 24}, 'micro avg': {'precision': 0.975, 'recall': 0.9512195121951219, 'f1-score': 0.9629629629629629, 'support': 41}, 'macro avg': {'precision': 0.9791666666666667, 'recall': 0.9497549019607843, 'f1-score': 0.9640151515151516, 'support': 41}, 'weighted avg': {'precision': 0.975609756097561, 'recall': 0.9512195121951219, 'f1-score': 0.9630450849963045, 'support': 41}}
{'C': {'precision': 1.0, 'recall': 0.9411764705882353, 'f1-score': 0.9696969696969697, 'support': 17}, 'P': {'precision': 0.9583333333333334, 'recall': 0.9583333333333334, 'f1-score': 0.9583333333333334, 'support': 24}, 'micro avg': {'precision': 0.975, 'recall': 0.9512195121951219, 'f1-score': 0.9629629629629629, 'support': 41}, 'macro avg': {'precision': 0.9791666666666667, 'recall': 0.9497549019607843, 'f1-score': 0.9640151515151516, 'support': 41}, 'weighted avg': {'precision': 0.975609756097561, 'recall': 0.9512195121951219, 'f1-score': 0.9630450849963045, 'support': 41}}
Dev-Data: Prec: 0.975, Rec: 0.951, F1: 0.9630
{'C': {'precision': 0.13780918727915195, 'recall': 0.12828947368421054, 'f1-score': 0.13287904599659286, 'support': 304}, 'P': {'precision': 0.23737373737373738, 'recall': 0.2822822822822823, 'f1-score': 0.2578875171467764, 'support': 333}, 'micro avg': {'precision': 0.1958762886597938, 'recall': 0.2087912087912088, 'f1-score': 0.20212765957446807, 'support': 637}, 'macro avg': {'precision': 0.18759146232644466, 'recall': 0.20528587798324643, 'f1-score': 0.1953832815716846, 'support': 637}, 'weighted avg': {'precision': 0.18985784533487715, 'recall': 0.2087912087912088, 'f1-score': 0.19822884331686147, 'support': 637}}
Wrong BIO-Encoding 125/795 labels, 15.72%
{'C': {'precision': 0.13780918727915195, 'recall': 0.12828947368421054, 'f1-score': 0.13287904599659286, 'support': 304}, 'P': {'precision': 0.23737373737373738, 'recall': 0.2822822822822823, 'f1-score': 0.2578875171467764, 'support': 333}, 'micro avg': {'precision': 0.1958762886597938, 'recall': 0.2087912087912088, 'f1-score': 0.20212765957446807, 'support': 637}, 'macro avg': {'precision': 0.18759146232644466, 'recall': 0.20528587798324643, 'f1-score': 0.1953832815716846, 'support': 637}, 'weighted avg': {'precision': 0.18985784533487715, 'recall': 0.2087912087912088, 'f1-score': 0.19822884331686147, 'support': 637}}
Wrong BIO-Encoding 9/679 labels, 1.33%
Test-Data: Prec: 0.199, Rec: 0.209, F1: 0.2035

Scores from epoch with best dev-scores:
  Dev-Score: 0.9630
  Test-Score 0.2035

4.85 sec for evaluation

--------- Epoch 36 -----------
328.17 sec for training (12151.01 total)
-- cmv_modes1 --
{'C': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 17}, 'P': {'precision': 0.8, 'recall': 0.8333333333333334, 'f1-score': 0.816326530612245, 'support': 24}, 'micro avg': {'precision': 0.8809523809523809, 'recall': 0.9024390243902439, 'f1-score': 0.8915662650602411, 'support': 41}, 'macro avg': {'precision': 0.9, 'recall': 0.9166666666666667, 'f1-score': 0.9081632653061225, 'support': 41}, 'weighted avg': {'precision': 0.8829268292682928, 'recall': 0.9024390243902439, 'f1-score': 0.8924838227974118, 'support': 41}}
{'C': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 17}, 'P': {'precision': 0.8, 'recall': 0.8333333333333334, 'f1-score': 0.816326530612245, 'support': 24}, 'micro avg': {'precision': 0.8809523809523809, 'recall': 0.9024390243902439, 'f1-score': 0.8915662650602411, 'support': 41}, 'macro avg': {'precision': 0.9, 'recall': 0.9166666666666667, 'f1-score': 0.9081632653061225, 'support': 41}, 'weighted avg': {'precision': 0.8829268292682928, 'recall': 0.9024390243902439, 'f1-score': 0.8924838227974118, 'support': 41}}
Dev-Data: Prec: 0.881, Rec: 0.902, F1: 0.8916
{'C': {'precision': 0.20157068062827224, 'recall': 0.2532894736842105, 'f1-score': 0.22448979591836735, 'support': 304}, 'P': {'precision': 0.31117021276595747, 'recall': 0.35135135135135137, 'f1-score': 0.33004231311706633, 'support': 333}, 'micro avg': {'precision': 0.2559366754617414, 'recall': 0.304552590266876, 'f1-score': 0.2781362007168459, 'support': 637}, 'macro avg': {'precision': 0.25637044669711484, 'recall': 0.30232041251778097, 'f1-score': 0.27726605451771685, 'support': 637}, 'weighted avg': {'precision': 0.25886525551343575, 'recall': 0.304552590266876, 'f1-score': 0.27966874132993214, 'support': 637}}
Wrong BIO-Encoding 267/1012 labels, 26.38%
{'C': {'precision': 0.20157068062827224, 'recall': 0.2532894736842105, 'f1-score': 0.22448979591836735, 'support': 304}, 'P': {'precision': 0.31117021276595747, 'recall': 0.35135135135135137, 'f1-score': 0.33004231311706633, 'support': 333}, 'micro avg': {'precision': 0.2559366754617414, 'recall': 0.304552590266876, 'f1-score': 0.2781362007168459, 'support': 637}, 'macro avg': {'precision': 0.25637044669711484, 'recall': 0.30232041251778097, 'f1-score': 0.27726605451771685, 'support': 637}, 'weighted avg': {'precision': 0.25886525551343575, 'recall': 0.304552590266876, 'f1-score': 0.27966874132993214, 'support': 637}}
Wrong BIO-Encoding 13/758 labels, 1.72%
Test-Data: Prec: 0.260, Rec: 0.305, F1: 0.2808

Scores from epoch with best dev-scores:
  Dev-Score: 0.9630
  Test-Score 0.2035

4.36 sec for evaluation

--------- Epoch 37 -----------
351.10 sec for training (12502.11 total)
-- cmv_modes1 --
{'C': {'precision': 1.0, 'recall': 0.9411764705882353, 'f1-score': 0.9696969696969697, 'support': 17}, 'P': {'precision': 0.9583333333333334, 'recall': 0.9583333333333334, 'f1-score': 0.9583333333333334, 'support': 24}, 'micro avg': {'precision': 0.975, 'recall': 0.9512195121951219, 'f1-score': 0.9629629629629629, 'support': 41}, 'macro avg': {'precision': 0.9791666666666667, 'recall': 0.9497549019607843, 'f1-score': 0.9640151515151516, 'support': 41}, 'weighted avg': {'precision': 0.975609756097561, 'recall': 0.9512195121951219, 'f1-score': 0.9630450849963045, 'support': 41}}
{'C': {'precision': 1.0, 'recall': 0.9411764705882353, 'f1-score': 0.9696969696969697, 'support': 17}, 'P': {'precision': 0.9583333333333334, 'recall': 0.9583333333333334, 'f1-score': 0.9583333333333334, 'support': 24}, 'micro avg': {'precision': 0.975, 'recall': 0.9512195121951219, 'f1-score': 0.9629629629629629, 'support': 41}, 'macro avg': {'precision': 0.9791666666666667, 'recall': 0.9497549019607843, 'f1-score': 0.9640151515151516, 'support': 41}, 'weighted avg': {'precision': 0.975609756097561, 'recall': 0.9512195121951219, 'f1-score': 0.9630450849963045, 'support': 41}}
Dev-Data: Prec: 0.975, Rec: 0.951, F1: 0.9630
{'C': {'precision': 0.16568047337278108, 'recall': 0.18421052631578946, 'f1-score': 0.17445482866043616, 'support': 304}, 'P': {'precision': 0.2644628099173554, 'recall': 0.2882882882882883, 'f1-score': 0.2758620689655173, 'support': 333}, 'micro avg': {'precision': 0.21683309557774608, 'recall': 0.23861852433281006, 'f1-score': 0.22720478325859492, 'support': 637}, 'macro avg': {'precision': 0.21507164164506823, 'recall': 0.23624940730203886, 'f1-score': 0.22515844881297672, 'support': 637}, 'weighted avg': {'precision': 0.2173202191645287, 'recall': 0.23861852433281006, 'f1-score': 0.22746677688899505, 'support': 637}}
Wrong BIO-Encoding 160/848 labels, 18.87%
{'C': {'precision': 0.16568047337278108, 'recall': 0.18421052631578946, 'f1-score': 0.17445482866043616, 'support': 304}, 'P': {'precision': 0.2644628099173554, 'recall': 0.2882882882882883, 'f1-score': 0.2758620689655173, 'support': 333}, 'micro avg': {'precision': 0.21683309557774608, 'recall': 0.23861852433281006, 'f1-score': 0.22720478325859492, 'support': 637}, 'macro avg': {'precision': 0.21507164164506823, 'recall': 0.23624940730203886, 'f1-score': 0.22515844881297672, 'support': 637}, 'weighted avg': {'precision': 0.2173202191645287, 'recall': 0.23861852433281006, 'f1-score': 0.22746677688899505, 'support': 637}}
Wrong BIO-Encoding 13/701 labels, 1.85%
Test-Data: Prec: 0.221, Rec: 0.239, F1: 0.2294

Scores from epoch with best dev-scores:
  Dev-Score: 0.9630
  Test-Score 0.2035

5.65 sec for evaluation

--------- Epoch 38 -----------
446.37 sec for training (12948.48 total)
-- cmv_modes1 --
{'C': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 17}, 'P': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 24}, 'micro avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}, 'macro avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}, 'weighted avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}}
{'C': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 17}, 'P': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 24}, 'micro avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}, 'macro avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}, 'weighted avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}}
Dev-Data: Prec: 1.000, Rec: 1.000, F1: 1.0000
{'C': {'precision': 0.20754716981132076, 'recall': 0.21710526315789475, 'f1-score': 0.2122186495176849, 'support': 304}, 'P': {'precision': 0.26365795724465557, 'recall': 0.3333333333333333, 'f1-score': 0.29442970822281167, 'support': 333}, 'micro avg': {'precision': 0.2395128552097429, 'recall': 0.2778649921507064, 'f1-score': 0.25726744186046513, 'support': 637}, 'macro avg': {'precision': 0.23560256352798817, 'recall': 0.27521929824561403, 'f1-score': 0.2533241788702483, 'support': 637}, 'weighted avg': {'precision': 0.23687981065166688, 'recall': 0.2778649921507064, 'f1-score': 0.2551955451987009, 'support': 637}}
Wrong BIO-Encoding 42/779 labels, 5.39%
{'C': {'precision': 0.20754716981132076, 'recall': 0.21710526315789475, 'f1-score': 0.2122186495176849, 'support': 304}, 'P': {'precision': 0.26365795724465557, 'recall': 0.3333333333333333, 'f1-score': 0.29442970822281167, 'support': 333}, 'micro avg': {'precision': 0.2395128552097429, 'recall': 0.2778649921507064, 'f1-score': 0.25726744186046513, 'support': 637}, 'macro avg': {'precision': 0.23560256352798817, 'recall': 0.27521929824561403, 'f1-score': 0.2533241788702483, 'support': 637}, 'weighted avg': {'precision': 0.23687981065166688, 'recall': 0.2778649921507064, 'f1-score': 0.2551955451987009, 'support': 637}}
Wrong BIO-Encoding 2/739 labels, 0.27%
Test-Data: Prec: 0.240, Rec: 0.278, F1: 0.2576

Scores from epoch with best dev-scores:
  Dev-Score: 1.0000
  Test-Score 0.2576

6.68 sec for evaluation

--------- Epoch 39 -----------
436.18 sec for training (13384.66 total)
-- cmv_modes1 --
{'C': {'precision': 0.9411764705882353, 'recall': 0.9411764705882353, 'f1-score': 0.9411764705882353, 'support': 17}, 'P': {'precision': 0.88, 'recall': 0.9166666666666666, 'f1-score': 0.8979591836734694, 'support': 24}, 'micro avg': {'precision': 0.9047619047619048, 'recall': 0.926829268292683, 'f1-score': 0.9156626506024096, 'support': 41}, 'macro avg': {'precision': 0.9105882352941177, 'recall': 0.928921568627451, 'f1-score': 0.9195678271308523, 'support': 41}, 'weighted avg': {'precision': 0.9053658536585367, 'recall': 0.926829268292683, 'f1-score': 0.9158785465405676, 'support': 41}}
{'C': {'precision': 0.9411764705882353, 'recall': 0.9411764705882353, 'f1-score': 0.9411764705882353, 'support': 17}, 'P': {'precision': 0.88, 'recall': 0.9166666666666666, 'f1-score': 0.8979591836734694, 'support': 24}, 'micro avg': {'precision': 0.9047619047619048, 'recall': 0.926829268292683, 'f1-score': 0.9156626506024096, 'support': 41}, 'macro avg': {'precision': 0.9105882352941177, 'recall': 0.928921568627451, 'f1-score': 0.9195678271308523, 'support': 41}, 'weighted avg': {'precision': 0.9053658536585367, 'recall': 0.926829268292683, 'f1-score': 0.9158785465405676, 'support': 41}}
Dev-Data: Prec: 0.905, Rec: 0.927, F1: 0.9157
{'C': {'precision': 0.2017291066282421, 'recall': 0.23026315789473684, 'f1-score': 0.21505376344086022, 'support': 304}, 'P': {'precision': 0.3333333333333333, 'recall': 0.4114114114114114, 'f1-score': 0.3682795698924731, 'support': 333}, 'micro avg': {'precision': 0.27308707124010556, 'recall': 0.3249607535321821, 'f1-score': 0.29677419354838713, 'support': 637}, 'macro avg': {'precision': 0.2675312199807877, 'recall': 0.32083728465307415, 'f1-score': 0.2916666666666667, 'support': 637}, 'weighted avg': {'precision': 0.27052692058867445, 'recall': 0.3249607535321821, 'f1-score': 0.2951545382420958, 'support': 637}}
Wrong BIO-Encoding 134/886 labels, 15.12%
{'C': {'precision': 0.2017291066282421, 'recall': 0.23026315789473684, 'f1-score': 0.21505376344086022, 'support': 304}, 'P': {'precision': 0.3333333333333333, 'recall': 0.4114114114114114, 'f1-score': 0.3682795698924731, 'support': 333}, 'micro avg': {'precision': 0.27308707124010556, 'recall': 0.3249607535321821, 'f1-score': 0.29677419354838713, 'support': 637}, 'macro avg': {'precision': 0.2675312199807877, 'recall': 0.32083728465307415, 'f1-score': 0.2916666666666667, 'support': 637}, 'weighted avg': {'precision': 0.27052692058867445, 'recall': 0.3249607535321821, 'f1-score': 0.2951545382420958, 'support': 637}}
Wrong BIO-Encoding 6/758 labels, 0.79%
Test-Data: Prec: 0.275, Rec: 0.325, F1: 0.2981

Scores from epoch with best dev-scores:
  Dev-Score: 1.0000
  Test-Score 0.2576

4.24 sec for evaluation

--------- Epoch 40 -----------
328.77 sec for training (13713.43 total)
-- cmv_modes1 --
{'C': {'precision': 0.9411764705882353, 'recall': 0.9411764705882353, 'f1-score': 0.9411764705882353, 'support': 17}, 'P': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 24}, 'micro avg': {'precision': 0.975609756097561, 'recall': 0.975609756097561, 'f1-score': 0.975609756097561, 'support': 41}, 'macro avg': {'precision': 0.9705882352941176, 'recall': 0.9705882352941176, 'f1-score': 0.9705882352941176, 'support': 41}, 'weighted avg': {'precision': 0.975609756097561, 'recall': 0.975609756097561, 'f1-score': 0.975609756097561, 'support': 41}}
{'C': {'precision': 0.9411764705882353, 'recall': 0.9411764705882353, 'f1-score': 0.9411764705882353, 'support': 17}, 'P': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 24}, 'micro avg': {'precision': 0.975609756097561, 'recall': 0.975609756097561, 'f1-score': 0.975609756097561, 'support': 41}, 'macro avg': {'precision': 0.9705882352941176, 'recall': 0.9705882352941176, 'f1-score': 0.9705882352941176, 'support': 41}, 'weighted avg': {'precision': 0.975609756097561, 'recall': 0.975609756097561, 'f1-score': 0.975609756097561, 'support': 41}}
Dev-Data: Prec: 0.976, Rec: 0.976, F1: 0.9756
{'C': {'precision': 0.1925287356321839, 'recall': 0.22039473684210525, 'f1-score': 0.20552147239263802, 'support': 304}, 'P': {'precision': 0.32934131736526945, 'recall': 0.3303303303303303, 'f1-score': 0.32983508245877063, 'support': 333}, 'micro avg': {'precision': 0.2595307917888563, 'recall': 0.2778649921507064, 'f1-score': 0.26838514025777105, 'support': 637}, 'macro avg': {'precision': 0.2609350264987267, 'recall': 0.27536253358621776, 'f1-score': 0.2676782774257043, 'support': 637}, 'weighted avg': {'precision': 0.26404928463864774, 'recall': 0.2778649921507064, 'f1-score': 0.27050802208184077, 'support': 637}}
Wrong BIO-Encoding 113/790 labels, 14.30%
{'C': {'precision': 0.1925287356321839, 'recall': 0.22039473684210525, 'f1-score': 0.20552147239263802, 'support': 304}, 'P': {'precision': 0.32934131736526945, 'recall': 0.3303303303303303, 'f1-score': 0.32983508245877063, 'support': 333}, 'micro avg': {'precision': 0.2595307917888563, 'recall': 0.2778649921507064, 'f1-score': 0.26838514025777105, 'support': 637}, 'macro avg': {'precision': 0.2609350264987267, 'recall': 0.27536253358621776, 'f1-score': 0.2676782774257043, 'support': 637}, 'weighted avg': {'precision': 0.26404928463864774, 'recall': 0.2778649921507064, 'f1-score': 0.27050802208184077, 'support': 637}}
Wrong BIO-Encoding 5/682 labels, 0.73%
Test-Data: Prec: 0.261, Rec: 0.278, F1: 0.2694

Scores from epoch with best dev-scores:
  Dev-Score: 1.0000
  Test-Score 0.2576

4.14 sec for evaluation

--------- Epoch 41 -----------
326.54 sec for training (14039.97 total)
-- cmv_modes1 --
{'C': {'precision': 0.8823529411764706, 'recall': 0.8823529411764706, 'f1-score': 0.8823529411764706, 'support': 17}, 'P': {'precision': 1.0, 'recall': 0.9583333333333334, 'f1-score': 0.9787234042553191, 'support': 24}, 'micro avg': {'precision': 0.95, 'recall': 0.926829268292683, 'f1-score': 0.9382716049382716, 'support': 41}, 'macro avg': {'precision': 0.9411764705882353, 'recall': 0.920343137254902, 'f1-score': 0.9305381727158948, 'support': 41}, 'weighted avg': {'precision': 0.9512195121951219, 'recall': 0.926829268292683, 'f1-score': 0.9387649195640893, 'support': 41}}
{'C': {'precision': 0.8823529411764706, 'recall': 0.8823529411764706, 'f1-score': 0.8823529411764706, 'support': 17}, 'P': {'precision': 1.0, 'recall': 0.9583333333333334, 'f1-score': 0.9787234042553191, 'support': 24}, 'micro avg': {'precision': 0.95, 'recall': 0.926829268292683, 'f1-score': 0.9382716049382716, 'support': 41}, 'macro avg': {'precision': 0.9411764705882353, 'recall': 0.920343137254902, 'f1-score': 0.9305381727158948, 'support': 41}, 'weighted avg': {'precision': 0.9512195121951219, 'recall': 0.926829268292683, 'f1-score': 0.9387649195640893, 'support': 41}}
Dev-Data: Prec: 0.950, Rec: 0.927, F1: 0.9383
{'C': {'precision': 0.20812182741116753, 'recall': 0.26973684210526316, 'f1-score': 0.2349570200573066, 'support': 304}, 'P': {'precision': 0.3208092485549133, 'recall': 0.3333333333333333, 'f1-score': 0.3269513991163476, 'support': 333}, 'micro avg': {'precision': 0.2608108108108108, 'recall': 0.3029827315541601, 'f1-score': 0.280319535221496, 'support': 637}, 'macro avg': {'precision': 0.2644655379830404, 'recall': 0.30153508771929827, 'f1-score': 0.2809542095868271, 'support': 637}, 'weighted avg': {'precision': 0.2670306362665323, 'recall': 0.3029827315541601, 'f1-score': 0.28304827316038456, 'support': 637}}
Wrong BIO-Encoding 91/826 labels, 11.02%
{'C': {'precision': 0.20812182741116753, 'recall': 0.26973684210526316, 'f1-score': 0.2349570200573066, 'support': 304}, 'P': {'precision': 0.3208092485549133, 'recall': 0.3333333333333333, 'f1-score': 0.3269513991163476, 'support': 333}, 'micro avg': {'precision': 0.2608108108108108, 'recall': 0.3029827315541601, 'f1-score': 0.280319535221496, 'support': 637}, 'macro avg': {'precision': 0.2644655379830404, 'recall': 0.30153508771929827, 'f1-score': 0.2809542095868271, 'support': 637}, 'weighted avg': {'precision': 0.2670306362665323, 'recall': 0.3029827315541601, 'f1-score': 0.28304827316038456, 'support': 637}}
Wrong BIO-Encoding 5/740 labels, 0.68%
Test-Data: Prec: 0.263, Rec: 0.303, F1: 0.2813

Scores from epoch with best dev-scores:
  Dev-Score: 1.0000
  Test-Score 0.2576

4.16 sec for evaluation

--------- Epoch 42 -----------
323.71 sec for training (14363.68 total)
-- cmv_modes1 --
{'C': {'precision': 0.9411764705882353, 'recall': 0.9411764705882353, 'f1-score': 0.9411764705882353, 'support': 17}, 'P': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 24}, 'micro avg': {'precision': 0.975609756097561, 'recall': 0.975609756097561, 'f1-score': 0.975609756097561, 'support': 41}, 'macro avg': {'precision': 0.9705882352941176, 'recall': 0.9705882352941176, 'f1-score': 0.9705882352941176, 'support': 41}, 'weighted avg': {'precision': 0.975609756097561, 'recall': 0.975609756097561, 'f1-score': 0.975609756097561, 'support': 41}}
{'C': {'precision': 0.9411764705882353, 'recall': 0.9411764705882353, 'f1-score': 0.9411764705882353, 'support': 17}, 'P': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 24}, 'micro avg': {'precision': 0.975609756097561, 'recall': 0.975609756097561, 'f1-score': 0.975609756097561, 'support': 41}, 'macro avg': {'precision': 0.9705882352941176, 'recall': 0.9705882352941176, 'f1-score': 0.9705882352941176, 'support': 41}, 'weighted avg': {'precision': 0.975609756097561, 'recall': 0.975609756097561, 'f1-score': 0.975609756097561, 'support': 41}}
Dev-Data: Prec: 0.976, Rec: 0.976, F1: 0.9756
{'C': {'precision': 0.16101694915254236, 'recall': 0.1875, 'f1-score': 0.17325227963525833, 'support': 304}, 'P': {'precision': 0.26216216216216215, 'recall': 0.2912912912912913, 'f1-score': 0.2759601706970128, 'support': 333}, 'micro avg': {'precision': 0.212707182320442, 'recall': 0.24175824175824176, 'f1-score': 0.22630418809698752, 'support': 637}, 'macro avg': {'precision': 0.21158955565735227, 'recall': 0.23939564564564564, 'f1-score': 0.22460622516613554, 'support': 637}, 'weighted avg': {'precision': 0.21389191921879575, 'recall': 0.24175824175824176, 'f1-score': 0.22694415989203107, 'support': 637}}
Wrong BIO-Encoding 8/731 labels, 1.09%
{'C': {'precision': 0.16101694915254236, 'recall': 0.1875, 'f1-score': 0.17325227963525833, 'support': 304}, 'P': {'precision': 0.26216216216216215, 'recall': 0.2912912912912913, 'f1-score': 0.2759601706970128, 'support': 333}, 'micro avg': {'precision': 0.212707182320442, 'recall': 0.24175824175824176, 'f1-score': 0.22630418809698752, 'support': 637}, 'macro avg': {'precision': 0.21158955565735227, 'recall': 0.23939564564564564, 'f1-score': 0.22460622516613554, 'support': 637}, 'weighted avg': {'precision': 0.21389191921879575, 'recall': 0.24175824175824176, 'f1-score': 0.22694415989203107, 'support': 637}}
Wrong BIO-Encoding 1/724 labels, 0.14%
Test-Data: Prec: 0.213, Rec: 0.242, F1: 0.2265

Scores from epoch with best dev-scores:
  Dev-Score: 1.0000
  Test-Score 0.2576

4.16 sec for evaluation

--------- Epoch 43 -----------
323.09 sec for training (14686.77 total)
-- cmv_modes1 --
{'C': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 17}, 'P': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 24}, 'micro avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}, 'macro avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}, 'weighted avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}}
{'C': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 17}, 'P': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 24}, 'micro avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}, 'macro avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}, 'weighted avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}}
Dev-Data: Prec: 1.000, Rec: 1.000, F1: 1.0000
{'C': {'precision': 0.18082191780821918, 'recall': 0.21710526315789475, 'f1-score': 0.19730941704035876, 'support': 304}, 'P': {'precision': 0.29155313351498635, 'recall': 0.3213213213213213, 'f1-score': 0.3057142857142857, 'support': 333}, 'micro avg': {'precision': 0.23633879781420766, 'recall': 0.271585557299843, 'f1-score': 0.2527392257121987, 'support': 637}, 'macro avg': {'precision': 0.23618752566160278, 'recall': 0.269213292239608, 'f1-score': 0.25151185137732224, 'support': 637}, 'weighted avg': {'precision': 0.23870809493593265, 'recall': 0.271585557299843, 'f1-score': 0.25397946612735667, 'support': 637}}
Wrong BIO-Encoding 75/803 labels, 9.34%
{'C': {'precision': 0.18082191780821918, 'recall': 0.21710526315789475, 'f1-score': 0.19730941704035876, 'support': 304}, 'P': {'precision': 0.29155313351498635, 'recall': 0.3213213213213213, 'f1-score': 0.3057142857142857, 'support': 333}, 'micro avg': {'precision': 0.23633879781420766, 'recall': 0.271585557299843, 'f1-score': 0.2527392257121987, 'support': 637}, 'macro avg': {'precision': 0.23618752566160278, 'recall': 0.269213292239608, 'f1-score': 0.25151185137732224, 'support': 637}, 'weighted avg': {'precision': 0.23870809493593265, 'recall': 0.271585557299843, 'f1-score': 0.25397946612735667, 'support': 637}}
Wrong BIO-Encoding 4/732 labels, 0.55%
Test-Data: Prec: 0.238, Rec: 0.272, F1: 0.2535

Scores from epoch with best dev-scores:
  Dev-Score: 1.0000
  Test-Score 0.2576

4.11 sec for evaluation

--------- Epoch 44 -----------
326.50 sec for training (15013.27 total)
-- cmv_modes1 --
{'C': {'precision': 0.9411764705882353, 'recall': 0.9411764705882353, 'f1-score': 0.9411764705882353, 'support': 17}, 'P': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 24}, 'micro avg': {'precision': 0.975609756097561, 'recall': 0.975609756097561, 'f1-score': 0.975609756097561, 'support': 41}, 'macro avg': {'precision': 0.9705882352941176, 'recall': 0.9705882352941176, 'f1-score': 0.9705882352941176, 'support': 41}, 'weighted avg': {'precision': 0.975609756097561, 'recall': 0.975609756097561, 'f1-score': 0.975609756097561, 'support': 41}}
{'C': {'precision': 0.9411764705882353, 'recall': 0.9411764705882353, 'f1-score': 0.9411764705882353, 'support': 17}, 'P': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 24}, 'micro avg': {'precision': 0.975609756097561, 'recall': 0.975609756097561, 'f1-score': 0.975609756097561, 'support': 41}, 'macro avg': {'precision': 0.9705882352941176, 'recall': 0.9705882352941176, 'f1-score': 0.9705882352941176, 'support': 41}, 'weighted avg': {'precision': 0.975609756097561, 'recall': 0.975609756097561, 'f1-score': 0.975609756097561, 'support': 41}}
Dev-Data: Prec: 0.976, Rec: 0.976, F1: 0.9756
{'C': {'precision': 0.23961661341853036, 'recall': 0.24671052631578946, 'f1-score': 0.2431118314424635, 'support': 304}, 'P': {'precision': 0.2676767676767677, 'recall': 0.3183183183183183, 'f1-score': 0.2908093278463649, 'support': 333}, 'micro avg': {'precision': 0.2552891396332863, 'recall': 0.28414442700156983, 'f1-score': 0.2689450222882615, 'support': 637}, 'macro avg': {'precision': 0.253646690547649, 'recall': 0.28251442231705387, 'f1-score': 0.2669605796444142, 'support': 637}, 'weighted avg': {'precision': 0.2542854224734645, 'recall': 0.28414442700156983, 'f1-score': 0.268046315433828, 'support': 637}}
Wrong BIO-Encoding 308/1002 labels, 30.74%
{'C': {'precision': 0.23961661341853036, 'recall': 0.24671052631578946, 'f1-score': 0.2431118314424635, 'support': 304}, 'P': {'precision': 0.2676767676767677, 'recall': 0.3183183183183183, 'f1-score': 0.2908093278463649, 'support': 333}, 'micro avg': {'precision': 0.2552891396332863, 'recall': 0.28414442700156983, 'f1-score': 0.2689450222882615, 'support': 637}, 'macro avg': {'precision': 0.253646690547649, 'recall': 0.28251442231705387, 'f1-score': 0.2669605796444142, 'support': 637}, 'weighted avg': {'precision': 0.2542854224734645, 'recall': 0.28414442700156983, 'f1-score': 0.268046315433828, 'support': 637}}
Wrong BIO-Encoding 15/709 labels, 2.12%
Test-Data: Prec: 0.261, Rec: 0.284, F1: 0.2720

Scores from epoch with best dev-scores:
  Dev-Score: 1.0000
  Test-Score 0.2576

4.17 sec for evaluation

--------- Epoch 45 -----------
326.23 sec for training (15339.50 total)
-- cmv_modes1 --
{'C': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 17}, 'P': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 24}, 'micro avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}, 'macro avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}, 'weighted avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}}
{'C': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 17}, 'P': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 24}, 'micro avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}, 'macro avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}, 'weighted avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}}
Dev-Data: Prec: 1.000, Rec: 1.000, F1: 1.0000
{'C': {'precision': 0.2305194805194805, 'recall': 0.23355263157894737, 'f1-score': 0.23202614379084965, 'support': 304}, 'P': {'precision': 0.23192019950124687, 'recall': 0.27927927927927926, 'f1-score': 0.25340599455040874, 'support': 333}, 'micro avg': {'precision': 0.231311706629055, 'recall': 0.25745682888540034, 'f1-score': 0.24368499257057952, 'support': 637}, 'macro avg': {'precision': 0.2312198400103637, 'recall': 0.25641595542911333, 'f1-score': 0.2427160691706292, 'support': 637}, 'weighted avg': {'precision': 0.2312517245083788, 'recall': 0.25745682888540034, 'f1-score': 0.24320273767300535, 'support': 637}}
Wrong BIO-Encoding 28/735 labels, 3.81%
{'C': {'precision': 0.2305194805194805, 'recall': 0.23355263157894737, 'f1-score': 0.23202614379084965, 'support': 304}, 'P': {'precision': 0.23192019950124687, 'recall': 0.27927927927927926, 'f1-score': 0.25340599455040874, 'support': 333}, 'micro avg': {'precision': 0.231311706629055, 'recall': 0.25745682888540034, 'f1-score': 0.24368499257057952, 'support': 637}, 'macro avg': {'precision': 0.2312198400103637, 'recall': 0.25641595542911333, 'f1-score': 0.2427160691706292, 'support': 637}, 'weighted avg': {'precision': 0.2312517245083788, 'recall': 0.25745682888540034, 'f1-score': 0.24320273767300535, 'support': 637}}
Wrong BIO-Encoding 2/709 labels, 0.28%
Test-Data: Prec: 0.232, Rec: 0.257, F1: 0.2440

Scores from epoch with best dev-scores:
  Dev-Score: 1.0000
  Test-Score 0.2576

4.14 sec for evaluation

--------- Epoch 46 -----------
322.74 sec for training (15662.24 total)
-- cmv_modes1 --
{'C': {'precision': 0.9411764705882353, 'recall': 0.9411764705882353, 'f1-score': 0.9411764705882353, 'support': 17}, 'P': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 24}, 'micro avg': {'precision': 0.975609756097561, 'recall': 0.975609756097561, 'f1-score': 0.975609756097561, 'support': 41}, 'macro avg': {'precision': 0.9705882352941176, 'recall': 0.9705882352941176, 'f1-score': 0.9705882352941176, 'support': 41}, 'weighted avg': {'precision': 0.975609756097561, 'recall': 0.975609756097561, 'f1-score': 0.975609756097561, 'support': 41}}
{'C': {'precision': 0.9411764705882353, 'recall': 0.9411764705882353, 'f1-score': 0.9411764705882353, 'support': 17}, 'P': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 24}, 'micro avg': {'precision': 0.975609756097561, 'recall': 0.975609756097561, 'f1-score': 0.975609756097561, 'support': 41}, 'macro avg': {'precision': 0.9705882352941176, 'recall': 0.9705882352941176, 'f1-score': 0.9705882352941176, 'support': 41}, 'weighted avg': {'precision': 0.975609756097561, 'recall': 0.975609756097561, 'f1-score': 0.975609756097561, 'support': 41}}
Dev-Data: Prec: 0.976, Rec: 0.976, F1: 0.9756
{'C': {'precision': 0.162534435261708, 'recall': 0.19407894736842105, 'f1-score': 0.17691154422788608, 'support': 304}, 'P': {'precision': 0.2884097035040431, 'recall': 0.3213213213213213, 'f1-score': 0.3039772727272727, 'support': 333}, 'micro avg': {'precision': 0.22615803814713897, 'recall': 0.260596546310832, 'f1-score': 0.24215900802334062, 'support': 637}, 'macro avg': {'precision': 0.22547206938287556, 'recall': 0.25770013434487116, 'f1-score': 0.2404444084775794, 'support': 637}, 'weighted avg': {'precision': 0.2283373619880778, 'recall': 0.260596546310832, 'f1-score': 0.24333679947167847, 'support': 637}}
Wrong BIO-Encoding 213/934 labels, 22.81%
{'C': {'precision': 0.162534435261708, 'recall': 0.19407894736842105, 'f1-score': 0.17691154422788608, 'support': 304}, 'P': {'precision': 0.2884097035040431, 'recall': 0.3213213213213213, 'f1-score': 0.3039772727272727, 'support': 333}, 'micro avg': {'precision': 0.22615803814713897, 'recall': 0.260596546310832, 'f1-score': 0.24215900802334062, 'support': 637}, 'macro avg': {'precision': 0.22547206938287556, 'recall': 0.25770013434487116, 'f1-score': 0.2404444084775794, 'support': 637}, 'weighted avg': {'precision': 0.2283373619880778, 'recall': 0.260596546310832, 'f1-score': 0.24333679947167847, 'support': 637}}
Wrong BIO-Encoding 13/734 labels, 1.77%
Test-Data: Prec: 0.230, Rec: 0.261, F1: 0.2445

Scores from epoch with best dev-scores:
  Dev-Score: 1.0000
  Test-Score 0.2576

4.14 sec for evaluation

--------- Epoch 47 -----------
324.85 sec for training (15987.09 total)
-- cmv_modes1 --
{'C': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 17}, 'P': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 24}, 'micro avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}, 'macro avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}, 'weighted avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}}
{'C': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 17}, 'P': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 24}, 'micro avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}, 'macro avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}, 'weighted avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}}
Dev-Data: Prec: 1.000, Rec: 1.000, F1: 1.0000
{'C': {'precision': 0.17073170731707318, 'recall': 0.18421052631578946, 'f1-score': 0.17721518987341772, 'support': 304}, 'P': {'precision': 0.29120879120879123, 'recall': 0.3183183183183183, 'f1-score': 0.30416068866571017, 'support': 333}, 'micro avg': {'precision': 0.23410404624277456, 'recall': 0.2543171114599686, 'f1-score': 0.2437923250564334, 'support': 637}, 'macro avg': {'precision': 0.2309702492629322, 'recall': 0.25126442231705387, 'f1-score': 0.24068793926956394, 'support': 637}, 'weighted avg': {'precision': 0.23371266326046738, 'recall': 0.2543171114599686, 'f1-score': 0.2435775934806915, 'support': 637}}
Wrong BIO-Encoding 53/743 labels, 7.13%
{'C': {'precision': 0.17073170731707318, 'recall': 0.18421052631578946, 'f1-score': 0.17721518987341772, 'support': 304}, 'P': {'precision': 0.29120879120879123, 'recall': 0.3183183183183183, 'f1-score': 0.30416068866571017, 'support': 333}, 'micro avg': {'precision': 0.23410404624277456, 'recall': 0.2543171114599686, 'f1-score': 0.2437923250564334, 'support': 637}, 'macro avg': {'precision': 0.2309702492629322, 'recall': 0.25126442231705387, 'f1-score': 0.24068793926956394, 'support': 637}, 'weighted avg': {'precision': 0.23371266326046738, 'recall': 0.2543171114599686, 'f1-score': 0.2435775934806915, 'support': 637}}
Wrong BIO-Encoding 2/692 labels, 0.29%
Test-Data: Prec: 0.235, Rec: 0.254, F1: 0.2442

Scores from epoch with best dev-scores:
  Dev-Score: 1.0000
  Test-Score 0.2576

4.14 sec for evaluation

--------- Epoch 48 -----------
323.83 sec for training (16310.92 total)
-- cmv_modes1 --
{'C': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 17}, 'P': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 24}, 'micro avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}, 'macro avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}, 'weighted avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}}
{'C': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 17}, 'P': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 24}, 'micro avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}, 'macro avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}, 'weighted avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}}
Dev-Data: Prec: 1.000, Rec: 1.000, F1: 1.0000
{'C': {'precision': 0.16621253405994552, 'recall': 0.20065789473684212, 'f1-score': 0.1818181818181818, 'support': 304}, 'P': {'precision': 0.26666666666666666, 'recall': 0.25225225225225223, 'f1-score': 0.2592592592592592, 'support': 333}, 'micro avg': {'precision': 0.2126099706744868, 'recall': 0.22762951334379905, 'f1-score': 0.21986353297952996, 'support': 637}, 'macro avg': {'precision': 0.2164396003633061, 'recall': 0.2264550734945472, 'f1-score': 0.22053872053872048, 'support': 637}, 'weighted avg': {'precision': 0.2187262328951702, 'recall': 0.22762951334379905, 'f1-score': 0.22230150801579368, 'support': 637}}
Wrong BIO-Encoding 124/794 labels, 15.62%
{'C': {'precision': 0.16621253405994552, 'recall': 0.20065789473684212, 'f1-score': 0.1818181818181818, 'support': 304}, 'P': {'precision': 0.26666666666666666, 'recall': 0.25225225225225223, 'f1-score': 0.2592592592592592, 'support': 333}, 'micro avg': {'precision': 0.2126099706744868, 'recall': 0.22762951334379905, 'f1-score': 0.21986353297952996, 'support': 637}, 'macro avg': {'precision': 0.2164396003633061, 'recall': 0.2264550734945472, 'f1-score': 0.22053872053872048, 'support': 637}, 'weighted avg': {'precision': 0.2187262328951702, 'recall': 0.22762951334379905, 'f1-score': 0.22230150801579368, 'support': 637}}
Wrong BIO-Encoding 12/682 labels, 1.76%
Test-Data: Prec: 0.216, Rec: 0.228, F1: 0.2219

Scores from epoch with best dev-scores:
  Dev-Score: 1.0000
  Test-Score 0.2576

4.13 sec for evaluation

--------- Epoch 49 -----------
322.58 sec for training (16633.50 total)
-- cmv_modes1 --
{'C': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 17}, 'P': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 24}, 'micro avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}, 'macro avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}, 'weighted avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}}
{'C': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 17}, 'P': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 24}, 'micro avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}, 'macro avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}, 'weighted avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}}
Dev-Data: Prec: 1.000, Rec: 1.000, F1: 1.0000
{'C': {'precision': 0.20180722891566266, 'recall': 0.22039473684210525, 'f1-score': 0.21069182389937108, 'support': 304}, 'P': {'precision': 0.23820754716981132, 'recall': 0.3033033033033033, 'f1-score': 0.2668428005284016, 'support': 333}, 'micro avg': {'precision': 0.2222222222222222, 'recall': 0.26373626373626374, 'f1-score': 0.24120603015075376, 'support': 637}, 'macro avg': {'precision': 0.220007388042737, 'recall': 0.2618490200727043, 'f1-score': 0.23876731221388633, 'support': 637}, 'weighted avg': {'precision': 0.22083596671571212, 'recall': 0.26373626373626374, 'f1-score': 0.24004547416227087, 'support': 637}}
Wrong BIO-Encoding 50/804 labels, 6.22%
{'C': {'precision': 0.20180722891566266, 'recall': 0.22039473684210525, 'f1-score': 0.21069182389937108, 'support': 304}, 'P': {'precision': 0.23820754716981132, 'recall': 0.3033033033033033, 'f1-score': 0.2668428005284016, 'support': 333}, 'micro avg': {'precision': 0.2222222222222222, 'recall': 0.26373626373626374, 'f1-score': 0.24120603015075376, 'support': 637}, 'macro avg': {'precision': 0.220007388042737, 'recall': 0.2618490200727043, 'f1-score': 0.23876731221388633, 'support': 637}, 'weighted avg': {'precision': 0.22083596671571212, 'recall': 0.26373626373626374, 'f1-score': 0.24004547416227087, 'support': 637}}
Wrong BIO-Encoding 2/756 labels, 0.26%
Test-Data: Prec: 0.223, Rec: 0.264, F1: 0.2416

Scores from epoch with best dev-scores:
  Dev-Score: 1.0000
  Test-Score 0.2576

4.09 sec for evaluation

--------- Epoch 50 -----------
323.70 sec for training (16957.20 total)
-- cmv_modes1 --
{'C': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 17}, 'P': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 24}, 'micro avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}, 'macro avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}, 'weighted avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}}
{'C': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 17}, 'P': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 24}, 'micro avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}, 'macro avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}, 'weighted avg': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 41}}
Dev-Data: Prec: 1.000, Rec: 1.000, F1: 1.0000
{'C': {'precision': 0.17435897435897435, 'recall': 0.2236842105263158, 'f1-score': 0.19596541786743518, 'support': 304}, 'P': {'precision': 0.2719033232628399, 'recall': 0.2702702702702703, 'f1-score': 0.2710843373493976, 'support': 333}, 'micro avg': {'precision': 0.21914008321775313, 'recall': 0.24803767660910517, 'f1-score': 0.23269513991163476, 'support': 637}, 'macro avg': {'precision': 0.22313114881090712, 'recall': 0.24697724039829305, 'f1-score': 0.2335248776084164, 'support': 637}, 'weighted avg': {'precision': 0.22535154607794958, 'recall': 0.24803767660910517, 'f1-score': 0.23523480591687548, 'support': 637}}
Wrong BIO-Encoding 15/734 labels, 2.04%
{'C': {'precision': 0.17435897435897435, 'recall': 0.2236842105263158, 'f1-score': 0.19596541786743518, 'support': 304}, 'P': {'precision': 0.2719033232628399, 'recall': 0.2702702702702703, 'f1-score': 0.2710843373493976, 'support': 333}, 'micro avg': {'precision': 0.21914008321775313, 'recall': 0.24803767660910517, 'f1-score': 0.23269513991163476, 'support': 637}, 'macro avg': {'precision': 0.22313114881090712, 'recall': 0.24697724039829305, 'f1-score': 0.2335248776084164, 'support': 637}, 'weighted avg': {'precision': 0.22535154607794958, 'recall': 0.24803767660910517, 'f1-score': 0.23523480591687548, 'support': 637}}
Wrong BIO-Encoding 2/721 labels, 0.28%
Test-Data: Prec: 0.220, Rec: 0.248, F1: 0.2330

Scores from epoch with best dev-scores:
  Dev-Score: 1.0000
  Test-Score 0.2576

4.11 sec for evaluation
---------RUN 2 ------------
Generate new embeddings files for a dataset
Read file: komninos_english_embeddings.gz
Added words: 12
:: Transform cmv_modes dataset ::
:: Create Train Matrix ::
Unknown-Tokens: 0.85%
:: Create Dev Matrix ::
Unknown-Tokens: 0.63%
:: Create Test Matrix ::
Unknown-Tokens: 0.77%
:: Transform cmv_modes1 dataset ::
:: Create Train Matrix ::
Unknown-Tokens: 0.85%
:: Create Dev Matrix ::
Unknown-Tokens: 0.63%
:: Create Test Matrix ::
Unknown-Tokens: 0.77%
:: Transform cmv_modes2 dataset ::
:: Create Train Matrix ::
Unknown-Tokens: 0.85%
:: Create Dev Matrix ::
Unknown-Tokens: 0.63%
:: Create Test Matrix ::
Unknown-Tokens: 0.77%
DONE - Embeddings file saved: pkl/cmv_modes_cmv_modes1_cmv_modes2_komninos_english_embeddings.pkl
--- cmv_modes ---
338 train sentences
3 dev sentences
118 test sentences
--- cmv_modes1 ---
338 train sentences
3 dev sentences
118 test sentences
--- cmv_modes2 ---
338 train sentences
3 dev sentences
118 test sentences
LSTM-Size: [100]
_____________________________________________________________________________________________________________________________
Layer (type)                             Output Shape               Param #        Connected to                              
=============================================================================================================================
words_input (InputLayer)                 (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
casing_input (InputLayer)                (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
word_embeddings (Embedding)              (None, None, 300)          66695400       words_input[0][0]                         
_____________________________________________________________________________________________________________________________
casing_emebddings (Embedding)            (None, None, 10)           80             casing_input[0][0]                        
_____________________________________________________________________________________________________________________________
concatenate_1 (Concatenate)              (None, None, 310)          0              word_embeddings[0][0]                     
                                                                                   casing_emebddings[0][0]                   
_____________________________________________________________________________________________________________________________
shared_varLSTM_1 (Bidirectional)         (None, None, 200)          328800         concatenate_1[0][0]                       
_____________________________________________________________________________________________________________________________
cmv_modes_hidden_lin_layer (TimeDistribu (None, None, 287)          57687          shared_varLSTM_1[0][0]                    
_____________________________________________________________________________________________________________________________
cmv_modes_crf (ChainCRF)                 (None, None, 287)          82943          cmv_modes_hidden_lin_layer[0][0]          
=============================================================================================================================
Total params: 67,164,910
Trainable params: 469,510
Non-trainable params: 66,695,400
_____________________________________________________________________________________________________________________________
_____________________________________________________________________________________________________________________________
Layer (type)                             Output Shape               Param #        Connected to                              
=============================================================================================================================
words_input (InputLayer)                 (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
casing_input (InputLayer)                (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
word_embeddings (Embedding)              (None, None, 300)          66695400       words_input[0][0]                         
_____________________________________________________________________________________________________________________________
casing_emebddings (Embedding)            (None, None, 10)           80             casing_input[0][0]                        
_____________________________________________________________________________________________________________________________
concatenate_1 (Concatenate)              (None, None, 310)          0              word_embeddings[0][0]                     
                                                                                   casing_emebddings[0][0]                   
_____________________________________________________________________________________________________________________________
shared_varLSTM_1 (Bidirectional)         (None, None, 200)          328800         concatenate_1[0][0]                       
_____________________________________________________________________________________________________________________________
cmv_modes1_hidden_lin_layer (TimeDistrib (None, None, 5)            1005           shared_varLSTM_1[0][0]                    
_____________________________________________________________________________________________________________________________
cmv_modes1_crf (ChainCRF)                (None, None, 5)            35             cmv_modes1_hidden_lin_layer[0][0]         
=============================================================================================================================
Total params: 67,025,320
Trainable params: 329,920
Non-trainable params: 66,695,400
_____________________________________________________________________________________________________________________________
_____________________________________________________________________________________________________________________________
Layer (type)                             Output Shape               Param #        Connected to                              
=============================================================================================================================
words_input (InputLayer)                 (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
casing_input (InputLayer)                (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
word_embeddings (Embedding)              (None, None, 300)          66695400       words_input[0][0]                         
_____________________________________________________________________________________________________________________________
casing_emebddings (Embedding)            (None, None, 10)           80             casing_input[0][0]                        
_____________________________________________________________________________________________________________________________
concatenate_1 (Concatenate)              (None, None, 310)          0              word_embeddings[0][0]                     
                                                                                   casing_emebddings[0][0]                   
_____________________________________________________________________________________________________________________________
shared_varLSTM_1 (Bidirectional)         (None, None, 200)          328800         concatenate_1[0][0]                       
_____________________________________________________________________________________________________________________________
cmv_modes2_softmax (TimeDistributed)     (None, None, 119)          23919          shared_varLSTM_1[0][0]                    
=============================================================================================================================
Total params: 67,048,199
Trainable params: 352,799
Non-trainable params: 66,695,400
_____________________________________________________________________________________________________________________________

--------- Epoch 1 -----------
323.72 sec for training (323.72 total)
-- cmv_modes1 --
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 26}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 20}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 46}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 46}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 46}}
Wrong BIO-Encoding 1148/1148 labels, 100.00%
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 26}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 20}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 46}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 46}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 46}}
Wrong BIO-Encoding 23/23 labels, 100.00%
Dev-Data: Prec: 0.000, Rec: 0.000, F1: 0.0000
{'C': {'precision': 0.00823045267489712, 'recall': 0.004784688995215311, 'f1-score': 0.00605143721633888, 'support': 418}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 447}, 'micro avg': {'precision': 0.004901960784313725, 'recall': 0.0023121387283236996, 'f1-score': 0.0031421838177533384, 'support': 865}, 'macro avg': {'precision': 0.00411522633744856, 'recall': 0.0023923444976076554, 'f1-score': 0.00302571860816944, 'support': 865}, 'weighted avg': {'precision': 0.003977259211684389, 'recall': 0.0023121387283236996, 'f1-score': 0.0029242783311325456, 'support': 865}}
Wrong BIO-Encoding 16683/16683 labels, 100.00%
{'C': {'precision': 0.00823045267489712, 'recall': 0.004784688995215311, 'f1-score': 0.00605143721633888, 'support': 418}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 447}, 'micro avg': {'precision': 0.004901960784313725, 'recall': 0.0023121387283236996, 'f1-score': 0.0031421838177533384, 'support': 865}, 'macro avg': {'precision': 0.00411522633744856, 'recall': 0.0023923444976076554, 'f1-score': 0.00302571860816944, 'support': 865}, 'weighted avg': {'precision': 0.003977259211684389, 'recall': 0.0023121387283236996, 'f1-score': 0.0029242783311325456, 'support': 865}}
Wrong BIO-Encoding 408/408 labels, 100.00%
Test-Data: Prec: 0.005, Rec: 0.002, F1: 0.0031

Scores from epoch with best dev-scores:
  Dev-Score: 0.0000
  Test-Score 0.0000

5.40 sec for evaluation

--------- Epoch 2 -----------
311.58 sec for training (635.30 total)
-- cmv_modes1 --
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 26}, 'P': {'precision': 0.034482758620689655, 'recall': 0.05, 'f1-score': 0.04081632653061224, 'support': 20}, 'micro avg': {'precision': 0.0196078431372549, 'recall': 0.021739130434782608, 'f1-score': 0.020618556701030927, 'support': 46}, 'macro avg': {'precision': 0.017241379310344827, 'recall': 0.025, 'f1-score': 0.02040816326530612, 'support': 46}, 'weighted avg': {'precision': 0.014992503748125939, 'recall': 0.021739130434782608, 'f1-score': 0.017746228926353146, 'support': 46}}
Wrong BIO-Encoding 1062/1062 labels, 100.00%
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 26}, 'P': {'precision': 0.034482758620689655, 'recall': 0.05, 'f1-score': 0.04081632653061224, 'support': 20}, 'micro avg': {'precision': 0.0196078431372549, 'recall': 0.021739130434782608, 'f1-score': 0.020618556701030927, 'support': 46}, 'macro avg': {'precision': 0.017241379310344827, 'recall': 0.025, 'f1-score': 0.02040816326530612, 'support': 46}, 'weighted avg': {'precision': 0.014992503748125939, 'recall': 0.021739130434782608, 'f1-score': 0.017746228926353146, 'support': 46}}
Wrong BIO-Encoding 51/51 labels, 100.00%
Dev-Data: Prec: 0.020, Rec: 0.022, F1: 0.0206
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 418}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 447}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 865}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 865}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 865}}
Wrong BIO-Encoding 13181/13187 labels, 99.95%
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 418}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 447}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 865}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 865}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 865}}
Wrong BIO-Encoding 568/574 labels, 98.95%
Test-Data: Prec: 0.000, Rec: 0.000, F1: 0.0000

Scores from epoch with best dev-scores:
  Dev-Score: 0.0206
  Test-Score 0.0000

6.41 sec for evaluation

--------- Epoch 3 -----------
316.35 sec for training (951.65 total)
-- cmv_modes1 --
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 26}, 'P': {'precision': 0.025, 'recall': 0.05, 'f1-score': 0.03333333333333333, 'support': 20}, 'micro avg': {'precision': 0.023255813953488372, 'recall': 0.021739130434782608, 'f1-score': 0.022471910112359553, 'support': 46}, 'macro avg': {'precision': 0.0125, 'recall': 0.025, 'f1-score': 0.016666666666666666, 'support': 46}, 'weighted avg': {'precision': 0.010869565217391304, 'recall': 0.021739130434782608, 'f1-score': 0.014492753623188404, 'support': 46}}
Wrong BIO-Encoding 324/356 labels, 91.01%
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 26}, 'P': {'precision': 0.025, 'recall': 0.05, 'f1-score': 0.03333333333333333, 'support': 20}, 'micro avg': {'precision': 0.023255813953488372, 'recall': 0.021739130434782608, 'f1-score': 0.022471910112359553, 'support': 46}, 'macro avg': {'precision': 0.0125, 'recall': 0.025, 'f1-score': 0.016666666666666666, 'support': 46}, 'weighted avg': {'precision': 0.010869565217391304, 'recall': 0.021739130434782608, 'f1-score': 0.014492753623188404, 'support': 46}}
Wrong BIO-Encoding 11/43 labels, 25.58%
Dev-Data: Prec: 0.031, Rec: 0.022, F1: 0.0256
{'C': {'precision': 0.02666666666666667, 'recall': 0.009569377990430622, 'f1-score': 0.014084507042253523, 'support': 418}, 'P': {'precision': 0.06759098786828423, 'recall': 0.087248322147651, 'f1-score': 0.076171875, 'support': 447}, 'micro avg': {'precision': 0.059147180192572216, 'recall': 0.04971098265895954, 'f1-score': 0.05402010050251257, 'support': 865}, 'macro avg': {'precision': 0.04712882726747545, 'recall': 0.04840885006904081, 'f1-score': 0.045128191021126765, 'support': 865}, 'weighted avg': {'precision': 0.047814841900334935, 'recall': 0.04971098265895954, 'f1-score': 0.04616896192908899, 'support': 865}}
Wrong BIO-Encoding 3305/3837 labels, 86.14%
{'C': {'precision': 0.02666666666666667, 'recall': 0.009569377990430622, 'f1-score': 0.014084507042253523, 'support': 418}, 'P': {'precision': 0.06759098786828423, 'recall': 0.087248322147651, 'f1-score': 0.076171875, 'support': 447}, 'micro avg': {'precision': 0.059147180192572216, 'recall': 0.04971098265895954, 'f1-score': 0.05402010050251257, 'support': 865}, 'macro avg': {'precision': 0.04712882726747545, 'recall': 0.04840885006904081, 'f1-score': 0.045128191021126765, 'support': 865}, 'weighted avg': {'precision': 0.047814841900334935, 'recall': 0.04971098265895954, 'f1-score': 0.04616896192908899, 'support': 865}}
Wrong BIO-Encoding 195/727 labels, 26.82%
Test-Data: Prec: 0.075, Rec: 0.046, F1: 0.0573

Scores from epoch with best dev-scores:
  Dev-Score: 0.0256
  Test-Score 0.0573

5.61 sec for evaluation

--------- Epoch 4 -----------
314.64 sec for training (1266.29 total)
-- cmv_modes1 --
{'C': {'precision': 0.05263157894736842, 'recall': 0.038461538461538464, 'f1-score': 0.044444444444444446, 'support': 26}, 'P': {'precision': 0.04081632653061224, 'recall': 0.1, 'f1-score': 0.05797101449275362, 'support': 20}, 'micro avg': {'precision': 0.04411764705882353, 'recall': 0.06521739130434782, 'f1-score': 0.052631578947368425, 'support': 46}, 'macro avg': {'precision': 0.046723952738990326, 'recall': 0.06923076923076923, 'f1-score': 0.05120772946859903, 'support': 46}, 'weighted avg': {'precision': 0.047494512679213556, 'recall': 0.06521739130434782, 'f1-score': 0.050325561856752785, 'support': 46}}
Wrong BIO-Encoding 224/279 labels, 80.29%
{'C': {'precision': 0.05263157894736842, 'recall': 0.038461538461538464, 'f1-score': 0.044444444444444446, 'support': 26}, 'P': {'precision': 0.04081632653061224, 'recall': 0.1, 'f1-score': 0.05797101449275362, 'support': 20}, 'micro avg': {'precision': 0.04411764705882353, 'recall': 0.06521739130434782, 'f1-score': 0.052631578947368425, 'support': 46}, 'macro avg': {'precision': 0.046723952738990326, 'recall': 0.06923076923076923, 'f1-score': 0.05120772946859903, 'support': 46}, 'weighted avg': {'precision': 0.047494512679213556, 'recall': 0.06521739130434782, 'f1-score': 0.050325561856752785, 'support': 46}}
Wrong BIO-Encoding 13/68 labels, 19.12%
Dev-Data: Prec: 0.055, Rec: 0.065, F1: 0.0594
{'C': {'precision': 0.07180851063829788, 'recall': 0.0645933014354067, 'f1-score': 0.06801007556675064, 'support': 418}, 'P': {'precision': 0.08093994778067885, 'recall': 0.06935123042505593, 'f1-score': 0.0746987951807229, 'support': 447}, 'micro avg': {'precision': 0.0764163372859025, 'recall': 0.06705202312138728, 'f1-score': 0.07142857142857142, 'support': 865}, 'macro avg': {'precision': 0.07637422920948836, 'recall': 0.06697226593023131, 'f1-score': 0.07135443537373676, 'support': 865}, 'weighted avg': {'precision': 0.07652729954308898, 'recall': 0.06705202312138728, 'f1-score': 0.07146655841928891, 'support': 865}}
Wrong BIO-Encoding 4506/5064 labels, 88.98%
{'C': {'precision': 0.07180851063829788, 'recall': 0.0645933014354067, 'f1-score': 0.06801007556675064, 'support': 418}, 'P': {'precision': 0.08093994778067885, 'recall': 0.06935123042505593, 'f1-score': 0.0746987951807229, 'support': 447}, 'micro avg': {'precision': 0.0764163372859025, 'recall': 0.06705202312138728, 'f1-score': 0.07142857142857142, 'support': 865}, 'macro avg': {'precision': 0.07637422920948836, 'recall': 0.06697226593023131, 'f1-score': 0.07135443537373676, 'support': 865}, 'weighted avg': {'precision': 0.07652729954308898, 'recall': 0.06705202312138728, 'f1-score': 0.07146655841928891, 'support': 865}}
Wrong BIO-Encoding 201/759 labels, 26.48%
Test-Data: Prec: 0.104, Rec: 0.067, F1: 0.0815

Scores from epoch with best dev-scores:
  Dev-Score: 0.0594
  Test-Score 0.0815

5.41 sec for evaluation

--------- Epoch 5 -----------
311.97 sec for training (1578.26 total)
-- cmv_modes1 --
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 26}, 'P': {'precision': 0.017857142857142856, 'recall': 0.05, 'f1-score': 0.026315789473684206, 'support': 20}, 'micro avg': {'precision': 0.017241379310344827, 'recall': 0.021739130434782608, 'f1-score': 0.019230769230769232, 'support': 46}, 'macro avg': {'precision': 0.008928571428571428, 'recall': 0.025, 'f1-score': 0.013157894736842103, 'support': 46}, 'weighted avg': {'precision': 0.007763975155279502, 'recall': 0.021739130434782608, 'f1-score': 0.011441647597254, 'support': 46}}
Wrong BIO-Encoding 32/88 labels, 36.36%
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 26}, 'P': {'precision': 0.017857142857142856, 'recall': 0.05, 'f1-score': 0.026315789473684206, 'support': 20}, 'micro avg': {'precision': 0.017241379310344827, 'recall': 0.021739130434782608, 'f1-score': 0.019230769230769232, 'support': 46}, 'macro avg': {'precision': 0.008928571428571428, 'recall': 0.025, 'f1-score': 0.013157894736842103, 'support': 46}, 'weighted avg': {'precision': 0.007763975155279502, 'recall': 0.021739130434782608, 'f1-score': 0.011441647597254, 'support': 46}}
Wrong BIO-Encoding 2/58 labels, 3.45%
Dev-Data: Prec: 0.018, Rec: 0.022, F1: 0.0196
{'C': {'precision': 0.11538461538461539, 'recall': 0.0215311004784689, 'f1-score': 0.036290322580645164, 'support': 418}, 'P': {'precision': 0.1294871794871795, 'recall': 0.22595078299776286, 'f1-score': 0.16462917685411574, 'support': 447}, 'micro avg': {'precision': 0.1282051282051282, 'recall': 0.12716763005780346, 'f1-score': 0.1276842716192687, 'support': 865}, 'macro avg': {'precision': 0.12243589743589745, 'recall': 0.12374094173811588, 'f1-score': 0.10045974971738045, 'support': 865}, 'weighted avg': {'precision': 0.12267229879946644, 'recall': 0.12716763005780346, 'f1-score': 0.10261109467340973, 'support': 865}}
Wrong BIO-Encoding 1067/1838 labels, 58.05%
{'C': {'precision': 0.11538461538461539, 'recall': 0.0215311004784689, 'f1-score': 0.036290322580645164, 'support': 418}, 'P': {'precision': 0.1294871794871795, 'recall': 0.22595078299776286, 'f1-score': 0.16462917685411574, 'support': 447}, 'micro avg': {'precision': 0.1282051282051282, 'recall': 0.12716763005780346, 'f1-score': 0.1276842716192687, 'support': 865}, 'macro avg': {'precision': 0.12243589743589745, 'recall': 0.12374094173811588, 'f1-score': 0.10045974971738045, 'support': 865}, 'weighted avg': {'precision': 0.12267229879946644, 'recall': 0.12716763005780346, 'f1-score': 0.10261109467340973, 'support': 865}}
Wrong BIO-Encoding 87/858 labels, 10.14%
Test-Data: Prec: 0.143, Rec: 0.127, F1: 0.1345

Scores from epoch with best dev-scores:
  Dev-Score: 0.0594
  Test-Score 0.0815

4.89 sec for evaluation

--------- Epoch 6 -----------
309.17 sec for training (1887.43 total)
-- cmv_modes1 --
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 26}, 'P': {'precision': 0.02702702702702703, 'recall': 0.05, 'f1-score': 0.03508771929824561, 'support': 20}, 'micro avg': {'precision': 0.022222222222222223, 'recall': 0.021739130434782608, 'f1-score': 0.021978021978021976, 'support': 46}, 'macro avg': {'precision': 0.013513513513513514, 'recall': 0.025, 'f1-score': 0.017543859649122806, 'support': 46}, 'weighted avg': {'precision': 0.011750881316098707, 'recall': 0.021739130434782608, 'f1-score': 0.015255530129672006, 'support': 46}}
Wrong BIO-Encoding 63/105 labels, 60.00%
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 26}, 'P': {'precision': 0.02702702702702703, 'recall': 0.05, 'f1-score': 0.03508771929824561, 'support': 20}, 'micro avg': {'precision': 0.022222222222222223, 'recall': 0.021739130434782608, 'f1-score': 0.021978021978021976, 'support': 46}, 'macro avg': {'precision': 0.013513513513513514, 'recall': 0.025, 'f1-score': 0.017543859649122806, 'support': 46}, 'weighted avg': {'precision': 0.011750881316098707, 'recall': 0.021739130434782608, 'f1-score': 0.015255530129672006, 'support': 46}}
Wrong BIO-Encoding 3/45 labels, 6.67%
Dev-Data: Prec: 0.024, Rec: 0.022, F1: 0.0227
{'C': {'precision': 0.16319444444444445, 'recall': 0.11244019138755981, 'f1-score': 0.13314447592067988, 'support': 418}, 'P': {'precision': 0.1643835616438356, 'recall': 0.1610738255033557, 'f1-score': 0.16271186440677965, 'support': 447}, 'micro avg': {'precision': 0.16391184573002754, 'recall': 0.1375722543352601, 'f1-score': 0.1495914519170333, 'support': 865}, 'macro avg': {'precision': 0.16378900304414, 'recall': 0.13675700844545774, 'f1-score': 0.14792817016372978, 'support': 865}, 'weighted avg': {'precision': 0.16380893622262693, 'recall': 0.1375722543352601, 'f1-score': 0.148423808467832, 'support': 865}}
Wrong BIO-Encoding 1194/1849 labels, 64.58%
{'C': {'precision': 0.16319444444444445, 'recall': 0.11244019138755981, 'f1-score': 0.13314447592067988, 'support': 418}, 'P': {'precision': 0.1643835616438356, 'recall': 0.1610738255033557, 'f1-score': 0.16271186440677965, 'support': 447}, 'micro avg': {'precision': 0.16391184573002754, 'recall': 0.1375722543352601, 'f1-score': 0.1495914519170333, 'support': 865}, 'macro avg': {'precision': 0.16378900304414, 'recall': 0.13675700844545774, 'f1-score': 0.14792817016372978, 'support': 865}, 'weighted avg': {'precision': 0.16380893622262693, 'recall': 0.1375722543352601, 'f1-score': 0.148423808467832, 'support': 865}}
Wrong BIO-Encoding 71/726 labels, 9.78%
Test-Data: Prec: 0.182, Rec: 0.138, F1: 0.1566

Scores from epoch with best dev-scores:
  Dev-Score: 0.0594
  Test-Score 0.0815

4.83 sec for evaluation

--------- Epoch 7 -----------
310.32 sec for training (2197.74 total)
-- cmv_modes1 --
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 26}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 20}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 46}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 46}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 46}}
Wrong BIO-Encoding 4/54 labels, 7.41%
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 26}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 20}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 46}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 46}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 46}}
Wrong BIO-Encoding 1/51 labels, 1.96%
Dev-Data: Prec: 0.000, Rec: 0.000, F1: 0.0000
{'C': {'precision': 0.22033898305084745, 'recall': 0.12440191387559808, 'f1-score': 0.15902140672782875, 'support': 418}, 'P': {'precision': 0.19732441471571907, 'recall': 0.2639821029082774, 'f1-score': 0.22583732057416267, 'support': 447}, 'micro avg': {'precision': 0.2038369304556355, 'recall': 0.19653179190751446, 'f1-score': 0.20011771630370806, 'support': 865}, 'macro avg': {'precision': 0.20883169888328326, 'recall': 0.19419200839193773, 'f1-score': 0.19242936365099572, 'support': 865}, 'weighted avg': {'precision': 0.2084459055412493, 'recall': 0.19653179190751446, 'f1-score': 0.19354939920102093, 'support': 865}}
Wrong BIO-Encoding 437/1242 labels, 35.19%
{'C': {'precision': 0.22033898305084745, 'recall': 0.12440191387559808, 'f1-score': 0.15902140672782875, 'support': 418}, 'P': {'precision': 0.19732441471571907, 'recall': 0.2639821029082774, 'f1-score': 0.22583732057416267, 'support': 447}, 'micro avg': {'precision': 0.2038369304556355, 'recall': 0.19653179190751446, 'f1-score': 0.20011771630370806, 'support': 865}, 'macro avg': {'precision': 0.20883169888328326, 'recall': 0.19419200839193773, 'f1-score': 0.19242936365099572, 'support': 865}, 'weighted avg': {'precision': 0.2084459055412493, 'recall': 0.19653179190751446, 'f1-score': 0.19354939920102093, 'support': 865}}
Wrong BIO-Encoding 29/834 labels, 3.48%
Test-Data: Prec: 0.209, Rec: 0.194, F1: 0.2012

Scores from epoch with best dev-scores:
  Dev-Score: 0.0594
  Test-Score 0.0815

4.86 sec for evaluation

--------- Epoch 8 -----------
309.98 sec for training (2507.72 total)
-- cmv_modes1 --
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 26}, 'P': {'precision': 0.030303030303030304, 'recall': 0.05, 'f1-score': 0.03773584905660378, 'support': 20}, 'micro avg': {'precision': 0.023809523809523808, 'recall': 0.021739130434782608, 'f1-score': 0.022727272727272724, 'support': 46}, 'macro avg': {'precision': 0.015151515151515152, 'recall': 0.025, 'f1-score': 0.01886792452830189, 'support': 46}, 'weighted avg': {'precision': 0.013175230566534914, 'recall': 0.021739130434782608, 'f1-score': 0.016406890894175553, 'support': 46}}
Wrong BIO-Encoding 12/53 labels, 22.64%
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 26}, 'P': {'precision': 0.030303030303030304, 'recall': 0.05, 'f1-score': 0.03773584905660378, 'support': 20}, 'micro avg': {'precision': 0.023809523809523808, 'recall': 0.021739130434782608, 'f1-score': 0.022727272727272724, 'support': 46}, 'macro avg': {'precision': 0.015151515151515152, 'recall': 0.025, 'f1-score': 0.01886792452830189, 'support': 46}, 'weighted avg': {'precision': 0.013175230566534914, 'recall': 0.021739130434782608, 'f1-score': 0.016406890894175553, 'support': 46}}
Wrong BIO-Encoding 1/42 labels, 2.38%
Dev-Data: Prec: 0.024, Rec: 0.022, F1: 0.0230
{'C': {'precision': 0.22393822393822393, 'recall': 0.13875598086124402, 'f1-score': 0.17134416543574593, 'support': 418}, 'P': {'precision': 0.19221967963386727, 'recall': 0.18791946308724833, 'f1-score': 0.19004524886877827, 'support': 447}, 'micro avg': {'precision': 0.20402298850574713, 'recall': 0.16416184971098266, 'f1-score': 0.18193465727098015, 'support': 865}, 'macro avg': {'precision': 0.2080789517860456, 'recall': 0.16333772197424618, 'f1-score': 0.1806947071522621, 'support': 865}, 'weighted avg': {'precision': 0.2075472536445275, 'recall': 0.16416184971098266, 'f1-score': 0.18100819352194877, 'support': 865}}
Wrong BIO-Encoding 870/1509 labels, 57.65%
{'C': {'precision': 0.22393822393822393, 'recall': 0.13875598086124402, 'f1-score': 0.17134416543574593, 'support': 418}, 'P': {'precision': 0.19221967963386727, 'recall': 0.18791946308724833, 'f1-score': 0.19004524886877827, 'support': 447}, 'micro avg': {'precision': 0.20402298850574713, 'recall': 0.16416184971098266, 'f1-score': 0.18193465727098015, 'support': 865}, 'macro avg': {'precision': 0.2080789517860456, 'recall': 0.16333772197424618, 'f1-score': 0.1806947071522621, 'support': 865}, 'weighted avg': {'precision': 0.2075472536445275, 'recall': 0.16416184971098266, 'f1-score': 0.18100819352194877, 'support': 865}}
Wrong BIO-Encoding 57/696 labels, 8.19%
Test-Data: Prec: 0.222, Rec: 0.164, F1: 0.1888

Scores from epoch with best dev-scores:
  Dev-Score: 0.0594
  Test-Score 0.0815

4.90 sec for evaluation

--------- Epoch 9 -----------
309.71 sec for training (2817.44 total)
-- cmv_modes1 --
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 26}, 'P': {'precision': 0.03125, 'recall': 0.05, 'f1-score': 0.038461538461538464, 'support': 20}, 'micro avg': {'precision': 0.027777777777777776, 'recall': 0.021739130434782608, 'f1-score': 0.024390243902439025, 'support': 46}, 'macro avg': {'precision': 0.015625, 'recall': 0.025, 'f1-score': 0.019230769230769232, 'support': 46}, 'weighted avg': {'precision': 0.01358695652173913, 'recall': 0.021739130434782608, 'f1-score': 0.016722408026755852, 'support': 46}}
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 26}, 'P': {'precision': 0.03125, 'recall': 0.05, 'f1-score': 0.038461538461538464, 'support': 20}, 'micro avg': {'precision': 0.027777777777777776, 'recall': 0.021739130434782608, 'f1-score': 0.024390243902439025, 'support': 46}, 'macro avg': {'precision': 0.015625, 'recall': 0.025, 'f1-score': 0.019230769230769232, 'support': 46}, 'weighted avg': {'precision': 0.01358695652173913, 'recall': 0.021739130434782608, 'f1-score': 0.016722408026755852, 'support': 46}}
Dev-Data: Prec: 0.028, Rec: 0.022, F1: 0.0244
{'C': {'precision': 0.22556390977443608, 'recall': 0.07177033492822966, 'f1-score': 0.10889292196007261, 'support': 418}, 'P': {'precision': 0.19038817005545286, 'recall': 0.23042505592841164, 'f1-score': 0.20850202429149797, 'support': 447}, 'micro avg': {'precision': 0.19732937685459942, 'recall': 0.15375722543352602, 'f1-score': 0.17283950617283952, 'support': 865}, 'macro avg': {'precision': 0.20797603991494445, 'recall': 0.15109769542832066, 'f1-score': 0.1586974731257853, 'support': 865}, 'weighted avg': {'precision': 0.20738638878670718, 'recall': 0.15375722543352602, 'f1-score': 0.1603672210839421, 'support': 865}}
Wrong BIO-Encoding 726/1346 labels, 53.94%
{'C': {'precision': 0.22556390977443608, 'recall': 0.07177033492822966, 'f1-score': 0.10889292196007261, 'support': 418}, 'P': {'precision': 0.19038817005545286, 'recall': 0.23042505592841164, 'f1-score': 0.20850202429149797, 'support': 447}, 'micro avg': {'precision': 0.19732937685459942, 'recall': 0.15375722543352602, 'f1-score': 0.17283950617283952, 'support': 865}, 'macro avg': {'precision': 0.20797603991494445, 'recall': 0.15109769542832066, 'f1-score': 0.1586974731257853, 'support': 865}, 'weighted avg': {'precision': 0.20738638878670718, 'recall': 0.15375722543352602, 'f1-score': 0.1603672210839421, 'support': 865}}
Wrong BIO-Encoding 54/674 labels, 8.01%
Test-Data: Prec: 0.215, Rec: 0.154, F1: 0.1791

Scores from epoch with best dev-scores:
  Dev-Score: 0.0594
  Test-Score 0.0815

4.85 sec for evaluation

--------- Epoch 10 -----------
312.89 sec for training (3130.33 total)
-- cmv_modes1 --
{'C': {'precision': 0.1, 'recall': 0.038461538461538464, 'f1-score': 0.05555555555555555, 'support': 26}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 20}, 'micro avg': {'precision': 0.023255813953488372, 'recall': 0.021739130434782608, 'f1-score': 0.022471910112359553, 'support': 46}, 'macro avg': {'precision': 0.05, 'recall': 0.019230769230769232, 'f1-score': 0.027777777777777776, 'support': 46}, 'weighted avg': {'precision': 0.05652173913043478, 'recall': 0.021739130434782608, 'f1-score': 0.03140096618357488, 'support': 46}}
Wrong BIO-Encoding 22/64 labels, 34.38%
{'C': {'precision': 0.1, 'recall': 0.038461538461538464, 'f1-score': 0.05555555555555555, 'support': 26}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 20}, 'micro avg': {'precision': 0.023255813953488372, 'recall': 0.021739130434782608, 'f1-score': 0.022471910112359553, 'support': 46}, 'macro avg': {'precision': 0.05, 'recall': 0.019230769230769232, 'f1-score': 0.027777777777777776, 'support': 46}, 'weighted avg': {'precision': 0.05652173913043478, 'recall': 0.021739130434782608, 'f1-score': 0.03140096618357488, 'support': 46}}
Wrong BIO-Encoding 1/43 labels, 2.33%
Dev-Data: Prec: 0.024, Rec: 0.022, F1: 0.0227
{'C': {'precision': 0.22633744855967078, 'recall': 0.13157894736842105, 'f1-score': 0.1664145234493192, 'support': 418}, 'P': {'precision': 0.21862348178137653, 'recall': 0.24161073825503357, 'f1-score': 0.2295430393198725, 'support': 447}, 'micro avg': {'precision': 0.22116689280868385, 'recall': 0.1884393063583815, 'f1-score': 0.2034956304619226, 'support': 865}, 'macro avg': {'precision': 0.22248046517052367, 'recall': 0.1865948428117273, 'f1-score': 0.19797878138459585, 'support': 865}, 'weighted avg': {'precision': 0.22235115590082968, 'recall': 0.1884393063583815, 'f1-score': 0.19903700506103864, 'support': 865}}
Wrong BIO-Encoding 604/1318 labels, 45.83%
{'C': {'precision': 0.22633744855967078, 'recall': 0.13157894736842105, 'f1-score': 0.1664145234493192, 'support': 418}, 'P': {'precision': 0.21862348178137653, 'recall': 0.24161073825503357, 'f1-score': 0.2295430393198725, 'support': 447}, 'micro avg': {'precision': 0.22116689280868385, 'recall': 0.1884393063583815, 'f1-score': 0.2034956304619226, 'support': 865}, 'macro avg': {'precision': 0.22248046517052367, 'recall': 0.1865948428117273, 'f1-score': 0.19797878138459585, 'support': 865}, 'weighted avg': {'precision': 0.22235115590082968, 'recall': 0.1884393063583815, 'f1-score': 0.19903700506103864, 'support': 865}}
Wrong BIO-Encoding 23/737 labels, 3.12%
Test-Data: Prec: 0.227, Rec: 0.187, F1: 0.2052

Scores from epoch with best dev-scores:
  Dev-Score: 0.0594
  Test-Score 0.0815

4.90 sec for evaluation

--------- Epoch 11 -----------
318.35 sec for training (3448.68 total)
-- cmv_modes1 --
{'C': {'precision': 0.16666666666666666, 'recall': 0.038461538461538464, 'f1-score': 0.0625, 'support': 26}, 'P': {'precision': 0.09090909090909091, 'recall': 0.15, 'f1-score': 0.11320754716981132, 'support': 20}, 'micro avg': {'precision': 0.10256410256410256, 'recall': 0.08695652173913043, 'f1-score': 0.09411764705882353, 'support': 46}, 'macro avg': {'precision': 0.12878787878787878, 'recall': 0.09423076923076923, 'f1-score': 0.08785377358490566, 'support': 46}, 'weighted avg': {'precision': 0.13372859025032938, 'recall': 0.08695652173913043, 'f1-score': 0.0845467596390484, 'support': 46}}
Wrong BIO-Encoding 18/56 labels, 32.14%
{'C': {'precision': 0.16666666666666666, 'recall': 0.038461538461538464, 'f1-score': 0.0625, 'support': 26}, 'P': {'precision': 0.09090909090909091, 'recall': 0.15, 'f1-score': 0.11320754716981132, 'support': 20}, 'micro avg': {'precision': 0.10256410256410256, 'recall': 0.08695652173913043, 'f1-score': 0.09411764705882353, 'support': 46}, 'macro avg': {'precision': 0.12878787878787878, 'recall': 0.09423076923076923, 'f1-score': 0.08785377358490566, 'support': 46}, 'weighted avg': {'precision': 0.13372859025032938, 'recall': 0.08695652173913043, 'f1-score': 0.0845467596390484, 'support': 46}}
Wrong BIO-Encoding 1/39 labels, 2.56%
Dev-Data: Prec: 0.105, Rec: 0.087, F1: 0.0952
{'C': {'precision': 0.25112107623318386, 'recall': 0.1339712918660287, 'f1-score': 0.1747269890795632, 'support': 418}, 'P': {'precision': 0.24116424116424118, 'recall': 0.2595078299776286, 'f1-score': 0.25, 'support': 447}, 'micro avg': {'precision': 0.24431818181818182, 'recall': 0.19884393063583816, 'f1-score': 0.21924792861695347, 'support': 865}, 'macro avg': {'precision': 0.24614265869871252, 'recall': 0.19673956092182865, 'f1-score': 0.2123634945397816, 'support': 865}, 'weighted avg': {'precision': 0.24597575221489787, 'recall': 0.19884393063583816, 'f1-score': 0.21362529645694497, 'support': 865}}
Wrong BIO-Encoding 455/1134 labels, 40.12%
{'C': {'precision': 0.25112107623318386, 'recall': 0.1339712918660287, 'f1-score': 0.1747269890795632, 'support': 418}, 'P': {'precision': 0.24116424116424118, 'recall': 0.2595078299776286, 'f1-score': 0.25, 'support': 447}, 'micro avg': {'precision': 0.24431818181818182, 'recall': 0.19884393063583816, 'f1-score': 0.21924792861695347, 'support': 865}, 'macro avg': {'precision': 0.24614265869871252, 'recall': 0.19673956092182865, 'f1-score': 0.2123634945397816, 'support': 865}, 'weighted avg': {'precision': 0.24597575221489787, 'recall': 0.19884393063583816, 'f1-score': 0.21362529645694497, 'support': 865}}
Wrong BIO-Encoding 25/704 labels, 3.55%
Test-Data: Prec: 0.252, Rec: 0.198, F1: 0.2215

Scores from epoch with best dev-scores:
  Dev-Score: 0.0952
  Test-Score 0.2215

5.63 sec for evaluation

--------- Epoch 12 -----------
309.84 sec for training (3758.51 total)
-- cmv_modes1 --
{'C': {'precision': 0.38095238095238093, 'recall': 0.3076923076923077, 'f1-score': 0.3404255319148936, 'support': 26}, 'P': {'precision': 0.30434782608695654, 'recall': 0.35, 'f1-score': 0.3255813953488372, 'support': 20}, 'micro avg': {'precision': 0.3409090909090909, 'recall': 0.32608695652173914, 'f1-score': 0.3333333333333333, 'support': 46}, 'macro avg': {'precision': 0.34265010351966874, 'recall': 0.32884615384615384, 'f1-score': 0.3330034636318654, 'support': 46}, 'weighted avg': {'precision': 0.3476460527500225, 'recall': 0.32608695652173914, 'f1-score': 0.33397155949486906, 'support': 46}}
{'C': {'precision': 0.38095238095238093, 'recall': 0.3076923076923077, 'f1-score': 0.3404255319148936, 'support': 26}, 'P': {'precision': 0.30434782608695654, 'recall': 0.35, 'f1-score': 0.3255813953488372, 'support': 20}, 'micro avg': {'precision': 0.3409090909090909, 'recall': 0.32608695652173914, 'f1-score': 0.3333333333333333, 'support': 46}, 'macro avg': {'precision': 0.34265010351966874, 'recall': 0.32884615384615384, 'f1-score': 0.3330034636318654, 'support': 46}, 'weighted avg': {'precision': 0.3476460527500225, 'recall': 0.32608695652173914, 'f1-score': 0.33397155949486906, 'support': 46}}
Dev-Data: Prec: 0.341, Rec: 0.326, F1: 0.3333
{'C': {'precision': 0.21515892420537897, 'recall': 0.21052631578947367, 'f1-score': 0.21281741233373638, 'support': 418}, 'P': {'precision': 0.24607329842931938, 'recall': 0.21029082774049218, 'f1-score': 0.22677925211097708, 'support': 447}, 'micro avg': {'precision': 0.23008849557522124, 'recall': 0.21040462427745665, 'f1-score': 0.21980676328502413, 'support': 865}, 'macro avg': {'precision': 0.23061611131734916, 'recall': 0.21040857176498293, 'f1-score': 0.21979833222235673, 'support': 865}, 'weighted avg': {'precision': 0.2311343291511609, 'recall': 0.21040462427745665, 'f1-score': 0.22003237462324693, 'support': 865}}
Wrong BIO-Encoding 447/1212 labels, 36.88%
{'C': {'precision': 0.21515892420537897, 'recall': 0.21052631578947367, 'f1-score': 0.21281741233373638, 'support': 418}, 'P': {'precision': 0.24607329842931938, 'recall': 0.21029082774049218, 'f1-score': 0.22677925211097708, 'support': 447}, 'micro avg': {'precision': 0.23008849557522124, 'recall': 0.21040462427745665, 'f1-score': 0.21980676328502413, 'support': 865}, 'macro avg': {'precision': 0.23061611131734916, 'recall': 0.21040857176498293, 'f1-score': 0.21979833222235673, 'support': 865}, 'weighted avg': {'precision': 0.2311343291511609, 'recall': 0.21040462427745665, 'f1-score': 0.22003237462324693, 'support': 865}}
Wrong BIO-Encoding 26/791 labels, 3.29%
Test-Data: Prec: 0.237, Rec: 0.209, F1: 0.2221

Scores from epoch with best dev-scores:
  Dev-Score: 0.3333
  Test-Score 0.2221

5.60 sec for evaluation

--------- Epoch 13 -----------
308.92 sec for training (4067.43 total)
-- cmv_modes1 --
{'C': {'precision': 0.21428571428571427, 'recall': 0.11538461538461539, 'f1-score': 0.15, 'support': 26}, 'P': {'precision': 0.18181818181818182, 'recall': 0.3, 'f1-score': 0.22641509433962265, 'support': 20}, 'micro avg': {'precision': 0.19148936170212766, 'recall': 0.1956521739130435, 'f1-score': 0.1935483870967742, 'support': 46}, 'macro avg': {'precision': 0.19805194805194803, 'recall': 0.20769230769230768, 'f1-score': 0.1882075471698113, 'support': 46}, 'weighted avg': {'precision': 0.20016939582156973, 'recall': 0.1956521739130435, 'f1-score': 0.1832239540607055, 'support': 46}}
{'C': {'precision': 0.21428571428571427, 'recall': 0.11538461538461539, 'f1-score': 0.15, 'support': 26}, 'P': {'precision': 0.18181818181818182, 'recall': 0.3, 'f1-score': 0.22641509433962265, 'support': 20}, 'micro avg': {'precision': 0.19148936170212766, 'recall': 0.1956521739130435, 'f1-score': 0.1935483870967742, 'support': 46}, 'macro avg': {'precision': 0.19805194805194803, 'recall': 0.20769230769230768, 'f1-score': 0.1882075471698113, 'support': 46}, 'weighted avg': {'precision': 0.20016939582156973, 'recall': 0.1956521739130435, 'f1-score': 0.1832239540607055, 'support': 46}}
Dev-Data: Prec: 0.191, Rec: 0.196, F1: 0.1935
{'C': {'precision': 0.24583333333333332, 'recall': 0.14114832535885166, 'f1-score': 0.17933130699088146, 'support': 418}, 'P': {'precision': 0.24952380952380954, 'recall': 0.2930648769574944, 'f1-score': 0.2695473251028807, 'support': 447}, 'micro avg': {'precision': 0.24836601307189543, 'recall': 0.21965317919075145, 'f1-score': 0.23312883435582823, 'support': 865}, 'macro avg': {'precision': 0.24767857142857141, 'recall': 0.21710660115817304, 'f1-score': 0.22443931604688108, 'support': 865}, 'weighted avg': {'precision': 0.24774043490228462, 'recall': 0.21965317919075145, 'f1-score': 0.22595160767997238, 'support': 865}}
Wrong BIO-Encoding 208/963 labels, 21.60%
{'C': {'precision': 0.24583333333333332, 'recall': 0.14114832535885166, 'f1-score': 0.17933130699088146, 'support': 418}, 'P': {'precision': 0.24952380952380954, 'recall': 0.2930648769574944, 'f1-score': 0.2695473251028807, 'support': 447}, 'micro avg': {'precision': 0.24836601307189543, 'recall': 0.21965317919075145, 'f1-score': 0.23312883435582823, 'support': 865}, 'macro avg': {'precision': 0.24767857142857141, 'recall': 0.21710660115817304, 'f1-score': 0.22443931604688108, 'support': 865}, 'weighted avg': {'precision': 0.24774043490228462, 'recall': 0.21965317919075145, 'f1-score': 0.22595160767997238, 'support': 865}}
Wrong BIO-Encoding 10/765 labels, 1.31%
Test-Data: Prec: 0.250, Rec: 0.218, F1: 0.2333

Scores from epoch with best dev-scores:
  Dev-Score: 0.3333
  Test-Score 0.2221

4.90 sec for evaluation

--------- Epoch 14 -----------
311.57 sec for training (4379.01 total)
-- cmv_modes1 --
{'C': {'precision': 0.1, 'recall': 0.038461538461538464, 'f1-score': 0.05555555555555555, 'support': 26}, 'P': {'precision': 0.12121212121212122, 'recall': 0.2, 'f1-score': 0.15094339622641512, 'support': 20}, 'micro avg': {'precision': 0.11627906976744186, 'recall': 0.10869565217391304, 'f1-score': 0.11235955056179775, 'support': 46}, 'macro avg': {'precision': 0.11060606060606061, 'recall': 0.11923076923076924, 'f1-score': 0.10324947589098533, 'support': 46}, 'weighted avg': {'precision': 0.10922266139657444, 'recall': 0.10869565217391304, 'f1-score': 0.09702852976027711, 'support': 46}}
{'C': {'precision': 0.1, 'recall': 0.038461538461538464, 'f1-score': 0.05555555555555555, 'support': 26}, 'P': {'precision': 0.12121212121212122, 'recall': 0.2, 'f1-score': 0.15094339622641512, 'support': 20}, 'micro avg': {'precision': 0.11627906976744186, 'recall': 0.10869565217391304, 'f1-score': 0.11235955056179775, 'support': 46}, 'macro avg': {'precision': 0.11060606060606061, 'recall': 0.11923076923076924, 'f1-score': 0.10324947589098533, 'support': 46}, 'weighted avg': {'precision': 0.10922266139657444, 'recall': 0.10869565217391304, 'f1-score': 0.09702852976027711, 'support': 46}}
Dev-Data: Prec: 0.116, Rec: 0.109, F1: 0.1124
{'C': {'precision': 0.19921875, 'recall': 0.12200956937799043, 'f1-score': 0.15133531157270028, 'support': 418}, 'P': {'precision': 0.2476007677543186, 'recall': 0.28859060402684567, 'f1-score': 0.2665289256198347, 'support': 447}, 'micro avg': {'precision': 0.23166023166023167, 'recall': 0.20809248554913296, 'f1-score': 0.2192448233861145, 'support': 865}, 'macro avg': {'precision': 0.2234097588771593, 'recall': 0.20530008670241806, 'f1-score': 0.20893211859626748, 'support': 865}, 'weighted avg': {'precision': 0.22422078692043976, 'recall': 0.20809248554913296, 'f1-score': 0.21086310981439865, 'support': 865}}
Wrong BIO-Encoding 426/1186 labels, 35.92%
{'C': {'precision': 0.19921875, 'recall': 0.12200956937799043, 'f1-score': 0.15133531157270028, 'support': 418}, 'P': {'precision': 0.2476007677543186, 'recall': 0.28859060402684567, 'f1-score': 0.2665289256198347, 'support': 447}, 'micro avg': {'precision': 0.23166023166023167, 'recall': 0.20809248554913296, 'f1-score': 0.2192448233861145, 'support': 865}, 'macro avg': {'precision': 0.2234097588771593, 'recall': 0.20530008670241806, 'f1-score': 0.20893211859626748, 'support': 865}, 'weighted avg': {'precision': 0.22422078692043976, 'recall': 0.20809248554913296, 'f1-score': 0.21086310981439865, 'support': 865}}
Wrong BIO-Encoding 17/777 labels, 2.19%
Test-Data: Prec: 0.237, Rec: 0.208, F1: 0.2215

Scores from epoch with best dev-scores:
  Dev-Score: 0.3333
  Test-Score 0.2221

4.92 sec for evaluation

--------- Epoch 15 -----------
309.86 sec for training (4688.87 total)
-- cmv_modes1 --
{'C': {'precision': 0.23529411764705882, 'recall': 0.15384615384615385, 'f1-score': 0.186046511627907, 'support': 26}, 'P': {'precision': 0.16, 'recall': 0.2, 'f1-score': 0.17777777777777778, 'support': 20}, 'micro avg': {'precision': 0.19047619047619047, 'recall': 0.17391304347826086, 'f1-score': 0.1818181818181818, 'support': 46}, 'macro avg': {'precision': 0.1976470588235294, 'recall': 0.17692307692307693, 'f1-score': 0.1819121447028424, 'support': 46}, 'weighted avg': {'precision': 0.20255754475703322, 'recall': 0.17391304347826086, 'f1-score': 0.1824514099539378, 'support': 46}}
Wrong BIO-Encoding 22/63 labels, 34.92%
{'C': {'precision': 0.23529411764705882, 'recall': 0.15384615384615385, 'f1-score': 0.186046511627907, 'support': 26}, 'P': {'precision': 0.16, 'recall': 0.2, 'f1-score': 0.17777777777777778, 'support': 20}, 'micro avg': {'precision': 0.19047619047619047, 'recall': 0.17391304347826086, 'f1-score': 0.1818181818181818, 'support': 46}, 'macro avg': {'precision': 0.1976470588235294, 'recall': 0.17692307692307693, 'f1-score': 0.1819121447028424, 'support': 46}, 'weighted avg': {'precision': 0.20255754475703322, 'recall': 0.17391304347826086, 'f1-score': 0.1824514099539378, 'support': 46}}
Wrong BIO-Encoding 1/42 labels, 2.38%
Dev-Data: Prec: 0.195, Rec: 0.174, F1: 0.1839
{'C': {'precision': 0.1903409090909091, 'recall': 0.16028708133971292, 'f1-score': 0.17402597402597403, 'support': 418}, 'P': {'precision': 0.2537313432835821, 'recall': 0.22818791946308725, 'f1-score': 0.2402826855123675, 'support': 447}, 'micro avg': {'precision': 0.22413793103448276, 'recall': 0.19537572254335261, 'f1-score': 0.20877084620135888, 'support': 865}, 'macro avg': {'precision': 0.2220361261872456, 'recall': 0.1942375004014001, 'f1-score': 0.20715432976917075, 'support': 865}, 'weighted avg': {'precision': 0.22309874040203606, 'recall': 0.19537572254335261, 'f1-score': 0.20826499140680396, 'support': 865}}
Wrong BIO-Encoding 286/1030 labels, 27.77%
{'C': {'precision': 0.1903409090909091, 'recall': 0.16028708133971292, 'f1-score': 0.17402597402597403, 'support': 418}, 'P': {'precision': 0.2537313432835821, 'recall': 0.22818791946308725, 'f1-score': 0.2402826855123675, 'support': 447}, 'micro avg': {'precision': 0.22413793103448276, 'recall': 0.19537572254335261, 'f1-score': 0.20877084620135888, 'support': 865}, 'macro avg': {'precision': 0.2220361261872456, 'recall': 0.1942375004014001, 'f1-score': 0.20715432976917075, 'support': 865}, 'weighted avg': {'precision': 0.22309874040203606, 'recall': 0.19537572254335261, 'f1-score': 0.20826499140680396, 'support': 865}}
Wrong BIO-Encoding 10/754 labels, 1.33%
Test-Data: Prec: 0.227, Rec: 0.195, F1: 0.2101

Scores from epoch with best dev-scores:
  Dev-Score: 0.3333
  Test-Score 0.2221

4.89 sec for evaluation

--------- Epoch 16 -----------
310.44 sec for training (4999.30 total)
-- cmv_modes1 --
{'C': {'precision': 0.2222222222222222, 'recall': 0.15384615384615385, 'f1-score': 0.18181818181818185, 'support': 26}, 'P': {'precision': 0.19230769230769232, 'recall': 0.25, 'f1-score': 0.2173913043478261, 'support': 20}, 'micro avg': {'precision': 0.20454545454545456, 'recall': 0.1956521739130435, 'f1-score': 0.2, 'support': 46}, 'macro avg': {'precision': 0.20726495726495725, 'recall': 0.20192307692307693, 'f1-score': 0.19960474308300397, 'support': 46}, 'weighted avg': {'precision': 0.20921590486807878, 'recall': 0.1956521739130435, 'f1-score': 0.19728475683107066, 'support': 46}}
Wrong BIO-Encoding 25/68 labels, 36.76%
{'C': {'precision': 0.2222222222222222, 'recall': 0.15384615384615385, 'f1-score': 0.18181818181818185, 'support': 26}, 'P': {'precision': 0.19230769230769232, 'recall': 0.25, 'f1-score': 0.2173913043478261, 'support': 20}, 'micro avg': {'precision': 0.20454545454545456, 'recall': 0.1956521739130435, 'f1-score': 0.2, 'support': 46}, 'macro avg': {'precision': 0.20726495726495725, 'recall': 0.20192307692307693, 'f1-score': 0.19960474308300397, 'support': 46}, 'weighted avg': {'precision': 0.20921590486807878, 'recall': 0.1956521739130435, 'f1-score': 0.19728475683107066, 'support': 46}}
Wrong BIO-Encoding 1/44 labels, 2.27%
Dev-Data: Prec: 0.209, Rec: 0.196, F1: 0.2022
{'C': {'precision': 0.17857142857142858, 'recall': 0.14354066985645933, 'f1-score': 0.15915119363395225, 'support': 418}, 'P': {'precision': 0.2484472049689441, 'recall': 0.2684563758389262, 'f1-score': 0.2580645161290323, 'support': 447}, 'micro avg': {'precision': 0.21978021978021978, 'recall': 0.20809248554913296, 'f1-score': 0.2137767220902613, 'support': 865}, 'macro avg': {'precision': 0.21350931677018634, 'recall': 0.20599852284769277, 'f1-score': 0.20860785488149228, 'support': 865}, 'weighted avg': {'precision': 0.2146806448138441, 'recall': 0.20809248554913296, 'f1-score': 0.2102659394782306, 'support': 865}}
Wrong BIO-Encoding 401/1207 labels, 33.22%
{'C': {'precision': 0.17857142857142858, 'recall': 0.14354066985645933, 'f1-score': 0.15915119363395225, 'support': 418}, 'P': {'precision': 0.2484472049689441, 'recall': 0.2684563758389262, 'f1-score': 0.2580645161290323, 'support': 447}, 'micro avg': {'precision': 0.21978021978021978, 'recall': 0.20809248554913296, 'f1-score': 0.2137767220902613, 'support': 865}, 'macro avg': {'precision': 0.21350931677018634, 'recall': 0.20599852284769277, 'f1-score': 0.20860785488149228, 'support': 865}, 'weighted avg': {'precision': 0.2146806448138441, 'recall': 0.20809248554913296, 'f1-score': 0.2102659394782306, 'support': 865}}
Wrong BIO-Encoding 13/819 labels, 1.59%
Test-Data: Prec: 0.223, Rec: 0.208, F1: 0.2154

Scores from epoch with best dev-scores:
  Dev-Score: 0.3333
  Test-Score 0.2221

4.97 sec for evaluation

--------- Epoch 17 -----------
309.35 sec for training (5308.65 total)
-- cmv_modes1 --
{'C': {'precision': 0.5, 'recall': 0.34615384615384615, 'f1-score': 0.40909090909090906, 'support': 26}, 'P': {'precision': 0.3076923076923077, 'recall': 0.4, 'f1-score': 0.34782608695652173, 'support': 20}, 'micro avg': {'precision': 0.38636363636363635, 'recall': 0.3695652173913043, 'f1-score': 0.37777777777777777, 'support': 46}, 'macro avg': {'precision': 0.40384615384615385, 'recall': 0.3730769230769231, 'f1-score': 0.3784584980237154, 'support': 46}, 'weighted avg': {'precision': 0.41638795986622074, 'recall': 0.3695652173913043, 'f1-score': 0.382454029902045, 'support': 46}}
Wrong BIO-Encoding 20/63 labels, 31.75%
{'C': {'precision': 0.5, 'recall': 0.34615384615384615, 'f1-score': 0.40909090909090906, 'support': 26}, 'P': {'precision': 0.3076923076923077, 'recall': 0.4, 'f1-score': 0.34782608695652173, 'support': 20}, 'micro avg': {'precision': 0.38636363636363635, 'recall': 0.3695652173913043, 'f1-score': 0.37777777777777777, 'support': 46}, 'macro avg': {'precision': 0.40384615384615385, 'recall': 0.3730769230769231, 'f1-score': 0.3784584980237154, 'support': 46}, 'weighted avg': {'precision': 0.41638795986622074, 'recall': 0.3695652173913043, 'f1-score': 0.382454029902045, 'support': 46}}
Wrong BIO-Encoding 1/44 labels, 2.27%
Dev-Data: Prec: 0.395, Rec: 0.370, F1: 0.3820
{'C': {'precision': 0.22336769759450173, 'recall': 0.15550239234449761, 'f1-score': 0.18335684062059238, 'support': 418}, 'P': {'precision': 0.27705627705627706, 'recall': 0.28635346756152125, 'f1-score': 0.2816281628162816, 'support': 447}, 'micro avg': {'precision': 0.25630810092961487, 'recall': 0.223121387283237, 'f1-score': 0.23856613102595797, 'support': 865}, 'macro avg': {'precision': 0.2502119873253894, 'recall': 0.22092792995300942, 'f1-score': 0.232492501718437, 'support': 865}, 'weighted avg': {'precision': 0.25111196929324575, 'recall': 0.223121387283237, 'f1-score': 0.23413982446044562, 'support': 865}}
Wrong BIO-Encoding 312/1049 labels, 29.74%
{'C': {'precision': 0.22336769759450173, 'recall': 0.15550239234449761, 'f1-score': 0.18335684062059238, 'support': 418}, 'P': {'precision': 0.27705627705627706, 'recall': 0.28635346756152125, 'f1-score': 0.2816281628162816, 'support': 447}, 'micro avg': {'precision': 0.25630810092961487, 'recall': 0.223121387283237, 'f1-score': 0.23856613102595797, 'support': 865}, 'macro avg': {'precision': 0.2502119873253894, 'recall': 0.22092792995300942, 'f1-score': 0.232492501718437, 'support': 865}, 'weighted avg': {'precision': 0.25111196929324575, 'recall': 0.223121387283237, 'f1-score': 0.23413982446044562, 'support': 865}}
Wrong BIO-Encoding 16/753 labels, 2.12%
Test-Data: Prec: 0.261, Rec: 0.222, F1: 0.2397

Scores from epoch with best dev-scores:
  Dev-Score: 0.3820
  Test-Score 0.2397

5.60 sec for evaluation

--------- Epoch 18 -----------
310.22 sec for training (5618.87 total)
-- cmv_modes1 --
{'C': {'precision': 0.3333333333333333, 'recall': 0.19230769230769232, 'f1-score': 0.2439024390243902, 'support': 26}, 'P': {'precision': 0.17857142857142858, 'recall': 0.25, 'f1-score': 0.20833333333333331, 'support': 20}, 'micro avg': {'precision': 0.23255813953488372, 'recall': 0.21739130434782608, 'f1-score': 0.2247191011235955, 'support': 46}, 'macro avg': {'precision': 0.25595238095238093, 'recall': 0.22115384615384615, 'f1-score': 0.22611788617886175, 'support': 46}, 'weighted avg': {'precision': 0.2660455486542443, 'recall': 0.21739130434782608, 'f1-score': 0.22843761046306116, 'support': 46}}
Wrong BIO-Encoding 25/67 labels, 37.31%
{'C': {'precision': 0.3333333333333333, 'recall': 0.19230769230769232, 'f1-score': 0.2439024390243902, 'support': 26}, 'P': {'precision': 0.17857142857142858, 'recall': 0.25, 'f1-score': 0.20833333333333331, 'support': 20}, 'micro avg': {'precision': 0.23255813953488372, 'recall': 0.21739130434782608, 'f1-score': 0.2247191011235955, 'support': 46}, 'macro avg': {'precision': 0.25595238095238093, 'recall': 0.22115384615384615, 'f1-score': 0.22611788617886175, 'support': 46}, 'weighted avg': {'precision': 0.2660455486542443, 'recall': 0.21739130434782608, 'f1-score': 0.22843761046306116, 'support': 46}}
Wrong BIO-Encoding 1/43 labels, 2.33%
Dev-Data: Prec: 0.238, Rec: 0.217, F1: 0.2273
{'C': {'precision': 0.21333333333333335, 'recall': 0.11483253588516747, 'f1-score': 0.14930015552099532, 'support': 418}, 'P': {'precision': 0.2647058823529412, 'recall': 0.3221476510067114, 'f1-score': 0.29061553985872857, 'support': 447}, 'micro avg': {'precision': 0.24967490247074123, 'recall': 0.22196531791907514, 'f1-score': 0.23500611995104043, 'support': 865}, 'macro avg': {'precision': 0.23901960784313725, 'recall': 0.21849009344593942, 'f1-score': 0.21995784768986193, 'support': 865}, 'weighted avg': {'precision': 0.2398807661793041, 'recall': 0.22196531791907514, 'f1-score': 0.2223267182943673, 'support': 865}}
Wrong BIO-Encoding 205/959 labels, 21.38%
{'C': {'precision': 0.21333333333333335, 'recall': 0.11483253588516747, 'f1-score': 0.14930015552099532, 'support': 418}, 'P': {'precision': 0.2647058823529412, 'recall': 0.3221476510067114, 'f1-score': 0.29061553985872857, 'support': 447}, 'micro avg': {'precision': 0.24967490247074123, 'recall': 0.22196531791907514, 'f1-score': 0.23500611995104043, 'support': 865}, 'macro avg': {'precision': 0.23901960784313725, 'recall': 0.21849009344593942, 'f1-score': 0.21995784768986193, 'support': 865}, 'weighted avg': {'precision': 0.2398807661793041, 'recall': 0.22196531791907514, 'f1-score': 0.2223267182943673, 'support': 865}}
Wrong BIO-Encoding 15/769 labels, 1.95%
Test-Data: Prec: 0.255, Rec: 0.222, F1: 0.2372

Scores from epoch with best dev-scores:
  Dev-Score: 0.3820
  Test-Score 0.2397

4.91 sec for evaluation

--------- Epoch 19 -----------
311.45 sec for training (5930.31 total)
-- cmv_modes1 --
{'C': {'precision': 0.34782608695652173, 'recall': 0.3076923076923077, 'f1-score': 0.32653061224489793, 'support': 26}, 'P': {'precision': 0.19047619047619047, 'recall': 0.2, 'f1-score': 0.1951219512195122, 'support': 20}, 'micro avg': {'precision': 0.2727272727272727, 'recall': 0.2608695652173913, 'f1-score': 0.2666666666666666, 'support': 46}, 'macro avg': {'precision': 0.2691511387163561, 'recall': 0.25384615384615383, 'f1-score': 0.26082628173220507, 'support': 46}, 'weighted avg': {'precision': 0.27941308848681246, 'recall': 0.2608695652173913, 'f1-score': 0.26939641179907803, 'support': 46}}
Wrong BIO-Encoding 25/68 labels, 36.76%
{'C': {'precision': 0.34782608695652173, 'recall': 0.3076923076923077, 'f1-score': 0.32653061224489793, 'support': 26}, 'P': {'precision': 0.19047619047619047, 'recall': 0.2, 'f1-score': 0.1951219512195122, 'support': 20}, 'micro avg': {'precision': 0.2727272727272727, 'recall': 0.2608695652173913, 'f1-score': 0.2666666666666666, 'support': 46}, 'macro avg': {'precision': 0.2691511387163561, 'recall': 0.25384615384615383, 'f1-score': 0.26082628173220507, 'support': 46}, 'weighted avg': {'precision': 0.27941308848681246, 'recall': 0.2608695652173913, 'f1-score': 0.26939641179907803, 'support': 46}}
Wrong BIO-Encoding 1/44 labels, 2.27%
Dev-Data: Prec: 0.279, Rec: 0.261, F1: 0.2697
{'C': {'precision': 0.20954907161803712, 'recall': 0.18899521531100477, 'f1-score': 0.19874213836477989, 'support': 418}, 'P': {'precision': 0.3249370277078086, 'recall': 0.28859060402684567, 'f1-score': 0.3056872037914692, 'support': 447}, 'micro avg': {'precision': 0.268733850129199, 'recall': 0.24046242774566473, 'f1-score': 0.25381330079316655, 'support': 865}, 'macro avg': {'precision': 0.26724304966292284, 'recall': 0.23879290966892522, 'f1-score': 0.25221467107812456, 'support': 865}, 'weighted avg': {'precision': 0.2691772986378381, 'recall': 0.24046242774566473, 'f1-score': 0.2540073918280517, 'support': 865}}
Wrong BIO-Encoding 437/1194 labels, 36.60%
{'C': {'precision': 0.20954907161803712, 'recall': 0.18899521531100477, 'f1-score': 0.19874213836477989, 'support': 418}, 'P': {'precision': 0.3249370277078086, 'recall': 0.28859060402684567, 'f1-score': 0.3056872037914692, 'support': 447}, 'micro avg': {'precision': 0.268733850129199, 'recall': 0.24046242774566473, 'f1-score': 0.25381330079316655, 'support': 865}, 'macro avg': {'precision': 0.26724304966292284, 'recall': 0.23879290966892522, 'f1-score': 0.25221467107812456, 'support': 865}, 'weighted avg': {'precision': 0.2691772986378381, 'recall': 0.24046242774566473, 'f1-score': 0.2540073918280517, 'support': 865}}
Wrong BIO-Encoding 17/774 labels, 2.20%
Test-Data: Prec: 0.275, Rec: 0.240, F1: 0.2565

Scores from epoch with best dev-scores:
  Dev-Score: 0.3820
  Test-Score 0.2397

4.90 sec for evaluation

--------- Epoch 20 -----------
310.22 sec for training (6240.53 total)
-- cmv_modes1 --
{'C': {'precision': 0.4090909090909091, 'recall': 0.34615384615384615, 'f1-score': 0.37500000000000006, 'support': 26}, 'P': {'precision': 0.2857142857142857, 'recall': 0.3, 'f1-score': 0.2926829268292683, 'support': 20}, 'micro avg': {'precision': 0.3488372093023256, 'recall': 0.32608695652173914, 'f1-score': 0.33707865168539325, 'support': 46}, 'macro avg': {'precision': 0.3474025974025974, 'recall': 0.32307692307692304, 'f1-score': 0.33384146341463417, 'support': 46}, 'weighted avg': {'precision': 0.35544889892715975, 'recall': 0.32608695652173914, 'f1-score': 0.3392099681866384, 'support': 46}}
{'C': {'precision': 0.4090909090909091, 'recall': 0.34615384615384615, 'f1-score': 0.37500000000000006, 'support': 26}, 'P': {'precision': 0.2857142857142857, 'recall': 0.3, 'f1-score': 0.2926829268292683, 'support': 20}, 'micro avg': {'precision': 0.3488372093023256, 'recall': 0.32608695652173914, 'f1-score': 0.33707865168539325, 'support': 46}, 'macro avg': {'precision': 0.3474025974025974, 'recall': 0.32307692307692304, 'f1-score': 0.33384146341463417, 'support': 46}, 'weighted avg': {'precision': 0.35544889892715975, 'recall': 0.32608695652173914, 'f1-score': 0.3392099681866384, 'support': 46}}
Dev-Data: Prec: 0.349, Rec: 0.326, F1: 0.3371
{'C': {'precision': 0.19402985074626866, 'recall': 0.15550239234449761, 'f1-score': 0.17264276228419656, 'support': 418}, 'P': {'precision': 0.24307036247334754, 'recall': 0.2550335570469799, 'f1-score': 0.24890829694323147, 'support': 447}, 'micro avg': {'precision': 0.22263681592039802, 'recall': 0.2069364161849711, 'f1-score': 0.21449970041941283, 'support': 865}, 'macro avg': {'precision': 0.21855010660980811, 'recall': 0.20526797469573876, 'f1-score': 0.210775529613714, 'support': 865}, 'weighted avg': {'precision': 0.21937217299136028, 'recall': 0.2069364161849711, 'f1-score': 0.2120539692120447, 'support': 865}}
Wrong BIO-Encoding 278/1069 labels, 26.01%
{'C': {'precision': 0.19402985074626866, 'recall': 0.15550239234449761, 'f1-score': 0.17264276228419656, 'support': 418}, 'P': {'precision': 0.24307036247334754, 'recall': 0.2550335570469799, 'f1-score': 0.24890829694323147, 'support': 447}, 'micro avg': {'precision': 0.22263681592039802, 'recall': 0.2069364161849711, 'f1-score': 0.21449970041941283, 'support': 865}, 'macro avg': {'precision': 0.21855010660980811, 'recall': 0.20526797469573876, 'f1-score': 0.210775529613714, 'support': 865}, 'weighted avg': {'precision': 0.21937217299136028, 'recall': 0.2069364161849711, 'f1-score': 0.2120539692120447, 'support': 865}}
Wrong BIO-Encoding 13/804 labels, 1.62%
Test-Data: Prec: 0.225, Rec: 0.206, F1: 0.2150

Scores from epoch with best dev-scores:
  Dev-Score: 0.3820
  Test-Score 0.2397

4.94 sec for evaluation

--------- Epoch 21 -----------
310.62 sec for training (6551.16 total)
-- cmv_modes1 --
{'C': {'precision': 0.3333333333333333, 'recall': 0.2692307692307692, 'f1-score': 0.2978723404255319, 'support': 26}, 'P': {'precision': 0.19047619047619047, 'recall': 0.2, 'f1-score': 0.1951219512195122, 'support': 20}, 'micro avg': {'precision': 0.2619047619047619, 'recall': 0.2391304347826087, 'f1-score': 0.25, 'support': 46}, 'macro avg': {'precision': 0.26190476190476186, 'recall': 0.23461538461538461, 'f1-score': 0.24649714582252205, 'support': 46}, 'weighted avg': {'precision': 0.2712215320910973, 'recall': 0.2391304347826087, 'f1-score': 0.25319825816204505, 'support': 46}}
{'C': {'precision': 0.3333333333333333, 'recall': 0.2692307692307692, 'f1-score': 0.2978723404255319, 'support': 26}, 'P': {'precision': 0.19047619047619047, 'recall': 0.2, 'f1-score': 0.1951219512195122, 'support': 20}, 'micro avg': {'precision': 0.2619047619047619, 'recall': 0.2391304347826087, 'f1-score': 0.25, 'support': 46}, 'macro avg': {'precision': 0.26190476190476186, 'recall': 0.23461538461538461, 'f1-score': 0.24649714582252205, 'support': 46}, 'weighted avg': {'precision': 0.2712215320910973, 'recall': 0.2391304347826087, 'f1-score': 0.25319825816204505, 'support': 46}}
Dev-Data: Prec: 0.262, Rec: 0.239, F1: 0.2500
{'C': {'precision': 0.22788203753351208, 'recall': 0.20334928229665072, 'f1-score': 0.21491782553729455, 'support': 418}, 'P': {'precision': 0.28672985781990523, 'recall': 0.27069351230425054, 'f1-score': 0.2784810126582279, 'support': 447}, 'micro avg': {'precision': 0.2591194968553459, 'recall': 0.23815028901734103, 'f1-score': 0.24819277108433732, 'support': 865}, 'macro avg': {'precision': 0.25730594767670867, 'recall': 0.23702139730045063, 'f1-score': 0.24669941909776122, 'support': 865}, 'weighted avg': {'precision': 0.25829241402833025, 'recall': 0.23815028901734103, 'f1-score': 0.24776492917088672, 'support': 865}}
Wrong BIO-Encoding 270/1048 labels, 25.76%
{'C': {'precision': 0.22788203753351208, 'recall': 0.20334928229665072, 'f1-score': 0.21491782553729455, 'support': 418}, 'P': {'precision': 0.28672985781990523, 'recall': 0.27069351230425054, 'f1-score': 0.2784810126582279, 'support': 447}, 'micro avg': {'precision': 0.2591194968553459, 'recall': 0.23815028901734103, 'f1-score': 0.24819277108433732, 'support': 865}, 'macro avg': {'precision': 0.25730594767670867, 'recall': 0.23702139730045063, 'f1-score': 0.24669941909776122, 'support': 865}, 'weighted avg': {'precision': 0.25829241402833025, 'recall': 0.23815028901734103, 'f1-score': 0.24776492917088672, 'support': 865}}
Wrong BIO-Encoding 17/795 labels, 2.14%
Test-Data: Prec: 0.265, Rec: 0.238, F1: 0.2508

Scores from epoch with best dev-scores:
  Dev-Score: 0.3820
  Test-Score 0.2397

4.80 sec for evaluation

--------- Epoch 22 -----------
309.10 sec for training (6860.26 total)
-- cmv_modes1 --
{'C': {'precision': 0.47368421052631576, 'recall': 0.34615384615384615, 'f1-score': 0.39999999999999997, 'support': 26}, 'P': {'precision': 0.3157894736842105, 'recall': 0.3, 'f1-score': 0.3076923076923077, 'support': 20}, 'micro avg': {'precision': 0.39473684210526316, 'recall': 0.32608695652173914, 'f1-score': 0.35714285714285715, 'support': 46}, 'macro avg': {'precision': 0.39473684210526316, 'recall': 0.32307692307692304, 'f1-score': 0.3538461538461538, 'support': 46}, 'weighted avg': {'precision': 0.4050343249427918, 'recall': 0.32608695652173914, 'f1-score': 0.3598662207357859, 'support': 46}}
Wrong BIO-Encoding 23/60 labels, 38.33%
{'C': {'precision': 0.47368421052631576, 'recall': 0.34615384615384615, 'f1-score': 0.39999999999999997, 'support': 26}, 'P': {'precision': 0.3157894736842105, 'recall': 0.3, 'f1-score': 0.3076923076923077, 'support': 20}, 'micro avg': {'precision': 0.39473684210526316, 'recall': 0.32608695652173914, 'f1-score': 0.35714285714285715, 'support': 46}, 'macro avg': {'precision': 0.39473684210526316, 'recall': 0.32307692307692304, 'f1-score': 0.3538461538461538, 'support': 46}, 'weighted avg': {'precision': 0.4050343249427918, 'recall': 0.32608695652173914, 'f1-score': 0.3598662207357859, 'support': 46}}
Wrong BIO-Encoding 1/38 labels, 2.63%
Dev-Data: Prec: 0.405, Rec: 0.326, F1: 0.3614
{'C': {'precision': 0.19873817034700317, 'recall': 0.1507177033492823, 'f1-score': 0.17142857142857143, 'support': 418}, 'P': {'precision': 0.3036529680365297, 'recall': 0.2975391498881432, 'f1-score': 0.3005649717514124, 'support': 447}, 'micro avg': {'precision': 0.2596026490066225, 'recall': 0.22658959537572254, 'f1-score': 0.2419753086419753, 'support': 865}, 'macro avg': {'precision': 0.25119556919176644, 'recall': 0.22412842661871274, 'f1-score': 0.2359967715899919, 'support': 865}, 'weighted avg': {'precision': 0.25295425655187986, 'recall': 0.22658959537572254, 'f1-score': 0.2381614858150569, 'support': 865}}
Wrong BIO-Encoding 525/1259 labels, 41.70%
{'C': {'precision': 0.19873817034700317, 'recall': 0.1507177033492823, 'f1-score': 0.17142857142857143, 'support': 418}, 'P': {'precision': 0.3036529680365297, 'recall': 0.2975391498881432, 'f1-score': 0.3005649717514124, 'support': 447}, 'micro avg': {'precision': 0.2596026490066225, 'recall': 0.22658959537572254, 'f1-score': 0.2419753086419753, 'support': 865}, 'macro avg': {'precision': 0.25119556919176644, 'recall': 0.22412842661871274, 'f1-score': 0.2359967715899919, 'support': 865}, 'weighted avg': {'precision': 0.25295425655187986, 'recall': 0.22658959537572254, 'f1-score': 0.2381614858150569, 'support': 865}}
Wrong BIO-Encoding 21/755 labels, 2.78%
Test-Data: Prec: 0.267, Rec: 0.227, F1: 0.2452

Scores from epoch with best dev-scores:
  Dev-Score: 0.3820
  Test-Score 0.2397

4.89 sec for evaluation

--------- Epoch 23 -----------
308.30 sec for training (7168.56 total)
-- cmv_modes1 --
{'C': {'precision': 0.5238095238095238, 'recall': 0.4230769230769231, 'f1-score': 0.4680851063829788, 'support': 26}, 'P': {'precision': 0.2222222222222222, 'recall': 0.2, 'f1-score': 0.2105263157894737, 'support': 20}, 'micro avg': {'precision': 0.38461538461538464, 'recall': 0.32608695652173914, 'f1-score': 0.3529411764705882, 'support': 46}, 'macro avg': {'precision': 0.373015873015873, 'recall': 0.31153846153846154, 'f1-score': 0.33930571108622626, 'support': 46}, 'weighted avg': {'precision': 0.39268461007591443, 'recall': 0.32608695652173914, 'f1-score': 0.35610302351623746, 'support': 46}}
Wrong BIO-Encoding 23/61 labels, 37.70%
{'C': {'precision': 0.5238095238095238, 'recall': 0.4230769230769231, 'f1-score': 0.4680851063829788, 'support': 26}, 'P': {'precision': 0.2222222222222222, 'recall': 0.2, 'f1-score': 0.2105263157894737, 'support': 20}, 'micro avg': {'precision': 0.38461538461538464, 'recall': 0.32608695652173914, 'f1-score': 0.3529411764705882, 'support': 46}, 'macro avg': {'precision': 0.373015873015873, 'recall': 0.31153846153846154, 'f1-score': 0.33930571108622626, 'support': 46}, 'weighted avg': {'precision': 0.39268461007591443, 'recall': 0.32608695652173914, 'f1-score': 0.35610302351623746, 'support': 46}}
Wrong BIO-Encoding 1/39 labels, 2.56%
Dev-Data: Prec: 0.395, Rec: 0.326, F1: 0.3571
{'C': {'precision': 0.20615384615384616, 'recall': 0.16028708133971292, 'f1-score': 0.18034993270524902, 'support': 418}, 'P': {'precision': 0.2863741339491917, 'recall': 0.27740492170022374, 'f1-score': 0.2818181818181818, 'support': 447}, 'micro avg': {'precision': 0.2519788918205805, 'recall': 0.2208092485549133, 'f1-score': 0.23536660505237214, 'support': 865}, 'macro avg': {'precision': 0.24626399005151894, 'recall': 0.21884600151996833, 'f1-score': 0.2310840572617154, 'support': 865}, 'weighted avg': {'precision': 0.2476087231995334, 'recall': 0.2208092485549133, 'f1-score': 0.2327849701081172, 'support': 865}}
Wrong BIO-Encoding 181/930 labels, 19.46%
{'C': {'precision': 0.20615384615384616, 'recall': 0.16028708133971292, 'f1-score': 0.18034993270524902, 'support': 418}, 'P': {'precision': 0.2863741339491917, 'recall': 0.27740492170022374, 'f1-score': 0.2818181818181818, 'support': 447}, 'micro avg': {'precision': 0.2519788918205805, 'recall': 0.2208092485549133, 'f1-score': 0.23536660505237214, 'support': 865}, 'macro avg': {'precision': 0.24626399005151894, 'recall': 0.21884600151996833, 'f1-score': 0.2310840572617154, 'support': 865}, 'weighted avg': {'precision': 0.2476087231995334, 'recall': 0.2208092485549133, 'f1-score': 0.2327849701081172, 'support': 865}}
Wrong BIO-Encoding 9/758 labels, 1.19%
Test-Data: Prec: 0.255, Rec: 0.221, F1: 0.2367

Scores from epoch with best dev-scores:
  Dev-Score: 0.3820
  Test-Score 0.2397

4.87 sec for evaluation

--------- Epoch 24 -----------
310.66 sec for training (7479.22 total)
-- cmv_modes1 --
{'C': {'precision': 0.5454545454545454, 'recall': 0.46153846153846156, 'f1-score': 0.4999999999999999, 'support': 26}, 'P': {'precision': 0.3181818181818182, 'recall': 0.35, 'f1-score': 0.3333333333333333, 'support': 20}, 'micro avg': {'precision': 0.4318181818181818, 'recall': 0.41304347826086957, 'f1-score': 0.4222222222222222, 'support': 46}, 'macro avg': {'precision': 0.43181818181818177, 'recall': 0.40576923076923077, 'f1-score': 0.41666666666666663, 'support': 46}, 'weighted avg': {'precision': 0.44664031620553357, 'recall': 0.41304347826086957, 'f1-score': 0.4275362318840579, 'support': 46}}
{'C': {'precision': 0.5454545454545454, 'recall': 0.46153846153846156, 'f1-score': 0.4999999999999999, 'support': 26}, 'P': {'precision': 0.3181818181818182, 'recall': 0.35, 'f1-score': 0.3333333333333333, 'support': 20}, 'micro avg': {'precision': 0.4318181818181818, 'recall': 0.41304347826086957, 'f1-score': 0.4222222222222222, 'support': 46}, 'macro avg': {'precision': 0.43181818181818177, 'recall': 0.40576923076923077, 'f1-score': 0.41666666666666663, 'support': 46}, 'weighted avg': {'precision': 0.44664031620553357, 'recall': 0.41304347826086957, 'f1-score': 0.4275362318840579, 'support': 46}}
Dev-Data: Prec: 0.432, Rec: 0.413, F1: 0.4222
{'C': {'precision': 0.20376175548589343, 'recall': 0.15550239234449761, 'f1-score': 0.17639077340569878, 'support': 418}, 'P': {'precision': 0.24497991967871485, 'recall': 0.27293064876957496, 'f1-score': 0.25820105820105815, 'support': 447}, 'micro avg': {'precision': 0.22888616891064872, 'recall': 0.2161849710982659, 'f1-score': 0.22235434007134366, 'support': 865}, 'macro avg': {'precision': 0.22437083758230414, 'recall': 0.21421652055703627, 'f1-score': 0.21729591580337848, 'support': 865}, 'weighted avg': {'precision': 0.22506177790692367, 'recall': 0.2161849710982659, 'f1-score': 0.21866730208029486, 'support': 865}}
Wrong BIO-Encoding 227/1027 labels, 22.10%
{'C': {'precision': 0.20376175548589343, 'recall': 0.15550239234449761, 'f1-score': 0.17639077340569878, 'support': 418}, 'P': {'precision': 0.24497991967871485, 'recall': 0.27293064876957496, 'f1-score': 0.25820105820105815, 'support': 447}, 'micro avg': {'precision': 0.22888616891064872, 'recall': 0.2161849710982659, 'f1-score': 0.22235434007134366, 'support': 865}, 'macro avg': {'precision': 0.22437083758230414, 'recall': 0.21421652055703627, 'f1-score': 0.21729591580337848, 'support': 865}, 'weighted avg': {'precision': 0.22506177790692367, 'recall': 0.2161849710982659, 'f1-score': 0.21866730208029486, 'support': 865}}
Wrong BIO-Encoding 17/817 labels, 2.08%
Test-Data: Prec: 0.234, Rec: 0.216, F1: 0.2246

Scores from epoch with best dev-scores:
  Dev-Score: 0.4222
  Test-Score 0.2246

5.50 sec for evaluation

--------- Epoch 25 -----------
308.73 sec for training (7787.95 total)
-- cmv_modes1 --
{'C': {'precision': 0.4090909090909091, 'recall': 0.34615384615384615, 'f1-score': 0.37500000000000006, 'support': 26}, 'P': {'precision': 0.3157894736842105, 'recall': 0.3, 'f1-score': 0.3076923076923077, 'support': 20}, 'micro avg': {'precision': 0.36585365853658536, 'recall': 0.32608695652173914, 'f1-score': 0.3448275862068966, 'support': 46}, 'macro avg': {'precision': 0.3624401913875598, 'recall': 0.32307692307692304, 'f1-score': 0.34134615384615385, 'support': 46}, 'weighted avg': {'precision': 0.36852506760973575, 'recall': 0.32608695652173914, 'f1-score': 0.34573578595317733, 'support': 46}}
Wrong BIO-Encoding 23/63 labels, 36.51%
{'C': {'precision': 0.4090909090909091, 'recall': 0.34615384615384615, 'f1-score': 0.37500000000000006, 'support': 26}, 'P': {'precision': 0.3157894736842105, 'recall': 0.3, 'f1-score': 0.3076923076923077, 'support': 20}, 'micro avg': {'precision': 0.36585365853658536, 'recall': 0.32608695652173914, 'f1-score': 0.3448275862068966, 'support': 46}, 'macro avg': {'precision': 0.3624401913875598, 'recall': 0.32307692307692304, 'f1-score': 0.34134615384615385, 'support': 46}, 'weighted avg': {'precision': 0.36852506760973575, 'recall': 0.32608695652173914, 'f1-score': 0.34573578595317733, 'support': 46}}
Wrong BIO-Encoding 1/41 labels, 2.44%
Dev-Data: Prec: 0.375, Rec: 0.326, F1: 0.3488
{'C': {'precision': 0.21367521367521367, 'recall': 0.17942583732057416, 'f1-score': 0.19505851755526657, 'support': 418}, 'P': {'precision': 0.30024213075060535, 'recall': 0.27740492170022374, 'f1-score': 0.2883720930232559, 'support': 447}, 'micro avg': {'precision': 0.2604712041884817, 'recall': 0.2300578034682081, 'f1-score': 0.2443216697360344, 'support': 865}, 'macro avg': {'precision': 0.2569586722129095, 'recall': 0.22841537951039895, 'f1-score': 0.24171530528926122, 'support': 865}, 'weighted avg': {'precision': 0.25840979394423114, 'recall': 0.2300578034682081, 'f1-score': 0.24327952129421596, 'support': 865}}
Wrong BIO-Encoding 249/1002 labels, 24.85%
{'C': {'precision': 0.21367521367521367, 'recall': 0.17942583732057416, 'f1-score': 0.19505851755526657, 'support': 418}, 'P': {'precision': 0.30024213075060535, 'recall': 0.27740492170022374, 'f1-score': 0.2883720930232559, 'support': 447}, 'micro avg': {'precision': 0.2604712041884817, 'recall': 0.2300578034682081, 'f1-score': 0.2443216697360344, 'support': 865}, 'macro avg': {'precision': 0.2569586722129095, 'recall': 0.22841537951039895, 'f1-score': 0.24171530528926122, 'support': 865}, 'weighted avg': {'precision': 0.25840979394423114, 'recall': 0.2300578034682081, 'f1-score': 0.24327952129421596, 'support': 865}}
Wrong BIO-Encoding 11/764 labels, 1.44%
Test-Data: Prec: 0.264, Rec: 0.230, F1: 0.2460

Scores from epoch with best dev-scores:
  Dev-Score: 0.4222
  Test-Score 0.2246

4.93 sec for evaluation

--------- Epoch 26 -----------
308.63 sec for training (8096.57 total)
-- cmv_modes1 --
{'C': {'precision': 0.6842105263157895, 'recall': 0.5, 'f1-score': 0.5777777777777778, 'support': 26}, 'P': {'precision': 0.5, 'recall': 0.5, 'f1-score': 0.5, 'support': 20}, 'micro avg': {'precision': 0.5897435897435898, 'recall': 0.5, 'f1-score': 0.5411764705882353, 'support': 46}, 'macro avg': {'precision': 0.5921052631578947, 'recall': 0.5, 'f1-score': 0.538888888888889, 'support': 46}, 'weighted avg': {'precision': 0.6041189931350115, 'recall': 0.5, 'f1-score': 0.543961352657005, 'support': 46}}
{'C': {'precision': 0.6842105263157895, 'recall': 0.5, 'f1-score': 0.5777777777777778, 'support': 26}, 'P': {'precision': 0.5, 'recall': 0.5, 'f1-score': 0.5, 'support': 20}, 'micro avg': {'precision': 0.5897435897435898, 'recall': 0.5, 'f1-score': 0.5411764705882353, 'support': 46}, 'macro avg': {'precision': 0.5921052631578947, 'recall': 0.5, 'f1-score': 0.538888888888889, 'support': 46}, 'weighted avg': {'precision': 0.6041189931350115, 'recall': 0.5, 'f1-score': 0.543961352657005, 'support': 46}}
Dev-Data: Prec: 0.590, Rec: 0.500, F1: 0.5412
{'C': {'precision': 0.2012779552715655, 'recall': 0.1507177033492823, 'f1-score': 0.1723666210670315, 'support': 418}, 'P': {'precision': 0.25995316159250587, 'recall': 0.2483221476510067, 'f1-score': 0.2540045766590389, 'support': 447}, 'micro avg': {'precision': 0.23513513513513515, 'recall': 0.20115606936416186, 'f1-score': 0.21682242990654205, 'support': 865}, 'macro avg': {'precision': 0.23061555843203568, 'recall': 0.19951992550014452, 'f1-score': 0.2131855988630352, 'support': 865}, 'weighted avg': {'precision': 0.23159913125475665, 'recall': 0.20115606936416186, 'f1-score': 0.21455409638451975, 'support': 865}}
Wrong BIO-Encoding 199/928 labels, 21.44%
{'C': {'precision': 0.2012779552715655, 'recall': 0.1507177033492823, 'f1-score': 0.1723666210670315, 'support': 418}, 'P': {'precision': 0.25995316159250587, 'recall': 0.2483221476510067, 'f1-score': 0.2540045766590389, 'support': 447}, 'micro avg': {'precision': 0.23513513513513515, 'recall': 0.20115606936416186, 'f1-score': 0.21682242990654205, 'support': 865}, 'macro avg': {'precision': 0.23061555843203568, 'recall': 0.19951992550014452, 'f1-score': 0.2131855988630352, 'support': 865}, 'weighted avg': {'precision': 0.23159913125475665, 'recall': 0.20115606936416186, 'f1-score': 0.21455409638451975, 'support': 865}}
Wrong BIO-Encoding 11/740 labels, 1.49%
Test-Data: Prec: 0.239, Rec: 0.201, F1: 0.2183

Scores from epoch with best dev-scores:
  Dev-Score: 0.5412
  Test-Score 0.2183

5.52 sec for evaluation

--------- Epoch 27 -----------
310.56 sec for training (8407.14 total)
-- cmv_modes1 --
{'C': {'precision': 0.5714285714285714, 'recall': 0.46153846153846156, 'f1-score': 0.5106382978723405, 'support': 26}, 'P': {'precision': 0.42857142857142855, 'recall': 0.45, 'f1-score': 0.4390243902439024, 'support': 20}, 'micro avg': {'precision': 0.5, 'recall': 0.45652173913043476, 'f1-score': 0.47727272727272724, 'support': 46}, 'macro avg': {'precision': 0.5, 'recall': 0.4557692307692308, 'f1-score': 0.47483134405812144, 'support': 46}, 'weighted avg': {'precision': 0.5093167701863354, 'recall': 0.45652173913043476, 'f1-score': 0.4795018162947587, 'support': 46}}
{'C': {'precision': 0.5714285714285714, 'recall': 0.46153846153846156, 'f1-score': 0.5106382978723405, 'support': 26}, 'P': {'precision': 0.42857142857142855, 'recall': 0.45, 'f1-score': 0.4390243902439024, 'support': 20}, 'micro avg': {'precision': 0.5, 'recall': 0.45652173913043476, 'f1-score': 0.47727272727272724, 'support': 46}, 'macro avg': {'precision': 0.5, 'recall': 0.4557692307692308, 'f1-score': 0.47483134405812144, 'support': 46}, 'weighted avg': {'precision': 0.5093167701863354, 'recall': 0.45652173913043476, 'f1-score': 0.4795018162947587, 'support': 46}}
Dev-Data: Prec: 0.500, Rec: 0.457, F1: 0.4773
{'C': {'precision': 0.1987179487179487, 'recall': 0.14832535885167464, 'f1-score': 0.16986301369863016, 'support': 418}, 'P': {'precision': 0.25, 'recall': 0.2684563758389262, 'f1-score': 0.2588996763754045, 'support': 447}, 'micro avg': {'precision': 0.2297979797979798, 'recall': 0.21040462427745665, 'f1-score': 0.21967410983705496, 'support': 865}, 'macro avg': {'precision': 0.22435897435897434, 'recall': 0.2083908673453004, 'f1-score': 0.21438134503701733, 'support': 865}, 'weighted avg': {'precision': 0.2252186156810434, 'recall': 0.21040462427745665, 'f1-score': 0.21587386712813092, 'support': 865}}
Wrong BIO-Encoding 229/1005 labels, 22.79%
{'C': {'precision': 0.1987179487179487, 'recall': 0.14832535885167464, 'f1-score': 0.16986301369863016, 'support': 418}, 'P': {'precision': 0.25, 'recall': 0.2684563758389262, 'f1-score': 0.2588996763754045, 'support': 447}, 'micro avg': {'precision': 0.2297979797979798, 'recall': 0.21040462427745665, 'f1-score': 0.21967410983705496, 'support': 865}, 'macro avg': {'precision': 0.22435897435897434, 'recall': 0.2083908673453004, 'f1-score': 0.21438134503701733, 'support': 865}, 'weighted avg': {'precision': 0.2252186156810434, 'recall': 0.21040462427745665, 'f1-score': 0.21587386712813092, 'support': 865}}
Wrong BIO-Encoding 16/792 labels, 2.02%
Test-Data: Prec: 0.235, Rec: 0.210, F1: 0.2218

Scores from epoch with best dev-scores:
  Dev-Score: 0.5412
  Test-Score 0.2183

4.82 sec for evaluation

--------- Epoch 28 -----------
310.02 sec for training (8717.16 total)
-- cmv_modes1 --
{'C': {'precision': 0.6666666666666666, 'recall': 0.5384615384615384, 'f1-score': 0.5957446808510638, 'support': 26}, 'P': {'precision': 0.45454545454545453, 'recall': 0.5, 'f1-score': 0.47619047619047616, 'support': 20}, 'micro avg': {'precision': 0.5581395348837209, 'recall': 0.5217391304347826, 'f1-score': 0.5393258426966292, 'support': 46}, 'macro avg': {'precision': 0.5606060606060606, 'recall': 0.5192307692307692, 'f1-score': 0.53596757852077, 'support': 46}, 'weighted avg': {'precision': 0.5744400527009222, 'recall': 0.5217391304347826, 'f1-score': 0.5437645918681997, 'support': 46}}
{'C': {'precision': 0.6666666666666666, 'recall': 0.5384615384615384, 'f1-score': 0.5957446808510638, 'support': 26}, 'P': {'precision': 0.45454545454545453, 'recall': 0.5, 'f1-score': 0.47619047619047616, 'support': 20}, 'micro avg': {'precision': 0.5581395348837209, 'recall': 0.5217391304347826, 'f1-score': 0.5393258426966292, 'support': 46}, 'macro avg': {'precision': 0.5606060606060606, 'recall': 0.5192307692307692, 'f1-score': 0.53596757852077, 'support': 46}, 'weighted avg': {'precision': 0.5744400527009222, 'recall': 0.5217391304347826, 'f1-score': 0.5437645918681997, 'support': 46}}
Dev-Data: Prec: 0.558, Rec: 0.522, F1: 0.5393
{'C': {'precision': 0.15680473372781065, 'recall': 0.12679425837320574, 'f1-score': 0.14021164021164023, 'support': 418}, 'P': {'precision': 0.24439918533604887, 'recall': 0.2684563758389262, 'f1-score': 0.25586353944562906, 'support': 447}, 'micro avg': {'precision': 0.20868516284680338, 'recall': 0.2, 'f1-score': 0.20425029515938606, 'support': 865}, 'macro avg': {'precision': 0.20060195953192977, 'recall': 0.19762531710606596, 'f1-score': 0.19803758982863465, 'support': 865}, 'weighted avg': {'precision': 0.20207030583056498, 'recall': 0.2, 'f1-score': 0.19997626328400211, 'support': 865}}
Wrong BIO-Encoding 144/964 labels, 14.94%
{'C': {'precision': 0.15680473372781065, 'recall': 0.12679425837320574, 'f1-score': 0.14021164021164023, 'support': 418}, 'P': {'precision': 0.24439918533604887, 'recall': 0.2684563758389262, 'f1-score': 0.25586353944562906, 'support': 447}, 'micro avg': {'precision': 0.20868516284680338, 'recall': 0.2, 'f1-score': 0.20425029515938606, 'support': 865}, 'macro avg': {'precision': 0.20060195953192977, 'recall': 0.19762531710606596, 'f1-score': 0.19803758982863465, 'support': 865}, 'weighted avg': {'precision': 0.20207030583056498, 'recall': 0.2, 'f1-score': 0.19997626328400211, 'support': 865}}
Wrong BIO-Encoding 9/829 labels, 1.09%
Test-Data: Prec: 0.211, Rec: 0.200, F1: 0.2053

Scores from epoch with best dev-scores:
  Dev-Score: 0.5412
  Test-Score 0.2183

4.83 sec for evaluation

--------- Epoch 29 -----------
307.51 sec for training (9024.66 total)
-- cmv_modes1 --
{'C': {'precision': 0.6666666666666666, 'recall': 0.46153846153846156, 'f1-score': 0.5454545454545455, 'support': 26}, 'P': {'precision': 0.47619047619047616, 'recall': 0.5, 'f1-score': 0.4878048780487805, 'support': 20}, 'micro avg': {'precision': 0.5641025641025641, 'recall': 0.4782608695652174, 'f1-score': 0.5176470588235293, 'support': 46}, 'macro avg': {'precision': 0.5714285714285714, 'recall': 0.4807692307692308, 'f1-score': 0.516629711751663, 'support': 46}, 'weighted avg': {'precision': 0.5838509316770185, 'recall': 0.4782608695652174, 'f1-score': 0.5203894726694303, 'support': 46}}
{'C': {'precision': 0.6666666666666666, 'recall': 0.46153846153846156, 'f1-score': 0.5454545454545455, 'support': 26}, 'P': {'precision': 0.47619047619047616, 'recall': 0.5, 'f1-score': 0.4878048780487805, 'support': 20}, 'micro avg': {'precision': 0.5641025641025641, 'recall': 0.4782608695652174, 'f1-score': 0.5176470588235293, 'support': 46}, 'macro avg': {'precision': 0.5714285714285714, 'recall': 0.4807692307692308, 'f1-score': 0.516629711751663, 'support': 46}, 'weighted avg': {'precision': 0.5838509316770185, 'recall': 0.4782608695652174, 'f1-score': 0.5203894726694303, 'support': 46}}
Dev-Data: Prec: 0.564, Rec: 0.478, F1: 0.5176
{'C': {'precision': 0.1930379746835443, 'recall': 0.145933014354067, 'f1-score': 0.16621253405994552, 'support': 418}, 'P': {'precision': 0.2375296912114014, 'recall': 0.22371364653243847, 'f1-score': 0.23041474654377883, 'support': 447}, 'micro avg': {'precision': 0.21845318860244234, 'recall': 0.1861271676300578, 'f1-score': 0.20099875156054933, 'support': 865}, 'macro avg': {'precision': 0.21528383294747286, 'recall': 0.18482333044325272, 'f1-score': 0.19831364030186216, 'support': 865}, 'weighted avg': {'precision': 0.21602964784880688, 'recall': 0.1861271676300578, 'f1-score': 0.19938986236083975, 'support': 865}}
Wrong BIO-Encoding 452/1164 labels, 38.83%
{'C': {'precision': 0.1930379746835443, 'recall': 0.145933014354067, 'f1-score': 0.16621253405994552, 'support': 418}, 'P': {'precision': 0.2375296912114014, 'recall': 0.22371364653243847, 'f1-score': 0.23041474654377883, 'support': 447}, 'micro avg': {'precision': 0.21845318860244234, 'recall': 0.1861271676300578, 'f1-score': 0.20099875156054933, 'support': 865}, 'macro avg': {'precision': 0.21528383294747286, 'recall': 0.18482333044325272, 'f1-score': 0.19831364030186216, 'support': 865}, 'weighted avg': {'precision': 0.21602964784880688, 'recall': 0.1861271676300578, 'f1-score': 0.19938986236083975, 'support': 865}}
Wrong BIO-Encoding 25/737 labels, 3.39%
Test-Data: Prec: 0.226, Rec: 0.186, F1: 0.2042

Scores from epoch with best dev-scores:
  Dev-Score: 0.5412
  Test-Score 0.2183

4.86 sec for evaluation

--------- Epoch 30 -----------
309.40 sec for training (9334.07 total)
-- cmv_modes1 --
{'C': {'precision': 0.6153846153846154, 'recall': 0.6153846153846154, 'f1-score': 0.6153846153846154, 'support': 26}, 'P': {'precision': 0.5, 'recall': 0.45, 'f1-score': 0.4736842105263158, 'support': 20}, 'micro avg': {'precision': 0.5681818181818182, 'recall': 0.5434782608695652, 'f1-score': 0.5555555555555556, 'support': 46}, 'macro avg': {'precision': 0.5576923076923077, 'recall': 0.5326923076923077, 'f1-score': 0.5445344129554657, 'support': 46}, 'weighted avg': {'precision': 0.5652173913043478, 'recall': 0.5434782608695652, 'f1-score': 0.5537757437070938, 'support': 46}}
{'C': {'precision': 0.6153846153846154, 'recall': 0.6153846153846154, 'f1-score': 0.6153846153846154, 'support': 26}, 'P': {'precision': 0.5, 'recall': 0.45, 'f1-score': 0.4736842105263158, 'support': 20}, 'micro avg': {'precision': 0.5681818181818182, 'recall': 0.5434782608695652, 'f1-score': 0.5555555555555556, 'support': 46}, 'macro avg': {'precision': 0.5576923076923077, 'recall': 0.5326923076923077, 'f1-score': 0.5445344129554657, 'support': 46}, 'weighted avg': {'precision': 0.5652173913043478, 'recall': 0.5434782608695652, 'f1-score': 0.5537757437070938, 'support': 46}}
Dev-Data: Prec: 0.568, Rec: 0.543, F1: 0.5556
{'C': {'precision': 0.21678321678321677, 'recall': 0.14832535885167464, 'f1-score': 0.17613636363636365, 'support': 418}, 'P': {'precision': 0.24737945492662475, 'recall': 0.2639821029082774, 'f1-score': 0.2554112554112554, 'support': 447}, 'micro avg': {'precision': 0.23591087811271297, 'recall': 0.20809248554913296, 'f1-score': 0.22113022113022116, 'support': 865}, 'macro avg': {'precision': 0.23208133585492075, 'recall': 0.20615373087997602, 'f1-score': 0.21577380952380953, 'support': 865}, 'weighted avg': {'precision': 0.23259422077177558, 'recall': 0.20809248554913296, 'f1-score': 0.21710269499286838, 'support': 865}}
Wrong BIO-Encoding 351/1095 labels, 32.05%
{'C': {'precision': 0.21678321678321677, 'recall': 0.14832535885167464, 'f1-score': 0.17613636363636365, 'support': 418}, 'P': {'precision': 0.24737945492662475, 'recall': 0.2639821029082774, 'f1-score': 0.2554112554112554, 'support': 447}, 'micro avg': {'precision': 0.23591087811271297, 'recall': 0.20809248554913296, 'f1-score': 0.22113022113022116, 'support': 865}, 'macro avg': {'precision': 0.23208133585492075, 'recall': 0.20615373087997602, 'f1-score': 0.21577380952380953, 'support': 865}, 'weighted avg': {'precision': 0.23259422077177558, 'recall': 0.20809248554913296, 'f1-score': 0.21710269499286838, 'support': 865}}
Wrong BIO-Encoding 19/763 labels, 2.49%
Test-Data: Prec: 0.242, Rec: 0.208, F1: 0.2237

Scores from epoch with best dev-scores:
  Dev-Score: 0.5556
  Test-Score 0.2237

5.38 sec for evaluation

--------- Epoch 31 -----------
309.97 sec for training (9644.03 total)
-- cmv_modes1 --
{'C': {'precision': 0.5217391304347826, 'recall': 0.46153846153846156, 'f1-score': 0.4897959183673469, 'support': 26}, 'P': {'precision': 0.43478260869565216, 'recall': 0.5, 'f1-score': 0.46511627906976744, 'support': 20}, 'micro avg': {'precision': 0.4782608695652174, 'recall': 0.4782608695652174, 'f1-score': 0.4782608695652174, 'support': 46}, 'macro avg': {'precision': 0.4782608695652174, 'recall': 0.4807692307692308, 'f1-score': 0.4774560987185572, 'support': 46}, 'weighted avg': {'precision': 0.4839319470699433, 'recall': 0.4782608695652174, 'f1-score': 0.47906564041187755, 'support': 46}}
{'C': {'precision': 0.5217391304347826, 'recall': 0.46153846153846156, 'f1-score': 0.4897959183673469, 'support': 26}, 'P': {'precision': 0.43478260869565216, 'recall': 0.5, 'f1-score': 0.46511627906976744, 'support': 20}, 'micro avg': {'precision': 0.4782608695652174, 'recall': 0.4782608695652174, 'f1-score': 0.4782608695652174, 'support': 46}, 'macro avg': {'precision': 0.4782608695652174, 'recall': 0.4807692307692308, 'f1-score': 0.4774560987185572, 'support': 46}, 'weighted avg': {'precision': 0.4839319470699433, 'recall': 0.4782608695652174, 'f1-score': 0.47906564041187755, 'support': 46}}
Dev-Data: Prec: 0.478, Rec: 0.478, F1: 0.4783
{'C': {'precision': 0.17891373801916932, 'recall': 0.1339712918660287, 'f1-score': 0.15321477428180574, 'support': 418}, 'P': {'precision': 0.23700623700623702, 'recall': 0.2550335570469799, 'f1-score': 0.2456896551724138, 'support': 447}, 'micro avg': {'precision': 0.2141057934508816, 'recall': 0.19653179190751446, 'f1-score': 0.20494273658830622, 'support': 865}, 'macro avg': {'precision': 0.20795998751270317, 'recall': 0.19450242445650429, 'f1-score': 0.19945221472710978, 'support': 865}, 'weighted avg': {'precision': 0.2089337924090182, 'recall': 0.19653179190751446, 'f1-score': 0.20100237169001592, 'support': 865}}
Wrong BIO-Encoding 295/1075 labels, 27.44%
{'C': {'precision': 0.17891373801916932, 'recall': 0.1339712918660287, 'f1-score': 0.15321477428180574, 'support': 418}, 'P': {'precision': 0.23700623700623702, 'recall': 0.2550335570469799, 'f1-score': 0.2456896551724138, 'support': 447}, 'micro avg': {'precision': 0.2141057934508816, 'recall': 0.19653179190751446, 'f1-score': 0.20494273658830622, 'support': 865}, 'macro avg': {'precision': 0.20795998751270317, 'recall': 0.19450242445650429, 'f1-score': 0.19945221472710978, 'support': 865}, 'weighted avg': {'precision': 0.2089337924090182, 'recall': 0.19653179190751446, 'f1-score': 0.20100237169001592, 'support': 865}}
Wrong BIO-Encoding 14/794 labels, 1.76%
Test-Data: Prec: 0.218, Rec: 0.197, F1: 0.2067

Scores from epoch with best dev-scores:
  Dev-Score: 0.5556
  Test-Score 0.2237

4.89 sec for evaluation

--------- Epoch 32 -----------
309.11 sec for training (9953.14 total)
-- cmv_modes1 --
{'C': {'precision': 0.5714285714285714, 'recall': 0.6153846153846154, 'f1-score': 0.5925925925925927, 'support': 26}, 'P': {'precision': 0.4375, 'recall': 0.35, 'f1-score': 0.38888888888888884, 'support': 20}, 'micro avg': {'precision': 0.5227272727272727, 'recall': 0.5, 'f1-score': 0.5111111111111111, 'support': 46}, 'macro avg': {'precision': 0.5044642857142857, 'recall': 0.4826923076923077, 'f1-score': 0.49074074074074076, 'support': 46}, 'weighted avg': {'precision': 0.513198757763975, 'recall': 0.5, 'f1-score': 0.5040257648953301, 'support': 46}}
{'C': {'precision': 0.5714285714285714, 'recall': 0.6153846153846154, 'f1-score': 0.5925925925925927, 'support': 26}, 'P': {'precision': 0.4375, 'recall': 0.35, 'f1-score': 0.38888888888888884, 'support': 20}, 'micro avg': {'precision': 0.5227272727272727, 'recall': 0.5, 'f1-score': 0.5111111111111111, 'support': 46}, 'macro avg': {'precision': 0.5044642857142857, 'recall': 0.4826923076923077, 'f1-score': 0.49074074074074076, 'support': 46}, 'weighted avg': {'precision': 0.513198757763975, 'recall': 0.5, 'f1-score': 0.5040257648953301, 'support': 46}}
Dev-Data: Prec: 0.523, Rec: 0.500, F1: 0.5111
{'C': {'precision': 0.1606714628297362, 'recall': 0.16028708133971292, 'f1-score': 0.16047904191616766, 'support': 418}, 'P': {'precision': 0.2872628726287263, 'recall': 0.2371364653243848, 'f1-score': 0.25980392156862747, 'support': 447}, 'micro avg': {'precision': 0.22010178117048346, 'recall': 0.2, 'f1-score': 0.2095699576014537, 'support': 865}, 'macro avg': {'precision': 0.22396716772923125, 'recall': 0.19871177333204887, 'f1-score': 0.21014148174239755, 'support': 865}, 'weighted avg': {'precision': 0.226089220263434, 'recall': 0.2, 'f1-score': 0.211806465274144, 'support': 865}}
Wrong BIO-Encoding 342/1111 labels, 30.78%
{'C': {'precision': 0.1606714628297362, 'recall': 0.16028708133971292, 'f1-score': 0.16047904191616766, 'support': 418}, 'P': {'precision': 0.2872628726287263, 'recall': 0.2371364653243848, 'f1-score': 0.25980392156862747, 'support': 447}, 'micro avg': {'precision': 0.22010178117048346, 'recall': 0.2, 'f1-score': 0.2095699576014537, 'support': 865}, 'macro avg': {'precision': 0.22396716772923125, 'recall': 0.19871177333204887, 'f1-score': 0.21014148174239755, 'support': 865}, 'weighted avg': {'precision': 0.226089220263434, 'recall': 0.2, 'f1-score': 0.211806465274144, 'support': 865}}
Wrong BIO-Encoding 17/786 labels, 2.16%
Test-Data: Prec: 0.225, Rec: 0.200, F1: 0.2118

Scores from epoch with best dev-scores:
  Dev-Score: 0.5556
  Test-Score 0.2237

4.90 sec for evaluation

--------- Epoch 33 -----------
311.48 sec for training (10264.62 total)
-- cmv_modes1 --
{'C': {'precision': 0.6206896551724138, 'recall': 0.6923076923076923, 'f1-score': 0.6545454545454545, 'support': 26}, 'P': {'precision': 0.5, 'recall': 0.45, 'f1-score': 0.4736842105263158, 'support': 20}, 'micro avg': {'precision': 0.574468085106383, 'recall': 0.5869565217391305, 'f1-score': 0.5806451612903226, 'support': 46}, 'macro avg': {'precision': 0.5603448275862069, 'recall': 0.5711538461538461, 'f1-score': 0.5641148325358851, 'support': 46}, 'weighted avg': {'precision': 0.568215892053973, 'recall': 0.5869565217391305, 'f1-score': 0.5759101310588726, 'support': 46}}
{'C': {'precision': 0.6206896551724138, 'recall': 0.6923076923076923, 'f1-score': 0.6545454545454545, 'support': 26}, 'P': {'precision': 0.5, 'recall': 0.45, 'f1-score': 0.4736842105263158, 'support': 20}, 'micro avg': {'precision': 0.574468085106383, 'recall': 0.5869565217391305, 'f1-score': 0.5806451612903226, 'support': 46}, 'macro avg': {'precision': 0.5603448275862069, 'recall': 0.5711538461538461, 'f1-score': 0.5641148325358851, 'support': 46}, 'weighted avg': {'precision': 0.568215892053973, 'recall': 0.5869565217391305, 'f1-score': 0.5759101310588726, 'support': 46}}
Dev-Data: Prec: 0.574, Rec: 0.587, F1: 0.5806
{'C': {'precision': 0.17525773195876287, 'recall': 0.16267942583732056, 'f1-score': 0.16873449131513646, 'support': 418}, 'P': {'precision': 0.2085201793721973, 'recall': 0.2080536912751678, 'f1-score': 0.20828667413213886, 'support': 447}, 'micro avg': {'precision': 0.19304556354916066, 'recall': 0.1861271676300578, 'f1-score': 0.18952324896998232, 'support': 865}, 'macro avg': {'precision': 0.1918889556654801, 'recall': 0.18536655855624418, 'f1-score': 0.18851058272363766, 'support': 865}, 'weighted avg': {'precision': 0.19244653426373998, 'recall': 0.1861271676300578, 'f1-score': 0.1891735961928244, 'support': 865}}
Wrong BIO-Encoding 146/969 labels, 15.07%
{'C': {'precision': 0.17525773195876287, 'recall': 0.16267942583732056, 'f1-score': 0.16873449131513646, 'support': 418}, 'P': {'precision': 0.2085201793721973, 'recall': 0.2080536912751678, 'f1-score': 0.20828667413213886, 'support': 447}, 'micro avg': {'precision': 0.19304556354916066, 'recall': 0.1861271676300578, 'f1-score': 0.18952324896998232, 'support': 865}, 'macro avg': {'precision': 0.1918889556654801, 'recall': 0.18536655855624418, 'f1-score': 0.18851058272363766, 'support': 865}, 'weighted avg': {'precision': 0.19244653426373998, 'recall': 0.1861271676300578, 'f1-score': 0.1891735961928244, 'support': 865}}
Wrong BIO-Encoding 11/834 labels, 1.32%
Test-Data: Prec: 0.196, Rec: 0.186, F1: 0.1908

Scores from epoch with best dev-scores:
  Dev-Score: 0.5806
  Test-Score 0.1908

5.58 sec for evaluation

--------- Epoch 34 -----------
309.81 sec for training (10574.42 total)
-- cmv_modes1 --
{'C': {'precision': 0.5714285714285714, 'recall': 0.6153846153846154, 'f1-score': 0.5925925925925927, 'support': 26}, 'P': {'precision': 0.5, 'recall': 0.5, 'f1-score': 0.5, 'support': 20}, 'micro avg': {'precision': 0.5416666666666666, 'recall': 0.5652173913043478, 'f1-score': 0.5531914893617021, 'support': 46}, 'macro avg': {'precision': 0.5357142857142857, 'recall': 0.5576923076923077, 'f1-score': 0.5462962962962963, 'support': 46}, 'weighted avg': {'precision': 0.5403726708074533, 'recall': 0.5652173913043478, 'f1-score': 0.5523349436392916, 'support': 46}}
{'C': {'precision': 0.5714285714285714, 'recall': 0.6153846153846154, 'f1-score': 0.5925925925925927, 'support': 26}, 'P': {'precision': 0.5, 'recall': 0.5, 'f1-score': 0.5, 'support': 20}, 'micro avg': {'precision': 0.5416666666666666, 'recall': 0.5652173913043478, 'f1-score': 0.5531914893617021, 'support': 46}, 'macro avg': {'precision': 0.5357142857142857, 'recall': 0.5576923076923077, 'f1-score': 0.5462962962962963, 'support': 46}, 'weighted avg': {'precision': 0.5403726708074533, 'recall': 0.5652173913043478, 'f1-score': 0.5523349436392916, 'support': 46}}
Dev-Data: Prec: 0.542, Rec: 0.565, F1: 0.5532
{'C': {'precision': 0.21221864951768488, 'recall': 0.15789473684210525, 'f1-score': 0.1810699588477366, 'support': 418}, 'P': {'precision': 0.2018348623853211, 'recall': 0.24608501118568232, 'f1-score': 0.2217741935483871, 'support': 447}, 'micro avg': {'precision': 0.205607476635514, 'recall': 0.20346820809248556, 'f1-score': 0.20453224869262057, 'support': 865}, 'macro avg': {'precision': 0.207026755951503, 'recall': 0.2019898740138938, 'f1-score': 0.20142207619806185, 'support': 865}, 'weighted avg': {'precision': 0.2068526924677813, 'recall': 0.20346820809248556, 'f1-score': 0.20210440151963344, 'support': 865}}
Wrong BIO-Encoding 25/878 labels, 2.85%
{'C': {'precision': 0.21221864951768488, 'recall': 0.15789473684210525, 'f1-score': 0.1810699588477366, 'support': 418}, 'P': {'precision': 0.2018348623853211, 'recall': 0.24608501118568232, 'f1-score': 0.2217741935483871, 'support': 447}, 'micro avg': {'precision': 0.205607476635514, 'recall': 0.20346820809248556, 'f1-score': 0.20453224869262057, 'support': 865}, 'macro avg': {'precision': 0.207026755951503, 'recall': 0.2019898740138938, 'f1-score': 0.20142207619806185, 'support': 865}, 'weighted avg': {'precision': 0.2068526924677813, 'recall': 0.20346820809248556, 'f1-score': 0.20210440151963344, 'support': 865}}
Wrong BIO-Encoding 3/856 labels, 0.35%
Test-Data: Prec: 0.206, Rec: 0.203, F1: 0.2049

Scores from epoch with best dev-scores:
  Dev-Score: 0.5806
  Test-Score 0.1908

4.87 sec for evaluation

--------- Epoch 35 -----------
309.31 sec for training (10883.74 total)
-- cmv_modes1 --
{'C': {'precision': 0.6842105263157895, 'recall': 0.5, 'f1-score': 0.5777777777777778, 'support': 26}, 'P': {'precision': 0.38095238095238093, 'recall': 0.4, 'f1-score': 0.3902439024390244, 'support': 20}, 'micro avg': {'precision': 0.525, 'recall': 0.45652173913043476, 'f1-score': 0.48837209302325585, 'support': 46}, 'macro avg': {'precision': 0.5325814536340852, 'recall': 0.45, 'f1-score': 0.4840108401084011, 'support': 46}, 'weighted avg': {'precision': 0.5523591587664815, 'recall': 0.45652173913043476, 'f1-score': 0.49624131023918944, 'support': 46}}
{'C': {'precision': 0.6842105263157895, 'recall': 0.5, 'f1-score': 0.5777777777777778, 'support': 26}, 'P': {'precision': 0.38095238095238093, 'recall': 0.4, 'f1-score': 0.3902439024390244, 'support': 20}, 'micro avg': {'precision': 0.525, 'recall': 0.45652173913043476, 'f1-score': 0.48837209302325585, 'support': 46}, 'macro avg': {'precision': 0.5325814536340852, 'recall': 0.45, 'f1-score': 0.4840108401084011, 'support': 46}, 'weighted avg': {'precision': 0.5523591587664815, 'recall': 0.45652173913043476, 'f1-score': 0.49624131023918944, 'support': 46}}
Dev-Data: Prec: 0.525, Rec: 0.457, F1: 0.4884
{'C': {'precision': 0.23684210526315788, 'recall': 0.1507177033492823, 'f1-score': 0.18421052631578946, 'support': 418}, 'P': {'precision': 0.23333333333333334, 'recall': 0.2505592841163311, 'f1-score': 0.24163969795037757, 'support': 447}, 'micro avg': {'precision': 0.23458445040214476, 'recall': 0.2023121387283237, 'f1-score': 0.21725636250775915, 'support': 865}, 'macro avg': {'precision': 0.23508771929824562, 'recall': 0.2006384937328067, 'f1-score': 0.21292511213308352, 'support': 865}, 'weighted avg': {'precision': 0.23502890173410407, 'recall': 0.2023121387283237, 'f1-score': 0.21388779766915467, 'support': 865}}
Wrong BIO-Encoding 314/1045 labels, 30.05%
{'C': {'precision': 0.23684210526315788, 'recall': 0.1507177033492823, 'f1-score': 0.18421052631578946, 'support': 418}, 'P': {'precision': 0.23333333333333334, 'recall': 0.2505592841163311, 'f1-score': 0.24163969795037757, 'support': 447}, 'micro avg': {'precision': 0.23458445040214476, 'recall': 0.2023121387283237, 'f1-score': 0.21725636250775915, 'support': 865}, 'macro avg': {'precision': 0.23508771929824562, 'recall': 0.2006384937328067, 'f1-score': 0.21292511213308352, 'support': 865}, 'weighted avg': {'precision': 0.23502890173410407, 'recall': 0.2023121387283237, 'f1-score': 0.21388779766915467, 'support': 865}}
Wrong BIO-Encoding 15/746 labels, 2.01%
Test-Data: Prec: 0.239, Rec: 0.202, F1: 0.2193

Scores from epoch with best dev-scores:
  Dev-Score: 0.5806
  Test-Score 0.1908

4.79 sec for evaluation

--------- Epoch 36 -----------
309.80 sec for training (11193.54 total)
-- cmv_modes1 --
{'C': {'precision': 0.64, 'recall': 0.6153846153846154, 'f1-score': 0.6274509803921569, 'support': 26}, 'P': {'precision': 0.5263157894736842, 'recall': 0.5, 'f1-score': 0.5128205128205129, 'support': 20}, 'micro avg': {'precision': 0.5909090909090909, 'recall': 0.5652173913043478, 'f1-score': 0.5777777777777778, 'support': 46}, 'macro avg': {'precision': 0.5831578947368421, 'recall': 0.5576923076923077, 'f1-score': 0.5701357466063348, 'support': 46}, 'weighted avg': {'precision': 0.5905720823798627, 'recall': 0.5652173913043478, 'f1-score': 0.577611646665355, 'support': 46}}
{'C': {'precision': 0.64, 'recall': 0.6153846153846154, 'f1-score': 0.6274509803921569, 'support': 26}, 'P': {'precision': 0.5263157894736842, 'recall': 0.5, 'f1-score': 0.5128205128205129, 'support': 20}, 'micro avg': {'precision': 0.5909090909090909, 'recall': 0.5652173913043478, 'f1-score': 0.5777777777777778, 'support': 46}, 'macro avg': {'precision': 0.5831578947368421, 'recall': 0.5576923076923077, 'f1-score': 0.5701357466063348, 'support': 46}, 'weighted avg': {'precision': 0.5905720823798627, 'recall': 0.5652173913043478, 'f1-score': 0.577611646665355, 'support': 46}}
Dev-Data: Prec: 0.591, Rec: 0.565, F1: 0.5778
{'C': {'precision': 0.17721518987341772, 'recall': 0.1339712918660287, 'f1-score': 0.15258855585831063, 'support': 418}, 'P': {'precision': 0.21428571428571427, 'recall': 0.22818791946308725, 'f1-score': 0.22101841820151677, 'support': 447}, 'micro avg': {'precision': 0.1994949494949495, 'recall': 0.18265895953757225, 'f1-score': 0.19070609535304767, 'support': 865}, 'macro avg': {'precision': 0.19575045207956598, 'recall': 0.181079605664558, 'f1-score': 0.1868034870299137, 'support': 865}, 'weighted avg': {'precision': 0.1963718654945698, 'recall': 0.18265895953757225, 'f1-score': 0.1879505772079212, 'support': 865}}
Wrong BIO-Encoding 322/1103 labels, 29.19%
{'C': {'precision': 0.17721518987341772, 'recall': 0.1339712918660287, 'f1-score': 0.15258855585831063, 'support': 418}, 'P': {'precision': 0.21428571428571427, 'recall': 0.22818791946308725, 'f1-score': 0.22101841820151677, 'support': 447}, 'micro avg': {'precision': 0.1994949494949495, 'recall': 0.18265895953757225, 'f1-score': 0.19070609535304767, 'support': 865}, 'macro avg': {'precision': 0.19575045207956598, 'recall': 0.181079605664558, 'f1-score': 0.1868034870299137, 'support': 865}, 'weighted avg': {'precision': 0.1963718654945698, 'recall': 0.18265895953757225, 'f1-score': 0.1879505772079212, 'support': 865}}
Wrong BIO-Encoding 11/792 labels, 1.39%
Test-Data: Prec: 0.202, Rec: 0.183, F1: 0.1920

Scores from epoch with best dev-scores:
  Dev-Score: 0.5806
  Test-Score 0.1908

4.76 sec for evaluation

--------- Epoch 37 -----------
310.26 sec for training (11503.79 total)
-- cmv_modes1 --
{'C': {'precision': 0.5769230769230769, 'recall': 0.5769230769230769, 'f1-score': 0.5769230769230769, 'support': 26}, 'P': {'precision': 0.3888888888888889, 'recall': 0.35, 'f1-score': 0.36842105263157887, 'support': 20}, 'micro avg': {'precision': 0.5, 'recall': 0.4782608695652174, 'f1-score': 0.4888888888888889, 'support': 46}, 'macro avg': {'precision': 0.48290598290598286, 'recall': 0.4634615384615384, 'f1-score': 0.47267206477732787, 'support': 46}, 'weighted avg': {'precision': 0.4951690821256038, 'recall': 0.4782608695652174, 'f1-score': 0.4862700228832951, 'support': 46}}
{'C': {'precision': 0.5769230769230769, 'recall': 0.5769230769230769, 'f1-score': 0.5769230769230769, 'support': 26}, 'P': {'precision': 0.3888888888888889, 'recall': 0.35, 'f1-score': 0.36842105263157887, 'support': 20}, 'micro avg': {'precision': 0.5, 'recall': 0.4782608695652174, 'f1-score': 0.4888888888888889, 'support': 46}, 'macro avg': {'precision': 0.48290598290598286, 'recall': 0.4634615384615384, 'f1-score': 0.47267206477732787, 'support': 46}, 'weighted avg': {'precision': 0.4951690821256038, 'recall': 0.4782608695652174, 'f1-score': 0.4862700228832951, 'support': 46}}
Dev-Data: Prec: 0.500, Rec: 0.478, F1: 0.4889
{'C': {'precision': 0.192, 'recall': 0.1722488038277512, 'f1-score': 0.18158890290037832, 'support': 418}, 'P': {'precision': 0.2600896860986547, 'recall': 0.2595078299776286, 'f1-score': 0.2597984322508398, 'support': 447}, 'micro avg': {'precision': 0.2289890377588307, 'recall': 0.21734104046242775, 'f1-score': 0.2230130486358244, 'support': 865}, 'macro avg': {'precision': 0.22604484304932734, 'recall': 0.2158783169026899, 'f1-score': 0.22069366757560907, 'support': 865}, 'weighted avg': {'precision': 0.22718623085098108, 'recall': 0.21734104046242775, 'f1-score': 0.22200469436818906, 'support': 865}}
Wrong BIO-Encoding 395/1196 labels, 33.03%
{'C': {'precision': 0.192, 'recall': 0.1722488038277512, 'f1-score': 0.18158890290037832, 'support': 418}, 'P': {'precision': 0.2600896860986547, 'recall': 0.2595078299776286, 'f1-score': 0.2597984322508398, 'support': 447}, 'micro avg': {'precision': 0.2289890377588307, 'recall': 0.21734104046242775, 'f1-score': 0.2230130486358244, 'support': 865}, 'macro avg': {'precision': 0.22604484304932734, 'recall': 0.2158783169026899, 'f1-score': 0.22069366757560907, 'support': 865}, 'weighted avg': {'precision': 0.22718623085098108, 'recall': 0.21734104046242775, 'f1-score': 0.22200469436818906, 'support': 865}}
Wrong BIO-Encoding 20/821 labels, 2.44%
Test-Data: Prec: 0.235, Rec: 0.217, F1: 0.2257

Scores from epoch with best dev-scores:
  Dev-Score: 0.5806
  Test-Score 0.1908

4.96 sec for evaluation

--------- Epoch 38 -----------
310.54 sec for training (11814.33 total)
-- cmv_modes1 --
{'C': {'precision': 0.47368421052631576, 'recall': 0.34615384615384615, 'f1-score': 0.39999999999999997, 'support': 26}, 'P': {'precision': 0.43478260869565216, 'recall': 0.5, 'f1-score': 0.46511627906976744, 'support': 20}, 'micro avg': {'precision': 0.4523809523809524, 'recall': 0.41304347826086957, 'f1-score': 0.4318181818181818, 'support': 46}, 'macro avg': {'precision': 0.45423340961098396, 'recall': 0.4230769230769231, 'f1-score': 0.4325581395348837, 'support': 46}, 'weighted avg': {'precision': 0.45677047059994025, 'recall': 0.41304347826086957, 'f1-score': 0.42831142568250763, 'support': 46}}
{'C': {'precision': 0.47368421052631576, 'recall': 0.34615384615384615, 'f1-score': 0.39999999999999997, 'support': 26}, 'P': {'precision': 0.43478260869565216, 'recall': 0.5, 'f1-score': 0.46511627906976744, 'support': 20}, 'micro avg': {'precision': 0.4523809523809524, 'recall': 0.41304347826086957, 'f1-score': 0.4318181818181818, 'support': 46}, 'macro avg': {'precision': 0.45423340961098396, 'recall': 0.4230769230769231, 'f1-score': 0.4325581395348837, 'support': 46}, 'weighted avg': {'precision': 0.45677047059994025, 'recall': 0.41304347826086957, 'f1-score': 0.42831142568250763, 'support': 46}}
Dev-Data: Prec: 0.452, Rec: 0.413, F1: 0.4318
{'C': {'precision': 0.21201413427561838, 'recall': 0.14354066985645933, 'f1-score': 0.17118402282453637, 'support': 418}, 'P': {'precision': 0.248, 'recall': 0.27740492170022374, 'f1-score': 0.26187961985216474, 'support': 447}, 'micro avg': {'precision': 0.23499361430395913, 'recall': 0.21271676300578035, 'f1-score': 0.2233009708737864, 'support': 865}, 'macro avg': {'precision': 0.2300070671378092, 'recall': 0.21047279577834155, 'f1-score': 0.21653182133835056, 'support': 865}, 'weighted avg': {'precision': 0.23061029841295777, 'recall': 0.21271676300578035, 'f1-score': 0.2180521521555767, 'support': 865}}
Wrong BIO-Encoding 256/1026 labels, 24.95%
{'C': {'precision': 0.21201413427561838, 'recall': 0.14354066985645933, 'f1-score': 0.17118402282453637, 'support': 418}, 'P': {'precision': 0.248, 'recall': 0.27740492170022374, 'f1-score': 0.26187961985216474, 'support': 447}, 'micro avg': {'precision': 0.23499361430395913, 'recall': 0.21271676300578035, 'f1-score': 0.2233009708737864, 'support': 865}, 'macro avg': {'precision': 0.2300070671378092, 'recall': 0.21047279577834155, 'f1-score': 0.21653182133835056, 'support': 865}, 'weighted avg': {'precision': 0.23061029841295777, 'recall': 0.21271676300578035, 'f1-score': 0.2180521521555767, 'support': 865}}
Wrong BIO-Encoding 13/783 labels, 1.66%
Test-Data: Prec: 0.239, Rec: 0.213, F1: 0.2251

Scores from epoch with best dev-scores:
  Dev-Score: 0.5806
  Test-Score 0.1908

4.91 sec for evaluation

--------- Epoch 39 -----------
309.42 sec for training (12123.75 total)
-- cmv_modes1 --
{'C': {'precision': 0.6956521739130435, 'recall': 0.6153846153846154, 'f1-score': 0.6530612244897959, 'support': 26}, 'P': {'precision': 0.6666666666666666, 'recall': 0.6, 'f1-score': 0.631578947368421, 'support': 20}, 'micro avg': {'precision': 0.6829268292682927, 'recall': 0.6086956521739131, 'f1-score': 0.6436781609195402, 'support': 46}, 'macro avg': {'precision': 0.681159420289855, 'recall': 0.6076923076923078, 'f1-score': 0.6423200859291085, 'support': 46}, 'weighted avg': {'precision': 0.683049779458097, 'recall': 0.6086956521739131, 'f1-score': 0.6437211040022416, 'support': 46}}
{'C': {'precision': 0.6956521739130435, 'recall': 0.6153846153846154, 'f1-score': 0.6530612244897959, 'support': 26}, 'P': {'precision': 0.6666666666666666, 'recall': 0.6, 'f1-score': 0.631578947368421, 'support': 20}, 'micro avg': {'precision': 0.6829268292682927, 'recall': 0.6086956521739131, 'f1-score': 0.6436781609195402, 'support': 46}, 'macro avg': {'precision': 0.681159420289855, 'recall': 0.6076923076923078, 'f1-score': 0.6423200859291085, 'support': 46}, 'weighted avg': {'precision': 0.683049779458097, 'recall': 0.6086956521739131, 'f1-score': 0.6437211040022416, 'support': 46}}
Dev-Data: Prec: 0.683, Rec: 0.609, F1: 0.6437
{'C': {'precision': 0.20279720279720279, 'recall': 0.13875598086124402, 'f1-score': 0.1647727272727273, 'support': 418}, 'P': {'precision': 0.22007722007722008, 'recall': 0.2550335570469799, 'f1-score': 0.23626943005181347, 'support': 447}, 'micro avg': {'precision': 0.21393034825870647, 'recall': 0.19884393063583816, 'f1-score': 0.20611144397843018, 'support': 865}, 'macro avg': {'precision': 0.21143721143721145, 'recall': 0.19689476895411195, 'f1-score': 0.20052107866227037, 'support': 865}, 'weighted avg': {'precision': 0.21172687646676086, 'recall': 0.19884393063583816, 'f1-score': 0.20171957830423193, 'support': 865}}
Wrong BIO-Encoding 238/1023 labels, 23.26%
{'C': {'precision': 0.20279720279720279, 'recall': 0.13875598086124402, 'f1-score': 0.1647727272727273, 'support': 418}, 'P': {'precision': 0.22007722007722008, 'recall': 0.2550335570469799, 'f1-score': 0.23626943005181347, 'support': 447}, 'micro avg': {'precision': 0.21393034825870647, 'recall': 0.19884393063583816, 'f1-score': 0.20611144397843018, 'support': 865}, 'macro avg': {'precision': 0.21143721143721145, 'recall': 0.19689476895411195, 'f1-score': 0.20052107866227037, 'support': 865}, 'weighted avg': {'precision': 0.21172687646676086, 'recall': 0.19884393063583816, 'f1-score': 0.20171957830423193, 'support': 865}}
Wrong BIO-Encoding 19/804 labels, 2.36%
Test-Data: Prec: 0.218, Rec: 0.198, F1: 0.2073

Scores from epoch with best dev-scores:
  Dev-Score: 0.6437
  Test-Score 0.2073

5.52 sec for evaluation

--------- Epoch 40 -----------
311.20 sec for training (12434.95 total)
-- cmv_modes1 --
{'C': {'precision': 0.5217391304347826, 'recall': 0.46153846153846156, 'f1-score': 0.4897959183673469, 'support': 26}, 'P': {'precision': 0.45454545454545453, 'recall': 0.5, 'f1-score': 0.47619047619047616, 'support': 20}, 'micro avg': {'precision': 0.4888888888888889, 'recall': 0.4782608695652174, 'f1-score': 0.4835164835164835, 'support': 46}, 'macro avg': {'precision': 0.48814229249011853, 'recall': 0.4807692307692308, 'f1-score': 0.48299319727891155, 'support': 46}, 'weighted avg': {'precision': 0.49252448874377036, 'recall': 0.4782608695652174, 'f1-score': 0.4838805087252292, 'support': 46}}
{'C': {'precision': 0.5217391304347826, 'recall': 0.46153846153846156, 'f1-score': 0.4897959183673469, 'support': 26}, 'P': {'precision': 0.45454545454545453, 'recall': 0.5, 'f1-score': 0.47619047619047616, 'support': 20}, 'micro avg': {'precision': 0.4888888888888889, 'recall': 0.4782608695652174, 'f1-score': 0.4835164835164835, 'support': 46}, 'macro avg': {'precision': 0.48814229249011853, 'recall': 0.4807692307692308, 'f1-score': 0.48299319727891155, 'support': 46}, 'weighted avg': {'precision': 0.49252448874377036, 'recall': 0.4782608695652174, 'f1-score': 0.4838805087252292, 'support': 46}}
Dev-Data: Prec: 0.489, Rec: 0.478, F1: 0.4835
{'C': {'precision': 0.16878980891719744, 'recall': 0.12679425837320574, 'f1-score': 0.1448087431693989, 'support': 418}, 'P': {'precision': 0.2531914893617021, 'recall': 0.2662192393736018, 'f1-score': 0.2595419847328244, 'support': 447}, 'micro avg': {'precision': 0.2193877551020408, 'recall': 0.19884393063583816, 'f1-score': 0.20861127956337175, 'support': 865}, 'macro avg': {'precision': 0.21099064913944976, 'recall': 0.19650674887340377, 'f1-score': 0.20217536395111166, 'support': 865}, 'weighted avg': {'precision': 0.212405474996612, 'recall': 0.19884393063583816, 'f1-score': 0.2040986379426373, 'support': 865}}
Wrong BIO-Encoding 272/1044 labels, 26.05%
{'C': {'precision': 0.16878980891719744, 'recall': 0.12679425837320574, 'f1-score': 0.1448087431693989, 'support': 418}, 'P': {'precision': 0.2531914893617021, 'recall': 0.2662192393736018, 'f1-score': 0.2595419847328244, 'support': 447}, 'micro avg': {'precision': 0.2193877551020408, 'recall': 0.19884393063583816, 'f1-score': 0.20861127956337175, 'support': 865}, 'macro avg': {'precision': 0.21099064913944976, 'recall': 0.19650674887340377, 'f1-score': 0.20217536395111166, 'support': 865}, 'weighted avg': {'precision': 0.212405474996612, 'recall': 0.19884393063583816, 'f1-score': 0.2040986379426373, 'support': 865}}
Wrong BIO-Encoding 12/784 labels, 1.53%
Test-Data: Prec: 0.223, Rec: 0.199, F1: 0.2101

Scores from epoch with best dev-scores:
  Dev-Score: 0.6437
  Test-Score 0.2073

4.87 sec for evaluation

--------- Epoch 41 -----------
309.31 sec for training (12744.26 total)
-- cmv_modes1 --
{'C': {'precision': 0.6190476190476191, 'recall': 0.5, 'f1-score': 0.5531914893617021, 'support': 26}, 'P': {'precision': 0.5789473684210527, 'recall': 0.55, 'f1-score': 0.5641025641025641, 'support': 20}, 'micro avg': {'precision': 0.6, 'recall': 0.5217391304347826, 'f1-score': 0.5581395348837209, 'support': 46}, 'macro avg': {'precision': 0.5989974937343359, 'recall': 0.525, 'f1-score': 0.5586470267321331, 'support': 46}, 'weighted avg': {'precision': 0.601612727470851, 'recall': 0.5217391304347826, 'f1-score': 0.5579354349012072, 'support': 46}}
Wrong BIO-Encoding 21/60 labels, 35.00%
{'C': {'precision': 0.6190476190476191, 'recall': 0.5, 'f1-score': 0.5531914893617021, 'support': 26}, 'P': {'precision': 0.5789473684210527, 'recall': 0.55, 'f1-score': 0.5641025641025641, 'support': 20}, 'micro avg': {'precision': 0.6, 'recall': 0.5217391304347826, 'f1-score': 0.5581395348837209, 'support': 46}, 'macro avg': {'precision': 0.5989974937343359, 'recall': 0.525, 'f1-score': 0.5586470267321331, 'support': 46}, 'weighted avg': {'precision': 0.601612727470851, 'recall': 0.5217391304347826, 'f1-score': 0.5579354349012072, 'support': 46}}
Wrong BIO-Encoding 1/40 labels, 2.50%
Dev-Data: Prec: 0.615, Rec: 0.522, F1: 0.5647
{'C': {'precision': 0.19298245614035087, 'recall': 0.13157894736842105, 'f1-score': 0.15647226173541962, 'support': 418}, 'P': {'precision': 0.27941176470588236, 'recall': 0.2550335570469799, 'f1-score': 0.26666666666666666, 'support': 447}, 'micro avg': {'precision': 0.24386724386724387, 'recall': 0.19537572254335261, 'f1-score': 0.21694480102695765, 'support': 865}, 'macro avg': {'precision': 0.2361971104231166, 'recall': 0.19330625220770048, 'f1-score': 0.21156946420104314, 'support': 865}, 'weighted avg': {'precision': 0.23764592542219198, 'recall': 0.19537572254335261, 'f1-score': 0.21341665364786752, 'support': 865}}
Wrong BIO-Encoding 325/1000 labels, 32.50%
{'C': {'precision': 0.19298245614035087, 'recall': 0.13157894736842105, 'f1-score': 0.15647226173541962, 'support': 418}, 'P': {'precision': 0.27941176470588236, 'recall': 0.2550335570469799, 'f1-score': 0.26666666666666666, 'support': 447}, 'micro avg': {'precision': 0.24386724386724387, 'recall': 0.19537572254335261, 'f1-score': 0.21694480102695765, 'support': 865}, 'macro avg': {'precision': 0.2361971104231166, 'recall': 0.19330625220770048, 'f1-score': 0.21156946420104314, 'support': 865}, 'weighted avg': {'precision': 0.23764592542219198, 'recall': 0.19537572254335261, 'f1-score': 0.21341665364786752, 'support': 865}}
Wrong BIO-Encoding 18/693 labels, 2.60%
Test-Data: Prec: 0.249, Rec: 0.194, F1: 0.2182

Scores from epoch with best dev-scores:
  Dev-Score: 0.6437
  Test-Score 0.2073

4.91 sec for evaluation

--------- Epoch 42 -----------
309.65 sec for training (13053.92 total)
-- cmv_modes1 --
{'C': {'precision': 0.6153846153846154, 'recall': 0.6153846153846154, 'f1-score': 0.6153846153846154, 'support': 26}, 'P': {'precision': 0.47058823529411764, 'recall': 0.4, 'f1-score': 0.4324324324324324, 'support': 20}, 'micro avg': {'precision': 0.5581395348837209, 'recall': 0.5217391304347826, 'f1-score': 0.5393258426966292, 'support': 46}, 'macro avg': {'precision': 0.5429864253393666, 'recall': 0.5076923076923077, 'f1-score': 0.5239085239085239, 'support': 46}, 'weighted avg': {'precision': 0.5524296675191817, 'recall': 0.5217391304347826, 'f1-score': 0.5358401880141009, 'support': 46}}
Wrong BIO-Encoding 8/50 labels, 16.00%
{'C': {'precision': 0.6153846153846154, 'recall': 0.6153846153846154, 'f1-score': 0.6153846153846154, 'support': 26}, 'P': {'precision': 0.47058823529411764, 'recall': 0.4, 'f1-score': 0.4324324324324324, 'support': 20}, 'micro avg': {'precision': 0.5581395348837209, 'recall': 0.5217391304347826, 'f1-score': 0.5393258426966292, 'support': 46}, 'macro avg': {'precision': 0.5429864253393666, 'recall': 0.5076923076923077, 'f1-score': 0.5239085239085239, 'support': 46}, 'weighted avg': {'precision': 0.5524296675191817, 'recall': 0.5217391304347826, 'f1-score': 0.5358401880141009, 'support': 46}}
Wrong BIO-Encoding 1/43 labels, 2.33%
Dev-Data: Prec: 0.571, Rec: 0.522, F1: 0.5455
{'C': {'precision': 0.21867321867321868, 'recall': 0.21291866028708134, 'f1-score': 0.21575757575757573, 'support': 418}, 'P': {'precision': 0.26519337016574585, 'recall': 0.21476510067114093, 'f1-score': 0.23733003708281827, 'support': 447}, 'micro avg': {'precision': 0.24057217165149544, 'recall': 0.2138728323699422, 'f1-score': 0.22643818849449204, 'support': 865}, 'macro avg': {'precision': 0.24193329441948225, 'recall': 0.21384188047911112, 'f1-score': 0.226543806420197, 'support': 865}, 'weighted avg': {'precision': 0.24271311198785409, 'recall': 0.2138728323699422, 'f1-score': 0.22690542571408837, 'support': 865}}
Wrong BIO-Encoding 257/1012 labels, 25.40%
{'C': {'precision': 0.21867321867321868, 'recall': 0.21291866028708134, 'f1-score': 0.21575757575757573, 'support': 418}, 'P': {'precision': 0.26519337016574585, 'recall': 0.21476510067114093, 'f1-score': 0.23733003708281827, 'support': 447}, 'micro avg': {'precision': 0.24057217165149544, 'recall': 0.2138728323699422, 'f1-score': 0.22643818849449204, 'support': 865}, 'macro avg': {'precision': 0.24193329441948225, 'recall': 0.21384188047911112, 'f1-score': 0.226543806420197, 'support': 865}, 'weighted avg': {'precision': 0.24271311198785409, 'recall': 0.2138728323699422, 'f1-score': 0.22690542571408837, 'support': 865}}
Wrong BIO-Encoding 14/769 labels, 1.82%
Test-Data: Prec: 0.245, Rec: 0.214, F1: 0.2284

Scores from epoch with best dev-scores:
  Dev-Score: 0.6437
  Test-Score 0.2073

4.91 sec for evaluation

--------- Epoch 43 -----------
310.95 sec for training (13364.86 total)
-- cmv_modes1 --
{'C': {'precision': 0.5625, 'recall': 0.6923076923076923, 'f1-score': 0.6206896551724138, 'support': 26}, 'P': {'precision': 0.7142857142857143, 'recall': 0.5, 'f1-score': 0.588235294117647, 'support': 20}, 'micro avg': {'precision': 0.6086956521739131, 'recall': 0.6086956521739131, 'f1-score': 0.6086956521739131, 'support': 46}, 'macro avg': {'precision': 0.6383928571428572, 'recall': 0.5961538461538461, 'f1-score': 0.6044624746450304, 'support': 46}, 'weighted avg': {'precision': 0.6284937888198757, 'recall': 0.6086956521739131, 'f1-score': 0.6065790634094717, 'support': 46}}
{'C': {'precision': 0.5625, 'recall': 0.6923076923076923, 'f1-score': 0.6206896551724138, 'support': 26}, 'P': {'precision': 0.7142857142857143, 'recall': 0.5, 'f1-score': 0.588235294117647, 'support': 20}, 'micro avg': {'precision': 0.6086956521739131, 'recall': 0.6086956521739131, 'f1-score': 0.6086956521739131, 'support': 46}, 'macro avg': {'precision': 0.6383928571428572, 'recall': 0.5961538461538461, 'f1-score': 0.6044624746450304, 'support': 46}, 'weighted avg': {'precision': 0.6284937888198757, 'recall': 0.6086956521739131, 'f1-score': 0.6065790634094717, 'support': 46}}
Dev-Data: Prec: 0.609, Rec: 0.609, F1: 0.6087
{'C': {'precision': 0.17829457364341086, 'recall': 0.22009569377990432, 'f1-score': 0.19700214132762314, 'support': 418}, 'P': {'precision': 0.3188854489164087, 'recall': 0.23042505592841164, 'f1-score': 0.2675324675324675, 'support': 447}, 'micro avg': {'precision': 0.232419547079857, 'recall': 0.2254335260115607, 'f1-score': 0.22887323943661975, 'support': 865}, 'macro avg': {'precision': 0.24859001127990976, 'recall': 0.22526037485415798, 'f1-score': 0.23226730443004534, 'support': 865}, 'weighted avg': {'precision': 0.2509467369347751, 'recall': 0.2254335260115607, 'f1-score': 0.2334496046959069, 'support': 865}}
Wrong BIO-Encoding 192/1019 labels, 18.84%
{'C': {'precision': 0.17829457364341086, 'recall': 0.22009569377990432, 'f1-score': 0.19700214132762314, 'support': 418}, 'P': {'precision': 0.3188854489164087, 'recall': 0.23042505592841164, 'f1-score': 0.2675324675324675, 'support': 447}, 'micro avg': {'precision': 0.232419547079857, 'recall': 0.2254335260115607, 'f1-score': 0.22887323943661975, 'support': 865}, 'macro avg': {'precision': 0.24859001127990976, 'recall': 0.22526037485415798, 'f1-score': 0.23226730443004534, 'support': 865}, 'weighted avg': {'precision': 0.2509467369347751, 'recall': 0.2254335260115607, 'f1-score': 0.2334496046959069, 'support': 865}}
Wrong BIO-Encoding 12/839 labels, 1.43%
Test-Data: Prec: 0.236, Rec: 0.225, F1: 0.2305

Scores from epoch with best dev-scores:
  Dev-Score: 0.6437
  Test-Score 0.2073

4.84 sec for evaluation

--------- Epoch 44 -----------
310.29 sec for training (13675.16 total)
-- cmv_modes1 --
{'C': {'precision': 0.6538461538461539, 'recall': 0.6538461538461539, 'f1-score': 0.6538461538461539, 'support': 26}, 'P': {'precision': 0.7058823529411765, 'recall': 0.6, 'f1-score': 0.6486486486486486, 'support': 20}, 'micro avg': {'precision': 0.6744186046511628, 'recall': 0.6304347826086957, 'f1-score': 0.651685393258427, 'support': 46}, 'macro avg': {'precision': 0.6798642533936652, 'recall': 0.6269230769230769, 'f1-score': 0.6512474012474012, 'support': 46}, 'weighted avg': {'precision': 0.6764705882352942, 'recall': 0.6304347826086957, 'f1-score': 0.6515863689776733, 'support': 46}}
{'C': {'precision': 0.6538461538461539, 'recall': 0.6538461538461539, 'f1-score': 0.6538461538461539, 'support': 26}, 'P': {'precision': 0.7058823529411765, 'recall': 0.6, 'f1-score': 0.6486486486486486, 'support': 20}, 'micro avg': {'precision': 0.6744186046511628, 'recall': 0.6304347826086957, 'f1-score': 0.651685393258427, 'support': 46}, 'macro avg': {'precision': 0.6798642533936652, 'recall': 0.6269230769230769, 'f1-score': 0.6512474012474012, 'support': 46}, 'weighted avg': {'precision': 0.6764705882352942, 'recall': 0.6304347826086957, 'f1-score': 0.6515863689776733, 'support': 46}}
Dev-Data: Prec: 0.674, Rec: 0.630, F1: 0.6517
{'C': {'precision': 0.1976401179941003, 'recall': 0.16028708133971292, 'f1-score': 0.17701453104359313, 'support': 418}, 'P': {'precision': 0.23940149625935161, 'recall': 0.21476510067114093, 'f1-score': 0.22641509433962265, 'support': 447}, 'micro avg': {'precision': 0.22027027027027027, 'recall': 0.1884393063583815, 'f1-score': 0.20311526479750777, 'support': 865}, 'macro avg': {'precision': 0.21852080712672595, 'recall': 0.18752609100542694, 'f1-score': 0.2017148126916079, 'support': 865}, 'weighted avg': {'precision': 0.21922085335198163, 'recall': 0.1884393063583815, 'f1-score': 0.20254291461969162, 'support': 865}}
Wrong BIO-Encoding 357/1077 labels, 33.15%
{'C': {'precision': 0.1976401179941003, 'recall': 0.16028708133971292, 'f1-score': 0.17701453104359313, 'support': 418}, 'P': {'precision': 0.23940149625935161, 'recall': 0.21476510067114093, 'f1-score': 0.22641509433962265, 'support': 447}, 'micro avg': {'precision': 0.22027027027027027, 'recall': 0.1884393063583815, 'f1-score': 0.20311526479750777, 'support': 865}, 'macro avg': {'precision': 0.21852080712672595, 'recall': 0.18752609100542694, 'f1-score': 0.2017148126916079, 'support': 865}, 'weighted avg': {'precision': 0.21922085335198163, 'recall': 0.1884393063583815, 'f1-score': 0.20254291461969162, 'support': 865}}
Wrong BIO-Encoding 20/740 labels, 2.70%
Test-Data: Prec: 0.226, Rec: 0.188, F1: 0.2057

Scores from epoch with best dev-scores:
  Dev-Score: 0.6517
  Test-Score 0.2057

5.60 sec for evaluation

--------- Epoch 45 -----------
308.38 sec for training (13983.53 total)
-- cmv_modes1 --
{'C': {'precision': 0.68, 'recall': 0.6538461538461539, 'f1-score': 0.6666666666666666, 'support': 26}, 'P': {'precision': 0.6, 'recall': 0.6, 'f1-score': 0.6, 'support': 20}, 'micro avg': {'precision': 0.6444444444444445, 'recall': 0.6304347826086957, 'f1-score': 0.6373626373626373, 'support': 46}, 'macro avg': {'precision': 0.64, 'recall': 0.6269230769230769, 'f1-score': 0.6333333333333333, 'support': 46}, 'weighted avg': {'precision': 0.6452173913043479, 'recall': 0.6304347826086957, 'f1-score': 0.6376811594202898, 'support': 46}}
Wrong BIO-Encoding 8/52 labels, 15.38%
{'C': {'precision': 0.68, 'recall': 0.6538461538461539, 'f1-score': 0.6666666666666666, 'support': 26}, 'P': {'precision': 0.6, 'recall': 0.6, 'f1-score': 0.6, 'support': 20}, 'micro avg': {'precision': 0.6444444444444445, 'recall': 0.6304347826086957, 'f1-score': 0.6373626373626373, 'support': 46}, 'macro avg': {'precision': 0.64, 'recall': 0.6269230769230769, 'f1-score': 0.6333333333333333, 'support': 46}, 'weighted avg': {'precision': 0.6452173913043479, 'recall': 0.6304347826086957, 'f1-score': 0.6376811594202898, 'support': 46}}
Wrong BIO-Encoding 1/45 labels, 2.22%
Dev-Data: Prec: 0.659, Rec: 0.630, F1: 0.6444
{'C': {'precision': 0.18275862068965518, 'recall': 0.12679425837320574, 'f1-score': 0.1497175141242938, 'support': 418}, 'P': {'precision': 0.23958333333333334, 'recall': 0.25727069351230425, 'f1-score': 0.2481121898597627, 'support': 447}, 'micro avg': {'precision': 0.21818181818181817, 'recall': 0.19421965317919074, 'f1-score': 0.2055045871559633, 'support': 865}, 'macro avg': {'precision': 0.21117097701149426, 'recall': 0.192032475942755, 'f1-score': 0.19891485199202824, 'support': 865}, 'weighted avg': {'precision': 0.2121235299980068, 'recall': 0.19421965317919074, 'f1-score': 0.20056424251013727, 'support': 865}}
Wrong BIO-Encoding 335/1084 labels, 30.90%
{'C': {'precision': 0.18275862068965518, 'recall': 0.12679425837320574, 'f1-score': 0.1497175141242938, 'support': 418}, 'P': {'precision': 0.23958333333333334, 'recall': 0.25727069351230425, 'f1-score': 0.2481121898597627, 'support': 447}, 'micro avg': {'precision': 0.21818181818181817, 'recall': 0.19421965317919074, 'f1-score': 0.2055045871559633, 'support': 865}, 'macro avg': {'precision': 0.21117097701149426, 'recall': 0.192032475942755, 'f1-score': 0.19891485199202824, 'support': 865}, 'weighted avg': {'precision': 0.2121235299980068, 'recall': 0.19421965317919074, 'f1-score': 0.20056424251013727, 'support': 865}}
Wrong BIO-Encoding 21/770 labels, 2.73%
Test-Data: Prec: 0.224, Rec: 0.194, F1: 0.2082

Scores from epoch with best dev-scores:
  Dev-Score: 0.6517
  Test-Score 0.2057

4.89 sec for evaluation

--------- Epoch 46 -----------
311.17 sec for training (14294.70 total)
-- cmv_modes1 --
{'C': {'precision': 0.75, 'recall': 0.6923076923076923, 'f1-score': 0.7199999999999999, 'support': 26}, 'P': {'precision': 0.5238095238095238, 'recall': 0.55, 'f1-score': 0.5365853658536585, 'support': 20}, 'micro avg': {'precision': 0.6444444444444445, 'recall': 0.6304347826086957, 'f1-score': 0.6373626373626373, 'support': 46}, 'macro avg': {'precision': 0.6369047619047619, 'recall': 0.6211538461538462, 'f1-score': 0.6282926829268292, 'support': 46}, 'weighted avg': {'precision': 0.6516563146997929, 'recall': 0.6304347826086957, 'f1-score': 0.6402545068928949, 'support': 46}}
{'C': {'precision': 0.75, 'recall': 0.6923076923076923, 'f1-score': 0.7199999999999999, 'support': 26}, 'P': {'precision': 0.5238095238095238, 'recall': 0.55, 'f1-score': 0.5365853658536585, 'support': 20}, 'micro avg': {'precision': 0.6444444444444445, 'recall': 0.6304347826086957, 'f1-score': 0.6373626373626373, 'support': 46}, 'macro avg': {'precision': 0.6369047619047619, 'recall': 0.6211538461538462, 'f1-score': 0.6282926829268292, 'support': 46}, 'weighted avg': {'precision': 0.6516563146997929, 'recall': 0.6304347826086957, 'f1-score': 0.6402545068928949, 'support': 46}}
Dev-Data: Prec: 0.644, Rec: 0.630, F1: 0.6374
{'C': {'precision': 0.20504731861198738, 'recall': 0.15550239234449761, 'f1-score': 0.17687074829931973, 'support': 418}, 'P': {'precision': 0.225, 'recall': 0.26174496644295303, 'f1-score': 0.2419855222337125, 'support': 447}, 'micro avg': {'precision': 0.2174432497013142, 'recall': 0.21040462427745665, 'f1-score': 0.21386603995299647, 'support': 865}, 'macro avg': {'precision': 0.2150236593059937, 'recall': 0.20862367939372534, 'f1-score': 0.2094281352665161, 'support': 865}, 'weighted avg': {'precision': 0.21535812621943437, 'recall': 0.21040462427745665, 'f1-score': 0.21051965459836433, 'support': 865}}
Wrong BIO-Encoding 93/921 labels, 10.10%
{'C': {'precision': 0.20504731861198738, 'recall': 0.15550239234449761, 'f1-score': 0.17687074829931973, 'support': 418}, 'P': {'precision': 0.225, 'recall': 0.26174496644295303, 'f1-score': 0.2419855222337125, 'support': 447}, 'micro avg': {'precision': 0.2174432497013142, 'recall': 0.21040462427745665, 'f1-score': 0.21386603995299647, 'support': 865}, 'macro avg': {'precision': 0.2150236593059937, 'recall': 0.20862367939372534, 'f1-score': 0.2094281352665161, 'support': 865}, 'weighted avg': {'precision': 0.21535812621943437, 'recall': 0.21040462427745665, 'f1-score': 0.21051965459836433, 'support': 865}}
Wrong BIO-Encoding 9/837 labels, 1.08%
Test-Data: Prec: 0.217, Rec: 0.210, F1: 0.2139

Scores from epoch with best dev-scores:
  Dev-Score: 0.6517
  Test-Score 0.2057

4.82 sec for evaluation

--------- Epoch 47 -----------
309.40 sec for training (14604.10 total)
-- cmv_modes1 --
{'C': {'precision': 0.6428571428571429, 'recall': 0.6923076923076923, 'f1-score': 0.6666666666666666, 'support': 26}, 'P': {'precision': 0.625, 'recall': 0.5, 'f1-score': 0.5555555555555556, 'support': 20}, 'micro avg': {'precision': 0.6363636363636364, 'recall': 0.6086956521739131, 'f1-score': 0.6222222222222223, 'support': 46}, 'macro avg': {'precision': 0.6339285714285714, 'recall': 0.5961538461538461, 'f1-score': 0.6111111111111112, 'support': 46}, 'weighted avg': {'precision': 0.6350931677018634, 'recall': 0.6086956521739131, 'f1-score': 0.6183574879227053, 'support': 46}}
{'C': {'precision': 0.6428571428571429, 'recall': 0.6923076923076923, 'f1-score': 0.6666666666666666, 'support': 26}, 'P': {'precision': 0.625, 'recall': 0.5, 'f1-score': 0.5555555555555556, 'support': 20}, 'micro avg': {'precision': 0.6363636363636364, 'recall': 0.6086956521739131, 'f1-score': 0.6222222222222223, 'support': 46}, 'macro avg': {'precision': 0.6339285714285714, 'recall': 0.5961538461538461, 'f1-score': 0.6111111111111112, 'support': 46}, 'weighted avg': {'precision': 0.6350931677018634, 'recall': 0.6086956521739131, 'f1-score': 0.6183574879227053, 'support': 46}}
Dev-Data: Prec: 0.636, Rec: 0.609, F1: 0.6222
{'C': {'precision': 0.1834625322997416, 'recall': 0.16985645933014354, 'f1-score': 0.17639751552795033, 'support': 418}, 'P': {'precision': 0.23057644110275688, 'recall': 0.2058165548098434, 'f1-score': 0.21749408983451535, 'support': 447}, 'micro avg': {'precision': 0.20737913486005088, 'recall': 0.1884393063583815, 'f1-score': 0.19745608721986677, 'support': 865}, 'macro avg': {'precision': 0.20701948670124926, 'recall': 0.18783650706999347, 'f1-score': 0.19694580268123285, 'support': 865}, 'weighted avg': {'precision': 0.20780925742684891, 'recall': 0.1884393063583815, 'f1-score': 0.19763470479388626, 'support': 865}}
Wrong BIO-Encoding 222/996 labels, 22.29%
{'C': {'precision': 0.1834625322997416, 'recall': 0.16985645933014354, 'f1-score': 0.17639751552795033, 'support': 418}, 'P': {'precision': 0.23057644110275688, 'recall': 0.2058165548098434, 'f1-score': 0.21749408983451535, 'support': 447}, 'micro avg': {'precision': 0.20737913486005088, 'recall': 0.1884393063583815, 'f1-score': 0.19745608721986677, 'support': 865}, 'macro avg': {'precision': 0.20701948670124926, 'recall': 0.18783650706999347, 'f1-score': 0.19694580268123285, 'support': 865}, 'weighted avg': {'precision': 0.20780925742684891, 'recall': 0.1884393063583815, 'f1-score': 0.19763470479388626, 'support': 865}}
Wrong BIO-Encoding 12/786 labels, 1.53%
Test-Data: Prec: 0.211, Rec: 0.188, F1: 0.1989

Scores from epoch with best dev-scores:
  Dev-Score: 0.6517
  Test-Score 0.2057

4.88 sec for evaluation

--------- Epoch 48 -----------
309.23 sec for training (14913.33 total)
-- cmv_modes1 --
{'C': {'precision': 0.68, 'recall': 0.6538461538461539, 'f1-score': 0.6666666666666666, 'support': 26}, 'P': {'precision': 0.6, 'recall': 0.6, 'f1-score': 0.6, 'support': 20}, 'micro avg': {'precision': 0.6444444444444445, 'recall': 0.6304347826086957, 'f1-score': 0.6373626373626373, 'support': 46}, 'macro avg': {'precision': 0.64, 'recall': 0.6269230769230769, 'f1-score': 0.6333333333333333, 'support': 46}, 'weighted avg': {'precision': 0.6452173913043479, 'recall': 0.6304347826086957, 'f1-score': 0.6376811594202898, 'support': 46}}
{'C': {'precision': 0.68, 'recall': 0.6538461538461539, 'f1-score': 0.6666666666666666, 'support': 26}, 'P': {'precision': 0.6, 'recall': 0.6, 'f1-score': 0.6, 'support': 20}, 'micro avg': {'precision': 0.6444444444444445, 'recall': 0.6304347826086957, 'f1-score': 0.6373626373626373, 'support': 46}, 'macro avg': {'precision': 0.64, 'recall': 0.6269230769230769, 'f1-score': 0.6333333333333333, 'support': 46}, 'weighted avg': {'precision': 0.6452173913043479, 'recall': 0.6304347826086957, 'f1-score': 0.6376811594202898, 'support': 46}}
Dev-Data: Prec: 0.644, Rec: 0.630, F1: 0.6374
{'C': {'precision': 0.1951219512195122, 'recall': 0.15311004784688995, 'f1-score': 0.17158176943699732, 'support': 418}, 'P': {'precision': 0.2631578947368421, 'recall': 0.2684563758389262, 'f1-score': 0.26578073089700993, 'support': 447}, 'micro avg': {'precision': 0.23469387755102042, 'recall': 0.21271676300578035, 'f1-score': 0.2231655548817465, 'support': 865}, 'macro avg': {'precision': 0.22913992297817715, 'recall': 0.21078321184290805, 'f1-score': 0.21868125016700363, 'support': 865}, 'weighted avg': {'precision': 0.2302804098926295, 'recall': 0.21271676300578035, 'f1-score': 0.2202603079024605, 'support': 865}}
Wrong BIO-Encoding 172/946 labels, 18.18%
{'C': {'precision': 0.1951219512195122, 'recall': 0.15311004784688995, 'f1-score': 0.17158176943699732, 'support': 418}, 'P': {'precision': 0.2631578947368421, 'recall': 0.2684563758389262, 'f1-score': 0.26578073089700993, 'support': 447}, 'micro avg': {'precision': 0.23469387755102042, 'recall': 0.21271676300578035, 'f1-score': 0.2231655548817465, 'support': 865}, 'macro avg': {'precision': 0.22913992297817715, 'recall': 0.21078321184290805, 'f1-score': 0.21868125016700363, 'support': 865}, 'weighted avg': {'precision': 0.2302804098926295, 'recall': 0.21271676300578035, 'f1-score': 0.2202603079024605, 'support': 865}}
Wrong BIO-Encoding 10/784 labels, 1.28%
Test-Data: Prec: 0.238, Rec: 0.213, F1: 0.2245

Scores from epoch with best dev-scores:
  Dev-Score: 0.6517
  Test-Score 0.2057

4.89 sec for evaluation

--------- Epoch 49 -----------
310.88 sec for training (15224.21 total)
-- cmv_modes1 --
{'C': {'precision': 0.7407407407407407, 'recall': 0.7692307692307693, 'f1-score': 0.7547169811320754, 'support': 26}, 'P': {'precision': 0.5882352941176471, 'recall': 0.5, 'f1-score': 0.5405405405405405, 'support': 20}, 'micro avg': {'precision': 0.6818181818181818, 'recall': 0.6521739130434783, 'f1-score': 0.6666666666666666, 'support': 46}, 'macro avg': {'precision': 0.6644880174291938, 'recall': 0.6346153846153846, 'f1-score': 0.6476287608363079, 'support': 46}, 'weighted avg': {'precision': 0.6744340248176566, 'recall': 0.6521739130434783, 'f1-score': 0.6615967895705385, 'support': 46}}
Wrong BIO-Encoding 8/51 labels, 15.69%
{'C': {'precision': 0.7407407407407407, 'recall': 0.7692307692307693, 'f1-score': 0.7547169811320754, 'support': 26}, 'P': {'precision': 0.5882352941176471, 'recall': 0.5, 'f1-score': 0.5405405405405405, 'support': 20}, 'micro avg': {'precision': 0.6818181818181818, 'recall': 0.6521739130434783, 'f1-score': 0.6666666666666666, 'support': 46}, 'macro avg': {'precision': 0.6644880174291938, 'recall': 0.6346153846153846, 'f1-score': 0.6476287608363079, 'support': 46}, 'weighted avg': {'precision': 0.6744340248176566, 'recall': 0.6521739130434783, 'f1-score': 0.6615967895705385, 'support': 46}}
Wrong BIO-Encoding 1/44 labels, 2.27%
Dev-Data: Prec: 0.698, Rec: 0.652, F1: 0.6742
{'C': {'precision': 0.21485411140583555, 'recall': 0.1937799043062201, 'f1-score': 0.2037735849056604, 'support': 418}, 'P': {'precision': 0.2735229759299781, 'recall': 0.2796420581655481, 'f1-score': 0.27654867256637167, 'support': 447}, 'micro avg': {'precision': 0.24700239808153476, 'recall': 0.23815028901734103, 'f1-score': 0.24249558563861093, 'support': 865}, 'macro avg': {'precision': 0.24418854366790682, 'recall': 0.2367109812358841, 'f1-score': 0.24016112873601603, 'support': 865}, 'weighted avg': {'precision': 0.24517201018305143, 'recall': 0.23815028901734103, 'f1-score': 0.24138105795113776, 'support': 865}}
Wrong BIO-Encoding 285/1104 labels, 25.82%
{'C': {'precision': 0.21485411140583555, 'recall': 0.1937799043062201, 'f1-score': 0.2037735849056604, 'support': 418}, 'P': {'precision': 0.2735229759299781, 'recall': 0.2796420581655481, 'f1-score': 0.27654867256637167, 'support': 447}, 'micro avg': {'precision': 0.24700239808153476, 'recall': 0.23815028901734103, 'f1-score': 0.24249558563861093, 'support': 865}, 'macro avg': {'precision': 0.24418854366790682, 'recall': 0.2367109812358841, 'f1-score': 0.24016112873601603, 'support': 865}, 'weighted avg': {'precision': 0.24517201018305143, 'recall': 0.23815028901734103, 'f1-score': 0.24138105795113776, 'support': 865}}
Wrong BIO-Encoding 15/834 labels, 1.80%
Test-Data: Prec: 0.252, Rec: 0.238, F1: 0.2447

Scores from epoch with best dev-scores:
  Dev-Score: 0.6742
  Test-Score 0.2447

5.62 sec for evaluation

--------- Epoch 50 -----------
310.22 sec for training (15534.43 total)
-- cmv_modes1 --
{'C': {'precision': 0.7916666666666666, 'recall': 0.7307692307692307, 'f1-score': 0.76, 'support': 26}, 'P': {'precision': 0.6818181818181818, 'recall': 0.75, 'f1-score': 0.7142857142857143, 'support': 20}, 'micro avg': {'precision': 0.7391304347826086, 'recall': 0.7391304347826086, 'f1-score': 0.7391304347826085, 'support': 46}, 'macro avg': {'precision': 0.7367424242424242, 'recall': 0.7403846153846154, 'f1-score': 0.7371428571428571, 'support': 46}, 'weighted avg': {'precision': 0.7439064558629775, 'recall': 0.7391304347826086, 'f1-score': 0.7401242236024845, 'support': 46}}
Wrong BIO-Encoding 9/54 labels, 16.67%
{'C': {'precision': 0.7916666666666666, 'recall': 0.7307692307692307, 'f1-score': 0.76, 'support': 26}, 'P': {'precision': 0.6818181818181818, 'recall': 0.75, 'f1-score': 0.7142857142857143, 'support': 20}, 'micro avg': {'precision': 0.7391304347826086, 'recall': 0.7391304347826086, 'f1-score': 0.7391304347826085, 'support': 46}, 'macro avg': {'precision': 0.7367424242424242, 'recall': 0.7403846153846154, 'f1-score': 0.7371428571428571, 'support': 46}, 'weighted avg': {'precision': 0.7439064558629775, 'recall': 0.7391304347826086, 'f1-score': 0.7401242236024845, 'support': 46}}
Wrong BIO-Encoding 1/46 labels, 2.17%
Dev-Data: Prec: 0.756, Rec: 0.739, F1: 0.7473
{'C': {'precision': 0.18787878787878787, 'recall': 0.14832535885167464, 'f1-score': 0.1657754010695187, 'support': 418}, 'P': {'precision': 0.2802690582959641, 'recall': 0.2796420581655481, 'f1-score': 0.2799552071668533, 'support': 447}, 'micro avg': {'precision': 0.24097938144329897, 'recall': 0.2161849710982659, 'f1-score': 0.2279098110907983, 'support': 865}, 'macro avg': {'precision': 0.23407392308737598, 'recall': 0.21398370850861137, 'f1-score': 0.222865304118186, 'support': 865}, 'weighted avg': {'precision': 0.23562266172442692, 'recall': 0.2161849710982659, 'f1-score': 0.22477930086779452, 'support': 865}}
Wrong BIO-Encoding 228/996 labels, 22.89%
{'C': {'precision': 0.18787878787878787, 'recall': 0.14832535885167464, 'f1-score': 0.1657754010695187, 'support': 418}, 'P': {'precision': 0.2802690582959641, 'recall': 0.2796420581655481, 'f1-score': 0.2799552071668533, 'support': 447}, 'micro avg': {'precision': 0.24097938144329897, 'recall': 0.2161849710982659, 'f1-score': 0.2279098110907983, 'support': 865}, 'macro avg': {'precision': 0.23407392308737598, 'recall': 0.21398370850861137, 'f1-score': 0.222865304118186, 'support': 865}, 'weighted avg': {'precision': 0.23562266172442692, 'recall': 0.2161849710982659, 'f1-score': 0.22477930086779452, 'support': 865}}
Wrong BIO-Encoding 8/776 labels, 1.03%
Test-Data: Prec: 0.243, Rec: 0.216, F1: 0.2290

Scores from epoch with best dev-scores:
  Dev-Score: 0.7473
  Test-Score 0.2290

5.58 sec for evaluation
---------RUN 3 ------------
Generate new embeddings files for a dataset
Read file: komninos_english_embeddings.gz
Added words: 14
:: Transform cmv_modes dataset ::
:: Create Train Matrix ::
Unknown-Tokens: 0.72%
:: Create Dev Matrix ::
Unknown-Tokens: 1.94%
:: Create Test Matrix ::
Unknown-Tokens: 1.11%
:: Transform cmv_modes1 dataset ::
:: Create Train Matrix ::
Unknown-Tokens: 0.72%
:: Create Dev Matrix ::
Unknown-Tokens: 1.94%
:: Create Test Matrix ::
Unknown-Tokens: 1.11%
:: Transform cmv_modes2 dataset ::
:: Create Train Matrix ::
Unknown-Tokens: 0.72%
:: Create Dev Matrix ::
Unknown-Tokens: 1.94%
:: Create Test Matrix ::
Unknown-Tokens: 1.11%
DONE - Embeddings file saved: pkl/cmv_modes_cmv_modes1_cmv_modes2_komninos_english_embeddings.pkl
--- cmv_modes ---
374 train sentences
3 dev sentences
82 test sentences
--- cmv_modes1 ---
374 train sentences
3 dev sentences
82 test sentences
--- cmv_modes2 ---
374 train sentences
3 dev sentences
82 test sentences
LSTM-Size: [100]
_____________________________________________________________________________________________________________________________
Layer (type)                             Output Shape               Param #        Connected to                              
=============================================================================================================================
words_input (InputLayer)                 (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
casing_input (InputLayer)                (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
word_embeddings (Embedding)              (None, None, 300)          66696000       words_input[0][0]                         
_____________________________________________________________________________________________________________________________
casing_emebddings (Embedding)            (None, None, 10)           80             casing_input[0][0]                        
_____________________________________________________________________________________________________________________________
concatenate_1 (Concatenate)              (None, None, 310)          0              word_embeddings[0][0]                     
                                                                                   casing_emebddings[0][0]                   
_____________________________________________________________________________________________________________________________
shared_varLSTM_1 (Bidirectional)         (None, None, 200)          328800         concatenate_1[0][0]                       
_____________________________________________________________________________________________________________________________
cmv_modes_hidden_lin_layer (TimeDistribu (None, None, 287)          57687          shared_varLSTM_1[0][0]                    
_____________________________________________________________________________________________________________________________
cmv_modes_crf (ChainCRF)                 (None, None, 287)          82943          cmv_modes_hidden_lin_layer[0][0]          
=============================================================================================================================
Total params: 67,165,510
Trainable params: 469,510
Non-trainable params: 66,696,000
_____________________________________________________________________________________________________________________________
_____________________________________________________________________________________________________________________________
Layer (type)                             Output Shape               Param #        Connected to                              
=============================================================================================================================
words_input (InputLayer)                 (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
casing_input (InputLayer)                (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
word_embeddings (Embedding)              (None, None, 300)          66696000       words_input[0][0]                         
_____________________________________________________________________________________________________________________________
casing_emebddings (Embedding)            (None, None, 10)           80             casing_input[0][0]                        
_____________________________________________________________________________________________________________________________
concatenate_1 (Concatenate)              (None, None, 310)          0              word_embeddings[0][0]                     
                                                                                   casing_emebddings[0][0]                   
_____________________________________________________________________________________________________________________________
shared_varLSTM_1 (Bidirectional)         (None, None, 200)          328800         concatenate_1[0][0]                       
_____________________________________________________________________________________________________________________________
cmv_modes1_hidden_lin_layer (TimeDistrib (None, None, 5)            1005           shared_varLSTM_1[0][0]                    
_____________________________________________________________________________________________________________________________
cmv_modes1_crf (ChainCRF)                (None, None, 5)            35             cmv_modes1_hidden_lin_layer[0][0]         
=============================================================================================================================
Total params: 67,025,920
Trainable params: 329,920
Non-trainable params: 66,696,000
_____________________________________________________________________________________________________________________________
_____________________________________________________________________________________________________________________________
Layer (type)                             Output Shape               Param #        Connected to                              
=============================================================================================================================
words_input (InputLayer)                 (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
casing_input (InputLayer)                (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
word_embeddings (Embedding)              (None, None, 300)          66696000       words_input[0][0]                         
_____________________________________________________________________________________________________________________________
casing_emebddings (Embedding)            (None, None, 10)           80             casing_input[0][0]                        
_____________________________________________________________________________________________________________________________
concatenate_1 (Concatenate)              (None, None, 310)          0              word_embeddings[0][0]                     
                                                                                   casing_emebddings[0][0]                   
_____________________________________________________________________________________________________________________________
shared_varLSTM_1 (Bidirectional)         (None, None, 200)          328800         concatenate_1[0][0]                       
_____________________________________________________________________________________________________________________________
cmv_modes2_softmax (TimeDistributed)     (None, None, 119)          23919          shared_varLSTM_1[0][0]                    
=============================================================================================================================
Total params: 67,048,799
Trainable params: 352,799
Non-trainable params: 66,696,000
_____________________________________________________________________________________________________________________________

--------- Epoch 1 -----------
340.59 sec for training (340.59 total)
-- cmv_modes1 --
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 20}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 49}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 69}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 69}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 69}}
Wrong BIO-Encoding 1165/1172 labels, 99.40%
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 20}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 49}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 69}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 69}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 69}}
Wrong BIO-Encoding 839/846 labels, 99.17%
Dev-Data: Prec: 0.000, Rec: 0.000, F1: 0.0000
{'C': {'precision': 0.00048792388387411563, 'recall': 0.007246376811594203, 'f1-score': 0.0009142857142857143, 'support': 276}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 305}, 'micro avg': {'precision': 0.0002565418163160595, 'recall': 0.0034423407917383822, 'f1-score': 0.00047749791094663964, 'support': 581}, 'macro avg': {'precision': 0.00024396194193705782, 'recall': 0.0036231884057971015, 'f1-score': 0.00045714285714285713, 'support': 581}, 'weighted avg': {'precision': 0.00023178483984381395, 'recall': 0.0034423407917383822, 'f1-score': 0.0004343250553233342, 'support': 581}}
Wrong BIO-Encoding 10873/10913 labels, 99.63%
{'C': {'precision': 0.00048792388387411563, 'recall': 0.007246376811594203, 'f1-score': 0.0009142857142857143, 'support': 276}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 305}, 'micro avg': {'precision': 0.0002565418163160595, 'recall': 0.0034423407917383822, 'f1-score': 0.00047749791094663964, 'support': 581}, 'macro avg': {'precision': 0.00024396194193705782, 'recall': 0.0036231884057971015, 'f1-score': 0.00045714285714285713, 'support': 581}, 'weighted avg': {'precision': 0.00023178483984381395, 'recall': 0.0034423407917383822, 'f1-score': 0.0004343250553233342, 'support': 581}}
Wrong BIO-Encoding 7756/7796 labels, 99.49%
Test-Data: Prec: 0.000, Rec: 0.003, F1: 0.0005

Scores from epoch with best dev-scores:
  Dev-Score: 0.0000
  Test-Score 0.0000

4.57 sec for evaluation

--------- Epoch 2 -----------
327.01 sec for training (667.60 total)
-- cmv_modes1 --
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 20}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 49}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 69}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 69}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 69}}
Wrong BIO-Encoding 1005/1017 labels, 98.82%
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 20}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 49}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 69}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 69}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 69}}
Wrong BIO-Encoding 115/127 labels, 90.55%
Dev-Data: Prec: 0.000, Rec: 0.000, F1: 0.0000
{'C': {'precision': 0.008836524300441826, 'recall': 0.021739130434782608, 'f1-score': 0.01256544502617801, 'support': 276}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 305}, 'micro avg': {'precision': 0.005870841487279843, 'recall': 0.010327022375215147, 'f1-score': 0.007485963817841546, 'support': 581}, 'macro avg': {'precision': 0.004418262150220913, 'recall': 0.010869565217391304, 'f1-score': 0.006282722513089005, 'support': 581}, 'weighted avg': {'precision': 0.004197729271810575, 'recall': 0.010327022375215147, 'f1-score': 0.0059691270692343035, 'support': 581}}
Wrong BIO-Encoding 7456/7665 labels, 97.27%
{'C': {'precision': 0.008836524300441826, 'recall': 0.021739130434782608, 'f1-score': 0.01256544502617801, 'support': 276}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 305}, 'micro avg': {'precision': 0.005870841487279843, 'recall': 0.010327022375215147, 'f1-score': 0.007485963817841546, 'support': 581}, 'macro avg': {'precision': 0.004418262150220913, 'recall': 0.010869565217391304, 'f1-score': 0.006282722513089005, 'support': 581}, 'weighted avg': {'precision': 0.004197729271810575, 'recall': 0.010327022375215147, 'f1-score': 0.0059691270692343035, 'support': 581}}
Wrong BIO-Encoding 813/1022 labels, 79.55%
Test-Data: Prec: 0.029, Rec: 0.010, F1: 0.0152

Scores from epoch with best dev-scores:
  Dev-Score: 0.0000
  Test-Score 0.0000

3.98 sec for evaluation

--------- Epoch 3 -----------
325.33 sec for training (992.94 total)
-- cmv_modes1 --
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 20}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 49}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 69}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 69}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 69}}
Wrong BIO-Encoding 438/450 labels, 97.33%
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 20}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 49}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 69}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 69}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 69}}
Wrong BIO-Encoding 3/15 labels, 20.00%
Dev-Data: Prec: 0.000, Rec: 0.000, F1: 0.0000
{'C': {'precision': 0.0958904109589041, 'recall': 0.025362318840579712, 'f1-score': 0.04011461318051576, 'support': 276}, 'P': {'precision': 0.05084745762711865, 'recall': 0.029508196721311476, 'f1-score': 0.03734439834024897, 'support': 305}, 'micro avg': {'precision': 0.064, 'recall': 0.027538726333907058, 'f1-score': 0.03850782190132371, 'support': 581}, 'macro avg': {'precision': 0.07336893429301138, 'recall': 0.027435257780945594, 'f1-score': 0.038729505760382366, 'support': 581}, 'weighted avg': {'precision': 0.07224479862466217, 'recall': 0.027538726333907058, 'f1-score': 0.03866036958967003, 'support': 581}}
Wrong BIO-Encoding 5852/6031 labels, 97.03%
{'C': {'precision': 0.0958904109589041, 'recall': 0.025362318840579712, 'f1-score': 0.04011461318051576, 'support': 276}, 'P': {'precision': 0.05084745762711865, 'recall': 0.029508196721311476, 'f1-score': 0.03734439834024897, 'support': 305}, 'micro avg': {'precision': 0.064, 'recall': 0.027538726333907058, 'f1-score': 0.03850782190132371, 'support': 581}, 'macro avg': {'precision': 0.07336893429301138, 'recall': 0.027435257780945594, 'f1-score': 0.038729505760382366, 'support': 581}, 'weighted avg': {'precision': 0.07224479862466217, 'recall': 0.027538726333907058, 'f1-score': 0.03866036958967003, 'support': 581}}
Wrong BIO-Encoding 71/250 labels, 28.40%
Test-Data: Prec: 0.089, Rec: 0.028, F1: 0.0421

Scores from epoch with best dev-scores:
  Dev-Score: 0.0000
  Test-Score 0.0000

4.00 sec for evaluation

--------- Epoch 4 -----------
324.78 sec for training (1317.72 total)
-- cmv_modes1 --
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 20}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 49}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 69}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 69}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 69}}
Wrong BIO-Encoding 315/327 labels, 96.33%
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 20}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 49}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 69}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 69}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 69}}
Wrong BIO-Encoding 11/23 labels, 47.83%
Dev-Data: Prec: 0.000, Rec: 0.000, F1: 0.0000
{'C': {'precision': 0.06790123456790123, 'recall': 0.03985507246376811, 'f1-score': 0.0502283105022831, 'support': 276}, 'P': {'precision': 0.03867403314917127, 'recall': 0.022950819672131147, 'f1-score': 0.02880658436213992, 'support': 305}, 'micro avg': {'precision': 0.052478134110787174, 'recall': 0.03098106712564544, 'f1-score': 0.03896103896103897, 'support': 581}, 'macro avg': {'precision': 0.05328763385853625, 'recall': 0.03140294606794963, 'f1-score': 0.039517447432211514, 'support': 581}, 'weighted avg': {'precision': 0.0525582114479139, 'recall': 0.03098106712564544, 'f1-score': 0.03898282603972945, 'support': 581}}
Wrong BIO-Encoding 4603/4796 labels, 95.98%
{'C': {'precision': 0.06790123456790123, 'recall': 0.03985507246376811, 'f1-score': 0.0502283105022831, 'support': 276}, 'P': {'precision': 0.03867403314917127, 'recall': 0.022950819672131147, 'f1-score': 0.02880658436213992, 'support': 305}, 'micro avg': {'precision': 0.052478134110787174, 'recall': 0.03098106712564544, 'f1-score': 0.03896103896103897, 'support': 581}, 'macro avg': {'precision': 0.05328763385853625, 'recall': 0.03140294606794963, 'f1-score': 0.039517447432211514, 'support': 581}, 'weighted avg': {'precision': 0.0525582114479139, 'recall': 0.03098106712564544, 'f1-score': 0.03898282603972945, 'support': 581}}
Wrong BIO-Encoding 150/343 labels, 43.73%
Test-Data: Prec: 0.093, Rec: 0.031, F1: 0.0465

Scores from epoch with best dev-scores:
  Dev-Score: 0.0000
  Test-Score 0.0000

3.99 sec for evaluation

--------- Epoch 5 -----------
322.40 sec for training (1640.12 total)
-- cmv_modes1 --
{'C': {'precision': 0.10526315789473684, 'recall': 0.1, 'f1-score': 0.10256410256410256, 'support': 20}, 'P': {'precision': 0.07142857142857142, 'recall': 0.04081632653061224, 'f1-score': 0.051948051948051945, 'support': 49}, 'micro avg': {'precision': 0.0851063829787234, 'recall': 0.057971014492753624, 'f1-score': 0.06896551724137931, 'support': 69}, 'macro avg': {'precision': 0.08834586466165413, 'recall': 0.07040816326530612, 'f1-score': 0.07725607725607725, 'support': 69}, 'weighted avg': {'precision': 0.08123569794050342, 'recall': 0.057971014492753624, 'f1-score': 0.06661937096719704, 'support': 69}}
Wrong BIO-Encoding 361/395 labels, 91.39%
{'C': {'precision': 0.10526315789473684, 'recall': 0.1, 'f1-score': 0.10256410256410256, 'support': 20}, 'P': {'precision': 0.07142857142857142, 'recall': 0.04081632653061224, 'f1-score': 0.051948051948051945, 'support': 49}, 'micro avg': {'precision': 0.0851063829787234, 'recall': 0.057971014492753624, 'f1-score': 0.06896551724137931, 'support': 69}, 'macro avg': {'precision': 0.08834586466165413, 'recall': 0.07040816326530612, 'f1-score': 0.07725607725607725, 'support': 69}, 'weighted avg': {'precision': 0.08123569794050342, 'recall': 0.057971014492753624, 'f1-score': 0.06661937096719704, 'support': 69}}
Wrong BIO-Encoding 13/47 labels, 27.66%
Dev-Data: Prec: 0.118, Rec: 0.058, F1: 0.0777
{'C': {'precision': 0.14, 'recall': 0.12681159420289856, 'f1-score': 0.13307984790874527, 'support': 276}, 'P': {'precision': 0.24017467248908297, 'recall': 0.18032786885245902, 'f1-score': 0.20599250936329588, 'support': 305}, 'micro avg': {'precision': 0.18789144050104384, 'recall': 0.1549053356282272, 'f1-score': 0.16981132075471697, 'support': 581}, 'macro avg': {'precision': 0.1900873362445415, 'recall': 0.15356973152767878, 'f1-score': 0.16953617863602058, 'support': 581}, 'weighted avg': {'precision': 0.19258739261475094, 'recall': 0.1549053356282272, 'f1-score': 0.17135585779452486, 'support': 581}}
Wrong BIO-Encoding 1453/1857 labels, 78.24%
{'C': {'precision': 0.14, 'recall': 0.12681159420289856, 'f1-score': 0.13307984790874527, 'support': 276}, 'P': {'precision': 0.24017467248908297, 'recall': 0.18032786885245902, 'f1-score': 0.20599250936329588, 'support': 305}, 'micro avg': {'precision': 0.18789144050104384, 'recall': 0.1549053356282272, 'f1-score': 0.16981132075471697, 'support': 581}, 'macro avg': {'precision': 0.1900873362445415, 'recall': 0.15356973152767878, 'f1-score': 0.16953617863602058, 'support': 581}, 'weighted avg': {'precision': 0.19258739261475094, 'recall': 0.1549053356282272, 'f1-score': 0.17135585779452486, 'support': 581}}
Wrong BIO-Encoding 75/479 labels, 15.66%
Test-Data: Prec: 0.223, Rec: 0.155, F1: 0.1827

Scores from epoch with best dev-scores:
  Dev-Score: 0.0777
  Test-Score 0.1827

5.43 sec for evaluation

--------- Epoch 6 -----------
325.40 sec for training (1965.52 total)
-- cmv_modes1 --
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 20}, 'P': {'precision': 0.02702702702702703, 'recall': 0.02040816326530612, 'f1-score': 0.023255813953488372, 'support': 49}, 'micro avg': {'precision': 0.022727272727272728, 'recall': 0.014492753623188406, 'f1-score': 0.017699115044247787, 'support': 69}, 'macro avg': {'precision': 0.013513513513513514, 'recall': 0.01020408163265306, 'f1-score': 0.011627906976744186, 'support': 69}, 'weighted avg': {'precision': 0.019193106149627888, 'recall': 0.014492753623188404, 'f1-score': 0.01651499831479609, 'support': 69}}
Wrong BIO-Encoding 167/199 labels, 83.92%
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 20}, 'P': {'precision': 0.02702702702702703, 'recall': 0.02040816326530612, 'f1-score': 0.023255813953488372, 'support': 49}, 'micro avg': {'precision': 0.022727272727272728, 'recall': 0.014492753623188406, 'f1-score': 0.017699115044247787, 'support': 69}, 'macro avg': {'precision': 0.013513513513513514, 'recall': 0.01020408163265306, 'f1-score': 0.011627906976744186, 'support': 69}, 'weighted avg': {'precision': 0.019193106149627888, 'recall': 0.014492753623188404, 'f1-score': 0.01651499831479609, 'support': 69}}
Wrong BIO-Encoding 12/44 labels, 27.27%
Dev-Data: Prec: 0.031, Rec: 0.014, F1: 0.0198
{'C': {'precision': 0.1910828025477707, 'recall': 0.10869565217391304, 'f1-score': 0.13856812933025403, 'support': 276}, 'P': {'precision': 0.19269102990033224, 'recall': 0.1901639344262295, 'f1-score': 0.1914191419141914, 'support': 305}, 'micro avg': {'precision': 0.19213973799126638, 'recall': 0.1514629948364888, 'f1-score': 0.1693936477382098, 'support': 581}, 'macro avg': {'precision': 0.19188691622405146, 'recall': 0.14942979330007128, 'f1-score': 0.16499363562222272, 'support': 581}, 'weighted avg': {'precision': 0.19192705270703278, 'recall': 0.1514629948364888, 'f1-score': 0.16631263679686487, 'support': 581}}
Wrong BIO-Encoding 1292/1696 labels, 76.18%
{'C': {'precision': 0.1910828025477707, 'recall': 0.10869565217391304, 'f1-score': 0.13856812933025403, 'support': 276}, 'P': {'precision': 0.19269102990033224, 'recall': 0.1901639344262295, 'f1-score': 0.1914191419141914, 'support': 305}, 'micro avg': {'precision': 0.19213973799126638, 'recall': 0.1514629948364888, 'f1-score': 0.1693936477382098, 'support': 581}, 'macro avg': {'precision': 0.19188691622405146, 'recall': 0.14942979330007128, 'f1-score': 0.16499363562222272, 'support': 581}, 'weighted avg': {'precision': 0.19192705270703278, 'recall': 0.1514629948364888, 'f1-score': 0.16631263679686487, 'support': 581}}
Wrong BIO-Encoding 54/458 labels, 11.79%
Test-Data: Prec: 0.218, Rec: 0.151, F1: 0.1787

Scores from epoch with best dev-scores:
  Dev-Score: 0.0777
  Test-Score 0.1827

3.97 sec for evaluation

--------- Epoch 7 -----------
326.11 sec for training (2291.63 total)
-- cmv_modes1 --
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 20}, 'P': {'precision': 0.1388888888888889, 'recall': 0.10204081632653061, 'f1-score': 0.11764705882352941, 'support': 49}, 'micro avg': {'precision': 0.11904761904761904, 'recall': 0.07246376811594203, 'f1-score': 0.09009009009009009, 'support': 69}, 'macro avg': {'precision': 0.06944444444444445, 'recall': 0.05102040816326531, 'f1-score': 0.058823529411764705, 'support': 69}, 'weighted avg': {'precision': 0.09863123993558777, 'recall': 0.07246376811594203, 'f1-score': 0.08354646206308611, 'support': 69}}
Wrong BIO-Encoding 150/185 labels, 81.08%
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 20}, 'P': {'precision': 0.1388888888888889, 'recall': 0.10204081632653061, 'f1-score': 0.11764705882352941, 'support': 49}, 'micro avg': {'precision': 0.11904761904761904, 'recall': 0.07246376811594203, 'f1-score': 0.09009009009009009, 'support': 69}, 'macro avg': {'precision': 0.06944444444444445, 'recall': 0.05102040816326531, 'f1-score': 0.058823529411764705, 'support': 69}, 'weighted avg': {'precision': 0.09863123993558777, 'recall': 0.07246376811594203, 'f1-score': 0.08354646206308611, 'support': 69}}
Wrong BIO-Encoding 7/42 labels, 16.67%
Dev-Data: Prec: 0.143, Rec: 0.072, F1: 0.0962
{'C': {'precision': 0.27205882352941174, 'recall': 0.13405797101449277, 'f1-score': 0.17961165048543692, 'support': 276}, 'P': {'precision': 0.1971326164874552, 'recall': 0.18032786885245902, 'f1-score': 0.18835616438356165, 'support': 305}, 'micro avg': {'precision': 0.2216867469879518, 'recall': 0.15834767641996558, 'f1-score': 0.18473895582329317, 'support': 581}, 'macro avg': {'precision': 0.23459572000843348, 'recall': 0.1571929199334759, 'f1-score': 0.18398390743449927, 'support': 581}, 'weighted avg': {'precision': 0.23272578885162043, 'recall': 0.15834767641996558, 'f1-score': 0.18420214401199123, 'support': 581}}
Wrong BIO-Encoding 657/1043 labels, 62.99%
{'C': {'precision': 0.27205882352941174, 'recall': 0.13405797101449277, 'f1-score': 0.17961165048543692, 'support': 276}, 'P': {'precision': 0.1971326164874552, 'recall': 0.18032786885245902, 'f1-score': 0.18835616438356165, 'support': 305}, 'micro avg': {'precision': 0.2216867469879518, 'recall': 0.15834767641996558, 'f1-score': 0.18473895582329317, 'support': 581}, 'macro avg': {'precision': 0.23459572000843348, 'recall': 0.1571929199334759, 'f1-score': 0.18398390743449927, 'support': 581}, 'weighted avg': {'precision': 0.23272578885162043, 'recall': 0.15834767641996558, 'f1-score': 0.18420214401199123, 'support': 581}}
Wrong BIO-Encoding 29/415 labels, 6.99%
Test-Data: Prec: 0.238, Rec: 0.158, F1: 0.1903

Scores from epoch with best dev-scores:
  Dev-Score: 0.0962
  Test-Score 0.1903

4.66 sec for evaluation

--------- Epoch 8 -----------
325.60 sec for training (2617.23 total)
-- cmv_modes1 --
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 20}, 'P': {'precision': 0.13157894736842105, 'recall': 0.10204081632653061, 'f1-score': 0.11494252873563218, 'support': 49}, 'micro avg': {'precision': 0.125, 'recall': 0.07246376811594203, 'f1-score': 0.09174311926605505, 'support': 69}, 'macro avg': {'precision': 0.06578947368421052, 'recall': 0.05102040816326531, 'f1-score': 0.05747126436781609, 'support': 69}, 'weighted avg': {'precision': 0.09344012204424103, 'recall': 0.07246376811594203, 'f1-score': 0.08162585373979676, 'support': 69}}
Wrong BIO-Encoding 71/108 labels, 65.74%
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 20}, 'P': {'precision': 0.13157894736842105, 'recall': 0.10204081632653061, 'f1-score': 0.11494252873563218, 'support': 49}, 'micro avg': {'precision': 0.125, 'recall': 0.07246376811594203, 'f1-score': 0.09174311926605505, 'support': 69}, 'macro avg': {'precision': 0.06578947368421052, 'recall': 0.05102040816326531, 'f1-score': 0.05747126436781609, 'support': 69}, 'weighted avg': {'precision': 0.09344012204424103, 'recall': 0.07246376811594203, 'f1-score': 0.08162585373979676, 'support': 69}}
Wrong BIO-Encoding 3/40 labels, 7.50%
Dev-Data: Prec: 0.135, Rec: 0.072, F1: 0.0943
{'C': {'precision': 0.18620689655172415, 'recall': 0.09782608695652174, 'f1-score': 0.12826603325415675, 'support': 276}, 'P': {'precision': 0.2347266881028939, 'recall': 0.23934426229508196, 'f1-score': 0.237012987012987, 'support': 305}, 'micro avg': {'precision': 0.21929824561403508, 'recall': 0.1721170395869191, 'f1-score': 0.19286403085824494, 'support': 581}, 'macro avg': {'precision': 0.21046679232730903, 'recall': 0.16858517462580186, 'f1-score': 0.18263951013357188, 'support': 581}, 'weighted avg': {'precision': 0.21167769934536748, 'recall': 0.1721170395869191, 'f1-score': 0.18535350467660636, 'support': 581}}
Wrong BIO-Encoding 686/1119 labels, 61.30%
{'C': {'precision': 0.18620689655172415, 'recall': 0.09782608695652174, 'f1-score': 0.12826603325415675, 'support': 276}, 'P': {'precision': 0.2347266881028939, 'recall': 0.23934426229508196, 'f1-score': 0.237012987012987, 'support': 305}, 'micro avg': {'precision': 0.21929824561403508, 'recall': 0.1721170395869191, 'f1-score': 0.19286403085824494, 'support': 581}, 'macro avg': {'precision': 0.21046679232730903, 'recall': 0.16858517462580186, 'f1-score': 0.18263951013357188, 'support': 581}, 'weighted avg': {'precision': 0.21167769934536748, 'recall': 0.1721170395869191, 'f1-score': 0.18535350467660636, 'support': 581}}
Wrong BIO-Encoding 23/456 labels, 5.04%
Test-Data: Prec: 0.231, Rec: 0.172, F1: 0.1972

Scores from epoch with best dev-scores:
  Dev-Score: 0.0962
  Test-Score 0.1903

4.01 sec for evaluation

--------- Epoch 9 -----------
326.59 sec for training (2943.82 total)
-- cmv_modes1 --
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 20}, 'P': {'precision': 0.18181818181818182, 'recall': 0.12244897959183673, 'f1-score': 0.14634146341463417, 'support': 49}, 'micro avg': {'precision': 0.15384615384615385, 'recall': 0.08695652173913043, 'f1-score': 0.1111111111111111, 'support': 69}, 'macro avg': {'precision': 0.09090909090909091, 'recall': 0.061224489795918366, 'f1-score': 0.07317073170731708, 'support': 69}, 'weighted avg': {'precision': 0.12911725955204217, 'recall': 0.08695652173913043, 'f1-score': 0.1039236479321315, 'support': 69}}
Wrong BIO-Encoding 30/67 labels, 44.78%
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 20}, 'P': {'precision': 0.18181818181818182, 'recall': 0.12244897959183673, 'f1-score': 0.14634146341463417, 'support': 49}, 'micro avg': {'precision': 0.15384615384615385, 'recall': 0.08695652173913043, 'f1-score': 0.1111111111111111, 'support': 69}, 'macro avg': {'precision': 0.09090909090909091, 'recall': 0.061224489795918366, 'f1-score': 0.07317073170731708, 'support': 69}, 'weighted avg': {'precision': 0.12911725955204217, 'recall': 0.08695652173913043, 'f1-score': 0.1039236479321315, 'support': 69}}
Wrong BIO-Encoding 2/39 labels, 5.13%
Dev-Data: Prec: 0.162, Rec: 0.087, F1: 0.1132
{'C': {'precision': 0.2818181818181818, 'recall': 0.2246376811594203, 'f1-score': 0.24999999999999994, 'support': 276}, 'P': {'precision': 0.25766871165644173, 'recall': 0.2754098360655738, 'f1-score': 0.266244057052298, 'support': 305}, 'micro avg': {'precision': 0.2673992673992674, 'recall': 0.2512908777969019, 'f1-score': 0.259094942324756, 'support': 581}, 'macro avg': {'precision': 0.26974344673731177, 'recall': 0.25002375861249704, 'f1-score': 0.25812202852614896, 'support': 581}, 'weighted avg': {'precision': 0.2691407491170962, 'recall': 0.2512908777969019, 'f1-score': 0.25852743098270375, 'support': 581}}
Wrong BIO-Encoding 1019/1522 labels, 66.95%
{'C': {'precision': 0.2818181818181818, 'recall': 0.2246376811594203, 'f1-score': 0.24999999999999994, 'support': 276}, 'P': {'precision': 0.25766871165644173, 'recall': 0.2754098360655738, 'f1-score': 0.266244057052298, 'support': 305}, 'micro avg': {'precision': 0.2673992673992674, 'recall': 0.2512908777969019, 'f1-score': 0.259094942324756, 'support': 581}, 'macro avg': {'precision': 0.26974344673731177, 'recall': 0.25002375861249704, 'f1-score': 0.25812202852614896, 'support': 581}, 'weighted avg': {'precision': 0.2691407491170962, 'recall': 0.2512908777969019, 'f1-score': 0.25852743098270375, 'support': 581}}
Wrong BIO-Encoding 43/546 labels, 7.88%
Test-Data: Prec: 0.290, Rec: 0.251, F1: 0.2694

Scores from epoch with best dev-scores:
  Dev-Score: 0.1132
  Test-Score 0.2694

4.45 sec for evaluation

--------- Epoch 10 -----------
327.06 sec for training (3270.88 total)
-- cmv_modes1 --
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 20}, 'P': {'precision': 0.03333333333333333, 'recall': 0.02040816326530612, 'f1-score': 0.025316455696202528, 'support': 49}, 'micro avg': {'precision': 0.02702702702702703, 'recall': 0.014492753623188406, 'f1-score': 0.018867924528301886, 'support': 69}, 'macro avg': {'precision': 0.016666666666666666, 'recall': 0.01020408163265306, 'f1-score': 0.012658227848101264, 'support': 69}, 'weighted avg': {'precision': 0.02367149758454106, 'recall': 0.014492753623188404, 'f1-score': 0.017978352595853966, 'support': 69}}
Wrong BIO-Encoding 75/108 labels, 69.44%
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 20}, 'P': {'precision': 0.03333333333333333, 'recall': 0.02040816326530612, 'f1-score': 0.025316455696202528, 'support': 49}, 'micro avg': {'precision': 0.02702702702702703, 'recall': 0.014492753623188406, 'f1-score': 0.018867924528301886, 'support': 69}, 'macro avg': {'precision': 0.016666666666666666, 'recall': 0.01020408163265306, 'f1-score': 0.012658227848101264, 'support': 69}, 'weighted avg': {'precision': 0.02367149758454106, 'recall': 0.014492753623188404, 'f1-score': 0.017978352595853966, 'support': 69}}
Wrong BIO-Encoding 4/37 labels, 10.81%
Dev-Data: Prec: 0.030, Rec: 0.014, F1: 0.0196
{'C': {'precision': 0.23255813953488372, 'recall': 0.21739130434782608, 'f1-score': 0.2247191011235955, 'support': 276}, 'P': {'precision': 0.2635135135135135, 'recall': 0.25573770491803277, 'f1-score': 0.25956738768718796, 'support': 305}, 'micro avg': {'precision': 0.2490974729241877, 'recall': 0.23752151462994836, 'f1-score': 0.2431718061674009, 'support': 581}, 'macro avg': {'precision': 0.2480358265241986, 'recall': 0.23656450463292944, 'f1-score': 0.24214324440539173, 'support': 581}, 'weighted avg': {'precision': 0.24880837888683224, 'recall': 0.23752151462994836, 'f1-score': 0.24301295207350204, 'support': 581}}
Wrong BIO-Encoding 1411/1902 labels, 74.19%
{'C': {'precision': 0.23255813953488372, 'recall': 0.21739130434782608, 'f1-score': 0.2247191011235955, 'support': 276}, 'P': {'precision': 0.2635135135135135, 'recall': 0.25573770491803277, 'f1-score': 0.25956738768718796, 'support': 305}, 'micro avg': {'precision': 0.2490974729241877, 'recall': 0.23752151462994836, 'f1-score': 0.2431718061674009, 'support': 581}, 'macro avg': {'precision': 0.2480358265241986, 'recall': 0.23656450463292944, 'f1-score': 0.24214324440539173, 'support': 581}, 'weighted avg': {'precision': 0.24880837888683224, 'recall': 0.23752151462994836, 'f1-score': 0.24301295207350204, 'support': 581}}
Wrong BIO-Encoding 63/554 labels, 11.37%
Test-Data: Prec: 0.281, Rec: 0.238, F1: 0.2575

Scores from epoch with best dev-scores:
  Dev-Score: 0.1132
  Test-Score 0.2694

3.97 sec for evaluation

--------- Epoch 11 -----------
323.85 sec for training (3594.73 total)
-- cmv_modes1 --
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 20}, 'P': {'precision': 0.2, 'recall': 0.16326530612244897, 'f1-score': 0.17977528089887637, 'support': 49}, 'micro avg': {'precision': 0.17777777777777778, 'recall': 0.11594202898550725, 'f1-score': 0.14035087719298248, 'support': 69}, 'macro avg': {'precision': 0.1, 'recall': 0.08163265306122448, 'f1-score': 0.08988764044943819, 'support': 69}, 'weighted avg': {'precision': 0.14202898550724638, 'recall': 0.11594202898550723, 'f1-score': 0.1276665038267383, 'support': 69}}
Wrong BIO-Encoding 85/125 labels, 68.00%
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 20}, 'P': {'precision': 0.2, 'recall': 0.16326530612244897, 'f1-score': 0.17977528089887637, 'support': 49}, 'micro avg': {'precision': 0.17777777777777778, 'recall': 0.11594202898550725, 'f1-score': 0.14035087719298248, 'support': 69}, 'macro avg': {'precision': 0.1, 'recall': 0.08163265306122448, 'f1-score': 0.08988764044943819, 'support': 69}, 'weighted avg': {'precision': 0.14202898550724638, 'recall': 0.11594202898550723, 'f1-score': 0.1276665038267383, 'support': 69}}
Wrong BIO-Encoding 5/45 labels, 11.11%
Dev-Data: Prec: 0.178, Rec: 0.116, F1: 0.1404
{'C': {'precision': 0.2011173184357542, 'recall': 0.13043478260869565, 'f1-score': 0.15824175824175823, 'support': 276}, 'P': {'precision': 0.25483870967741934, 'recall': 0.25901639344262295, 'f1-score': 0.2569105691056911, 'support': 305}, 'micro avg': {'precision': 0.23517382413087934, 'recall': 0.19793459552495696, 'f1-score': 0.21495327102803735, 'support': 581}, 'macro avg': {'precision': 0.22797801405658677, 'recall': 0.1947255880256593, 'f1-score': 0.20757616367372467, 'support': 581}, 'weighted avg': {'precision': 0.22931873724592267, 'recall': 0.19793459552495696, 'f1-score': 0.21003863829941663, 'support': 581}}
Wrong BIO-Encoding 553/1012 labels, 54.64%
{'C': {'precision': 0.2011173184357542, 'recall': 0.13043478260869565, 'f1-score': 0.15824175824175823, 'support': 276}, 'P': {'precision': 0.25483870967741934, 'recall': 0.25901639344262295, 'f1-score': 0.2569105691056911, 'support': 305}, 'micro avg': {'precision': 0.23517382413087934, 'recall': 0.19793459552495696, 'f1-score': 0.21495327102803735, 'support': 581}, 'macro avg': {'precision': 0.22797801405658677, 'recall': 0.1947255880256593, 'f1-score': 0.20757616367372467, 'support': 581}, 'weighted avg': {'precision': 0.22931873724592267, 'recall': 0.19793459552495696, 'f1-score': 0.21003863829941663, 'support': 581}}
Wrong BIO-Encoding 30/489 labels, 6.13%
Test-Data: Prec: 0.251, Rec: 0.198, F1: 0.2212

Scores from epoch with best dev-scores:
  Dev-Score: 0.1404
  Test-Score 0.2212

4.69 sec for evaluation

--------- Epoch 12 -----------
327.07 sec for training (3921.80 total)
-- cmv_modes1 --
{'C': {'precision': 0.11764705882352941, 'recall': 0.2, 'f1-score': 0.14814814814814817, 'support': 20}, 'P': {'precision': 0.3333333333333333, 'recall': 0.16326530612244897, 'f1-score': 0.21917808219178078, 'support': 49}, 'micro avg': {'precision': 0.20689655172413793, 'recall': 0.17391304347826086, 'f1-score': 0.1889763779527559, 'support': 69}, 'macro avg': {'precision': 0.22549019607843135, 'recall': 0.1816326530612245, 'f1-score': 0.18366311516996447, 'support': 69}, 'weighted avg': {'precision': 0.2708155726058539, 'recall': 0.17391304347826086, 'f1-score': 0.198589695512467, 'support': 69}}
Wrong BIO-Encoding 227/283 labels, 80.21%
{'C': {'precision': 0.11764705882352941, 'recall': 0.2, 'f1-score': 0.14814814814814817, 'support': 20}, 'P': {'precision': 0.3333333333333333, 'recall': 0.16326530612244897, 'f1-score': 0.21917808219178078, 'support': 49}, 'micro avg': {'precision': 0.20689655172413793, 'recall': 0.17391304347826086, 'f1-score': 0.1889763779527559, 'support': 69}, 'macro avg': {'precision': 0.22549019607843135, 'recall': 0.1816326530612245, 'f1-score': 0.18366311516996447, 'support': 69}, 'weighted avg': {'precision': 0.2708155726058539, 'recall': 0.17391304347826086, 'f1-score': 0.198589695512467, 'support': 69}}
Wrong BIO-Encoding 2/58 labels, 3.45%
Dev-Data: Prec: 0.214, Rec: 0.174, F1: 0.1920
{'C': {'precision': 0.15578947368421053, 'recall': 0.26811594202898553, 'f1-score': 0.1970705725699068, 'support': 276}, 'P': {'precision': 0.27530364372469635, 'recall': 0.22295081967213115, 'f1-score': 0.24637681159420288, 'support': 305}, 'micro avg': {'precision': 0.19667590027700832, 'recall': 0.24440619621342513, 'f1-score': 0.21795855717574827, 'support': 581}, 'macro avg': {'precision': 0.21554655870445344, 'recall': 0.24553338085055834, 'f1-score': 0.22172369208205484, 'support': 581}, 'weighted avg': {'precision': 0.21852927034918157, 'recall': 0.24440619621342513, 'f1-score': 0.22295422644668872, 'support': 581}}
Wrong BIO-Encoding 360/1062 labels, 33.90%
{'C': {'precision': 0.15578947368421053, 'recall': 0.26811594202898553, 'f1-score': 0.1970705725699068, 'support': 276}, 'P': {'precision': 0.27530364372469635, 'recall': 0.22295081967213115, 'f1-score': 0.24637681159420288, 'support': 305}, 'micro avg': {'precision': 0.19667590027700832, 'recall': 0.24440619621342513, 'f1-score': 0.21795855717574827, 'support': 581}, 'macro avg': {'precision': 0.21554655870445344, 'recall': 0.24553338085055834, 'f1-score': 0.22172369208205484, 'support': 581}, 'weighted avg': {'precision': 0.21852927034918157, 'recall': 0.24440619621342513, 'f1-score': 0.22295422644668872, 'support': 581}}
Wrong BIO-Encoding 20/722 labels, 2.77%
Test-Data: Prec: 0.202, Rec: 0.244, F1: 0.2214

Scores from epoch with best dev-scores:
  Dev-Score: 0.1920
  Test-Score 0.2214

4.69 sec for evaluation

--------- Epoch 13 -----------
338.95 sec for training (4260.76 total)
-- cmv_modes1 --
{'C': {'precision': 0.08333333333333333, 'recall': 0.05, 'f1-score': 0.0625, 'support': 20}, 'P': {'precision': 0.17647058823529413, 'recall': 0.12244897959183673, 'f1-score': 0.14457831325301204, 'support': 49}, 'micro avg': {'precision': 0.15217391304347827, 'recall': 0.10144927536231885, 'f1-score': 0.12173913043478261, 'support': 69}, 'macro avg': {'precision': 0.12990196078431374, 'recall': 0.08622448979591837, 'f1-score': 0.10353915662650602, 'support': 69}, 'weighted avg': {'precision': 0.14947428246660985, 'recall': 0.10144927536231885, 'f1-score': 0.12078749781735637, 'support': 69}}
Wrong BIO-Encoding 46/89 labels, 51.69%
{'C': {'precision': 0.08333333333333333, 'recall': 0.05, 'f1-score': 0.0625, 'support': 20}, 'P': {'precision': 0.17647058823529413, 'recall': 0.12244897959183673, 'f1-score': 0.14457831325301204, 'support': 49}, 'micro avg': {'precision': 0.15217391304347827, 'recall': 0.10144927536231885, 'f1-score': 0.12173913043478261, 'support': 69}, 'macro avg': {'precision': 0.12990196078431374, 'recall': 0.08622448979591837, 'f1-score': 0.10353915662650602, 'support': 69}, 'weighted avg': {'precision': 0.14947428246660985, 'recall': 0.10144927536231885, 'f1-score': 0.12078749781735637, 'support': 69}}
Wrong BIO-Encoding 3/46 labels, 6.52%
Dev-Data: Prec: 0.163, Rec: 0.101, F1: 0.1250
{'C': {'precision': 0.14644351464435146, 'recall': 0.12681159420289856, 'f1-score': 0.1359223300970874, 'support': 276}, 'P': {'precision': 0.18688524590163935, 'recall': 0.18688524590163935, 'f1-score': 0.18688524590163935, 'support': 305}, 'micro avg': {'precision': 0.16911764705882354, 'recall': 0.15834767641996558, 'f1-score': 0.16355555555555557, 'support': 581}, 'macro avg': {'precision': 0.1666643802729954, 'recall': 0.15684842005226896, 'f1-score': 0.1614037879993634, 'support': 581}, 'weighted avg': {'precision': 0.16767368337666266, 'recall': 0.15834767641996558, 'f1-score': 0.1626756679979279, 'support': 581}}
Wrong BIO-Encoding 157/690 labels, 22.75%
{'C': {'precision': 0.14644351464435146, 'recall': 0.12681159420289856, 'f1-score': 0.1359223300970874, 'support': 276}, 'P': {'precision': 0.18688524590163935, 'recall': 0.18688524590163935, 'f1-score': 0.18688524590163935, 'support': 305}, 'micro avg': {'precision': 0.16911764705882354, 'recall': 0.15834767641996558, 'f1-score': 0.16355555555555557, 'support': 581}, 'macro avg': {'precision': 0.1666643802729954, 'recall': 0.15684842005226896, 'f1-score': 0.1614037879993634, 'support': 581}, 'weighted avg': {'precision': 0.16767368337666266, 'recall': 0.15834767641996558, 'f1-score': 0.1626756679979279, 'support': 581}}
Wrong BIO-Encoding 11/544 labels, 2.02%
Test-Data: Prec: 0.173, Rec: 0.158, F1: 0.1652

Scores from epoch with best dev-scores:
  Dev-Score: 0.1920
  Test-Score 0.2214

4.50 sec for evaluation

--------- Epoch 14 -----------
344.28 sec for training (4605.03 total)
-- cmv_modes1 --
{'C': {'precision': 0.15, 'recall': 0.15, 'f1-score': 0.15, 'support': 20}, 'P': {'precision': 0.23076923076923078, 'recall': 0.12244897959183673, 'f1-score': 0.16, 'support': 49}, 'micro avg': {'precision': 0.1956521739130435, 'recall': 0.13043478260869565, 'f1-score': 0.1565217391304348, 'support': 69}, 'macro avg': {'precision': 0.19038461538461537, 'recall': 0.13622448979591836, 'f1-score': 0.155, 'support': 69}, 'weighted avg': {'precision': 0.20735785953177258, 'recall': 0.13043478260869565, 'f1-score': 0.15710144927536232, 'support': 69}}
Wrong BIO-Encoding 16/61 labels, 26.23%
{'C': {'precision': 0.15, 'recall': 0.15, 'f1-score': 0.15, 'support': 20}, 'P': {'precision': 0.23076923076923078, 'recall': 0.12244897959183673, 'f1-score': 0.16, 'support': 49}, 'micro avg': {'precision': 0.1956521739130435, 'recall': 0.13043478260869565, 'f1-score': 0.1565217391304348, 'support': 69}, 'macro avg': {'precision': 0.19038461538461537, 'recall': 0.13622448979591836, 'f1-score': 0.155, 'support': 69}, 'weighted avg': {'precision': 0.20735785953177258, 'recall': 0.13043478260869565, 'f1-score': 0.15710144927536232, 'support': 69}}
Wrong BIO-Encoding 1/46 labels, 2.17%
Dev-Data: Prec: 0.196, Rec: 0.130, F1: 0.1565
{'C': {'precision': 0.15501519756838905, 'recall': 0.18478260869565216, 'f1-score': 0.16859504132231404, 'support': 276}, 'P': {'precision': 0.20361990950226244, 'recall': 0.14754098360655737, 'f1-score': 0.17110266159695817, 'support': 305}, 'micro avg': {'precision': 0.17454545454545456, 'recall': 0.16523235800344235, 'f1-score': 0.16976127320954906, 'support': 581}, 'macro avg': {'precision': 0.17931755353532575, 'recall': 0.16616179615110477, 'f1-score': 0.1698488514596361, 'support': 581}, 'weighted avg': {'precision': 0.18053057990889057, 'recall': 0.16523235800344235, 'f1-score': 0.1699114340654577, 'support': 581}}
Wrong BIO-Encoding 266/803 labels, 33.13%
{'C': {'precision': 0.15501519756838905, 'recall': 0.18478260869565216, 'f1-score': 0.16859504132231404, 'support': 276}, 'P': {'precision': 0.20361990950226244, 'recall': 0.14754098360655737, 'f1-score': 0.17110266159695817, 'support': 305}, 'micro avg': {'precision': 0.17454545454545456, 'recall': 0.16523235800344235, 'f1-score': 0.16976127320954906, 'support': 581}, 'macro avg': {'precision': 0.17931755353532575, 'recall': 0.16616179615110477, 'f1-score': 0.1698488514596361, 'support': 581}, 'weighted avg': {'precision': 0.18053057990889057, 'recall': 0.16523235800344235, 'f1-score': 0.1699114340654577, 'support': 581}}
Wrong BIO-Encoding 13/550 labels, 2.36%
Test-Data: Prec: 0.179, Rec: 0.165, F1: 0.1717

Scores from epoch with best dev-scores:
  Dev-Score: 0.1920
  Test-Score 0.2214

4.29 sec for evaluation

--------- Epoch 15 -----------
344.26 sec for training (4949.29 total)
-- cmv_modes1 --
{'C': {'precision': 0.1111111111111111, 'recall': 0.05, 'f1-score': 0.06896551724137932, 'support': 20}, 'P': {'precision': 0.20689655172413793, 'recall': 0.12244897959183673, 'f1-score': 0.15384615384615385, 'support': 49}, 'micro avg': {'precision': 0.18421052631578946, 'recall': 0.10144927536231885, 'f1-score': 0.1308411214953271, 'support': 69}, 'macro avg': {'precision': 0.15900383141762453, 'recall': 0.08622448979591837, 'f1-score': 0.1114058355437666, 'support': 69}, 'weighted avg': {'precision': 0.17913265589427507, 'recall': 0.10144927536231885, 'f1-score': 0.12924307077230618, 'support': 69}}
Wrong BIO-Encoding 16/53 labels, 30.19%
{'C': {'precision': 0.1111111111111111, 'recall': 0.05, 'f1-score': 0.06896551724137932, 'support': 20}, 'P': {'precision': 0.20689655172413793, 'recall': 0.12244897959183673, 'f1-score': 0.15384615384615385, 'support': 49}, 'micro avg': {'precision': 0.18421052631578946, 'recall': 0.10144927536231885, 'f1-score': 0.1308411214953271, 'support': 69}, 'macro avg': {'precision': 0.15900383141762453, 'recall': 0.08622448979591837, 'f1-score': 0.1114058355437666, 'support': 69}, 'weighted avg': {'precision': 0.17913265589427507, 'recall': 0.10144927536231885, 'f1-score': 0.12924307077230618, 'support': 69}}
Wrong BIO-Encoding 1/38 labels, 2.63%
Dev-Data: Prec: 0.189, Rec: 0.101, F1: 0.1321
{'C': {'precision': 0.11065573770491803, 'recall': 0.09782608695652174, 'f1-score': 0.10384615384615385, 'support': 276}, 'P': {'precision': 0.1952191235059761, 'recall': 0.16065573770491803, 'f1-score': 0.1762589928057554, 'support': 305}, 'micro avg': {'precision': 0.15353535353535352, 'recall': 0.13080895008605853, 'f1-score': 0.1412639405204461, 'support': 581}, 'macro avg': {'precision': 0.15293743060544707, 'recall': 0.12924091233071988, 'f1-score': 0.14005257332595464, 'support': 581}, 'weighted avg': {'precision': 0.15504787655056812, 'recall': 0.13080895008605853, 'f1-score': 0.1418597784290772, 'support': 581}}
Wrong BIO-Encoding 205/689 labels, 29.75%
{'C': {'precision': 0.11065573770491803, 'recall': 0.09782608695652174, 'f1-score': 0.10384615384615385, 'support': 276}, 'P': {'precision': 0.1952191235059761, 'recall': 0.16065573770491803, 'f1-score': 0.1762589928057554, 'support': 305}, 'micro avg': {'precision': 0.15353535353535352, 'recall': 0.13080895008605853, 'f1-score': 0.1412639405204461, 'support': 581}, 'macro avg': {'precision': 0.15293743060544707, 'recall': 0.12924091233071988, 'f1-score': 0.14005257332595464, 'support': 581}, 'weighted avg': {'precision': 0.15504787655056812, 'recall': 0.13080895008605853, 'f1-score': 0.1418597784290772, 'support': 581}}
Wrong BIO-Encoding 11/495 labels, 2.22%
Test-Data: Prec: 0.157, Rec: 0.131, F1: 0.1427

Scores from epoch with best dev-scores:
  Dev-Score: 0.1920
  Test-Score 0.2214

4.48 sec for evaluation

--------- Epoch 16 -----------
344.17 sec for training (5293.46 total)
-- cmv_modes1 --
{'C': {'precision': 0.2727272727272727, 'recall': 0.15, 'f1-score': 0.19354838709677416, 'support': 20}, 'P': {'precision': 0.2413793103448276, 'recall': 0.14285714285714285, 'f1-score': 0.1794871794871795, 'support': 49}, 'micro avg': {'precision': 0.25, 'recall': 0.14492753623188406, 'f1-score': 0.1834862385321101, 'support': 69}, 'macro avg': {'precision': 0.25705329153605017, 'recall': 0.1464285714285714, 'f1-score': 0.18651778329197682, 'support': 69}, 'weighted avg': {'precision': 0.25046567625278265, 'recall': 0.14492753623188406, 'f1-score': 0.18356289183778665, 'support': 69}}
{'C': {'precision': 0.2727272727272727, 'recall': 0.15, 'f1-score': 0.19354838709677416, 'support': 20}, 'P': {'precision': 0.2413793103448276, 'recall': 0.14285714285714285, 'f1-score': 0.1794871794871795, 'support': 49}, 'micro avg': {'precision': 0.25, 'recall': 0.14492753623188406, 'f1-score': 0.1834862385321101, 'support': 69}, 'macro avg': {'precision': 0.25705329153605017, 'recall': 0.1464285714285714, 'f1-score': 0.18651778329197682, 'support': 69}, 'weighted avg': {'precision': 0.25046567625278265, 'recall': 0.14492753623188406, 'f1-score': 0.18356289183778665, 'support': 69}}
Dev-Data: Prec: 0.250, Rec: 0.145, F1: 0.1835
{'C': {'precision': 0.22857142857142856, 'recall': 0.2318840579710145, 'f1-score': 0.2302158273381295, 'support': 276}, 'P': {'precision': 0.2755417956656347, 'recall': 0.29180327868852457, 'f1-score': 0.28343949044585987, 'support': 305}, 'micro avg': {'precision': 0.2537313432835821, 'recall': 0.2633390705679862, 'f1-score': 0.258445945945946, 'support': 581}, 'macro avg': {'precision': 0.25205661211853164, 'recall': 0.2618436683297695, 'f1-score': 0.25682765889199466, 'support': 581}, 'weighted avg': {'precision': 0.25322885019575364, 'recall': 0.2633390705679862, 'f1-score': 0.25815596029485544, 'support': 581}}
Wrong BIO-Encoding 437/1021 labels, 42.80%
{'C': {'precision': 0.22857142857142856, 'recall': 0.2318840579710145, 'f1-score': 0.2302158273381295, 'support': 276}, 'P': {'precision': 0.2755417956656347, 'recall': 0.29180327868852457, 'f1-score': 0.28343949044585987, 'support': 305}, 'micro avg': {'precision': 0.2537313432835821, 'recall': 0.2633390705679862, 'f1-score': 0.258445945945946, 'support': 581}, 'macro avg': {'precision': 0.25205661211853164, 'recall': 0.2618436683297695, 'f1-score': 0.25682765889199466, 'support': 581}, 'weighted avg': {'precision': 0.25322885019575364, 'recall': 0.2633390705679862, 'f1-score': 0.25815596029485544, 'support': 581}}
Wrong BIO-Encoding 19/603 labels, 3.15%
Test-Data: Prec: 0.262, Rec: 0.263, F1: 0.2627

Scores from epoch with best dev-scores:
  Dev-Score: 0.1920
  Test-Score 0.2214

4.45 sec for evaluation

--------- Epoch 17 -----------
344.91 sec for training (5638.37 total)
-- cmv_modes1 --
{'C': {'precision': 0.36363636363636365, 'recall': 0.2, 'f1-score': 0.25806451612903225, 'support': 20}, 'P': {'precision': 0.24242424242424243, 'recall': 0.16326530612244897, 'f1-score': 0.1951219512195122, 'support': 49}, 'micro avg': {'precision': 0.2727272727272727, 'recall': 0.17391304347826086, 'f1-score': 0.21238938053097345, 'support': 69}, 'macro avg': {'precision': 0.30303030303030304, 'recall': 0.1816326530612245, 'f1-score': 0.22659323367427223, 'support': 69}, 'weighted avg': {'precision': 0.27755819060166886, 'recall': 0.17391304347826086, 'f1-score': 0.21336617293241655, 'support': 69}}
Wrong BIO-Encoding 36/78 labels, 46.15%
{'C': {'precision': 0.36363636363636365, 'recall': 0.2, 'f1-score': 0.25806451612903225, 'support': 20}, 'P': {'precision': 0.24242424242424243, 'recall': 0.16326530612244897, 'f1-score': 0.1951219512195122, 'support': 49}, 'micro avg': {'precision': 0.2727272727272727, 'recall': 0.17391304347826086, 'f1-score': 0.21238938053097345, 'support': 69}, 'macro avg': {'precision': 0.30303030303030304, 'recall': 0.1816326530612245, 'f1-score': 0.22659323367427223, 'support': 69}, 'weighted avg': {'precision': 0.27755819060166886, 'recall': 0.17391304347826086, 'f1-score': 0.21336617293241655, 'support': 69}}
Wrong BIO-Encoding 2/44 labels, 4.55%
Dev-Data: Prec: 0.273, Rec: 0.174, F1: 0.2124
{'C': {'precision': 0.242152466367713, 'recall': 0.1956521739130435, 'f1-score': 0.21643286573146295, 'support': 276}, 'P': {'precision': 0.23118279569892472, 'recall': 0.2819672131147541, 'f1-score': 0.25406203840472674, 'support': 305}, 'micro avg': {'precision': 0.23529411764705882, 'recall': 0.24096385542168675, 'f1-score': 0.23809523809523808, 'support': 581}, 'macro avg': {'precision': 0.23666763103331886, 'recall': 0.2388096935138988, 'f1-score': 0.23524745206809483, 'support': 581}, 'weighted avg': {'precision': 0.23639386128340936, 'recall': 0.24096385542168675, 'f1-score': 0.2361865622294758, 'support': 581}}
Wrong BIO-Encoding 649/1211 labels, 53.59%
{'C': {'precision': 0.242152466367713, 'recall': 0.1956521739130435, 'f1-score': 0.21643286573146295, 'support': 276}, 'P': {'precision': 0.23118279569892472, 'recall': 0.2819672131147541, 'f1-score': 0.25406203840472674, 'support': 305}, 'micro avg': {'precision': 0.23529411764705882, 'recall': 0.24096385542168675, 'f1-score': 0.23809523809523808, 'support': 581}, 'macro avg': {'precision': 0.23666763103331886, 'recall': 0.2388096935138988, 'f1-score': 0.23524745206809483, 'support': 581}, 'weighted avg': {'precision': 0.23639386128340936, 'recall': 0.24096385542168675, 'f1-score': 0.2361865622294758, 'support': 581}}
Wrong BIO-Encoding 33/595 labels, 5.55%
Test-Data: Prec: 0.249, Rec: 0.241, F1: 0.2450

Scores from epoch with best dev-scores:
  Dev-Score: 0.2124
  Test-Score 0.2450

5.24 sec for evaluation

--------- Epoch 18 -----------
345.09 sec for training (5983.46 total)
-- cmv_modes1 --
{'C': {'precision': 0.2727272727272727, 'recall': 0.15, 'f1-score': 0.19354838709677416, 'support': 20}, 'P': {'precision': 0.2857142857142857, 'recall': 0.20408163265306123, 'f1-score': 0.23809523809523808, 'support': 49}, 'micro avg': {'precision': 0.2826086956521739, 'recall': 0.18840579710144928, 'f1-score': 0.22608695652173913, 'support': 69}, 'macro avg': {'precision': 0.2792207792207792, 'recall': 0.17704081632653063, 'f1-score': 0.21582181259600614, 'support': 69}, 'weighted avg': {'precision': 0.28194993412384717, 'recall': 0.18840579710144928, 'f1-score': 0.22518310737104563, 'support': 69}}
{'C': {'precision': 0.2727272727272727, 'recall': 0.15, 'f1-score': 0.19354838709677416, 'support': 20}, 'P': {'precision': 0.2857142857142857, 'recall': 0.20408163265306123, 'f1-score': 0.23809523809523808, 'support': 49}, 'micro avg': {'precision': 0.2826086956521739, 'recall': 0.18840579710144928, 'f1-score': 0.22608695652173913, 'support': 69}, 'macro avg': {'precision': 0.2792207792207792, 'recall': 0.17704081632653063, 'f1-score': 0.21582181259600614, 'support': 69}, 'weighted avg': {'precision': 0.28194993412384717, 'recall': 0.18840579710144928, 'f1-score': 0.22518310737104563, 'support': 69}}
Dev-Data: Prec: 0.283, Rec: 0.188, F1: 0.2261
{'C': {'precision': 0.1724137931034483, 'recall': 0.16304347826086957, 'f1-score': 0.1675977653631285, 'support': 276}, 'P': {'precision': 0.2395543175487465, 'recall': 0.2819672131147541, 'f1-score': 0.25903614457831325, 'support': 305}, 'micro avg': {'precision': 0.21129032258064517, 'recall': 0.22547332185886404, 'f1-score': 0.21815154038301415, 'support': 581}, 'macro avg': {'precision': 0.2059840553260974, 'recall': 0.22250534568781183, 'f1-score': 0.2133169549707209, 'support': 581}, 'weighted avg': {'precision': 0.2076596794301539, 'recall': 0.22547332185886404, 'f1-score': 0.2155989799253167, 'support': 581}}
Wrong BIO-Encoding 433/1030 labels, 42.04%
{'C': {'precision': 0.1724137931034483, 'recall': 0.16304347826086957, 'f1-score': 0.1675977653631285, 'support': 276}, 'P': {'precision': 0.2395543175487465, 'recall': 0.2819672131147541, 'f1-score': 0.25903614457831325, 'support': 305}, 'micro avg': {'precision': 0.21129032258064517, 'recall': 0.22547332185886404, 'f1-score': 0.21815154038301415, 'support': 581}, 'macro avg': {'precision': 0.2059840553260974, 'recall': 0.22250534568781183, 'f1-score': 0.2133169549707209, 'support': 581}, 'weighted avg': {'precision': 0.2076596794301539, 'recall': 0.22547332185886404, 'f1-score': 0.2155989799253167, 'support': 581}}
Wrong BIO-Encoding 23/620 labels, 3.71%
Test-Data: Prec: 0.219, Rec: 0.225, F1: 0.2224

Scores from epoch with best dev-scores:
  Dev-Score: 0.2261
  Test-Score 0.2224

5.10 sec for evaluation

--------- Epoch 19 -----------
344.51 sec for training (6327.97 total)
-- cmv_modes1 --
{'C': {'precision': 0.2, 'recall': 0.1, 'f1-score': 0.13333333333333333, 'support': 20}, 'P': {'precision': 0.2777777777777778, 'recall': 0.20408163265306123, 'f1-score': 0.23529411764705882, 'support': 49}, 'micro avg': {'precision': 0.2608695652173913, 'recall': 0.17391304347826086, 'f1-score': 0.20869565217391303, 'support': 69}, 'macro avg': {'precision': 0.2388888888888889, 'recall': 0.1520408163265306, 'f1-score': 0.1843137254901961, 'support': 69}, 'weighted avg': {'precision': 0.25523349436392917, 'recall': 0.17391304347826086, 'f1-score': 0.20574026712134127, 'support': 69}}
{'C': {'precision': 0.2, 'recall': 0.1, 'f1-score': 0.13333333333333333, 'support': 20}, 'P': {'precision': 0.2777777777777778, 'recall': 0.20408163265306123, 'f1-score': 0.23529411764705882, 'support': 49}, 'micro avg': {'precision': 0.2608695652173913, 'recall': 0.17391304347826086, 'f1-score': 0.20869565217391303, 'support': 69}, 'macro avg': {'precision': 0.2388888888888889, 'recall': 0.1520408163265306, 'f1-score': 0.1843137254901961, 'support': 69}, 'weighted avg': {'precision': 0.25523349436392917, 'recall': 0.17391304347826086, 'f1-score': 0.20574026712134127, 'support': 69}}
Dev-Data: Prec: 0.261, Rec: 0.174, F1: 0.2087
{'C': {'precision': 0.16535433070866143, 'recall': 0.15217391304347827, 'f1-score': 0.15849056603773584, 'support': 276}, 'P': {'precision': 0.17971014492753623, 'recall': 0.20327868852459016, 'f1-score': 0.19076923076923075, 'support': 305}, 'micro avg': {'precision': 0.17362270450751252, 'recall': 0.17900172117039587, 'f1-score': 0.17627118644067796, 'support': 581}, 'macro avg': {'precision': 0.17253223781809884, 'recall': 0.17772630078403423, 'f1-score': 0.1746298984034833, 'support': 581}, 'weighted avg': {'precision': 0.17289051545350967, 'recall': 0.17900172117039587, 'f1-score': 0.17543547609471682, 'support': 581}}
Wrong BIO-Encoding 270/856 labels, 31.54%
{'C': {'precision': 0.16535433070866143, 'recall': 0.15217391304347827, 'f1-score': 0.15849056603773584, 'support': 276}, 'P': {'precision': 0.17971014492753623, 'recall': 0.20327868852459016, 'f1-score': 0.19076923076923075, 'support': 305}, 'micro avg': {'precision': 0.17362270450751252, 'recall': 0.17900172117039587, 'f1-score': 0.17627118644067796, 'support': 581}, 'macro avg': {'precision': 0.17253223781809884, 'recall': 0.17772630078403423, 'f1-score': 0.1746298984034833, 'support': 581}, 'weighted avg': {'precision': 0.17289051545350967, 'recall': 0.17900172117039587, 'f1-score': 0.17543547609471682, 'support': 581}}
Wrong BIO-Encoding 13/599 labels, 2.17%
Test-Data: Prec: 0.177, Rec: 0.179, F1: 0.1782

Scores from epoch with best dev-scores:
  Dev-Score: 0.2261
  Test-Score 0.2224

4.48 sec for evaluation

--------- Epoch 20 -----------
343.38 sec for training (6671.36 total)
-- cmv_modes1 --
{'C': {'precision': 0.25, 'recall': 0.1, 'f1-score': 0.14285714285714288, 'support': 20}, 'P': {'precision': 0.2222222222222222, 'recall': 0.16326530612244897, 'f1-score': 0.18823529411764706, 'support': 49}, 'micro avg': {'precision': 0.22727272727272727, 'recall': 0.14492753623188406, 'f1-score': 0.17699115044247787, 'support': 69}, 'macro avg': {'precision': 0.2361111111111111, 'recall': 0.13163265306122449, 'f1-score': 0.16554621848739498, 'support': 69}, 'weighted avg': {'precision': 0.23027375201288242, 'recall': 0.14492753623188406, 'f1-score': 0.17508220679576178, 'support': 69}}
Wrong BIO-Encoding 20/63 labels, 31.75%
{'C': {'precision': 0.25, 'recall': 0.1, 'f1-score': 0.14285714285714288, 'support': 20}, 'P': {'precision': 0.2222222222222222, 'recall': 0.16326530612244897, 'f1-score': 0.18823529411764706, 'support': 49}, 'micro avg': {'precision': 0.22727272727272727, 'recall': 0.14492753623188406, 'f1-score': 0.17699115044247787, 'support': 69}, 'macro avg': {'precision': 0.2361111111111111, 'recall': 0.13163265306122449, 'f1-score': 0.16554621848739498, 'support': 69}, 'weighted avg': {'precision': 0.23027375201288242, 'recall': 0.14492753623188406, 'f1-score': 0.17508220679576178, 'support': 69}}
Wrong BIO-Encoding 1/44 labels, 2.27%
Dev-Data: Prec: 0.233, Rec: 0.145, F1: 0.1786
{'C': {'precision': 0.15609756097560976, 'recall': 0.11594202898550725, 'f1-score': 0.13305613305613306, 'support': 276}, 'P': {'precision': 0.2403560830860534, 'recall': 0.26557377049180325, 'f1-score': 0.2523364485981308, 'support': 305}, 'micro avg': {'precision': 0.20848708487084872, 'recall': 0.1944922547332186, 'f1-score': 0.20124666073018702, 'support': 581}, 'macro avg': {'precision': 0.19822682203083158, 'recall': 0.19075789973865526, 'f1-score': 0.19269629082713194, 'support': 581}, 'weighted avg': {'precision': 0.20032965950174628, 'recall': 0.19449225473321857, 'f1-score': 0.19567316617198385, 'support': 581}}
Wrong BIO-Encoding 341/864 labels, 39.47%
{'C': {'precision': 0.15609756097560976, 'recall': 0.11594202898550725, 'f1-score': 0.13305613305613306, 'support': 276}, 'P': {'precision': 0.2403560830860534, 'recall': 0.26557377049180325, 'f1-score': 0.2523364485981308, 'support': 305}, 'micro avg': {'precision': 0.20848708487084872, 'recall': 0.1944922547332186, 'f1-score': 0.20124666073018702, 'support': 581}, 'macro avg': {'precision': 0.19822682203083158, 'recall': 0.19075789973865526, 'f1-score': 0.19269629082713194, 'support': 581}, 'weighted avg': {'precision': 0.20032965950174628, 'recall': 0.19449225473321857, 'f1-score': 0.19567316617198385, 'support': 581}}
Wrong BIO-Encoding 19/542 labels, 3.51%
Test-Data: Prec: 0.216, Rec: 0.194, F1: 0.2047

Scores from epoch with best dev-scores:
  Dev-Score: 0.2261
  Test-Score 0.2224

4.19 sec for evaluation

--------- Epoch 21 -----------
343.43 sec for training (7014.78 total)
-- cmv_modes1 --
{'C': {'precision': 0.23529411764705882, 'recall': 0.2, 'f1-score': 0.2162162162162162, 'support': 20}, 'P': {'precision': 0.22857142857142856, 'recall': 0.16326530612244897, 'f1-score': 0.19047619047619044, 'support': 49}, 'micro avg': {'precision': 0.23076923076923078, 'recall': 0.17391304347826086, 'f1-score': 0.19834710743801653, 'support': 69}, 'macro avg': {'precision': 0.2319327731092437, 'recall': 0.1816326530612245, 'f1-score': 0.20334620334620332, 'support': 69}, 'weighted avg': {'precision': 0.23052003410059677, 'recall': 0.17391304347826086, 'f1-score': 0.19793706750228485, 'support': 69}}
Wrong BIO-Encoding 68/117 labels, 58.12%
{'C': {'precision': 0.23529411764705882, 'recall': 0.2, 'f1-score': 0.2162162162162162, 'support': 20}, 'P': {'precision': 0.22857142857142856, 'recall': 0.16326530612244897, 'f1-score': 0.19047619047619044, 'support': 49}, 'micro avg': {'precision': 0.23076923076923078, 'recall': 0.17391304347826086, 'f1-score': 0.19834710743801653, 'support': 69}, 'macro avg': {'precision': 0.2319327731092437, 'recall': 0.1816326530612245, 'f1-score': 0.20334620334620332, 'support': 69}, 'weighted avg': {'precision': 0.23052003410059677, 'recall': 0.17391304347826086, 'f1-score': 0.19793706750228485, 'support': 69}}
Wrong BIO-Encoding 3/52 labels, 5.77%
Dev-Data: Prec: 0.245, Rec: 0.174, F1: 0.2034
{'C': {'precision': 0.15666666666666668, 'recall': 0.17028985507246377, 'f1-score': 0.16319444444444442, 'support': 276}, 'P': {'precision': 0.20857142857142857, 'recall': 0.23934426229508196, 'f1-score': 0.22290076335877865, 'support': 305}, 'micro avg': {'precision': 0.18461538461538463, 'recall': 0.20654044750430292, 'f1-score': 0.19496344435418358, 'support': 581}, 'macro avg': {'precision': 0.18261904761904763, 'recall': 0.20481705868377287, 'f1-score': 0.19304760390161152, 'support': 581}, 'weighted avg': {'precision': 0.18391443324317677, 'recall': 0.20654044750430292, 'f1-score': 0.19453769275575583, 'support': 581}}
Wrong BIO-Encoding 227/866 labels, 26.21%
{'C': {'precision': 0.15666666666666668, 'recall': 0.17028985507246377, 'f1-score': 0.16319444444444442, 'support': 276}, 'P': {'precision': 0.20857142857142857, 'recall': 0.23934426229508196, 'f1-score': 0.22290076335877865, 'support': 305}, 'micro avg': {'precision': 0.18461538461538463, 'recall': 0.20654044750430292, 'f1-score': 0.19496344435418358, 'support': 581}, 'macro avg': {'precision': 0.18261904761904763, 'recall': 0.20481705868377287, 'f1-score': 0.19304760390161152, 'support': 581}, 'weighted avg': {'precision': 0.18391443324317677, 'recall': 0.20654044750430292, 'f1-score': 0.19453769275575583, 'support': 581}}
Wrong BIO-Encoding 11/650 labels, 1.69%
Test-Data: Prec: 0.188, Rec: 0.207, F1: 0.1967

Scores from epoch with best dev-scores:
  Dev-Score: 0.2261
  Test-Score 0.2224

4.46 sec for evaluation

--------- Epoch 22 -----------
342.82 sec for training (7357.60 total)
-- cmv_modes1 --
{'C': {'precision': 0.25, 'recall': 0.2, 'f1-score': 0.22222222222222224, 'support': 20}, 'P': {'precision': 0.34146341463414637, 'recall': 0.2857142857142857, 'f1-score': 0.31111111111111117, 'support': 49}, 'micro avg': {'precision': 0.3157894736842105, 'recall': 0.2608695652173913, 'f1-score': 0.28571428571428575, 'support': 69}, 'macro avg': {'precision': 0.2957317073170732, 'recall': 0.24285714285714285, 'f1-score': 0.2666666666666667, 'support': 69}, 'weighted avg': {'precision': 0.31495227995758224, 'recall': 0.2608695652173913, 'f1-score': 0.2853462157809984, 'support': 69}}
{'C': {'precision': 0.25, 'recall': 0.2, 'f1-score': 0.22222222222222224, 'support': 20}, 'P': {'precision': 0.34146341463414637, 'recall': 0.2857142857142857, 'f1-score': 0.31111111111111117, 'support': 49}, 'micro avg': {'precision': 0.3157894736842105, 'recall': 0.2608695652173913, 'f1-score': 0.28571428571428575, 'support': 69}, 'macro avg': {'precision': 0.2957317073170732, 'recall': 0.24285714285714285, 'f1-score': 0.2666666666666667, 'support': 69}, 'weighted avg': {'precision': 0.31495227995758224, 'recall': 0.2608695652173913, 'f1-score': 0.2853462157809984, 'support': 69}}
Dev-Data: Prec: 0.316, Rec: 0.261, F1: 0.2857
{'C': {'precision': 0.1597444089456869, 'recall': 0.18115942028985507, 'f1-score': 0.1697792869269949, 'support': 276}, 'P': {'precision': 0.2521246458923513, 'recall': 0.29180327868852457, 'f1-score': 0.2705167173252279, 'support': 305}, 'micro avg': {'precision': 0.2087087087087087, 'recall': 0.23924268502581755, 'f1-score': 0.22293504410585405, 'support': 581}, 'macro avg': {'precision': 0.20593452741901908, 'recall': 0.2364813494891898, 'f1-score': 0.2201480021261114, 'support': 581}, 'weighted avg': {'precision': 0.2082400582894608, 'recall': 0.23924268502581755, 'f1-score': 0.2226621032289933, 'support': 581}}
Wrong BIO-Encoding 114/773 labels, 14.75%
{'C': {'precision': 0.1597444089456869, 'recall': 0.18115942028985507, 'f1-score': 0.1697792869269949, 'support': 276}, 'P': {'precision': 0.2521246458923513, 'recall': 0.29180327868852457, 'f1-score': 0.2705167173252279, 'support': 305}, 'micro avg': {'precision': 0.2087087087087087, 'recall': 0.23924268502581755, 'f1-score': 0.22293504410585405, 'support': 581}, 'macro avg': {'precision': 0.20593452741901908, 'recall': 0.2364813494891898, 'f1-score': 0.2201480021261114, 'support': 581}, 'weighted avg': {'precision': 0.2082400582894608, 'recall': 0.23924268502581755, 'f1-score': 0.2226621032289933, 'support': 581}}
Wrong BIO-Encoding 7/666 labels, 1.05%
Test-Data: Prec: 0.211, Rec: 0.239, F1: 0.2242

Scores from epoch with best dev-scores:
  Dev-Score: 0.2857
  Test-Score 0.2242

5.15 sec for evaluation

--------- Epoch 23 -----------
343.63 sec for training (7701.24 total)
-- cmv_modes1 --
{'C': {'precision': 0.23076923076923078, 'recall': 0.15, 'f1-score': 0.18181818181818185, 'support': 20}, 'P': {'precision': 0.3611111111111111, 'recall': 0.2653061224489796, 'f1-score': 0.3058823529411765, 'support': 49}, 'micro avg': {'precision': 0.32653061224489793, 'recall': 0.2318840579710145, 'f1-score': 0.2711864406779661, 'support': 69}, 'macro avg': {'precision': 0.29594017094017094, 'recall': 0.2076530612244898, 'f1-score': 0.2438502673796792, 'support': 69}, 'weighted avg': {'precision': 0.3233308559395516, 'recall': 0.2318840579710145, 'f1-score': 0.2699217236301636, 'support': 69}}
Wrong BIO-Encoding 57/104 labels, 54.81%
{'C': {'precision': 0.23076923076923078, 'recall': 0.15, 'f1-score': 0.18181818181818185, 'support': 20}, 'P': {'precision': 0.3611111111111111, 'recall': 0.2653061224489796, 'f1-score': 0.3058823529411765, 'support': 49}, 'micro avg': {'precision': 0.32653061224489793, 'recall': 0.2318840579710145, 'f1-score': 0.2711864406779661, 'support': 69}, 'macro avg': {'precision': 0.29594017094017094, 'recall': 0.2076530612244898, 'f1-score': 0.2438502673796792, 'support': 69}, 'weighted avg': {'precision': 0.3233308559395516, 'recall': 0.2318840579710145, 'f1-score': 0.2699217236301636, 'support': 69}}
Wrong BIO-Encoding 2/49 labels, 4.08%
Dev-Data: Prec: 0.340, Rec: 0.232, F1: 0.2759
{'C': {'precision': 0.16326530612244897, 'recall': 0.14492753623188406, 'f1-score': 0.15355086372360846, 'support': 276}, 'P': {'precision': 0.16566265060240964, 'recall': 0.18032786885245902, 'f1-score': 0.1726844583987441, 'support': 305}, 'micro avg': {'precision': 0.16464471403812825, 'recall': 0.16351118760757316, 'f1-score': 0.16407599309153714, 'support': 581}, 'macro avg': {'precision': 0.16446397836242932, 'recall': 0.16262770254217154, 'f1-score': 0.16311766106117628, 'support': 581}, 'weighted avg': {'precision': 0.16452380881846962, 'recall': 0.16351118760757316, 'f1-score': 0.16359517762363662, 'support': 581}}
Wrong BIO-Encoding 146/716 labels, 20.39%
{'C': {'precision': 0.16326530612244897, 'recall': 0.14492753623188406, 'f1-score': 0.15355086372360846, 'support': 276}, 'P': {'precision': 0.16566265060240964, 'recall': 0.18032786885245902, 'f1-score': 0.1726844583987441, 'support': 305}, 'micro avg': {'precision': 0.16464471403812825, 'recall': 0.16351118760757316, 'f1-score': 0.16407599309153714, 'support': 581}, 'macro avg': {'precision': 0.16446397836242932, 'recall': 0.16262770254217154, 'f1-score': 0.16311766106117628, 'support': 581}, 'weighted avg': {'precision': 0.16452380881846962, 'recall': 0.16351118760757316, 'f1-score': 0.16359517762363662, 'support': 581}}
Wrong BIO-Encoding 7/577 labels, 1.21%
Test-Data: Prec: 0.167, Rec: 0.164, F1: 0.1651

Scores from epoch with best dev-scores:
  Dev-Score: 0.2857
  Test-Score 0.2242

4.44 sec for evaluation

--------- Epoch 24 -----------
344.27 sec for training (8045.51 total)
-- cmv_modes1 --
{'C': {'precision': 0.21052631578947367, 'recall': 0.2, 'f1-score': 0.20512820512820512, 'support': 20}, 'P': {'precision': 0.36363636363636365, 'recall': 0.24489795918367346, 'f1-score': 0.29268292682926833, 'support': 49}, 'micro avg': {'precision': 0.3076923076923077, 'recall': 0.2318840579710145, 'f1-score': 0.2644628099173553, 'support': 69}, 'macro avg': {'precision': 0.28708133971291866, 'recall': 0.22244897959183674, 'f1-score': 0.24890556597873673, 'support': 69}, 'weighted avg': {'precision': 0.31925663962277234, 'recall': 0.2318840579710145, 'f1-score': 0.26730474662606163, 'support': 69}}
{'C': {'precision': 0.21052631578947367, 'recall': 0.2, 'f1-score': 0.20512820512820512, 'support': 20}, 'P': {'precision': 0.36363636363636365, 'recall': 0.24489795918367346, 'f1-score': 0.29268292682926833, 'support': 49}, 'micro avg': {'precision': 0.3076923076923077, 'recall': 0.2318840579710145, 'f1-score': 0.2644628099173553, 'support': 69}, 'macro avg': {'precision': 0.28708133971291866, 'recall': 0.22244897959183674, 'f1-score': 0.24890556597873673, 'support': 69}, 'weighted avg': {'precision': 0.31925663962277234, 'recall': 0.2318840579710145, 'f1-score': 0.26730474662606163, 'support': 69}}
Dev-Data: Prec: 0.308, Rec: 0.232, F1: 0.2645
{'C': {'precision': 0.1387900355871886, 'recall': 0.14130434782608695, 'f1-score': 0.1400359066427289, 'support': 276}, 'P': {'precision': 0.17647058823529413, 'recall': 0.19672131147540983, 'f1-score': 0.18604651162790695, 'support': 305}, 'micro avg': {'precision': 0.15942028985507245, 'recall': 0.1703958691910499, 'f1-score': 0.16472545757071544, 'support': 581}, 'macro avg': {'precision': 0.15763031191124138, 'recall': 0.16901282965074838, 'f1-score': 0.16304120913531794, 'support': 581}, 'weighted avg': {'precision': 0.15857070436115106, 'recall': 0.1703958691910499, 'f1-score': 0.16418949445766748, 'support': 581}}
Wrong BIO-Encoding 106/720 labels, 14.72%
{'C': {'precision': 0.1387900355871886, 'recall': 0.14130434782608695, 'f1-score': 0.1400359066427289, 'support': 276}, 'P': {'precision': 0.17647058823529413, 'recall': 0.19672131147540983, 'f1-score': 0.18604651162790695, 'support': 305}, 'micro avg': {'precision': 0.15942028985507245, 'recall': 0.1703958691910499, 'f1-score': 0.16472545757071544, 'support': 581}, 'macro avg': {'precision': 0.15763031191124138, 'recall': 0.16901282965074838, 'f1-score': 0.16304120913531794, 'support': 581}, 'weighted avg': {'precision': 0.15857070436115106, 'recall': 0.1703958691910499, 'f1-score': 0.16418949445766748, 'support': 581}}
Wrong BIO-Encoding 7/621 labels, 1.13%
Test-Data: Prec: 0.161, Rec: 0.170, F1: 0.1657

Scores from epoch with best dev-scores:
  Dev-Score: 0.2857
  Test-Score 0.2242

4.45 sec for evaluation

--------- Epoch 25 -----------
343.81 sec for training (8389.32 total)
-- cmv_modes1 --
{'C': {'precision': 0.3076923076923077, 'recall': 0.2, 'f1-score': 0.24242424242424246, 'support': 20}, 'P': {'precision': 0.2857142857142857, 'recall': 0.20408163265306123, 'f1-score': 0.23809523809523808, 'support': 49}, 'micro avg': {'precision': 0.2916666666666667, 'recall': 0.2028985507246377, 'f1-score': 0.23931623931623933, 'support': 69}, 'macro avg': {'precision': 0.2967032967032967, 'recall': 0.20204081632653062, 'f1-score': 0.24025974025974028, 'support': 69}, 'weighted avg': {'precision': 0.29208472686733555, 'recall': 0.2028985507246377, 'f1-score': 0.23935002195871763, 'support': 69}}
Wrong BIO-Encoding 57/103 labels, 55.34%
{'C': {'precision': 0.3076923076923077, 'recall': 0.2, 'f1-score': 0.24242424242424246, 'support': 20}, 'P': {'precision': 0.2857142857142857, 'recall': 0.20408163265306123, 'f1-score': 0.23809523809523808, 'support': 49}, 'micro avg': {'precision': 0.2916666666666667, 'recall': 0.2028985507246377, 'f1-score': 0.23931623931623933, 'support': 69}, 'macro avg': {'precision': 0.2967032967032967, 'recall': 0.20204081632653062, 'f1-score': 0.24025974025974028, 'support': 69}, 'weighted avg': {'precision': 0.29208472686733555, 'recall': 0.2028985507246377, 'f1-score': 0.23935002195871763, 'support': 69}}
Wrong BIO-Encoding 2/48 labels, 4.17%
Dev-Data: Prec: 0.304, Rec: 0.203, F1: 0.2435
{'C': {'precision': 0.15765765765765766, 'recall': 0.12681159420289856, 'f1-score': 0.14056224899598393, 'support': 276}, 'P': {'precision': 0.18622448979591838, 'recall': 0.23934426229508196, 'f1-score': 0.2094691535150646, 'support': 305}, 'micro avg': {'precision': 0.1758957654723127, 'recall': 0.18588640275387264, 'f1-score': 0.1807531380753138, 'support': 581}, 'macro avg': {'precision': 0.17194107372678802, 'recall': 0.18307792824899027, 'f1-score': 0.17501570125552426, 'support': 581}, 'weighted avg': {'precision': 0.17265401532060004, 'recall': 0.18588640275387264, 'f1-score': 0.17673540885539804, 'support': 581}}
Wrong BIO-Encoding 141/748 labels, 18.85%
{'C': {'precision': 0.15765765765765766, 'recall': 0.12681159420289856, 'f1-score': 0.14056224899598393, 'support': 276}, 'P': {'precision': 0.18622448979591838, 'recall': 0.23934426229508196, 'f1-score': 0.2094691535150646, 'support': 305}, 'micro avg': {'precision': 0.1758957654723127, 'recall': 0.18588640275387264, 'f1-score': 0.1807531380753138, 'support': 581}, 'macro avg': {'precision': 0.17194107372678802, 'recall': 0.18307792824899027, 'f1-score': 0.17501570125552426, 'support': 581}, 'weighted avg': {'precision': 0.17265401532060004, 'recall': 0.18588640275387264, 'f1-score': 0.17673540885539804, 'support': 581}}
Wrong BIO-Encoding 7/614 labels, 1.14%
Test-Data: Prec: 0.178, Rec: 0.186, F1: 0.1818

Scores from epoch with best dev-scores:
  Dev-Score: 0.2857
  Test-Score 0.2242

4.48 sec for evaluation

--------- Epoch 26 -----------
343.53 sec for training (8732.85 total)
-- cmv_modes1 --
{'C': {'precision': 0.29411764705882354, 'recall': 0.25, 'f1-score': 0.27027027027027023, 'support': 20}, 'P': {'precision': 0.42857142857142855, 'recall': 0.30612244897959184, 'f1-score': 0.35714285714285715, 'support': 49}, 'micro avg': {'precision': 0.38461538461538464, 'recall': 0.2898550724637681, 'f1-score': 0.3305785123966942, 'support': 69}, 'macro avg': {'precision': 0.36134453781512604, 'recall': 0.2780612244897959, 'f1-score': 0.3137065637065637, 'support': 69}, 'weighted avg': {'precision': 0.3895993179880648, 'recall': 0.2898550724637681, 'f1-score': 0.3319623971797885, 'support': 69}}
Wrong BIO-Encoding 34/85 labels, 40.00%
{'C': {'precision': 0.29411764705882354, 'recall': 0.25, 'f1-score': 0.27027027027027023, 'support': 20}, 'P': {'precision': 0.42857142857142855, 'recall': 0.30612244897959184, 'f1-score': 0.35714285714285715, 'support': 49}, 'micro avg': {'precision': 0.38461538461538464, 'recall': 0.2898550724637681, 'f1-score': 0.3305785123966942, 'support': 69}, 'macro avg': {'precision': 0.36134453781512604, 'recall': 0.2780612244897959, 'f1-score': 0.3137065637065637, 'support': 69}, 'weighted avg': {'precision': 0.3895993179880648, 'recall': 0.2898550724637681, 'f1-score': 0.3319623971797885, 'support': 69}}
Wrong BIO-Encoding 1/52 labels, 1.92%
Dev-Data: Prec: 0.392, Rec: 0.290, F1: 0.3333
{'C': {'precision': 0.15677966101694915, 'recall': 0.13405797101449277, 'f1-score': 0.14453125, 'support': 276}, 'P': {'precision': 0.1891891891891892, 'recall': 0.22950819672131148, 'f1-score': 0.20740740740740743, 'support': 305}, 'micro avg': {'precision': 0.17656765676567657, 'recall': 0.18416523235800344, 'f1-score': 0.18028643639427128, 'support': 581}, 'macro avg': {'precision': 0.17298442510306916, 'recall': 0.18178308386790212, 'f1-score': 0.17596932870370371, 'support': 581}, 'weighted avg': {'precision': 0.17379326874936432, 'recall': 0.18416523235800344, 'f1-score': 0.17753852712437052, 'support': 581}}
Wrong BIO-Encoding 53/656 labels, 8.08%
{'C': {'precision': 0.15677966101694915, 'recall': 0.13405797101449277, 'f1-score': 0.14453125, 'support': 276}, 'P': {'precision': 0.1891891891891892, 'recall': 0.22950819672131148, 'f1-score': 0.20740740740740743, 'support': 305}, 'micro avg': {'precision': 0.17656765676567657, 'recall': 0.18416523235800344, 'f1-score': 0.18028643639427128, 'support': 581}, 'macro avg': {'precision': 0.17298442510306916, 'recall': 0.18178308386790212, 'f1-score': 0.17596932870370371, 'support': 581}, 'weighted avg': {'precision': 0.17379326874936432, 'recall': 0.18416523235800344, 'f1-score': 0.17753852712437052, 'support': 581}}
Wrong BIO-Encoding 3/606 labels, 0.50%
Test-Data: Prec: 0.177, Rec: 0.184, F1: 0.1807

Scores from epoch with best dev-scores:
  Dev-Score: 0.3333
  Test-Score 0.1807

5.17 sec for evaluation

--------- Epoch 27 -----------
344.36 sec for training (9077.21 total)
-- cmv_modes1 --
{'C': {'precision': 0.3125, 'recall': 0.25, 'f1-score': 0.2777777777777778, 'support': 20}, 'P': {'precision': 0.46511627906976744, 'recall': 0.40816326530612246, 'f1-score': 0.43478260869565216, 'support': 49}, 'micro avg': {'precision': 0.423728813559322, 'recall': 0.36231884057971014, 'f1-score': 0.39062499999999994, 'support': 69}, 'macro avg': {'precision': 0.3888081395348837, 'recall': 0.32908163265306123, 'f1-score': 0.356280193236715, 'support': 69}, 'weighted avg': {'precision': 0.42087967644084934, 'recall': 0.36231884057971014, 'f1-score': 0.38927396205279, 'support': 69}}
Wrong BIO-Encoding 11/69 labels, 15.94%
{'C': {'precision': 0.3125, 'recall': 0.25, 'f1-score': 0.2777777777777778, 'support': 20}, 'P': {'precision': 0.46511627906976744, 'recall': 0.40816326530612246, 'f1-score': 0.43478260869565216, 'support': 49}, 'micro avg': {'precision': 0.423728813559322, 'recall': 0.36231884057971014, 'f1-score': 0.39062499999999994, 'support': 69}, 'macro avg': {'precision': 0.3888081395348837, 'recall': 0.32908163265306123, 'f1-score': 0.356280193236715, 'support': 69}, 'weighted avg': {'precision': 0.42087967644084934, 'recall': 0.36231884057971014, 'f1-score': 0.38927396205279, 'support': 69}}
Wrong BIO-Encoding 1/59 labels, 1.69%
Dev-Data: Prec: 0.431, Rec: 0.362, F1: 0.3937
{'C': {'precision': 0.17142857142857143, 'recall': 0.13043478260869565, 'f1-score': 0.14814814814814817, 'support': 276}, 'P': {'precision': 0.18421052631578946, 'recall': 0.25245901639344265, 'f1-score': 0.21300138312586447, 'support': 305}, 'micro avg': {'precision': 0.17993630573248406, 'recall': 0.1944922547332186, 'f1-score': 0.1869313482216708, 'support': 581}, 'macro avg': {'precision': 0.17781954887218043, 'recall': 0.19144689950106913, 'f1-score': 0.1805747656370063, 'support': 581}, 'weighted avg': {'precision': 0.17813854774630206, 'recall': 0.1944922547332186, 'f1-score': 0.18219330592474622, 'support': 581}}
Wrong BIO-Encoding 56/680 labels, 8.24%
{'C': {'precision': 0.17142857142857143, 'recall': 0.13043478260869565, 'f1-score': 0.14814814814814817, 'support': 276}, 'P': {'precision': 0.18421052631578946, 'recall': 0.25245901639344265, 'f1-score': 0.21300138312586447, 'support': 305}, 'micro avg': {'precision': 0.17993630573248406, 'recall': 0.1944922547332186, 'f1-score': 0.1869313482216708, 'support': 581}, 'macro avg': {'precision': 0.17781954887218043, 'recall': 0.19144689950106913, 'f1-score': 0.1805747656370063, 'support': 581}, 'weighted avg': {'precision': 0.17813854774630206, 'recall': 0.1944922547332186, 'f1-score': 0.18219330592474622, 'support': 581}}
Wrong BIO-Encoding 4/628 labels, 0.64%
Test-Data: Prec: 0.181, Rec: 0.194, F1: 0.1876

Scores from epoch with best dev-scores:
  Dev-Score: 0.3937
  Test-Score 0.1876

5.12 sec for evaluation

--------- Epoch 28 -----------
343.65 sec for training (9420.86 total)
-- cmv_modes1 --
{'C': {'precision': 0.35714285714285715, 'recall': 0.25, 'f1-score': 0.2941176470588235, 'support': 20}, 'P': {'precision': 0.3157894736842105, 'recall': 0.24489795918367346, 'f1-score': 0.2758620689655173, 'support': 49}, 'micro avg': {'precision': 0.3269230769230769, 'recall': 0.2463768115942029, 'f1-score': 0.2809917355371901, 'support': 69}, 'macro avg': {'precision': 0.3364661654135338, 'recall': 0.24744897959183673, 'f1-score': 0.28498985801217036, 'support': 69}, 'weighted avg': {'precision': 0.3277759616432385, 'recall': 0.2463768115942029, 'f1-score': 0.28115354087662053, 'support': 69}}
Wrong BIO-Encoding 29/79 labels, 36.71%
{'C': {'precision': 0.35714285714285715, 'recall': 0.25, 'f1-score': 0.2941176470588235, 'support': 20}, 'P': {'precision': 0.3157894736842105, 'recall': 0.24489795918367346, 'f1-score': 0.2758620689655173, 'support': 49}, 'micro avg': {'precision': 0.3269230769230769, 'recall': 0.2463768115942029, 'f1-score': 0.2809917355371901, 'support': 69}, 'macro avg': {'precision': 0.3364661654135338, 'recall': 0.24744897959183673, 'f1-score': 0.28498985801217036, 'support': 69}, 'weighted avg': {'precision': 0.3277759616432385, 'recall': 0.2463768115942029, 'f1-score': 0.28115354087662053, 'support': 69}}
Wrong BIO-Encoding 2/52 labels, 3.85%
Dev-Data: Prec: 0.340, Rec: 0.246, F1: 0.2857
{'C': {'precision': 0.15636363636363637, 'recall': 0.15579710144927536, 'f1-score': 0.15607985480943737, 'support': 276}, 'P': {'precision': 0.21495327102803738, 'recall': 0.2262295081967213, 'f1-score': 0.22044728434504793, 'support': 305}, 'micro avg': {'precision': 0.18791946308724833, 'recall': 0.1927710843373494, 'f1-score': 0.1903143585386576, 'support': 581}, 'macro avg': {'precision': 0.1856584536958369, 'recall': 0.19101330482299833, 'f1-score': 0.18826356957724266, 'support': 581}, 'weighted avg': {'precision': 0.18712067349382966, 'recall': 0.1927710843373494, 'f1-score': 0.18986998563277854, 'support': 581}}
Wrong BIO-Encoding 188/775 labels, 24.26%
{'C': {'precision': 0.15636363636363637, 'recall': 0.15579710144927536, 'f1-score': 0.15607985480943737, 'support': 276}, 'P': {'precision': 0.21495327102803738, 'recall': 0.2262295081967213, 'f1-score': 0.22044728434504793, 'support': 305}, 'micro avg': {'precision': 0.18791946308724833, 'recall': 0.1927710843373494, 'f1-score': 0.1903143585386576, 'support': 581}, 'macro avg': {'precision': 0.1856584536958369, 'recall': 0.19101330482299833, 'f1-score': 0.18826356957724266, 'support': 581}, 'weighted avg': {'precision': 0.18712067349382966, 'recall': 0.1927710843373494, 'f1-score': 0.18986998563277854, 'support': 581}}
Wrong BIO-Encoding 9/596 labels, 1.51%
Test-Data: Prec: 0.191, Rec: 0.193, F1: 0.1918

Scores from epoch with best dev-scores:
  Dev-Score: 0.3937
  Test-Score 0.1876

4.45 sec for evaluation

--------- Epoch 29 -----------
344.05 sec for training (9764.91 total)
-- cmv_modes1 --
{'C': {'precision': 0.3333333333333333, 'recall': 0.2, 'f1-score': 0.25, 'support': 20}, 'P': {'precision': 0.4090909090909091, 'recall': 0.3673469387755102, 'f1-score': 0.3870967741935484, 'support': 49}, 'micro avg': {'precision': 0.39285714285714285, 'recall': 0.3188405797101449, 'f1-score': 0.3519999999999999, 'support': 69}, 'macro avg': {'precision': 0.3712121212121212, 'recall': 0.2836734693877551, 'f1-score': 0.3185483870967742, 'support': 69}, 'weighted avg': {'precision': 0.38713219148001754, 'recall': 0.3188405797101449, 'f1-score': 0.3473585787751286, 'support': 69}}
Wrong BIO-Encoding 55/109 labels, 50.46%
{'C': {'precision': 0.3333333333333333, 'recall': 0.2, 'f1-score': 0.25, 'support': 20}, 'P': {'precision': 0.4090909090909091, 'recall': 0.3673469387755102, 'f1-score': 0.3870967741935484, 'support': 49}, 'micro avg': {'precision': 0.39285714285714285, 'recall': 0.3188405797101449, 'f1-score': 0.3519999999999999, 'support': 69}, 'macro avg': {'precision': 0.3712121212121212, 'recall': 0.2836734693877551, 'f1-score': 0.3185483870967742, 'support': 69}, 'weighted avg': {'precision': 0.38713219148001754, 'recall': 0.3188405797101449, 'f1-score': 0.3473585787751286, 'support': 69}}
Wrong BIO-Encoding 2/56 labels, 3.57%
Dev-Data: Prec: 0.407, Rec: 0.319, F1: 0.3577
{'C': {'precision': 0.12015503875968993, 'recall': 0.11231884057971014, 'f1-score': 0.11610486891385768, 'support': 276}, 'P': {'precision': 0.20572916666666666, 'recall': 0.25901639344262295, 'f1-score': 0.22931785195936139, 'support': 305}, 'micro avg': {'precision': 0.17133956386292834, 'recall': 0.18932874354561102, 'f1-score': 0.17988552739165983, 'support': 581}, 'macro avg': {'precision': 0.1629421027131783, 'recall': 0.18566761701116655, 'f1-score': 0.17271136043660953, 'support': 581}, 'weighted avg': {'precision': 0.16507777371946256, 'recall': 0.18932874354561102, 'f1-score': 0.175536813541876, 'support': 581}}
Wrong BIO-Encoding 74/710 labels, 10.42%
{'C': {'precision': 0.12015503875968993, 'recall': 0.11231884057971014, 'f1-score': 0.11610486891385768, 'support': 276}, 'P': {'precision': 0.20572916666666666, 'recall': 0.25901639344262295, 'f1-score': 0.22931785195936139, 'support': 305}, 'micro avg': {'precision': 0.17133956386292834, 'recall': 0.18932874354561102, 'f1-score': 0.17988552739165983, 'support': 581}, 'macro avg': {'precision': 0.1629421027131783, 'recall': 0.18566761701116655, 'f1-score': 0.17271136043660953, 'support': 581}, 'weighted avg': {'precision': 0.16507777371946256, 'recall': 0.18932874354561102, 'f1-score': 0.175536813541876, 'support': 581}}
Wrong BIO-Encoding 6/642 labels, 0.93%
Test-Data: Prec: 0.173, Rec: 0.189, F1: 0.1808

Scores from epoch with best dev-scores:
  Dev-Score: 0.3937
  Test-Score 0.1876

4.46 sec for evaluation

--------- Epoch 30 -----------
343.90 sec for training (10108.82 total)
-- cmv_modes1 --
{'C': {'precision': 0.3684210526315789, 'recall': 0.35, 'f1-score': 0.358974358974359, 'support': 20}, 'P': {'precision': 0.45, 'recall': 0.3673469387755102, 'f1-score': 0.4044943820224719, 'support': 49}, 'micro avg': {'precision': 0.423728813559322, 'recall': 0.36231884057971014, 'f1-score': 0.39062499999999994, 'support': 69}, 'macro avg': {'precision': 0.40921052631578947, 'recall': 0.35867346938775513, 'f1-score': 0.3817343704984154, 'support': 69}, 'weighted avg': {'precision': 0.4263539282990084, 'recall': 0.36231884057971014, 'f1-score': 0.3913001724433087, 'support': 69}}
Wrong BIO-Encoding 34/91 labels, 37.36%
{'C': {'precision': 0.3684210526315789, 'recall': 0.35, 'f1-score': 0.358974358974359, 'support': 20}, 'P': {'precision': 0.45, 'recall': 0.3673469387755102, 'f1-score': 0.4044943820224719, 'support': 49}, 'micro avg': {'precision': 0.423728813559322, 'recall': 0.36231884057971014, 'f1-score': 0.39062499999999994, 'support': 69}, 'macro avg': {'precision': 0.40921052631578947, 'recall': 0.35867346938775513, 'f1-score': 0.3817343704984154, 'support': 69}, 'weighted avg': {'precision': 0.4263539282990084, 'recall': 0.36231884057971014, 'f1-score': 0.3913001724433087, 'support': 69}}
Wrong BIO-Encoding 2/59 labels, 3.39%
Dev-Data: Prec: 0.439, Rec: 0.362, F1: 0.3968
{'C': {'precision': 0.1326530612244898, 'recall': 0.14130434782608695, 'f1-score': 0.1368421052631579, 'support': 276}, 'P': {'precision': 0.1786833855799373, 'recall': 0.18688524590163935, 'f1-score': 0.18269230769230768, 'support': 305}, 'micro avg': {'precision': 0.1566068515497553, 'recall': 0.16523235800344235, 'f1-score': 0.1608040201005025, 'support': 581}, 'macro avg': {'precision': 0.15566822340221353, 'recall': 0.16409479686386313, 'f1-score': 0.1597672064777328, 'support': 581}, 'weighted avg': {'precision': 0.1568170008603099, 'recall': 0.16523235800344235, 'f1-score': 0.16091148863818489, 'support': 581}}
Wrong BIO-Encoding 81/688 labels, 11.77%
{'C': {'precision': 0.1326530612244898, 'recall': 0.14130434782608695, 'f1-score': 0.1368421052631579, 'support': 276}, 'P': {'precision': 0.1786833855799373, 'recall': 0.18688524590163935, 'f1-score': 0.18269230769230768, 'support': 305}, 'micro avg': {'precision': 0.1566068515497553, 'recall': 0.16523235800344235, 'f1-score': 0.1608040201005025, 'support': 581}, 'macro avg': {'precision': 0.15566822340221353, 'recall': 0.16409479686386313, 'f1-score': 0.1597672064777328, 'support': 581}, 'weighted avg': {'precision': 0.1568170008603099, 'recall': 0.16523235800344235, 'f1-score': 0.16091148863818489, 'support': 581}}
Wrong BIO-Encoding 6/613 labels, 0.98%
Test-Data: Prec: 0.158, Rec: 0.165, F1: 0.1616

Scores from epoch with best dev-scores:
  Dev-Score: 0.3968
  Test-Score 0.1616

5.15 sec for evaluation

--------- Epoch 31 -----------
342.73 sec for training (10451.54 total)
-- cmv_modes1 --
{'C': {'precision': 0.2727272727272727, 'recall': 0.15, 'f1-score': 0.19354838709677416, 'support': 20}, 'P': {'precision': 0.4444444444444444, 'recall': 0.40816326530612246, 'f1-score': 0.425531914893617, 'support': 49}, 'micro avg': {'precision': 0.4107142857142857, 'recall': 0.3333333333333333, 'f1-score': 0.36799999999999994, 'support': 69}, 'macro avg': {'precision': 0.35858585858585856, 'recall': 0.27908163265306124, 'f1-score': 0.3095401509951956, 'support': 69}, 'weighted avg': {'precision': 0.39467135119309027, 'recall': 0.3333333333333333, 'f1-score': 0.35829031263366257, 'support': 69}}
Wrong BIO-Encoding 38/93 labels, 40.86%
{'C': {'precision': 0.2727272727272727, 'recall': 0.15, 'f1-score': 0.19354838709677416, 'support': 20}, 'P': {'precision': 0.4444444444444444, 'recall': 0.40816326530612246, 'f1-score': 0.425531914893617, 'support': 49}, 'micro avg': {'precision': 0.4107142857142857, 'recall': 0.3333333333333333, 'f1-score': 0.36799999999999994, 'support': 69}, 'macro avg': {'precision': 0.35858585858585856, 'recall': 0.27908163265306124, 'f1-score': 0.3095401509951956, 'support': 69}, 'weighted avg': {'precision': 0.39467135119309027, 'recall': 0.3333333333333333, 'f1-score': 0.35829031263366257, 'support': 69}}
Wrong BIO-Encoding 1/56 labels, 1.79%
Dev-Data: Prec: 0.418, Rec: 0.333, F1: 0.3710
{'C': {'precision': 0.16751269035532995, 'recall': 0.11956521739130435, 'f1-score': 0.13953488372093023, 'support': 276}, 'P': {'precision': 0.14035087719298245, 'recall': 0.18360655737704917, 'f1-score': 0.1590909090909091, 'support': 305}, 'micro avg': {'precision': 0.1493288590604027, 'recall': 0.153184165232358, 'f1-score': 0.15123194562446896, 'support': 581}, 'macro avg': {'precision': 0.1539317837741562, 'recall': 0.15158588738417678, 'f1-score': 0.14931289640591966, 'support': 581}, 'weighted avg': {'precision': 0.15325390719781534, 'recall': 0.153184165232358, 'f1-score': 0.14980095555887096, 'support': 581}}
Wrong BIO-Encoding 98/689 labels, 14.22%
{'C': {'precision': 0.16751269035532995, 'recall': 0.11956521739130435, 'f1-score': 0.13953488372093023, 'support': 276}, 'P': {'precision': 0.14035087719298245, 'recall': 0.18360655737704917, 'f1-score': 0.1590909090909091, 'support': 305}, 'micro avg': {'precision': 0.1493288590604027, 'recall': 0.153184165232358, 'f1-score': 0.15123194562446896, 'support': 581}, 'macro avg': {'precision': 0.1539317837741562, 'recall': 0.15158588738417678, 'f1-score': 0.14931289640591966, 'support': 581}, 'weighted avg': {'precision': 0.15325390719781534, 'recall': 0.153184165232358, 'f1-score': 0.14980095555887096, 'support': 581}}
Wrong BIO-Encoding 5/596 labels, 0.84%
Test-Data: Prec: 0.151, Rec: 0.153, F1: 0.1519

Scores from epoch with best dev-scores:
  Dev-Score: 0.3968
  Test-Score 0.1616

4.39 sec for evaluation

--------- Epoch 32 -----------
343.40 sec for training (10794.95 total)
-- cmv_modes1 --
{'C': {'precision': 0.3125, 'recall': 0.25, 'f1-score': 0.2777777777777778, 'support': 20}, 'P': {'precision': 0.42857142857142855, 'recall': 0.3673469387755102, 'f1-score': 0.39560439560439564, 'support': 49}, 'micro avg': {'precision': 0.39655172413793105, 'recall': 0.3333333333333333, 'f1-score': 0.36220472440944884, 'support': 69}, 'macro avg': {'precision': 0.3705357142857143, 'recall': 0.3086734693877551, 'f1-score': 0.3366910866910867, 'support': 69}, 'weighted avg': {'precision': 0.39492753623188404, 'recall': 0.3333333333333333, 'f1-score': 0.36145175275610064, 'support': 69}}
Wrong BIO-Encoding 24/80 labels, 30.00%
{'C': {'precision': 0.3125, 'recall': 0.25, 'f1-score': 0.2777777777777778, 'support': 20}, 'P': {'precision': 0.42857142857142855, 'recall': 0.3673469387755102, 'f1-score': 0.39560439560439564, 'support': 49}, 'micro avg': {'precision': 0.39655172413793105, 'recall': 0.3333333333333333, 'f1-score': 0.36220472440944884, 'support': 69}, 'macro avg': {'precision': 0.3705357142857143, 'recall': 0.3086734693877551, 'f1-score': 0.3366910866910867, 'support': 69}, 'weighted avg': {'precision': 0.39492753623188404, 'recall': 0.3333333333333333, 'f1-score': 0.36145175275610064, 'support': 69}}
Wrong BIO-Encoding 2/58 labels, 3.45%
Dev-Data: Prec: 0.411, Rec: 0.333, F1: 0.3680
{'C': {'precision': 0.14233576642335766, 'recall': 0.14130434782608695, 'f1-score': 0.14181818181818182, 'support': 276}, 'P': {'precision': 0.18154761904761904, 'recall': 0.2, 'f1-score': 0.1903276131045242, 'support': 305}, 'micro avg': {'precision': 0.16393442622950818, 'recall': 0.1721170395869191, 'f1-score': 0.16792611251049536, 'support': 581}, 'macro avg': {'precision': 0.16194169273548836, 'recall': 0.1706521739130435, 'f1-score': 0.166072897461353, 'support': 581}, 'weighted avg': {'precision': 0.16292030179409728, 'recall': 0.1721170395869191, 'f1-score': 0.16728354591858532, 'support': 581}}
Wrong BIO-Encoding 134/733 labels, 18.28%
{'C': {'precision': 0.14233576642335766, 'recall': 0.14130434782608695, 'f1-score': 0.14181818181818182, 'support': 276}, 'P': {'precision': 0.18154761904761904, 'recall': 0.2, 'f1-score': 0.1903276131045242, 'support': 305}, 'micro avg': {'precision': 0.16393442622950818, 'recall': 0.1721170395869191, 'f1-score': 0.16792611251049536, 'support': 581}, 'macro avg': {'precision': 0.16194169273548836, 'recall': 0.1706521739130435, 'f1-score': 0.166072897461353, 'support': 581}, 'weighted avg': {'precision': 0.16292030179409728, 'recall': 0.1721170395869191, 'f1-score': 0.16728354591858532, 'support': 581}}
Wrong BIO-Encoding 11/610 labels, 1.80%
Test-Data: Prec: 0.164, Rec: 0.172, F1: 0.1679

Scores from epoch with best dev-scores:
  Dev-Score: 0.3968
  Test-Score 0.1616

4.50 sec for evaluation

--------- Epoch 33 -----------
342.64 sec for training (11137.59 total)
-- cmv_modes1 --
{'C': {'precision': 0.3333333333333333, 'recall': 0.35, 'f1-score': 0.3414634146341463, 'support': 20}, 'P': {'precision': 0.4523809523809524, 'recall': 0.3877551020408163, 'f1-score': 0.41758241758241765, 'support': 49}, 'micro avg': {'precision': 0.4126984126984127, 'recall': 0.37681159420289856, 'f1-score': 0.393939393939394, 'support': 69}, 'macro avg': {'precision': 0.39285714285714285, 'recall': 0.36887755102040815, 'f1-score': 0.379522916108282, 'support': 69}, 'weighted avg': {'precision': 0.4178743961352657, 'recall': 0.37681159420289856, 'f1-score': 0.39551893846697667, 'support': 69}}
Wrong BIO-Encoding 11/73 labels, 15.07%
{'C': {'precision': 0.3333333333333333, 'recall': 0.35, 'f1-score': 0.3414634146341463, 'support': 20}, 'P': {'precision': 0.4523809523809524, 'recall': 0.3877551020408163, 'f1-score': 0.41758241758241765, 'support': 49}, 'micro avg': {'precision': 0.4126984126984127, 'recall': 0.37681159420289856, 'f1-score': 0.393939393939394, 'support': 69}, 'macro avg': {'precision': 0.39285714285714285, 'recall': 0.36887755102040815, 'f1-score': 0.379522916108282, 'support': 69}, 'weighted avg': {'precision': 0.4178743961352657, 'recall': 0.37681159420289856, 'f1-score': 0.39551893846697667, 'support': 69}}
Wrong BIO-Encoding 1/63 labels, 1.59%
Dev-Data: Prec: 0.419, Rec: 0.377, F1: 0.3969
{'C': {'precision': 0.13738019169329074, 'recall': 0.15579710144927536, 'f1-score': 0.1460101867572156, 'support': 276}, 'P': {'precision': 0.18098159509202455, 'recall': 0.19344262295081968, 'f1-score': 0.1870047543581617, 'support': 305}, 'micro avg': {'precision': 0.1596244131455399, 'recall': 0.17555938037865748, 'f1-score': 0.16721311475409836, 'support': 581}, 'macro avg': {'precision': 0.15918089339265765, 'recall': 0.17461986220004752, 'f1-score': 0.16650747055768866, 'support': 581}, 'weighted avg': {'precision': 0.1602690523415073, 'recall': 0.17555938037865748, 'f1-score': 0.16753057078180864, 'support': 581}}
Wrong BIO-Encoding 194/820 labels, 23.66%
{'C': {'precision': 0.13738019169329074, 'recall': 0.15579710144927536, 'f1-score': 0.1460101867572156, 'support': 276}, 'P': {'precision': 0.18098159509202455, 'recall': 0.19344262295081968, 'f1-score': 0.1870047543581617, 'support': 305}, 'micro avg': {'precision': 0.1596244131455399, 'recall': 0.17555938037865748, 'f1-score': 0.16721311475409836, 'support': 581}, 'macro avg': {'precision': 0.15918089339265765, 'recall': 0.17461986220004752, 'f1-score': 0.16650747055768866, 'support': 581}, 'weighted avg': {'precision': 0.1602690523415073, 'recall': 0.17555938037865748, 'f1-score': 0.16753057078180864, 'support': 581}}
Wrong BIO-Encoding 13/639 labels, 2.03%
Test-Data: Prec: 0.163, Rec: 0.176, F1: 0.1690

Scores from epoch with best dev-scores:
  Dev-Score: 0.3969
  Test-Score 0.1690

4.94 sec for evaluation

--------- Epoch 34 -----------
342.60 sec for training (11480.19 total)
-- cmv_modes1 --
{'C': {'precision': 0.6, 'recall': 0.3, 'f1-score': 0.4, 'support': 20}, 'P': {'precision': 0.4444444444444444, 'recall': 0.40816326530612246, 'f1-score': 0.425531914893617, 'support': 49}, 'micro avg': {'precision': 0.4727272727272727, 'recall': 0.37681159420289856, 'f1-score': 0.41935483870967744, 'support': 69}, 'macro avg': {'precision': 0.5222222222222221, 'recall': 0.35408163265306125, 'f1-score': 0.41276595744680855, 'support': 69}, 'weighted avg': {'precision': 0.4895330112721416, 'recall': 0.37681159420289856, 'f1-score': 0.4181313598519889, 'support': 69}}
Wrong BIO-Encoding 38/92 labels, 41.30%
{'C': {'precision': 0.6, 'recall': 0.3, 'f1-score': 0.4, 'support': 20}, 'P': {'precision': 0.4444444444444444, 'recall': 0.40816326530612246, 'f1-score': 0.425531914893617, 'support': 49}, 'micro avg': {'precision': 0.4727272727272727, 'recall': 0.37681159420289856, 'f1-score': 0.41935483870967744, 'support': 69}, 'macro avg': {'precision': 0.5222222222222221, 'recall': 0.35408163265306125, 'f1-score': 0.41276595744680855, 'support': 69}, 'weighted avg': {'precision': 0.4895330112721416, 'recall': 0.37681159420289856, 'f1-score': 0.4181313598519889, 'support': 69}}
Wrong BIO-Encoding 1/55 labels, 1.82%
Dev-Data: Prec: 0.481, Rec: 0.377, F1: 0.4228
{'C': {'precision': 0.18090452261306533, 'recall': 0.13043478260869565, 'f1-score': 0.15157894736842104, 'support': 276}, 'P': {'precision': 0.20418848167539266, 'recall': 0.25573770491803277, 'f1-score': 0.22707423580786024, 'support': 305}, 'micro avg': {'precision': 0.1962134251290878, 'recall': 0.1962134251290878, 'f1-score': 0.1962134251290878, 'support': 581}, 'macro avg': {'precision': 0.192546502144229, 'recall': 0.1930862437633642, 'f1-score': 0.18932659158814064, 'support': 581}, 'weighted avg': {'precision': 0.19312759922926126, 'recall': 0.1962134251290878, 'f1-score': 0.1912107252927394, 'support': 581}}
Wrong BIO-Encoding 107/681 labels, 15.71%
{'C': {'precision': 0.18090452261306533, 'recall': 0.13043478260869565, 'f1-score': 0.15157894736842104, 'support': 276}, 'P': {'precision': 0.20418848167539266, 'recall': 0.25573770491803277, 'f1-score': 0.22707423580786024, 'support': 305}, 'micro avg': {'precision': 0.1962134251290878, 'recall': 0.1962134251290878, 'f1-score': 0.1962134251290878, 'support': 581}, 'macro avg': {'precision': 0.192546502144229, 'recall': 0.1930862437633642, 'f1-score': 0.18932659158814064, 'support': 581}, 'weighted avg': {'precision': 0.19312759922926126, 'recall': 0.1962134251290878, 'f1-score': 0.1912107252927394, 'support': 581}}
Wrong BIO-Encoding 7/581 labels, 1.20%
Test-Data: Prec: 0.196, Rec: 0.196, F1: 0.1962

Scores from epoch with best dev-scores:
  Dev-Score: 0.4228
  Test-Score 0.1962

5.03 sec for evaluation

--------- Epoch 35 -----------
342.60 sec for training (11822.79 total)
-- cmv_modes1 --
{'C': {'precision': 0.375, 'recall': 0.3, 'f1-score': 0.33333333333333326, 'support': 20}, 'P': {'precision': 0.475, 'recall': 0.3877551020408163, 'f1-score': 0.42696629213483145, 'support': 49}, 'micro avg': {'precision': 0.44642857142857145, 'recall': 0.36231884057971014, 'f1-score': 0.4, 'support': 69}, 'macro avg': {'precision': 0.425, 'recall': 0.3438775510204082, 'f1-score': 0.3801498127340823, 'support': 69}, 'weighted avg': {'precision': 0.44601449275362315, 'recall': 0.36231884057971014, 'f1-score': 0.39982630407642616, 'support': 69}}
{'C': {'precision': 0.375, 'recall': 0.3, 'f1-score': 0.33333333333333326, 'support': 20}, 'P': {'precision': 0.475, 'recall': 0.3877551020408163, 'f1-score': 0.42696629213483145, 'support': 49}, 'micro avg': {'precision': 0.44642857142857145, 'recall': 0.36231884057971014, 'f1-score': 0.4, 'support': 69}, 'macro avg': {'precision': 0.425, 'recall': 0.3438775510204082, 'f1-score': 0.3801498127340823, 'support': 69}, 'weighted avg': {'precision': 0.44601449275362315, 'recall': 0.36231884057971014, 'f1-score': 0.39982630407642616, 'support': 69}}
Dev-Data: Prec: 0.446, Rec: 0.362, F1: 0.4000
{'C': {'precision': 0.1553784860557769, 'recall': 0.14130434782608695, 'f1-score': 0.14800759013282733, 'support': 276}, 'P': {'precision': 0.20612813370473537, 'recall': 0.24262295081967214, 'f1-score': 0.22289156626506026, 'support': 305}, 'micro avg': {'precision': 0.18524590163934426, 'recall': 0.1944922547332186, 'f1-score': 0.1897565071368598, 'support': 581}, 'macro avg': {'precision': 0.18075330988025612, 'recall': 0.19196364932287954, 'f1-score': 0.1854495781989438, 'support': 581}, 'weighted avg': {'precision': 0.18201986735170175, 'recall': 0.1944922547332186, 'f1-score': 0.18731845540017852, 'support': 581}}
Wrong BIO-Encoding 193/794 labels, 24.31%
{'C': {'precision': 0.1553784860557769, 'recall': 0.14130434782608695, 'f1-score': 0.14800759013282733, 'support': 276}, 'P': {'precision': 0.20612813370473537, 'recall': 0.24262295081967214, 'f1-score': 0.22289156626506026, 'support': 305}, 'micro avg': {'precision': 0.18524590163934426, 'recall': 0.1944922547332186, 'f1-score': 0.1897565071368598, 'support': 581}, 'macro avg': {'precision': 0.18075330988025612, 'recall': 0.19196364932287954, 'f1-score': 0.1854495781989438, 'support': 581}, 'weighted avg': {'precision': 0.18201986735170175, 'recall': 0.1944922547332186, 'f1-score': 0.18731845540017852, 'support': 581}}
Wrong BIO-Encoding 9/610 labels, 1.48%
Test-Data: Prec: 0.185, Rec: 0.194, F1: 0.1898

Scores from epoch with best dev-scores:
  Dev-Score: 0.4228
  Test-Score 0.1962

4.51 sec for evaluation

--------- Epoch 36 -----------
344.33 sec for training (12167.11 total)
-- cmv_modes1 --
{'C': {'precision': 0.3333333333333333, 'recall': 0.2, 'f1-score': 0.25, 'support': 20}, 'P': {'precision': 0.425, 'recall': 0.3469387755102041, 'f1-score': 0.38202247191011235, 'support': 49}, 'micro avg': {'precision': 0.40384615384615385, 'recall': 0.30434782608695654, 'f1-score': 0.34710743801652894, 'support': 69}, 'macro avg': {'precision': 0.37916666666666665, 'recall': 0.27346938775510204, 'f1-score': 0.3160112359550562, 'support': 69}, 'weighted avg': {'precision': 0.39842995169082124, 'recall': 0.30434782608695654, 'f1-score': 0.34375508874776095, 'support': 69}}
Wrong BIO-Encoding 23/74 labels, 31.08%
{'C': {'precision': 0.3333333333333333, 'recall': 0.2, 'f1-score': 0.25, 'support': 20}, 'P': {'precision': 0.425, 'recall': 0.3469387755102041, 'f1-score': 0.38202247191011235, 'support': 49}, 'micro avg': {'precision': 0.40384615384615385, 'recall': 0.30434782608695654, 'f1-score': 0.34710743801652894, 'support': 69}, 'macro avg': {'precision': 0.37916666666666665, 'recall': 0.27346938775510204, 'f1-score': 0.3160112359550562, 'support': 69}, 'weighted avg': {'precision': 0.39842995169082124, 'recall': 0.30434782608695654, 'f1-score': 0.34375508874776095, 'support': 69}}
Wrong BIO-Encoding 1/52 labels, 1.92%
Dev-Data: Prec: 0.412, Rec: 0.304, F1: 0.3500
{'C': {'precision': 0.15748031496062992, 'recall': 0.14492753623188406, 'f1-score': 0.1509433962264151, 'support': 276}, 'P': {'precision': 0.1736842105263158, 'recall': 0.21639344262295082, 'f1-score': 0.19270072992700732, 'support': 305}, 'micro avg': {'precision': 0.167192429022082, 'recall': 0.18244406196213425, 'f1-score': 0.17448559670781894, 'support': 581}, 'macro avg': {'precision': 0.16558226274347287, 'recall': 0.18066048942741744, 'f1-score': 0.17182206307671122, 'support': 581}, 'weighted avg': {'precision': 0.16598666289098138, 'recall': 0.18244406196213425, 'f1-score': 0.17286419963206162, 'support': 581}}
Wrong BIO-Encoding 317/939 labels, 33.76%
{'C': {'precision': 0.15748031496062992, 'recall': 0.14492753623188406, 'f1-score': 0.1509433962264151, 'support': 276}, 'P': {'precision': 0.1736842105263158, 'recall': 0.21639344262295082, 'f1-score': 0.19270072992700732, 'support': 305}, 'micro avg': {'precision': 0.167192429022082, 'recall': 0.18244406196213425, 'f1-score': 0.17448559670781894, 'support': 581}, 'macro avg': {'precision': 0.16558226274347287, 'recall': 0.18066048942741744, 'f1-score': 0.17182206307671122, 'support': 581}, 'weighted avg': {'precision': 0.16598666289098138, 'recall': 0.18244406196213425, 'f1-score': 0.17286419963206162, 'support': 581}}
Wrong BIO-Encoding 12/634 labels, 1.89%
Test-Data: Prec: 0.170, Rec: 0.182, F1: 0.1762

Scores from epoch with best dev-scores:
  Dev-Score: 0.4228
  Test-Score 0.1962

4.46 sec for evaluation

--------- Epoch 37 -----------
345.42 sec for training (12512.53 total)
-- cmv_modes1 --
{'C': {'precision': 0.2608695652173913, 'recall': 0.3, 'f1-score': 0.27906976744186046, 'support': 20}, 'P': {'precision': 0.5128205128205128, 'recall': 0.40816326530612246, 'f1-score': 0.45454545454545453, 'support': 49}, 'micro avg': {'precision': 0.41935483870967744, 'recall': 0.37681159420289856, 'f1-score': 0.39694656488549623, 'support': 69}, 'macro avg': {'precision': 0.38684503901895206, 'recall': 0.35408163265306125, 'f1-score': 0.3668076109936575, 'support': 69}, 'weighted avg': {'precision': 0.43979125264569496, 'recall': 0.37681159420289856, 'f1-score': 0.4036829365444128, 'support': 69}}
{'C': {'precision': 0.2608695652173913, 'recall': 0.3, 'f1-score': 0.27906976744186046, 'support': 20}, 'P': {'precision': 0.5128205128205128, 'recall': 0.40816326530612246, 'f1-score': 0.45454545454545453, 'support': 49}, 'micro avg': {'precision': 0.41935483870967744, 'recall': 0.37681159420289856, 'f1-score': 0.39694656488549623, 'support': 69}, 'macro avg': {'precision': 0.38684503901895206, 'recall': 0.35408163265306125, 'f1-score': 0.3668076109936575, 'support': 69}, 'weighted avg': {'precision': 0.43979125264569496, 'recall': 0.37681159420289856, 'f1-score': 0.4036829365444128, 'support': 69}}
Dev-Data: Prec: 0.419, Rec: 0.377, F1: 0.3969
{'C': {'precision': 0.12643678160919541, 'recall': 0.15942028985507245, 'f1-score': 0.14102564102564102, 'support': 276}, 'P': {'precision': 0.23322683706070288, 'recall': 0.23934426229508196, 'f1-score': 0.23624595469255663, 'support': 305}, 'micro avg': {'precision': 0.17700453857791226, 'recall': 0.20137693631669534, 'f1-score': 0.18840579710144928, 'support': 581}, 'macro avg': {'precision': 0.17983180933494913, 'recall': 0.1993822760750772, 'f1-score': 0.18863579785909884, 'support': 581}, 'weighted avg': {'precision': 0.1824969656241864, 'recall': 0.20137693631669534, 'f1-score': 0.1910122084411475, 'support': 581}}
Wrong BIO-Encoding 231/880 labels, 26.25%
{'C': {'precision': 0.12643678160919541, 'recall': 0.15942028985507245, 'f1-score': 0.14102564102564102, 'support': 276}, 'P': {'precision': 0.23322683706070288, 'recall': 0.23934426229508196, 'f1-score': 0.23624595469255663, 'support': 305}, 'micro avg': {'precision': 0.17700453857791226, 'recall': 0.20137693631669534, 'f1-score': 0.18840579710144928, 'support': 581}, 'macro avg': {'precision': 0.17983180933494913, 'recall': 0.1993822760750772, 'f1-score': 0.18863579785909884, 'support': 581}, 'weighted avg': {'precision': 0.1824969656241864, 'recall': 0.20137693631669534, 'f1-score': 0.1910122084411475, 'support': 581}}
Wrong BIO-Encoding 12/661 labels, 1.82%
Test-Data: Prec: 0.180, Rec: 0.201, F1: 0.1902

Scores from epoch with best dev-scores:
  Dev-Score: 0.4228
  Test-Score 0.1962

4.47 sec for evaluation

--------- Epoch 38 -----------
346.04 sec for training (12858.57 total)
-- cmv_modes1 --
{'C': {'precision': 0.4, 'recall': 0.3, 'f1-score': 0.34285714285714286, 'support': 20}, 'P': {'precision': 0.46511627906976744, 'recall': 0.40816326530612246, 'f1-score': 0.43478260869565216, 'support': 49}, 'micro avg': {'precision': 0.4482758620689655, 'recall': 0.37681159420289856, 'f1-score': 0.4094488188976378, 'support': 69}, 'macro avg': {'precision': 0.43255813953488376, 'recall': 0.35408163265306125, 'f1-score': 0.38881987577639754, 'support': 69}, 'weighted avg': {'precision': 0.44624199528142905, 'recall': 0.37681159420289856, 'f1-score': 0.4081375461337654, 'support': 69}}
Wrong BIO-Encoding 34/91 labels, 37.36%
{'C': {'precision': 0.4, 'recall': 0.3, 'f1-score': 0.34285714285714286, 'support': 20}, 'P': {'precision': 0.46511627906976744, 'recall': 0.40816326530612246, 'f1-score': 0.43478260869565216, 'support': 49}, 'micro avg': {'precision': 0.4482758620689655, 'recall': 0.37681159420289856, 'f1-score': 0.4094488188976378, 'support': 69}, 'macro avg': {'precision': 0.43255813953488376, 'recall': 0.35408163265306125, 'f1-score': 0.38881987577639754, 'support': 69}, 'weighted avg': {'precision': 0.44624199528142905, 'recall': 0.37681159420289856, 'f1-score': 0.4081375461337654, 'support': 69}}
Wrong BIO-Encoding 1/58 labels, 1.72%
Dev-Data: Prec: 0.456, Rec: 0.377, F1: 0.4127
{'C': {'precision': 0.14615384615384616, 'recall': 0.13768115942028986, 'f1-score': 0.14179104477611942, 'support': 276}, 'P': {'precision': 0.20052770448548812, 'recall': 0.24918032786885247, 'f1-score': 0.2222222222222222, 'support': 305}, 'micro avg': {'precision': 0.1784037558685446, 'recall': 0.1962134251290878, 'f1-score': 0.18688524590163932, 'support': 581}, 'macro avg': {'precision': 0.17334077531966713, 'recall': 0.19343074364457116, 'f1-score': 0.18200663349917082, 'support': 581}, 'weighted avg': {'precision': 0.17469778211107645, 'recall': 0.1962134251290878, 'f1-score': 0.18401395204128526, 'support': 581}}
Wrong BIO-Encoding 67/700 labels, 9.57%
{'C': {'precision': 0.14615384615384616, 'recall': 0.13768115942028986, 'f1-score': 0.14179104477611942, 'support': 276}, 'P': {'precision': 0.20052770448548812, 'recall': 0.24918032786885247, 'f1-score': 0.2222222222222222, 'support': 305}, 'micro avg': {'precision': 0.1784037558685446, 'recall': 0.1962134251290878, 'f1-score': 0.18688524590163932, 'support': 581}, 'macro avg': {'precision': 0.17334077531966713, 'recall': 0.19343074364457116, 'f1-score': 0.18200663349917082, 'support': 581}, 'weighted avg': {'precision': 0.17469778211107645, 'recall': 0.1962134251290878, 'f1-score': 0.18401395204128526, 'support': 581}}
Wrong BIO-Encoding 6/639 labels, 0.94%
Test-Data: Prec: 0.180, Rec: 0.196, F1: 0.1878

Scores from epoch with best dev-scores:
  Dev-Score: 0.4228
  Test-Score 0.1962

4.50 sec for evaluation

--------- Epoch 39 -----------
345.43 sec for training (13204.00 total)
-- cmv_modes1 --
{'C': {'precision': 0.38095238095238093, 'recall': 0.4, 'f1-score': 0.3902439024390244, 'support': 20}, 'P': {'precision': 0.5238095238095238, 'recall': 0.4489795918367347, 'f1-score': 0.4835164835164835, 'support': 49}, 'micro avg': {'precision': 0.47619047619047616, 'recall': 0.43478260869565216, 'f1-score': 0.4545454545454545, 'support': 69}, 'macro avg': {'precision': 0.4523809523809524, 'recall': 0.42448979591836733, 'f1-score': 0.43688019297775393, 'support': 69}, 'weighted avg': {'precision': 0.4824016563146998, 'recall': 0.43478260869565216, 'f1-score': 0.45648095276939393, 'support': 69}}
Wrong BIO-Encoding 13/75 labels, 17.33%
{'C': {'precision': 0.38095238095238093, 'recall': 0.4, 'f1-score': 0.3902439024390244, 'support': 20}, 'P': {'precision': 0.5238095238095238, 'recall': 0.4489795918367347, 'f1-score': 0.4835164835164835, 'support': 49}, 'micro avg': {'precision': 0.47619047619047616, 'recall': 0.43478260869565216, 'f1-score': 0.4545454545454545, 'support': 69}, 'macro avg': {'precision': 0.4523809523809524, 'recall': 0.42448979591836733, 'f1-score': 0.43688019297775393, 'support': 69}, 'weighted avg': {'precision': 0.4824016563146998, 'recall': 0.43478260869565216, 'f1-score': 0.45648095276939393, 'support': 69}}
Wrong BIO-Encoding 1/63 labels, 1.59%
Dev-Data: Prec: 0.484, Rec: 0.435, F1: 0.4580
{'C': {'precision': 0.15447154471544716, 'recall': 0.13768115942028986, 'f1-score': 0.14559386973180077, 'support': 276}, 'P': {'precision': 0.1969309462915601, 'recall': 0.25245901639344265, 'f1-score': 0.22126436781609196, 'support': 305}, 'micro avg': {'precision': 0.18053375196232338, 'recall': 0.19793459552495696, 'f1-score': 0.18883415435139572, 'support': 581}, 'macro avg': {'precision': 0.17570124550350363, 'recall': 0.19507008790686625, 'f1-score': 0.18342911877394635, 'support': 581}, 'weighted avg': {'precision': 0.176760903546281, 'recall': 0.19793459552495699, 'f1-score': 0.18531762518052505, 'support': 581}}
Wrong BIO-Encoding 37/671 labels, 5.51%
{'C': {'precision': 0.15447154471544716, 'recall': 0.13768115942028986, 'f1-score': 0.14559386973180077, 'support': 276}, 'P': {'precision': 0.1969309462915601, 'recall': 0.25245901639344265, 'f1-score': 0.22126436781609196, 'support': 305}, 'micro avg': {'precision': 0.18053375196232338, 'recall': 0.19793459552495696, 'f1-score': 0.18883415435139572, 'support': 581}, 'macro avg': {'precision': 0.17570124550350363, 'recall': 0.19507008790686625, 'f1-score': 0.18342911877394635, 'support': 581}, 'weighted avg': {'precision': 0.176760903546281, 'recall': 0.19793459552495699, 'f1-score': 0.18531762518052505, 'support': 581}}
Wrong BIO-Encoding 3/637 labels, 0.47%
Test-Data: Prec: 0.181, Rec: 0.198, F1: 0.1893

Scores from epoch with best dev-scores:
  Dev-Score: 0.4580
  Test-Score 0.1893

5.08 sec for evaluation

--------- Epoch 40 -----------
327.81 sec for training (13531.81 total)
-- cmv_modes1 --
{'C': {'precision': 0.3333333333333333, 'recall': 0.25, 'f1-score': 0.28571428571428575, 'support': 20}, 'P': {'precision': 0.44680851063829785, 'recall': 0.42857142857142855, 'f1-score': 0.4375, 'support': 49}, 'micro avg': {'precision': 0.41935483870967744, 'recall': 0.37681159420289856, 'f1-score': 0.39694656488549623, 'support': 69}, 'macro avg': {'precision': 0.3900709219858156, 'recall': 0.3392857142857143, 'f1-score': 0.3616071428571429, 'support': 69}, 'weighted avg': {'precision': 0.4139171548977284, 'recall': 0.37681159420289856, 'f1-score': 0.3935041407867495, 'support': 69}}
{'C': {'precision': 0.3333333333333333, 'recall': 0.25, 'f1-score': 0.28571428571428575, 'support': 20}, 'P': {'precision': 0.44680851063829785, 'recall': 0.42857142857142855, 'f1-score': 0.4375, 'support': 49}, 'micro avg': {'precision': 0.41935483870967744, 'recall': 0.37681159420289856, 'f1-score': 0.39694656488549623, 'support': 69}, 'macro avg': {'precision': 0.3900709219858156, 'recall': 0.3392857142857143, 'f1-score': 0.3616071428571429, 'support': 69}, 'weighted avg': {'precision': 0.4139171548977284, 'recall': 0.37681159420289856, 'f1-score': 0.3935041407867495, 'support': 69}}
Dev-Data: Prec: 0.419, Rec: 0.377, F1: 0.3969
{'C': {'precision': 0.15566037735849056, 'recall': 0.11956521739130435, 'f1-score': 0.13524590163934427, 'support': 276}, 'P': {'precision': 0.1839080459770115, 'recall': 0.26229508196721313, 'f1-score': 0.2162162162162162, 'support': 305}, 'micro avg': {'precision': 0.17465224111282843, 'recall': 0.1944922547332186, 'f1-score': 0.18403908794788273, 'support': 581}, 'macro avg': {'precision': 0.16978421166775104, 'recall': 0.19093014967925875, 'f1-score': 0.17573105892778024, 'support': 581}, 'weighted avg': {'precision': 0.1704891879069396, 'recall': 0.1944922547332186, 'f1-score': 0.17775183269949218, 'support': 581}}
Wrong BIO-Encoding 125/759 labels, 16.47%
{'C': {'precision': 0.15566037735849056, 'recall': 0.11956521739130435, 'f1-score': 0.13524590163934427, 'support': 276}, 'P': {'precision': 0.1839080459770115, 'recall': 0.26229508196721313, 'f1-score': 0.2162162162162162, 'support': 305}, 'micro avg': {'precision': 0.17465224111282843, 'recall': 0.1944922547332186, 'f1-score': 0.18403908794788273, 'support': 581}, 'macro avg': {'precision': 0.16978421166775104, 'recall': 0.19093014967925875, 'f1-score': 0.17573105892778024, 'support': 581}, 'weighted avg': {'precision': 0.1704891879069396, 'recall': 0.1944922547332186, 'f1-score': 0.17775183269949218, 'support': 581}}
Wrong BIO-Encoding 13/647 labels, 2.01%
Test-Data: Prec: 0.178, Rec: 0.194, F1: 0.1860

Scores from epoch with best dev-scores:
  Dev-Score: 0.4580
  Test-Score 0.1893

3.98 sec for evaluation

--------- Epoch 41 -----------
324.70 sec for training (13856.51 total)
-- cmv_modes1 --
{'C': {'precision': 0.3125, 'recall': 0.25, 'f1-score': 0.2777777777777778, 'support': 20}, 'P': {'precision': 0.48936170212765956, 'recall': 0.46938775510204084, 'f1-score': 0.47916666666666663, 'support': 49}, 'micro avg': {'precision': 0.4444444444444444, 'recall': 0.4057971014492754, 'f1-score': 0.42424242424242425, 'support': 69}, 'macro avg': {'precision': 0.40093085106382975, 'recall': 0.35969387755102045, 'f1-score': 0.3784722222222222, 'support': 69}, 'weighted avg': {'precision': 0.43809744064138145, 'recall': 0.4057971014492754, 'f1-score': 0.42079307568438, 'support': 69}}
{'C': {'precision': 0.3125, 'recall': 0.25, 'f1-score': 0.2777777777777778, 'support': 20}, 'P': {'precision': 0.48936170212765956, 'recall': 0.46938775510204084, 'f1-score': 0.47916666666666663, 'support': 49}, 'micro avg': {'precision': 0.4444444444444444, 'recall': 0.4057971014492754, 'f1-score': 0.42424242424242425, 'support': 69}, 'macro avg': {'precision': 0.40093085106382975, 'recall': 0.35969387755102045, 'f1-score': 0.3784722222222222, 'support': 69}, 'weighted avg': {'precision': 0.43809744064138145, 'recall': 0.4057971014492754, 'f1-score': 0.42079307568438, 'support': 69}}
Dev-Data: Prec: 0.444, Rec: 0.406, F1: 0.4242
{'C': {'precision': 0.14052287581699346, 'recall': 0.15579710144927536, 'f1-score': 0.14776632302405499, 'support': 276}, 'P': {'precision': 0.20738636363636365, 'recall': 0.23934426229508196, 'f1-score': 0.2222222222222222, 'support': 305}, 'micro avg': {'precision': 0.1762917933130699, 'recall': 0.19965576592082615, 'f1-score': 0.18724778046811943, 'support': 581}, 'macro avg': {'precision': 0.17395461972667856, 'recall': 0.19757068187217866, 'f1-score': 0.1849942726231386, 'support': 581}, 'weighted avg': {'precision': 0.1756233298357678, 'recall': 0.19965576592082615, 'f1-score': 0.18685246632085534, 'support': 581}}
Wrong BIO-Encoding 141/788 labels, 17.89%
{'C': {'precision': 0.14052287581699346, 'recall': 0.15579710144927536, 'f1-score': 0.14776632302405499, 'support': 276}, 'P': {'precision': 0.20738636363636365, 'recall': 0.23934426229508196, 'f1-score': 0.2222222222222222, 'support': 305}, 'micro avg': {'precision': 0.1762917933130699, 'recall': 0.19965576592082615, 'f1-score': 0.18724778046811943, 'support': 581}, 'macro avg': {'precision': 0.17395461972667856, 'recall': 0.19757068187217866, 'f1-score': 0.1849942726231386, 'support': 581}, 'weighted avg': {'precision': 0.1756233298357678, 'recall': 0.19965576592082615, 'f1-score': 0.18685246632085534, 'support': 581}}
Wrong BIO-Encoding 11/658 labels, 1.67%
Test-Data: Prec: 0.179, Rec: 0.200, F1: 0.1889

Scores from epoch with best dev-scores:
  Dev-Score: 0.4580
  Test-Score 0.1893

3.97 sec for evaluation

--------- Epoch 42 -----------
325.74 sec for training (14182.25 total)
-- cmv_modes1 --
{'C': {'precision': 0.38461538461538464, 'recall': 0.25, 'f1-score': 0.30303030303030304, 'support': 20}, 'P': {'precision': 0.5, 'recall': 0.42857142857142855, 'f1-score': 0.4615384615384615, 'support': 49}, 'micro avg': {'precision': 0.4727272727272727, 'recall': 0.37681159420289856, 'f1-score': 0.41935483870967744, 'support': 69}, 'macro avg': {'precision': 0.4423076923076923, 'recall': 0.3392857142857143, 'f1-score': 0.3822843822843823, 'support': 69}, 'weighted avg': {'precision': 0.4665551839464883, 'recall': 0.37681159420289856, 'f1-score': 0.4155940677679808, 'support': 69}}
{'C': {'precision': 0.38461538461538464, 'recall': 0.25, 'f1-score': 0.30303030303030304, 'support': 20}, 'P': {'precision': 0.5, 'recall': 0.42857142857142855, 'f1-score': 0.4615384615384615, 'support': 49}, 'micro avg': {'precision': 0.4727272727272727, 'recall': 0.37681159420289856, 'f1-score': 0.41935483870967744, 'support': 69}, 'macro avg': {'precision': 0.4423076923076923, 'recall': 0.3392857142857143, 'f1-score': 0.3822843822843823, 'support': 69}, 'weighted avg': {'precision': 0.4665551839464883, 'recall': 0.37681159420289856, 'f1-score': 0.4155940677679808, 'support': 69}}
Dev-Data: Prec: 0.473, Rec: 0.377, F1: 0.4194
{'C': {'precision': 0.15086206896551724, 'recall': 0.12681159420289856, 'f1-score': 0.1377952755905512, 'support': 276}, 'P': {'precision': 0.18699186991869918, 'recall': 0.2262295081967213, 'f1-score': 0.20474777448071216, 'support': 305}, 'micro avg': {'precision': 0.17304492512479203, 'recall': 0.17900172117039587, 'f1-score': 0.17597292724196278, 'support': 581}, 'macro avg': {'precision': 0.16892696944210822, 'recall': 0.17652055119980992, 'f1-score': 0.17127152503563167, 'support': 581}, 'weighted avg': {'precision': 0.16982865982734252, 'recall': 0.17900172117039587, 'f1-score': 0.17294245659141022, 'support': 581}}
Wrong BIO-Encoding 161/750 labels, 21.47%
{'C': {'precision': 0.15086206896551724, 'recall': 0.12681159420289856, 'f1-score': 0.1377952755905512, 'support': 276}, 'P': {'precision': 0.18699186991869918, 'recall': 0.2262295081967213, 'f1-score': 0.20474777448071216, 'support': 305}, 'micro avg': {'precision': 0.17304492512479203, 'recall': 0.17900172117039587, 'f1-score': 0.17597292724196278, 'support': 581}, 'macro avg': {'precision': 0.16892696944210822, 'recall': 0.17652055119980992, 'f1-score': 0.17127152503563167, 'support': 581}, 'weighted avg': {'precision': 0.16982865982734252, 'recall': 0.17900172117039587, 'f1-score': 0.17294245659141022, 'support': 581}}
Wrong BIO-Encoding 12/601 labels, 2.00%
Test-Data: Prec: 0.177, Rec: 0.179, F1: 0.1778

Scores from epoch with best dev-scores:
  Dev-Score: 0.4580
  Test-Score 0.1893

3.97 sec for evaluation

--------- Epoch 43 -----------
345.87 sec for training (14528.12 total)
-- cmv_modes1 --
{'C': {'precision': 0.5333333333333333, 'recall': 0.4, 'f1-score': 0.4571428571428572, 'support': 20}, 'P': {'precision': 0.4782608695652174, 'recall': 0.4489795918367347, 'f1-score': 0.46315789473684216, 'support': 49}, 'micro avg': {'precision': 0.4918032786885246, 'recall': 0.43478260869565216, 'f1-score': 0.4615384615384615, 'support': 69}, 'macro avg': {'precision': 0.5057971014492754, 'recall': 0.42448979591836733, 'f1-score': 0.46015037593984964, 'support': 69}, 'weighted avg': {'precision': 0.4942239025414829, 'recall': 0.43478260869565216, 'f1-score': 0.46141440557916535, 'support': 69}}
Wrong BIO-Encoding 13/73 labels, 17.81%
{'C': {'precision': 0.5333333333333333, 'recall': 0.4, 'f1-score': 0.4571428571428572, 'support': 20}, 'P': {'precision': 0.4782608695652174, 'recall': 0.4489795918367347, 'f1-score': 0.46315789473684216, 'support': 49}, 'micro avg': {'precision': 0.4918032786885246, 'recall': 0.43478260869565216, 'f1-score': 0.4615384615384615, 'support': 69}, 'macro avg': {'precision': 0.5057971014492754, 'recall': 0.42448979591836733, 'f1-score': 0.46015037593984964, 'support': 69}, 'weighted avg': {'precision': 0.4942239025414829, 'recall': 0.43478260869565216, 'f1-score': 0.46141440557916535, 'support': 69}}
Wrong BIO-Encoding 1/61 labels, 1.64%
Dev-Data: Prec: 0.500, Rec: 0.435, F1: 0.4651
{'C': {'precision': 0.13636363636363635, 'recall': 0.14130434782608695, 'f1-score': 0.1387900355871886, 'support': 276}, 'P': {'precision': 0.16379310344827586, 'recall': 0.18688524590163935, 'f1-score': 0.17457886676875958, 'support': 305}, 'micro avg': {'precision': 0.15141955835962145, 'recall': 0.16523235800344235, 'f1-score': 0.15802469135802472, 'support': 581}, 'macro avg': {'precision': 0.1500783699059561, 'recall': 0.16409479686386313, 'f1-score': 0.15668445117797408, 'support': 581}, 'weighted avg': {'precision': 0.15076292631340407, 'recall': 0.16523235800344235, 'f1-score': 0.15757763199059505, 'support': 581}}
Wrong BIO-Encoding 84/710 labels, 11.83%
{'C': {'precision': 0.13636363636363635, 'recall': 0.14130434782608695, 'f1-score': 0.1387900355871886, 'support': 276}, 'P': {'precision': 0.16379310344827586, 'recall': 0.18688524590163935, 'f1-score': 0.17457886676875958, 'support': 305}, 'micro avg': {'precision': 0.15141955835962145, 'recall': 0.16523235800344235, 'f1-score': 0.15802469135802472, 'support': 581}, 'macro avg': {'precision': 0.1500783699059561, 'recall': 0.16409479686386313, 'f1-score': 0.15668445117797408, 'support': 581}, 'weighted avg': {'precision': 0.15076292631340407, 'recall': 0.16523235800344235, 'f1-score': 0.15757763199059505, 'support': 581}}
Wrong BIO-Encoding 8/634 labels, 1.26%
Test-Data: Prec: 0.153, Rec: 0.165, F1: 0.1591

Scores from epoch with best dev-scores:
  Dev-Score: 0.4651
  Test-Score 0.1591

4.99 sec for evaluation

--------- Epoch 44 -----------
344.74 sec for training (14872.86 total)
-- cmv_modes1 --
{'C': {'precision': 0.42857142857142855, 'recall': 0.3, 'f1-score': 0.3529411764705882, 'support': 20}, 'P': {'precision': 0.5, 'recall': 0.42857142857142855, 'f1-score': 0.4615384615384615, 'support': 49}, 'micro avg': {'precision': 0.48214285714285715, 'recall': 0.391304347826087, 'f1-score': 0.432, 'support': 69}, 'macro avg': {'precision': 0.4642857142857143, 'recall': 0.36428571428571427, 'f1-score': 0.4072398190045249, 'support': 69}, 'weighted avg': {'precision': 0.47929606625258797, 'recall': 0.391304347826087, 'f1-score': 0.4300609876057446, 'support': 69}}
{'C': {'precision': 0.42857142857142855, 'recall': 0.3, 'f1-score': 0.3529411764705882, 'support': 20}, 'P': {'precision': 0.5, 'recall': 0.42857142857142855, 'f1-score': 0.4615384615384615, 'support': 49}, 'micro avg': {'precision': 0.48214285714285715, 'recall': 0.391304347826087, 'f1-score': 0.432, 'support': 69}, 'macro avg': {'precision': 0.4642857142857143, 'recall': 0.36428571428571427, 'f1-score': 0.4072398190045249, 'support': 69}, 'weighted avg': {'precision': 0.47929606625258797, 'recall': 0.391304347826087, 'f1-score': 0.4300609876057446, 'support': 69}}
Dev-Data: Prec: 0.482, Rec: 0.391, F1: 0.4320
{'C': {'precision': 0.15827338129496402, 'recall': 0.15942028985507245, 'f1-score': 0.1588447653429603, 'support': 276}, 'P': {'precision': 0.18624641833810887, 'recall': 0.21311475409836064, 'f1-score': 0.19877675840978593, 'support': 305}, 'micro avg': {'precision': 0.17384370015948963, 'recall': 0.18760757314974183, 'f1-score': 0.18046357615894043, 'support': 581}, 'macro avg': {'precision': 0.17225989981653644, 'recall': 0.18626752197671653, 'f1-score': 0.17881076187637313, 'support': 581}, 'weighted avg': {'precision': 0.17295802208353403, 'recall': 0.18760757314974183, 'f1-score': 0.17980734345893587, 'support': 581}}
Wrong BIO-Encoding 136/753 labels, 18.06%
{'C': {'precision': 0.15827338129496402, 'recall': 0.15942028985507245, 'f1-score': 0.1588447653429603, 'support': 276}, 'P': {'precision': 0.18624641833810887, 'recall': 0.21311475409836064, 'f1-score': 0.19877675840978593, 'support': 305}, 'micro avg': {'precision': 0.17384370015948963, 'recall': 0.18760757314974183, 'f1-score': 0.18046357615894043, 'support': 581}, 'macro avg': {'precision': 0.17225989981653644, 'recall': 0.18626752197671653, 'f1-score': 0.17881076187637313, 'support': 581}, 'weighted avg': {'precision': 0.17295802208353403, 'recall': 0.18760757314974183, 'f1-score': 0.17980734345893587, 'support': 581}}
Wrong BIO-Encoding 10/627 labels, 1.59%
Test-Data: Prec: 0.177, Rec: 0.188, F1: 0.1820

Scores from epoch with best dev-scores:
  Dev-Score: 0.4651
  Test-Score 0.1591

4.43 sec for evaluation

--------- Epoch 45 -----------
344.29 sec for training (15217.14 total)
-- cmv_modes1 --
{'C': {'precision': 0.23076923076923078, 'recall': 0.15, 'f1-score': 0.18181818181818185, 'support': 20}, 'P': {'precision': 0.425531914893617, 'recall': 0.40816326530612246, 'f1-score': 0.4166666666666667, 'support': 49}, 'micro avg': {'precision': 0.38333333333333336, 'recall': 0.3333333333333333, 'f1-score': 0.3565891472868217, 'support': 69}, 'macro avg': {'precision': 0.3281505728314239, 'recall': 0.27908163265306124, 'f1-score': 0.29924242424242425, 'support': 69}, 'weighted avg': {'precision': 0.36907896297350506, 'recall': 0.3333333333333333, 'f1-score': 0.34859464207290297, 'support': 69}}
Wrong BIO-Encoding 13/72 labels, 18.06%
{'C': {'precision': 0.23076923076923078, 'recall': 0.15, 'f1-score': 0.18181818181818185, 'support': 20}, 'P': {'precision': 0.425531914893617, 'recall': 0.40816326530612246, 'f1-score': 0.4166666666666667, 'support': 49}, 'micro avg': {'precision': 0.38333333333333336, 'recall': 0.3333333333333333, 'f1-score': 0.3565891472868217, 'support': 69}, 'macro avg': {'precision': 0.3281505728314239, 'recall': 0.27908163265306124, 'f1-score': 0.29924242424242425, 'support': 69}, 'weighted avg': {'precision': 0.36907896297350506, 'recall': 0.3333333333333333, 'f1-score': 0.34859464207290297, 'support': 69}}
Wrong BIO-Encoding 1/60 labels, 1.67%
Dev-Data: Prec: 0.390, Rec: 0.333, F1: 0.3594
{'C': {'precision': 0.1346153846153846, 'recall': 0.12681159420289856, 'f1-score': 0.13059701492537315, 'support': 276}, 'P': {'precision': 0.16666666666666666, 'recall': 0.21311475409836064, 'f1-score': 0.18705035971223022, 'support': 305}, 'micro avg': {'precision': 0.15384615384615385, 'recall': 0.1721170395869191, 'f1-score': 0.16246953696181965, 'support': 581}, 'macro avg': {'precision': 0.15064102564102563, 'recall': 0.16996317415062961, 'f1-score': 0.1588236873188017, 'support': 581}, 'weighted avg': {'precision': 0.15144092854936225, 'recall': 0.1721170395869191, 'f1-score': 0.16023259179282823, 'support': 581}}
Wrong BIO-Encoding 212/845 labels, 25.09%
{'C': {'precision': 0.1346153846153846, 'recall': 0.12681159420289856, 'f1-score': 0.13059701492537315, 'support': 276}, 'P': {'precision': 0.16666666666666666, 'recall': 0.21311475409836064, 'f1-score': 0.18705035971223022, 'support': 305}, 'micro avg': {'precision': 0.15384615384615385, 'recall': 0.1721170395869191, 'f1-score': 0.16246953696181965, 'support': 581}, 'macro avg': {'precision': 0.15064102564102563, 'recall': 0.16996317415062961, 'f1-score': 0.1588236873188017, 'support': 581}, 'weighted avg': {'precision': 0.15144092854936225, 'recall': 0.1721170395869191, 'f1-score': 0.16023259179282823, 'support': 581}}
Wrong BIO-Encoding 17/650 labels, 2.62%
Test-Data: Prec: 0.158, Rec: 0.172, F1: 0.1647

Scores from epoch with best dev-scores:
  Dev-Score: 0.4651
  Test-Score 0.1591

4.48 sec for evaluation

--------- Epoch 46 -----------
345.33 sec for training (15562.47 total)
-- cmv_modes1 --
{'C': {'precision': 0.35714285714285715, 'recall': 0.25, 'f1-score': 0.2941176470588235, 'support': 20}, 'P': {'precision': 0.5869565217391305, 'recall': 0.5510204081632653, 'f1-score': 0.568421052631579, 'support': 49}, 'micro avg': {'precision': 0.5333333333333333, 'recall': 0.463768115942029, 'f1-score': 0.49612403100775193, 'support': 69}, 'macro avg': {'precision': 0.4720496894409938, 'recall': 0.4005102040816326, 'f1-score': 0.43126934984520127, 'support': 69}, 'weighted avg': {'precision': 0.5203438653344136, 'recall': 0.46376811594202894, 'f1-score': 0.4889128191322296, 'support': 69}}
{'C': {'precision': 0.35714285714285715, 'recall': 0.25, 'f1-score': 0.2941176470588235, 'support': 20}, 'P': {'precision': 0.5869565217391305, 'recall': 0.5510204081632653, 'f1-score': 0.568421052631579, 'support': 49}, 'micro avg': {'precision': 0.5333333333333333, 'recall': 0.463768115942029, 'f1-score': 0.49612403100775193, 'support': 69}, 'macro avg': {'precision': 0.4720496894409938, 'recall': 0.4005102040816326, 'f1-score': 0.43126934984520127, 'support': 69}, 'weighted avg': {'precision': 0.5203438653344136, 'recall': 0.46376811594202894, 'f1-score': 0.4889128191322296, 'support': 69}}
Dev-Data: Prec: 0.533, Rec: 0.464, F1: 0.4961
{'C': {'precision': 0.1732283464566929, 'recall': 0.15942028985507245, 'f1-score': 0.16603773584905662, 'support': 276}, 'P': {'precision': 0.1875, 'recall': 0.2360655737704918, 'f1-score': 0.20899854862119016, 'support': 305}, 'micro avg': {'precision': 0.18181818181818182, 'recall': 0.19965576592082615, 'f1-score': 0.1903199343724364, 'support': 581}, 'macro avg': {'precision': 0.18036417322834647, 'recall': 0.19774293181278213, 'f1-score': 0.1875181422351234, 'support': 581}, 'weighted avg': {'precision': 0.18072035046823967, 'recall': 0.19965576592082615, 'f1-score': 0.18859031398244858, 'support': 581}}
Wrong BIO-Encoding 134/761 labels, 17.61%
{'C': {'precision': 0.1732283464566929, 'recall': 0.15942028985507245, 'f1-score': 0.16603773584905662, 'support': 276}, 'P': {'precision': 0.1875, 'recall': 0.2360655737704918, 'f1-score': 0.20899854862119016, 'support': 305}, 'micro avg': {'precision': 0.18181818181818182, 'recall': 0.19965576592082615, 'f1-score': 0.1903199343724364, 'support': 581}, 'macro avg': {'precision': 0.18036417322834647, 'recall': 0.19774293181278213, 'f1-score': 0.1875181422351234, 'support': 581}, 'weighted avg': {'precision': 0.18072035046823967, 'recall': 0.19965576592082615, 'f1-score': 0.18859031398244858, 'support': 581}}
Wrong BIO-Encoding 11/638 labels, 1.72%
Test-Data: Prec: 0.185, Rec: 0.200, F1: 0.1921

Scores from epoch with best dev-scores:
  Dev-Score: 0.4961
  Test-Score 0.1921

5.13 sec for evaluation

--------- Epoch 47 -----------
346.45 sec for training (15908.92 total)
-- cmv_modes1 --
{'C': {'precision': 0.4375, 'recall': 0.35, 'f1-score': 0.38888888888888884, 'support': 20}, 'P': {'precision': 0.5111111111111111, 'recall': 0.46938775510204084, 'f1-score': 0.48936170212765956, 'support': 49}, 'micro avg': {'precision': 0.4918032786885246, 'recall': 0.43478260869565216, 'f1-score': 0.4615384615384615, 'support': 69}, 'macro avg': {'precision': 0.47430555555555554, 'recall': 0.4096938775510204, 'f1-score': 0.43912529550827417, 'support': 69}, 'weighted avg': {'precision': 0.4897745571658615, 'recall': 0.43478260869565216, 'f1-score': 0.46023914756569706, 'support': 69}}
{'C': {'precision': 0.4375, 'recall': 0.35, 'f1-score': 0.38888888888888884, 'support': 20}, 'P': {'precision': 0.5111111111111111, 'recall': 0.46938775510204084, 'f1-score': 0.48936170212765956, 'support': 49}, 'micro avg': {'precision': 0.4918032786885246, 'recall': 0.43478260869565216, 'f1-score': 0.4615384615384615, 'support': 69}, 'macro avg': {'precision': 0.47430555555555554, 'recall': 0.4096938775510204, 'f1-score': 0.43912529550827417, 'support': 69}, 'weighted avg': {'precision': 0.4897745571658615, 'recall': 0.43478260869565216, 'f1-score': 0.46023914756569706, 'support': 69}}
Dev-Data: Prec: 0.492, Rec: 0.435, F1: 0.4615
{'C': {'precision': 0.15139442231075698, 'recall': 0.13768115942028986, 'f1-score': 0.14421252371916507, 'support': 276}, 'P': {'precision': 0.15538847117794485, 'recall': 0.20327868852459016, 'f1-score': 0.17613636363636365, 'support': 305}, 'micro avg': {'precision': 0.15384615384615385, 'recall': 0.1721170395869191, 'f1-score': 0.16246953696181965, 'support': 581}, 'macro avg': {'precision': 0.1533914467443509, 'recall': 0.17047992397244, 'f1-score': 0.16017444367776434, 'support': 581}, 'weighted avg': {'precision': 0.15349112610506385, 'recall': 0.1721170395869191, 'f1-score': 0.16097116601648964, 'support': 581}}
Wrong BIO-Encoding 15/664 labels, 2.26%
{'C': {'precision': 0.15139442231075698, 'recall': 0.13768115942028986, 'f1-score': 0.14421252371916507, 'support': 276}, 'P': {'precision': 0.15538847117794485, 'recall': 0.20327868852459016, 'f1-score': 0.17613636363636365, 'support': 305}, 'micro avg': {'precision': 0.15384615384615385, 'recall': 0.1721170395869191, 'f1-score': 0.16246953696181965, 'support': 581}, 'macro avg': {'precision': 0.1533914467443509, 'recall': 0.17047992397244, 'f1-score': 0.16017444367776434, 'support': 581}, 'weighted avg': {'precision': 0.15349112610506385, 'recall': 0.1721170395869191, 'f1-score': 0.16097116601648964, 'support': 581}}
Wrong BIO-Encoding 1/650 labels, 0.15%
Test-Data: Prec: 0.154, Rec: 0.172, F1: 0.1626

Scores from epoch with best dev-scores:
  Dev-Score: 0.4961
  Test-Score 0.1921

4.46 sec for evaluation

--------- Epoch 48 -----------
345.16 sec for training (16254.08 total)
-- cmv_modes1 --
{'C': {'precision': 0.26666666666666666, 'recall': 0.2, 'f1-score': 0.2285714285714286, 'support': 20}, 'P': {'precision': 0.5, 'recall': 0.46938775510204084, 'f1-score': 0.4842105263157895, 'support': 49}, 'micro avg': {'precision': 0.4426229508196721, 'recall': 0.391304347826087, 'f1-score': 0.4153846153846154, 'support': 69}, 'macro avg': {'precision': 0.3833333333333333, 'recall': 0.3346938775510204, 'f1-score': 0.35639097744360904, 'support': 69}, 'weighted avg': {'precision': 0.4323671497584541, 'recall': 0.391304347826087, 'f1-score': 0.4101122371145255, 'support': 69}}
Wrong BIO-Encoding 34/94 labels, 36.17%
{'C': {'precision': 0.26666666666666666, 'recall': 0.2, 'f1-score': 0.2285714285714286, 'support': 20}, 'P': {'precision': 0.5, 'recall': 0.46938775510204084, 'f1-score': 0.4842105263157895, 'support': 49}, 'micro avg': {'precision': 0.4426229508196721, 'recall': 0.391304347826087, 'f1-score': 0.4153846153846154, 'support': 69}, 'macro avg': {'precision': 0.3833333333333333, 'recall': 0.3346938775510204, 'f1-score': 0.35639097744360904, 'support': 69}, 'weighted avg': {'precision': 0.4323671497584541, 'recall': 0.391304347826087, 'f1-score': 0.4101122371145255, 'support': 69}}
Wrong BIO-Encoding 1/61 labels, 1.64%
Dev-Data: Prec: 0.450, Rec: 0.391, F1: 0.4186
{'C': {'precision': 0.16363636363636364, 'recall': 0.13043478260869565, 'f1-score': 0.14516129032258066, 'support': 276}, 'P': {'precision': 0.178117048346056, 'recall': 0.22950819672131148, 'f1-score': 0.2005730659025788, 'support': 305}, 'micro avg': {'precision': 0.1729200652528548, 'recall': 0.18244406196213425, 'f1-score': 0.17755443886097153, 'support': 581}, 'macro avg': {'precision': 0.1708767059912098, 'recall': 0.17997148966500356, 'f1-score': 0.17286717811257973, 'support': 581}, 'weighted avg': {'precision': 0.17123810001580628, 'recall': 0.18244406196213425, 'f1-score': 0.17425008817438692, 'support': 581}}
Wrong BIO-Encoding 150/749 labels, 20.03%
{'C': {'precision': 0.16363636363636364, 'recall': 0.13043478260869565, 'f1-score': 0.14516129032258066, 'support': 276}, 'P': {'precision': 0.178117048346056, 'recall': 0.22950819672131148, 'f1-score': 0.2005730659025788, 'support': 305}, 'micro avg': {'precision': 0.1729200652528548, 'recall': 0.18244406196213425, 'f1-score': 0.17755443886097153, 'support': 581}, 'macro avg': {'precision': 0.1708767059912098, 'recall': 0.17997148966500356, 'f1-score': 0.17286717811257973, 'support': 581}, 'weighted avg': {'precision': 0.17123810001580628, 'recall': 0.18244406196213425, 'f1-score': 0.17425008817438692, 'support': 581}}
Wrong BIO-Encoding 14/613 labels, 2.28%
Test-Data: Prec: 0.177, Rec: 0.182, F1: 0.1797

Scores from epoch with best dev-scores:
  Dev-Score: 0.4961
  Test-Score 0.1921

4.47 sec for evaluation

--------- Epoch 49 -----------
344.36 sec for training (16598.44 total)
-- cmv_modes1 --
{'C': {'precision': 0.6666666666666666, 'recall': 0.3, 'f1-score': 0.41379310344827586, 'support': 20}, 'P': {'precision': 0.46808510638297873, 'recall': 0.4489795918367347, 'f1-score': 0.4583333333333333, 'support': 49}, 'micro avg': {'precision': 0.5, 'recall': 0.4057971014492754, 'f1-score': 0.448, 'support': 69}, 'macro avg': {'precision': 0.5673758865248226, 'recall': 0.37448979591836734, 'f1-score': 0.4360632183908046, 'support': 69}, 'weighted avg': {'precision': 0.5256449789289752, 'recall': 0.4057971014492754, 'f1-score': 0.44542312177244714, 'support': 69}}
{'C': {'precision': 0.6666666666666666, 'recall': 0.3, 'f1-score': 0.41379310344827586, 'support': 20}, 'P': {'precision': 0.46808510638297873, 'recall': 0.4489795918367347, 'f1-score': 0.4583333333333333, 'support': 49}, 'micro avg': {'precision': 0.5, 'recall': 0.4057971014492754, 'f1-score': 0.448, 'support': 69}, 'macro avg': {'precision': 0.5673758865248226, 'recall': 0.37448979591836734, 'f1-score': 0.4360632183908046, 'support': 69}, 'weighted avg': {'precision': 0.5256449789289752, 'recall': 0.4057971014492754, 'f1-score': 0.44542312177244714, 'support': 69}}
Dev-Data: Prec: 0.500, Rec: 0.406, F1: 0.4480
{'C': {'precision': 0.19337016574585636, 'recall': 0.12681159420289856, 'f1-score': 0.15317286652078774, 'support': 276}, 'P': {'precision': 0.18225419664268586, 'recall': 0.24918032786885247, 'f1-score': 0.21052631578947373, 'support': 305}, 'micro avg': {'precision': 0.18561872909698995, 'recall': 0.19104991394148021, 'f1-score': 0.18829516539440205, 'support': 581}, 'macro avg': {'precision': 0.18781218119427112, 'recall': 0.18799596103587551, 'f1-score': 0.18184959115513072, 'support': 581}, 'weighted avg': {'precision': 0.18753476027861538, 'recall': 0.19104991394148021, 'f1-score': 0.18328095951037332, 'support': 581}}
Wrong BIO-Encoding 245/827 labels, 29.63%
{'C': {'precision': 0.19337016574585636, 'recall': 0.12681159420289856, 'f1-score': 0.15317286652078774, 'support': 276}, 'P': {'precision': 0.18225419664268586, 'recall': 0.24918032786885247, 'f1-score': 0.21052631578947373, 'support': 305}, 'micro avg': {'precision': 0.18561872909698995, 'recall': 0.19104991394148021, 'f1-score': 0.18829516539440205, 'support': 581}, 'macro avg': {'precision': 0.18781218119427112, 'recall': 0.18799596103587551, 'f1-score': 0.18184959115513072, 'support': 581}, 'weighted avg': {'precision': 0.18753476027861538, 'recall': 0.19104991394148021, 'f1-score': 0.18328095951037332, 'support': 581}}
Wrong BIO-Encoding 16/598 labels, 2.68%
Test-Data: Prec: 0.191, Rec: 0.191, F1: 0.1909

Scores from epoch with best dev-scores:
  Dev-Score: 0.4961
  Test-Score 0.1921

4.46 sec for evaluation

--------- Epoch 50 -----------
342.33 sec for training (16940.78 total)
-- cmv_modes1 --
{'C': {'precision': 0.35294117647058826, 'recall': 0.3, 'f1-score': 0.3243243243243243, 'support': 20}, 'P': {'precision': 0.5581395348837209, 'recall': 0.4897959183673469, 'f1-score': 0.5217391304347826, 'support': 49}, 'micro avg': {'precision': 0.5, 'recall': 0.43478260869565216, 'f1-score': 0.46511627906976744, 'support': 69}, 'macro avg': {'precision': 0.45554035567715456, 'recall': 0.39489795918367343, 'f1-score': 0.4230317273795534, 'support': 69}, 'weighted avg': {'precision': 0.49866174983643613, 'recall': 0.43478260869565216, 'f1-score': 0.46451744750421503, 'support': 69}}
Wrong BIO-Encoding 47/105 labels, 44.76%
{'C': {'precision': 0.35294117647058826, 'recall': 0.3, 'f1-score': 0.3243243243243243, 'support': 20}, 'P': {'precision': 0.5581395348837209, 'recall': 0.4897959183673469, 'f1-score': 0.5217391304347826, 'support': 49}, 'micro avg': {'precision': 0.5, 'recall': 0.43478260869565216, 'f1-score': 0.46511627906976744, 'support': 69}, 'macro avg': {'precision': 0.45554035567715456, 'recall': 0.39489795918367343, 'f1-score': 0.4230317273795534, 'support': 69}, 'weighted avg': {'precision': 0.49866174983643613, 'recall': 0.43478260869565216, 'f1-score': 0.46451744750421503, 'support': 69}}
Wrong BIO-Encoding 2/60 labels, 3.33%
Dev-Data: Prec: 0.517, Rec: 0.435, F1: 0.4724
{'C': {'precision': 0.13074204946996468, 'recall': 0.13405797101449277, 'f1-score': 0.13237924865831843, 'support': 276}, 'P': {'precision': 0.1711229946524064, 'recall': 0.2098360655737705, 'f1-score': 0.18851251840942562, 'support': 305}, 'micro avg': {'precision': 0.1537290715372907, 'recall': 0.1738382099827883, 'f1-score': 0.1631663974151858, 'support': 581}, 'macro avg': {'precision': 0.15093252206118554, 'recall': 0.17194701829413161, 'f1-score': 0.160445883533872, 'support': 581}, 'weighted avg': {'precision': 0.15194030812856144, 'recall': 0.1738382099827883, 'f1-score': 0.16184679990459672, 'support': 581}}
Wrong BIO-Encoding 159/805 labels, 19.75%
{'C': {'precision': 0.13074204946996468, 'recall': 0.13405797101449277, 'f1-score': 0.13237924865831843, 'support': 276}, 'P': {'precision': 0.1711229946524064, 'recall': 0.2098360655737705, 'f1-score': 0.18851251840942562, 'support': 305}, 'micro avg': {'precision': 0.1537290715372907, 'recall': 0.1738382099827883, 'f1-score': 0.1631663974151858, 'support': 581}, 'macro avg': {'precision': 0.15093252206118554, 'recall': 0.17194701829413161, 'f1-score': 0.160445883533872, 'support': 581}, 'weighted avg': {'precision': 0.15194030812856144, 'recall': 0.1738382099827883, 'f1-score': 0.16184679990459672, 'support': 581}}
Wrong BIO-Encoding 11/657 labels, 1.67%
Test-Data: Prec: 0.156, Rec: 0.174, F1: 0.1646

Scores from epoch with best dev-scores:
  Dev-Score: 0.4961
  Test-Score 0.1921

4.34 sec for evaluation

---------RUN 4 ------------
Generate new embeddings files for a dataset
Read file: komninos_english_embeddings.gz
Added words: 12
:: Transform cmv_modes dataset ::
:: Create Train Matrix ::
Unknown-Tokens: 0.87%
:: Create Dev Matrix ::
Unknown-Tokens: 0.00%
:: Create Test Matrix ::
Unknown-Tokens: 0.65%
:: Transform cmv_modes1 dataset ::
:: Create Train Matrix ::
Unknown-Tokens: 0.87%
:: Create Dev Matrix ::
Unknown-Tokens: 0.00%
:: Create Test Matrix ::
Unknown-Tokens: 0.65%
:: Transform cmv_modes2 dataset ::
:: Create Train Matrix ::
Unknown-Tokens: 0.87%
:: Create Dev Matrix ::
Unknown-Tokens: 0.00%
:: Create Test Matrix ::
Unknown-Tokens: 0.65%
DONE - Embeddings file saved: pkl/cmv_modes_cmv_modes1_cmv_modes2_komninos_english_embeddings.pkl
--- cmv_modes ---
348 train sentences
3 dev sentences
108 test sentences
--- cmv_modes1 ---
348 train sentences
3 dev sentences
108 test sentences
--- cmv_modes2 ---
348 train sentences
3 dev sentences
108 test sentences
LSTM-Size: [100]
_____________________________________________________________________________________________________________________________
Layer (type)                             Output Shape               Param #        Connected to                              
=============================================================================================================================
words_input (InputLayer)                 (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
casing_input (InputLayer)                (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
word_embeddings (Embedding)              (None, None, 300)          66695400       words_input[0][0]                         
_____________________________________________________________________________________________________________________________
casing_emebddings (Embedding)            (None, None, 10)           80             casing_input[0][0]                        
_____________________________________________________________________________________________________________________________
concatenate_1 (Concatenate)              (None, None, 310)          0              word_embeddings[0][0]                     
                                                                                   casing_emebddings[0][0]                   
_____________________________________________________________________________________________________________________________
shared_varLSTM_1 (Bidirectional)         (None, None, 200)          328800         concatenate_1[0][0]                       
_____________________________________________________________________________________________________________________________
cmv_modes_hidden_lin_layer (TimeDistribu (None, None, 287)          57687          shared_varLSTM_1[0][0]                    
_____________________________________________________________________________________________________________________________
cmv_modes_crf (ChainCRF)                 (None, None, 287)          82943          cmv_modes_hidden_lin_layer[0][0]          
=============================================================================================================================
Total params: 67,164,910
Trainable params: 469,510
Non-trainable params: 66,695,400
_____________________________________________________________________________________________________________________________
_____________________________________________________________________________________________________________________________
Layer (type)                             Output Shape               Param #        Connected to                              
=============================================================================================================================
words_input (InputLayer)                 (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
casing_input (InputLayer)                (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
word_embeddings (Embedding)              (None, None, 300)          66695400       words_input[0][0]                         
_____________________________________________________________________________________________________________________________
casing_emebddings (Embedding)            (None, None, 10)           80             casing_input[0][0]                        
_____________________________________________________________________________________________________________________________
concatenate_1 (Concatenate)              (None, None, 310)          0              word_embeddings[0][0]                     
                                                                                   casing_emebddings[0][0]                   
_____________________________________________________________________________________________________________________________
shared_varLSTM_1 (Bidirectional)         (None, None, 200)          328800         concatenate_1[0][0]                       
_____________________________________________________________________________________________________________________________
cmv_modes1_hidden_lin_layer (TimeDistrib (None, None, 5)            1005           shared_varLSTM_1[0][0]                    
_____________________________________________________________________________________________________________________________
cmv_modes1_crf (ChainCRF)                (None, None, 5)            35             cmv_modes1_hidden_lin_layer[0][0]         
=============================================================================================================================
Total params: 67,025,320
Trainable params: 329,920
Non-trainable params: 66,695,400
_____________________________________________________________________________________________________________________________
_____________________________________________________________________________________________________________________________
Layer (type)                             Output Shape               Param #        Connected to                              
=============================================================================================================================
words_input (InputLayer)                 (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
casing_input (InputLayer)                (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
word_embeddings (Embedding)              (None, None, 300)          66695400       words_input[0][0]                         
_____________________________________________________________________________________________________________________________
casing_emebddings (Embedding)            (None, None, 10)           80             casing_input[0][0]                        
_____________________________________________________________________________________________________________________________
concatenate_1 (Concatenate)              (None, None, 310)          0              word_embeddings[0][0]                     
                                                                                   casing_emebddings[0][0]                   
_____________________________________________________________________________________________________________________________
shared_varLSTM_1 (Bidirectional)         (None, None, 200)          328800         concatenate_1[0][0]                       
_____________________________________________________________________________________________________________________________
cmv_modes2_softmax (TimeDistributed)     (None, None, 119)          23919          shared_varLSTM_1[0][0]                    
=============================================================================================================================
Total params: 67,048,199
Trainable params: 352,799
Non-trainable params: 66,695,400
_____________________________________________________________________________________________________________________________

--------- Epoch 1 -----------
354.77 sec for training (354.77 total)
-- cmv_modes1 --
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 28}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 32}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 60}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 60}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 60}}
Wrong BIO-Encoding 942/942 labels, 100.00%
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 28}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 32}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 60}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 60}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 60}}
Wrong BIO-Encoding 22/22 labels, 100.00%
Dev-Data: Prec: 0.000, Rec: 0.000, F1: 0.0000
{'C': {'precision': 0.003745318352059925, 'recall': 0.0025974025974025974, 'f1-score': 0.003067484662576687, 'support': 385}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 396}, 'micro avg': {'precision': 0.0022471910112359553, 'recall': 0.0012804097311139564, 'f1-score': 0.0016313213703099511, 'support': 781}, 'macro avg': {'precision': 0.0018726591760299626, 'recall': 0.0012987012987012987, 'f1-score': 0.0015337423312883436, 'support': 781}, 'weighted avg': {'precision': 0.0018462836946774278, 'recall': 0.0012804097311139564, 'f1-score': 0.0015121403266223107, 'support': 781}}
Wrong BIO-Encoding 13516/13541 labels, 99.82%
{'C': {'precision': 0.003745318352059925, 'recall': 0.0025974025974025974, 'f1-score': 0.003067484662576687, 'support': 385}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 396}, 'micro avg': {'precision': 0.0022471910112359553, 'recall': 0.0012804097311139564, 'f1-score': 0.0016313213703099511, 'support': 781}, 'macro avg': {'precision': 0.0018726591760299626, 'recall': 0.0012987012987012987, 'f1-score': 0.0015337423312883436, 'support': 781}, 'weighted avg': {'precision': 0.0018462836946774278, 'recall': 0.0012804097311139564, 'f1-score': 0.0015121403266223107, 'support': 781}}
Wrong BIO-Encoding 420/445 labels, 94.38%
Test-Data: Prec: 0.002, Rec: 0.001, F1: 0.0016

Scores from epoch with best dev-scores:
  Dev-Score: 0.0000
  Test-Score 0.0000

5.73 sec for evaluation

--------- Epoch 2 -----------
334.03 sec for training (688.80 total)
-- cmv_modes1 --
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 28}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 32}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 60}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 60}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 60}}
Wrong BIO-Encoding 11/12 labels, 91.67%
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 28}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 32}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 60}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 60}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 60}}
Wrong BIO-Encoding 1/2 labels, 50.00%
Dev-Data: Prec: 0.000, Rec: 0.000, F1: 0.0000
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 385}, 'P': {'precision': 0.010101010101010102, 'recall': 0.0025252525252525255, 'f1-score': 0.00404040404040404, 'support': 396}, 'micro avg': {'precision': 0.007575757575757576, 'recall': 0.0012804097311139564, 'f1-score': 0.0021905805038335154, 'support': 781}, 'macro avg': {'precision': 0.005050505050505051, 'recall': 0.0012626262626262627, 'f1-score': 0.00202020202020202, 'support': 781}, 'weighted avg': {'precision': 0.005121638924455826, 'recall': 0.0012804097311139564, 'f1-score': 0.0020486555697823306, 'support': 781}}
Wrong BIO-Encoding 3261/3283 labels, 99.33%
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 385}, 'P': {'precision': 0.010101010101010102, 'recall': 0.0025252525252525255, 'f1-score': 0.00404040404040404, 'support': 396}, 'micro avg': {'precision': 0.007575757575757576, 'recall': 0.0012804097311139564, 'f1-score': 0.0021905805038335154, 'support': 781}, 'macro avg': {'precision': 0.005050505050505051, 'recall': 0.0012626262626262627, 'f1-score': 0.00202020202020202, 'support': 781}, 'weighted avg': {'precision': 0.005121638924455826, 'recall': 0.0012804097311139564, 'f1-score': 0.0020486555697823306, 'support': 781}}
Wrong BIO-Encoding 110/132 labels, 83.33%
Test-Data: Prec: 0.008, Rec: 0.001, F1: 0.0022

Scores from epoch with best dev-scores:
  Dev-Score: 0.0000
  Test-Score 0.0000

4.64 sec for evaluation

--------- Epoch 3 -----------
333.58 sec for training (1022.38 total)
-- cmv_modes1 --
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 28}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 32}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 60}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 60}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 60}}
Wrong BIO-Encoding 107/113 labels, 94.69%
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 28}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 32}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 60}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 60}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 60}}
Wrong BIO-Encoding 9/15 labels, 60.00%
Dev-Data: Prec: 0.000, Rec: 0.000, F1: 0.0000
{'C': {'precision': 0.046357615894039736, 'recall': 0.01818181818181818, 'f1-score': 0.02611940298507463, 'support': 385}, 'P': {'precision': 0.038461538461538464, 'recall': 0.015151515151515152, 'f1-score': 0.021739130434782608, 'support': 396}, 'micro avg': {'precision': 0.04234527687296417, 'recall': 0.016645326504481434, 'f1-score': 0.02389705882352941, 'support': 781}, 'macro avg': {'precision': 0.0424095771777891, 'recall': 0.016666666666666666, 'f1-score': 0.02392926670992862, 'support': 781}, 'weighted avg': {'precision': 0.04235397099868698, 'recall': 0.016645326504481434, 'f1-score': 0.023898419720137832, 'support': 781}}
Wrong BIO-Encoding 7222/7342 labels, 98.37%
{'C': {'precision': 0.046357615894039736, 'recall': 0.01818181818181818, 'f1-score': 0.02611940298507463, 'support': 385}, 'P': {'precision': 0.038461538461538464, 'recall': 0.015151515151515152, 'f1-score': 0.021739130434782608, 'support': 396}, 'micro avg': {'precision': 0.04234527687296417, 'recall': 0.016645326504481434, 'f1-score': 0.02389705882352941, 'support': 781}, 'macro avg': {'precision': 0.0424095771777891, 'recall': 0.016666666666666666, 'f1-score': 0.02392926670992862, 'support': 781}, 'weighted avg': {'precision': 0.04235397099868698, 'recall': 0.016645326504481434, 'f1-score': 0.023898419720137832, 'support': 781}}
Wrong BIO-Encoding 187/307 labels, 60.91%
Test-Data: Prec: 0.042, Rec: 0.017, F1: 0.0239

Scores from epoch with best dev-scores:
  Dev-Score: 0.0000
  Test-Score 0.0000

4.71 sec for evaluation

--------- Epoch 4 -----------
331.71 sec for training (1354.08 total)
-- cmv_modes1 --
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 28}, 'P': {'precision': 0.04878048780487805, 'recall': 0.0625, 'f1-score': 0.05479452054794521, 'support': 32}, 'micro avg': {'precision': 0.045454545454545456, 'recall': 0.03333333333333333, 'f1-score': 0.03846153846153846, 'support': 60}, 'macro avg': {'precision': 0.024390243902439025, 'recall': 0.03125, 'f1-score': 0.027397260273972605, 'support': 60}, 'weighted avg': {'precision': 0.026016260162601626, 'recall': 0.03333333333333333, 'f1-score': 0.029223744292237445, 'support': 60}}
Wrong BIO-Encoding 49/91 labels, 53.85%
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 28}, 'P': {'precision': 0.04878048780487805, 'recall': 0.0625, 'f1-score': 0.05479452054794521, 'support': 32}, 'micro avg': {'precision': 0.045454545454545456, 'recall': 0.03333333333333333, 'f1-score': 0.03846153846153846, 'support': 60}, 'macro avg': {'precision': 0.024390243902439025, 'recall': 0.03125, 'f1-score': 0.027397260273972605, 'support': 60}, 'weighted avg': {'precision': 0.026016260162601626, 'recall': 0.03333333333333333, 'f1-score': 0.029223744292237445, 'support': 60}}
Wrong BIO-Encoding 2/44 labels, 4.55%
Dev-Data: Prec: 0.048, Rec: 0.033, F1: 0.0392
{'C': {'precision': 0.08571428571428572, 'recall': 0.023376623376623377, 'f1-score': 0.03673469387755102, 'support': 385}, 'P': {'precision': 0.15550239234449761, 'recall': 0.16414141414141414, 'f1-score': 0.15970515970515972, 'support': 396}, 'micro avg': {'precision': 0.14149139579349904, 'recall': 0.09475032010243278, 'f1-score': 0.11349693251533743, 'support': 781}, 'macro avg': {'precision': 0.12060833902939166, 'recall': 0.09375901875901876, 'f1-score': 0.09821992679135537, 'support': 781}, 'weighted avg': {'precision': 0.12109980456904104, 'recall': 0.09475032010243278, 'f1-score': 0.09908591598732445, 'support': 781}}
Wrong BIO-Encoding 2290/2735 labels, 83.73%
{'C': {'precision': 0.08571428571428572, 'recall': 0.023376623376623377, 'f1-score': 0.03673469387755102, 'support': 385}, 'P': {'precision': 0.15550239234449761, 'recall': 0.16414141414141414, 'f1-score': 0.15970515970515972, 'support': 396}, 'micro avg': {'precision': 0.14149139579349904, 'recall': 0.09475032010243278, 'f1-score': 0.11349693251533743, 'support': 781}, 'macro avg': {'precision': 0.12060833902939166, 'recall': 0.09375901875901876, 'f1-score': 0.09821992679135537, 'support': 781}, 'weighted avg': {'precision': 0.12109980456904104, 'recall': 0.09475032010243278, 'f1-score': 0.09908591598732445, 'support': 781}}
Wrong BIO-Encoding 78/523 labels, 14.91%
Test-Data: Prec: 0.162, Rec: 0.092, F1: 0.1175

Scores from epoch with best dev-scores:
  Dev-Score: 0.0392
  Test-Score 0.1175

4.49 sec for evaluation

--------- Epoch 5 -----------
328.32 sec for training (1682.40 total)
-- cmv_modes1 --
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 28}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 32}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 60}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 60}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 60}}
Wrong BIO-Encoding 32/42 labels, 76.19%
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 28}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 32}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 60}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 60}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 60}}
Wrong BIO-Encoding 1/11 labels, 9.09%
Dev-Data: Prec: 0.000, Rec: 0.000, F1: 0.0000
{'C': {'precision': 0.2079207920792079, 'recall': 0.05454545454545454, 'f1-score': 0.08641975308641975, 'support': 385}, 'P': {'precision': 0.19636363636363635, 'recall': 0.13636363636363635, 'f1-score': 0.16095380029806258, 'support': 396}, 'micro avg': {'precision': 0.19946808510638298, 'recall': 0.09603072983354674, 'f1-score': 0.1296456352636128, 'support': 781}, 'macro avg': {'precision': 0.20214221422142215, 'recall': 0.09545454545454544, 'f1-score': 0.12368677669224117, 'support': 781}, 'weighted avg': {'precision': 0.20206082580088994, 'recall': 0.09603072983354674, 'f1-score': 0.12421166434866118, 'support': 781}}
Wrong BIO-Encoding 1782/2101 labels, 84.82%
{'C': {'precision': 0.2079207920792079, 'recall': 0.05454545454545454, 'f1-score': 0.08641975308641975, 'support': 385}, 'P': {'precision': 0.19636363636363635, 'recall': 0.13636363636363635, 'f1-score': 0.16095380029806258, 'support': 396}, 'micro avg': {'precision': 0.19946808510638298, 'recall': 0.09603072983354674, 'f1-score': 0.1296456352636128, 'support': 781}, 'macro avg': {'precision': 0.20214221422142215, 'recall': 0.09545454545454544, 'f1-score': 0.12368677669224117, 'support': 781}, 'weighted avg': {'precision': 0.20206082580088994, 'recall': 0.09603072983354674, 'f1-score': 0.12421166434866118, 'support': 781}}
Wrong BIO-Encoding 57/376 labels, 15.16%
Test-Data: Prec: 0.229, Rec: 0.093, F1: 0.1327

Scores from epoch with best dev-scores:
  Dev-Score: 0.0392
  Test-Score 0.1175

4.29 sec for evaluation

--------- Epoch 6 -----------
328.48 sec for training (2010.88 total)
-- cmv_modes1 --
{'C': {'precision': 0.16666666666666666, 'recall': 0.07142857142857142, 'f1-score': 0.1, 'support': 28}, 'P': {'precision': 0.19047619047619047, 'recall': 0.25, 'f1-score': 0.2162162162162162, 'support': 32}, 'micro avg': {'precision': 0.18518518518518517, 'recall': 0.16666666666666666, 'f1-score': 0.17543859649122806, 'support': 60}, 'macro avg': {'precision': 0.17857142857142855, 'recall': 0.1607142857142857, 'f1-score': 0.1581081081081081, 'support': 60}, 'weighted avg': {'precision': 0.17936507936507934, 'recall': 0.16666666666666666, 'f1-score': 0.16198198198198197, 'support': 60}}
Wrong BIO-Encoding 95/145 labels, 65.52%
{'C': {'precision': 0.16666666666666666, 'recall': 0.07142857142857142, 'f1-score': 0.1, 'support': 28}, 'P': {'precision': 0.19047619047619047, 'recall': 0.25, 'f1-score': 0.2162162162162162, 'support': 32}, 'micro avg': {'precision': 0.18518518518518517, 'recall': 0.16666666666666666, 'f1-score': 0.17543859649122806, 'support': 60}, 'macro avg': {'precision': 0.17857142857142855, 'recall': 0.1607142857142857, 'f1-score': 0.1581081081081081, 'support': 60}, 'weighted avg': {'precision': 0.17936507936507934, 'recall': 0.16666666666666666, 'f1-score': 0.16198198198198197, 'support': 60}}
Wrong BIO-Encoding 4/54 labels, 7.41%
Dev-Data: Prec: 0.200, Rec: 0.167, F1: 0.1818
{'C': {'precision': 0.28662420382165604, 'recall': 0.11688311688311688, 'f1-score': 0.1660516605166052, 'support': 385}, 'P': {'precision': 0.1961904761904762, 'recall': 0.2601010101010101, 'f1-score': 0.22366992399565688, 'support': 396}, 'micro avg': {'precision': 0.21700879765395895, 'recall': 0.18950064020486557, 'f1-score': 0.20232399179767602, 'support': 781}, 'macro avg': {'precision': 0.24140734000606612, 'recall': 0.1884920634920635, 'f1-score': 0.19486079225613104, 'support': 781}, 'weighted avg': {'precision': 0.2407704827692268, 'recall': 0.18950064020486557, 'f1-score': 0.1952665546749976, 'support': 781}}
Wrong BIO-Encoding 765/1406 labels, 54.41%
{'C': {'precision': 0.28662420382165604, 'recall': 0.11688311688311688, 'f1-score': 0.1660516605166052, 'support': 385}, 'P': {'precision': 0.1961904761904762, 'recall': 0.2601010101010101, 'f1-score': 0.22366992399565688, 'support': 396}, 'micro avg': {'precision': 0.21700879765395895, 'recall': 0.18950064020486557, 'f1-score': 0.20232399179767602, 'support': 781}, 'macro avg': {'precision': 0.24140734000606612, 'recall': 0.1884920634920635, 'f1-score': 0.19486079225613104, 'support': 781}, 'weighted avg': {'precision': 0.2407704827692268, 'recall': 0.18950064020486557, 'f1-score': 0.1952665546749976, 'support': 781}}
Wrong BIO-Encoding 41/682 labels, 6.01%
Test-Data: Prec: 0.226, Rec: 0.186, F1: 0.2039

Scores from epoch with best dev-scores:
  Dev-Score: 0.1818
  Test-Score 0.2039

4.65 sec for evaluation

--------- Epoch 7 -----------
330.52 sec for training (2341.41 total)
-- cmv_modes1 --
{'C': {'precision': 0.17647058823529413, 'recall': 0.10714285714285714, 'f1-score': 0.13333333333333333, 'support': 28}, 'P': {'precision': 0.125, 'recall': 0.09375, 'f1-score': 0.10714285714285714, 'support': 32}, 'micro avg': {'precision': 0.14634146341463414, 'recall': 0.1, 'f1-score': 0.1188118811881188, 'support': 60}, 'macro avg': {'precision': 0.15073529411764708, 'recall': 0.10044642857142858, 'f1-score': 0.12023809523809523, 'support': 60}, 'weighted avg': {'precision': 0.14901960784313725, 'recall': 0.1, 'f1-score': 0.11936507936507935, 'support': 60}}
Wrong BIO-Encoding 134/169 labels, 79.29%
{'C': {'precision': 0.17647058823529413, 'recall': 0.10714285714285714, 'f1-score': 0.13333333333333333, 'support': 28}, 'P': {'precision': 0.125, 'recall': 0.09375, 'f1-score': 0.10714285714285714, 'support': 32}, 'micro avg': {'precision': 0.14634146341463414, 'recall': 0.1, 'f1-score': 0.1188118811881188, 'support': 60}, 'macro avg': {'precision': 0.15073529411764708, 'recall': 0.10044642857142858, 'f1-score': 0.12023809523809523, 'support': 60}, 'weighted avg': {'precision': 0.14901960784313725, 'recall': 0.1, 'f1-score': 0.11936507936507935, 'support': 60}}
Wrong BIO-Encoding 6/41 labels, 14.63%
Dev-Data: Prec: 0.171, Rec: 0.100, F1: 0.1263
{'C': {'precision': 0.22857142857142856, 'recall': 0.12467532467532468, 'f1-score': 0.16134453781512603, 'support': 385}, 'P': {'precision': 0.22468354430379747, 'recall': 0.17929292929292928, 'f1-score': 0.19943820224719103, 'support': 396}, 'micro avg': {'precision': 0.2262357414448669, 'recall': 0.1523687580025608, 'f1-score': 0.1820964039785769, 'support': 781}, 'macro avg': {'precision': 0.22662748643761302, 'recall': 0.15198412698412697, 'f1-score': 0.18039137003115852, 'support': 781}, 'weighted avg': {'precision': 0.22660010697093955, 'recall': 0.1523687580025608, 'f1-score': 0.18065963527363788, 'support': 781}}
Wrong BIO-Encoding 1428/1901 labels, 75.12%
{'C': {'precision': 0.22857142857142856, 'recall': 0.12467532467532468, 'f1-score': 0.16134453781512603, 'support': 385}, 'P': {'precision': 0.22468354430379747, 'recall': 0.17929292929292928, 'f1-score': 0.19943820224719103, 'support': 396}, 'micro avg': {'precision': 0.2262357414448669, 'recall': 0.1523687580025608, 'f1-score': 0.1820964039785769, 'support': 781}, 'macro avg': {'precision': 0.22662748643761302, 'recall': 0.15198412698412697, 'f1-score': 0.18039137003115852, 'support': 781}, 'weighted avg': {'precision': 0.22660010697093955, 'recall': 0.1523687580025608, 'f1-score': 0.18065963527363788, 'support': 781}}
Wrong BIO-Encoding 53/526 labels, 10.08%
Test-Data: Prec: 0.249, Rec: 0.151, F1: 0.1882

Scores from epoch with best dev-scores:
  Dev-Score: 0.1818
  Test-Score 0.2039

4.83 sec for evaluation

--------- Epoch 8 -----------
330.04 sec for training (2671.44 total)
-- cmv_modes1 --
{'C': {'precision': 0.0625, 'recall': 0.03571428571428571, 'f1-score': 0.045454545454545456, 'support': 28}, 'P': {'precision': 0.23529411764705882, 'recall': 0.125, 'f1-score': 0.16326530612244897, 'support': 32}, 'micro avg': {'precision': 0.15151515151515152, 'recall': 0.08333333333333333, 'f1-score': 0.1075268817204301, 'support': 60}, 'macro avg': {'precision': 0.1488970588235294, 'recall': 0.08035714285714285, 'f1-score': 0.1043599257884972, 'support': 60}, 'weighted avg': {'precision': 0.15465686274509804, 'recall': 0.08333333333333333, 'f1-score': 0.10828695114409399, 'support': 60}}
Wrong BIO-Encoding 119/147 labels, 80.95%
{'C': {'precision': 0.0625, 'recall': 0.03571428571428571, 'f1-score': 0.045454545454545456, 'support': 28}, 'P': {'precision': 0.23529411764705882, 'recall': 0.125, 'f1-score': 0.16326530612244897, 'support': 32}, 'micro avg': {'precision': 0.15151515151515152, 'recall': 0.08333333333333333, 'f1-score': 0.1075268817204301, 'support': 60}, 'macro avg': {'precision': 0.1488970588235294, 'recall': 0.08035714285714285, 'f1-score': 0.1043599257884972, 'support': 60}, 'weighted avg': {'precision': 0.15465686274509804, 'recall': 0.08333333333333333, 'f1-score': 0.10828695114409399, 'support': 60}}
Wrong BIO-Encoding 5/33 labels, 15.15%
Dev-Data: Prec: 0.179, Rec: 0.083, F1: 0.1136
{'C': {'precision': 0.22777777777777777, 'recall': 0.10649350649350649, 'f1-score': 0.14513274336283186, 'support': 385}, 'P': {'precision': 0.23076923076923078, 'recall': 0.24242424242424243, 'f1-score': 0.23645320197044337, 'support': 396}, 'micro avg': {'precision': 0.22986577181208054, 'recall': 0.17541613316261204, 'f1-score': 0.1989832970225127, 'support': 781}, 'macro avg': {'precision': 0.2292735042735043, 'recall': 0.17445887445887445, 'f1-score': 0.1907929726666376, 'support': 781}, 'weighted avg': {'precision': 0.2292945708438666, 'recall': 0.17541613316261204, 'f1-score': 0.19143607448781796, 'support': 781}}
Wrong BIO-Encoding 827/1378 labels, 60.01%
{'C': {'precision': 0.22777777777777777, 'recall': 0.10649350649350649, 'f1-score': 0.14513274336283186, 'support': 385}, 'P': {'precision': 0.23076923076923078, 'recall': 0.24242424242424243, 'f1-score': 0.23645320197044337, 'support': 396}, 'micro avg': {'precision': 0.22986577181208054, 'recall': 0.17541613316261204, 'f1-score': 0.1989832970225127, 'support': 781}, 'macro avg': {'precision': 0.2292735042735043, 'recall': 0.17445887445887445, 'f1-score': 0.1907929726666376, 'support': 781}, 'weighted avg': {'precision': 0.2292945708438666, 'recall': 0.17541613316261204, 'f1-score': 0.19143607448781796, 'support': 781}}
Wrong BIO-Encoding 45/596 labels, 7.55%
Test-Data: Prec: 0.249, Rec: 0.175, F1: 0.2057

Scores from epoch with best dev-scores:
  Dev-Score: 0.1818
  Test-Score 0.2039

4.64 sec for evaluation

--------- Epoch 9 -----------
323.20 sec for training (2994.64 total)
-- cmv_modes1 --
{'C': {'precision': 0.06896551724137931, 'recall': 0.07142857142857142, 'f1-score': 0.07017543859649124, 'support': 28}, 'P': {'precision': 0.2857142857142857, 'recall': 0.1875, 'f1-score': 0.22641509433962265, 'support': 32}, 'micro avg': {'precision': 0.16, 'recall': 0.13333333333333333, 'f1-score': 0.14545454545454545, 'support': 60}, 'macro avg': {'precision': 0.17733990147783252, 'recall': 0.1294642857142857, 'f1-score': 0.14829526646805694, 'support': 60}, 'weighted avg': {'precision': 0.18456486042692938, 'recall': 0.13333333333333333, 'f1-score': 0.153503254992828, 'support': 60}}
Wrong BIO-Encoding 123/167 labels, 73.65%
{'C': {'precision': 0.06896551724137931, 'recall': 0.07142857142857142, 'f1-score': 0.07017543859649124, 'support': 28}, 'P': {'precision': 0.2857142857142857, 'recall': 0.1875, 'f1-score': 0.22641509433962265, 'support': 32}, 'micro avg': {'precision': 0.16, 'recall': 0.13333333333333333, 'f1-score': 0.14545454545454545, 'support': 60}, 'macro avg': {'precision': 0.17733990147783252, 'recall': 0.1294642857142857, 'f1-score': 0.14829526646805694, 'support': 60}, 'weighted avg': {'precision': 0.18456486042692938, 'recall': 0.13333333333333333, 'f1-score': 0.153503254992828, 'support': 60}}
Wrong BIO-Encoding 6/50 labels, 12.00%
Dev-Data: Prec: 0.182, Rec: 0.133, F1: 0.1538
{'C': {'precision': 0.2511013215859031, 'recall': 0.14805194805194805, 'f1-score': 0.18627450980392155, 'support': 385}, 'P': {'precision': 0.24598930481283424, 'recall': 0.23232323232323232, 'f1-score': 0.23896103896103896, 'support': 396}, 'micro avg': {'precision': 0.24792013311148087, 'recall': 0.19078104993597952, 'f1-score': 0.21562952243125905, 'support': 781}, 'macro avg': {'precision': 0.24854531319936868, 'recall': 0.19018759018759018, 'f1-score': 0.21261777438248025, 'support': 781}, 'weighted avg': {'precision': 0.24850931308124846, 'recall': 0.19078104993597952, 'f1-score': 0.21298880627795289, 'support': 781}}
Wrong BIO-Encoding 380/959 labels, 39.62%
{'C': {'precision': 0.2511013215859031, 'recall': 0.14805194805194805, 'f1-score': 0.18627450980392155, 'support': 385}, 'P': {'precision': 0.24598930481283424, 'recall': 0.23232323232323232, 'f1-score': 0.23896103896103896, 'support': 396}, 'micro avg': {'precision': 0.24792013311148087, 'recall': 0.19078104993597952, 'f1-score': 0.21562952243125905, 'support': 781}, 'macro avg': {'precision': 0.24854531319936868, 'recall': 0.19018759018759018, 'f1-score': 0.21261777438248025, 'support': 781}, 'weighted avg': {'precision': 0.24850931308124846, 'recall': 0.19078104993597952, 'f1-score': 0.21298880627795289, 'support': 781}}
Wrong BIO-Encoding 22/601 labels, 3.66%
Test-Data: Prec: 0.257, Rec: 0.191, F1: 0.2191

Scores from epoch with best dev-scores:
  Dev-Score: 0.1818
  Test-Score 0.2039

4.58 sec for evaluation

--------- Epoch 10 -----------
332.99 sec for training (3327.63 total)
-- cmv_modes1 --
{'C': {'precision': 0.10526315789473684, 'recall': 0.07142857142857142, 'f1-score': 0.0851063829787234, 'support': 28}, 'P': {'precision': 0.24, 'recall': 0.1875, 'f1-score': 0.21052631578947367, 'support': 32}, 'micro avg': {'precision': 0.18181818181818182, 'recall': 0.13333333333333333, 'f1-score': 0.15384615384615383, 'support': 60}, 'macro avg': {'precision': 0.1726315789473684, 'recall': 0.1294642857142857, 'f1-score': 0.14781634938409854, 'support': 60}, 'weighted avg': {'precision': 0.17712280701754385, 'recall': 0.13333333333333333, 'f1-score': 0.15199701381112354, 'support': 60}}
Wrong BIO-Encoding 35/77 labels, 45.45%
{'C': {'precision': 0.10526315789473684, 'recall': 0.07142857142857142, 'f1-score': 0.0851063829787234, 'support': 28}, 'P': {'precision': 0.24, 'recall': 0.1875, 'f1-score': 0.21052631578947367, 'support': 32}, 'micro avg': {'precision': 0.18181818181818182, 'recall': 0.13333333333333333, 'f1-score': 0.15384615384615383, 'support': 60}, 'macro avg': {'precision': 0.1726315789473684, 'recall': 0.1294642857142857, 'f1-score': 0.14781634938409854, 'support': 60}, 'weighted avg': {'precision': 0.17712280701754385, 'recall': 0.13333333333333333, 'f1-score': 0.15199701381112354, 'support': 60}}
Wrong BIO-Encoding 2/44 labels, 4.55%
Dev-Data: Prec: 0.190, Rec: 0.133, F1: 0.1569
{'C': {'precision': 0.3756906077348066, 'recall': 0.17662337662337663, 'f1-score': 0.2402826855123675, 'support': 385}, 'P': {'precision': 0.25229357798165136, 'recall': 0.2777777777777778, 'f1-score': 0.2644230769230769, 'support': 396}, 'micro avg': {'precision': 0.2884927066450567, 'recall': 0.22791293213828426, 'f1-score': 0.2546494992846924, 'support': 781}, 'macro avg': {'precision': 0.313992092858229, 'recall': 0.2272005772005772, 'f1-score': 0.2523528812177222, 'support': 781}, 'weighted avg': {'precision': 0.31312309969095325, 'recall': 0.22791293213828426, 'f1-score': 0.25252288397413564, 'support': 781}}
Wrong BIO-Encoding 905/1497 labels, 60.45%
{'C': {'precision': 0.3756906077348066, 'recall': 0.17662337662337663, 'f1-score': 0.2402826855123675, 'support': 385}, 'P': {'precision': 0.25229357798165136, 'recall': 0.2777777777777778, 'f1-score': 0.2644230769230769, 'support': 396}, 'micro avg': {'precision': 0.2884927066450567, 'recall': 0.22791293213828426, 'f1-score': 0.2546494992846924, 'support': 781}, 'macro avg': {'precision': 0.313992092858229, 'recall': 0.2272005772005772, 'f1-score': 0.2523528812177222, 'support': 781}, 'weighted avg': {'precision': 0.31312309969095325, 'recall': 0.22791293213828426, 'f1-score': 0.25252288397413564, 'support': 781}}
Wrong BIO-Encoding 25/617 labels, 4.05%
Test-Data: Prec: 0.299, Rec: 0.227, F1: 0.2578

Scores from epoch with best dev-scores:
  Dev-Score: 0.1818
  Test-Score 0.2039

4.68 sec for evaluation

--------- Epoch 11 -----------
333.65 sec for training (3661.28 total)
-- cmv_modes1 --
{'C': {'precision': 0.21428571428571427, 'recall': 0.10714285714285714, 'f1-score': 0.14285714285714285, 'support': 28}, 'P': {'precision': 0.34210526315789475, 'recall': 0.40625, 'f1-score': 0.3714285714285715, 'support': 32}, 'micro avg': {'precision': 0.3076923076923077, 'recall': 0.26666666666666666, 'f1-score': 0.28571428571428575, 'support': 60}, 'macro avg': {'precision': 0.2781954887218045, 'recall': 0.25669642857142855, 'f1-score': 0.2571428571428572, 'support': 60}, 'weighted avg': {'precision': 0.2824561403508772, 'recall': 0.26666666666666666, 'f1-score': 0.2647619047619048, 'support': 60}}
Wrong BIO-Encoding 9/60 labels, 15.00%
{'C': {'precision': 0.21428571428571427, 'recall': 0.10714285714285714, 'f1-score': 0.14285714285714285, 'support': 28}, 'P': {'precision': 0.34210526315789475, 'recall': 0.40625, 'f1-score': 0.3714285714285715, 'support': 32}, 'micro avg': {'precision': 0.3076923076923077, 'recall': 0.26666666666666666, 'f1-score': 0.28571428571428575, 'support': 60}, 'macro avg': {'precision': 0.2781954887218045, 'recall': 0.25669642857142855, 'f1-score': 0.2571428571428572, 'support': 60}, 'weighted avg': {'precision': 0.2824561403508772, 'recall': 0.26666666666666666, 'f1-score': 0.2647619047619048, 'support': 60}}
Wrong BIO-Encoding 1/52 labels, 1.92%
Dev-Data: Prec: 0.314, Rec: 0.267, F1: 0.2883
{'C': {'precision': 0.32386363636363635, 'recall': 0.14805194805194805, 'f1-score': 0.20320855614973263, 'support': 385}, 'P': {'precision': 0.24165029469548133, 'recall': 0.3106060606060606, 'f1-score': 0.2718232044198895, 'support': 396}, 'micro avg': {'precision': 0.26277372262773724, 'recall': 0.23047375160051217, 'f1-score': 0.24556616643929058, 'support': 781}, 'macro avg': {'precision': 0.28275696552955887, 'recall': 0.22932900432900433, 'f1-score': 0.23751588028481108, 'support': 781}, 'weighted avg': {'precision': 0.2821779983347127, 'recall': 0.23047375160051217, 'f1-score': 0.23799908203319248, 'support': 781}}
Wrong BIO-Encoding 398/1065 labels, 37.37%
{'C': {'precision': 0.32386363636363635, 'recall': 0.14805194805194805, 'f1-score': 0.20320855614973263, 'support': 385}, 'P': {'precision': 0.24165029469548133, 'recall': 0.3106060606060606, 'f1-score': 0.2718232044198895, 'support': 396}, 'micro avg': {'precision': 0.26277372262773724, 'recall': 0.23047375160051217, 'f1-score': 0.24556616643929058, 'support': 781}, 'macro avg': {'precision': 0.28275696552955887, 'recall': 0.22932900432900433, 'f1-score': 0.23751588028481108, 'support': 781}, 'weighted avg': {'precision': 0.2821779983347127, 'recall': 0.23047375160051217, 'f1-score': 0.23799908203319248, 'support': 781}}
Wrong BIO-Encoding 18/685 labels, 2.63%
Test-Data: Prec: 0.270, Rec: 0.230, F1: 0.2486

Scores from epoch with best dev-scores:
  Dev-Score: 0.2883
  Test-Score 0.2486

4.40 sec for evaluation

--------- Epoch 12 -----------
323.50 sec for training (3984.78 total)
-- cmv_modes1 --
{'C': {'precision': 0.2222222222222222, 'recall': 0.14285714285714285, 'f1-score': 0.17391304347826086, 'support': 28}, 'P': {'precision': 0.3939393939393939, 'recall': 0.40625, 'f1-score': 0.4, 'support': 32}, 'micro avg': {'precision': 0.3333333333333333, 'recall': 0.2833333333333333, 'f1-score': 0.3063063063063063, 'support': 60}, 'macro avg': {'precision': 0.30808080808080807, 'recall': 0.2745535714285714, 'f1-score': 0.28695652173913044, 'support': 60}, 'weighted avg': {'precision': 0.3138047138047138, 'recall': 0.2833333333333333, 'f1-score': 0.29449275362318844, 'support': 60}}
Wrong BIO-Encoding 28/78 labels, 35.90%
{'C': {'precision': 0.2222222222222222, 'recall': 0.14285714285714285, 'f1-score': 0.17391304347826086, 'support': 28}, 'P': {'precision': 0.3939393939393939, 'recall': 0.40625, 'f1-score': 0.4, 'support': 32}, 'micro avg': {'precision': 0.3333333333333333, 'recall': 0.2833333333333333, 'f1-score': 0.3063063063063063, 'support': 60}, 'macro avg': {'precision': 0.30808080808080807, 'recall': 0.2745535714285714, 'f1-score': 0.28695652173913044, 'support': 60}, 'weighted avg': {'precision': 0.3138047138047138, 'recall': 0.2833333333333333, 'f1-score': 0.29449275362318844, 'support': 60}}
Wrong BIO-Encoding 1/51 labels, 1.96%
Dev-Data: Prec: 0.340, Rec: 0.283, F1: 0.3091
{'C': {'precision': 0.31958762886597936, 'recall': 0.16103896103896104, 'f1-score': 0.21416234887737476, 'support': 385}, 'P': {'precision': 0.2557603686635945, 'recall': 0.2803030303030303, 'f1-score': 0.2674698795180722, 'support': 396}, 'micro avg': {'precision': 0.2754777070063694, 'recall': 0.22151088348271447, 'f1-score': 0.24556422995031937, 'support': 781}, 'macro avg': {'precision': 0.28767399876478694, 'recall': 0.22067099567099566, 'f1-score': 0.24081611419772347, 'support': 781}, 'weighted avg': {'precision': 0.2872245110168828, 'recall': 0.22151088348271447, 'f1-score': 0.24119151934308047, 'support': 781}}
Wrong BIO-Encoding 268/884 labels, 30.32%
{'C': {'precision': 0.31958762886597936, 'recall': 0.16103896103896104, 'f1-score': 0.21416234887737476, 'support': 385}, 'P': {'precision': 0.2557603686635945, 'recall': 0.2803030303030303, 'f1-score': 0.2674698795180722, 'support': 396}, 'micro avg': {'precision': 0.2754777070063694, 'recall': 0.22151088348271447, 'f1-score': 0.24556422995031937, 'support': 781}, 'macro avg': {'precision': 0.28767399876478694, 'recall': 0.22067099567099566, 'f1-score': 0.24081611419772347, 'support': 781}, 'weighted avg': {'precision': 0.2872245110168828, 'recall': 0.22151088348271447, 'f1-score': 0.24119151934308047, 'support': 781}}
Wrong BIO-Encoding 12/628 labels, 1.91%
Test-Data: Prec: 0.279, Rec: 0.220, F1: 0.2462

Scores from epoch with best dev-scores:
  Dev-Score: 0.3091
  Test-Score 0.2462

4.33 sec for evaluation

--------- Epoch 13 -----------
320.57 sec for training (4305.35 total)
-- cmv_modes1 --
{'C': {'precision': 0.3333333333333333, 'recall': 0.14285714285714285, 'f1-score': 0.2, 'support': 28}, 'P': {'precision': 0.3939393939393939, 'recall': 0.40625, 'f1-score': 0.4, 'support': 32}, 'micro avg': {'precision': 0.37777777777777777, 'recall': 0.2833333333333333, 'f1-score': 0.32380952380952377, 'support': 60}, 'macro avg': {'precision': 0.36363636363636365, 'recall': 0.2745535714285714, 'f1-score': 0.30000000000000004, 'support': 60}, 'weighted avg': {'precision': 0.3656565656565656, 'recall': 0.2833333333333333, 'f1-score': 0.3066666666666667, 'support': 60}}
Wrong BIO-Encoding 48/91 labels, 52.75%
{'C': {'precision': 0.3333333333333333, 'recall': 0.14285714285714285, 'f1-score': 0.2, 'support': 28}, 'P': {'precision': 0.3939393939393939, 'recall': 0.40625, 'f1-score': 0.4, 'support': 32}, 'micro avg': {'precision': 0.37777777777777777, 'recall': 0.2833333333333333, 'f1-score': 0.32380952380952377, 'support': 60}, 'macro avg': {'precision': 0.36363636363636365, 'recall': 0.2745535714285714, 'f1-score': 0.30000000000000004, 'support': 60}, 'weighted avg': {'precision': 0.3656565656565656, 'recall': 0.2833333333333333, 'f1-score': 0.3066666666666667, 'support': 60}}
Wrong BIO-Encoding 2/45 labels, 4.44%
Dev-Data: Prec: 0.395, Rec: 0.283, F1: 0.3301
{'C': {'precision': 0.2982456140350877, 'recall': 0.13246753246753246, 'f1-score': 0.1834532374100719, 'support': 385}, 'P': {'precision': 0.24731182795698925, 'recall': 0.2904040404040404, 'f1-score': 0.2671312427409988, 'support': 396}, 'micro avg': {'precision': 0.2610062893081761, 'recall': 0.21254801536491677, 'f1-score': 0.23429781227946364, 'support': 781}, 'macro avg': {'precision': 0.2727787209960385, 'recall': 0.21143578643578642, 'f1-score': 0.22529224007553536, 'support': 781}, 'weighted avg': {'precision': 0.27242003236168566, 'recall': 0.21254801536491677, 'f1-score': 0.22588152180321794, 'support': 781}}
Wrong BIO-Encoding 617/1225 labels, 50.37%
{'C': {'precision': 0.2982456140350877, 'recall': 0.13246753246753246, 'f1-score': 0.1834532374100719, 'support': 385}, 'P': {'precision': 0.24731182795698925, 'recall': 0.2904040404040404, 'f1-score': 0.2671312427409988, 'support': 396}, 'micro avg': {'precision': 0.2610062893081761, 'recall': 0.21254801536491677, 'f1-score': 0.23429781227946364, 'support': 781}, 'macro avg': {'precision': 0.2727787209960385, 'recall': 0.21143578643578642, 'f1-score': 0.22529224007553536, 'support': 781}, 'weighted avg': {'precision': 0.27242003236168566, 'recall': 0.21254801536491677, 'f1-score': 0.22588152180321794, 'support': 781}}
Wrong BIO-Encoding 28/636 labels, 4.40%
Test-Data: Prec: 0.273, Rec: 0.213, F1: 0.2390

Scores from epoch with best dev-scores:
  Dev-Score: 0.3301
  Test-Score 0.2390

4.65 sec for evaluation

--------- Epoch 14 -----------
319.77 sec for training (4625.12 total)
-- cmv_modes1 --
{'C': {'precision': 0.20833333333333334, 'recall': 0.17857142857142858, 'f1-score': 0.1923076923076923, 'support': 28}, 'P': {'precision': 0.4411764705882353, 'recall': 0.46875, 'f1-score': 0.45454545454545453, 'support': 32}, 'micro avg': {'precision': 0.3448275862068966, 'recall': 0.3333333333333333, 'f1-score': 0.33898305084745767, 'support': 60}, 'macro avg': {'precision': 0.3247549019607843, 'recall': 0.3236607142857143, 'f1-score': 0.32342657342657344, 'support': 60}, 'weighted avg': {'precision': 0.3325163398692811, 'recall': 0.3333333333333333, 'f1-score': 0.3321678321678322, 'support': 60}}
Wrong BIO-Encoding 19/76 labels, 25.00%
{'C': {'precision': 0.20833333333333334, 'recall': 0.17857142857142858, 'f1-score': 0.1923076923076923, 'support': 28}, 'P': {'precision': 0.4411764705882353, 'recall': 0.46875, 'f1-score': 0.45454545454545453, 'support': 32}, 'micro avg': {'precision': 0.3448275862068966, 'recall': 0.3333333333333333, 'f1-score': 0.33898305084745767, 'support': 60}, 'macro avg': {'precision': 0.3247549019607843, 'recall': 0.3236607142857143, 'f1-score': 0.32342657342657344, 'support': 60}, 'weighted avg': {'precision': 0.3325163398692811, 'recall': 0.3333333333333333, 'f1-score': 0.3321678321678322, 'support': 60}}
Wrong BIO-Encoding 1/58 labels, 1.72%
Dev-Data: Prec: 0.351, Rec: 0.333, F1: 0.3419
{'C': {'precision': 0.2384937238493724, 'recall': 0.14805194805194805, 'f1-score': 0.18269230769230768, 'support': 385}, 'P': {'precision': 0.28893905191873587, 'recall': 0.32323232323232326, 'f1-score': 0.3051251489868892, 'support': 396}, 'micro avg': {'precision': 0.27126099706744866, 'recall': 0.23687580025608196, 'f1-score': 0.25290498974709497, 'support': 781}, 'macro avg': {'precision': 0.26371638788405416, 'recall': 0.23564213564213565, 'f1-score': 0.24390872833959842, 'support': 781}, 'weighted avg': {'precision': 0.26407163667327505, 'recall': 0.23687580025608196, 'f1-score': 0.24477093144730674, 'support': 781}}
Wrong BIO-Encoding 572/1232 labels, 46.43%
{'C': {'precision': 0.2384937238493724, 'recall': 0.14805194805194805, 'f1-score': 0.18269230769230768, 'support': 385}, 'P': {'precision': 0.28893905191873587, 'recall': 0.32323232323232326, 'f1-score': 0.3051251489868892, 'support': 396}, 'micro avg': {'precision': 0.27126099706744866, 'recall': 0.23687580025608196, 'f1-score': 0.25290498974709497, 'support': 781}, 'macro avg': {'precision': 0.26371638788405416, 'recall': 0.23564213564213565, 'f1-score': 0.24390872833959842, 'support': 781}, 'weighted avg': {'precision': 0.26407163667327505, 'recall': 0.23687580025608196, 'f1-score': 0.24477093144730674, 'support': 781}}
Wrong BIO-Encoding 22/682 labels, 3.23%
Test-Data: Prec: 0.279, Rec: 0.236, F1: 0.2554

Scores from epoch with best dev-scores:
  Dev-Score: 0.3419
  Test-Score 0.2554

4.37 sec for evaluation

--------- Epoch 15 -----------
318.38 sec for training (4943.50 total)
-- cmv_modes1 --
{'C': {'precision': 0.3333333333333333, 'recall': 0.2857142857142857, 'f1-score': 0.30769230769230765, 'support': 28}, 'P': {'precision': 0.3548387096774194, 'recall': 0.34375, 'f1-score': 0.3492063492063492, 'support': 32}, 'micro avg': {'precision': 0.34545454545454546, 'recall': 0.31666666666666665, 'f1-score': 0.33043478260869563, 'support': 60}, 'macro avg': {'precision': 0.34408602150537637, 'recall': 0.31473214285714285, 'f1-score': 0.3284493284493284, 'support': 60}, 'weighted avg': {'precision': 0.3448028673835125, 'recall': 0.31666666666666665, 'f1-score': 0.32983312983312985, 'support': 60}}
Wrong BIO-Encoding 86/138 labels, 62.32%
{'C': {'precision': 0.3333333333333333, 'recall': 0.2857142857142857, 'f1-score': 0.30769230769230765, 'support': 28}, 'P': {'precision': 0.3548387096774194, 'recall': 0.34375, 'f1-score': 0.3492063492063492, 'support': 32}, 'micro avg': {'precision': 0.34545454545454546, 'recall': 0.31666666666666665, 'f1-score': 0.33043478260869563, 'support': 60}, 'macro avg': {'precision': 0.34408602150537637, 'recall': 0.31473214285714285, 'f1-score': 0.3284493284493284, 'support': 60}, 'weighted avg': {'precision': 0.3448028673835125, 'recall': 0.31666666666666665, 'f1-score': 0.32983312983312985, 'support': 60}}
Wrong BIO-Encoding 3/55 labels, 5.45%
Dev-Data: Prec: 0.365, Rec: 0.317, F1: 0.3393
{'C': {'precision': 0.28076923076923077, 'recall': 0.18961038961038962, 'f1-score': 0.22635658914728685, 'support': 385}, 'P': {'precision': 0.27884615384615385, 'recall': 0.29292929292929293, 'f1-score': 0.28571428571428575, 'support': 396}, 'micro avg': {'precision': 0.27958579881656803, 'recall': 0.24199743918053776, 'f1-score': 0.25943719972546325, 'support': 781}, 'macro avg': {'precision': 0.2798076923076923, 'recall': 0.24126984126984127, 'f1-score': 0.2560354374307863, 'support': 781}, 'weighted avg': {'precision': 0.2797941495124594, 'recall': 0.24199743918053776, 'f1-score': 0.2564534493784412, 'support': 781}}
Wrong BIO-Encoding 606/1261 labels, 48.06%
{'C': {'precision': 0.28076923076923077, 'recall': 0.18961038961038962, 'f1-score': 0.22635658914728685, 'support': 385}, 'P': {'precision': 0.27884615384615385, 'recall': 0.29292929292929293, 'f1-score': 0.28571428571428575, 'support': 396}, 'micro avg': {'precision': 0.27958579881656803, 'recall': 0.24199743918053776, 'f1-score': 0.25943719972546325, 'support': 781}, 'macro avg': {'precision': 0.2798076923076923, 'recall': 0.24126984126984127, 'f1-score': 0.2560354374307863, 'support': 781}, 'weighted avg': {'precision': 0.2797941495124594, 'recall': 0.24199743918053776, 'f1-score': 0.2564534493784412, 'support': 781}}
Wrong BIO-Encoding 21/676 labels, 3.11%
Test-Data: Prec: 0.289, Rec: 0.242, F1: 0.2632

Scores from epoch with best dev-scores:
  Dev-Score: 0.3419
  Test-Score 0.2554

4.35 sec for evaluation

--------- Epoch 16 -----------
319.64 sec for training (5263.14 total)
-- cmv_modes1 --
{'C': {'precision': 0.2857142857142857, 'recall': 0.21428571428571427, 'f1-score': 0.24489795918367344, 'support': 28}, 'P': {'precision': 0.45161290322580644, 'recall': 0.4375, 'f1-score': 0.4444444444444444, 'support': 32}, 'micro avg': {'precision': 0.38461538461538464, 'recall': 0.3333333333333333, 'f1-score': 0.3571428571428571, 'support': 60}, 'macro avg': {'precision': 0.36866359447004604, 'recall': 0.32589285714285715, 'f1-score': 0.3446712018140589, 'support': 60}, 'weighted avg': {'precision': 0.3741935483870968, 'recall': 0.3333333333333333, 'f1-score': 0.35132275132275126, 'support': 60}}
Wrong BIO-Encoding 110/159 labels, 69.18%
{'C': {'precision': 0.2857142857142857, 'recall': 0.21428571428571427, 'f1-score': 0.24489795918367344, 'support': 28}, 'P': {'precision': 0.45161290322580644, 'recall': 0.4375, 'f1-score': 0.4444444444444444, 'support': 32}, 'micro avg': {'precision': 0.38461538461538464, 'recall': 0.3333333333333333, 'f1-score': 0.3571428571428571, 'support': 60}, 'macro avg': {'precision': 0.36866359447004604, 'recall': 0.32589285714285715, 'f1-score': 0.3446712018140589, 'support': 60}, 'weighted avg': {'precision': 0.3741935483870968, 'recall': 0.3333333333333333, 'f1-score': 0.35132275132275126, 'support': 60}}
Wrong BIO-Encoding 3/52 labels, 5.77%
Dev-Data: Prec: 0.408, Rec: 0.333, F1: 0.3670
{'C': {'precision': 0.26199261992619927, 'recall': 0.18441558441558442, 'f1-score': 0.21646341463414634, 'support': 385}, 'P': {'precision': 0.2660332541567696, 'recall': 0.2828282828282828, 'f1-score': 0.2741738066095471, 'support': 396}, 'micro avg': {'precision': 0.26445086705202314, 'recall': 0.23431498079385404, 'f1-score': 0.24847250509164973, 'support': 781}, 'macro avg': {'precision': 0.26401293704148443, 'recall': 0.23362193362193362, 'f1-score': 0.24531861062184673, 'support': 781}, 'weighted avg': {'precision': 0.26404139221212225, 'recall': 0.23431498079385404, 'f1-score': 0.2457250218329411, 'support': 781}}
Wrong BIO-Encoding 563/1232 labels, 45.70%
{'C': {'precision': 0.26199261992619927, 'recall': 0.18441558441558442, 'f1-score': 0.21646341463414634, 'support': 385}, 'P': {'precision': 0.2660332541567696, 'recall': 0.2828282828282828, 'f1-score': 0.2741738066095471, 'support': 396}, 'micro avg': {'precision': 0.26445086705202314, 'recall': 0.23431498079385404, 'f1-score': 0.24847250509164973, 'support': 781}, 'macro avg': {'precision': 0.26401293704148443, 'recall': 0.23362193362193362, 'f1-score': 0.24531861062184673, 'support': 781}, 'weighted avg': {'precision': 0.26404139221212225, 'recall': 0.23431498079385404, 'f1-score': 0.2457250218329411, 'support': 781}}
Wrong BIO-Encoding 23/692 labels, 3.32%
Test-Data: Prec: 0.274, Rec: 0.234, F1: 0.2524

Scores from epoch with best dev-scores:
  Dev-Score: 0.3670
  Test-Score 0.2524

4.25 sec for evaluation

--------- Epoch 17 -----------
318.84 sec for training (5581.98 total)
-- cmv_modes1 --
{'C': {'precision': 0.1875, 'recall': 0.21428571428571427, 'f1-score': 0.19999999999999998, 'support': 28}, 'P': {'precision': 0.5833333333333334, 'recall': 0.21875, 'f1-score': 0.31818181818181823, 'support': 32}, 'micro avg': {'precision': 0.29545454545454547, 'recall': 0.21666666666666667, 'f1-score': 0.25, 'support': 60}, 'macro avg': {'precision': 0.3854166666666667, 'recall': 0.21651785714285715, 'f1-score': 0.2590909090909091, 'support': 60}, 'weighted avg': {'precision': 0.39861111111111114, 'recall': 0.21666666666666667, 'f1-score': 0.26303030303030306, 'support': 60}}
Wrong BIO-Encoding 8/51 labels, 15.69%
{'C': {'precision': 0.1875, 'recall': 0.21428571428571427, 'f1-score': 0.19999999999999998, 'support': 28}, 'P': {'precision': 0.5833333333333334, 'recall': 0.21875, 'f1-score': 0.31818181818181823, 'support': 32}, 'micro avg': {'precision': 0.29545454545454547, 'recall': 0.21666666666666667, 'f1-score': 0.25, 'support': 60}, 'macro avg': {'precision': 0.3854166666666667, 'recall': 0.21651785714285715, 'f1-score': 0.2590909090909091, 'support': 60}, 'weighted avg': {'precision': 0.39861111111111114, 'recall': 0.21666666666666667, 'f1-score': 0.26303030303030306, 'support': 60}}
Wrong BIO-Encoding 1/44 labels, 2.27%
Dev-Data: Prec: 0.302, Rec: 0.217, F1: 0.2524
{'C': {'precision': 0.2194513715710723, 'recall': 0.22857142857142856, 'f1-score': 0.22391857506361323, 'support': 385}, 'P': {'precision': 0.29642857142857143, 'recall': 0.20959595959595959, 'f1-score': 0.24556213017751477, 'support': 396}, 'micro avg': {'precision': 0.2511013215859031, 'recall': 0.21895006402048656, 'f1-score': 0.23392612859097128, 'support': 781}, 'macro avg': {'precision': 0.25793997149982184, 'recall': 0.21908369408369407, 'f1-score': 0.234740352620564, 'support': 781}, 'weighted avg': {'precision': 0.2584820644565648, 'recall': 0.21895006402048656, 'f1-score': 0.2348927720227746, 'support': 781}}
Wrong BIO-Encoding 597/1250 labels, 47.76%
{'C': {'precision': 0.2194513715710723, 'recall': 0.22857142857142856, 'f1-score': 0.22391857506361323, 'support': 385}, 'P': {'precision': 0.29642857142857143, 'recall': 0.20959595959595959, 'f1-score': 0.24556213017751477, 'support': 396}, 'micro avg': {'precision': 0.2511013215859031, 'recall': 0.21895006402048656, 'f1-score': 0.23392612859097128, 'support': 781}, 'macro avg': {'precision': 0.25793997149982184, 'recall': 0.21908369408369407, 'f1-score': 0.234740352620564, 'support': 781}, 'weighted avg': {'precision': 0.2584820644565648, 'recall': 0.21895006402048656, 'f1-score': 0.2348927720227746, 'support': 781}}
Wrong BIO-Encoding 28/681 labels, 4.11%
Test-Data: Prec: 0.262, Rec: 0.219, F1: 0.2385

Scores from epoch with best dev-scores:
  Dev-Score: 0.3670
  Test-Score 0.2524

4.21 sec for evaluation

--------- Epoch 18 -----------
318.91 sec for training (5900.89 total)
-- cmv_modes1 --
{'C': {'precision': 0.1935483870967742, 'recall': 0.21428571428571427, 'f1-score': 0.20338983050847456, 'support': 28}, 'P': {'precision': 0.4, 'recall': 0.1875, 'f1-score': 0.25531914893617025, 'support': 32}, 'micro avg': {'precision': 0.2608695652173913, 'recall': 0.2, 'f1-score': 0.22641509433962265, 'support': 60}, 'macro avg': {'precision': 0.2967741935483871, 'recall': 0.20089285714285715, 'f1-score': 0.22935448972232242, 'support': 60}, 'weighted avg': {'precision': 0.3036559139784946, 'recall': 0.2, 'f1-score': 0.2310854670032456, 'support': 60}}
{'C': {'precision': 0.1935483870967742, 'recall': 0.21428571428571427, 'f1-score': 0.20338983050847456, 'support': 28}, 'P': {'precision': 0.4, 'recall': 0.1875, 'f1-score': 0.25531914893617025, 'support': 32}, 'micro avg': {'precision': 0.2608695652173913, 'recall': 0.2, 'f1-score': 0.22641509433962265, 'support': 60}, 'macro avg': {'precision': 0.2967741935483871, 'recall': 0.20089285714285715, 'f1-score': 0.22935448972232242, 'support': 60}, 'weighted avg': {'precision': 0.3036559139784946, 'recall': 0.2, 'f1-score': 0.2310854670032456, 'support': 60}}
Dev-Data: Prec: 0.261, Rec: 0.200, F1: 0.2264
{'C': {'precision': 0.22742474916387959, 'recall': 0.17662337662337663, 'f1-score': 0.19883040935672514, 'support': 385}, 'P': {'precision': 0.2872340425531915, 'recall': 0.20454545454545456, 'f1-score': 0.23893805309734512, 'support': 396}, 'micro avg': {'precision': 0.25645438898450945, 'recall': 0.19078104993597952, 'f1-score': 0.2187958883994126, 'support': 781}, 'macro avg': {'precision': 0.25732939585853554, 'recall': 0.19058441558441558, 'f1-score': 0.21888423122703513, 'support': 781}, 'weighted avg': {'precision': 0.25775058806550255, 'recall': 0.19078104993597952, 'f1-score': 0.2191666794223916, 'support': 781}}
Wrong BIO-Encoding 592/1150 labels, 51.48%
{'C': {'precision': 0.22742474916387959, 'recall': 0.17662337662337663, 'f1-score': 0.19883040935672514, 'support': 385}, 'P': {'precision': 0.2872340425531915, 'recall': 0.20454545454545456, 'f1-score': 0.23893805309734512, 'support': 396}, 'micro avg': {'precision': 0.25645438898450945, 'recall': 0.19078104993597952, 'f1-score': 0.2187958883994126, 'support': 781}, 'macro avg': {'precision': 0.25732939585853554, 'recall': 0.19058441558441558, 'f1-score': 0.21888423122703513, 'support': 781}, 'weighted avg': {'precision': 0.25775058806550255, 'recall': 0.19078104993597952, 'f1-score': 0.2191666794223916, 'support': 781}}
Wrong BIO-Encoding 23/581 labels, 3.96%
Test-Data: Prec: 0.267, Rec: 0.191, F1: 0.2226

Scores from epoch with best dev-scores:
  Dev-Score: 0.3670
  Test-Score 0.2524

4.21 sec for evaluation

--------- Epoch 19 -----------
319.09 sec for training (6219.99 total)
-- cmv_modes1 --
{'C': {'precision': 0.3888888888888889, 'recall': 0.25, 'f1-score': 0.30434782608695654, 'support': 28}, 'P': {'precision': 0.5151515151515151, 'recall': 0.53125, 'f1-score': 0.5230769230769231, 'support': 32}, 'micro avg': {'precision': 0.47058823529411764, 'recall': 0.4, 'f1-score': 0.4324324324324324, 'support': 60}, 'macro avg': {'precision': 0.452020202020202, 'recall': 0.390625, 'f1-score': 0.4137123745819398, 'support': 60}, 'weighted avg': {'precision': 0.4562289562289562, 'recall': 0.4, 'f1-score': 0.4210033444816054, 'support': 60}}
{'C': {'precision': 0.3888888888888889, 'recall': 0.25, 'f1-score': 0.30434782608695654, 'support': 28}, 'P': {'precision': 0.5151515151515151, 'recall': 0.53125, 'f1-score': 0.5230769230769231, 'support': 32}, 'micro avg': {'precision': 0.47058823529411764, 'recall': 0.4, 'f1-score': 0.4324324324324324, 'support': 60}, 'macro avg': {'precision': 0.452020202020202, 'recall': 0.390625, 'f1-score': 0.4137123745819398, 'support': 60}, 'weighted avg': {'precision': 0.4562289562289562, 'recall': 0.4, 'f1-score': 0.4210033444816054, 'support': 60}}
Dev-Data: Prec: 0.471, Rec: 0.400, F1: 0.4324
{'C': {'precision': 0.31100478468899523, 'recall': 0.16883116883116883, 'f1-score': 0.21885521885521886, 'support': 385}, 'P': {'precision': 0.3054892601431981, 'recall': 0.32323232323232326, 'f1-score': 0.3141104294478528, 'support': 396}, 'micro avg': {'precision': 0.3073248407643312, 'recall': 0.2471190781049936, 'f1-score': 0.2739531582682754, 'support': 781}, 'macro avg': {'precision': 0.3082470224160967, 'recall': 0.24603174603174605, 'f1-score': 0.2664828241515358, 'support': 781}, 'weighted avg': {'precision': 0.3082081806939432, 'recall': 0.2471190781049936, 'f1-score': 0.26715363549373744, 'support': 781}}
Wrong BIO-Encoding 82/704 labels, 11.65%
{'C': {'precision': 0.31100478468899523, 'recall': 0.16883116883116883, 'f1-score': 0.21885521885521886, 'support': 385}, 'P': {'precision': 0.3054892601431981, 'recall': 0.32323232323232326, 'f1-score': 0.3141104294478528, 'support': 396}, 'micro avg': {'precision': 0.3073248407643312, 'recall': 0.2471190781049936, 'f1-score': 0.2739531582682754, 'support': 781}, 'macro avg': {'precision': 0.3082470224160967, 'recall': 0.24603174603174605, 'f1-score': 0.2664828241515358, 'support': 781}, 'weighted avg': {'precision': 0.3082081806939432, 'recall': 0.2471190781049936, 'f1-score': 0.26715363549373744, 'support': 781}}
Wrong BIO-Encoding 6/628 labels, 0.96%
Test-Data: Prec: 0.310, Rec: 0.247, F1: 0.2751

Scores from epoch with best dev-scores:
  Dev-Score: 0.4324
  Test-Score 0.2751

4.38 sec for evaluation

--------- Epoch 20 -----------
318.81 sec for training (6538.80 total)
-- cmv_modes1 --
{'C': {'precision': 0.36363636363636365, 'recall': 0.2857142857142857, 'f1-score': 0.32, 'support': 28}, 'P': {'precision': 0.4666666666666667, 'recall': 0.4375, 'f1-score': 0.45161290322580644, 'support': 32}, 'micro avg': {'precision': 0.4230769230769231, 'recall': 0.36666666666666664, 'f1-score': 0.3928571428571428, 'support': 60}, 'macro avg': {'precision': 0.41515151515151516, 'recall': 0.36160714285714285, 'f1-score': 0.3858064516129032, 'support': 60}, 'weighted avg': {'precision': 0.4185858585858586, 'recall': 0.36666666666666664, 'f1-score': 0.3901935483870968, 'support': 60}}
Wrong BIO-Encoding 27/78 labels, 34.62%
{'C': {'precision': 0.36363636363636365, 'recall': 0.2857142857142857, 'f1-score': 0.32, 'support': 28}, 'P': {'precision': 0.4666666666666667, 'recall': 0.4375, 'f1-score': 0.45161290322580644, 'support': 32}, 'micro avg': {'precision': 0.4230769230769231, 'recall': 0.36666666666666664, 'f1-score': 0.3928571428571428, 'support': 60}, 'macro avg': {'precision': 0.41515151515151516, 'recall': 0.36160714285714285, 'f1-score': 0.3858064516129032, 'support': 60}, 'weighted avg': {'precision': 0.4185858585858586, 'recall': 0.36666666666666664, 'f1-score': 0.3901935483870968, 'support': 60}}
Wrong BIO-Encoding 1/52 labels, 1.92%
Dev-Data: Prec: 0.431, Rec: 0.367, F1: 0.3964
{'C': {'precision': 0.25096525096525096, 'recall': 0.16883116883116883, 'f1-score': 0.20186335403726707, 'support': 385}, 'P': {'precision': 0.271505376344086, 'recall': 0.255050505050505, 'f1-score': 0.2630208333333333, 'support': 396}, 'micro avg': {'precision': 0.2630744849445325, 'recall': 0.21254801536491677, 'f1-score': 0.2351274787535411, 'support': 781}, 'macro avg': {'precision': 0.26123531365466846, 'recall': 0.21194083694083693, 'f1-score': 0.2324420936853002, 'support': 781}, 'weighted avg': {'precision': 0.26137996242494194, 'recall': 0.21254801536491677, 'f1-score': 0.23287278015921614, 'support': 781}}
Wrong BIO-Encoding 170/792 labels, 21.46%
{'C': {'precision': 0.25096525096525096, 'recall': 0.16883116883116883, 'f1-score': 0.20186335403726707, 'support': 385}, 'P': {'precision': 0.271505376344086, 'recall': 0.255050505050505, 'f1-score': 0.2630208333333333, 'support': 396}, 'micro avg': {'precision': 0.2630744849445325, 'recall': 0.21254801536491677, 'f1-score': 0.2351274787535411, 'support': 781}, 'macro avg': {'precision': 0.26123531365466846, 'recall': 0.21194083694083693, 'f1-score': 0.2324420936853002, 'support': 781}, 'weighted avg': {'precision': 0.26137996242494194, 'recall': 0.21254801536491677, 'f1-score': 0.23287278015921614, 'support': 781}}
Wrong BIO-Encoding 9/631 labels, 1.43%
Test-Data: Prec: 0.267, Rec: 0.213, F1: 0.2366

Scores from epoch with best dev-scores:
  Dev-Score: 0.4324
  Test-Score 0.2751

4.56 sec for evaluation

--------- Epoch 21 -----------
319.02 sec for training (6857.82 total)
-- cmv_modes1 --
{'C': {'precision': 0.24242424242424243, 'recall': 0.2857142857142857, 'f1-score': 0.26229508196721313, 'support': 28}, 'P': {'precision': 0.6875, 'recall': 0.34375, 'f1-score': 0.4583333333333333, 'support': 32}, 'micro avg': {'precision': 0.3877551020408163, 'recall': 0.31666666666666665, 'f1-score': 0.34862385321100914, 'support': 60}, 'macro avg': {'precision': 0.4649621212121212, 'recall': 0.31473214285714285, 'f1-score': 0.3603142076502732, 'support': 60}, 'weighted avg': {'precision': 0.47979797979797983, 'recall': 0.31666666666666665, 'f1-score': 0.3668488160291439, 'support': 60}}
{'C': {'precision': 0.24242424242424243, 'recall': 0.2857142857142857, 'f1-score': 0.26229508196721313, 'support': 28}, 'P': {'precision': 0.6875, 'recall': 0.34375, 'f1-score': 0.4583333333333333, 'support': 32}, 'micro avg': {'precision': 0.3877551020408163, 'recall': 0.31666666666666665, 'f1-score': 0.34862385321100914, 'support': 60}, 'macro avg': {'precision': 0.4649621212121212, 'recall': 0.31473214285714285, 'f1-score': 0.3603142076502732, 'support': 60}, 'weighted avg': {'precision': 0.47979797979797983, 'recall': 0.31666666666666665, 'f1-score': 0.3668488160291439, 'support': 60}}
Dev-Data: Prec: 0.388, Rec: 0.317, F1: 0.3486
{'C': {'precision': 0.24025974025974026, 'recall': 0.19220779220779222, 'f1-score': 0.2135642135642136, 'support': 385}, 'P': {'precision': 0.2852664576802508, 'recall': 0.2297979797979798, 'f1-score': 0.2545454545454545, 'support': 396}, 'micro avg': {'precision': 0.2631578947368421, 'recall': 0.2112676056338028, 'f1-score': 0.23437499999999997, 'support': 781}, 'macro avg': {'precision': 0.2627630989699955, 'recall': 0.21100288600288603, 'f1-score': 0.23405483405483407, 'support': 781}, 'weighted avg': {'precision': 0.26308004768422444, 'recall': 0.2112676056338028, 'f1-score': 0.23434343434343433, 'support': 781}}
Wrong BIO-Encoding 436/1047 labels, 41.64%
{'C': {'precision': 0.24025974025974026, 'recall': 0.19220779220779222, 'f1-score': 0.2135642135642136, 'support': 385}, 'P': {'precision': 0.2852664576802508, 'recall': 0.2297979797979798, 'f1-score': 0.2545454545454545, 'support': 396}, 'micro avg': {'precision': 0.2631578947368421, 'recall': 0.2112676056338028, 'f1-score': 0.23437499999999997, 'support': 781}, 'macro avg': {'precision': 0.2627630989699955, 'recall': 0.21100288600288603, 'f1-score': 0.23405483405483407, 'support': 781}, 'weighted avg': {'precision': 0.26308004768422444, 'recall': 0.2112676056338028, 'f1-score': 0.23434343434343433, 'support': 781}}
Wrong BIO-Encoding 16/627 labels, 2.55%
Test-Data: Prec: 0.270, Rec: 0.211, F1: 0.2371

Scores from epoch with best dev-scores:
  Dev-Score: 0.4324
  Test-Score 0.2751

4.25 sec for evaluation

--------- Epoch 22 -----------
318.59 sec for training (7176.41 total)
-- cmv_modes1 --
{'C': {'precision': 0.2727272727272727, 'recall': 0.21428571428571427, 'f1-score': 0.23999999999999996, 'support': 28}, 'P': {'precision': 0.48484848484848486, 'recall': 0.5, 'f1-score': 0.49230769230769234, 'support': 32}, 'micro avg': {'precision': 0.4, 'recall': 0.36666666666666664, 'f1-score': 0.3826086956521739, 'support': 60}, 'macro avg': {'precision': 0.3787878787878788, 'recall': 0.35714285714285715, 'f1-score': 0.36615384615384616, 'support': 60}, 'weighted avg': {'precision': 0.38585858585858585, 'recall': 0.36666666666666664, 'f1-score': 0.37456410256410255, 'support': 60}}
Wrong BIO-Encoding 22/76 labels, 28.95%
{'C': {'precision': 0.2727272727272727, 'recall': 0.21428571428571427, 'f1-score': 0.23999999999999996, 'support': 28}, 'P': {'precision': 0.48484848484848486, 'recall': 0.5, 'f1-score': 0.49230769230769234, 'support': 32}, 'micro avg': {'precision': 0.4, 'recall': 0.36666666666666664, 'f1-score': 0.3826086956521739, 'support': 60}, 'macro avg': {'precision': 0.3787878787878788, 'recall': 0.35714285714285715, 'f1-score': 0.36615384615384616, 'support': 60}, 'weighted avg': {'precision': 0.38585858585858585, 'recall': 0.36666666666666664, 'f1-score': 0.37456410256410255, 'support': 60}}
Wrong BIO-Encoding 1/55 labels, 1.82%
Dev-Data: Prec: 0.407, Rec: 0.367, F1: 0.3860
{'C': {'precision': 0.2857142857142857, 'recall': 0.18181818181818182, 'f1-score': 0.2222222222222222, 'support': 385}, 'P': {'precision': 0.24947145877378435, 'recall': 0.29797979797979796, 'f1-score': 0.2715765247410817, 'support': 396}, 'micro avg': {'precision': 0.2618384401114206, 'recall': 0.2407170294494238, 'f1-score': 0.25083388925950634, 'support': 781}, 'macro avg': {'precision': 0.26759287224403505, 'recall': 0.2398989898989899, 'f1-score': 0.24689937348165195, 'support': 781}, 'weighted avg': {'precision': 0.2673376410683977, 'recall': 0.2407170294494238, 'f1-score': 0.24724693899234815, 'support': 781}}
Wrong BIO-Encoding 127/839 labels, 15.14%
{'C': {'precision': 0.2857142857142857, 'recall': 0.18181818181818182, 'f1-score': 0.2222222222222222, 'support': 385}, 'P': {'precision': 0.24947145877378435, 'recall': 0.29797979797979796, 'f1-score': 0.2715765247410817, 'support': 396}, 'micro avg': {'precision': 0.2618384401114206, 'recall': 0.2407170294494238, 'f1-score': 0.25083388925950634, 'support': 781}, 'macro avg': {'precision': 0.26759287224403505, 'recall': 0.2398989898989899, 'f1-score': 0.24689937348165195, 'support': 781}, 'weighted avg': {'precision': 0.2673376410683977, 'recall': 0.2407170294494238, 'f1-score': 0.24724693899234815, 'support': 781}}
Wrong BIO-Encoding 6/718 labels, 0.84%
Test-Data: Prec: 0.264, Rec: 0.241, F1: 0.2518

Scores from epoch with best dev-scores:
  Dev-Score: 0.4324
  Test-Score 0.2751

4.34 sec for evaluation

--------- Epoch 23 -----------
319.76 sec for training (7496.17 total)
-- cmv_modes1 --
{'C': {'precision': 0.46153846153846156, 'recall': 0.42857142857142855, 'f1-score': 0.4444444444444445, 'support': 28}, 'P': {'precision': 0.6521739130434783, 'recall': 0.46875, 'f1-score': 0.5454545454545454, 'support': 32}, 'micro avg': {'precision': 0.5510204081632653, 'recall': 0.45, 'f1-score': 0.4954128440366973, 'support': 60}, 'macro avg': {'precision': 0.5568561872909699, 'recall': 0.4486607142857143, 'f1-score': 0.4949494949494949, 'support': 60}, 'weighted avg': {'precision': 0.5632107023411372, 'recall': 0.45, 'f1-score': 0.49831649831649827, 'support': 60}}
Wrong BIO-Encoding 60/108 labels, 55.56%
{'C': {'precision': 0.46153846153846156, 'recall': 0.42857142857142855, 'f1-score': 0.4444444444444445, 'support': 28}, 'P': {'precision': 0.6521739130434783, 'recall': 0.46875, 'f1-score': 0.5454545454545454, 'support': 32}, 'micro avg': {'precision': 0.5510204081632653, 'recall': 0.45, 'f1-score': 0.4954128440366973, 'support': 60}, 'macro avg': {'precision': 0.5568561872909699, 'recall': 0.4486607142857143, 'f1-score': 0.4949494949494949, 'support': 60}, 'weighted avg': {'precision': 0.5632107023411372, 'recall': 0.45, 'f1-score': 0.49831649831649827, 'support': 60}}
Wrong BIO-Encoding 1/49 labels, 2.04%
Dev-Data: Prec: 0.562, Rec: 0.450, F1: 0.5000
{'C': {'precision': 0.2268041237113402, 'recall': 0.22857142857142856, 'f1-score': 0.22768434670116428, 'support': 385}, 'P': {'precision': 0.2593856655290102, 'recall': 0.1919191919191919, 'f1-score': 0.22060957910014511, 'support': 396}, 'micro avg': {'precision': 0.24082232011747431, 'recall': 0.20998719590268886, 'f1-score': 0.2243502051983584, 'support': 781}, 'macro avg': {'precision': 0.2430948946201752, 'recall': 0.21024531024531024, 'f1-score': 0.2241469629006547, 'support': 781}, 'weighted avg': {'precision': 0.24332434209776443, 'recall': 0.20998719590268886, 'f1-score': 0.22409714059360525, 'support': 781}}
Wrong BIO-Encoding 361/1027 labels, 35.15%
{'C': {'precision': 0.2268041237113402, 'recall': 0.22857142857142856, 'f1-score': 0.22768434670116428, 'support': 385}, 'P': {'precision': 0.2593856655290102, 'recall': 0.1919191919191919, 'f1-score': 0.22060957910014511, 'support': 396}, 'micro avg': {'precision': 0.24082232011747431, 'recall': 0.20998719590268886, 'f1-score': 0.2243502051983584, 'support': 781}, 'macro avg': {'precision': 0.2430948946201752, 'recall': 0.21024531024531024, 'f1-score': 0.2241469629006547, 'support': 781}, 'weighted avg': {'precision': 0.24332434209776443, 'recall': 0.20998719590268886, 'f1-score': 0.22409714059360525, 'support': 781}}
Wrong BIO-Encoding 15/681 labels, 2.20%
Test-Data: Prec: 0.246, Rec: 0.210, F1: 0.2267

Scores from epoch with best dev-scores:
  Dev-Score: 0.5000
  Test-Score 0.2267

4.26 sec for evaluation

--------- Epoch 24 -----------
319.69 sec for training (7815.85 total)
-- cmv_modes1 --
{'C': {'precision': 0.40625, 'recall': 0.4642857142857143, 'f1-score': 0.4333333333333333, 'support': 28}, 'P': {'precision': 0.56, 'recall': 0.4375, 'f1-score': 0.4912280701754386, 'support': 32}, 'micro avg': {'precision': 0.47368421052631576, 'recall': 0.45, 'f1-score': 0.46153846153846156, 'support': 60}, 'macro avg': {'precision': 0.483125, 'recall': 0.45089285714285715, 'f1-score': 0.46228070175438596, 'support': 60}, 'weighted avg': {'precision': 0.48825, 'recall': 0.45, 'f1-score': 0.46421052631578946, 'support': 60}}
Wrong BIO-Encoding 21/77 labels, 27.27%
{'C': {'precision': 0.40625, 'recall': 0.4642857142857143, 'f1-score': 0.4333333333333333, 'support': 28}, 'P': {'precision': 0.56, 'recall': 0.4375, 'f1-score': 0.4912280701754386, 'support': 32}, 'micro avg': {'precision': 0.47368421052631576, 'recall': 0.45, 'f1-score': 0.46153846153846156, 'support': 60}, 'macro avg': {'precision': 0.483125, 'recall': 0.45089285714285715, 'f1-score': 0.46228070175438596, 'support': 60}, 'weighted avg': {'precision': 0.48825, 'recall': 0.45, 'f1-score': 0.46421052631578946, 'support': 60}}
Wrong BIO-Encoding 1/57 labels, 1.75%
Dev-Data: Prec: 0.482, Rec: 0.450, F1: 0.4655
{'C': {'precision': 0.2638522427440633, 'recall': 0.2597402597402597, 'f1-score': 0.26178010471204183, 'support': 385}, 'P': {'precision': 0.27624309392265195, 'recall': 0.25252525252525254, 'f1-score': 0.2638522427440633, 'support': 396}, 'micro avg': {'precision': 0.2699055330634278, 'recall': 0.2560819462227913, 'f1-score': 0.26281208935611033, 'support': 781}, 'macro avg': {'precision': 0.27004766833335764, 'recall': 0.2561327561327561, 'f1-score': 0.26281617372805255, 'support': 781}, 'weighted avg': {'precision': 0.27013492784869986, 'recall': 0.2560819462227913, 'f1-score': 0.2628307662494048, 'support': 781}}
Wrong BIO-Encoding 124/857 labels, 14.47%
{'C': {'precision': 0.2638522427440633, 'recall': 0.2597402597402597, 'f1-score': 0.26178010471204183, 'support': 385}, 'P': {'precision': 0.27624309392265195, 'recall': 0.25252525252525254, 'f1-score': 0.2638522427440633, 'support': 396}, 'micro avg': {'precision': 0.2699055330634278, 'recall': 0.2560819462227913, 'f1-score': 0.26281208935611033, 'support': 781}, 'macro avg': {'precision': 0.27004766833335764, 'recall': 0.2561327561327561, 'f1-score': 0.26281617372805255, 'support': 781}, 'weighted avg': {'precision': 0.27013492784869986, 'recall': 0.2560819462227913, 'f1-score': 0.2628307662494048, 'support': 781}}
Wrong BIO-Encoding 8/741 labels, 1.08%
Test-Data: Prec: 0.273, Rec: 0.256, F1: 0.2642

Scores from epoch with best dev-scores:
  Dev-Score: 0.5000
  Test-Score 0.2267

4.33 sec for evaluation

--------- Epoch 25 -----------
328.63 sec for training (8144.49 total)
-- cmv_modes1 --
{'C': {'precision': 0.27586206896551724, 'recall': 0.2857142857142857, 'f1-score': 0.28070175438596495, 'support': 28}, 'P': {'precision': 0.7272727272727273, 'recall': 0.5, 'f1-score': 0.5925925925925926, 'support': 32}, 'micro avg': {'precision': 0.47058823529411764, 'recall': 0.4, 'f1-score': 0.4324324324324324, 'support': 60}, 'macro avg': {'precision': 0.5015673981191222, 'recall': 0.39285714285714285, 'f1-score': 0.43664717348927873, 'support': 60}, 'weighted avg': {'precision': 0.516614420062696, 'recall': 0.4, 'f1-score': 0.44704353476283304, 'support': 60}}
{'C': {'precision': 0.27586206896551724, 'recall': 0.2857142857142857, 'f1-score': 0.28070175438596495, 'support': 28}, 'P': {'precision': 0.7272727272727273, 'recall': 0.5, 'f1-score': 0.5925925925925926, 'support': 32}, 'micro avg': {'precision': 0.47058823529411764, 'recall': 0.4, 'f1-score': 0.4324324324324324, 'support': 60}, 'macro avg': {'precision': 0.5015673981191222, 'recall': 0.39285714285714285, 'f1-score': 0.43664717348927873, 'support': 60}, 'weighted avg': {'precision': 0.516614420062696, 'recall': 0.4, 'f1-score': 0.44704353476283304, 'support': 60}}
Dev-Data: Prec: 0.471, Rec: 0.400, F1: 0.4324
{'C': {'precision': 0.2680722891566265, 'recall': 0.23116883116883116, 'f1-score': 0.2482566248256625, 'support': 385}, 'P': {'precision': 0.2454780361757106, 'recall': 0.2398989898989899, 'f1-score': 0.24265644955300128, 'support': 396}, 'micro avg': {'precision': 0.25591098748261476, 'recall': 0.235595390524968, 'f1-score': 0.24533333333333332, 'support': 781}, 'macro avg': {'precision': 0.25677516266616857, 'recall': 0.23553391053391054, 'f1-score': 0.24545653718933189, 'support': 781}, 'weighted avg': {'precision': 0.25661604820855644, 'recall': 0.235595390524968, 'f1-score': 0.24541709933529907, 'support': 781}}
Wrong BIO-Encoding 91/805 labels, 11.30%
{'C': {'precision': 0.2680722891566265, 'recall': 0.23116883116883116, 'f1-score': 0.2482566248256625, 'support': 385}, 'P': {'precision': 0.2454780361757106, 'recall': 0.2398989898989899, 'f1-score': 0.24265644955300128, 'support': 396}, 'micro avg': {'precision': 0.25591098748261476, 'recall': 0.235595390524968, 'f1-score': 0.24533333333333332, 'support': 781}, 'macro avg': {'precision': 0.25677516266616857, 'recall': 0.23553391053391054, 'f1-score': 0.24545653718933189, 'support': 781}, 'weighted avg': {'precision': 0.25661604820855644, 'recall': 0.235595390524968, 'f1-score': 0.24541709933529907, 'support': 781}}
Wrong BIO-Encoding 5/719 labels, 0.70%
Test-Data: Prec: 0.258, Rec: 0.236, F1: 0.2462

Scores from epoch with best dev-scores:
  Dev-Score: 0.5000
  Test-Score 0.2267

4.43 sec for evaluation

--------- Epoch 26 -----------
326.39 sec for training (8470.88 total)
-- cmv_modes1 --
{'C': {'precision': 0.4375, 'recall': 0.5, 'f1-score': 0.4666666666666667, 'support': 28}, 'P': {'precision': 0.6818181818181818, 'recall': 0.46875, 'f1-score': 0.5555555555555556, 'support': 32}, 'micro avg': {'precision': 0.5370370370370371, 'recall': 0.48333333333333334, 'f1-score': 0.5087719298245614, 'support': 60}, 'macro avg': {'precision': 0.5596590909090908, 'recall': 0.484375, 'f1-score': 0.5111111111111111, 'support': 60}, 'weighted avg': {'precision': 0.5678030303030303, 'recall': 0.48333333333333334, 'f1-score': 0.5140740740740741, 'support': 60}}
Wrong BIO-Encoding 96/147 labels, 65.31%
{'C': {'precision': 0.4375, 'recall': 0.5, 'f1-score': 0.4666666666666667, 'support': 28}, 'P': {'precision': 0.6818181818181818, 'recall': 0.46875, 'f1-score': 0.5555555555555556, 'support': 32}, 'micro avg': {'precision': 0.5370370370370371, 'recall': 0.48333333333333334, 'f1-score': 0.5087719298245614, 'support': 60}, 'macro avg': {'precision': 0.5596590909090908, 'recall': 0.484375, 'f1-score': 0.5111111111111111, 'support': 60}, 'weighted avg': {'precision': 0.5678030303030303, 'recall': 0.48333333333333334, 'f1-score': 0.5140740740740741, 'support': 60}}
Wrong BIO-Encoding 3/54 labels, 5.56%
Dev-Data: Prec: 0.537, Rec: 0.483, F1: 0.5088
{'C': {'precision': 0.23607427055702918, 'recall': 0.23116883116883116, 'f1-score': 0.23359580052493437, 'support': 385}, 'P': {'precision': 0.25914634146341464, 'recall': 0.21464646464646464, 'f1-score': 0.23480662983425415, 'support': 396}, 'micro avg': {'precision': 0.24680851063829787, 'recall': 0.22279129321382843, 'f1-score': 0.23418573351278602, 'support': 781}, 'macro avg': {'precision': 0.2476103060102219, 'recall': 0.2229076479076479, 'f1-score': 0.23420121517959425, 'support': 781}, 'weighted avg': {'precision': 0.2477727853828021, 'recall': 0.22279129321382843, 'f1-score': 0.23420974214656126, 'support': 781}}
Wrong BIO-Encoding 210/901 labels, 23.31%
{'C': {'precision': 0.23607427055702918, 'recall': 0.23116883116883116, 'f1-score': 0.23359580052493437, 'support': 385}, 'P': {'precision': 0.25914634146341464, 'recall': 0.21464646464646464, 'f1-score': 0.23480662983425415, 'support': 396}, 'micro avg': {'precision': 0.24680851063829787, 'recall': 0.22279129321382843, 'f1-score': 0.23418573351278602, 'support': 781}, 'macro avg': {'precision': 0.2476103060102219, 'recall': 0.2229076479076479, 'f1-score': 0.23420121517959425, 'support': 781}, 'weighted avg': {'precision': 0.2477727853828021, 'recall': 0.22279129321382843, 'f1-score': 0.23420974214656126, 'support': 781}}
Wrong BIO-Encoding 14/705 labels, 1.99%
Test-Data: Prec: 0.252, Rec: 0.223, F1: 0.2364

Scores from epoch with best dev-scores:
  Dev-Score: 0.5088
  Test-Score 0.2364

4.43 sec for evaluation

--------- Epoch 27 -----------
325.18 sec for training (8796.05 total)
-- cmv_modes1 --
{'C': {'precision': 0.2962962962962963, 'recall': 0.2857142857142857, 'f1-score': 0.2909090909090909, 'support': 28}, 'P': {'precision': 0.5161290322580645, 'recall': 0.5, 'f1-score': 0.5079365079365079, 'support': 32}, 'micro avg': {'precision': 0.41379310344827586, 'recall': 0.4, 'f1-score': 0.4067796610169491, 'support': 60}, 'macro avg': {'precision': 0.4062126642771804, 'recall': 0.39285714285714285, 'f1-score': 0.3994227994227994, 'support': 60}, 'weighted avg': {'precision': 0.4135404221425727, 'recall': 0.4, 'f1-score': 0.4066570466570466, 'support': 60}}
Wrong BIO-Encoding 31/88 labels, 35.23%
{'C': {'precision': 0.2962962962962963, 'recall': 0.2857142857142857, 'f1-score': 0.2909090909090909, 'support': 28}, 'P': {'precision': 0.5161290322580645, 'recall': 0.5, 'f1-score': 0.5079365079365079, 'support': 32}, 'micro avg': {'precision': 0.41379310344827586, 'recall': 0.4, 'f1-score': 0.4067796610169491, 'support': 60}, 'macro avg': {'precision': 0.4062126642771804, 'recall': 0.39285714285714285, 'f1-score': 0.3994227994227994, 'support': 60}, 'weighted avg': {'precision': 0.4135404221425727, 'recall': 0.4, 'f1-score': 0.4066570466570466, 'support': 60}}
Wrong BIO-Encoding 1/58 labels, 1.72%
Dev-Data: Prec: 0.421, Rec: 0.400, F1: 0.4103
{'C': {'precision': 0.25555555555555554, 'recall': 0.23896103896103896, 'f1-score': 0.24697986577181208, 'support': 385}, 'P': {'precision': 0.26634382566585957, 'recall': 0.2777777777777778, 'f1-score': 0.2719406674907293, 'support': 396}, 'micro avg': {'precision': 0.2613195342820181, 'recall': 0.2586427656850192, 'f1-score': 0.25997425997426, 'support': 781}, 'macro avg': {'precision': 0.26094969061070755, 'recall': 0.25836940836940836, 'f1-score': 0.2594602666312707, 'support': 781}, 'weighted avg': {'precision': 0.2610256643438787, 'recall': 0.2586427656850192, 'f1-score': 0.25963604692506587, 'support': 781}}
Wrong BIO-Encoding 60/830 labels, 7.23%
{'C': {'precision': 0.25555555555555554, 'recall': 0.23896103896103896, 'f1-score': 0.24697986577181208, 'support': 385}, 'P': {'precision': 0.26634382566585957, 'recall': 0.2777777777777778, 'f1-score': 0.2719406674907293, 'support': 396}, 'micro avg': {'precision': 0.2613195342820181, 'recall': 0.2586427656850192, 'f1-score': 0.25997425997426, 'support': 781}, 'macro avg': {'precision': 0.26094969061070755, 'recall': 0.25836940836940836, 'f1-score': 0.2594602666312707, 'support': 781}, 'weighted avg': {'precision': 0.2610256643438787, 'recall': 0.2586427656850192, 'f1-score': 0.25963604692506587, 'support': 781}}
Wrong BIO-Encoding 3/773 labels, 0.39%
Test-Data: Prec: 0.262, Rec: 0.259, F1: 0.2605

Scores from epoch with best dev-scores:
  Dev-Score: 0.5088
  Test-Score 0.2364

4.51 sec for evaluation

--------- Epoch 28 -----------
326.15 sec for training (9122.20 total)
-- cmv_modes1 --
{'C': {'precision': 0.5, 'recall': 0.5, 'f1-score': 0.5, 'support': 28}, 'P': {'precision': 0.5161290322580645, 'recall': 0.5, 'f1-score': 0.5079365079365079, 'support': 32}, 'micro avg': {'precision': 0.5084745762711864, 'recall': 0.5, 'f1-score': 0.5042016806722689, 'support': 60}, 'macro avg': {'precision': 0.5080645161290323, 'recall': 0.5, 'f1-score': 0.503968253968254, 'support': 60}, 'weighted avg': {'precision': 0.5086021505376344, 'recall': 0.5, 'f1-score': 0.5042328042328043, 'support': 60}}
{'C': {'precision': 0.5, 'recall': 0.5, 'f1-score': 0.5, 'support': 28}, 'P': {'precision': 0.5161290322580645, 'recall': 0.5, 'f1-score': 0.5079365079365079, 'support': 32}, 'micro avg': {'precision': 0.5084745762711864, 'recall': 0.5, 'f1-score': 0.5042016806722689, 'support': 60}, 'macro avg': {'precision': 0.5080645161290323, 'recall': 0.5, 'f1-score': 0.503968253968254, 'support': 60}, 'weighted avg': {'precision': 0.5086021505376344, 'recall': 0.5, 'f1-score': 0.5042328042328043, 'support': 60}}
Dev-Data: Prec: 0.508, Rec: 0.500, F1: 0.5042
{'C': {'precision': 0.2191358024691358, 'recall': 0.18441558441558442, 'f1-score': 0.20028208744710857, 'support': 385}, 'P': {'precision': 0.2571428571428571, 'recall': 0.25, 'f1-score': 0.2535211267605634, 'support': 396}, 'micro avg': {'precision': 0.2397743300423131, 'recall': 0.2176696542893726, 'f1-score': 0.22818791946308722, 'support': 781}, 'macro avg': {'precision': 0.23813932980599645, 'recall': 0.2172077922077922, 'f1-score': 0.22690160710383597, 'support': 781}, 'weighted avg': {'precision': 0.2384069851206001, 'recall': 0.2176696542893726, 'f1-score': 0.22727652991590258, 'support': 781}}
Wrong BIO-Encoding 164/865 labels, 18.96%
{'C': {'precision': 0.2191358024691358, 'recall': 0.18441558441558442, 'f1-score': 0.20028208744710857, 'support': 385}, 'P': {'precision': 0.2571428571428571, 'recall': 0.25, 'f1-score': 0.2535211267605634, 'support': 396}, 'micro avg': {'precision': 0.2397743300423131, 'recall': 0.2176696542893726, 'f1-score': 0.22818791946308722, 'support': 781}, 'macro avg': {'precision': 0.23813932980599645, 'recall': 0.2172077922077922, 'f1-score': 0.22690160710383597, 'support': 781}, 'weighted avg': {'precision': 0.2384069851206001, 'recall': 0.2176696542893726, 'f1-score': 0.22727652991590258, 'support': 781}}
Wrong BIO-Encoding 8/709 labels, 1.13%
Test-Data: Prec: 0.243, Rec: 0.218, F1: 0.2294

Scores from epoch with best dev-scores:
  Dev-Score: 0.5088
  Test-Score 0.2364

4.27 sec for evaluation

--------- Epoch 29 -----------
325.78 sec for training (9447.98 total)
-- cmv_modes1 --
{'C': {'precision': 0.4, 'recall': 0.35714285714285715, 'f1-score': 0.3773584905660378, 'support': 28}, 'P': {'precision': 0.5862068965517241, 'recall': 0.53125, 'f1-score': 0.5573770491803278, 'support': 32}, 'micro avg': {'precision': 0.5, 'recall': 0.45, 'f1-score': 0.4736842105263158, 'support': 60}, 'macro avg': {'precision': 0.49310344827586206, 'recall': 0.4441964285714286, 'f1-score': 0.46736776987318285, 'support': 60}, 'weighted avg': {'precision': 0.4993103448275862, 'recall': 0.45, 'f1-score': 0.47336838849365914, 'support': 60}}
Wrong BIO-Encoding 25/78 labels, 32.05%
{'C': {'precision': 0.4, 'recall': 0.35714285714285715, 'f1-score': 0.3773584905660378, 'support': 28}, 'P': {'precision': 0.5862068965517241, 'recall': 0.53125, 'f1-score': 0.5573770491803278, 'support': 32}, 'micro avg': {'precision': 0.5, 'recall': 0.45, 'f1-score': 0.4736842105263158, 'support': 60}, 'macro avg': {'precision': 0.49310344827586206, 'recall': 0.4441964285714286, 'f1-score': 0.46736776987318285, 'support': 60}, 'weighted avg': {'precision': 0.4993103448275862, 'recall': 0.45, 'f1-score': 0.47336838849365914, 'support': 60}}
Wrong BIO-Encoding 1/54 labels, 1.85%
Dev-Data: Prec: 0.509, Rec: 0.450, F1: 0.4779
{'C': {'precision': 0.25483870967741934, 'recall': 0.2051948051948052, 'f1-score': 0.2273381294964029, 'support': 385}, 'P': {'precision': 0.24378109452736318, 'recall': 0.2474747474747475, 'f1-score': 0.24561403508771928, 'support': 396}, 'micro avg': {'precision': 0.24859550561797752, 'recall': 0.2266325224071703, 'f1-score': 0.23710649698593436, 'support': 781}, 'macro avg': {'precision': 0.24930990210239126, 'recall': 0.22633477633477633, 'f1-score': 0.23647608229206107, 'support': 781}, 'weighted avg': {'precision': 0.24923203157316548, 'recall': 0.2266325224071703, 'f1-score': 0.2366047858525633, 'support': 781}}
Wrong BIO-Encoding 354/1049 labels, 33.75%
{'C': {'precision': 0.25483870967741934, 'recall': 0.2051948051948052, 'f1-score': 0.2273381294964029, 'support': 385}, 'P': {'precision': 0.24378109452736318, 'recall': 0.2474747474747475, 'f1-score': 0.24561403508771928, 'support': 396}, 'micro avg': {'precision': 0.24859550561797752, 'recall': 0.2266325224071703, 'f1-score': 0.23710649698593436, 'support': 781}, 'macro avg': {'precision': 0.24930990210239126, 'recall': 0.22633477633477633, 'f1-score': 0.23647608229206107, 'support': 781}, 'weighted avg': {'precision': 0.24923203157316548, 'recall': 0.2266325224071703, 'f1-score': 0.2366047858525633, 'support': 781}}
Wrong BIO-Encoding 17/712 labels, 2.39%
Test-Data: Prec: 0.255, Rec: 0.227, F1: 0.2398

Scores from epoch with best dev-scores:
  Dev-Score: 0.5088
  Test-Score 0.2364

4.37 sec for evaluation

--------- Epoch 30 -----------
329.27 sec for training (9777.25 total)
-- cmv_modes1 --
{'C': {'precision': 0.52, 'recall': 0.4642857142857143, 'f1-score': 0.49056603773584906, 'support': 28}, 'P': {'precision': 0.5333333333333333, 'recall': 0.5, 'f1-score': 0.5161290322580646, 'support': 32}, 'micro avg': {'precision': 0.5272727272727272, 'recall': 0.48333333333333334, 'f1-score': 0.5043478260869565, 'support': 60}, 'macro avg': {'precision': 0.5266666666666666, 'recall': 0.48214285714285715, 'f1-score': 0.5033475349969568, 'support': 60}, 'weighted avg': {'precision': 0.5271111111111111, 'recall': 0.48333333333333334, 'f1-score': 0.504199634814364, 'support': 60}}
Wrong BIO-Encoding 31/85 labels, 36.47%
{'C': {'precision': 0.52, 'recall': 0.4642857142857143, 'f1-score': 0.49056603773584906, 'support': 28}, 'P': {'precision': 0.5333333333333333, 'recall': 0.5, 'f1-score': 0.5161290322580646, 'support': 32}, 'micro avg': {'precision': 0.5272727272727272, 'recall': 0.48333333333333334, 'f1-score': 0.5043478260869565, 'support': 60}, 'macro avg': {'precision': 0.5266666666666666, 'recall': 0.48214285714285715, 'f1-score': 0.5033475349969568, 'support': 60}, 'weighted avg': {'precision': 0.5271111111111111, 'recall': 0.48333333333333334, 'f1-score': 0.504199634814364, 'support': 60}}
Wrong BIO-Encoding 1/55 labels, 1.82%
Dev-Data: Prec: 0.537, Rec: 0.483, F1: 0.5088
{'C': {'precision': 0.2345679012345679, 'recall': 0.1974025974025974, 'f1-score': 0.2143864598025388, 'support': 385}, 'P': {'precision': 0.2458233890214797, 'recall': 0.2601010101010101, 'f1-score': 0.252760736196319, 'support': 396}, 'micro avg': {'precision': 0.24091520861372812, 'recall': 0.22919334186939821, 'f1-score': 0.23490813648293962, 'support': 781}, 'macro avg': {'precision': 0.2401956451280238, 'recall': 0.22875180375180376, 'f1-score': 0.2335735979994289, 'support': 781}, 'weighted avg': {'precision': 0.2402749091265232, 'recall': 0.22919334186939821, 'f1-score': 0.23384383938248365, 'support': 781}}
Wrong BIO-Encoding 255/988 labels, 25.81%
{'C': {'precision': 0.2345679012345679, 'recall': 0.1974025974025974, 'f1-score': 0.2143864598025388, 'support': 385}, 'P': {'precision': 0.2458233890214797, 'recall': 0.2601010101010101, 'f1-score': 0.252760736196319, 'support': 396}, 'micro avg': {'precision': 0.24091520861372812, 'recall': 0.22919334186939821, 'f1-score': 0.23490813648293962, 'support': 781}, 'macro avg': {'precision': 0.2401956451280238, 'recall': 0.22875180375180376, 'f1-score': 0.2335735979994289, 'support': 781}, 'weighted avg': {'precision': 0.2402749091265232, 'recall': 0.22919334186939821, 'f1-score': 0.23384383938248365, 'support': 781}}
Wrong BIO-Encoding 10/743 labels, 1.35%
Test-Data: Prec: 0.244, Rec: 0.229, F1: 0.2365

Scores from epoch with best dev-scores:
  Dev-Score: 0.5088
  Test-Score 0.2364

4.49 sec for evaluation

--------- Epoch 31 -----------
327.69 sec for training (10104.93 total)
-- cmv_modes1 --
{'C': {'precision': 0.5789473684210527, 'recall': 0.39285714285714285, 'f1-score': 0.46808510638297873, 'support': 28}, 'P': {'precision': 0.5405405405405406, 'recall': 0.625, 'f1-score': 0.5797101449275363, 'support': 32}, 'micro avg': {'precision': 0.5535714285714286, 'recall': 0.5166666666666667, 'f1-score': 0.5344827586206896, 'support': 60}, 'macro avg': {'precision': 0.5597439544807966, 'recall': 0.5089285714285714, 'f1-score': 0.5238976256552574, 'support': 60}, 'weighted avg': {'precision': 0.5584637268847795, 'recall': 0.5166666666666667, 'f1-score': 0.5276184602734094, 'support': 60}}
Wrong BIO-Encoding 27/82 labels, 32.93%
{'C': {'precision': 0.5789473684210527, 'recall': 0.39285714285714285, 'f1-score': 0.46808510638297873, 'support': 28}, 'P': {'precision': 0.5405405405405406, 'recall': 0.625, 'f1-score': 0.5797101449275363, 'support': 32}, 'micro avg': {'precision': 0.5535714285714286, 'recall': 0.5166666666666667, 'f1-score': 0.5344827586206896, 'support': 60}, 'macro avg': {'precision': 0.5597439544807966, 'recall': 0.5089285714285714, 'f1-score': 0.5238976256552574, 'support': 60}, 'weighted avg': {'precision': 0.5584637268847795, 'recall': 0.5166666666666667, 'f1-score': 0.5276184602734094, 'support': 60}}
Wrong BIO-Encoding 1/56 labels, 1.79%
Dev-Data: Prec: 0.564, Rec: 0.517, F1: 0.5391
{'C': {'precision': 0.27697841726618705, 'recall': 0.2, 'f1-score': 0.23227752639517346, 'support': 385}, 'P': {'precision': 0.26869158878504673, 'recall': 0.2904040404040404, 'f1-score': 0.27912621359223294, 'support': 396}, 'micro avg': {'precision': 0.2719546742209632, 'recall': 0.24583866837387963, 'f1-score': 0.2582380632145259, 'support': 781}, 'macro avg': {'precision': 0.2728350030256169, 'recall': 0.2452020202020202, 'f1-score': 0.2557018699937032, 'support': 781}, 'weighted avg': {'precision': 0.27277664507856664, 'recall': 0.24583866837387963, 'f1-score': 0.25603179032607687, 'support': 781}}
Wrong BIO-Encoding 100/800 labels, 12.50%
{'C': {'precision': 0.27697841726618705, 'recall': 0.2, 'f1-score': 0.23227752639517346, 'support': 385}, 'P': {'precision': 0.26869158878504673, 'recall': 0.2904040404040404, 'f1-score': 0.27912621359223294, 'support': 396}, 'micro avg': {'precision': 0.2719546742209632, 'recall': 0.24583866837387963, 'f1-score': 0.2582380632145259, 'support': 781}, 'macro avg': {'precision': 0.2728350030256169, 'recall': 0.2452020202020202, 'f1-score': 0.2557018699937032, 'support': 781}, 'weighted avg': {'precision': 0.27277664507856664, 'recall': 0.24583866837387963, 'f1-score': 0.25603179032607687, 'support': 781}}
Wrong BIO-Encoding 6/706 labels, 0.85%
Test-Data: Prec: 0.274, Rec: 0.246, F1: 0.2593

Scores from epoch with best dev-scores:
  Dev-Score: 0.5391
  Test-Score 0.2593

4.51 sec for evaluation

--------- Epoch 32 -----------
329.01 sec for training (10433.95 total)
-- cmv_modes1 --
{'C': {'precision': 0.4827586206896552, 'recall': 0.5, 'f1-score': 0.49122807017543857, 'support': 28}, 'P': {'precision': 0.5357142857142857, 'recall': 0.46875, 'f1-score': 0.5, 'support': 32}, 'micro avg': {'precision': 0.5087719298245614, 'recall': 0.48333333333333334, 'f1-score': 0.4957264957264957, 'support': 60}, 'macro avg': {'precision': 0.5092364532019704, 'recall': 0.484375, 'f1-score': 0.4956140350877193, 'support': 60}, 'weighted avg': {'precision': 0.5110016420361247, 'recall': 0.48333333333333334, 'f1-score': 0.495906432748538, 'support': 60}}
Wrong BIO-Encoding 46/101 labels, 45.54%
{'C': {'precision': 0.4827586206896552, 'recall': 0.5, 'f1-score': 0.49122807017543857, 'support': 28}, 'P': {'precision': 0.5357142857142857, 'recall': 0.46875, 'f1-score': 0.5, 'support': 32}, 'micro avg': {'precision': 0.5087719298245614, 'recall': 0.48333333333333334, 'f1-score': 0.4957264957264957, 'support': 60}, 'macro avg': {'precision': 0.5092364532019704, 'recall': 0.484375, 'f1-score': 0.4956140350877193, 'support': 60}, 'weighted avg': {'precision': 0.5110016420361247, 'recall': 0.48333333333333334, 'f1-score': 0.495906432748538, 'support': 60}}
Wrong BIO-Encoding 2/57 labels, 3.51%
Dev-Data: Prec: 0.527, Rec: 0.483, F1: 0.5043
{'C': {'precision': 0.27071823204419887, 'recall': 0.2545454545454545, 'f1-score': 0.26238286479250333, 'support': 385}, 'P': {'precision': 0.26005361930294907, 'recall': 0.24494949494949494, 'f1-score': 0.25227568270481143, 'support': 396}, 'micro avg': {'precision': 0.2653061224489796, 'recall': 0.2496798975672215, 'f1-score': 0.25725593667546176, 'support': 781}, 'macro avg': {'precision': 0.265385925673574, 'recall': 0.24974747474747472, 'f1-score': 0.2573292737486574, 'support': 781}, 'weighted avg': {'precision': 0.26531082276694545, 'recall': 0.2496798975672215, 'f1-score': 0.2572580964100117, 'support': 781}}
Wrong BIO-Encoding 94/823 labels, 11.42%
{'C': {'precision': 0.27071823204419887, 'recall': 0.2545454545454545, 'f1-score': 0.26238286479250333, 'support': 385}, 'P': {'precision': 0.26005361930294907, 'recall': 0.24494949494949494, 'f1-score': 0.25227568270481143, 'support': 396}, 'micro avg': {'precision': 0.2653061224489796, 'recall': 0.2496798975672215, 'f1-score': 0.25725593667546176, 'support': 781}, 'macro avg': {'precision': 0.265385925673574, 'recall': 0.24974747474747472, 'f1-score': 0.2573292737486574, 'support': 781}, 'weighted avg': {'precision': 0.26531082276694545, 'recall': 0.2496798975672215, 'f1-score': 0.2572580964100117, 'support': 781}}
Wrong BIO-Encoding 6/735 labels, 0.82%
Test-Data: Prec: 0.267, Rec: 0.250, F1: 0.2583

Scores from epoch with best dev-scores:
  Dev-Score: 0.5391
  Test-Score 0.2593

4.35 sec for evaluation

--------- Epoch 33 -----------
329.71 sec for training (10763.65 total)
-- cmv_modes1 --
{'C': {'precision': 0.4, 'recall': 0.35714285714285715, 'f1-score': 0.3773584905660378, 'support': 28}, 'P': {'precision': 0.5483870967741935, 'recall': 0.53125, 'f1-score': 0.5396825396825397, 'support': 32}, 'micro avg': {'precision': 0.48214285714285715, 'recall': 0.45, 'f1-score': 0.46551724137931033, 'support': 60}, 'macro avg': {'precision': 0.47419354838709676, 'recall': 0.4441964285714286, 'f1-score': 0.4585205151242887, 'support': 60}, 'weighted avg': {'precision': 0.4791397849462366, 'recall': 0.45, 'f1-score': 0.4639313167615055, 'support': 60}}
{'C': {'precision': 0.4, 'recall': 0.35714285714285715, 'f1-score': 0.3773584905660378, 'support': 28}, 'P': {'precision': 0.5483870967741935, 'recall': 0.53125, 'f1-score': 0.5396825396825397, 'support': 32}, 'micro avg': {'precision': 0.48214285714285715, 'recall': 0.45, 'f1-score': 0.46551724137931033, 'support': 60}, 'macro avg': {'precision': 0.47419354838709676, 'recall': 0.4441964285714286, 'f1-score': 0.4585205151242887, 'support': 60}, 'weighted avg': {'precision': 0.4791397849462366, 'recall': 0.45, 'f1-score': 0.4639313167615055, 'support': 60}}
Dev-Data: Prec: 0.482, Rec: 0.450, F1: 0.4655
{'C': {'precision': 0.29194630872483224, 'recall': 0.22597402597402597, 'f1-score': 0.2547584187408492, 'support': 385}, 'P': {'precision': 0.24764150943396226, 'recall': 0.26515151515151514, 'f1-score': 0.25609756097560976, 'support': 396}, 'micro avg': {'precision': 0.2659279778393352, 'recall': 0.24583866837387963, 'f1-score': 0.25548902195608775, 'support': 781}, 'macro avg': {'precision': 0.26979390907939726, 'recall': 0.24556277056277054, 'f1-score': 0.25542798985822945, 'support': 781}, 'weighted avg': {'precision': 0.2694819034505883, 'recall': 0.24583866837387963, 'f1-score': 0.2554374204373475, 'support': 781}}
Wrong BIO-Encoding 173/882 labels, 19.61%
{'C': {'precision': 0.29194630872483224, 'recall': 0.22597402597402597, 'f1-score': 0.2547584187408492, 'support': 385}, 'P': {'precision': 0.24764150943396226, 'recall': 0.26515151515151514, 'f1-score': 0.25609756097560976, 'support': 396}, 'micro avg': {'precision': 0.2659279778393352, 'recall': 0.24583866837387963, 'f1-score': 0.25548902195608775, 'support': 781}, 'macro avg': {'precision': 0.26979390907939726, 'recall': 0.24556277056277054, 'f1-score': 0.25542798985822945, 'support': 781}, 'weighted avg': {'precision': 0.2694819034505883, 'recall': 0.24583866837387963, 'f1-score': 0.2554374204373475, 'support': 781}}
Wrong BIO-Encoding 13/722 labels, 1.80%
Test-Data: Prec: 0.271, Rec: 0.246, F1: 0.2577

Scores from epoch with best dev-scores:
  Dev-Score: 0.5391
  Test-Score 0.2593

4.28 sec for evaluation

--------- Epoch 34 -----------
329.53 sec for training (11093.19 total)
-- cmv_modes1 --
{'C': {'precision': 0.5, 'recall': 0.5, 'f1-score': 0.5, 'support': 28}, 'P': {'precision': 0.7037037037037037, 'recall': 0.59375, 'f1-score': 0.6440677966101694, 'support': 32}, 'micro avg': {'precision': 0.6, 'recall': 0.55, 'f1-score': 0.5739130434782609, 'support': 60}, 'macro avg': {'precision': 0.6018518518518519, 'recall': 0.546875, 'f1-score': 0.5720338983050848, 'support': 60}, 'weighted avg': {'precision': 0.608641975308642, 'recall': 0.55, 'f1-score': 0.5768361581920904, 'support': 60}}
{'C': {'precision': 0.5, 'recall': 0.5, 'f1-score': 0.5, 'support': 28}, 'P': {'precision': 0.7037037037037037, 'recall': 0.59375, 'f1-score': 0.6440677966101694, 'support': 32}, 'micro avg': {'precision': 0.6, 'recall': 0.55, 'f1-score': 0.5739130434782609, 'support': 60}, 'macro avg': {'precision': 0.6018518518518519, 'recall': 0.546875, 'f1-score': 0.5720338983050848, 'support': 60}, 'weighted avg': {'precision': 0.608641975308642, 'recall': 0.55, 'f1-score': 0.5768361581920904, 'support': 60}}
Dev-Data: Prec: 0.600, Rec: 0.550, F1: 0.5739
{'C': {'precision': 0.2316715542521994, 'recall': 0.2051948051948052, 'f1-score': 0.21763085399449036, 'support': 385}, 'P': {'precision': 0.2853107344632768, 'recall': 0.255050505050505, 'f1-score': 0.26933333333333337, 'support': 396}, 'micro avg': {'precision': 0.2589928057553957, 'recall': 0.23047375160051217, 'f1-score': 0.24390243902439027, 'support': 781}, 'macro avg': {'precision': 0.2584911443577381, 'recall': 0.23012265512265512, 'f1-score': 0.24348209366391188, 'support': 781}, 'weighted avg': {'precision': 0.2588688850634499, 'recall': 0.23047375160051217, 'f1-score': 0.24384619563108684, 'support': 781}}
Wrong BIO-Encoding 43/736 labels, 5.84%
{'C': {'precision': 0.2316715542521994, 'recall': 0.2051948051948052, 'f1-score': 0.21763085399449036, 'support': 385}, 'P': {'precision': 0.2853107344632768, 'recall': 0.255050505050505, 'f1-score': 0.26933333333333337, 'support': 396}, 'micro avg': {'precision': 0.2589928057553957, 'recall': 0.23047375160051217, 'f1-score': 0.24390243902439027, 'support': 781}, 'macro avg': {'precision': 0.2584911443577381, 'recall': 0.23012265512265512, 'f1-score': 0.24348209366391188, 'support': 781}, 'weighted avg': {'precision': 0.2588688850634499, 'recall': 0.23047375160051217, 'f1-score': 0.24384619563108684, 'support': 781}}
Wrong BIO-Encoding 2/695 labels, 0.29%
Test-Data: Prec: 0.260, Rec: 0.230, F1: 0.2442

Scores from epoch with best dev-scores:
  Dev-Score: 0.5739
  Test-Score 0.2442

4.29 sec for evaluation

--------- Epoch 35 -----------
328.99 sec for training (11422.18 total)
-- cmv_modes1 --
{'C': {'precision': 0.4375, 'recall': 0.5, 'f1-score': 0.4666666666666667, 'support': 28}, 'P': {'precision': 0.7272727272727273, 'recall': 0.5, 'f1-score': 0.5925925925925926, 'support': 32}, 'micro avg': {'precision': 0.5555555555555556, 'recall': 0.5, 'f1-score': 0.5263157894736842, 'support': 60}, 'macro avg': {'precision': 0.5823863636363636, 'recall': 0.5, 'f1-score': 0.5296296296296297, 'support': 60}, 'weighted avg': {'precision': 0.5920454545454545, 'recall': 0.5, 'f1-score': 0.5338271604938271, 'support': 60}}
Wrong BIO-Encoding 25/78 labels, 32.05%
{'C': {'precision': 0.4375, 'recall': 0.5, 'f1-score': 0.4666666666666667, 'support': 28}, 'P': {'precision': 0.7272727272727273, 'recall': 0.5, 'f1-score': 0.5925925925925926, 'support': 32}, 'micro avg': {'precision': 0.5555555555555556, 'recall': 0.5, 'f1-score': 0.5263157894736842, 'support': 60}, 'macro avg': {'precision': 0.5823863636363636, 'recall': 0.5, 'f1-score': 0.5296296296296297, 'support': 60}, 'weighted avg': {'precision': 0.5920454545454545, 'recall': 0.5, 'f1-score': 0.5338271604938271, 'support': 60}}
Wrong BIO-Encoding 1/54 labels, 1.85%
Dev-Data: Prec: 0.566, Rec: 0.500, F1: 0.5310
{'C': {'precision': 0.23929471032745592, 'recall': 0.24675324675324675, 'f1-score': 0.24296675191815856, 'support': 385}, 'P': {'precision': 0.27666666666666667, 'recall': 0.20959595959595959, 'f1-score': 0.23850574712643677, 'support': 396}, 'micro avg': {'precision': 0.25538020086083213, 'recall': 0.22791293213828426, 'f1-score': 0.24086603518267932, 'support': 781}, 'macro avg': {'precision': 0.2579806884970613, 'recall': 0.22817460317460317, 'f1-score': 0.24073624952229766, 'support': 781}, 'weighted avg': {'precision': 0.2582438712881825, 'recall': 0.22791293213828426, 'f1-score': 0.24070483399559542, 'support': 781}}
Wrong BIO-Encoding 76/768 labels, 9.90%
{'C': {'precision': 0.23929471032745592, 'recall': 0.24675324675324675, 'f1-score': 0.24296675191815856, 'support': 385}, 'P': {'precision': 0.27666666666666667, 'recall': 0.20959595959595959, 'f1-score': 0.23850574712643677, 'support': 396}, 'micro avg': {'precision': 0.25538020086083213, 'recall': 0.22791293213828426, 'f1-score': 0.24086603518267932, 'support': 781}, 'macro avg': {'precision': 0.2579806884970613, 'recall': 0.22817460317460317, 'f1-score': 0.24073624952229766, 'support': 781}, 'weighted avg': {'precision': 0.2582438712881825, 'recall': 0.22791293213828426, 'f1-score': 0.24070483399559542, 'support': 781}}
Wrong BIO-Encoding 5/697 labels, 0.72%
Test-Data: Prec: 0.257, Rec: 0.228, F1: 0.2417

Scores from epoch with best dev-scores:
  Dev-Score: 0.5739
  Test-Score 0.2442

4.34 sec for evaluation

--------- Epoch 36 -----------
327.33 sec for training (11749.51 total)
-- cmv_modes1 --
{'C': {'precision': 0.4827586206896552, 'recall': 0.5, 'f1-score': 0.49122807017543857, 'support': 28}, 'P': {'precision': 0.5925925925925926, 'recall': 0.5, 'f1-score': 0.5423728813559322, 'support': 32}, 'micro avg': {'precision': 0.5357142857142857, 'recall': 0.5, 'f1-score': 0.5172413793103449, 'support': 60}, 'macro avg': {'precision': 0.5376756066411239, 'recall': 0.5, 'f1-score': 0.5168004757656854, 'support': 60}, 'weighted avg': {'precision': 0.5413367390378885, 'recall': 0.5, 'f1-score': 0.5185053028050352, 'support': 60}}
{'C': {'precision': 0.4827586206896552, 'recall': 0.5, 'f1-score': 0.49122807017543857, 'support': 28}, 'P': {'precision': 0.5925925925925926, 'recall': 0.5, 'f1-score': 0.5423728813559322, 'support': 32}, 'micro avg': {'precision': 0.5357142857142857, 'recall': 0.5, 'f1-score': 0.5172413793103449, 'support': 60}, 'macro avg': {'precision': 0.5376756066411239, 'recall': 0.5, 'f1-score': 0.5168004757656854, 'support': 60}, 'weighted avg': {'precision': 0.5413367390378885, 'recall': 0.5, 'f1-score': 0.5185053028050352, 'support': 60}}
Dev-Data: Prec: 0.536, Rec: 0.500, F1: 0.5172
{'C': {'precision': 0.2471590909090909, 'recall': 0.22597402597402597, 'f1-score': 0.2360922659430122, 'support': 385}, 'P': {'precision': 0.27631578947368424, 'recall': 0.26515151515151514, 'f1-score': 0.2706185567010309, 'support': 396}, 'micro avg': {'precision': 0.26229508196721313, 'recall': 0.24583866837387963, 'f1-score': 0.25380039656311965, 'support': 781}, 'macro avg': {'precision': 0.26173744019138756, 'recall': 0.24556277056277054, 'f1-score': 0.25335541132202155, 'support': 781}, 'weighted avg': {'precision': 0.2619427690545185, 'recall': 0.24583866837387963, 'f1-score': 0.2535985542146837, 'support': 781}}
Wrong BIO-Encoding 133/855 labels, 15.56%
{'C': {'precision': 0.2471590909090909, 'recall': 0.22597402597402597, 'f1-score': 0.2360922659430122, 'support': 385}, 'P': {'precision': 0.27631578947368424, 'recall': 0.26515151515151514, 'f1-score': 0.2706185567010309, 'support': 396}, 'micro avg': {'precision': 0.26229508196721313, 'recall': 0.24583866837387963, 'f1-score': 0.25380039656311965, 'support': 781}, 'macro avg': {'precision': 0.26173744019138756, 'recall': 0.24556277056277054, 'f1-score': 0.25335541132202155, 'support': 781}, 'weighted avg': {'precision': 0.2619427690545185, 'recall': 0.24583866837387963, 'f1-score': 0.2535985542146837, 'support': 781}}
Wrong BIO-Encoding 10/732 labels, 1.37%
Test-Data: Prec: 0.266, Rec: 0.246, F1: 0.2555

Scores from epoch with best dev-scores:
  Dev-Score: 0.5739
  Test-Score 0.2442

4.45 sec for evaluation

--------- Epoch 37 -----------
328.32 sec for training (12077.84 total)
-- cmv_modes1 --
{'C': {'precision': 0.5714285714285714, 'recall': 0.42857142857142855, 'f1-score': 0.48979591836734687, 'support': 28}, 'P': {'precision': 0.46875, 'recall': 0.46875, 'f1-score': 0.46875, 'support': 32}, 'micro avg': {'precision': 0.5094339622641509, 'recall': 0.45, 'f1-score': 0.47787610619469023, 'support': 60}, 'macro avg': {'precision': 0.5200892857142857, 'recall': 0.4486607142857143, 'f1-score': 0.4792729591836734, 'support': 60}, 'weighted avg': {'precision': 0.5166666666666667, 'recall': 0.45, 'f1-score': 0.47857142857142854, 'support': 60}}
Wrong BIO-Encoding 105/155 labels, 67.74%
{'C': {'precision': 0.5714285714285714, 'recall': 0.42857142857142855, 'f1-score': 0.48979591836734687, 'support': 28}, 'P': {'precision': 0.46875, 'recall': 0.46875, 'f1-score': 0.46875, 'support': 32}, 'micro avg': {'precision': 0.5094339622641509, 'recall': 0.45, 'f1-score': 0.47787610619469023, 'support': 60}, 'macro avg': {'precision': 0.5200892857142857, 'recall': 0.4486607142857143, 'f1-score': 0.4792729591836734, 'support': 60}, 'weighted avg': {'precision': 0.5166666666666667, 'recall': 0.45, 'f1-score': 0.47857142857142854, 'support': 60}}
Wrong BIO-Encoding 3/53 labels, 5.66%
Dev-Data: Prec: 0.540, Rec: 0.450, F1: 0.4909
{'C': {'precision': 0.305019305019305, 'recall': 0.2051948051948052, 'f1-score': 0.2453416149068323, 'support': 385}, 'P': {'precision': 0.24390243902439024, 'recall': 0.2777777777777778, 'f1-score': 0.25974025974025977, 'support': 396}, 'micro avg': {'precision': 0.2661971830985915, 'recall': 0.24199743918053776, 'f1-score': 0.2535211267605634, 'support': 781}, 'macro avg': {'precision': 0.27446087202184766, 'recall': 0.2414862914862915, 'f1-score': 0.25254093732354604, 'support': 781}, 'weighted avg': {'precision': 0.2740304715570947, 'recall': 0.24199743918053776, 'f1-score': 0.2526423362308237, 'support': 781}}
Wrong BIO-Encoding 162/863 labels, 18.77%
{'C': {'precision': 0.305019305019305, 'recall': 0.2051948051948052, 'f1-score': 0.2453416149068323, 'support': 385}, 'P': {'precision': 0.24390243902439024, 'recall': 0.2777777777777778, 'f1-score': 0.25974025974025977, 'support': 396}, 'micro avg': {'precision': 0.2661971830985915, 'recall': 0.24199743918053776, 'f1-score': 0.2535211267605634, 'support': 781}, 'macro avg': {'precision': 0.27446087202184766, 'recall': 0.2414862914862915, 'f1-score': 0.25254093732354604, 'support': 781}, 'weighted avg': {'precision': 0.2740304715570947, 'recall': 0.24199743918053776, 'f1-score': 0.2526423362308237, 'support': 781}}
Wrong BIO-Encoding 9/710 labels, 1.27%
Test-Data: Prec: 0.270, Rec: 0.242, F1: 0.2551

Scores from epoch with best dev-scores:
  Dev-Score: 0.5739
  Test-Score 0.2442

4.25 sec for evaluation

--------- Epoch 38 -----------
327.81 sec for training (12405.64 total)
-- cmv_modes1 --
{'C': {'precision': 0.5416666666666666, 'recall': 0.4642857142857143, 'f1-score': 0.5, 'support': 28}, 'P': {'precision': 0.5, 'recall': 0.5, 'f1-score': 0.5, 'support': 32}, 'micro avg': {'precision': 0.5178571428571429, 'recall': 0.48333333333333334, 'f1-score': 0.5, 'support': 60}, 'macro avg': {'precision': 0.5208333333333333, 'recall': 0.48214285714285715, 'f1-score': 0.5, 'support': 60}, 'weighted avg': {'precision': 0.5194444444444444, 'recall': 0.48333333333333334, 'f1-score': 0.5, 'support': 60}}
Wrong BIO-Encoding 88/142 labels, 61.97%
{'C': {'precision': 0.5416666666666666, 'recall': 0.4642857142857143, 'f1-score': 0.5, 'support': 28}, 'P': {'precision': 0.5, 'recall': 0.5, 'f1-score': 0.5, 'support': 32}, 'micro avg': {'precision': 0.5178571428571429, 'recall': 0.48333333333333334, 'f1-score': 0.5, 'support': 60}, 'macro avg': {'precision': 0.5208333333333333, 'recall': 0.48214285714285715, 'f1-score': 0.5, 'support': 60}, 'weighted avg': {'precision': 0.5194444444444444, 'recall': 0.48333333333333334, 'f1-score': 0.5, 'support': 60}}
Wrong BIO-Encoding 2/56 labels, 3.57%
Dev-Data: Prec: 0.537, Rec: 0.483, F1: 0.5088
{'C': {'precision': 0.2576271186440678, 'recall': 0.1974025974025974, 'f1-score': 0.2235294117647059, 'support': 385}, 'P': {'precision': 0.25181598062953997, 'recall': 0.26262626262626265, 'f1-score': 0.2571075401730531, 'support': 396}, 'micro avg': {'precision': 0.2542372881355932, 'recall': 0.23047375160051217, 'f1-score': 0.241773002014775, 'support': 781}, 'macro avg': {'precision': 0.2547215496368039, 'recall': 0.23001443001443003, 'f1-score': 0.2403184759688795, 'support': 781}, 'weighted avg': {'precision': 0.2546806261296593, 'recall': 0.23047375160051217, 'f1-score': 0.240554941661896, 'support': 781}}
Wrong BIO-Encoding 62/765 labels, 8.10%
{'C': {'precision': 0.2576271186440678, 'recall': 0.1974025974025974, 'f1-score': 0.2235294117647059, 'support': 385}, 'P': {'precision': 0.25181598062953997, 'recall': 0.26262626262626265, 'f1-score': 0.2571075401730531, 'support': 396}, 'micro avg': {'precision': 0.2542372881355932, 'recall': 0.23047375160051217, 'f1-score': 0.241773002014775, 'support': 781}, 'macro avg': {'precision': 0.2547215496368039, 'recall': 0.23001443001443003, 'f1-score': 0.2403184759688795, 'support': 781}, 'weighted avg': {'precision': 0.2546806261296593, 'recall': 0.23047375160051217, 'f1-score': 0.240554941661896, 'support': 781}}
Wrong BIO-Encoding 5/708 labels, 0.71%
Test-Data: Prec: 0.256, Rec: 0.230, F1: 0.2426

Scores from epoch with best dev-scores:
  Dev-Score: 0.5739
  Test-Score 0.2442

4.51 sec for evaluation

--------- Epoch 39 -----------
333.28 sec for training (12738.92 total)
-- cmv_modes1 --
{'C': {'precision': 0.6333333333333333, 'recall': 0.6785714285714286, 'f1-score': 0.6551724137931035, 'support': 28}, 'P': {'precision': 0.75, 'recall': 0.5625, 'f1-score': 0.6428571428571429, 'support': 32}, 'micro avg': {'precision': 0.6851851851851852, 'recall': 0.6166666666666667, 'f1-score': 0.6491228070175439, 'support': 60}, 'macro avg': {'precision': 0.6916666666666667, 'recall': 0.6205357142857143, 'f1-score': 0.6490147783251232, 'support': 60}, 'weighted avg': {'precision': 0.6955555555555556, 'recall': 0.6166666666666667, 'f1-score': 0.6486042692939246, 'support': 60}}
Wrong BIO-Encoding 26/79 labels, 32.91%
{'C': {'precision': 0.6333333333333333, 'recall': 0.6785714285714286, 'f1-score': 0.6551724137931035, 'support': 28}, 'P': {'precision': 0.75, 'recall': 0.5625, 'f1-score': 0.6428571428571429, 'support': 32}, 'micro avg': {'precision': 0.6851851851851852, 'recall': 0.6166666666666667, 'f1-score': 0.6491228070175439, 'support': 60}, 'macro avg': {'precision': 0.6916666666666667, 'recall': 0.6205357142857143, 'f1-score': 0.6490147783251232, 'support': 60}, 'weighted avg': {'precision': 0.6955555555555556, 'recall': 0.6166666666666667, 'f1-score': 0.6486042692939246, 'support': 60}}
Wrong BIO-Encoding 1/54 labels, 1.85%
Dev-Data: Prec: 0.685, Rec: 0.617, F1: 0.6491
{'C': {'precision': 0.22110552763819097, 'recall': 0.22857142857142856, 'f1-score': 0.2247765006385696, 'support': 385}, 'P': {'precision': 0.245014245014245, 'recall': 0.21717171717171718, 'f1-score': 0.23025435073627845, 'support': 396}, 'micro avg': {'precision': 0.23230974632843793, 'recall': 0.22279129321382843, 'f1-score': 0.2274509803921569, 'support': 781}, 'macro avg': {'precision': 0.233059886326218, 'recall': 0.2228715728715729, 'f1-score': 0.22751542568742403, 'support': 781}, 'weighted avg': {'precision': 0.23322825757534513, 'recall': 0.22279129321382843, 'f1-score': 0.2275540020965628, 'support': 781}}
Wrong BIO-Encoding 167/903 labels, 18.49%
{'C': {'precision': 0.22110552763819097, 'recall': 0.22857142857142856, 'f1-score': 0.2247765006385696, 'support': 385}, 'P': {'precision': 0.245014245014245, 'recall': 0.21717171717171718, 'f1-score': 0.23025435073627845, 'support': 396}, 'micro avg': {'precision': 0.23230974632843793, 'recall': 0.22279129321382843, 'f1-score': 0.2274509803921569, 'support': 781}, 'macro avg': {'precision': 0.233059886326218, 'recall': 0.2228715728715729, 'f1-score': 0.22751542568742403, 'support': 781}, 'weighted avg': {'precision': 0.23322825757534513, 'recall': 0.22279129321382843, 'f1-score': 0.2275540020965628, 'support': 781}}
Wrong BIO-Encoding 13/749 labels, 1.74%
Test-Data: Prec: 0.236, Rec: 0.223, F1: 0.2294

Scores from epoch with best dev-scores:
  Dev-Score: 0.6491
  Test-Score 0.2294

4.37 sec for evaluation

--------- Epoch 40 -----------
331.15 sec for training (13070.07 total)
-- cmv_modes1 --
{'C': {'precision': 0.5909090909090909, 'recall': 0.4642857142857143, 'f1-score': 0.52, 'support': 28}, 'P': {'precision': 0.5428571428571428, 'recall': 0.59375, 'f1-score': 0.5671641791044776, 'support': 32}, 'micro avg': {'precision': 0.5614035087719298, 'recall': 0.5333333333333333, 'f1-score': 0.5470085470085471, 'support': 60}, 'macro avg': {'precision': 0.5668831168831169, 'recall': 0.5290178571428572, 'f1-score': 0.5435820895522387, 'support': 60}, 'weighted avg': {'precision': 0.5652813852813853, 'recall': 0.5333333333333333, 'f1-score': 0.5451542288557214, 'support': 60}}
{'C': {'precision': 0.5909090909090909, 'recall': 0.4642857142857143, 'f1-score': 0.52, 'support': 28}, 'P': {'precision': 0.5428571428571428, 'recall': 0.59375, 'f1-score': 0.5671641791044776, 'support': 32}, 'micro avg': {'precision': 0.5614035087719298, 'recall': 0.5333333333333333, 'f1-score': 0.5470085470085471, 'support': 60}, 'macro avg': {'precision': 0.5668831168831169, 'recall': 0.5290178571428572, 'f1-score': 0.5435820895522387, 'support': 60}, 'weighted avg': {'precision': 0.5652813852813853, 'recall': 0.5333333333333333, 'f1-score': 0.5451542288557214, 'support': 60}}
Dev-Data: Prec: 0.561, Rec: 0.533, F1: 0.5470
{'C': {'precision': 0.3047945205479452, 'recall': 0.23116883116883116, 'f1-score': 0.26292466765140327, 'support': 385}, 'P': {'precision': 0.2764423076923077, 'recall': 0.2904040404040404, 'f1-score': 0.2832512315270935, 'support': 396}, 'micro avg': {'precision': 0.288135593220339, 'recall': 0.2612035851472471, 'f1-score': 0.2740094022834117, 'support': 781}, 'macro avg': {'precision': 0.29061841412012646, 'recall': 0.2607864357864358, 'f1-score': 0.2730879495892484, 'support': 781}, 'weighted avg': {'precision': 0.2904187506493121, 'recall': 0.2612035851472471, 'f1-score': 0.2732310944052744, 'support': 781}}
Wrong BIO-Encoding 93/793 labels, 11.73%
{'C': {'precision': 0.3047945205479452, 'recall': 0.23116883116883116, 'f1-score': 0.26292466765140327, 'support': 385}, 'P': {'precision': 0.2764423076923077, 'recall': 0.2904040404040404, 'f1-score': 0.2832512315270935, 'support': 396}, 'micro avg': {'precision': 0.288135593220339, 'recall': 0.2612035851472471, 'f1-score': 0.2740094022834117, 'support': 781}, 'macro avg': {'precision': 0.29061841412012646, 'recall': 0.2607864357864358, 'f1-score': 0.2730879495892484, 'support': 781}, 'weighted avg': {'precision': 0.2904187506493121, 'recall': 0.2612035851472471, 'f1-score': 0.2732310944052744, 'support': 781}}
Wrong BIO-Encoding 8/708 labels, 1.13%
Test-Data: Prec: 0.291, Rec: 0.261, F1: 0.2755

Scores from epoch with best dev-scores:
  Dev-Score: 0.6491
  Test-Score 0.2294

4.54 sec for evaluation

--------- Epoch 41 -----------
327.26 sec for training (13397.33 total)
-- cmv_modes1 --
{'C': {'precision': 0.5652173913043478, 'recall': 0.4642857142857143, 'f1-score': 0.5098039215686274, 'support': 28}, 'P': {'precision': 0.625, 'recall': 0.625, 'f1-score': 0.625, 'support': 32}, 'micro avg': {'precision': 0.6, 'recall': 0.55, 'f1-score': 0.5739130434782609, 'support': 60}, 'macro avg': {'precision': 0.5951086956521738, 'recall': 0.5446428571428572, 'f1-score': 0.5674019607843137, 'support': 60}, 'weighted avg': {'precision': 0.5971014492753622, 'recall': 0.55, 'f1-score': 0.5712418300653594, 'support': 60}}
{'C': {'precision': 0.5652173913043478, 'recall': 0.4642857142857143, 'f1-score': 0.5098039215686274, 'support': 28}, 'P': {'precision': 0.625, 'recall': 0.625, 'f1-score': 0.625, 'support': 32}, 'micro avg': {'precision': 0.6, 'recall': 0.55, 'f1-score': 0.5739130434782609, 'support': 60}, 'macro avg': {'precision': 0.5951086956521738, 'recall': 0.5446428571428572, 'f1-score': 0.5674019607843137, 'support': 60}, 'weighted avg': {'precision': 0.5971014492753622, 'recall': 0.55, 'f1-score': 0.5712418300653594, 'support': 60}}
Dev-Data: Prec: 0.600, Rec: 0.550, F1: 0.5739
{'C': {'precision': 0.2724014336917563, 'recall': 0.1974025974025974, 'f1-score': 0.22891566265060243, 'support': 385}, 'P': {'precision': 0.21987315010570824, 'recall': 0.26262626262626265, 'f1-score': 0.23935558112773303, 'support': 396}, 'micro avg': {'precision': 0.2393617021276596, 'recall': 0.23047375160051217, 'f1-score': 0.23483365949119375, 'support': 781}, 'macro avg': {'precision': 0.24613729189873226, 'recall': 0.23001443001443003, 'f1-score': 0.23413562188916773, 'support': 781}, 'weighted avg': {'precision': 0.24576737440868968, 'recall': 0.23047375160051217, 'f1-score': 0.23420914244182356, 'support': 781}}
Wrong BIO-Encoding 110/849 labels, 12.96%
{'C': {'precision': 0.2724014336917563, 'recall': 0.1974025974025974, 'f1-score': 0.22891566265060243, 'support': 385}, 'P': {'precision': 0.21987315010570824, 'recall': 0.26262626262626265, 'f1-score': 0.23935558112773303, 'support': 396}, 'micro avg': {'precision': 0.2393617021276596, 'recall': 0.23047375160051217, 'f1-score': 0.23483365949119375, 'support': 781}, 'macro avg': {'precision': 0.24613729189873226, 'recall': 0.23001443001443003, 'f1-score': 0.23413562188916773, 'support': 781}, 'weighted avg': {'precision': 0.24576737440868968, 'recall': 0.23047375160051217, 'f1-score': 0.23420914244182356, 'support': 781}}
Wrong BIO-Encoding 13/752 labels, 1.73%
Test-Data: Prec: 0.244, Rec: 0.230, F1: 0.2368

Scores from epoch with best dev-scores:
  Dev-Score: 0.6491
  Test-Score 0.2294

4.48 sec for evaluation

--------- Epoch 42 -----------
327.21 sec for training (13724.53 total)
-- cmv_modes1 --
{'C': {'precision': 0.40625, 'recall': 0.4642857142857143, 'f1-score': 0.4333333333333333, 'support': 28}, 'P': {'precision': 0.8, 'recall': 0.5, 'f1-score': 0.6153846153846154, 'support': 32}, 'micro avg': {'precision': 0.5576923076923077, 'recall': 0.48333333333333334, 'f1-score': 0.5178571428571428, 'support': 60}, 'macro avg': {'precision': 0.603125, 'recall': 0.48214285714285715, 'f1-score': 0.5243589743589744, 'support': 60}, 'weighted avg': {'precision': 0.6162500000000001, 'recall': 0.48333333333333334, 'f1-score': 0.5304273504273505, 'support': 60}}
{'C': {'precision': 0.40625, 'recall': 0.4642857142857143, 'f1-score': 0.4333333333333333, 'support': 28}, 'P': {'precision': 0.8, 'recall': 0.5, 'f1-score': 0.6153846153846154, 'support': 32}, 'micro avg': {'precision': 0.5576923076923077, 'recall': 0.48333333333333334, 'f1-score': 0.5178571428571428, 'support': 60}, 'macro avg': {'precision': 0.603125, 'recall': 0.48214285714285715, 'f1-score': 0.5243589743589744, 'support': 60}, 'weighted avg': {'precision': 0.6162500000000001, 'recall': 0.48333333333333334, 'f1-score': 0.5304273504273505, 'support': 60}}
Dev-Data: Prec: 0.558, Rec: 0.483, F1: 0.5179
{'C': {'precision': 0.23969072164948454, 'recall': 0.24155844155844156, 'f1-score': 0.24062095730918498, 'support': 385}, 'P': {'precision': 0.30701754385964913, 'recall': 0.26515151515151514, 'f1-score': 0.2845528455284552, 'support': 396}, 'micro avg': {'precision': 0.27123287671232876, 'recall': 0.2535211267605634, 'f1-score': 0.2620780939774983, 'support': 781}, 'macro avg': {'precision': 0.2733541327545668, 'recall': 0.25335497835497833, 'f1-score': 0.26258690141882013, 'support': 781}, 'weighted avg': {'precision': 0.27382826530534266, 'recall': 0.2535211267605634, 'f1-score': 0.262896280913322, 'support': 781}}
Wrong BIO-Encoding 197/916 labels, 21.51%
{'C': {'precision': 0.23969072164948454, 'recall': 0.24155844155844156, 'f1-score': 0.24062095730918498, 'support': 385}, 'P': {'precision': 0.30701754385964913, 'recall': 0.26515151515151514, 'f1-score': 0.2845528455284552, 'support': 396}, 'micro avg': {'precision': 0.27123287671232876, 'recall': 0.2535211267605634, 'f1-score': 0.2620780939774983, 'support': 781}, 'macro avg': {'precision': 0.2733541327545668, 'recall': 0.25335497835497833, 'f1-score': 0.26258690141882013, 'support': 781}, 'weighted avg': {'precision': 0.27382826530534266, 'recall': 0.2535211267605634, 'f1-score': 0.262896280913322, 'support': 781}}
Wrong BIO-Encoding 11/730 labels, 1.51%
Test-Data: Prec: 0.275, Rec: 0.254, F1: 0.2640

Scores from epoch with best dev-scores:
  Dev-Score: 0.6491
  Test-Score 0.2294

4.31 sec for evaluation

--------- Epoch 43 -----------
333.16 sec for training (14057.69 total)
-- cmv_modes1 --
{'C': {'precision': 0.5185185185185185, 'recall': 0.5, 'f1-score': 0.509090909090909, 'support': 28}, 'P': {'precision': 0.8148148148148148, 'recall': 0.6875, 'f1-score': 0.7457627118644067, 'support': 32}, 'micro avg': {'precision': 0.6666666666666666, 'recall': 0.6, 'f1-score': 0.631578947368421, 'support': 60}, 'macro avg': {'precision': 0.6666666666666666, 'recall': 0.59375, 'f1-score': 0.6274268104776579, 'support': 60}, 'weighted avg': {'precision': 0.6765432098765432, 'recall': 0.6, 'f1-score': 0.6353158705701077, 'support': 60}}
{'C': {'precision': 0.5185185185185185, 'recall': 0.5, 'f1-score': 0.509090909090909, 'support': 28}, 'P': {'precision': 0.8148148148148148, 'recall': 0.6875, 'f1-score': 0.7457627118644067, 'support': 32}, 'micro avg': {'precision': 0.6666666666666666, 'recall': 0.6, 'f1-score': 0.631578947368421, 'support': 60}, 'macro avg': {'precision': 0.6666666666666666, 'recall': 0.59375, 'f1-score': 0.6274268104776579, 'support': 60}, 'weighted avg': {'precision': 0.6765432098765432, 'recall': 0.6, 'f1-score': 0.6353158705701077, 'support': 60}}
Dev-Data: Prec: 0.667, Rec: 0.600, F1: 0.6316
{'C': {'precision': 0.22153846153846155, 'recall': 0.18701298701298702, 'f1-score': 0.20281690140845074, 'support': 385}, 'P': {'precision': 0.2655086848635236, 'recall': 0.2702020202020202, 'f1-score': 0.26783479349186484, 'support': 396}, 'micro avg': {'precision': 0.24587912087912087, 'recall': 0.22919334186939821, 'f1-score': 0.23724320742213387, 'support': 781}, 'macro avg': {'precision': 0.24352357320099255, 'recall': 0.22860750360750362, 'f1-score': 0.23532584745015778, 'support': 781}, 'weighted avg': {'precision': 0.24383322266102825, 'recall': 0.22919334186939821, 'f1-score': 0.23578371992961847, 'support': 781}}
Wrong BIO-Encoding 170/887 labels, 19.17%
{'C': {'precision': 0.22153846153846155, 'recall': 0.18701298701298702, 'f1-score': 0.20281690140845074, 'support': 385}, 'P': {'precision': 0.2655086848635236, 'recall': 0.2702020202020202, 'f1-score': 0.26783479349186484, 'support': 396}, 'micro avg': {'precision': 0.24587912087912087, 'recall': 0.22919334186939821, 'f1-score': 0.23724320742213387, 'support': 781}, 'macro avg': {'precision': 0.24352357320099255, 'recall': 0.22860750360750362, 'f1-score': 0.23532584745015778, 'support': 781}, 'weighted avg': {'precision': 0.24383322266102825, 'recall': 0.22919334186939821, 'f1-score': 0.23578371992961847, 'support': 781}}
Wrong BIO-Encoding 11/728 labels, 1.51%
Test-Data: Prec: 0.250, Rec: 0.229, F1: 0.2390

Scores from epoch with best dev-scores:
  Dev-Score: 0.6491
  Test-Score 0.2294

4.31 sec for evaluation

--------- Epoch 44 -----------
340.18 sec for training (14397.87 total)
-- cmv_modes1 --
{'C': {'precision': 0.4782608695652174, 'recall': 0.39285714285714285, 'f1-score': 0.4313725490196078, 'support': 28}, 'P': {'precision': 0.5483870967741935, 'recall': 0.53125, 'f1-score': 0.5396825396825397, 'support': 32}, 'micro avg': {'precision': 0.5185185185185185, 'recall': 0.4666666666666667, 'f1-score': 0.4912280701754386, 'support': 60}, 'macro avg': {'precision': 0.5133239831697054, 'recall': 0.4620535714285714, 'f1-score': 0.4855275443510737, 'support': 60}, 'weighted avg': {'precision': 0.5156615240766713, 'recall': 0.4666666666666667, 'f1-score': 0.4891378773731715, 'support': 60}}
Wrong BIO-Encoding 27/80 labels, 33.75%
{'C': {'precision': 0.4782608695652174, 'recall': 0.39285714285714285, 'f1-score': 0.4313725490196078, 'support': 28}, 'P': {'precision': 0.5483870967741935, 'recall': 0.53125, 'f1-score': 0.5396825396825397, 'support': 32}, 'micro avg': {'precision': 0.5185185185185185, 'recall': 0.4666666666666667, 'f1-score': 0.4912280701754386, 'support': 60}, 'macro avg': {'precision': 0.5133239831697054, 'recall': 0.4620535714285714, 'f1-score': 0.4855275443510737, 'support': 60}, 'weighted avg': {'precision': 0.5156615240766713, 'recall': 0.4666666666666667, 'f1-score': 0.4891378773731715, 'support': 60}}
Wrong BIO-Encoding 1/54 labels, 1.85%
Dev-Data: Prec: 0.528, Rec: 0.467, F1: 0.4956
{'C': {'precision': 0.26421404682274247, 'recall': 0.2051948051948052, 'f1-score': 0.23099415204678364, 'support': 385}, 'P': {'precision': 0.2540792540792541, 'recall': 0.27525252525252525, 'f1-score': 0.2642424242424242, 'support': 396}, 'micro avg': {'precision': 0.25824175824175827, 'recall': 0.2407170294494238, 'f1-score': 0.2491716368455931, 'support': 781}, 'macro avg': {'precision': 0.2591466504509983, 'recall': 0.24022366522366523, 'f1-score': 0.24761828814460393, 'support': 781}, 'weighted avg': {'precision': 0.2590752786711146, 'recall': 0.2407170294494238, 'f1-score': 0.24785243090654507, 'support': 781}}
Wrong BIO-Encoding 163/880 labels, 18.52%
{'C': {'precision': 0.26421404682274247, 'recall': 0.2051948051948052, 'f1-score': 0.23099415204678364, 'support': 385}, 'P': {'precision': 0.2540792540792541, 'recall': 0.27525252525252525, 'f1-score': 0.2642424242424242, 'support': 396}, 'micro avg': {'precision': 0.25824175824175827, 'recall': 0.2407170294494238, 'f1-score': 0.2491716368455931, 'support': 781}, 'macro avg': {'precision': 0.2591466504509983, 'recall': 0.24022366522366523, 'f1-score': 0.24761828814460393, 'support': 781}, 'weighted avg': {'precision': 0.2590752786711146, 'recall': 0.2407170294494238, 'f1-score': 0.24785243090654507, 'support': 781}}
Wrong BIO-Encoding 11/728 labels, 1.51%
Test-Data: Prec: 0.262, Rec: 0.241, F1: 0.2510

Scores from epoch with best dev-scores:
  Dev-Score: 0.6491
  Test-Score 0.2294

4.30 sec for evaluation

--------- Epoch 45 -----------
340.19 sec for training (14738.06 total)
-- cmv_modes1 --
{'C': {'precision': 0.47619047619047616, 'recall': 0.35714285714285715, 'f1-score': 0.40816326530612246, 'support': 28}, 'P': {'precision': 0.7586206896551724, 'recall': 0.6875, 'f1-score': 0.7213114754098361, 'support': 32}, 'micro avg': {'precision': 0.64, 'recall': 0.5333333333333333, 'f1-score': 0.5818181818181818, 'support': 60}, 'macro avg': {'precision': 0.6174055829228242, 'recall': 0.5223214285714286, 'f1-score': 0.5647373703579792, 'support': 60}, 'weighted avg': {'precision': 0.6268199233716475, 'recall': 0.5333333333333333, 'f1-score': 0.5751756440281031, 'support': 60}}
{'C': {'precision': 0.47619047619047616, 'recall': 0.35714285714285715, 'f1-score': 0.40816326530612246, 'support': 28}, 'P': {'precision': 0.7586206896551724, 'recall': 0.6875, 'f1-score': 0.7213114754098361, 'support': 32}, 'micro avg': {'precision': 0.64, 'recall': 0.5333333333333333, 'f1-score': 0.5818181818181818, 'support': 60}, 'macro avg': {'precision': 0.6174055829228242, 'recall': 0.5223214285714286, 'f1-score': 0.5647373703579792, 'support': 60}, 'weighted avg': {'precision': 0.6268199233716475, 'recall': 0.5333333333333333, 'f1-score': 0.5751756440281031, 'support': 60}}
Dev-Data: Prec: 0.640, Rec: 0.533, F1: 0.5818
{'C': {'precision': 0.28515625, 'recall': 0.18961038961038962, 'f1-score': 0.2277691107644306, 'support': 385}, 'P': {'precision': 0.27505827505827507, 'recall': 0.29797979797979796, 'f1-score': 0.286060606060606, 'support': 396}, 'micro avg': {'precision': 0.27883211678832115, 'recall': 0.24455825864276567, 'f1-score': 0.2605729877216917, 'support': 781}, 'macro avg': {'precision': 0.28010726252913754, 'recall': 0.2437950937950938, 'f1-score': 0.2569148584125183, 'support': 781}, 'weighted avg': {'precision': 0.2800361500295479, 'recall': 0.24455825864276567, 'f1-score': 0.2573253619005195, 'support': 781}}
Wrong BIO-Encoding 107/783 labels, 13.67%
{'C': {'precision': 0.28515625, 'recall': 0.18961038961038962, 'f1-score': 0.2277691107644306, 'support': 385}, 'P': {'precision': 0.27505827505827507, 'recall': 0.29797979797979796, 'f1-score': 0.286060606060606, 'support': 396}, 'micro avg': {'precision': 0.27883211678832115, 'recall': 0.24455825864276567, 'f1-score': 0.2605729877216917, 'support': 781}, 'macro avg': {'precision': 0.28010726252913754, 'recall': 0.2437950937950938, 'f1-score': 0.2569148584125183, 'support': 781}, 'weighted avg': {'precision': 0.2800361500295479, 'recall': 0.24455825864276567, 'f1-score': 0.2573253619005195, 'support': 781}}
Wrong BIO-Encoding 9/685 labels, 1.31%
Test-Data: Prec: 0.283, Rec: 0.245, F1: 0.2622

Scores from epoch with best dev-scores:
  Dev-Score: 0.6491
  Test-Score 0.2294

4.26 sec for evaluation

--------- Epoch 46 -----------
334.04 sec for training (15072.10 total)
-- cmv_modes1 --
{'C': {'precision': 0.56, 'recall': 0.5, 'f1-score': 0.5283018867924528, 'support': 28}, 'P': {'precision': 0.7586206896551724, 'recall': 0.6875, 'f1-score': 0.7213114754098361, 'support': 32}, 'micro avg': {'precision': 0.6666666666666666, 'recall': 0.6, 'f1-score': 0.631578947368421, 'support': 60}, 'macro avg': {'precision': 0.6593103448275862, 'recall': 0.59375, 'f1-score': 0.6248066811011445, 'support': 60}, 'weighted avg': {'precision': 0.6659310344827586, 'recall': 0.6, 'f1-score': 0.6312403340550572, 'support': 60}}
{'C': {'precision': 0.56, 'recall': 0.5, 'f1-score': 0.5283018867924528, 'support': 28}, 'P': {'precision': 0.7586206896551724, 'recall': 0.6875, 'f1-score': 0.7213114754098361, 'support': 32}, 'micro avg': {'precision': 0.6666666666666666, 'recall': 0.6, 'f1-score': 0.631578947368421, 'support': 60}, 'macro avg': {'precision': 0.6593103448275862, 'recall': 0.59375, 'f1-score': 0.6248066811011445, 'support': 60}, 'weighted avg': {'precision': 0.6659310344827586, 'recall': 0.6, 'f1-score': 0.6312403340550572, 'support': 60}}
Dev-Data: Prec: 0.667, Rec: 0.600, F1: 0.6316
{'C': {'precision': 0.25477707006369427, 'recall': 0.2077922077922078, 'f1-score': 0.22889842632331903, 'support': 385}, 'P': {'precision': 0.2823529411764706, 'recall': 0.30303030303030304, 'f1-score': 0.29232643118148594, 'support': 396}, 'micro avg': {'precision': 0.2706359945872801, 'recall': 0.2560819462227913, 'f1-score': 0.26315789473684215, 'support': 781}, 'macro avg': {'precision': 0.26856500562008245, 'recall': 0.2554112554112554, 'f1-score': 0.2606124287524025, 'support': 781}, 'weighted avg': {'precision': 0.2687592018955245, 'recall': 0.2560819462227913, 'f1-score': 0.26105910484295297, 'support': 781}}
Wrong BIO-Encoding 81/812 labels, 9.98%
{'C': {'precision': 0.25477707006369427, 'recall': 0.2077922077922078, 'f1-score': 0.22889842632331903, 'support': 385}, 'P': {'precision': 0.2823529411764706, 'recall': 0.30303030303030304, 'f1-score': 0.29232643118148594, 'support': 396}, 'micro avg': {'precision': 0.2706359945872801, 'recall': 0.2560819462227913, 'f1-score': 0.26315789473684215, 'support': 781}, 'macro avg': {'precision': 0.26856500562008245, 'recall': 0.2554112554112554, 'f1-score': 0.2606124287524025, 'support': 781}, 'weighted avg': {'precision': 0.2687592018955245, 'recall': 0.2560819462227913, 'f1-score': 0.26105910484295297, 'support': 781}}
Wrong BIO-Encoding 8/739 labels, 1.08%
Test-Data: Prec: 0.274, Rec: 0.256, F1: 0.2646

Scores from epoch with best dev-scores:
  Dev-Score: 0.6491
  Test-Score 0.2294

4.36 sec for evaluation

--------- Epoch 47 -----------
330.59 sec for training (15402.69 total)
-- cmv_modes1 --
{'C': {'precision': 0.52, 'recall': 0.4642857142857143, 'f1-score': 0.49056603773584906, 'support': 28}, 'P': {'precision': 0.6428571428571429, 'recall': 0.5625, 'f1-score': 0.6000000000000001, 'support': 32}, 'micro avg': {'precision': 0.5849056603773585, 'recall': 0.5166666666666667, 'f1-score': 0.5486725663716815, 'support': 60}, 'macro avg': {'precision': 0.5814285714285714, 'recall': 0.5133928571428572, 'f1-score': 0.5452830188679245, 'support': 60}, 'weighted avg': {'precision': 0.5855238095238096, 'recall': 0.5166666666666667, 'f1-score': 0.548930817610063, 'support': 60}}
{'C': {'precision': 0.52, 'recall': 0.4642857142857143, 'f1-score': 0.49056603773584906, 'support': 28}, 'P': {'precision': 0.6428571428571429, 'recall': 0.5625, 'f1-score': 0.6000000000000001, 'support': 32}, 'micro avg': {'precision': 0.5849056603773585, 'recall': 0.5166666666666667, 'f1-score': 0.5486725663716815, 'support': 60}, 'macro avg': {'precision': 0.5814285714285714, 'recall': 0.5133928571428572, 'f1-score': 0.5452830188679245, 'support': 60}, 'weighted avg': {'precision': 0.5855238095238096, 'recall': 0.5166666666666667, 'f1-score': 0.548930817610063, 'support': 60}}
Dev-Data: Prec: 0.585, Rec: 0.517, F1: 0.5487
{'C': {'precision': 0.25161290322580643, 'recall': 0.2025974025974026, 'f1-score': 0.22446043165467625, 'support': 385}, 'P': {'precision': 0.2664835164835165, 'recall': 0.24494949494949494, 'f1-score': 0.2552631578947368, 'support': 396}, 'micro avg': {'precision': 0.2596439169139466, 'recall': 0.22407170294494239, 'f1-score': 0.24054982817869416, 'support': 781}, 'macro avg': {'precision': 0.2590482098546615, 'recall': 0.2237734487734488, 'f1-score': 0.23986179477470654, 'support': 781}, 'weighted avg': {'precision': 0.2591529324832369, 'recall': 0.22407170294494239, 'f1-score': 0.24007871538203088, 'support': 781}}
Wrong BIO-Encoding 145/809 labels, 17.92%
{'C': {'precision': 0.25161290322580643, 'recall': 0.2025974025974026, 'f1-score': 0.22446043165467625, 'support': 385}, 'P': {'precision': 0.2664835164835165, 'recall': 0.24494949494949494, 'f1-score': 0.2552631578947368, 'support': 396}, 'micro avg': {'precision': 0.2596439169139466, 'recall': 0.22407170294494239, 'f1-score': 0.24054982817869416, 'support': 781}, 'macro avg': {'precision': 0.2590482098546615, 'recall': 0.2237734487734488, 'f1-score': 0.23986179477470654, 'support': 781}, 'weighted avg': {'precision': 0.2591529324832369, 'recall': 0.22407170294494239, 'f1-score': 0.24007871538203088, 'support': 781}}
Wrong BIO-Encoding 10/674 labels, 1.48%
Test-Data: Prec: 0.264, Rec: 0.224, F1: 0.2422

Scores from epoch with best dev-scores:
  Dev-Score: 0.6491
  Test-Score 0.2294

4.63 sec for evaluation

--------- Epoch 48 -----------
327.12 sec for training (15729.81 total)
-- cmv_modes1 --
{'C': {'precision': 0.7037037037037037, 'recall': 0.6785714285714286, 'f1-score': 0.6909090909090909, 'support': 28}, 'P': {'precision': 0.7142857142857143, 'recall': 0.625, 'f1-score': 0.6666666666666666, 'support': 32}, 'micro avg': {'precision': 0.7090909090909091, 'recall': 0.65, 'f1-score': 0.6782608695652174, 'support': 60}, 'macro avg': {'precision': 0.7089947089947091, 'recall': 0.6517857142857143, 'f1-score': 0.6787878787878787, 'support': 60}, 'weighted avg': {'precision': 0.709347442680776, 'recall': 0.65, 'f1-score': 0.6779797979797979, 'support': 60}}
{'C': {'precision': 0.7037037037037037, 'recall': 0.6785714285714286, 'f1-score': 0.6909090909090909, 'support': 28}, 'P': {'precision': 0.7142857142857143, 'recall': 0.625, 'f1-score': 0.6666666666666666, 'support': 32}, 'micro avg': {'precision': 0.7090909090909091, 'recall': 0.65, 'f1-score': 0.6782608695652174, 'support': 60}, 'macro avg': {'precision': 0.7089947089947091, 'recall': 0.6517857142857143, 'f1-score': 0.6787878787878787, 'support': 60}, 'weighted avg': {'precision': 0.709347442680776, 'recall': 0.65, 'f1-score': 0.6779797979797979, 'support': 60}}
Dev-Data: Prec: 0.709, Rec: 0.650, F1: 0.6783
{'C': {'precision': 0.25, 'recall': 0.23376623376623376, 'f1-score': 0.24161073825503357, 'support': 385}, 'P': {'precision': 0.3050314465408805, 'recall': 0.24494949494949494, 'f1-score': 0.27170868347338933, 'support': 396}, 'micro avg': {'precision': 0.275811209439528, 'recall': 0.23943661971830985, 'f1-score': 0.25633995887594246, 'support': 781}, 'macro avg': {'precision': 0.2775157232704403, 'recall': 0.23935786435786435, 'f1-score': 0.25665971086421147, 'support': 781}, 'weighted avg': {'precision': 0.2779032686686154, 'recall': 0.23943661971830985, 'f1-score': 0.2568716682249041, 'support': 781}}
Wrong BIO-Encoding 194/859 labels, 22.58%
{'C': {'precision': 0.25, 'recall': 0.23376623376623376, 'f1-score': 0.24161073825503357, 'support': 385}, 'P': {'precision': 0.3050314465408805, 'recall': 0.24494949494949494, 'f1-score': 0.27170868347338933, 'support': 396}, 'micro avg': {'precision': 0.275811209439528, 'recall': 0.23943661971830985, 'f1-score': 0.25633995887594246, 'support': 781}, 'macro avg': {'precision': 0.2775157232704403, 'recall': 0.23935786435786435, 'f1-score': 0.25665971086421147, 'support': 781}, 'weighted avg': {'precision': 0.2779032686686154, 'recall': 0.23943661971830985, 'f1-score': 0.2568716682249041, 'support': 781}}
Wrong BIO-Encoding 13/678 labels, 1.92%
Test-Data: Prec: 0.281, Rec: 0.239, F1: 0.2586

Scores from epoch with best dev-scores:
  Dev-Score: 0.6783
  Test-Score 0.2586

4.56 sec for evaluation

--------- Epoch 49 -----------
336.31 sec for training (16066.12 total)
-- cmv_modes1 --
{'C': {'precision': 0.65, 'recall': 0.4642857142857143, 'f1-score': 0.5416666666666667, 'support': 28}, 'P': {'precision': 0.71875, 'recall': 0.71875, 'f1-score': 0.71875, 'support': 32}, 'micro avg': {'precision': 0.6923076923076923, 'recall': 0.6, 'f1-score': 0.6428571428571429, 'support': 60}, 'macro avg': {'precision': 0.684375, 'recall': 0.5915178571428572, 'f1-score': 0.6302083333333334, 'support': 60}, 'weighted avg': {'precision': 0.6866666666666668, 'recall': 0.6, 'f1-score': 0.6361111111111112, 'support': 60}}
{'C': {'precision': 0.65, 'recall': 0.4642857142857143, 'f1-score': 0.5416666666666667, 'support': 28}, 'P': {'precision': 0.71875, 'recall': 0.71875, 'f1-score': 0.71875, 'support': 32}, 'micro avg': {'precision': 0.6923076923076923, 'recall': 0.6, 'f1-score': 0.6428571428571429, 'support': 60}, 'macro avg': {'precision': 0.684375, 'recall': 0.5915178571428572, 'f1-score': 0.6302083333333334, 'support': 60}, 'weighted avg': {'precision': 0.6866666666666668, 'recall': 0.6, 'f1-score': 0.6361111111111112, 'support': 60}}
Dev-Data: Prec: 0.692, Rec: 0.600, F1: 0.6429
{'C': {'precision': 0.25296442687747034, 'recall': 0.16623376623376623, 'f1-score': 0.2006269592476489, 'support': 385}, 'P': {'precision': 0.2505643340857788, 'recall': 0.2803030303030303, 'f1-score': 0.26460071513706784, 'support': 396}, 'micro avg': {'precision': 0.2514367816091954, 'recall': 0.22407170294494239, 'f1-score': 0.23696682464454977, 'support': 781}, 'macro avg': {'precision': 0.25176438048162453, 'recall': 0.22326839826839825, 'f1-score': 0.23261383719235837, 'support': 781}, 'weighted avg': {'precision': 0.25174747841971123, 'recall': 0.22407170294494239, 'f1-score': 0.23306435660003033, 'support': 781}}
Wrong BIO-Encoding 101/790 labels, 12.78%
{'C': {'precision': 0.25296442687747034, 'recall': 0.16623376623376623, 'f1-score': 0.2006269592476489, 'support': 385}, 'P': {'precision': 0.2505643340857788, 'recall': 0.2803030303030303, 'f1-score': 0.26460071513706784, 'support': 396}, 'micro avg': {'precision': 0.2514367816091954, 'recall': 0.22407170294494239, 'f1-score': 0.23696682464454977, 'support': 781}, 'macro avg': {'precision': 0.25176438048162453, 'recall': 0.22326839826839825, 'f1-score': 0.23261383719235837, 'support': 781}, 'weighted avg': {'precision': 0.25174747841971123, 'recall': 0.22407170294494239, 'f1-score': 0.23306435660003033, 'support': 781}}
Wrong BIO-Encoding 7/696 labels, 1.01%
Test-Data: Prec: 0.254, Rec: 0.224, F1: 0.2381

Scores from epoch with best dev-scores:
  Dev-Score: 0.6783
  Test-Score 0.2586

4.33 sec for evaluation

--------- Epoch 50 -----------
329.67 sec for training (16395.79 total)
-- cmv_modes1 --
{'C': {'precision': 0.6086956521739131, 'recall': 0.5, 'f1-score': 0.5490196078431373, 'support': 28}, 'P': {'precision': 0.7741935483870968, 'recall': 0.75, 'f1-score': 0.7619047619047619, 'support': 32}, 'micro avg': {'precision': 0.7037037037037037, 'recall': 0.6333333333333333, 'f1-score': 0.6666666666666667, 'support': 60}, 'macro avg': {'precision': 0.6914446002805049, 'recall': 0.625, 'f1-score': 0.6554621848739496, 'support': 60}, 'weighted avg': {'precision': 0.6969611968209445, 'recall': 0.6333333333333333, 'f1-score': 0.6625583566760037, 'support': 60}}
{'C': {'precision': 0.6086956521739131, 'recall': 0.5, 'f1-score': 0.5490196078431373, 'support': 28}, 'P': {'precision': 0.7741935483870968, 'recall': 0.75, 'f1-score': 0.7619047619047619, 'support': 32}, 'micro avg': {'precision': 0.7037037037037037, 'recall': 0.6333333333333333, 'f1-score': 0.6666666666666667, 'support': 60}, 'macro avg': {'precision': 0.6914446002805049, 'recall': 0.625, 'f1-score': 0.6554621848739496, 'support': 60}, 'weighted avg': {'precision': 0.6969611968209445, 'recall': 0.6333333333333333, 'f1-score': 0.6625583566760037, 'support': 60}}
Dev-Data: Prec: 0.704, Rec: 0.633, F1: 0.6667
{'C': {'precision': 0.2453416149068323, 'recall': 0.2051948051948052, 'f1-score': 0.22347949080622345, 'support': 385}, 'P': {'precision': 0.25, 'recall': 0.25757575757575757, 'f1-score': 0.2537313432835821, 'support': 396}, 'micro avg': {'precision': 0.24794520547945206, 'recall': 0.23175416133162613, 'f1-score': 0.2395764394440768, 'support': 781}, 'macro avg': {'precision': 0.24767080745341613, 'recall': 0.2313852813852814, 'f1-score': 0.2386054170449028, 'support': 781}, 'weighted avg': {'precision': 0.24770361298224128, 'recall': 0.23175416133162613, 'f1-score': 0.2388184582595321, 'support': 781}}
Wrong BIO-Encoding 119/842 labels, 14.13%
{'C': {'precision': 0.2453416149068323, 'recall': 0.2051948051948052, 'f1-score': 0.22347949080622345, 'support': 385}, 'P': {'precision': 0.25, 'recall': 0.25757575757575757, 'f1-score': 0.2537313432835821, 'support': 396}, 'micro avg': {'precision': 0.24794520547945206, 'recall': 0.23175416133162613, 'f1-score': 0.2395764394440768, 'support': 781}, 'macro avg': {'precision': 0.24767080745341613, 'recall': 0.2313852813852814, 'f1-score': 0.2386054170449028, 'support': 781}, 'weighted avg': {'precision': 0.24770361298224128, 'recall': 0.23175416133162613, 'f1-score': 0.2388184582595321, 'support': 781}}
Wrong BIO-Encoding 7/730 labels, 0.96%
Test-Data: Prec: 0.250, Rec: 0.232, F1: 0.2407

Scores from epoch with best dev-scores:
  Dev-Score: 0.6783
  Test-Score 0.2586

4.41 sec for evaluation
---------RUN 5 ------------
Generate new embeddings files for a dataset
Read file: komninos_english_embeddings.gz
Added words: 12
:: Transform cmv_modes dataset ::
:: Create Train Matrix ::
Unknown-Tokens: 0.85%
:: Create Dev Matrix ::
Unknown-Tokens: 0.81%
:: Create Test Matrix ::
Unknown-Tokens: 0.77%
:: Transform cmv_modes1 dataset ::
:: Create Train Matrix ::
Unknown-Tokens: 0.85%
:: Create Dev Matrix ::
Unknown-Tokens: 0.81%
:: Create Test Matrix ::
Unknown-Tokens: 0.77%
:: Transform cmv_modes2 dataset ::
:: Create Train Matrix ::
Unknown-Tokens: 0.85%
:: Create Dev Matrix ::
Unknown-Tokens: 0.81%
:: Create Test Matrix ::
Unknown-Tokens: 0.77%
DONE - Embeddings file saved: pkl/cmv_modes_cmv_modes1_cmv_modes2_komninos_english_embeddings.pkl
--- cmv_modes ---
364 train sentences
3 dev sentences
92 test sentences
--- cmv_modes1 ---
364 train sentences
3 dev sentences
92 test sentences
--- cmv_modes2 ---
364 train sentences
3 dev sentences
92 test sentences
LSTM-Size: [100]
_____________________________________________________________________________________________________________________________
Layer (type)                             Output Shape               Param #        Connected to                              
=============================================================================================================================
words_input (InputLayer)                 (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
casing_input (InputLayer)                (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
word_embeddings (Embedding)              (None, None, 300)          66695400       words_input[0][0]                         
_____________________________________________________________________________________________________________________________
casing_emebddings (Embedding)            (None, None, 10)           80             casing_input[0][0]                        
_____________________________________________________________________________________________________________________________
concatenate_1 (Concatenate)              (None, None, 310)          0              word_embeddings[0][0]                     
                                                                                   casing_emebddings[0][0]                   
_____________________________________________________________________________________________________________________________
shared_varLSTM_1 (Bidirectional)         (None, None, 200)          328800         concatenate_1[0][0]                       
_____________________________________________________________________________________________________________________________
cmv_modes_hidden_lin_layer (TimeDistribu (None, None, 287)          57687          shared_varLSTM_1[0][0]                    
_____________________________________________________________________________________________________________________________
cmv_modes_crf (ChainCRF)                 (None, None, 287)          82943          cmv_modes_hidden_lin_layer[0][0]          
=============================================================================================================================
Total params: 67,164,910
Trainable params: 469,510
Non-trainable params: 66,695,400
_____________________________________________________________________________________________________________________________
_____________________________________________________________________________________________________________________________
Layer (type)                             Output Shape               Param #        Connected to                              
=============================================================================================================================
words_input (InputLayer)                 (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
casing_input (InputLayer)                (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
word_embeddings (Embedding)              (None, None, 300)          66695400       words_input[0][0]                         
_____________________________________________________________________________________________________________________________
casing_emebddings (Embedding)            (None, None, 10)           80             casing_input[0][0]                        
_____________________________________________________________________________________________________________________________
concatenate_1 (Concatenate)              (None, None, 310)          0              word_embeddings[0][0]                     
                                                                                   casing_emebddings[0][0]                   
_____________________________________________________________________________________________________________________________
shared_varLSTM_1 (Bidirectional)         (None, None, 200)          328800         concatenate_1[0][0]                       
_____________________________________________________________________________________________________________________________
cmv_modes1_hidden_lin_layer (TimeDistrib (None, None, 5)            1005           shared_varLSTM_1[0][0]                    
_____________________________________________________________________________________________________________________________
cmv_modes1_crf (ChainCRF)                (None, None, 5)            35             cmv_modes1_hidden_lin_layer[0][0]         
=============================================================================================================================
Total params: 67,025,320
Trainable params: 329,920
Non-trainable params: 66,695,400
_____________________________________________________________________________________________________________________________
_____________________________________________________________________________________________________________________________
Layer (type)                             Output Shape               Param #        Connected to                              
=============================================================================================================================
words_input (InputLayer)                 (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
casing_input (InputLayer)                (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
word_embeddings (Embedding)              (None, None, 300)          66695400       words_input[0][0]                         
_____________________________________________________________________________________________________________________________
casing_emebddings (Embedding)            (None, None, 10)           80             casing_input[0][0]                        
_____________________________________________________________________________________________________________________________
concatenate_1 (Concatenate)              (None, None, 310)          0              word_embeddings[0][0]                     
                                                                                   casing_emebddings[0][0]                   
_____________________________________________________________________________________________________________________________
shared_varLSTM_1 (Bidirectional)         (None, None, 200)          328800         concatenate_1[0][0]                       
_____________________________________________________________________________________________________________________________
cmv_modes2_softmax (TimeDistributed)     (None, None, 119)          23919          shared_varLSTM_1[0][0]                    
=============================================================================================================================
Total params: 67,048,199
Trainable params: 352,799
Non-trainable params: 66,695,400
_____________________________________________________________________________________________________________________________

--------- Epoch 1 -----------
311.92 sec for training (311.92 total)
-- cmv_modes1 --
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 18}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 21}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 39}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 39}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 39}}
Wrong BIO-Encoding 485/486 labels, 99.79%
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 18}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 21}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 39}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 39}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 39}}
Wrong BIO-Encoding 58/59 labels, 98.31%
Dev-Data: Prec: 0.000, Rec: 0.000, F1: 0.0000
{'C': {'precision': 0.005555555555555556, 'recall': 0.0024875621890547263, 'f1-score': 0.003436426116838488, 'support': 402}, 'P': {'precision': 0.029684601113172542, 'recall': 0.09486166007905138, 'f1-score': 0.04521902967498822, 'support': 506}, 'micro avg': {'precision': 0.027267668336115748, 'recall': 0.053964757709251104, 'f1-score': 0.03622920517560074, 'support': 908}, 'macro avg': {'precision': 0.017620078334364048, 'recall': 0.04867461113405305, 'f1-score': 0.024327727895913354, 'support': 908}, 'weighted avg': {'precision': 0.01900191794779586, 'recall': 0.053964757709251104, 'f1-score': 0.026720564223032057, 'support': 908}}
Wrong BIO-Encoding 17346/17365 labels, 99.89%
{'C': {'precision': 0.005555555555555556, 'recall': 0.0024875621890547263, 'f1-score': 0.003436426116838488, 'support': 402}, 'P': {'precision': 0.029684601113172542, 'recall': 0.09486166007905138, 'f1-score': 0.04521902967498822, 'support': 506}, 'micro avg': {'precision': 0.027267668336115748, 'recall': 0.053964757709251104, 'f1-score': 0.03622920517560074, 'support': 908}, 'macro avg': {'precision': 0.017620078334364048, 'recall': 0.04867461113405305, 'f1-score': 0.024327727895913354, 'support': 908}, 'weighted avg': {'precision': 0.01900191794779586, 'recall': 0.053964757709251104, 'f1-score': 0.026720564223032057, 'support': 908}}
Wrong BIO-Encoding 1778/1797 labels, 98.94%
Test-Data: Prec: 0.027, Rec: 0.054, F1: 0.0362

Scores from epoch with best dev-scores:
  Dev-Score: 0.0000
  Test-Score 0.0000

6.38 sec for evaluation

--------- Epoch 2 -----------
299.43 sec for training (611.35 total)
-- cmv_modes1 --
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 18}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 21}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 39}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 39}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 39}}
Wrong BIO-Encoding 264/274 labels, 96.35%
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 18}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 21}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 39}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 39}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 39}}
Wrong BIO-Encoding 14/24 labels, 58.33%
Dev-Data: Prec: 0.000, Rec: 0.000, F1: 0.0000
{'C': {'precision': 0.013392857142857142, 'recall': 0.007462686567164179, 'f1-score': 0.009584664536741215, 'support': 402}, 'P': {'precision': 0.00408997955010225, 'recall': 0.003952569169960474, 'f1-score': 0.004020100502512562, 'support': 506}, 'micro avg': {'precision': 0.0070126227208976155, 'recall': 0.005506607929515419, 'f1-score': 0.006169031462060456, 'support': 908}, 'macro avg': {'precision': 0.008741418346479696, 'recall': 0.005707627868562326, 'f1-score': 0.006802382519626889, 'support': 908}, 'weighted avg': {'precision': 0.008208654431476111, 'recall': 0.005506607929515419, 'f1-score': 0.006483707046301019, 'support': 908}}
Wrong BIO-Encoding 12254/12443 labels, 98.48%
{'C': {'precision': 0.013392857142857142, 'recall': 0.007462686567164179, 'f1-score': 0.009584664536741215, 'support': 402}, 'P': {'precision': 0.00408997955010225, 'recall': 0.003952569169960474, 'f1-score': 0.004020100502512562, 'support': 506}, 'micro avg': {'precision': 0.0070126227208976155, 'recall': 0.005506607929515419, 'f1-score': 0.006169031462060456, 'support': 908}, 'macro avg': {'precision': 0.008741418346479696, 'recall': 0.005707627868562326, 'f1-score': 0.006802382519626889, 'support': 908}, 'weighted avg': {'precision': 0.008208654431476111, 'recall': 0.005506607929515419, 'f1-score': 0.006483707046301019, 'support': 908}}
Wrong BIO-Encoding 524/713 labels, 73.49%
Test-Data: Prec: 0.026, Rec: 0.006, F1: 0.0091

Scores from epoch with best dev-scores:
  Dev-Score: 0.0000
  Test-Score 0.0000

5.84 sec for evaluation

--------- Epoch 3 -----------
301.67 sec for training (913.02 total)
-- cmv_modes1 --
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 18}, 'P': {'precision': 0.09090909090909091, 'recall': 0.047619047619047616, 'f1-score': 0.0625, 'support': 21}, 'micro avg': {'precision': 0.07692307692307693, 'recall': 0.02564102564102564, 'f1-score': 0.038461538461538464, 'support': 39}, 'macro avg': {'precision': 0.045454545454545456, 'recall': 0.023809523809523808, 'f1-score': 0.03125, 'support': 39}, 'weighted avg': {'precision': 0.04895104895104895, 'recall': 0.02564102564102564, 'f1-score': 0.03365384615384615, 'support': 39}}
Wrong BIO-Encoding 104/115 labels, 90.43%
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 18}, 'P': {'precision': 0.09090909090909091, 'recall': 0.047619047619047616, 'f1-score': 0.0625, 'support': 21}, 'micro avg': {'precision': 0.07692307692307693, 'recall': 0.02564102564102564, 'f1-score': 0.038461538461538464, 'support': 39}, 'macro avg': {'precision': 0.045454545454545456, 'recall': 0.023809523809523808, 'f1-score': 0.03125, 'support': 39}, 'weighted avg': {'precision': 0.04895104895104895, 'recall': 0.02564102564102564, 'f1-score': 0.03365384615384615, 'support': 39}}
Wrong BIO-Encoding 2/13 labels, 15.38%
Dev-Data: Prec: 0.091, Rec: 0.026, F1: 0.0400
{'C': {'precision': 0.037037037037037035, 'recall': 0.007462686567164179, 'f1-score': 0.012422360248447204, 'support': 402}, 'P': {'precision': 0.01812688821752266, 'recall': 0.011857707509881422, 'f1-score': 0.014336917562724014, 'support': 506}, 'micro avg': {'precision': 0.021844660194174758, 'recall': 0.009911894273127754, 'f1-score': 0.01363636363636364, 'support': 908}, 'macro avg': {'precision': 0.027581962627279848, 'recall': 0.0096601970385228, 'f1-score': 0.01337963890558561, 'support': 908}, 'weighted avg': {'precision': 0.02649900256272616, 'recall': 0.009911894273127754, 'f1-score': 0.013489283157064018, 'support': 908}}
Wrong BIO-Encoding 6016/6319 labels, 95.20%
{'C': {'precision': 0.037037037037037035, 'recall': 0.007462686567164179, 'f1-score': 0.012422360248447204, 'support': 402}, 'P': {'precision': 0.01812688821752266, 'recall': 0.011857707509881422, 'f1-score': 0.014336917562724014, 'support': 506}, 'micro avg': {'precision': 0.021844660194174758, 'recall': 0.009911894273127754, 'f1-score': 0.01363636363636364, 'support': 908}, 'macro avg': {'precision': 0.027581962627279848, 'recall': 0.0096601970385228, 'f1-score': 0.01337963890558561, 'support': 908}, 'weighted avg': {'precision': 0.02649900256272616, 'recall': 0.009911894273127754, 'f1-score': 0.013489283157064018, 'support': 908}}
Wrong BIO-Encoding 109/412 labels, 26.46%
Test-Data: Prec: 0.030, Rec: 0.010, F1: 0.0149

Scores from epoch with best dev-scores:
  Dev-Score: 0.0400
  Test-Score 0.0149

5.74 sec for evaluation

--------- Epoch 4 -----------
296.15 sec for training (1209.16 total)
-- cmv_modes1 --
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 18}, 'P': {'precision': 0.25, 'recall': 0.2857142857142857, 'f1-score': 0.26666666666666666, 'support': 21}, 'micro avg': {'precision': 0.20689655172413793, 'recall': 0.15384615384615385, 'f1-score': 0.17647058823529413, 'support': 39}, 'macro avg': {'precision': 0.125, 'recall': 0.14285714285714285, 'f1-score': 0.13333333333333333, 'support': 39}, 'weighted avg': {'precision': 0.1346153846153846, 'recall': 0.15384615384615385, 'f1-score': 0.14358974358974358, 'support': 39}}
Wrong BIO-Encoding 48/76 labels, 63.16%
{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 18}, 'P': {'precision': 0.25, 'recall': 0.2857142857142857, 'f1-score': 0.26666666666666666, 'support': 21}, 'micro avg': {'precision': 0.20689655172413793, 'recall': 0.15384615384615385, 'f1-score': 0.17647058823529413, 'support': 39}, 'macro avg': {'precision': 0.125, 'recall': 0.14285714285714285, 'f1-score': 0.13333333333333333, 'support': 39}, 'weighted avg': {'precision': 0.1346153846153846, 'recall': 0.15384615384615385, 'f1-score': 0.14358974358974358, 'support': 39}}
Wrong BIO-Encoding 1/29 labels, 3.45%
Dev-Data: Prec: 0.214, Rec: 0.154, F1: 0.1791
{'C': {'precision': 0.08664259927797834, 'recall': 0.05970149253731343, 'f1-score': 0.07069219440353461, 'support': 402}, 'P': {'precision': 0.0888382687927107, 'recall': 0.07707509881422925, 'f1-score': 0.08253968253968254, 'support': 506}, 'micro avg': {'precision': 0.08798882681564246, 'recall': 0.06938325991189427, 'f1-score': 0.07758620689655173, 'support': 908}, 'macro avg': {'precision': 0.08774043403534451, 'recall': 0.06838829567577134, 'f1-score': 0.07661593847160858, 'support': 908}, 'weighted avg': {'precision': 0.08786617722341289, 'recall': 0.06938325991189427, 'f1-score': 0.07729442898160822, 'support': 908}}
Wrong BIO-Encoding 1634/2288 labels, 71.42%
{'C': {'precision': 0.08664259927797834, 'recall': 0.05970149253731343, 'f1-score': 0.07069219440353461, 'support': 402}, 'P': {'precision': 0.0888382687927107, 'recall': 0.07707509881422925, 'f1-score': 0.08253968253968254, 'support': 506}, 'micro avg': {'precision': 0.08798882681564246, 'recall': 0.06938325991189427, 'f1-score': 0.07758620689655173, 'support': 908}, 'macro avg': {'precision': 0.08774043403534451, 'recall': 0.06838829567577134, 'f1-score': 0.07661593847160858, 'support': 908}, 'weighted avg': {'precision': 0.08786617722341289, 'recall': 0.06938325991189427, 'f1-score': 0.07729442898160822, 'support': 908}}
Wrong BIO-Encoding 62/716 labels, 8.66%
Test-Data: Prec: 0.095, Rec: 0.068, F1: 0.0794

Scores from epoch with best dev-scores:
  Dev-Score: 0.1791
  Test-Score 0.0794

5.71 sec for evaluation

--------- Epoch 5 -----------
296.22 sec for training (1505.38 total)
-- cmv_modes1 --
{'C': {'precision': 0.4, 'recall': 0.1111111111111111, 'f1-score': 0.1739130434782609, 'support': 18}, 'P': {'precision': 0.2, 'recall': 0.23809523809523808, 'f1-score': 0.21739130434782608, 'support': 21}, 'micro avg': {'precision': 0.23333333333333334, 'recall': 0.1794871794871795, 'f1-score': 0.20289855072463772, 'support': 39}, 'macro avg': {'precision': 0.30000000000000004, 'recall': 0.1746031746031746, 'f1-score': 0.1956521739130435, 'support': 39}, 'weighted avg': {'precision': 0.2923076923076923, 'recall': 0.1794871794871795, 'f1-score': 0.19732441471571907, 'support': 39}}
Wrong BIO-Encoding 12/41 labels, 29.27%
{'C': {'precision': 0.4, 'recall': 0.1111111111111111, 'f1-score': 0.1739130434782609, 'support': 18}, 'P': {'precision': 0.2, 'recall': 0.23809523809523808, 'f1-score': 0.21739130434782608, 'support': 21}, 'micro avg': {'precision': 0.23333333333333334, 'recall': 0.1794871794871795, 'f1-score': 0.20289855072463772, 'support': 39}, 'macro avg': {'precision': 0.30000000000000004, 'recall': 0.1746031746031746, 'f1-score': 0.1956521739130435, 'support': 39}, 'weighted avg': {'precision': 0.2923076923076923, 'recall': 0.1794871794871795, 'f1-score': 0.19732441471571907, 'support': 39}}
Wrong BIO-Encoding 1/30 labels, 3.33%
Dev-Data: Prec: 0.241, Rec: 0.179, F1: 0.2059
{'C': {'precision': 0.15942028985507245, 'recall': 0.05472636815920398, 'f1-score': 0.08148148148148149, 'support': 402}, 'P': {'precision': 0.1906005221932115, 'recall': 0.2885375494071146, 'f1-score': 0.22955974842767296, 'support': 506}, 'micro avg': {'precision': 0.18584070796460178, 'recall': 0.18502202643171806, 'f1-score': 0.18543046357615894, 'support': 908}, 'macro avg': {'precision': 0.17501040602414197, 'recall': 0.1716319587831593, 'f1-score': 0.15552061495457722, 'support': 908}, 'weighted avg': {'precision': 0.1767960580963702, 'recall': 0.18502202643171806, 'f1-score': 0.16400086812770712, 'support': 908}}
Wrong BIO-Encoding 1192/2032 labels, 58.66%
{'C': {'precision': 0.15942028985507245, 'recall': 0.05472636815920398, 'f1-score': 0.08148148148148149, 'support': 402}, 'P': {'precision': 0.1906005221932115, 'recall': 0.2885375494071146, 'f1-score': 0.22955974842767296, 'support': 506}, 'micro avg': {'precision': 0.18584070796460178, 'recall': 0.18502202643171806, 'f1-score': 0.18543046357615894, 'support': 908}, 'macro avg': {'precision': 0.17501040602414197, 'recall': 0.1716319587831593, 'f1-score': 0.15552061495457722, 'support': 908}, 'weighted avg': {'precision': 0.1767960580963702, 'recall': 0.18502202643171806, 'f1-score': 0.16400086812770712, 'support': 908}}
Wrong BIO-Encoding 64/904 labels, 7.08%
Test-Data: Prec: 0.199, Rec: 0.184, F1: 0.1911

Scores from epoch with best dev-scores:
  Dev-Score: 0.2059
  Test-Score 0.1911

5.88 sec for evaluation

--------- Epoch 6 -----------
296.26 sec for training (1801.64 total)
-- cmv_modes1 --
{'C': {'precision': 0.5, 'recall': 0.1111111111111111, 'f1-score': 0.1818181818181818, 'support': 18}, 'P': {'precision': 0.2903225806451613, 'recall': 0.42857142857142855, 'f1-score': 0.34615384615384615, 'support': 21}, 'micro avg': {'precision': 0.3142857142857143, 'recall': 0.28205128205128205, 'f1-score': 0.29729729729729726, 'support': 39}, 'macro avg': {'precision': 0.3951612903225806, 'recall': 0.2698412698412698, 'f1-score': 0.26398601398601396, 'support': 39}, 'weighted avg': {'precision': 0.38709677419354843, 'recall': 0.28205128205128205, 'f1-score': 0.2703066164604626, 'support': 39}}
Wrong BIO-Encoding 11/45 labels, 24.44%
{'C': {'precision': 0.5, 'recall': 0.1111111111111111, 'f1-score': 0.1818181818181818, 'support': 18}, 'P': {'precision': 0.2903225806451613, 'recall': 0.42857142857142855, 'f1-score': 0.34615384615384615, 'support': 21}, 'micro avg': {'precision': 0.3142857142857143, 'recall': 0.28205128205128205, 'f1-score': 0.29729729729729726, 'support': 39}, 'macro avg': {'precision': 0.3951612903225806, 'recall': 0.2698412698412698, 'f1-score': 0.26398601398601396, 'support': 39}, 'weighted avg': {'precision': 0.38709677419354843, 'recall': 0.28205128205128205, 'f1-score': 0.2703066164604626, 'support': 39}}
Wrong BIO-Encoding 1/35 labels, 2.86%
Dev-Data: Prec: 0.324, Rec: 0.282, F1: 0.3014
{'C': {'precision': 0.17687074829931973, 'recall': 0.06467661691542288, 'f1-score': 0.09471766848816028, 'support': 402}, 'P': {'precision': 0.1913946587537092, 'recall': 0.2549407114624506, 'f1-score': 0.21864406779661016, 'support': 506}, 'micro avg': {'precision': 0.18879415347137637, 'recall': 0.17070484581497797, 'f1-score': 0.1792943898207056, 'support': 908}, 'macro avg': {'precision': 0.18413270352651445, 'recall': 0.15980866418893674, 'f1-score': 0.15668086814238522, 'support': 908}, 'weighted avg': {'precision': 0.1849644693234619, 'recall': 0.17070484581497797, 'f1-score': 0.16377797471071054, 'support': 908}}
Wrong BIO-Encoding 1366/2107 labels, 64.83%
{'C': {'precision': 0.17687074829931973, 'recall': 0.06467661691542288, 'f1-score': 0.09471766848816028, 'support': 402}, 'P': {'precision': 0.1913946587537092, 'recall': 0.2549407114624506, 'f1-score': 0.21864406779661016, 'support': 506}, 'micro avg': {'precision': 0.18879415347137637, 'recall': 0.17070484581497797, 'f1-score': 0.1792943898207056, 'support': 908}, 'macro avg': {'precision': 0.18413270352651445, 'recall': 0.15980866418893674, 'f1-score': 0.15668086814238522, 'support': 908}, 'weighted avg': {'precision': 0.1849644693234619, 'recall': 0.17070484581497797, 'f1-score': 0.16377797471071054, 'support': 908}}
Wrong BIO-Encoding 80/821 labels, 9.74%
Test-Data: Prec: 0.206, Rec: 0.169, F1: 0.1856

Scores from epoch with best dev-scores:
  Dev-Score: 0.3014
  Test-Score 0.1856

5.87 sec for evaluation

--------- Epoch 7 -----------
296.33 sec for training (2097.97 total)
-- cmv_modes1 --
{'C': {'precision': 0.2857142857142857, 'recall': 0.1111111111111111, 'f1-score': 0.16, 'support': 18}, 'P': {'precision': 0.35714285714285715, 'recall': 0.47619047619047616, 'f1-score': 0.40816326530612246, 'support': 21}, 'micro avg': {'precision': 0.34285714285714286, 'recall': 0.3076923076923077, 'f1-score': 0.3243243243243243, 'support': 39}, 'macro avg': {'precision': 0.3214285714285714, 'recall': 0.2936507936507936, 'f1-score': 0.28408163265306124, 'support': 39}, 'weighted avg': {'precision': 0.3241758241758242, 'recall': 0.3076923076923077, 'f1-score': 0.2936263736263736, 'support': 39}}
{'C': {'precision': 0.2857142857142857, 'recall': 0.1111111111111111, 'f1-score': 0.16, 'support': 18}, 'P': {'precision': 0.35714285714285715, 'recall': 0.47619047619047616, 'f1-score': 0.40816326530612246, 'support': 21}, 'micro avg': {'precision': 0.34285714285714286, 'recall': 0.3076923076923077, 'f1-score': 0.3243243243243243, 'support': 39}, 'macro avg': {'precision': 0.3214285714285714, 'recall': 0.2936507936507936, 'f1-score': 0.28408163265306124, 'support': 39}, 'weighted avg': {'precision': 0.3241758241758242, 'recall': 0.3076923076923077, 'f1-score': 0.2936263736263736, 'support': 39}}
Dev-Data: Prec: 0.343, Rec: 0.308, F1: 0.3243
{'C': {'precision': 0.13425925925925927, 'recall': 0.07213930348258707, 'f1-score': 0.09385113268608414, 'support': 402}, 'P': {'precision': 0.18844566712517194, 'recall': 0.2707509881422925, 'f1-score': 0.2222222222222222, 'support': 506}, 'micro avg': {'precision': 0.176033934252386, 'recall': 0.1828193832599119, 'f1-score': 0.17936250675310644, 'support': 908}, 'macro avg': {'precision': 0.1613524631922156, 'recall': 0.17144514581243978, 'f1-score': 0.15803667745415317, 'support': 908}, 'weighted avg': {'precision': 0.16445564954577008, 'recall': 0.1828193832599119, 'f1-score': 0.16538832575357962, 'support': 908}}
Wrong BIO-Encoding 685/1589 labels, 43.11%
{'C': {'precision': 0.13425925925925927, 'recall': 0.07213930348258707, 'f1-score': 0.09385113268608414, 'support': 402}, 'P': {'precision': 0.18844566712517194, 'recall': 0.2707509881422925, 'f1-score': 0.2222222222222222, 'support': 506}, 'micro avg': {'precision': 0.176033934252386, 'recall': 0.1828193832599119, 'f1-score': 0.17936250675310644, 'support': 908}, 'macro avg': {'precision': 0.1613524631922156, 'recall': 0.17144514581243978, 'f1-score': 0.15803667745415317, 'support': 908}, 'weighted avg': {'precision': 0.16445564954577008, 'recall': 0.1828193832599119, 'f1-score': 0.16538832575357962, 'support': 908}}
Wrong BIO-Encoding 39/943 labels, 4.14%
Test-Data: Prec: 0.184, Rec: 0.183, F1: 0.1832

Scores from epoch with best dev-scores:
  Dev-Score: 0.3243
  Test-Score 0.1832

5.76 sec for evaluation

--------- Epoch 8 -----------
296.58 sec for training (2394.55 total)
-- cmv_modes1 --
{'C': {'precision': 0.4166666666666667, 'recall': 0.2777777777777778, 'f1-score': 0.33333333333333337, 'support': 18}, 'P': {'precision': 0.36363636363636365, 'recall': 0.38095238095238093, 'f1-score': 0.37209302325581395, 'support': 21}, 'micro avg': {'precision': 0.38235294117647056, 'recall': 0.3333333333333333, 'f1-score': 0.35616438356164387, 'support': 39}, 'macro avg': {'precision': 0.39015151515151514, 'recall': 0.32936507936507936, 'f1-score': 0.35271317829457366, 'support': 39}, 'weighted avg': {'precision': 0.3881118881118881, 'recall': 0.3333333333333333, 'f1-score': 0.3542039355992844, 'support': 39}}
{'C': {'precision': 0.4166666666666667, 'recall': 0.2777777777777778, 'f1-score': 0.33333333333333337, 'support': 18}, 'P': {'precision': 0.36363636363636365, 'recall': 0.38095238095238093, 'f1-score': 0.37209302325581395, 'support': 21}, 'micro avg': {'precision': 0.38235294117647056, 'recall': 0.3333333333333333, 'f1-score': 0.35616438356164387, 'support': 39}, 'macro avg': {'precision': 0.39015151515151514, 'recall': 0.32936507936507936, 'f1-score': 0.35271317829457366, 'support': 39}, 'weighted avg': {'precision': 0.3881118881118881, 'recall': 0.3333333333333333, 'f1-score': 0.3542039355992844, 'support': 39}}
Dev-Data: Prec: 0.382, Rec: 0.333, F1: 0.3562
{'C': {'precision': 0.10173697270471464, 'recall': 0.10199004975124377, 'f1-score': 0.10186335403726708, 'support': 402}, 'P': {'precision': 0.21610169491525424, 'recall': 0.2015810276679842, 'f1-score': 0.2085889570552147, 'support': 506}, 'micro avg': {'precision': 0.16342857142857142, 'recall': 0.15748898678414097, 'f1-score': 0.1604038137969714, 'support': 908}, 'macro avg': {'precision': 0.15891933380998444, 'recall': 0.15178553870961398, 'f1-score': 0.1552261555462409, 'support': 908}, 'weighted avg': {'precision': 0.16546885534627084, 'recall': 0.15748898678414097, 'f1-score': 0.16133819448559472, 'support': 908}}
Wrong BIO-Encoding 1039/1869 labels, 55.59%
{'C': {'precision': 0.10173697270471464, 'recall': 0.10199004975124377, 'f1-score': 0.10186335403726708, 'support': 402}, 'P': {'precision': 0.21610169491525424, 'recall': 0.2015810276679842, 'f1-score': 0.2085889570552147, 'support': 506}, 'micro avg': {'precision': 0.16342857142857142, 'recall': 0.15748898678414097, 'f1-score': 0.1604038137969714, 'support': 908}, 'macro avg': {'precision': 0.15891933380998444, 'recall': 0.15178553870961398, 'f1-score': 0.1552261555462409, 'support': 908}, 'weighted avg': {'precision': 0.16546885534627084, 'recall': 0.15748898678414097, 'f1-score': 0.16133819448559472, 'support': 908}}
Wrong BIO-Encoding 45/875 labels, 5.14%
Test-Data: Prec: 0.172, Rec: 0.157, F1: 0.1646

Scores from epoch with best dev-scores:
  Dev-Score: 0.3562
  Test-Score 0.1646

5.74 sec for evaluation

--------- Epoch 9 -----------
292.22 sec for training (2686.78 total)
-- cmv_modes1 --
{'C': {'precision': 0.3125, 'recall': 0.2777777777777778, 'f1-score': 0.29411764705882354, 'support': 18}, 'P': {'precision': 0.47058823529411764, 'recall': 0.38095238095238093, 'f1-score': 0.42105263157894735, 'support': 21}, 'micro avg': {'precision': 0.3939393939393939, 'recall': 0.3333333333333333, 'f1-score': 0.36111111111111105, 'support': 39}, 'macro avg': {'precision': 0.3915441176470588, 'recall': 0.32936507936507936, 'f1-score': 0.35758513931888547, 'support': 39}, 'weighted avg': {'precision': 0.3976244343891403, 'recall': 0.3333333333333333, 'f1-score': 0.3624672541081209, 'support': 39}}
{'C': {'precision': 0.3125, 'recall': 0.2777777777777778, 'f1-score': 0.29411764705882354, 'support': 18}, 'P': {'precision': 0.47058823529411764, 'recall': 0.38095238095238093, 'f1-score': 0.42105263157894735, 'support': 21}, 'micro avg': {'precision': 0.3939393939393939, 'recall': 0.3333333333333333, 'f1-score': 0.36111111111111105, 'support': 39}, 'macro avg': {'precision': 0.3915441176470588, 'recall': 0.32936507936507936, 'f1-score': 0.35758513931888547, 'support': 39}, 'weighted avg': {'precision': 0.3976244343891403, 'recall': 0.3333333333333333, 'f1-score': 0.3624672541081209, 'support': 39}}
Dev-Data: Prec: 0.394, Rec: 0.333, F1: 0.3611
{'C': {'precision': 0.13846153846153847, 'recall': 0.15671641791044777, 'f1-score': 0.14702450408401402, 'support': 402}, 'P': {'precision': 0.2255125284738041, 'recall': 0.1956521739130435, 'f1-score': 0.20952380952380956, 'support': 506}, 'micro avg': {'precision': 0.18120805369127516, 'recall': 0.17841409691629956, 'f1-score': 0.17980022197558265, 'support': 908}, 'macro avg': {'precision': 0.18198703346767128, 'recall': 0.17618429591174561, 'f1-score': 0.1782741568039118, 'support': 908}, 'weighted avg': {'precision': 0.18697233245515787, 'recall': 0.17841409691629956, 'f1-score': 0.18185341218152123, 'support': 908}}
Wrong BIO-Encoding 721/1576 labels, 45.75%
{'C': {'precision': 0.13846153846153847, 'recall': 0.15671641791044777, 'f1-score': 0.14702450408401402, 'support': 402}, 'P': {'precision': 0.2255125284738041, 'recall': 0.1956521739130435, 'f1-score': 0.20952380952380956, 'support': 506}, 'micro avg': {'precision': 0.18120805369127516, 'recall': 0.17841409691629956, 'f1-score': 0.17980022197558265, 'support': 908}, 'macro avg': {'precision': 0.18198703346767128, 'recall': 0.17618429591174561, 'f1-score': 0.1782741568039118, 'support': 908}, 'weighted avg': {'precision': 0.18697233245515787, 'recall': 0.17841409691629956, 'f1-score': 0.18185341218152123, 'support': 908}}
Wrong BIO-Encoding 39/894 labels, 4.36%
Test-Data: Prec: 0.189, Rec: 0.178, F1: 0.1838

Scores from epoch with best dev-scores:
  Dev-Score: 0.3611
  Test-Score 0.1838

5.90 sec for evaluation

--------- Epoch 10 -----------
304.37 sec for training (2991.15 total)
-- cmv_modes1 --
{'C': {'precision': 0.25, 'recall': 0.3888888888888889, 'f1-score': 0.30434782608695654, 'support': 18}, 'P': {'precision': 0.5, 'recall': 0.14285714285714285, 'f1-score': 0.22222222222222224, 'support': 21}, 'micro avg': {'precision': 0.29411764705882354, 'recall': 0.2564102564102564, 'f1-score': 0.273972602739726, 'support': 39}, 'macro avg': {'precision': 0.375, 'recall': 0.26587301587301587, 'f1-score': 0.2632850241545894, 'support': 39}, 'weighted avg': {'precision': 0.38461538461538464, 'recall': 0.2564102564102564, 'f1-score': 0.26012634708286886, 'support': 39}}
{'C': {'precision': 0.25, 'recall': 0.3888888888888889, 'f1-score': 0.30434782608695654, 'support': 18}, 'P': {'precision': 0.5, 'recall': 0.14285714285714285, 'f1-score': 0.22222222222222224, 'support': 21}, 'micro avg': {'precision': 0.29411764705882354, 'recall': 0.2564102564102564, 'f1-score': 0.273972602739726, 'support': 39}, 'macro avg': {'precision': 0.375, 'recall': 0.26587301587301587, 'f1-score': 0.2632850241545894, 'support': 39}, 'weighted avg': {'precision': 0.38461538461538464, 'recall': 0.2564102564102564, 'f1-score': 0.26012634708286886, 'support': 39}}
Dev-Data: Prec: 0.294, Rec: 0.256, F1: 0.2740
{'C': {'precision': 0.12698412698412698, 'recall': 0.19900497512437812, 'f1-score': 0.1550387596899225, 'support': 402}, 'P': {'precision': 0.15584415584415584, 'recall': 0.04743083003952569, 'f1-score': 0.07272727272727272, 'support': 506}, 'micro avg': {'precision': 0.1326530612244898, 'recall': 0.1145374449339207, 'f1-score': 0.12293144208037825, 'support': 908}, 'macro avg': {'precision': 0.1414141414141414, 'recall': 0.12321790258195191, 'f1-score': 0.11388301620859761, 'support': 908}, 'weighted avg': {'precision': 0.14306691839731486, 'recall': 0.1145374449339207, 'f1-score': 0.1091691425058908, 'support': 908}}
Wrong BIO-Encoding 482/1241 labels, 38.84%
{'C': {'precision': 0.12698412698412698, 'recall': 0.19900497512437812, 'f1-score': 0.1550387596899225, 'support': 402}, 'P': {'precision': 0.15584415584415584, 'recall': 0.04743083003952569, 'f1-score': 0.07272727272727272, 'support': 506}, 'micro avg': {'precision': 0.1326530612244898, 'recall': 0.1145374449339207, 'f1-score': 0.12293144208037825, 'support': 908}, 'macro avg': {'precision': 0.1414141414141414, 'recall': 0.12321790258195191, 'f1-score': 0.11388301620859761, 'support': 908}, 'weighted avg': {'precision': 0.14306691839731486, 'recall': 0.1145374449339207, 'f1-score': 0.1091691425058908, 'support': 908}}
Wrong BIO-Encoding 25/784 labels, 3.19%
Test-Data: Prec: 0.137, Rec: 0.115, F1: 0.1248

Scores from epoch with best dev-scores:
  Dev-Score: 0.3611
  Test-Score 0.1838

5.65 sec for evaluation

--------- Epoch 11 -----------
297.11 sec for training (3288.26 total)
-- cmv_modes1 --
{'C': {'precision': 0.35, 'recall': 0.3888888888888889, 'f1-score': 0.36842105263157887, 'support': 18}, 'P': {'precision': 0.4666666666666667, 'recall': 0.3333333333333333, 'f1-score': 0.3888888888888889, 'support': 21}, 'micro avg': {'precision': 0.4, 'recall': 0.358974358974359, 'f1-score': 0.37837837837837845, 'support': 39}, 'macro avg': {'precision': 0.4083333333333333, 'recall': 0.3611111111111111, 'f1-score': 0.3786549707602339, 'support': 39}, 'weighted avg': {'precision': 0.41282051282051285, 'recall': 0.358974358974359, 'f1-score': 0.37944219523166883, 'support': 39}}
{'C': {'precision': 0.35, 'recall': 0.3888888888888889, 'f1-score': 0.36842105263157887, 'support': 18}, 'P': {'precision': 0.4666666666666667, 'recall': 0.3333333333333333, 'f1-score': 0.3888888888888889, 'support': 21}, 'micro avg': {'precision': 0.4, 'recall': 0.358974358974359, 'f1-score': 0.37837837837837845, 'support': 39}, 'macro avg': {'precision': 0.4083333333333333, 'recall': 0.3611111111111111, 'f1-score': 0.3786549707602339, 'support': 39}, 'weighted avg': {'precision': 0.41282051282051285, 'recall': 0.358974358974359, 'f1-score': 0.37944219523166883, 'support': 39}}
Dev-Data: Prec: 0.400, Rec: 0.359, F1: 0.3784
{'C': {'precision': 0.12980769230769232, 'recall': 0.20149253731343283, 'f1-score': 0.15789473684210528, 'support': 402}, 'P': {'precision': 0.23461538461538461, 'recall': 0.12055335968379446, 'f1-score': 0.15926892950391644, 'support': 506}, 'micro avg': {'precision': 0.16063348416289594, 'recall': 0.15638766519823788, 'f1-score': 0.15848214285714288, 'support': 908}, 'macro avg': {'precision': 0.18221153846153848, 'recall': 0.16102294849861365, 'f1-score': 0.15858183317301086, 'support': 908}, 'weighted avg': {'precision': 0.18821374110471029, 'recall': 0.15638766519823788, 'f1-score': 0.15866053143117625, 'support': 908}}
Wrong BIO-Encoding 611/1470 labels, 41.56%
{'C': {'precision': 0.12980769230769232, 'recall': 0.20149253731343283, 'f1-score': 0.15789473684210528, 'support': 402}, 'P': {'precision': 0.23461538461538461, 'recall': 0.12055335968379446, 'f1-score': 0.15926892950391644, 'support': 506}, 'micro avg': {'precision': 0.16063348416289594, 'recall': 0.15638766519823788, 'f1-score': 0.15848214285714288, 'support': 908}, 'macro avg': {'precision': 0.18221153846153848, 'recall': 0.16102294849861365, 'f1-score': 0.15858183317301086, 'support': 908}, 'weighted avg': {'precision': 0.18821374110471029, 'recall': 0.15638766519823788, 'f1-score': 0.15866053143117625, 'support': 908}}
Wrong BIO-Encoding 25/884 labels, 2.83%
Test-Data: Prec: 0.165, Rec: 0.156, F1: 0.1607

Scores from epoch with best dev-scores:
  Dev-Score: 0.3784
  Test-Score 0.1607

6.58 sec for evaluation

--------- Epoch 12 -----------
354.93 sec for training (3643.20 total)
-- cmv_modes1 --
{'C': {'precision': 0.6363636363636364, 'recall': 0.3888888888888889, 'f1-score': 0.4827586206896552, 'support': 18}, 'P': {'precision': 0.2777777777777778, 'recall': 0.23809523809523808, 'f1-score': 0.25641025641025644, 'support': 21}, 'micro avg': {'precision': 0.41379310344827586, 'recall': 0.3076923076923077, 'f1-score': 0.35294117647058826, 'support': 39}, 'macro avg': {'precision': 0.45707070707070707, 'recall': 0.3134920634920635, 'f1-score': 0.3695844385499558, 'support': 39}, 'weighted avg': {'precision': 0.4432789432789433, 'recall': 0.3076923076923077, 'f1-score': 0.3608787322315174, 'support': 39}}
{'C': {'precision': 0.6363636363636364, 'recall': 0.3888888888888889, 'f1-score': 0.4827586206896552, 'support': 18}, 'P': {'precision': 0.2777777777777778, 'recall': 0.23809523809523808, 'f1-score': 0.25641025641025644, 'support': 21}, 'micro avg': {'precision': 0.41379310344827586, 'recall': 0.3076923076923077, 'f1-score': 0.35294117647058826, 'support': 39}, 'macro avg': {'precision': 0.45707070707070707, 'recall': 0.3134920634920635, 'f1-score': 0.3695844385499558, 'support': 39}, 'weighted avg': {'precision': 0.4432789432789433, 'recall': 0.3076923076923077, 'f1-score': 0.3608787322315174, 'support': 39}}
Dev-Data: Prec: 0.414, Rec: 0.308, F1: 0.3529
{'C': {'precision': 0.1652892561983471, 'recall': 0.09950248756218906, 'f1-score': 0.12422360248447205, 'support': 402}, 'P': {'precision': 0.22244897959183674, 'recall': 0.21541501976284586, 'f1-score': 0.21887550200803216, 'support': 506}, 'micro avg': {'precision': 0.20355191256830601, 'recall': 0.16409691629955947, 'f1-score': 0.18170731707317073, 'support': 908}, 'macro avg': {'precision': 0.19386911789509192, 'recall': 0.15745875366251746, 'f1-score': 0.1715495522462521, 'support': 908}, 'weighted avg': {'precision': 0.1971425822304019, 'recall': 0.16409691629955947, 'f1-score': 0.1769701456110375, 'support': 908}}
Wrong BIO-Encoding 456/1164 labels, 39.18%
{'C': {'precision': 0.1652892561983471, 'recall': 0.09950248756218906, 'f1-score': 0.12422360248447205, 'support': 402}, 'P': {'precision': 0.22244897959183674, 'recall': 0.21541501976284586, 'f1-score': 0.21887550200803216, 'support': 506}, 'micro avg': {'precision': 0.20355191256830601, 'recall': 0.16409691629955947, 'f1-score': 0.18170731707317073, 'support': 908}, 'macro avg': {'precision': 0.19386911789509192, 'recall': 0.15745875366251746, 'f1-score': 0.1715495522462521, 'support': 908}, 'weighted avg': {'precision': 0.1971425822304019, 'recall': 0.16409691629955947, 'f1-score': 0.1769701456110375, 'support': 908}}
Wrong BIO-Encoding 24/732 labels, 3.28%
Test-Data: Prec: 0.210, Rec: 0.164, F1: 0.1844

Scores from epoch with best dev-scores:
  Dev-Score: 0.3784
  Test-Score 0.1607

6.49 sec for evaluation

--------- Epoch 13 -----------
347.34 sec for training (3990.53 total)
-- cmv_modes1 --
{'C': {'precision': 0.45454545454545453, 'recall': 0.2777777777777778, 'f1-score': 0.3448275862068966, 'support': 18}, 'P': {'precision': 0.2608695652173913, 'recall': 0.2857142857142857, 'f1-score': 0.2727272727272727, 'support': 21}, 'micro avg': {'precision': 0.3235294117647059, 'recall': 0.28205128205128205, 'f1-score': 0.3013698630136986, 'support': 39}, 'macro avg': {'precision': 0.3577075098814229, 'recall': 0.28174603174603174, 'f1-score': 0.30877742946708464, 'support': 39}, 'weighted avg': {'precision': 0.3502584372149589, 'recall': 0.28205128205128205, 'f1-score': 0.3060043404870991, 'support': 39}}
{'C': {'precision': 0.45454545454545453, 'recall': 0.2777777777777778, 'f1-score': 0.3448275862068966, 'support': 18}, 'P': {'precision': 0.2608695652173913, 'recall': 0.2857142857142857, 'f1-score': 0.2727272727272727, 'support': 21}, 'micro avg': {'precision': 0.3235294117647059, 'recall': 0.28205128205128205, 'f1-score': 0.3013698630136986, 'support': 39}, 'macro avg': {'precision': 0.3577075098814229, 'recall': 0.28174603174603174, 'f1-score': 0.30877742946708464, 'support': 39}, 'weighted avg': {'precision': 0.3502584372149589, 'recall': 0.28205128205128205, 'f1-score': 0.3060043404870991, 'support': 39}}
Dev-Data: Prec: 0.324, Rec: 0.282, F1: 0.3014
{'C': {'precision': 0.1828358208955224, 'recall': 0.12189054726368159, 'f1-score': 0.14626865671641792, 'support': 402}, 'P': {'precision': 0.2063758389261745, 'recall': 0.24308300395256918, 'f1-score': 0.22323049001814882, 'support': 506}, 'micro avg': {'precision': 0.19907407407407407, 'recall': 0.1894273127753304, 'f1-score': 0.19413092550790065, 'support': 908}, 'macro avg': {'precision': 0.19460582991084846, 'recall': 0.18248677560812537, 'f1-score': 0.18474957336728337, 'support': 908}, 'weighted avg': {'precision': 0.1959539366703131, 'recall': 0.1894273127753304, 'f1-score': 0.18915707923918867, 'support': 908}}
Wrong BIO-Encoding 406/1253 labels, 32.40%
{'C': {'precision': 0.1828358208955224, 'recall': 0.12189054726368159, 'f1-score': 0.14626865671641792, 'support': 402}, 'P': {'precision': 0.2063758389261745, 'recall': 0.24308300395256918, 'f1-score': 0.22323049001814882, 'support': 506}, 'micro avg': {'precision': 0.19907407407407407, 'recall': 0.1894273127753304, 'f1-score': 0.19413092550790065, 'support': 908}, 'macro avg': {'precision': 0.19460582991084846, 'recall': 0.18248677560812537, 'f1-score': 0.18474957336728337, 'support': 908}, 'weighted avg': {'precision': 0.1959539366703131, 'recall': 0.1894273127753304, 'f1-score': 0.18915707923918867, 'support': 908}}
Wrong BIO-Encoding 17/864 labels, 1.97%
Test-Data: Prec: 0.203, Rec: 0.189, F1: 0.1960

Scores from epoch with best dev-scores:
  Dev-Score: 0.3784
  Test-Score 0.1607

6.35 sec for evaluation

--------- Epoch 14 -----------
358.75 sec for training (4349.28 total)
-- cmv_modes1 --
{'C': {'precision': 0.5714285714285714, 'recall': 0.4444444444444444, 'f1-score': 0.5, 'support': 18}, 'P': {'precision': 0.5, 'recall': 0.47619047619047616, 'f1-score': 0.4878048780487805, 'support': 21}, 'micro avg': {'precision': 0.5294117647058824, 'recall': 0.46153846153846156, 'f1-score': 0.4931506849315069, 'support': 39}, 'macro avg': {'precision': 0.5357142857142857, 'recall': 0.4603174603174603, 'f1-score': 0.49390243902439024, 'support': 39}, 'weighted avg': {'precision': 0.532967032967033, 'recall': 0.46153846153846156, 'f1-score': 0.49343339587242024, 'support': 39}}
{'C': {'precision': 0.5714285714285714, 'recall': 0.4444444444444444, 'f1-score': 0.5, 'support': 18}, 'P': {'precision': 0.5, 'recall': 0.47619047619047616, 'f1-score': 0.4878048780487805, 'support': 21}, 'micro avg': {'precision': 0.5294117647058824, 'recall': 0.46153846153846156, 'f1-score': 0.4931506849315069, 'support': 39}, 'macro avg': {'precision': 0.5357142857142857, 'recall': 0.4603174603174603, 'f1-score': 0.49390243902439024, 'support': 39}, 'weighted avg': {'precision': 0.532967032967033, 'recall': 0.46153846153846156, 'f1-score': 0.49343339587242024, 'support': 39}}
Dev-Data: Prec: 0.529, Rec: 0.462, F1: 0.4932
{'C': {'precision': 0.20608108108108109, 'recall': 0.1517412935323383, 'f1-score': 0.17478510028653296, 'support': 402}, 'P': {'precision': 0.23225806451612904, 'recall': 0.2134387351778656, 'f1-score': 0.22245108135942326, 'support': 506}, 'micro avg': {'precision': 0.22207621550591328, 'recall': 0.18612334801762115, 'f1-score': 0.2025164769322948, 'support': 908}, 'macro avg': {'precision': 0.21916957279860505, 'recall': 0.18259001435510197, 'f1-score': 0.1986180908229781, 'support': 908}, 'weighted avg': {'precision': 0.22066869519796906, 'recall': 0.18612334801762115, 'f1-score': 0.20134786066415686, 'support': 908}}
Wrong BIO-Encoding 409/1147 labels, 35.66%
{'C': {'precision': 0.20608108108108109, 'recall': 0.1517412935323383, 'f1-score': 0.17478510028653296, 'support': 402}, 'P': {'precision': 0.23225806451612904, 'recall': 0.2134387351778656, 'f1-score': 0.22245108135942326, 'support': 506}, 'micro avg': {'precision': 0.22207621550591328, 'recall': 0.18612334801762115, 'f1-score': 0.2025164769322948, 'support': 908}, 'macro avg': {'precision': 0.21916957279860505, 'recall': 0.18259001435510197, 'f1-score': 0.1986180908229781, 'support': 908}, 'weighted avg': {'precision': 0.22066869519796906, 'recall': 0.18612334801762115, 'f1-score': 0.20134786066415686, 'support': 908}}
Wrong BIO-Encoding 23/761 labels, 3.02%
Test-Data: Prec: 0.229, Rec: 0.186, F1: 0.2053

Scores from epoch with best dev-scores:
  Dev-Score: 0.4932
  Test-Score 0.2053

6.32 sec for evaluation

--------- Epoch 15 -----------
344.78 sec for training (4694.06 total)
-- cmv_modes1 --
{'C': {'precision': 0.6666666666666666, 'recall': 0.4444444444444444, 'f1-score': 0.5333333333333333, 'support': 18}, 'P': {'precision': 0.4444444444444444, 'recall': 0.38095238095238093, 'f1-score': 0.41025641025641024, 'support': 21}, 'micro avg': {'precision': 0.5333333333333333, 'recall': 0.41025641025641024, 'f1-score': 0.463768115942029, 'support': 39}, 'macro avg': {'precision': 0.5555555555555556, 'recall': 0.4126984126984127, 'f1-score': 0.4717948717948718, 'support': 39}, 'weighted avg': {'precision': 0.547008547008547, 'recall': 0.41025641025641024, 'f1-score': 0.4670611439842209, 'support': 39}}
{'C': {'precision': 0.6666666666666666, 'recall': 0.4444444444444444, 'f1-score': 0.5333333333333333, 'support': 18}, 'P': {'precision': 0.4444444444444444, 'recall': 0.38095238095238093, 'f1-score': 0.41025641025641024, 'support': 21}, 'micro avg': {'precision': 0.5333333333333333, 'recall': 0.41025641025641024, 'f1-score': 0.463768115942029, 'support': 39}, 'macro avg': {'precision': 0.5555555555555556, 'recall': 0.4126984126984127, 'f1-score': 0.4717948717948718, 'support': 39}, 'weighted avg': {'precision': 0.547008547008547, 'recall': 0.41025641025641024, 'f1-score': 0.4670611439842209, 'support': 39}}
Dev-Data: Prec: 0.533, Rec: 0.410, F1: 0.4638
{'C': {'precision': 0.1646586345381526, 'recall': 0.10199004975124377, 'f1-score': 0.1259600614439324, 'support': 402}, 'P': {'precision': 0.24069478908188585, 'recall': 0.191699604743083, 'f1-score': 0.2134213421342134, 'support': 506}, 'micro avg': {'precision': 0.2116564417177914, 'recall': 0.15198237885462554, 'f1-score': 0.1769230769230769, 'support': 908}, 'macro avg': {'precision': 0.20267671181001923, 'recall': 0.14684482724716338, 'f1-score': 0.16969070178907292, 'support': 908}, 'weighted avg': {'precision': 0.2070312052420392, 'recall': 0.15198237885462554, 'f1-score': 0.17469949759952952, 'support': 908}}
Wrong BIO-Encoding 841/1454 labels, 57.84%
{'C': {'precision': 0.1646586345381526, 'recall': 0.10199004975124377, 'f1-score': 0.1259600614439324, 'support': 402}, 'P': {'precision': 0.24069478908188585, 'recall': 0.191699604743083, 'f1-score': 0.2134213421342134, 'support': 506}, 'micro avg': {'precision': 0.2116564417177914, 'recall': 0.15198237885462554, 'f1-score': 0.1769230769230769, 'support': 908}, 'macro avg': {'precision': 0.20267671181001923, 'recall': 0.14684482724716338, 'f1-score': 0.16969070178907292, 'support': 908}, 'weighted avg': {'precision': 0.2070312052420392, 'recall': 0.15198237885462554, 'f1-score': 0.17469949759952952, 'support': 908}}
Wrong BIO-Encoding 39/652 labels, 5.98%
Test-Data: Prec: 0.225, Rec: 0.152, F1: 0.1815

Scores from epoch with best dev-scores:
  Dev-Score: 0.4932
  Test-Score 0.2053

6.50 sec for evaluation

--------- Epoch 16 -----------
344.66 sec for training (5038.72 total)
-- cmv_modes1 --
{'C': {'precision': 0.3, 'recall': 0.16666666666666666, 'f1-score': 0.21428571428571427, 'support': 18}, 'P': {'precision': 0.36, 'recall': 0.42857142857142855, 'f1-score': 0.391304347826087, 'support': 21}, 'micro avg': {'precision': 0.34285714285714286, 'recall': 0.3076923076923077, 'f1-score': 0.3243243243243243, 'support': 39}, 'macro avg': {'precision': 0.32999999999999996, 'recall': 0.2976190476190476, 'f1-score': 0.3027950310559006, 'support': 39}, 'weighted avg': {'precision': 0.3323076923076923, 'recall': 0.3076923076923077, 'f1-score': 0.3096034400382226, 'support': 39}}
Wrong BIO-Encoding 8/42 labels, 19.05%
{'C': {'precision': 0.3, 'recall': 0.16666666666666666, 'f1-score': 0.21428571428571427, 'support': 18}, 'P': {'precision': 0.36, 'recall': 0.42857142857142855, 'f1-score': 0.391304347826087, 'support': 21}, 'micro avg': {'precision': 0.34285714285714286, 'recall': 0.3076923076923077, 'f1-score': 0.3243243243243243, 'support': 39}, 'macro avg': {'precision': 0.32999999999999996, 'recall': 0.2976190476190476, 'f1-score': 0.3027950310559006, 'support': 39}, 'weighted avg': {'precision': 0.3323076923076923, 'recall': 0.3076923076923077, 'f1-score': 0.3096034400382226, 'support': 39}}
Wrong BIO-Encoding 1/35 labels, 2.86%
Dev-Data: Prec: 0.353, Rec: 0.308, F1: 0.3288
{'C': {'precision': 0.27586206896551724, 'recall': 0.19900497512437812, 'f1-score': 0.23121387283236997, 'support': 402}, 'P': {'precision': 0.2112676056338028, 'recall': 0.2075098814229249, 'f1-score': 0.20937188434695914, 'support': 506}, 'micro avg': {'precision': 0.23506988564167725, 'recall': 0.20374449339207049, 'f1-score': 0.2182890855457227, 'support': 908}, 'macro avg': {'precision': 0.24356483729966003, 'recall': 0.2032574282736515, 'f1-score': 0.22029287858966456, 'support': 908}, 'weighted avg': {'precision': 0.23986559490621384, 'recall': 0.20374449339207049, 'f1-score': 0.21904201581296698, 'support': 908}}
Wrong BIO-Encoding 475/1238 labels, 38.37%
{'C': {'precision': 0.27586206896551724, 'recall': 0.19900497512437812, 'f1-score': 0.23121387283236997, 'support': 402}, 'P': {'precision': 0.2112676056338028, 'recall': 0.2075098814229249, 'f1-score': 0.20937188434695914, 'support': 506}, 'micro avg': {'precision': 0.23506988564167725, 'recall': 0.20374449339207049, 'f1-score': 0.2182890855457227, 'support': 908}, 'macro avg': {'precision': 0.24356483729966003, 'recall': 0.2032574282736515, 'f1-score': 0.22029287858966456, 'support': 908}, 'weighted avg': {'precision': 0.23986559490621384, 'recall': 0.20374449339207049, 'f1-score': 0.21904201581296698, 'support': 908}}
Wrong BIO-Encoding 24/787 labels, 3.05%
Test-Data: Prec: 0.242, Rec: 0.204, F1: 0.2214

Scores from epoch with best dev-scores:
  Dev-Score: 0.4932
  Test-Score 0.2053

6.69 sec for evaluation

--------- Epoch 17 -----------
349.91 sec for training (5388.64 total)
-- cmv_modes1 --
{'C': {'precision': 0.5, 'recall': 0.2777777777777778, 'f1-score': 0.35714285714285715, 'support': 18}, 'P': {'precision': 0.46153846153846156, 'recall': 0.5714285714285714, 'f1-score': 0.5106382978723405, 'support': 21}, 'micro avg': {'precision': 0.4722222222222222, 'recall': 0.4358974358974359, 'f1-score': 0.45333333333333337, 'support': 39}, 'macro avg': {'precision': 0.4807692307692308, 'recall': 0.4246031746031746, 'f1-score': 0.43389057750759885, 'support': 39}, 'weighted avg': {'precision': 0.47928994082840237, 'recall': 0.4358974358974359, 'f1-score': 0.43979424830488667, 'support': 39}}
Wrong BIO-Encoding 8/43 labels, 18.60%
{'C': {'precision': 0.5, 'recall': 0.2777777777777778, 'f1-score': 0.35714285714285715, 'support': 18}, 'P': {'precision': 0.46153846153846156, 'recall': 0.5714285714285714, 'f1-score': 0.5106382978723405, 'support': 21}, 'micro avg': {'precision': 0.4722222222222222, 'recall': 0.4358974358974359, 'f1-score': 0.45333333333333337, 'support': 39}, 'macro avg': {'precision': 0.4807692307692308, 'recall': 0.4246031746031746, 'f1-score': 0.43389057750759885, 'support': 39}, 'weighted avg': {'precision': 0.47928994082840237, 'recall': 0.4358974358974359, 'f1-score': 0.43979424830488667, 'support': 39}}
Wrong BIO-Encoding 1/36 labels, 2.78%
Dev-Data: Prec: 0.486, Rec: 0.436, F1: 0.4595
{'C': {'precision': 0.24925816023738873, 'recall': 0.208955223880597, 'f1-score': 0.2273342354533153, 'support': 402}, 'P': {'precision': 0.22178217821782178, 'recall': 0.22134387351778656, 'f1-score': 0.2215628090999011, 'support': 506}, 'micro avg': {'precision': 0.2327790973871734, 'recall': 0.21585903083700442, 'f1-score': 0.224, 'support': 908}, 'macro avg': {'precision': 0.23552016922760527, 'recall': 0.21514954869919178, 'f1-score': 0.2244485222766082, 'support': 908}, 'weighted avg': {'precision': 0.2339466548388195, 'recall': 0.21585903083700442, 'f1-score': 0.22411800006253602, 'support': 908}}
Wrong BIO-Encoding 194/1022 labels, 18.98%
{'C': {'precision': 0.24925816023738873, 'recall': 0.208955223880597, 'f1-score': 0.2273342354533153, 'support': 402}, 'P': {'precision': 0.22178217821782178, 'recall': 0.22134387351778656, 'f1-score': 0.2215628090999011, 'support': 506}, 'micro avg': {'precision': 0.2327790973871734, 'recall': 0.21585903083700442, 'f1-score': 0.224, 'support': 908}, 'macro avg': {'precision': 0.23552016922760527, 'recall': 0.21514954869919178, 'f1-score': 0.2244485222766082, 'support': 908}, 'weighted avg': {'precision': 0.2339466548388195, 'recall': 0.21585903083700442, 'f1-score': 0.22411800006253602, 'support': 908}}
Wrong BIO-Encoding 14/842 labels, 1.66%
Test-Data: Prec: 0.237, Rec: 0.216, F1: 0.2258

Scores from epoch with best dev-scores:
  Dev-Score: 0.4932
  Test-Score 0.2053

6.95 sec for evaluation

--------- Epoch 18 -----------
346.68 sec for training (5735.31 total)
-- cmv_modes1 --
{'C': {'precision': 0.5, 'recall': 0.5, 'f1-score': 0.5, 'support': 18}, 'P': {'precision': 0.4166666666666667, 'recall': 0.23809523809523808, 'f1-score': 0.30303030303030304, 'support': 21}, 'micro avg': {'precision': 0.4666666666666667, 'recall': 0.358974358974359, 'f1-score': 0.40579710144927544, 'support': 39}, 'macro avg': {'precision': 0.45833333333333337, 'recall': 0.36904761904761907, 'f1-score': 0.4015151515151515, 'support': 39}, 'weighted avg': {'precision': 0.4551282051282051, 'recall': 0.358974358974359, 'f1-score': 0.3939393939393939, 'support': 39}}
Wrong BIO-Encoding 6/35 labels, 17.14%
{'C': {'precision': 0.5, 'recall': 0.5, 'f1-score': 0.5, 'support': 18}, 'P': {'precision': 0.4166666666666667, 'recall': 0.23809523809523808, 'f1-score': 0.30303030303030304, 'support': 21}, 'micro avg': {'precision': 0.4666666666666667, 'recall': 0.358974358974359, 'f1-score': 0.40579710144927544, 'support': 39}, 'macro avg': {'precision': 0.45833333333333337, 'recall': 0.36904761904761907, 'f1-score': 0.4015151515151515, 'support': 39}, 'weighted avg': {'precision': 0.4551282051282051, 'recall': 0.358974358974359, 'f1-score': 0.3939393939393939, 'support': 39}}
Wrong BIO-Encoding 1/30 labels, 3.33%
Dev-Data: Prec: 0.483, Rec: 0.359, F1: 0.4118
{'C': {'precision': 0.17782909930715934, 'recall': 0.19154228855721392, 'f1-score': 0.1844311377245509, 'support': 402}, 'P': {'precision': 0.22591362126245848, 'recall': 0.13438735177865613, 'f1-score': 0.16852540272614622, 'support': 506}, 'micro avg': {'precision': 0.19754768392370572, 'recall': 0.15969162995594713, 'f1-score': 0.17661388550548113, 'support': 908}, 'macro avg': {'precision': 0.2018713602848089, 'recall': 0.162964820167935, 'f1-score': 0.17647827022534857, 'support': 908}, 'weighted avg': {'precision': 0.20462509942762339, 'recall': 0.15969162995594713, 'f1-score': 0.17556736910209192, 'support': 908}}
Wrong BIO-Encoding 725/1430 labels, 50.70%
{'C': {'precision': 0.17782909930715934, 'recall': 0.19154228855721392, 'f1-score': 0.1844311377245509, 'support': 402}, 'P': {'precision': 0.22591362126245848, 'recall': 0.13438735177865613, 'f1-score': 0.16852540272614622, 'support': 506}, 'micro avg': {'precision': 0.19754768392370572, 'recall': 0.15969162995594713, 'f1-score': 0.17661388550548113, 'support': 908}, 'macro avg': {'precision': 0.2018713602848089, 'recall': 0.162964820167935, 'f1-score': 0.17647827022534857, 'support': 908}, 'weighted avg': {'precision': 0.20462509942762339, 'recall': 0.15969162995594713, 'f1-score': 0.17556736910209192, 'support': 908}}
Wrong BIO-Encoding 29/734 labels, 3.95%
Test-Data: Prec: 0.206, Rec: 0.160, F1: 0.1798

Scores from epoch with best dev-scores:
  Dev-Score: 0.4932
  Test-Score 0.2053

6.22 sec for evaluation

--------- Epoch 19 -----------
349.91 sec for training (6085.22 total)
-- cmv_modes1 --
{'C': {'precision': 0.5714285714285714, 'recall': 0.6666666666666666, 'f1-score': 0.6153846153846153, 'support': 18}, 'P': {'precision': 0.7142857142857143, 'recall': 0.47619047619047616, 'f1-score': 0.5714285714285714, 'support': 21}, 'micro avg': {'precision': 0.6285714285714286, 'recall': 0.5641025641025641, 'f1-score': 0.5945945945945945, 'support': 39}, 'macro avg': {'precision': 0.6428571428571428, 'recall': 0.5714285714285714, 'f1-score': 0.5934065934065933, 'support': 39}, 'weighted avg': {'precision': 0.6483516483516484, 'recall': 0.5641025641025641, 'f1-score': 0.5917159763313609, 'support': 39}}
{'C': {'precision': 0.5714285714285714, 'recall': 0.6666666666666666, 'f1-score': 0.6153846153846153, 'support': 18}, 'P': {'precision': 0.7142857142857143, 'recall': 0.47619047619047616, 'f1-score': 0.5714285714285714, 'support': 21}, 'micro avg': {'precision': 0.6285714285714286, 'recall': 0.5641025641025641, 'f1-score': 0.5945945945945945, 'support': 39}, 'macro avg': {'precision': 0.6428571428571428, 'recall': 0.5714285714285714, 'f1-score': 0.5934065934065933, 'support': 39}, 'weighted avg': {'precision': 0.6483516483516484, 'recall': 0.5641025641025641, 'f1-score': 0.5917159763313609, 'support': 39}}
Dev-Data: Prec: 0.629, Rec: 0.564, F1: 0.5946
{'C': {'precision': 0.19230769230769232, 'recall': 0.22388059701492538, 'f1-score': 0.20689655172413793, 'support': 402}, 'P': {'precision': 0.23728813559322035, 'recall': 0.22134387351778656, 'f1-score': 0.22903885480572597, 'support': 506}, 'micro avg': {'precision': 0.2148936170212766, 'recall': 0.22246696035242292, 'f1-score': 0.21861471861471862, 'support': 908}, 'macro avg': {'precision': 0.21479791395045633, 'recall': 0.22261223526635598, 'f1-score': 0.21796770326493195, 'support': 908}, 'weighted avg': {'precision': 0.21737388647341607, 'recall': 0.22246696035242292, 'f1-score': 0.21923576467489073, 'support': 908}}
Wrong BIO-Encoding 546/1460 labels, 37.40%
{'C': {'precision': 0.19230769230769232, 'recall': 0.22388059701492538, 'f1-score': 0.20689655172413793, 'support': 402}, 'P': {'precision': 0.23728813559322035, 'recall': 0.22134387351778656, 'f1-score': 0.22903885480572597, 'support': 506}, 'micro avg': {'precision': 0.2148936170212766, 'recall': 0.22246696035242292, 'f1-score': 0.21861471861471862, 'support': 908}, 'macro avg': {'precision': 0.21479791395045633, 'recall': 0.22261223526635598, 'f1-score': 0.21796770326493195, 'support': 908}, 'weighted avg': {'precision': 0.21737388647341607, 'recall': 0.22246696035242292, 'f1-score': 0.21923576467489073, 'support': 908}}
Wrong BIO-Encoding 26/940 labels, 2.77%
Test-Data: Prec: 0.221, Rec: 0.222, F1: 0.2217

Scores from epoch with best dev-scores:
  Dev-Score: 0.5946
  Test-Score 0.2217

6.58 sec for evaluation

--------- Epoch 20 -----------
349.85 sec for training (6435.07 total)
-- cmv_modes1 --
{'C': {'precision': 0.6470588235294118, 'recall': 0.6111111111111112, 'f1-score': 0.6285714285714287, 'support': 18}, 'P': {'precision': 0.7058823529411765, 'recall': 0.5714285714285714, 'f1-score': 0.6315789473684211, 'support': 21}, 'micro avg': {'precision': 0.6764705882352942, 'recall': 0.5897435897435898, 'f1-score': 0.6301369863013699, 'support': 39}, 'macro avg': {'precision': 0.6764705882352942, 'recall': 0.5912698412698413, 'f1-score': 0.6300751879699249, 'support': 39}, 'weighted avg': {'precision': 0.6787330316742082, 'recall': 0.5897435897435898, 'f1-score': 0.6301908617698092, 'support': 39}}
{'C': {'precision': 0.6470588235294118, 'recall': 0.6111111111111112, 'f1-score': 0.6285714285714287, 'support': 18}, 'P': {'precision': 0.7058823529411765, 'recall': 0.5714285714285714, 'f1-score': 0.6315789473684211, 'support': 21}, 'micro avg': {'precision': 0.6764705882352942, 'recall': 0.5897435897435898, 'f1-score': 0.6301369863013699, 'support': 39}, 'macro avg': {'precision': 0.6764705882352942, 'recall': 0.5912698412698413, 'f1-score': 0.6300751879699249, 'support': 39}, 'weighted avg': {'precision': 0.6787330316742082, 'recall': 0.5897435897435898, 'f1-score': 0.6301908617698092, 'support': 39}}
Dev-Data: Prec: 0.676, Rec: 0.590, F1: 0.6301
{'C': {'precision': 0.2, 'recall': 0.20398009950248755, 'f1-score': 0.20197044334975367, 'support': 402}, 'P': {'precision': 0.19858156028368795, 'recall': 0.22134387351778656, 'f1-score': 0.20934579439252338, 'support': 506}, 'micro avg': {'precision': 0.19917864476386038, 'recall': 0.21365638766519823, 'f1-score': 0.20616365568544104, 'support': 908}, 'macro avg': {'precision': 0.19929078014184398, 'recall': 0.21266198651013707, 'f1-score': 0.20565811887113852, 'support': 908}, 'weighted avg': {'precision': 0.19920954791139442, 'recall': 0.21365638766519823, 'f1-score': 0.2060804958031033, 'support': 908}}
Wrong BIO-Encoding 488/1443 labels, 33.82%
{'C': {'precision': 0.2, 'recall': 0.20398009950248755, 'f1-score': 0.20197044334975367, 'support': 402}, 'P': {'precision': 0.19858156028368795, 'recall': 0.22134387351778656, 'f1-score': 0.20934579439252338, 'support': 506}, 'micro avg': {'precision': 0.19917864476386038, 'recall': 0.21365638766519823, 'f1-score': 0.20616365568544104, 'support': 908}, 'macro avg': {'precision': 0.19929078014184398, 'recall': 0.21266198651013707, 'f1-score': 0.20565811887113852, 'support': 908}, 'weighted avg': {'precision': 0.19920954791139442, 'recall': 0.21365638766519823, 'f1-score': 0.2060804958031033, 'support': 908}}
Wrong BIO-Encoding 19/974 labels, 1.95%
Test-Data: Prec: 0.203, Rec: 0.214, F1: 0.2083

Scores from epoch with best dev-scores:
  Dev-Score: 0.6301
  Test-Score 0.2083

6.47 sec for evaluation

--------- Epoch 21 -----------
349.59 sec for training (6784.66 total)
-- cmv_modes1 --
{'C': {'precision': 0.6666666666666666, 'recall': 0.6666666666666666, 'f1-score': 0.6666666666666666, 'support': 18}, 'P': {'precision': 0.7058823529411765, 'recall': 0.5714285714285714, 'f1-score': 0.6315789473684211, 'support': 21}, 'micro avg': {'precision': 0.6857142857142857, 'recall': 0.6153846153846154, 'f1-score': 0.6486486486486486, 'support': 39}, 'macro avg': {'precision': 0.6862745098039216, 'recall': 0.6190476190476191, 'f1-score': 0.6491228070175439, 'support': 39}, 'weighted avg': {'precision': 0.6877828054298643, 'recall': 0.6153846153846154, 'f1-score': 0.6477732793522267, 'support': 39}}
{'C': {'precision': 0.6666666666666666, 'recall': 0.6666666666666666, 'f1-score': 0.6666666666666666, 'support': 18}, 'P': {'precision': 0.7058823529411765, 'recall': 0.5714285714285714, 'f1-score': 0.6315789473684211, 'support': 21}, 'micro avg': {'precision': 0.6857142857142857, 'recall': 0.6153846153846154, 'f1-score': 0.6486486486486486, 'support': 39}, 'macro avg': {'precision': 0.6862745098039216, 'recall': 0.6190476190476191, 'f1-score': 0.6491228070175439, 'support': 39}, 'weighted avg': {'precision': 0.6877828054298643, 'recall': 0.6153846153846154, 'f1-score': 0.6477732793522267, 'support': 39}}
Dev-Data: Prec: 0.686, Rec: 0.615, F1: 0.6486
{'C': {'precision': 0.19036144578313252, 'recall': 0.19651741293532338, 'f1-score': 0.193390452876377, 'support': 402}, 'P': {'precision': 0.22661122661122662, 'recall': 0.21541501976284586, 'f1-score': 0.22087132725430597, 'support': 506}, 'micro avg': {'precision': 0.20982142857142858, 'recall': 0.20704845814977973, 'f1-score': 0.20842572062084258, 'support': 908}, 'macro avg': {'precision': 0.20848633619717957, 'recall': 0.20596621634908463, 'f1-score': 0.20713089006534147, 'support': 908}, 'weighted avg': {'precision': 0.21056231483491183, 'recall': 0.20704845814977973, 'f1-score': 0.20870468463324052, 'support': 908}}
Wrong BIO-Encoding 270/1149 labels, 23.50%
{'C': {'precision': 0.19036144578313252, 'recall': 0.19651741293532338, 'f1-score': 0.193390452876377, 'support': 402}, 'P': {'precision': 0.22661122661122662, 'recall': 0.21541501976284586, 'f1-score': 0.22087132725430597, 'support': 506}, 'micro avg': {'precision': 0.20982142857142858, 'recall': 0.20704845814977973, 'f1-score': 0.20842572062084258, 'support': 908}, 'macro avg': {'precision': 0.20848633619717957, 'recall': 0.20596621634908463, 'f1-score': 0.20713089006534147, 'support': 908}, 'weighted avg': {'precision': 0.21056231483491183, 'recall': 0.20704845814977973, 'f1-score': 0.20870468463324052, 'support': 908}}
Wrong BIO-Encoding 17/896 labels, 1.90%
Test-Data: Prec: 0.214, Rec: 0.207, F1: 0.2104

Scores from epoch with best dev-scores:
  Dev-Score: 0.6486
  Test-Score 0.2104

6.18 sec for evaluation

--------- Epoch 22 -----------
342.98 sec for training (7127.64 total)
-- cmv_modes1 --
{'C': {'precision': 0.5882352941176471, 'recall': 0.5555555555555556, 'f1-score': 0.5714285714285715, 'support': 18}, 'P': {'precision': 0.7647058823529411, 'recall': 0.6190476190476191, 'f1-score': 0.6842105263157895, 'support': 21}, 'micro avg': {'precision': 0.6764705882352942, 'recall': 0.5897435897435898, 'f1-score': 0.6301369863013699, 'support': 39}, 'macro avg': {'precision': 0.6764705882352942, 'recall': 0.5873015873015873, 'f1-score': 0.6278195488721805, 'support': 39}, 'weighted avg': {'precision': 0.6832579185520362, 'recall': 0.5897435897435898, 'f1-score': 0.6321573163678428, 'support': 39}}
{'C': {'precision': 0.5882352941176471, 'recall': 0.5555555555555556, 'f1-score': 0.5714285714285715, 'support': 18}, 'P': {'precision': 0.7647058823529411, 'recall': 0.6190476190476191, 'f1-score': 0.6842105263157895, 'support': 21}, 'micro avg': {'precision': 0.6764705882352942, 'recall': 0.5897435897435898, 'f1-score': 0.6301369863013699, 'support': 39}, 'macro avg': {'precision': 0.6764705882352942, 'recall': 0.5873015873015873, 'f1-score': 0.6278195488721805, 'support': 39}, 'weighted avg': {'precision': 0.6832579185520362, 'recall': 0.5897435897435898, 'f1-score': 0.6321573163678428, 'support': 39}}
Dev-Data: Prec: 0.676, Rec: 0.590, F1: 0.6301
{'C': {'precision': 0.188911704312115, 'recall': 0.22885572139303484, 'f1-score': 0.20697412823397077, 'support': 402}, 'P': {'precision': 0.21108742004264391, 'recall': 0.1956521739130435, 'f1-score': 0.20307692307692307, 'support': 506}, 'micro avg': {'precision': 0.1997907949790795, 'recall': 0.21035242290748898, 'f1-score': 0.20493562231759657, 'support': 908}, 'macro avg': {'precision': 0.19999956217737946, 'recall': 0.21225394765303918, 'f1-score': 0.2050255256554469, 'support': 908}, 'weighted avg': {'precision': 0.20126953708705733, 'recall': 0.21035242290748898, 'f1-score': 0.20480233769491116, 'support': 908}}
Wrong BIO-Encoding 323/1261 labels, 25.61%
{'C': {'precision': 0.188911704312115, 'recall': 0.22885572139303484, 'f1-score': 0.20697412823397077, 'support': 402}, 'P': {'precision': 0.21108742004264391, 'recall': 0.1956521739130435, 'f1-score': 0.20307692307692307, 'support': 506}, 'micro avg': {'precision': 0.1997907949790795, 'recall': 0.21035242290748898, 'f1-score': 0.20493562231759657, 'support': 908}, 'macro avg': {'precision': 0.19999956217737946, 'recall': 0.21225394765303918, 'f1-score': 0.2050255256554469, 'support': 908}, 'weighted avg': {'precision': 0.20126953708705733, 'recall': 0.21035242290748898, 'f1-score': 0.20480233769491116, 'support': 908}}
Wrong BIO-Encoding 18/956 labels, 1.88%
Test-Data: Prec: 0.204, Rec: 0.210, F1: 0.2069

Scores from epoch with best dev-scores:
  Dev-Score: 0.6486
  Test-Score 0.2104

6.42 sec for evaluation

--------- Epoch 23 -----------
341.83 sec for training (7469.47 total)
-- cmv_modes1 --
{'C': {'precision': 0.6666666666666666, 'recall': 0.6666666666666666, 'f1-score': 0.6666666666666666, 'support': 18}, 'P': {'precision': 0.625, 'recall': 0.47619047619047616, 'f1-score': 0.5405405405405405, 'support': 21}, 'micro avg': {'precision': 0.6470588235294118, 'recall': 0.5641025641025641, 'f1-score': 0.6027397260273972, 'support': 39}, 'macro avg': {'precision': 0.6458333333333333, 'recall': 0.5714285714285714, 'f1-score': 0.6036036036036035, 'support': 39}, 'weighted avg': {'precision': 0.6442307692307693, 'recall': 0.5641025641025641, 'f1-score': 0.5987525987525987, 'support': 39}}
{'C': {'precision': 0.6666666666666666, 'recall': 0.6666666666666666, 'f1-score': 0.6666666666666666, 'support': 18}, 'P': {'precision': 0.625, 'recall': 0.47619047619047616, 'f1-score': 0.5405405405405405, 'support': 21}, 'micro avg': {'precision': 0.6470588235294118, 'recall': 0.5641025641025641, 'f1-score': 0.6027397260273972, 'support': 39}, 'macro avg': {'precision': 0.6458333333333333, 'recall': 0.5714285714285714, 'f1-score': 0.6036036036036035, 'support': 39}, 'weighted avg': {'precision': 0.6442307692307693, 'recall': 0.5641025641025641, 'f1-score': 0.5987525987525987, 'support': 39}}
Dev-Data: Prec: 0.647, Rec: 0.564, F1: 0.6027
{'C': {'precision': 0.19238900634249473, 'recall': 0.2263681592039801, 'f1-score': 0.20800000000000005, 'support': 402}, 'P': {'precision': 0.19548872180451127, 'recall': 0.1541501976284585, 'f1-score': 0.1723756906077348, 'support': 506}, 'micro avg': {'precision': 0.1938073394495413, 'recall': 0.18612334801762115, 'f1-score': 0.1898876404494382, 'support': 908}, 'macro avg': {'precision': 0.193938864073503, 'recall': 0.1902591784162193, 'f1-score': 0.19018784530386743, 'support': 908}, 'weighted avg': {'precision': 0.19411638081802376, 'recall': 0.18612334801762115, 'f1-score': 0.18814768661620465, 'support': 908}}
Wrong BIO-Encoding 400/1249 labels, 32.03%
{'C': {'precision': 0.19238900634249473, 'recall': 0.2263681592039801, 'f1-score': 0.20800000000000005, 'support': 402}, 'P': {'precision': 0.19548872180451127, 'recall': 0.1541501976284585, 'f1-score': 0.1723756906077348, 'support': 506}, 'micro avg': {'precision': 0.1938073394495413, 'recall': 0.18612334801762115, 'f1-score': 0.1898876404494382, 'support': 908}, 'macro avg': {'precision': 0.193938864073503, 'recall': 0.1902591784162193, 'f1-score': 0.19018784530386743, 'support': 908}, 'weighted avg': {'precision': 0.19411638081802376, 'recall': 0.18612334801762115, 'f1-score': 0.18814768661620465, 'support': 908}}
Wrong BIO-Encoding 23/872 labels, 2.64%
Test-Data: Prec: 0.199, Rec: 0.186, F1: 0.1924

Scores from epoch with best dev-scores:
  Dev-Score: 0.6486
  Test-Score 0.2104

5.99 sec for evaluation

--------- Epoch 24 -----------
341.30 sec for training (7810.76 total)
-- cmv_modes1 --
{'C': {'precision': 0.7857142857142857, 'recall': 0.6111111111111112, 'f1-score': 0.6875000000000001, 'support': 18}, 'P': {'precision': 0.5714285714285714, 'recall': 0.5714285714285714, 'f1-score': 0.5714285714285714, 'support': 21}, 'micro avg': {'precision': 0.6571428571428571, 'recall': 0.5897435897435898, 'f1-score': 0.6216216216216216, 'support': 39}, 'macro avg': {'precision': 0.6785714285714286, 'recall': 0.5912698412698413, 'f1-score': 0.6294642857142858, 'support': 39}, 'weighted avg': {'precision': 0.6703296703296703, 'recall': 0.5897435897435898, 'f1-score': 0.625, 'support': 39}}
{'C': {'precision': 0.7857142857142857, 'recall': 0.6111111111111112, 'f1-score': 0.6875000000000001, 'support': 18}, 'P': {'precision': 0.5714285714285714, 'recall': 0.5714285714285714, 'f1-score': 0.5714285714285714, 'support': 21}, 'micro avg': {'precision': 0.6571428571428571, 'recall': 0.5897435897435898, 'f1-score': 0.6216216216216216, 'support': 39}, 'macro avg': {'precision': 0.6785714285714286, 'recall': 0.5912698412698413, 'f1-score': 0.6294642857142858, 'support': 39}, 'weighted avg': {'precision': 0.6703296703296703, 'recall': 0.5897435897435898, 'f1-score': 0.625, 'support': 39}}
Dev-Data: Prec: 0.657, Rec: 0.590, F1: 0.6216
{'C': {'precision': 0.2168284789644013, 'recall': 0.16666666666666666, 'f1-score': 0.18846694796061883, 'support': 402}, 'P': {'precision': 0.1996370235934664, 'recall': 0.21739130434782608, 'f1-score': 0.20813623462630085, 'support': 506}, 'micro avg': {'precision': 0.2058139534883721, 'recall': 0.1949339207048458, 'f1-score': 0.20022624434389139, 'support': 908}, 'macro avg': {'precision': 0.20823275127893387, 'recall': 0.19202898550724637, 'f1-score': 0.19830159129345984, 'support': 908}, 'weighted avg': {'precision': 0.20724821859249268, 'recall': 0.1949339207048458, 'f1-score': 0.1994280262126399, 'support': 908}}
Wrong BIO-Encoding 206/1054 labels, 19.54%
{'C': {'precision': 0.2168284789644013, 'recall': 0.16666666666666666, 'f1-score': 0.18846694796061883, 'support': 402}, 'P': {'precision': 0.1996370235934664, 'recall': 0.21739130434782608, 'f1-score': 0.20813623462630085, 'support': 506}, 'micro avg': {'precision': 0.2058139534883721, 'recall': 0.1949339207048458, 'f1-score': 0.20022624434389139, 'support': 908}, 'macro avg': {'precision': 0.20823275127893387, 'recall': 0.19202898550724637, 'f1-score': 0.19830159129345984, 'support': 908}, 'weighted avg': {'precision': 0.20724821859249268, 'recall': 0.1949339207048458, 'f1-score': 0.1994280262126399, 'support': 908}}
Wrong BIO-Encoding 12/860 labels, 1.40%
Test-Data: Prec: 0.208, Rec: 0.194, F1: 0.2005

Scores from epoch with best dev-scores:
  Dev-Score: 0.6486
  Test-Score 0.2104

6.07 sec for evaluation

--------- Epoch 25 -----------
340.13 sec for training (8150.90 total)
-- cmv_modes1 --
{'C': {'precision': 0.7857142857142857, 'recall': 0.6111111111111112, 'f1-score': 0.6875000000000001, 'support': 18}, 'P': {'precision': 0.6, 'recall': 0.5714285714285714, 'f1-score': 0.5853658536585366, 'support': 21}, 'micro avg': {'precision': 0.6764705882352942, 'recall': 0.5897435897435898, 'f1-score': 0.6301369863013699, 'support': 39}, 'macro avg': {'precision': 0.6928571428571428, 'recall': 0.5912698412698413, 'f1-score': 0.6364329268292683, 'support': 39}, 'weighted avg': {'precision': 0.6857142857142856, 'recall': 0.5897435897435898, 'f1-score': 0.6325046904315197, 'support': 39}}
{'C': {'precision': 0.7857142857142857, 'recall': 0.6111111111111112, 'f1-score': 0.6875000000000001, 'support': 18}, 'P': {'precision': 0.6, 'recall': 0.5714285714285714, 'f1-score': 0.5853658536585366, 'support': 21}, 'micro avg': {'precision': 0.6764705882352942, 'recall': 0.5897435897435898, 'f1-score': 0.6301369863013699, 'support': 39}, 'macro avg': {'precision': 0.6928571428571428, 'recall': 0.5912698412698413, 'f1-score': 0.6364329268292683, 'support': 39}, 'weighted avg': {'precision': 0.6857142857142856, 'recall': 0.5897435897435898, 'f1-score': 0.6325046904315197, 'support': 39}}
Dev-Data: Prec: 0.676, Rec: 0.590, F1: 0.6301
{'C': {'precision': 0.187683284457478, 'recall': 0.15920398009950248, 'f1-score': 0.17227456258411844, 'support': 402}, 'P': {'precision': 0.19649805447470817, 'recall': 0.19960474308300397, 'f1-score': 0.1980392156862745, 'support': 506}, 'micro avg': {'precision': 0.19298245614035087, 'recall': 0.1817180616740088, 'f1-score': 0.18718094157685763, 'support': 908}, 'macro avg': {'precision': 0.1920906694660931, 'recall': 0.17940436159125323, 'f1-score': 0.18515688913519646, 'support': 908}, 'weighted avg': {'precision': 0.1925954800838199, 'recall': 0.1817180616740088, 'f1-score': 0.18663239790316133, 'support': 908}}
Wrong BIO-Encoding 591/1425 labels, 41.47%
{'C': {'precision': 0.187683284457478, 'recall': 0.15920398009950248, 'f1-score': 0.17227456258411844, 'support': 402}, 'P': {'precision': 0.19649805447470817, 'recall': 0.19960474308300397, 'f1-score': 0.1980392156862745, 'support': 506}, 'micro avg': {'precision': 0.19298245614035087, 'recall': 0.1817180616740088, 'f1-score': 0.18718094157685763, 'support': 908}, 'macro avg': {'precision': 0.1920906694660931, 'recall': 0.17940436159125323, 'f1-score': 0.18515688913519646, 'support': 908}, 'weighted avg': {'precision': 0.1925954800838199, 'recall': 0.1817180616740088, 'f1-score': 0.18663239790316133, 'support': 908}}
Wrong BIO-Encoding 21/855 labels, 2.46%
Test-Data: Prec: 0.198, Rec: 0.182, F1: 0.1894

Scores from epoch with best dev-scores:
  Dev-Score: 0.6486
  Test-Score 0.2104

6.38 sec for evaluation

--------- Epoch 26 -----------
345.68 sec for training (8496.58 total)
-- cmv_modes1 --
{'C': {'precision': 0.8125, 'recall': 0.7222222222222222, 'f1-score': 0.7647058823529411, 'support': 18}, 'P': {'precision': 0.6842105263157895, 'recall': 0.6190476190476191, 'f1-score': 0.6500000000000001, 'support': 21}, 'micro avg': {'precision': 0.7428571428571429, 'recall': 0.6666666666666666, 'f1-score': 0.7027027027027027, 'support': 39}, 'macro avg': {'precision': 0.7483552631578947, 'recall': 0.6706349206349207, 'f1-score': 0.7073529411764706, 'support': 39}, 'weighted avg': {'precision': 0.743421052631579, 'recall': 0.6666666666666666, 'f1-score': 0.7029411764705882, 'support': 39}}
{'C': {'precision': 0.8125, 'recall': 0.7222222222222222, 'f1-score': 0.7647058823529411, 'support': 18}, 'P': {'precision': 0.6842105263157895, 'recall': 0.6190476190476191, 'f1-score': 0.6500000000000001, 'support': 21}, 'micro avg': {'precision': 0.7428571428571429, 'recall': 0.6666666666666666, 'f1-score': 0.7027027027027027, 'support': 39}, 'macro avg': {'precision': 0.7483552631578947, 'recall': 0.6706349206349207, 'f1-score': 0.7073529411764706, 'support': 39}, 'weighted avg': {'precision': 0.743421052631579, 'recall': 0.6666666666666666, 'f1-score': 0.7029411764705882, 'support': 39}}
Dev-Data: Prec: 0.743, Rec: 0.667, F1: 0.7027
{'C': {'precision': 0.2222222222222222, 'recall': 0.20398009950248755, 'f1-score': 0.2127107652399481, 'support': 402}, 'P': {'precision': 0.19831223628691982, 'recall': 0.1857707509881423, 'f1-score': 0.19183673469387755, 'support': 506}, 'micro avg': {'precision': 0.20877817319098457, 'recall': 0.19383259911894274, 'f1-score': 0.20102798400913766, 'support': 908}, 'macro avg': {'precision': 0.21026722925457103, 'recall': 0.19487542524531493, 'f1-score': 0.20227374996691283, 'support': 908}, 'weighted avg': {'precision': 0.20889793490585326, 'recall': 0.19383259911894274, 'f1-score': 0.20107832090480304, 'support': 908}}
Wrong BIO-Encoding 517/1336 labels, 38.70%
{'C': {'precision': 0.2222222222222222, 'recall': 0.20398009950248755, 'f1-score': 0.2127107652399481, 'support': 402}, 'P': {'precision': 0.19831223628691982, 'recall': 0.1857707509881423, 'f1-score': 0.19183673469387755, 'support': 506}, 'micro avg': {'precision': 0.20877817319098457, 'recall': 0.19383259911894274, 'f1-score': 0.20102798400913766, 'support': 908}, 'macro avg': {'precision': 0.21026722925457103, 'recall': 0.19487542524531493, 'f1-score': 0.20227374996691283, 'support': 908}, 'weighted avg': {'precision': 0.20889793490585326, 'recall': 0.19383259911894274, 'f1-score': 0.20107832090480304, 'support': 908}}
Wrong BIO-Encoding 24/843 labels, 2.85%
Test-Data: Prec: 0.215, Rec: 0.194, F1: 0.2038

Scores from epoch with best dev-scores:
  Dev-Score: 0.7027
  Test-Score 0.2038

6.70 sec for evaluation

--------- Epoch 27 -----------
343.00 sec for training (8839.58 total)
-- cmv_modes1 --
{'C': {'precision': 0.8, 'recall': 0.6666666666666666, 'f1-score': 0.7272727272727272, 'support': 18}, 'P': {'precision': 0.5909090909090909, 'recall': 0.6190476190476191, 'f1-score': 0.6046511627906977, 'support': 21}, 'micro avg': {'precision': 0.6756756756756757, 'recall': 0.6410256410256411, 'f1-score': 0.6578947368421052, 'support': 39}, 'macro avg': {'precision': 0.6954545454545455, 'recall': 0.6428571428571428, 'f1-score': 0.6659619450317125, 'support': 39}, 'weighted avg': {'precision': 0.6874125874125875, 'recall': 0.6410256410256411, 'f1-score': 0.6612457310131729, 'support': 39}}
{'C': {'precision': 0.8, 'recall': 0.6666666666666666, 'f1-score': 0.7272727272727272, 'support': 18}, 'P': {'precision': 0.5909090909090909, 'recall': 0.6190476190476191, 'f1-score': 0.6046511627906977, 'support': 21}, 'micro avg': {'precision': 0.6756756756756757, 'recall': 0.6410256410256411, 'f1-score': 0.6578947368421052, 'support': 39}, 'macro avg': {'precision': 0.6954545454545455, 'recall': 0.6428571428571428, 'f1-score': 0.6659619450317125, 'support': 39}, 'weighted avg': {'precision': 0.6874125874125875, 'recall': 0.6410256410256411, 'f1-score': 0.6612457310131729, 'support': 39}}
Dev-Data: Prec: 0.676, Rec: 0.641, F1: 0.6579
{'C': {'precision': 0.22153846153846155, 'recall': 0.1791044776119403, 'f1-score': 0.19807427785419532, 'support': 402}, 'P': {'precision': 0.17275747508305647, 'recall': 0.20553359683794467, 'f1-score': 0.18772563176895307, 'support': 506}, 'micro avg': {'precision': 0.18985976267529667, 'recall': 0.19383259911894274, 'f1-score': 0.19182561307901907, 'support': 908}, 'macro avg': {'precision': 0.197147968310759, 'recall': 0.19231903722494248, 'f1-score': 0.19289995481157418, 'support': 908}, 'weighted avg': {'precision': 0.19435434353577988, 'recall': 0.19383259911894274, 'f1-score': 0.19230730107100968, 'support': 908}}
Wrong BIO-Encoding 152/1071 labels, 14.19%
{'C': {'precision': 0.22153846153846155, 'recall': 0.1791044776119403, 'f1-score': 0.19807427785419532, 'support': 402}, 'P': {'precision': 0.17275747508305647, 'recall': 0.20553359683794467, 'f1-score': 0.18772563176895307, 'support': 506}, 'micro avg': {'precision': 0.18985976267529667, 'recall': 0.19383259911894274, 'f1-score': 0.19182561307901907, 'support': 908}, 'macro avg': {'precision': 0.197147968310759, 'recall': 0.19231903722494248, 'f1-score': 0.19289995481157418, 'support': 908}, 'weighted avg': {'precision': 0.19435434353577988, 'recall': 0.19383259911894274, 'f1-score': 0.19230730107100968, 'support': 908}}
Wrong BIO-Encoding 8/927 labels, 0.86%
Test-Data: Prec: 0.190, Rec: 0.194, F1: 0.1918

Scores from epoch with best dev-scores:
  Dev-Score: 0.7027
  Test-Score 0.2038

6.61 sec for evaluation

--------- Epoch 28 -----------
343.86 sec for training (9183.44 total)
-- cmv_modes1 --
{'C': {'precision': 0.8, 'recall': 0.6666666666666666, 'f1-score': 0.7272727272727272, 'support': 18}, 'P': {'precision': 0.5238095238095238, 'recall': 0.5238095238095238, 'f1-score': 0.5238095238095238, 'support': 21}, 'micro avg': {'precision': 0.6388888888888888, 'recall': 0.5897435897435898, 'f1-score': 0.6133333333333332, 'support': 39}, 'macro avg': {'precision': 0.661904761904762, 'recall': 0.5952380952380952, 'f1-score': 0.6255411255411255, 'support': 39}, 'weighted avg': {'precision': 0.6512820512820513, 'recall': 0.5897435897435898, 'f1-score': 0.6177156177156177, 'support': 39}}
{'C': {'precision': 0.8, 'recall': 0.6666666666666666, 'f1-score': 0.7272727272727272, 'support': 18}, 'P': {'precision': 0.5238095238095238, 'recall': 0.5238095238095238, 'f1-score': 0.5238095238095238, 'support': 21}, 'micro avg': {'precision': 0.6388888888888888, 'recall': 0.5897435897435898, 'f1-score': 0.6133333333333332, 'support': 39}, 'macro avg': {'precision': 0.661904761904762, 'recall': 0.5952380952380952, 'f1-score': 0.6255411255411255, 'support': 39}, 'weighted avg': {'precision': 0.6512820512820513, 'recall': 0.5897435897435898, 'f1-score': 0.6177156177156177, 'support': 39}}
Dev-Data: Prec: 0.639, Rec: 0.590, F1: 0.6133
{'C': {'precision': 0.18235294117647058, 'recall': 0.15422885572139303, 'f1-score': 0.16711590296495957, 'support': 402}, 'P': {'precision': 0.19382504288164665, 'recall': 0.22332015810276679, 'f1-score': 0.20752984389348023, 'support': 506}, 'micro avg': {'precision': 0.18959913326110509, 'recall': 0.19273127753303965, 'f1-score': 0.19115237575095573, 'support': 908}, 'macro avg': {'precision': 0.1880889920290586, 'recall': 0.18877450691207992, 'f1-score': 0.18732287342921988, 'support': 908}, 'weighted avg': {'precision': 0.18874598463772507, 'recall': 0.19273127753303965, 'f1-score': 0.18963732819605147, 'support': 908}}
Wrong BIO-Encoding 265/1175 labels, 22.55%
{'C': {'precision': 0.18235294117647058, 'recall': 0.15422885572139303, 'f1-score': 0.16711590296495957, 'support': 402}, 'P': {'precision': 0.19382504288164665, 'recall': 0.22332015810276679, 'f1-score': 0.20752984389348023, 'support': 506}, 'micro avg': {'precision': 0.18959913326110509, 'recall': 0.19273127753303965, 'f1-score': 0.19115237575095573, 'support': 908}, 'macro avg': {'precision': 0.1880889920290586, 'recall': 0.18877450691207992, 'f1-score': 0.18732287342921988, 'support': 908}, 'weighted avg': {'precision': 0.18874598463772507, 'recall': 0.19273127753303965, 'f1-score': 0.18963732819605147, 'support': 908}}
Wrong BIO-Encoding 13/923 labels, 1.41%
Test-Data: Prec: 0.191, Rec: 0.192, F1: 0.1914

Scores from epoch with best dev-scores:
  Dev-Score: 0.7027
  Test-Score 0.2038

6.35 sec for evaluation

--------- Epoch 29 -----------
345.58 sec for training (9529.02 total)
-- cmv_modes1 --
{'C': {'precision': 0.8125, 'recall': 0.7222222222222222, 'f1-score': 0.7647058823529411, 'support': 18}, 'P': {'precision': 0.5714285714285714, 'recall': 0.5714285714285714, 'f1-score': 0.5714285714285714, 'support': 21}, 'micro avg': {'precision': 0.6756756756756757, 'recall': 0.6410256410256411, 'f1-score': 0.6578947368421052, 'support': 39}, 'macro avg': {'precision': 0.6919642857142857, 'recall': 0.6468253968253967, 'f1-score': 0.6680672268907563, 'support': 39}, 'weighted avg': {'precision': 0.6826923076923077, 'recall': 0.6410256410256411, 'f1-score': 0.6606334841628959, 'support': 39}}
{'C': {'precision': 0.8125, 'recall': 0.7222222222222222, 'f1-score': 0.7647058823529411, 'support': 18}, 'P': {'precision': 0.5714285714285714, 'recall': 0.5714285714285714, 'f1-score': 0.5714285714285714, 'support': 21}, 'micro avg': {'precision': 0.6756756756756757, 'recall': 0.6410256410256411, 'f1-score': 0.6578947368421052, 'support': 39}, 'macro avg': {'precision': 0.6919642857142857, 'recall': 0.6468253968253967, 'f1-score': 0.6680672268907563, 'support': 39}, 'weighted avg': {'precision': 0.6826923076923077, 'recall': 0.6410256410256411, 'f1-score': 0.6606334841628959, 'support': 39}}
Dev-Data: Prec: 0.676, Rec: 0.641, F1: 0.6579
{'C': {'precision': 0.1956521739130435, 'recall': 0.1791044776119403, 'f1-score': 0.187012987012987, 'support': 402}, 'P': {'precision': 0.1903765690376569, 'recall': 0.17984189723320157, 'f1-score': 0.18495934959349594, 'support': 506}, 'micro avg': {'precision': 0.19267139479905437, 'recall': 0.17951541850220265, 'f1-score': 0.18586088939566706, 'support': 908}, 'macro avg': {'precision': 0.1930143714753502, 'recall': 0.17947318742257093, 'f1-score': 0.18598616830324147, 'support': 908}, 'weighted avg': {'precision': 0.19271224432389633, 'recall': 0.17951541850220265, 'f1-score': 0.18586855911181688, 'support': 908}}
Wrong BIO-Encoding 125/961 labels, 13.01%
{'C': {'precision': 0.1956521739130435, 'recall': 0.1791044776119403, 'f1-score': 0.187012987012987, 'support': 402}, 'P': {'precision': 0.1903765690376569, 'recall': 0.17984189723320157, 'f1-score': 0.18495934959349594, 'support': 506}, 'micro avg': {'precision': 0.19267139479905437, 'recall': 0.17951541850220265, 'f1-score': 0.18586088939566706, 'support': 908}, 'macro avg': {'precision': 0.1930143714753502, 'recall': 0.17947318742257093, 'f1-score': 0.18598616830324147, 'support': 908}, 'weighted avg': {'precision': 0.19271224432389633, 'recall': 0.17951541850220265, 'f1-score': 0.18586855911181688, 'support': 908}}
Wrong BIO-Encoding 10/846 labels, 1.18%
Test-Data: Prec: 0.195, Rec: 0.180, F1: 0.1869

Scores from epoch with best dev-scores:
  Dev-Score: 0.7027
  Test-Score 0.2038

6.62 sec for evaluation

--------- Epoch 30 -----------
346.14 sec for training (9875.16 total)
-- cmv_modes1 --
{'C': {'precision': 0.8235294117647058, 'recall': 0.7777777777777778, 'f1-score': 0.7999999999999999, 'support': 18}, 'P': {'precision': 0.7222222222222222, 'recall': 0.6190476190476191, 'f1-score': 0.6666666666666666, 'support': 21}, 'micro avg': {'precision': 0.7714285714285715, 'recall': 0.6923076923076923, 'f1-score': 0.7297297297297296, 'support': 39}, 'macro avg': {'precision': 0.772875816993464, 'recall': 0.6984126984126984, 'f1-score': 0.7333333333333333, 'support': 39}, 'weighted avg': {'precision': 0.7689793866264454, 'recall': 0.6923076923076923, 'f1-score': 0.7282051282051282, 'support': 39}}
{'C': {'precision': 0.8235294117647058, 'recall': 0.7777777777777778, 'f1-score': 0.7999999999999999, 'support': 18}, 'P': {'precision': 0.7222222222222222, 'recall': 0.6190476190476191, 'f1-score': 0.6666666666666666, 'support': 21}, 'micro avg': {'precision': 0.7714285714285715, 'recall': 0.6923076923076923, 'f1-score': 0.7297297297297296, 'support': 39}, 'macro avg': {'precision': 0.772875816993464, 'recall': 0.6984126984126984, 'f1-score': 0.7333333333333333, 'support': 39}, 'weighted avg': {'precision': 0.7689793866264454, 'recall': 0.6923076923076923, 'f1-score': 0.7282051282051282, 'support': 39}}
Dev-Data: Prec: 0.771, Rec: 0.692, F1: 0.7297
{'C': {'precision': 0.17010309278350516, 'recall': 0.16417910447761194, 'f1-score': 0.16708860759493674, 'support': 402}, 'P': {'precision': 0.21008403361344538, 'recall': 0.1976284584980237, 'f1-score': 0.20366598778004075, 'support': 506}, 'micro avg': {'precision': 0.19212962962962962, 'recall': 0.1828193832599119, 'f1-score': 0.18735891647855532, 'support': 908}, 'macro avg': {'precision': 0.19009356319847526, 'recall': 0.18090378148781783, 'f1-score': 0.18537729768748873, 'support': 908}, 'weighted avg': {'precision': 0.19238322060283308, 'recall': 0.1828193832599119, 'f1-score': 0.18747203752187794, 'support': 908}}
Wrong BIO-Encoding 249/1097 labels, 22.70%
{'C': {'precision': 0.17010309278350516, 'recall': 0.16417910447761194, 'f1-score': 0.16708860759493674, 'support': 402}, 'P': {'precision': 0.21008403361344538, 'recall': 0.1976284584980237, 'f1-score': 0.20366598778004075, 'support': 506}, 'micro avg': {'precision': 0.19212962962962962, 'recall': 0.1828193832599119, 'f1-score': 0.18735891647855532, 'support': 908}, 'macro avg': {'precision': 0.19009356319847526, 'recall': 0.18090378148781783, 'f1-score': 0.18537729768748873, 'support': 908}, 'weighted avg': {'precision': 0.19238322060283308, 'recall': 0.1828193832599119, 'f1-score': 0.18747203752187794, 'support': 908}}
Wrong BIO-Encoding 16/864 labels, 1.85%
Test-Data: Prec: 0.196, Rec: 0.183, F1: 0.1891

Scores from epoch with best dev-scores:
  Dev-Score: 0.7297
  Test-Score 0.1891

6.42 sec for evaluation

--------- Epoch 31 -----------
344.35 sec for training (10219.51 total)
-- cmv_modes1 --
{'C': {'precision': 1.0, 'recall': 0.6111111111111112, 'f1-score': 0.7586206896551725, 'support': 18}, 'P': {'precision': 0.46153846153846156, 'recall': 0.5714285714285714, 'f1-score': 0.5106382978723405, 'support': 21}, 'micro avg': {'precision': 0.6216216216216216, 'recall': 0.5897435897435898, 'f1-score': 0.6052631578947368, 'support': 39}, 'macro avg': {'precision': 0.7307692307692308, 'recall': 0.5912698412698413, 'f1-score': 0.6346294937637564, 'support': 39}, 'weighted avg': {'precision': 0.7100591715976332, 'recall': 0.5897435897435898, 'f1-score': 0.6250917094644168, 'support': 39}}
{'C': {'precision': 1.0, 'recall': 0.6111111111111112, 'f1-score': 0.7586206896551725, 'support': 18}, 'P': {'precision': 0.46153846153846156, 'recall': 0.5714285714285714, 'f1-score': 0.5106382978723405, 'support': 21}, 'micro avg': {'precision': 0.6216216216216216, 'recall': 0.5897435897435898, 'f1-score': 0.6052631578947368, 'support': 39}, 'macro avg': {'precision': 0.7307692307692308, 'recall': 0.5912698412698413, 'f1-score': 0.6346294937637564, 'support': 39}, 'weighted avg': {'precision': 0.7100591715976332, 'recall': 0.5897435897435898, 'f1-score': 0.6250917094644168, 'support': 39}}
Dev-Data: Prec: 0.622, Rec: 0.590, F1: 0.6053
{'C': {'precision': 0.2175226586102719, 'recall': 0.1791044776119403, 'f1-score': 0.19645293315143245, 'support': 402}, 'P': {'precision': 0.1890547263681592, 'recall': 0.22529644268774704, 'f1-score': 0.20559062218214608, 'support': 506}, 'micro avg': {'precision': 0.19914346895074947, 'recall': 0.20484581497797358, 'f1-score': 0.20195439739413681, 'support': 908}, 'macro avg': {'precision': 0.20328869248921555, 'recall': 0.20220046014984366, 'f1-score': 0.20102177766678925, 'support': 908}, 'weighted avg': {'precision': 0.20165837037843376, 'recall': 0.20484581497797358, 'f1-score': 0.2015450814438786, 'support': 908}}
Wrong BIO-Encoding 121/1048 labels, 11.55%
{'C': {'precision': 0.2175226586102719, 'recall': 0.1791044776119403, 'f1-score': 0.19645293315143245, 'support': 402}, 'P': {'precision': 0.1890547263681592, 'recall': 0.22529644268774704, 'f1-score': 0.20559062218214608, 'support': 506}, 'micro avg': {'precision': 0.19914346895074947, 'recall': 0.20484581497797358, 'f1-score': 0.20195439739413681, 'support': 908}, 'macro avg': {'precision': 0.20328869248921555, 'recall': 0.20220046014984366, 'f1-score': 0.20102177766678925, 'support': 908}, 'weighted avg': {'precision': 0.20165837037843376, 'recall': 0.20484581497797358, 'f1-score': 0.2015450814438786, 'support': 908}}
Wrong BIO-Encoding 7/934 labels, 0.75%
Test-Data: Prec: 0.201, Rec: 0.205, F1: 0.2027

Scores from epoch with best dev-scores:
  Dev-Score: 0.7297
  Test-Score 0.1891

6.15 sec for evaluation

--------- Epoch 32 -----------
344.85 sec for training (10564.35 total)
-- cmv_modes1 --
{'C': {'precision': 0.7222222222222222, 'recall': 0.7222222222222222, 'f1-score': 0.7222222222222222, 'support': 18}, 'P': {'precision': 0.7777777777777778, 'recall': 0.6666666666666666, 'f1-score': 0.717948717948718, 'support': 21}, 'micro avg': {'precision': 0.75, 'recall': 0.6923076923076923, 'f1-score': 0.7199999999999999, 'support': 39}, 'macro avg': {'precision': 0.75, 'recall': 0.6944444444444444, 'f1-score': 0.7200854700854701, 'support': 39}, 'weighted avg': {'precision': 0.7521367521367521, 'recall': 0.6923076923076923, 'f1-score': 0.7199211045364892, 'support': 39}}
{'C': {'precision': 0.7222222222222222, 'recall': 0.7222222222222222, 'f1-score': 0.7222222222222222, 'support': 18}, 'P': {'precision': 0.7777777777777778, 'recall': 0.6666666666666666, 'f1-score': 0.717948717948718, 'support': 21}, 'micro avg': {'precision': 0.75, 'recall': 0.6923076923076923, 'f1-score': 0.7199999999999999, 'support': 39}, 'macro avg': {'precision': 0.75, 'recall': 0.6944444444444444, 'f1-score': 0.7200854700854701, 'support': 39}, 'weighted avg': {'precision': 0.7521367521367521, 'recall': 0.6923076923076923, 'f1-score': 0.7199211045364892, 'support': 39}}
Dev-Data: Prec: 0.750, Rec: 0.692, F1: 0.7200
{'C': {'precision': 0.2025, 'recall': 0.20149253731343283, 'f1-score': 0.20199501246882792, 'support': 402}, 'P': {'precision': 0.2, 'recall': 0.19367588932806323, 'f1-score': 0.1967871485943775, 'support': 506}, 'micro avg': {'precision': 0.20112359550561798, 'recall': 0.197136563876652, 'f1-score': 0.19911012235817574, 'support': 908}, 'macro avg': {'precision': 0.20125, 'recall': 0.19758421332074805, 'f1-score': 0.1993910805316027, 'support': 908}, 'weighted avg': {'precision': 0.20110682819383263, 'recall': 0.197136563876652, 'f1-score': 0.1990928328207311, 'support': 908}}
Wrong BIO-Encoding 156/1037 labels, 15.04%
{'C': {'precision': 0.2025, 'recall': 0.20149253731343283, 'f1-score': 0.20199501246882792, 'support': 402}, 'P': {'precision': 0.2, 'recall': 0.19367588932806323, 'f1-score': 0.1967871485943775, 'support': 506}, 'micro avg': {'precision': 0.20112359550561798, 'recall': 0.197136563876652, 'f1-score': 0.19911012235817574, 'support': 908}, 'macro avg': {'precision': 0.20125, 'recall': 0.19758421332074805, 'f1-score': 0.1993910805316027, 'support': 908}, 'weighted avg': {'precision': 0.20110682819383263, 'recall': 0.197136563876652, 'f1-score': 0.1990928328207311, 'support': 908}}
Wrong BIO-Encoding 9/890 labels, 1.01%
Test-Data: Prec: 0.203, Rec: 0.197, F1: 0.2001

Scores from epoch with best dev-scores:
  Dev-Score: 0.7297
  Test-Score 0.1891

6.38 sec for evaluation

--------- Epoch 33 -----------
344.88 sec for training (10909.24 total)
-- cmv_modes1 --
{'C': {'precision': 0.875, 'recall': 0.7777777777777778, 'f1-score': 0.823529411764706, 'support': 18}, 'P': {'precision': 0.65, 'recall': 0.6190476190476191, 'f1-score': 0.6341463414634146, 'support': 21}, 'micro avg': {'precision': 0.75, 'recall': 0.6923076923076923, 'f1-score': 0.7199999999999999, 'support': 39}, 'macro avg': {'precision': 0.7625, 'recall': 0.6984126984126984, 'f1-score': 0.7288378766140603, 'support': 39}, 'weighted avg': {'precision': 0.7538461538461538, 'recall': 0.6923076923076923, 'f1-score': 0.7215539123717029, 'support': 39}}
{'C': {'precision': 0.875, 'recall': 0.7777777777777778, 'f1-score': 0.823529411764706, 'support': 18}, 'P': {'precision': 0.65, 'recall': 0.6190476190476191, 'f1-score': 0.6341463414634146, 'support': 21}, 'micro avg': {'precision': 0.75, 'recall': 0.6923076923076923, 'f1-score': 0.7199999999999999, 'support': 39}, 'macro avg': {'precision': 0.7625, 'recall': 0.6984126984126984, 'f1-score': 0.7288378766140603, 'support': 39}, 'weighted avg': {'precision': 0.7538461538461538, 'recall': 0.6923076923076923, 'f1-score': 0.7215539123717029, 'support': 39}}
Dev-Data: Prec: 0.750, Rec: 0.692, F1: 0.7200
{'C': {'precision': 0.1618798955613577, 'recall': 0.15422885572139303, 'f1-score': 0.15796178343949047, 'support': 402}, 'P': {'precision': 0.202, 'recall': 0.19960474308300397, 'f1-score': 0.20079522862823063, 'support': 506}, 'micro avg': {'precision': 0.18459796149490373, 'recall': 0.17951541850220265, 'f1-score': 0.1820212171970966, 'support': 908}, 'macro avg': {'precision': 0.18193994778067885, 'recall': 0.1769167994021985, 'f1-score': 0.17937850603386055, 'support': 908}, 'weighted avg': {'precision': 0.18423757490712092, 'recall': 0.17951541850220265, 'f1-score': 0.18183152271867828, 'support': 908}}
Wrong BIO-Encoding 396/1258 labels, 31.48%
{'C': {'precision': 0.1618798955613577, 'recall': 0.15422885572139303, 'f1-score': 0.15796178343949047, 'support': 402}, 'P': {'precision': 0.202, 'recall': 0.19960474308300397, 'f1-score': 0.20079522862823063, 'support': 506}, 'micro avg': {'precision': 0.18459796149490373, 'recall': 0.17951541850220265, 'f1-score': 0.1820212171970966, 'support': 908}, 'macro avg': {'precision': 0.18193994778067885, 'recall': 0.1769167994021985, 'f1-score': 0.17937850603386055, 'support': 908}, 'weighted avg': {'precision': 0.18423757490712092, 'recall': 0.17951541850220265, 'f1-score': 0.18183152271867828, 'support': 908}}
Wrong BIO-Encoding 21/883 labels, 2.38%
Test-Data: Prec: 0.189, Rec: 0.180, F1: 0.1842

Scores from epoch with best dev-scores:
  Dev-Score: 0.7297
  Test-Score 0.1891

6.28 sec for evaluation

--------- Epoch 34 -----------
343.99 sec for training (11253.23 total)
-- cmv_modes1 --
{'C': {'precision': 0.8666666666666667, 'recall': 0.7222222222222222, 'f1-score': 0.7878787878787877, 'support': 18}, 'P': {'precision': 0.5909090909090909, 'recall': 0.6190476190476191, 'f1-score': 0.6046511627906977, 'support': 21}, 'micro avg': {'precision': 0.7027027027027027, 'recall': 0.6666666666666666, 'f1-score': 0.6842105263157895, 'support': 39}, 'macro avg': {'precision': 0.7287878787878788, 'recall': 0.6706349206349207, 'f1-score': 0.6962649753347427, 'support': 39}, 'weighted avg': {'precision': 0.7181818181818183, 'recall': 0.6666666666666666, 'f1-score': 0.6892177589852009, 'support': 39}}
{'C': {'precision': 0.8666666666666667, 'recall': 0.7222222222222222, 'f1-score': 0.7878787878787877, 'support': 18}, 'P': {'precision': 0.5909090909090909, 'recall': 0.6190476190476191, 'f1-score': 0.6046511627906977, 'support': 21}, 'micro avg': {'precision': 0.7027027027027027, 'recall': 0.6666666666666666, 'f1-score': 0.6842105263157895, 'support': 39}, 'macro avg': {'precision': 0.7287878787878788, 'recall': 0.6706349206349207, 'f1-score': 0.6962649753347427, 'support': 39}, 'weighted avg': {'precision': 0.7181818181818183, 'recall': 0.6666666666666666, 'f1-score': 0.6892177589852009, 'support': 39}}
Dev-Data: Prec: 0.703, Rec: 0.667, F1: 0.6842
{'C': {'precision': 0.17708333333333334, 'recall': 0.1691542288557214, 'f1-score': 0.17302798982188294, 'support': 402}, 'P': {'precision': 0.17964071856287425, 'recall': 0.17786561264822134, 'f1-score': 0.17874875868917578, 'support': 506}, 'micro avg': {'precision': 0.17853107344632768, 'recall': 0.17400881057268722, 'f1-score': 0.17624093697713328, 'support': 908}, 'macro avg': {'precision': 0.1783620259481038, 'recall': 0.17350992075197136, 'f1-score': 0.17588837425552936, 'support': 908}, 'weighted avg': {'precision': 0.17850848413305545, 'recall': 0.17400881057268722, 'f1-score': 0.17621599538008798, 'support': 908}}
Wrong BIO-Encoding 307/1170 labels, 26.24%
{'C': {'precision': 0.17708333333333334, 'recall': 0.1691542288557214, 'f1-score': 0.17302798982188294, 'support': 402}, 'P': {'precision': 0.17964071856287425, 'recall': 0.17786561264822134, 'f1-score': 0.17874875868917578, 'support': 506}, 'micro avg': {'precision': 0.17853107344632768, 'recall': 0.17400881057268722, 'f1-score': 0.17624093697713328, 'support': 908}, 'macro avg': {'precision': 0.1783620259481038, 'recall': 0.17350992075197136, 'f1-score': 0.17588837425552936, 'support': 908}, 'weighted avg': {'precision': 0.17850848413305545, 'recall': 0.17400881057268722, 'f1-score': 0.17621599538008798, 'support': 908}}
Wrong BIO-Encoding 22/885 labels, 2.49%
Test-Data: Prec: 0.183, Rec: 0.174, F1: 0.1784

Scores from epoch with best dev-scores:
  Dev-Score: 0.7297
  Test-Score 0.1891

6.39 sec for evaluation

--------- Epoch 35 -----------
343.50 sec for training (11596.73 total)
-- cmv_modes1 --
{'C': {'precision': 0.8461538461538461, 'recall': 0.6111111111111112, 'f1-score': 0.7096774193548387, 'support': 18}, 'P': {'precision': 0.5909090909090909, 'recall': 0.6190476190476191, 'f1-score': 0.6046511627906977, 'support': 21}, 'micro avg': {'precision': 0.6857142857142857, 'recall': 0.6153846153846154, 'f1-score': 0.6486486486486486, 'support': 39}, 'macro avg': {'precision': 0.7185314685314685, 'recall': 0.6150793650793651, 'f1-score': 0.6571642910727682, 'support': 39}, 'weighted avg': {'precision': 0.7087143625605165, 'recall': 0.6153846153846154, 'f1-score': 0.6531248196664552, 'support': 39}}
{'C': {'precision': 0.8461538461538461, 'recall': 0.6111111111111112, 'f1-score': 0.7096774193548387, 'support': 18}, 'P': {'precision': 0.5909090909090909, 'recall': 0.6190476190476191, 'f1-score': 0.6046511627906977, 'support': 21}, 'micro avg': {'precision': 0.6857142857142857, 'recall': 0.6153846153846154, 'f1-score': 0.6486486486486486, 'support': 39}, 'macro avg': {'precision': 0.7185314685314685, 'recall': 0.6150793650793651, 'f1-score': 0.6571642910727682, 'support': 39}, 'weighted avg': {'precision': 0.7087143625605165, 'recall': 0.6153846153846154, 'f1-score': 0.6531248196664552, 'support': 39}}
Dev-Data: Prec: 0.686, Rec: 0.615, F1: 0.6486
{'C': {'precision': 0.2007168458781362, 'recall': 0.13930348258706468, 'f1-score': 0.16446402349486047, 'support': 402}, 'P': {'precision': 0.1696, 'recall': 0.20948616600790515, 'f1-score': 0.1874447391688771, 'support': 506}, 'micro avg': {'precision': 0.17920353982300885, 'recall': 0.17841409691629956, 'f1-score': 0.17880794701986755, 'support': 908}, 'macro avg': {'precision': 0.1851584229390681, 'recall': 0.17439482429748493, 'f1-score': 0.1759543813318688, 'support': 908}, 'weighted avg': {'precision': 0.18337640092842594, 'recall': 0.17841409691629956, 'f1-score': 0.17727045755989618, 'support': 908}}
Wrong BIO-Encoding 152/1047 labels, 14.52%
{'C': {'precision': 0.2007168458781362, 'recall': 0.13930348258706468, 'f1-score': 0.16446402349486047, 'support': 402}, 'P': {'precision': 0.1696, 'recall': 0.20948616600790515, 'f1-score': 0.1874447391688771, 'support': 506}, 'micro avg': {'precision': 0.17920353982300885, 'recall': 0.17841409691629956, 'f1-score': 0.17880794701986755, 'support': 908}, 'macro avg': {'precision': 0.1851584229390681, 'recall': 0.17439482429748493, 'f1-score': 0.1759543813318688, 'support': 908}, 'weighted avg': {'precision': 0.18337640092842594, 'recall': 0.17841409691629956, 'f1-score': 0.17727045755989618, 'support': 908}}
Wrong BIO-Encoding 9/904 labels, 1.00%
Test-Data: Prec: 0.181, Rec: 0.178, F1: 0.1797

Scores from epoch with best dev-scores:
  Dev-Score: 0.7297
  Test-Score 0.1891

6.19 sec for evaluation

--------- Epoch 36 -----------
341.42 sec for training (11938.15 total)
-- cmv_modes1 --
{'C': {'precision': 0.8125, 'recall': 0.7222222222222222, 'f1-score': 0.7647058823529411, 'support': 18}, 'P': {'precision': 0.7, 'recall': 0.6666666666666666, 'f1-score': 0.6829268292682926, 'support': 21}, 'micro avg': {'precision': 0.75, 'recall': 0.6923076923076923, 'f1-score': 0.7199999999999999, 'support': 39}, 'macro avg': {'precision': 0.75625, 'recall': 0.6944444444444444, 'f1-score': 0.7238163558106169, 'support': 39}, 'weighted avg': {'precision': 0.7519230769230769, 'recall': 0.6923076923076923, 'f1-score': 0.7206710076150534, 'support': 39}}
{'C': {'precision': 0.8125, 'recall': 0.7222222222222222, 'f1-score': 0.7647058823529411, 'support': 18}, 'P': {'precision': 0.7, 'recall': 0.6666666666666666, 'f1-score': 0.6829268292682926, 'support': 21}, 'micro avg': {'precision': 0.75, 'recall': 0.6923076923076923, 'f1-score': 0.7199999999999999, 'support': 39}, 'macro avg': {'precision': 0.75625, 'recall': 0.6944444444444444, 'f1-score': 0.7238163558106169, 'support': 39}, 'weighted avg': {'precision': 0.7519230769230769, 'recall': 0.6923076923076923, 'f1-score': 0.7206710076150534, 'support': 39}}
Dev-Data: Prec: 0.750, Rec: 0.692, F1: 0.7200
{'C': {'precision': 0.15845824411134904, 'recall': 0.18407960199004975, 'f1-score': 0.17031070195627157, 'support': 402}, 'P': {'precision': 0.19103773584905662, 'recall': 0.1600790513833992, 'f1-score': 0.17419354838709677, 'support': 506}, 'micro avg': {'precision': 0.1739618406285073, 'recall': 0.17070484581497797, 'f1-score': 0.17231795441912173, 'support': 908}, 'macro avg': {'precision': 0.17474798998020283, 'recall': 0.1720793266867245, 'f1-score': 0.17225212517168417, 'support': 908}, 'weighted avg': {'precision': 0.17661377585064425, 'recall': 0.17070484581497797, 'f1-score': 0.17247449082631292, 'support': 908}}
Wrong BIO-Encoding 468/1335 labels, 35.06%
{'C': {'precision': 0.15845824411134904, 'recall': 0.18407960199004975, 'f1-score': 0.17031070195627157, 'support': 402}, 'P': {'precision': 0.19103773584905662, 'recall': 0.1600790513833992, 'f1-score': 0.17419354838709677, 'support': 506}, 'micro avg': {'precision': 0.1739618406285073, 'recall': 0.17070484581497797, 'f1-score': 0.17231795441912173, 'support': 908}, 'macro avg': {'precision': 0.17474798998020283, 'recall': 0.1720793266867245, 'f1-score': 0.17225212517168417, 'support': 908}, 'weighted avg': {'precision': 0.17661377585064425, 'recall': 0.17070484581497797, 'f1-score': 0.17247449082631292, 'support': 908}}
Wrong BIO-Encoding 24/891 labels, 2.69%
Test-Data: Prec: 0.179, Rec: 0.171, F1: 0.1746

Scores from epoch with best dev-scores:
  Dev-Score: 0.7297
  Test-Score 0.1891

6.03 sec for evaluation

--------- Epoch 37 -----------
342.01 sec for training (12280.17 total)
-- cmv_modes1 --
{'C': {'precision': 0.7368421052631579, 'recall': 0.7777777777777778, 'f1-score': 0.7567567567567567, 'support': 18}, 'P': {'precision': 0.6666666666666666, 'recall': 0.6666666666666666, 'f1-score': 0.6666666666666666, 'support': 21}, 'micro avg': {'precision': 0.7, 'recall': 0.717948717948718, 'f1-score': 0.708860759493671, 'support': 39}, 'macro avg': {'precision': 0.7017543859649122, 'recall': 0.7222222222222222, 'f1-score': 0.7117117117117117, 'support': 39}, 'weighted avg': {'precision': 0.699055330634278, 'recall': 0.717948717948718, 'f1-score': 0.7082467082467082, 'support': 39}}
{'C': {'precision': 0.7368421052631579, 'recall': 0.7777777777777778, 'f1-score': 0.7567567567567567, 'support': 18}, 'P': {'precision': 0.6666666666666666, 'recall': 0.6666666666666666, 'f1-score': 0.6666666666666666, 'support': 21}, 'micro avg': {'precision': 0.7, 'recall': 0.717948717948718, 'f1-score': 0.708860759493671, 'support': 39}, 'macro avg': {'precision': 0.7017543859649122, 'recall': 0.7222222222222222, 'f1-score': 0.7117117117117117, 'support': 39}, 'weighted avg': {'precision': 0.699055330634278, 'recall': 0.717948717948718, 'f1-score': 0.7082467082467082, 'support': 39}}
Dev-Data: Prec: 0.700, Rec: 0.718, F1: 0.7089
{'C': {'precision': 0.1810344827586207, 'recall': 0.208955223880597, 'f1-score': 0.19399538106235562, 'support': 402}, 'P': {'precision': 0.20335429769392033, 'recall': 0.191699604743083, 'f1-score': 0.1973550356052899, 'support': 506}, 'micro avg': {'precision': 0.19234856535600425, 'recall': 0.19933920704845814, 'f1-score': 0.19578150351541374, 'support': 908}, 'macro avg': {'precision': 0.1921943902262705, 'recall': 0.20032741431184, 'f1-score': 0.19567520833382276, 'support': 908}, 'weighted avg': {'precision': 0.1934726175133141, 'recall': 0.19933920704845814, 'f1-score': 0.19586761145742693, 'support': 908}}
Wrong BIO-Encoding 239/1167 labels, 20.48%
{'C': {'precision': 0.1810344827586207, 'recall': 0.208955223880597, 'f1-score': 0.19399538106235562, 'support': 402}, 'P': {'precision': 0.20335429769392033, 'recall': 0.191699604743083, 'f1-score': 0.1973550356052899, 'support': 506}, 'micro avg': {'precision': 0.19234856535600425, 'recall': 0.19933920704845814, 'f1-score': 0.19578150351541374, 'support': 908}, 'macro avg': {'precision': 0.1921943902262705, 'recall': 0.20032741431184, 'f1-score': 0.19567520833382276, 'support': 908}, 'weighted avg': {'precision': 0.1934726175133141, 'recall': 0.19933920704845814, 'f1-score': 0.19586761145742693, 'support': 908}}
Wrong BIO-Encoding 13/941 labels, 1.38%
Test-Data: Prec: 0.195, Rec: 0.199, F1: 0.1972

Scores from epoch with best dev-scores:
  Dev-Score: 0.7297
  Test-Score 0.1891

6.04 sec for evaluation

--------- Epoch 38 -----------
339.28 sec for training (12619.45 total)
-- cmv_modes1 --
{'C': {'precision': 0.8823529411764706, 'recall': 0.8333333333333334, 'f1-score': 0.8571428571428571, 'support': 18}, 'P': {'precision': 0.8421052631578947, 'recall': 0.7619047619047619, 'f1-score': 0.8, 'support': 21}, 'micro avg': {'precision': 0.8611111111111112, 'recall': 0.7948717948717948, 'f1-score': 0.8266666666666667, 'support': 39}, 'macro avg': {'precision': 0.8622291021671826, 'recall': 0.7976190476190477, 'f1-score': 0.8285714285714285, 'support': 39}, 'weighted avg': {'precision': 0.8606811145510835, 'recall': 0.7948717948717948, 'f1-score': 0.8263736263736263, 'support': 39}}
{'C': {'precision': 0.8823529411764706, 'recall': 0.8333333333333334, 'f1-score': 0.8571428571428571, 'support': 18}, 'P': {'precision': 0.8421052631578947, 'recall': 0.7619047619047619, 'f1-score': 0.8, 'support': 21}, 'micro avg': {'precision': 0.8611111111111112, 'recall': 0.7948717948717948, 'f1-score': 0.8266666666666667, 'support': 39}, 'macro avg': {'precision': 0.8622291021671826, 'recall': 0.7976190476190477, 'f1-score': 0.8285714285714285, 'support': 39}, 'weighted avg': {'precision': 0.8606811145510835, 'recall': 0.7948717948717948, 'f1-score': 0.8263736263736263, 'support': 39}}
Dev-Data: Prec: 0.861, Rec: 0.795, F1: 0.8267
{'C': {'precision': 0.16348195329087048, 'recall': 0.19154228855721392, 'f1-score': 0.1764032073310424, 'support': 402}, 'P': {'precision': 0.2125984251968504, 'recall': 0.1600790513833992, 'f1-score': 0.18263810597519728, 'support': 506}, 'micro avg': {'precision': 0.18544600938967137, 'recall': 0.17400881057268722, 'f1-score': 0.17954545454545456, 'support': 908}, 'macro avg': {'precision': 0.18804018924386046, 'recall': 0.17581066997030656, 'f1-score': 0.17952065665311984, 'support': 908}, 'weighted avg': {'precision': 0.19085302684200026, 'recall': 0.17400881057268722, 'f1-score': 0.17987772133318158, 'support': 908}}
Wrong BIO-Encoding 283/1118 labels, 25.31%
{'C': {'precision': 0.16348195329087048, 'recall': 0.19154228855721392, 'f1-score': 0.1764032073310424, 'support': 402}, 'P': {'precision': 0.2125984251968504, 'recall': 0.1600790513833992, 'f1-score': 0.18263810597519728, 'support': 506}, 'micro avg': {'precision': 0.18544600938967137, 'recall': 0.17400881057268722, 'f1-score': 0.17954545454545456, 'support': 908}, 'macro avg': {'precision': 0.18804018924386046, 'recall': 0.17581066997030656, 'f1-score': 0.17952065665311984, 'support': 908}, 'weighted avg': {'precision': 0.19085302684200026, 'recall': 0.17400881057268722, 'f1-score': 0.17987772133318158, 'support': 908}}
Wrong BIO-Encoding 17/852 labels, 2.00%
Test-Data: Prec: 0.189, Rec: 0.174, F1: 0.1813

Scores from epoch with best dev-scores:
  Dev-Score: 0.8267
  Test-Score 0.1813

6.18 sec for evaluation

--------- Epoch 39 -----------
348.76 sec for training (12968.20 total)
-- cmv_modes1 --
{'C': {'precision': 0.8333333333333334, 'recall': 0.8333333333333334, 'f1-score': 0.8333333333333334, 'support': 18}, 'P': {'precision': 0.6842105263157895, 'recall': 0.6190476190476191, 'f1-score': 0.6500000000000001, 'support': 21}, 'micro avg': {'precision': 0.7567567567567568, 'recall': 0.717948717948718, 'f1-score': 0.736842105263158, 'support': 39}, 'macro avg': {'precision': 0.7587719298245614, 'recall': 0.7261904761904763, 'f1-score': 0.7416666666666667, 'support': 39}, 'weighted avg': {'precision': 0.7530364372469636, 'recall': 0.717948717948718, 'f1-score': 0.7346153846153847, 'support': 39}}
{'C': {'precision': 0.8333333333333334, 'recall': 0.8333333333333334, 'f1-score': 0.8333333333333334, 'support': 18}, 'P': {'precision': 0.6842105263157895, 'recall': 0.6190476190476191, 'f1-score': 0.6500000000000001, 'support': 21}, 'micro avg': {'precision': 0.7567567567567568, 'recall': 0.717948717948718, 'f1-score': 0.736842105263158, 'support': 39}, 'macro avg': {'precision': 0.7587719298245614, 'recall': 0.7261904761904763, 'f1-score': 0.7416666666666667, 'support': 39}, 'weighted avg': {'precision': 0.7530364372469636, 'recall': 0.717948717948718, 'f1-score': 0.7346153846153847, 'support': 39}}
Dev-Data: Prec: 0.757, Rec: 0.718, F1: 0.7368
{'C': {'precision': 0.16835699797160245, 'recall': 0.2064676616915423, 'f1-score': 0.18547486033519556, 'support': 402}, 'P': {'precision': 0.22146118721461186, 'recall': 0.191699604743083, 'f1-score': 0.20550847457627122, 'support': 506}, 'micro avg': {'precision': 0.1933404940923738, 'recall': 0.19823788546255505, 'f1-score': 0.1957585644371941, 'support': 908}, 'macro avg': {'precision': 0.19490909259310715, 'recall': 0.19908363321731265, 'f1-score': 0.19549166745573338, 'support': 908}, 'weighted avg': {'precision': 0.19795030166869798, 'recall': 0.19823788546255505, 'f1-score': 0.1966389669497157, 'support': 908}}
Wrong BIO-Encoding 257/1174 labels, 21.89%
{'C': {'precision': 0.16835699797160245, 'recall': 0.2064676616915423, 'f1-score': 0.18547486033519556, 'support': 402}, 'P': {'precision': 0.22146118721461186, 'recall': 0.191699604743083, 'f1-score': 0.20550847457627122, 'support': 506}, 'micro avg': {'precision': 0.1933404940923738, 'recall': 0.19823788546255505, 'f1-score': 0.1957585644371941, 'support': 908}, 'macro avg': {'precision': 0.19490909259310715, 'recall': 0.19908363321731265, 'f1-score': 0.19549166745573338, 'support': 908}, 'weighted avg': {'precision': 0.19795030166869798, 'recall': 0.19823788546255505, 'f1-score': 0.1966389669497157, 'support': 908}}
Wrong BIO-Encoding 14/931 labels, 1.50%
Test-Data: Prec: 0.196, Rec: 0.198, F1: 0.1973

Scores from epoch with best dev-scores:
  Dev-Score: 0.8267
  Test-Score 0.1813

5.90 sec for evaluation

--------- Epoch 40 -----------
342.21 sec for training (13310.41 total)
-- cmv_modes1 --
{'C': {'precision': 0.8823529411764706, 'recall': 0.8333333333333334, 'f1-score': 0.8571428571428571, 'support': 18}, 'P': {'precision': 0.7, 'recall': 0.6666666666666666, 'f1-score': 0.6829268292682926, 'support': 21}, 'micro avg': {'precision': 0.7837837837837838, 'recall': 0.7435897435897436, 'f1-score': 0.7631578947368421, 'support': 39}, 'macro avg': {'precision': 0.7911764705882353, 'recall': 0.75, 'f1-score': 0.7700348432055748, 'support': 39}, 'weighted avg': {'precision': 0.7841628959276018, 'recall': 0.7435897435897436, 'f1-score': 0.7633342267488609, 'support': 39}}
{'C': {'precision': 0.8823529411764706, 'recall': 0.8333333333333334, 'f1-score': 0.8571428571428571, 'support': 18}, 'P': {'precision': 0.7, 'recall': 0.6666666666666666, 'f1-score': 0.6829268292682926, 'support': 21}, 'micro avg': {'precision': 0.7837837837837838, 'recall': 0.7435897435897436, 'f1-score': 0.7631578947368421, 'support': 39}, 'macro avg': {'precision': 0.7911764705882353, 'recall': 0.75, 'f1-score': 0.7700348432055748, 'support': 39}, 'weighted avg': {'precision': 0.7841628959276018, 'recall': 0.7435897435897436, 'f1-score': 0.7633342267488609, 'support': 39}}
Dev-Data: Prec: 0.784, Rec: 0.744, F1: 0.7632
{'C': {'precision': 0.15859030837004406, 'recall': 0.1791044776119403, 'f1-score': 0.16822429906542058, 'support': 402}, 'P': {'precision': 0.1950207468879668, 'recall': 0.1857707509881423, 'f1-score': 0.19028340080971662, 'support': 506}, 'micro avg': {'precision': 0.17735042735042736, 'recall': 0.1828193832599119, 'f1-score': 0.18004338394793928, 'support': 908}, 'macro avg': {'precision': 0.17680552762900542, 'recall': 0.1824376143000413, 'f1-score': 0.1792538499375686, 'support': 908}, 'weighted avg': {'precision': 0.178891852301838, 'recall': 0.1828193832599119, 'f1-score': 0.18051714651323314, 'support': 908}}
Wrong BIO-Encoding 298/1218 labels, 24.47%
{'C': {'precision': 0.15859030837004406, 'recall': 0.1791044776119403, 'f1-score': 0.16822429906542058, 'support': 402}, 'P': {'precision': 0.1950207468879668, 'recall': 0.1857707509881423, 'f1-score': 0.19028340080971662, 'support': 506}, 'micro avg': {'precision': 0.17735042735042736, 'recall': 0.1828193832599119, 'f1-score': 0.18004338394793928, 'support': 908}, 'macro avg': {'precision': 0.17680552762900542, 'recall': 0.1824376143000413, 'f1-score': 0.1792538499375686, 'support': 908}, 'weighted avg': {'precision': 0.178891852301838, 'recall': 0.1828193832599119, 'f1-score': 0.18051714651323314, 'support': 908}}
Wrong BIO-Encoding 16/936 labels, 1.71%
Test-Data: Prec: 0.180, Rec: 0.183, F1: 0.1816

Scores from epoch with best dev-scores:
  Dev-Score: 0.8267
  Test-Score 0.1813

6.30 sec for evaluation

--------- Epoch 41 -----------
341.74 sec for training (13652.15 total)
-- cmv_modes1 --
{'C': {'precision': 0.8823529411764706, 'recall': 0.8333333333333334, 'f1-score': 0.8571428571428571, 'support': 18}, 'P': {'precision': 0.7, 'recall': 0.6666666666666666, 'f1-score': 0.6829268292682926, 'support': 21}, 'micro avg': {'precision': 0.7837837837837838, 'recall': 0.7435897435897436, 'f1-score': 0.7631578947368421, 'support': 39}, 'macro avg': {'precision': 0.7911764705882353, 'recall': 0.75, 'f1-score': 0.7700348432055748, 'support': 39}, 'weighted avg': {'precision': 0.7841628959276018, 'recall': 0.7435897435897436, 'f1-score': 0.7633342267488609, 'support': 39}}
{'C': {'precision': 0.8823529411764706, 'recall': 0.8333333333333334, 'f1-score': 0.8571428571428571, 'support': 18}, 'P': {'precision': 0.7, 'recall': 0.6666666666666666, 'f1-score': 0.6829268292682926, 'support': 21}, 'micro avg': {'precision': 0.7837837837837838, 'recall': 0.7435897435897436, 'f1-score': 0.7631578947368421, 'support': 39}, 'macro avg': {'precision': 0.7911764705882353, 'recall': 0.75, 'f1-score': 0.7700348432055748, 'support': 39}, 'weighted avg': {'precision': 0.7841628959276018, 'recall': 0.7435897435897436, 'f1-score': 0.7633342267488609, 'support': 39}}
Dev-Data: Prec: 0.784, Rec: 0.744, F1: 0.7632
{'C': {'precision': 0.15566037735849056, 'recall': 0.16417910447761194, 'f1-score': 0.15980629539951574, 'support': 402}, 'P': {'precision': 0.19801980198019803, 'recall': 0.1976284584980237, 'f1-score': 0.19782393669634024, 'support': 506}, 'micro avg': {'precision': 0.17868675995694294, 'recall': 0.1828193832599119, 'f1-score': 0.18072945019052805, 'support': 908}, 'macro avg': {'precision': 0.17684008966934428, 'recall': 0.18090378148781783, 'f1-score': 0.178815116047928, 'support': 908}, 'weighted avg': {'precision': 0.17926595980186502, 'recall': 0.1828193832599119, 'f1-score': 0.18099233779620427, 'support': 908}}
Wrong BIO-Encoding 320/1236 labels, 25.89%
{'C': {'precision': 0.15566037735849056, 'recall': 0.16417910447761194, 'f1-score': 0.15980629539951574, 'support': 402}, 'P': {'precision': 0.19801980198019803, 'recall': 0.1976284584980237, 'f1-score': 0.19782393669634024, 'support': 506}, 'micro avg': {'precision': 0.17868675995694294, 'recall': 0.1828193832599119, 'f1-score': 0.18072945019052805, 'support': 908}, 'macro avg': {'precision': 0.17684008966934428, 'recall': 0.18090378148781783, 'f1-score': 0.178815116047928, 'support': 908}, 'weighted avg': {'precision': 0.17926595980186502, 'recall': 0.1828193832599119, 'f1-score': 0.18099233779620427, 'support': 908}}
Wrong BIO-Encoding 13/929 labels, 1.40%
Test-Data: Prec: 0.181, Rec: 0.183, F1: 0.1820

Scores from epoch with best dev-scores:
  Dev-Score: 0.8267
  Test-Score 0.1813

6.33 sec for evaluation

--------- Epoch 42 -----------
342.42 sec for training (13994.58 total)
-- cmv_modes1 --
{'C': {'precision': 0.8461538461538461, 'recall': 0.6111111111111112, 'f1-score': 0.7096774193548387, 'support': 18}, 'P': {'precision': 0.5652173913043478, 'recall': 0.6190476190476191, 'f1-score': 0.5909090909090909, 'support': 21}, 'micro avg': {'precision': 0.6666666666666666, 'recall': 0.6153846153846154, 'f1-score': 0.64, 'support': 39}, 'macro avg': {'precision': 0.705685618729097, 'recall': 0.6150793650793651, 'f1-score': 0.6502932551319649, 'support': 39}, 'weighted avg': {'precision': 0.6948803704656547, 'recall': 0.6153846153846154, 'f1-score': 0.6457252424994362, 'support': 39}}
{'C': {'precision': 0.8461538461538461, 'recall': 0.6111111111111112, 'f1-score': 0.7096774193548387, 'support': 18}, 'P': {'precision': 0.5652173913043478, 'recall': 0.6190476190476191, 'f1-score': 0.5909090909090909, 'support': 21}, 'micro avg': {'precision': 0.6666666666666666, 'recall': 0.6153846153846154, 'f1-score': 0.64, 'support': 39}, 'macro avg': {'precision': 0.705685618729097, 'recall': 0.6150793650793651, 'f1-score': 0.6502932551319649, 'support': 39}, 'weighted avg': {'precision': 0.6948803704656547, 'recall': 0.6153846153846154, 'f1-score': 0.6457252424994362, 'support': 39}}
Dev-Data: Prec: 0.667, Rec: 0.615, F1: 0.6400
{'C': {'precision': 0.16666666666666666, 'recall': 0.14427860696517414, 'f1-score': 0.1546666666666667, 'support': 402}, 'P': {'precision': 0.21495327102803738, 'recall': 0.22727272727272727, 'f1-score': 0.22094140249759847, 'support': 506}, 'micro avg': {'precision': 0.19592298980747452, 'recall': 0.1905286343612335, 'f1-score': 0.19318816303740927, 'support': 908}, 'macro avg': {'precision': 0.19080996884735202, 'recall': 0.18577566711895072, 'f1-score': 0.18780403458213257, 'support': 908}, 'weighted avg': {'precision': 0.1935752809913953, 'recall': 0.1905286343612335, 'f1-score': 0.1915995040350053, 'support': 908}}
Wrong BIO-Encoding 282/1149 labels, 24.54%
{'C': {'precision': 0.16666666666666666, 'recall': 0.14427860696517414, 'f1-score': 0.1546666666666667, 'support': 402}, 'P': {'precision': 0.21495327102803738, 'recall': 0.22727272727272727, 'f1-score': 0.22094140249759847, 'support': 506}, 'micro avg': {'precision': 0.19592298980747452, 'recall': 0.1905286343612335, 'f1-score': 0.19318816303740927, 'support': 908}, 'macro avg': {'precision': 0.19080996884735202, 'recall': 0.18577566711895072, 'f1-score': 0.18780403458213257, 'support': 908}, 'weighted avg': {'precision': 0.1935752809913953, 'recall': 0.1905286343612335, 'f1-score': 0.1915995040350053, 'support': 908}}
Wrong BIO-Encoding 16/883 labels, 1.81%
Test-Data: Prec: 0.200, Rec: 0.191, F1: 0.1949

Scores from epoch with best dev-scores:
  Dev-Score: 0.8267
  Test-Score 0.1813

6.54 sec for evaluation

--------- Epoch 43 -----------
343.07 sec for training (14337.64 total)
-- cmv_modes1 --
{'C': {'precision': 0.875, 'recall': 0.7777777777777778, 'f1-score': 0.823529411764706, 'support': 18}, 'P': {'precision': 0.7619047619047619, 'recall': 0.7619047619047619, 'f1-score': 0.7619047619047619, 'support': 21}, 'micro avg': {'precision': 0.8108108108108109, 'recall': 0.7692307692307693, 'f1-score': 0.7894736842105263, 'support': 39}, 'macro avg': {'precision': 0.8184523809523809, 'recall': 0.7698412698412698, 'f1-score': 0.792717086834734, 'support': 39}, 'weighted avg': {'precision': 0.8141025641025641, 'recall': 0.7692307692307693, 'f1-score': 0.7903469079939668, 'support': 39}}
{'C': {'precision': 0.875, 'recall': 0.7777777777777778, 'f1-score': 0.823529411764706, 'support': 18}, 'P': {'precision': 0.7619047619047619, 'recall': 0.7619047619047619, 'f1-score': 0.7619047619047619, 'support': 21}, 'micro avg': {'precision': 0.8108108108108109, 'recall': 0.7692307692307693, 'f1-score': 0.7894736842105263, 'support': 39}, 'macro avg': {'precision': 0.8184523809523809, 'recall': 0.7698412698412698, 'f1-score': 0.792717086834734, 'support': 39}, 'weighted avg': {'precision': 0.8141025641025641, 'recall': 0.7692307692307693, 'f1-score': 0.7903469079939668, 'support': 39}}
Dev-Data: Prec: 0.811, Rec: 0.769, F1: 0.7895
{'C': {'precision': 0.1597051597051597, 'recall': 0.16169154228855723, 'f1-score': 0.1606922126081582, 'support': 402}, 'P': {'precision': 0.22171945701357465, 'recall': 0.19367588932806323, 'f1-score': 0.20675105485232068, 'support': 506}, 'micro avg': {'precision': 0.19199057714958775, 'recall': 0.17951541850220265, 'f1-score': 0.18554354012521343, 'support': 908}, 'macro avg': {'precision': 0.19071230835936717, 'recall': 0.17768371580831022, 'f1-score': 0.18372163373023942, 'support': 908}, 'weighted avg': {'precision': 0.19426378794090635, 'recall': 0.17951541850220265, 'f1-score': 0.18635936478386989, 'support': 908}}
Wrong BIO-Encoding 73/916 labels, 7.97%
{'C': {'precision': 0.1597051597051597, 'recall': 0.16169154228855723, 'f1-score': 0.1606922126081582, 'support': 402}, 'P': {'precision': 0.22171945701357465, 'recall': 0.19367588932806323, 'f1-score': 0.20675105485232068, 'support': 506}, 'micro avg': {'precision': 0.19199057714958775, 'recall': 0.17951541850220265, 'f1-score': 0.18554354012521343, 'support': 908}, 'macro avg': {'precision': 0.19071230835936717, 'recall': 0.17768371580831022, 'f1-score': 0.18372163373023942, 'support': 908}, 'weighted avg': {'precision': 0.19426378794090635, 'recall': 0.17951541850220265, 'f1-score': 0.18635936478386989, 'support': 908}}
Wrong BIO-Encoding 6/849 labels, 0.71%
Test-Data: Prec: 0.193, Rec: 0.180, F1: 0.1862

Scores from epoch with best dev-scores:
  Dev-Score: 0.8267
  Test-Score 0.1813

6.51 sec for evaluation

--------- Epoch 44 -----------
340.59 sec for training (14678.23 total)
-- cmv_modes1 --
{'C': {'precision': 0.8333333333333334, 'recall': 0.8333333333333334, 'f1-score': 0.8333333333333334, 'support': 18}, 'P': {'precision': 0.8095238095238095, 'recall': 0.8095238095238095, 'f1-score': 0.8095238095238095, 'support': 21}, 'micro avg': {'precision': 0.8205128205128205, 'recall': 0.8205128205128205, 'f1-score': 0.8205128205128205, 'support': 39}, 'macro avg': {'precision': 0.8214285714285714, 'recall': 0.8214285714285714, 'f1-score': 0.8214285714285714, 'support': 39}, 'weighted avg': {'precision': 0.8205128205128205, 'recall': 0.8205128205128205, 'f1-score': 0.8205128205128205, 'support': 39}}
{'C': {'precision': 0.8333333333333334, 'recall': 0.8333333333333334, 'f1-score': 0.8333333333333334, 'support': 18}, 'P': {'precision': 0.8095238095238095, 'recall': 0.8095238095238095, 'f1-score': 0.8095238095238095, 'support': 21}, 'micro avg': {'precision': 0.8205128205128205, 'recall': 0.8205128205128205, 'f1-score': 0.8205128205128205, 'support': 39}, 'macro avg': {'precision': 0.8214285714285714, 'recall': 0.8214285714285714, 'f1-score': 0.8214285714285714, 'support': 39}, 'weighted avg': {'precision': 0.8205128205128205, 'recall': 0.8205128205128205, 'f1-score': 0.8205128205128205, 'support': 39}}
Dev-Data: Prec: 0.821, Rec: 0.821, F1: 0.8205
{'C': {'precision': 0.15565031982942432, 'recall': 0.18159203980099503, 'f1-score': 0.16762342135476463, 'support': 402}, 'P': {'precision': 0.1987179487179487, 'recall': 0.18379446640316205, 'f1-score': 0.19096509240246407, 'support': 506}, 'micro avg': {'precision': 0.17716115261472787, 'recall': 0.1828193832599119, 'f1-score': 0.1799457994579946, 'support': 908}, 'macro avg': {'precision': 0.1771841342736865, 'recall': 0.18269325310207854, 'f1-score': 0.17929425687861433, 'support': 908}, 'weighted avg': {'precision': 0.17965056235981347, 'recall': 0.1828193832599119, 'f1-score': 0.18063100455976014, 'support': 908}}
Wrong BIO-Encoding 80/1012 labels, 7.91%
{'C': {'precision': 0.15565031982942432, 'recall': 0.18159203980099503, 'f1-score': 0.16762342135476463, 'support': 402}, 'P': {'precision': 0.1987179487179487, 'recall': 0.18379446640316205, 'f1-score': 0.19096509240246407, 'support': 506}, 'micro avg': {'precision': 0.17716115261472787, 'recall': 0.1828193832599119, 'f1-score': 0.1799457994579946, 'support': 908}, 'macro avg': {'precision': 0.1771841342736865, 'recall': 0.18269325310207854, 'f1-score': 0.17929425687861433, 'support': 908}, 'weighted avg': {'precision': 0.17965056235981347, 'recall': 0.1828193832599119, 'f1-score': 0.18063100455976014, 'support': 908}}
Wrong BIO-Encoding 5/937 labels, 0.53%
Test-Data: Prec: 0.178, Rec: 0.183, F1: 0.1804

Scores from epoch with best dev-scores:
  Dev-Score: 0.8267
  Test-Score 0.1813

6.04 sec for evaluation

--------- Epoch 45 -----------
338.48 sec for training (15016.71 total)
-- cmv_modes1 --
{'C': {'precision': 0.8235294117647058, 'recall': 0.7777777777777778, 'f1-score': 0.7999999999999999, 'support': 18}, 'P': {'precision': 0.7727272727272727, 'recall': 0.8095238095238095, 'f1-score': 0.7906976744186046, 'support': 21}, 'micro avg': {'precision': 0.7948717948717948, 'recall': 0.7948717948717948, 'f1-score': 0.7948717948717948, 'support': 39}, 'macro avg': {'precision': 0.7981283422459893, 'recall': 0.7936507936507937, 'f1-score': 0.7953488372093023, 'support': 39}, 'weighted avg': {'precision': 0.7961744138214726, 'recall': 0.7948717948717948, 'f1-score': 0.7949910554561717, 'support': 39}}
{'C': {'precision': 0.8235294117647058, 'recall': 0.7777777777777778, 'f1-score': 0.7999999999999999, 'support': 18}, 'P': {'precision': 0.7727272727272727, 'recall': 0.8095238095238095, 'f1-score': 0.7906976744186046, 'support': 21}, 'micro avg': {'precision': 0.7948717948717948, 'recall': 0.7948717948717948, 'f1-score': 0.7948717948717948, 'support': 39}, 'macro avg': {'precision': 0.7981283422459893, 'recall': 0.7936507936507937, 'f1-score': 0.7953488372093023, 'support': 39}, 'weighted avg': {'precision': 0.7961744138214726, 'recall': 0.7948717948717948, 'f1-score': 0.7949910554561717, 'support': 39}}
Dev-Data: Prec: 0.795, Rec: 0.795, F1: 0.7949
{'C': {'precision': 0.1751269035532995, 'recall': 0.17164179104477612, 'f1-score': 0.17336683417085427, 'support': 402}, 'P': {'precision': 0.21226415094339623, 'recall': 0.17786561264822134, 'f1-score': 0.1935483870967742, 'support': 506}, 'micro avg': {'precision': 0.19437652811735942, 'recall': 0.1751101321585903, 'f1-score': 0.1842410196987254, 'support': 908}, 'macro avg': {'precision': 0.19369552724834788, 'recall': 0.17475370184649874, 'f1-score': 0.18345761063381422, 'support': 908}, 'weighted avg': {'precision': 0.1958223299623182, 'recall': 0.1751101321585903, 'f1-score': 0.184613382387281, 'support': 908}}
Wrong BIO-Encoding 102/916 labels, 11.14%
{'C': {'precision': 0.1751269035532995, 'recall': 0.17164179104477612, 'f1-score': 0.17336683417085427, 'support': 402}, 'P': {'precision': 0.21226415094339623, 'recall': 0.17786561264822134, 'f1-score': 0.1935483870967742, 'support': 506}, 'micro avg': {'precision': 0.19437652811735942, 'recall': 0.1751101321585903, 'f1-score': 0.1842410196987254, 'support': 908}, 'macro avg': {'precision': 0.19369552724834788, 'recall': 0.17475370184649874, 'f1-score': 0.18345761063381422, 'support': 908}, 'weighted avg': {'precision': 0.1958223299623182, 'recall': 0.1751101321585903, 'f1-score': 0.184613382387281, 'support': 908}}
Wrong BIO-Encoding 4/818 labels, 0.49%
Test-Data: Prec: 0.195, Rec: 0.175, F1: 0.1847

Scores from epoch with best dev-scores:
  Dev-Score: 0.8267
  Test-Score 0.1813

5.89 sec for evaluation

--------- Epoch 46 -----------
341.52 sec for training (15358.23 total)
-- cmv_modes1 --
{'C': {'precision': 0.875, 'recall': 0.7777777777777778, 'f1-score': 0.823529411764706, 'support': 18}, 'P': {'precision': 0.7272727272727273, 'recall': 0.7619047619047619, 'f1-score': 0.7441860465116279, 'support': 21}, 'micro avg': {'precision': 0.7894736842105263, 'recall': 0.7692307692307693, 'f1-score': 0.7792207792207793, 'support': 39}, 'macro avg': {'precision': 0.8011363636363636, 'recall': 0.7698412698412698, 'f1-score': 0.783857729138167, 'support': 39}, 'weighted avg': {'precision': 0.7954545454545455, 'recall': 0.7692307692307693, 'f1-score': 0.7808060612438178, 'support': 39}}
{'C': {'precision': 0.875, 'recall': 0.7777777777777778, 'f1-score': 0.823529411764706, 'support': 18}, 'P': {'precision': 0.7272727272727273, 'recall': 0.7619047619047619, 'f1-score': 0.7441860465116279, 'support': 21}, 'micro avg': {'precision': 0.7894736842105263, 'recall': 0.7692307692307693, 'f1-score': 0.7792207792207793, 'support': 39}, 'macro avg': {'precision': 0.8011363636363636, 'recall': 0.7698412698412698, 'f1-score': 0.783857729138167, 'support': 39}, 'weighted avg': {'precision': 0.7954545454545455, 'recall': 0.7692307692307693, 'f1-score': 0.7808060612438178, 'support': 39}}
Dev-Data: Prec: 0.789, Rec: 0.769, F1: 0.7792
{'C': {'precision': 0.16444444444444445, 'recall': 0.18407960199004975, 'f1-score': 0.17370892018779344, 'support': 402}, 'P': {'precision': 0.22604422604422605, 'recall': 0.18181818181818182, 'f1-score': 0.20153340635268346, 'support': 506}, 'micro avg': {'precision': 0.19369894982497082, 'recall': 0.1828193832599119, 'f1-score': 0.18810198300283287, 'support': 908}, 'macro avg': {'precision': 0.19524433524433527, 'recall': 0.18294889190411578, 'f1-score': 0.18762116327023845, 'support': 908}, 'weighted avg': {'precision': 0.19877207604079852, 'recall': 0.1828193832599119, 'f1-score': 0.18921463604620134, 'support': 908}}
Wrong BIO-Encoding 292/1133 labels, 25.77%
{'C': {'precision': 0.16444444444444445, 'recall': 0.18407960199004975, 'f1-score': 0.17370892018779344, 'support': 402}, 'P': {'precision': 0.22604422604422605, 'recall': 0.18181818181818182, 'f1-score': 0.20153340635268346, 'support': 506}, 'micro avg': {'precision': 0.19369894982497082, 'recall': 0.1828193832599119, 'f1-score': 0.18810198300283287, 'support': 908}, 'macro avg': {'precision': 0.19524433524433527, 'recall': 0.18294889190411578, 'f1-score': 0.18762116327023845, 'support': 908}, 'weighted avg': {'precision': 0.19877207604079852, 'recall': 0.1828193832599119, 'f1-score': 0.18921463604620134, 'support': 908}}
Wrong BIO-Encoding 16/857 labels, 1.87%
Test-Data: Prec: 0.197, Rec: 0.183, F1: 0.1898

Scores from epoch with best dev-scores:
  Dev-Score: 0.8267
  Test-Score 0.1813

6.09 sec for evaluation

--------- Epoch 47 -----------
341.98 sec for training (15700.21 total)
-- cmv_modes1 --
{'C': {'precision': 0.875, 'recall': 0.7777777777777778, 'f1-score': 0.823529411764706, 'support': 18}, 'P': {'precision': 0.6363636363636364, 'recall': 0.6666666666666666, 'f1-score': 0.6511627906976744, 'support': 21}, 'micro avg': {'precision': 0.7368421052631579, 'recall': 0.717948717948718, 'f1-score': 0.7272727272727273, 'support': 39}, 'macro avg': {'precision': 0.7556818181818181, 'recall': 0.7222222222222222, 'f1-score': 0.7373461012311902, 'support': 39}, 'weighted avg': {'precision': 0.7465034965034965, 'recall': 0.717948717948718, 'f1-score': 0.730716615805535, 'support': 39}}
{'C': {'precision': 0.875, 'recall': 0.7777777777777778, 'f1-score': 0.823529411764706, 'support': 18}, 'P': {'precision': 0.6363636363636364, 'recall': 0.6666666666666666, 'f1-score': 0.6511627906976744, 'support': 21}, 'micro avg': {'precision': 0.7368421052631579, 'recall': 0.717948717948718, 'f1-score': 0.7272727272727273, 'support': 39}, 'macro avg': {'precision': 0.7556818181818181, 'recall': 0.7222222222222222, 'f1-score': 0.7373461012311902, 'support': 39}, 'weighted avg': {'precision': 0.7465034965034965, 'recall': 0.717948717948718, 'f1-score': 0.730716615805535, 'support': 39}}
Dev-Data: Prec: 0.737, Rec: 0.718, F1: 0.7273
{'C': {'precision': 0.16976127320954906, 'recall': 0.15920398009950248, 'f1-score': 0.1643132220795892, 'support': 402}, 'P': {'precision': 0.2330316742081448, 'recall': 0.20355731225296442, 'f1-score': 0.21729957805907174, 'support': 506}, 'micro avg': {'precision': 0.2039072039072039, 'recall': 0.183920704845815, 'f1-score': 0.19339895773016794, 'support': 908}, 'macro avg': {'precision': 0.20139647370884695, 'recall': 0.18138064617623345, 'f1-score': 0.19080640006933047, 'support': 908}, 'weighted avg': {'precision': 0.2050198887440088, 'recall': 0.183920704845815, 'f1-score': 0.19384086098445502, 'support': 908}}
Wrong BIO-Encoding 275/1078 labels, 25.51%
{'C': {'precision': 0.16976127320954906, 'recall': 0.15920398009950248, 'f1-score': 0.1643132220795892, 'support': 402}, 'P': {'precision': 0.2330316742081448, 'recall': 0.20355731225296442, 'f1-score': 0.21729957805907174, 'support': 506}, 'micro avg': {'precision': 0.2039072039072039, 'recall': 0.183920704845815, 'f1-score': 0.19339895773016794, 'support': 908}, 'macro avg': {'precision': 0.20139647370884695, 'recall': 0.18138064617623345, 'f1-score': 0.19080640006933047, 'support': 908}, 'weighted avg': {'precision': 0.2050198887440088, 'recall': 0.183920704845815, 'f1-score': 0.19384086098445502, 'support': 908}}
Wrong BIO-Encoding 16/819 labels, 1.95%
Test-Data: Prec: 0.208, Rec: 0.184, F1: 0.1952

Scores from epoch with best dev-scores:
  Dev-Score: 0.8267
  Test-Score 0.1813

5.98 sec for evaluation

--------- Epoch 48 -----------
340.90 sec for training (16041.11 total)
-- cmv_modes1 --
{'C': {'precision': 0.8125, 'recall': 0.7222222222222222, 'f1-score': 0.7647058823529411, 'support': 18}, 'P': {'precision': 0.6818181818181818, 'recall': 0.7142857142857143, 'f1-score': 0.6976744186046512, 'support': 21}, 'micro avg': {'precision': 0.7368421052631579, 'recall': 0.717948717948718, 'f1-score': 0.7272727272727273, 'support': 39}, 'macro avg': {'precision': 0.7471590909090908, 'recall': 0.7182539682539683, 'f1-score': 0.7311901504787961, 'support': 39}, 'weighted avg': {'precision': 0.7421328671328671, 'recall': 0.717948717948718, 'f1-score': 0.7286120172577082, 'support': 39}}
{'C': {'precision': 0.8125, 'recall': 0.7222222222222222, 'f1-score': 0.7647058823529411, 'support': 18}, 'P': {'precision': 0.6818181818181818, 'recall': 0.7142857142857143, 'f1-score': 0.6976744186046512, 'support': 21}, 'micro avg': {'precision': 0.7368421052631579, 'recall': 0.717948717948718, 'f1-score': 0.7272727272727273, 'support': 39}, 'macro avg': {'precision': 0.7471590909090908, 'recall': 0.7182539682539683, 'f1-score': 0.7311901504787961, 'support': 39}, 'weighted avg': {'precision': 0.7421328671328671, 'recall': 0.717948717948718, 'f1-score': 0.7286120172577082, 'support': 39}}
Dev-Data: Prec: 0.737, Rec: 0.718, F1: 0.7273
{'C': {'precision': 0.1722488038277512, 'recall': 0.1791044776119403, 'f1-score': 0.175609756097561, 'support': 402}, 'P': {'precision': 0.19474835886214442, 'recall': 0.17588932806324112, 'f1-score': 0.18483904465212875, 'support': 506}, 'micro avg': {'precision': 0.184, 'recall': 0.17731277533039647, 'f1-score': 0.18059450364554122, 'support': 908}, 'macro avg': {'precision': 0.18349858134494781, 'recall': 0.1774969028375907, 'f1-score': 0.18022440037484488, 'support': 908}, 'weighted avg': {'precision': 0.1847871021178426, 'recall': 0.17731277533039647, 'f1-score': 0.18075294993964391, 'support': 908}}
Wrong BIO-Encoding 148/1015 labels, 14.58%
{'C': {'precision': 0.1722488038277512, 'recall': 0.1791044776119403, 'f1-score': 0.175609756097561, 'support': 402}, 'P': {'precision': 0.19474835886214442, 'recall': 0.17588932806324112, 'f1-score': 0.18483904465212875, 'support': 506}, 'micro avg': {'precision': 0.184, 'recall': 0.17731277533039647, 'f1-score': 0.18059450364554122, 'support': 908}, 'macro avg': {'precision': 0.18349858134494781, 'recall': 0.1774969028375907, 'f1-score': 0.18022440037484488, 'support': 908}, 'weighted avg': {'precision': 0.1847871021178426, 'recall': 0.17731277533039647, 'f1-score': 0.18075294993964391, 'support': 908}}
Wrong BIO-Encoding 8/875 labels, 0.91%
Test-Data: Prec: 0.186, Rec: 0.177, F1: 0.1814

Scores from epoch with best dev-scores:
  Dev-Score: 0.8267
  Test-Score 0.1813

6.47 sec for evaluation

--------- Epoch 49 -----------
341.57 sec for training (16382.68 total)
-- cmv_modes1 --
{'C': {'precision': 0.8125, 'recall': 0.7222222222222222, 'f1-score': 0.7647058823529411, 'support': 18}, 'P': {'precision': 0.7727272727272727, 'recall': 0.8095238095238095, 'f1-score': 0.7906976744186046, 'support': 21}, 'micro avg': {'precision': 0.7894736842105263, 'recall': 0.7692307692307693, 'f1-score': 0.7792207792207793, 'support': 39}, 'macro avg': {'precision': 0.7926136363636364, 'recall': 0.7658730158730158, 'f1-score': 0.7777017783857729, 'support': 39}, 'weighted avg': {'precision': 0.791083916083916, 'recall': 0.7692307692307693, 'f1-score': 0.7787014626959907, 'support': 39}}
{'C': {'precision': 0.8125, 'recall': 0.7222222222222222, 'f1-score': 0.7647058823529411, 'support': 18}, 'P': {'precision': 0.7727272727272727, 'recall': 0.8095238095238095, 'f1-score': 0.7906976744186046, 'support': 21}, 'micro avg': {'precision': 0.7894736842105263, 'recall': 0.7692307692307693, 'f1-score': 0.7792207792207793, 'support': 39}, 'macro avg': {'precision': 0.7926136363636364, 'recall': 0.7658730158730158, 'f1-score': 0.7777017783857729, 'support': 39}, 'weighted avg': {'precision': 0.791083916083916, 'recall': 0.7692307692307693, 'f1-score': 0.7787014626959907, 'support': 39}}
Dev-Data: Prec: 0.789, Rec: 0.769, F1: 0.7792
{'C': {'precision': 0.17633410672853828, 'recall': 0.1890547263681592, 'f1-score': 0.1824729891956783, 'support': 402}, 'P': {'precision': 0.21095334685598377, 'recall': 0.20553359683794467, 'f1-score': 0.20820820820820818, 'support': 506}, 'micro avg': {'precision': 0.19480519480519481, 'recall': 0.19823788546255505, 'f1-score': 0.1965065502183406, 'support': 908}, 'macro avg': {'precision': 0.19364372679226102, 'recall': 0.19729416160305194, 'f1-score': 0.19534059870194326, 'support': 908}, 'weighted avg': {'precision': 0.1956263264471368, 'recall': 0.19823788546255505, 'f1-score': 0.19681442181719827, 'support': 908}}
Wrong BIO-Encoding 218/1125 labels, 19.38%
{'C': {'precision': 0.17633410672853828, 'recall': 0.1890547263681592, 'f1-score': 0.1824729891956783, 'support': 402}, 'P': {'precision': 0.21095334685598377, 'recall': 0.20553359683794467, 'f1-score': 0.20820820820820818, 'support': 506}, 'micro avg': {'precision': 0.19480519480519481, 'recall': 0.19823788546255505, 'f1-score': 0.1965065502183406, 'support': 908}, 'macro avg': {'precision': 0.19364372679226102, 'recall': 0.19729416160305194, 'f1-score': 0.19534059870194326, 'support': 908}, 'weighted avg': {'precision': 0.1956263264471368, 'recall': 0.19823788546255505, 'f1-score': 0.19681442181719827, 'support': 908}}
Wrong BIO-Encoding 17/924 labels, 1.84%
Test-Data: Prec: 0.197, Rec: 0.197, F1: 0.1972

Scores from epoch with best dev-scores:
  Dev-Score: 0.8267
  Test-Score 0.1813

6.00 sec for evaluation

--------- Epoch 50 -----------
338.60 sec for training (16721.28 total)
-- cmv_modes1 --
{'C': {'precision': 0.8125, 'recall': 0.7222222222222222, 'f1-score': 0.7647058823529411, 'support': 18}, 'P': {'precision': 0.782608695652174, 'recall': 0.8571428571428571, 'f1-score': 0.8181818181818182, 'support': 21}, 'micro avg': {'precision': 0.7948717948717948, 'recall': 0.7948717948717948, 'f1-score': 0.7948717948717948, 'support': 39}, 'macro avg': {'precision': 0.7975543478260869, 'recall': 0.7896825396825397, 'f1-score': 0.7914438502673797, 'support': 39}, 'weighted avg': {'precision': 0.7964046822742475, 'recall': 0.7948717948717948, 'f1-score': 0.7935006170300287, 'support': 39}}
{'C': {'precision': 0.8125, 'recall': 0.7222222222222222, 'f1-score': 0.7647058823529411, 'support': 18}, 'P': {'precision': 0.782608695652174, 'recall': 0.8571428571428571, 'f1-score': 0.8181818181818182, 'support': 21}, 'micro avg': {'precision': 0.7948717948717948, 'recall': 0.7948717948717948, 'f1-score': 0.7948717948717948, 'support': 39}, 'macro avg': {'precision': 0.7975543478260869, 'recall': 0.7896825396825397, 'f1-score': 0.7914438502673797, 'support': 39}, 'weighted avg': {'precision': 0.7964046822742475, 'recall': 0.7948717948717948, 'f1-score': 0.7935006170300287, 'support': 39}}
Dev-Data: Prec: 0.795, Rec: 0.795, F1: 0.7949
{'C': {'precision': 0.14868804664723032, 'recall': 0.12686567164179105, 'f1-score': 0.13691275167785233, 'support': 402}, 'P': {'precision': 0.2088888888888889, 'recall': 0.1857707509881423, 'f1-score': 0.19665271966527195, 'support': 506}, 'micro avg': {'precision': 0.1828499369482976, 'recall': 0.15969162995594713, 'f1-score': 0.17048794826572602, 'support': 908}, 'macro avg': {'precision': 0.17878846776805962, 'recall': 0.15631821131496668, 'f1-score': 0.16678273567156215, 'support': 908}, 'weighted avg': {'precision': 0.18223609309467442, 'recall': 0.15969162995594713, 'f1-score': 0.17020396731841878, 'support': 908}}
Wrong BIO-Encoding 166/948 labels, 17.51%
{'C': {'precision': 0.14868804664723032, 'recall': 0.12686567164179105, 'f1-score': 0.13691275167785233, 'support': 402}, 'P': {'precision': 0.2088888888888889, 'recall': 0.1857707509881423, 'f1-score': 0.19665271966527195, 'support': 506}, 'micro avg': {'precision': 0.1828499369482976, 'recall': 0.15969162995594713, 'f1-score': 0.17048794826572602, 'support': 908}, 'macro avg': {'precision': 0.17878846776805962, 'recall': 0.15631821131496668, 'f1-score': 0.16678273567156215, 'support': 908}, 'weighted avg': {'precision': 0.18223609309467442, 'recall': 0.15969162995594713, 'f1-score': 0.17020396731841878, 'support': 908}}
Wrong BIO-Encoding 11/793 labels, 1.39%
Test-Data: Prec: 0.185, Rec: 0.160, F1: 0.1716

Scores from epoch with best dev-scores:
  Dev-Score: 0.8267
  Test-Score 0.1813

6.37 sec for evaluation
Cleaning up...

--Train size: 50 Test size: 50--

---------RUN 1 ------------
Generate new embeddings files for a dataset
Read file: komninos_english_embeddings.gz
Added words: 10
:: Transform cmv_modes dataset ::
:: Create Train Matrix ::
Unknown-Tokens: 0.84%
:: Create Dev Matrix ::
Unknown-Tokens: 1.19%
:: Create Test Matrix ::
Unknown-Tokens: 0.94%
:: Transform cmv_modes1 dataset ::
:: Create Train Matrix ::
Unknown-Tokens: 0.84%
:: Create Dev Matrix ::
Unknown-Tokens: 1.19%
:: Create Test Matrix ::
Unknown-Tokens: 0.94%
:: Transform cmv_modes2 dataset ::
:: Create Train Matrix ::
Unknown-Tokens: 0.84%
:: Create Dev Matrix ::
Unknown-Tokens: 1.19%
:: Create Test Matrix ::
Unknown-Tokens: 0.94%
DONE - Embeddings file saved: pkl/cmv_modes_cmv_modes1_cmv_modes2_komninos_english_embeddings.pkl
--- cmv_modes ---
224 train sentences
3 dev sentences
232 test sentences
--- cmv_modes1 ---
224 train sentences
3 dev sentences
232 test sentences
--- cmv_modes2 ---
224 train sentences
3 dev sentences
232 test sentences
LSTM-Size: [100]
_____________________________________________________________________________________________________________________________
Layer (type)                             Output Shape               Param #        Connected to                              
=============================================================================================================================
words_input (InputLayer)                 (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
casing_input (InputLayer)                (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
word_embeddings (Embedding)              (None, None, 300)          66694800       words_input[0][0]                         
_____________________________________________________________________________________________________________________________
casing_emebddings (Embedding)            (None, None, 10)           80             casing_input[0][0]                        
_____________________________________________________________________________________________________________________________
concatenate_1 (Concatenate)              (None, None, 310)          0              word_embeddings[0][0]                     
                                                                                   casing_emebddings[0][0]                   
_____________________________________________________________________________________________________________________________
shared_varLSTM_1 (Bidirectional)         (None, None, 200)          328800         concatenate_1[0][0]                       
_____________________________________________________________________________________________________________________________
cmv_modes_hidden_lin_layer (TimeDistribu (None, None, 287)          57687          shared_varLSTM_1[0][0]                    
_____________________________________________________________________________________________________________________________
cmv_modes_crf (ChainCRF)                 (None, None, 287)          82943          cmv_modes_hidden_lin_layer[0][0]          
=============================================================================================================================
Total params: 67,164,310
Trainable params: 469,510
Non-trainable params: 66,694,800
_____________________________________________________________________________________________________________________________
_____________________________________________________________________________________________________________________________
Layer (type)                             Output Shape               Param #        Connected to                              
=============================================================================================================================
words_input (InputLayer)                 (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
casing_input (InputLayer)                (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
word_embeddings (Embedding)              (None, None, 300)          66694800       words_input[0][0]                         
_____________________________________________________________________________________________________________________________
casing_emebddings (Embedding)            (None, None, 10)           80             casing_input[0][0]                        
_____________________________________________________________________________________________________________________________
concatenate_1 (Concatenate)              (None, None, 310)          0              word_embeddings[0][0]                     
                                                                                   casing_emebddings[0][0]                   
_____________________________________________________________________________________________________________________________
shared_varLSTM_1 (Bidirectional)         (None, None, 200)          328800         concatenate_1[0][0]                       
_____________________________________________________________________________________________________________________________
cmv_modes1_hidden_lin_layer (TimeDistrib (None, None, 5)            1005           shared_varLSTM_1[0][0]                    
_____________________________________________________________________________________________________________________________
cmv_modes1_crf (ChainCRF)                (None, None, 5)            35             cmv_modes1_hidden_lin_layer[0][0]         
=============================================================================================================================
Total params: 67,024,720
Trainable params: 329,920
Non-trainable params: 66,694,800
_____________________________________________________________________________________________________________________________
_____________________________________________________________________________________________________________________________
Layer (type)                             Output Shape               Param #        Connected to                              
=============================================================================================================================
words_input (InputLayer)                 (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
casing_input (InputLayer)                (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
word_embeddings (Embedding)              (None, None, 300)          66694800       words_input[0][0]                         
_____________________________________________________________________________________________________________________________
casing_emebddings (Embedding)            (None, None, 10)           80             casing_input[0][0]                        
_____________________________________________________________________________________________________________________________
concatenate_1 (Concatenate)              (None, None, 310)          0              word_embeddings[0][0]                     
                                                                                   casing_emebddings[0][0]                   
_____________________________________________________________________________________________________________________________
shared_varLSTM_1 (Bidirectional)         (None, None, 200)          328800         concatenate_1[0][0]                       
_____________________________________________________________________________________________________________________________
cmv_modes2_softmax (TimeDistributed)     (None, None, 119)          23919          shared_varLSTM_1[0][0]                    
=============================================================================================================================
Total params: 67,047,599
Trainable params: 352,799
Non-trainable params: 66,694,800
_____________________________________________________________________________________________________________________________

--------- Epoch 1 -----------
251.40 sec for training (251.40 total)
-- cmv_modes1 --



{'C': {'precision': 0.011764705882352941, 'recall': 0.06666666666666667, 'f1-score': 0.02, 'support': 15}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 6}, 'micro avg': {'precision': 0.011764705882352941, 'recall': 0.047619047619047616, 'f1-score': 0.018867924528301886, 'support': 21}, 'macro avg': {'precision': 0.0058823529411764705, 'recall': 0.03333333333333333, 'f1-score': 0.01, 'support': 21}, 'weighted avg': {'precision': 0.008403361344537815, 'recall': 0.047619047619047616, 'f1-score': 0.014285714285714285, 'support': 21}}
Token level accuracy: 0.337295690936107
Wrong BIO-Encoding 587/588 labels, 99.83%



{'C': {'precision': 0.011764705882352941, 'recall': 0.06666666666666667, 'f1-score': 0.02, 'support': 15}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 6}, 'micro avg': {'precision': 0.011764705882352941, 'recall': 0.047619047619047616, 'f1-score': 0.018867924528301886, 'support': 21}, 'macro avg': {'precision': 0.0058823529411764705, 'recall': 0.03333333333333333, 'f1-score': 0.01, 'support': 21}, 'weighted avg': {'precision': 0.008403361344537815, 'recall': 0.047619047619047616, 'f1-score': 0.014285714285714285, 'support': 21}}
Token level accuracy: 0.337295690936107
Wrong BIO-Encoding 84/85 labels, 98.82%
Dev-Data: Prec: 0.012, Rec: 0.048, F1: 0.0189



{'C': {'precision': 0.03253383994300641, 'recall': 0.17723156532988357, 'f1-score': 0.05497592295345105, 'support': 773}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 948}, 'micro avg': {'precision': 0.032472149798530456, 'recall': 0.07960488088320744, 'f1-score': 0.04612794612794612, 'support': 1721}, 'macro avg': {'precision': 0.016266919971503205, 'recall': 0.08861578266494179, 'f1-score': 0.027487961476725525, 'support': 1721}, 'weighted avg': {'precision': 0.014612817127219032, 'recall': 0.07960488088320744, 'f1-score': 0.024692846277174704, 'support': 1721}}
Token level accuracy: 0.3167863300651072
Wrong BIO-Encoding 34242/34282 labels, 99.88%



{'C': {'precision': 0.03253383994300641, 'recall': 0.17723156532988357, 'f1-score': 0.05497592295345105, 'support': 773}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 948}, 'micro avg': {'precision': 0.032472149798530456, 'recall': 0.07960488088320744, 'f1-score': 0.04612794612794612, 'support': 1721}, 'macro avg': {'precision': 0.016266919971503205, 'recall': 0.08861578266494179, 'f1-score': 0.027487961476725525, 'support': 1721}, 'weighted avg': {'precision': 0.014612817127219032, 'recall': 0.07960488088320744, 'f1-score': 0.024692846277174704, 'support': 1721}}
Token level accuracy: 0.3167863300651072
Wrong BIO-Encoding 4179/4219 labels, 99.05%
Test-Data: Prec: 0.032, Rec: 0.080, F1: 0.0461

Scores from epoch with best dev-scores:
  Dev-Score: 0.0189
  Test-Score 0.0461

10.11 sec for evaluation

--------- Epoch 2 -----------
237.00 sec for training (488.40 total)
-- cmv_modes1 --



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 15}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 6}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 21}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 21}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 21}}
Token level accuracy: 0.1426448736998514
Wrong BIO-Encoding 488/494 labels, 98.79%



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 15}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 6}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 21}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 21}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 21}}
Token level accuracy: 0.1426448736998514
Wrong BIO-Encoding 13/19 labels, 68.42%
Dev-Data: Prec: 0.000, Rec: 0.000, F1: 0.0000



{'C': {'precision': 0.021739130434782608, 'recall': 0.018111254851228976, 'f1-score': 0.01976005645730416, 'support': 773}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 948}, 'micro avg': {'precision': 0.014418125643666324, 'recall': 0.008134805345729227, 'f1-score': 0.010401188707280832, 'support': 1721}, 'macro avg': {'precision': 0.010869565217391304, 'recall': 0.009055627425614488, 'f1-score': 0.00988002822865208, 'support': 1721}, 'weighted avg': {'precision': 0.009764292751938963, 'recall': 0.008134805345729227, 'f1-score': 0.008875376898022149, 'support': 1721}}
Token level accuracy: 0.4564450963740704
Wrong BIO-Encoding 28084/28336 labels, 99.11%



{'C': {'precision': 0.021739130434782608, 'recall': 0.018111254851228976, 'f1-score': 0.01976005645730416, 'support': 773}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 948}, 'micro avg': {'precision': 0.014418125643666324, 'recall': 0.008134805345729227, 'f1-score': 0.010401188707280832, 'support': 1721}, 'macro avg': {'precision': 0.010869565217391304, 'recall': 0.009055627425614488, 'f1-score': 0.00988002822865208, 'support': 1721}, 'weighted avg': {'precision': 0.009764292751938963, 'recall': 0.008134805345729227, 'f1-score': 0.008875376898022149, 'support': 1721}}
Token level accuracy: 0.4564450963740704
Wrong BIO-Encoding 719/971 labels, 74.05%
Test-Data: Prec: 0.014, Rec: 0.008, F1: 0.0104

Scores from epoch with best dev-scores:
  Dev-Score: 0.0189
  Test-Score 0.0461

9.66 sec for evaluation

--------- Epoch 3 -----------
236.89 sec for training (725.29 total)
-- cmv_modes1 --



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 15}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 6}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 21}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 21}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 21}}
Token level accuracy: 0.19910846953937592
Wrong BIO-Encoding 297/306 labels, 97.06%



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 15}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 6}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 21}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 21}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 21}}
Token level accuracy: 0.19910846953937592
Wrong BIO-Encoding 4/13 labels, 30.77%
Dev-Data: Prec: 0.000, Rec: 0.000, F1: 0.0000



{'C': {'precision': 0.027124773960216998, 'recall': 0.019404915912031046, 'f1-score': 0.02262443438914027, 'support': 773}, 'P': {'precision': 0.00749063670411985, 'recall': 0.002109704641350211, 'f1-score': 0.003292181069958848, 'support': 948}, 'micro avg': {'precision': 0.020731707317073172, 'recall': 0.009877977919814061, 'f1-score': 0.013380558835104289, 'support': 1721}, 'macro avg': {'precision': 0.017307705332168424, 'recall': 0.010757310276690628, 'f1-score': 0.01295830772954956, 'support': 1721}, 'weighted avg': {'precision': 0.016309456052732922, 'recall': 0.00987797791981406, 'f1-score': 0.01197540699426288, 'support': 1721}}
Token level accuracy: 0.4757971126379989
Wrong BIO-Encoding 25869/26310 labels, 98.32%



{'C': {'precision': 0.027124773960216998, 'recall': 0.019404915912031046, 'f1-score': 0.02262443438914027, 'support': 773}, 'P': {'precision': 0.00749063670411985, 'recall': 0.002109704641350211, 'f1-score': 0.003292181069958848, 'support': 948}, 'micro avg': {'precision': 0.020731707317073172, 'recall': 0.009877977919814061, 'f1-score': 0.013380558835104289, 'support': 1721}, 'macro avg': {'precision': 0.017307705332168424, 'recall': 0.010757310276690628, 'f1-score': 0.01295830772954956, 'support': 1721}, 'weighted avg': {'precision': 0.016309456052732922, 'recall': 0.00987797791981406, 'f1-score': 0.01197540699426288, 'support': 1721}}
Token level accuracy: 0.4757971126379989
Wrong BIO-Encoding 379/820 labels, 46.22%
Test-Data: Prec: 0.039, Rec: 0.010, F1: 0.0157

Scores from epoch with best dev-scores:
  Dev-Score: 0.0189
  Test-Score 0.0461

9.58 sec for evaluation

--------- Epoch 4 -----------
236.89 sec for training (962.18 total)
-- cmv_modes1 --



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 15}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 6}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 21}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 21}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 21}}
Token level accuracy: 0.300148588410104
Wrong BIO-Encoding 67/85 labels, 78.82%



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 15}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 6}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 21}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 21}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 21}}
Token level accuracy: 0.300148588410104
Wrong BIO-Encoding 7/25 labels, 28.00%
Dev-Data: Prec: 0.000, Rec: 0.000, F1: 0.0000



{'C': {'precision': 0.0427807486631016, 'recall': 0.04139715394566624, 'f1-score': 0.042077580539119, 'support': 773}, 'P': {'precision': 0.008333333333333333, 'recall': 0.0031645569620253164, 'f1-score': 0.0045871559633027525, 'support': 948}, 'micro avg': {'precision': 0.0315884476534296, 'recall': 0.02033701336432307, 'f1-score': 0.024743725698126547, 'support': 1721}, 'macro avg': {'precision': 0.025557040998217467, 'recall': 0.02228085545384578, 'f1-score': 0.023332368251210878, 'support': 1721}, 'weighted avg': {'precision': 0.023805647133397757, 'recall': 0.02033701336432307, 'f1-score': 0.021426260087129573, 'support': 1721}}
Token level accuracy: 0.5099462158058622
Wrong BIO-Encoding 17705/18247 labels, 97.03%



{'C': {'precision': 0.0427807486631016, 'recall': 0.04139715394566624, 'f1-score': 0.042077580539119, 'support': 773}, 'P': {'precision': 0.008333333333333333, 'recall': 0.0031645569620253164, 'f1-score': 0.0045871559633027525, 'support': 948}, 'micro avg': {'precision': 0.0315884476534296, 'recall': 0.02033701336432307, 'f1-score': 0.024743725698126547, 'support': 1721}, 'macro avg': {'precision': 0.025557040998217467, 'recall': 0.02228085545384578, 'f1-score': 0.023332368251210878, 'support': 1721}, 'weighted avg': {'precision': 0.023805647133397757, 'recall': 0.02033701336432307, 'f1-score': 0.021426260087129573, 'support': 1721}}
Token level accuracy: 0.5099462158058622
Wrong BIO-Encoding 566/1108 labels, 51.08%
Test-Data: Prec: 0.061, Rec: 0.019, F1: 0.0292

Scores from epoch with best dev-scores:
  Dev-Score: 0.0189
  Test-Score 0.0461

9.51 sec for evaluation

--------- Epoch 5 -----------
233.32 sec for training (1195.50 total)
-- cmv_modes1 --



{'C': {'precision': 0.07407407407407407, 'recall': 0.13333333333333333, 'f1-score': 0.09523809523809523, 'support': 15}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 6}, 'micro avg': {'precision': 0.047619047619047616, 'recall': 0.09523809523809523, 'f1-score': 0.06349206349206349, 'support': 21}, 'macro avg': {'precision': 0.037037037037037035, 'recall': 0.06666666666666667, 'f1-score': 0.047619047619047616, 'support': 21}, 'weighted avg': {'precision': 0.052910052910052914, 'recall': 0.09523809523809523, 'f1-score': 0.06802721088435373, 'support': 21}}
Token level accuracy: 0.4011887072808321
Wrong BIO-Encoding 112/136 labels, 82.35%



{'C': {'precision': 0.07407407407407407, 'recall': 0.13333333333333333, 'f1-score': 0.09523809523809523, 'support': 15}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 6}, 'micro avg': {'precision': 0.047619047619047616, 'recall': 0.09523809523809523, 'f1-score': 0.06349206349206349, 'support': 21}, 'macro avg': {'precision': 0.037037037037037035, 'recall': 0.06666666666666667, 'f1-score': 0.047619047619047616, 'support': 21}, 'weighted avg': {'precision': 0.052910052910052914, 'recall': 0.09523809523809523, 'f1-score': 0.06802721088435373, 'support': 21}}
Token level accuracy: 0.4011887072808321
Wrong BIO-Encoding 18/42 labels, 42.86%
Dev-Data: Prec: 0.083, Rec: 0.095, F1: 0.0889



{'C': {'precision': 0.07663782447466007, 'recall': 0.08020698576972833, 'f1-score': 0.07838179519595449, 'support': 773}, 'P': {'precision': 0.009523809523809525, 'recall': 0.004219409282700422, 'f1-score': 0.005847953216374268, 'support': 948}, 'micro avg': {'precision': 0.05370219690805533, 'recall': 0.03834979662986636, 'f1-score': 0.044745762711864416, 'support': 1721}, 'macro avg': {'precision': 0.0430808169992348, 'recall': 0.04221319752621438, 'f1-score': 0.04211487420616438, 'support': 1721}, 'weighted avg': {'precision': 0.03966857045176273, 'recall': 0.03834979662986636, 'f1-score': 0.038427069921903326, 'support': 1721}}
Token level accuracy: 0.5362721634627757
Wrong BIO-Encoding 10420/11191 labels, 93.11%



{'C': {'precision': 0.07663782447466007, 'recall': 0.08020698576972833, 'f1-score': 0.07838179519595449, 'support': 773}, 'P': {'precision': 0.009523809523809525, 'recall': 0.004219409282700422, 'f1-score': 0.005847953216374268, 'support': 948}, 'micro avg': {'precision': 0.05370219690805533, 'recall': 0.03834979662986636, 'f1-score': 0.044745762711864416, 'support': 1721}, 'macro avg': {'precision': 0.0430808169992348, 'recall': 0.04221319752621438, 'f1-score': 0.04211487420616438, 'support': 1721}, 'weighted avg': {'precision': 0.03966857045176273, 'recall': 0.03834979662986636, 'f1-score': 0.038427069921903326, 'support': 1721}}
Token level accuracy: 0.5362721634627757
Wrong BIO-Encoding 458/1229 labels, 37.27%
Test-Data: Prec: 0.083, Rec: 0.037, F1: 0.0514

Scores from epoch with best dev-scores:
  Dev-Score: 0.0889
  Test-Score 0.0514

8.53 sec for evaluation

--------- Epoch 6 -----------
228.49 sec for training (1423.99 total)
-- cmv_modes1 --



{'C': {'precision': 0.2, 'recall': 0.26666666666666666, 'f1-score': 0.2285714285714286, 'support': 15}, 'P': {'precision': 0.1111111111111111, 'recall': 0.16666666666666666, 'f1-score': 0.13333333333333333, 'support': 6}, 'micro avg': {'precision': 0.1724137931034483, 'recall': 0.23809523809523808, 'f1-score': 0.19999999999999998, 'support': 21}, 'macro avg': {'precision': 0.15555555555555556, 'recall': 0.21666666666666667, 'f1-score': 0.18095238095238098, 'support': 21}, 'weighted avg': {'precision': 0.1746031746031746, 'recall': 0.23809523809523808, 'f1-score': 0.20136054421768707, 'support': 21}}
Token level accuracy: 0.4962852897473997
Wrong BIO-Encoding 165/184 labels, 89.67%



{'C': {'precision': 0.2, 'recall': 0.26666666666666666, 'f1-score': 0.2285714285714286, 'support': 15}, 'P': {'precision': 0.1111111111111111, 'recall': 0.16666666666666666, 'f1-score': 0.13333333333333333, 'support': 6}, 'micro avg': {'precision': 0.1724137931034483, 'recall': 0.23809523809523808, 'f1-score': 0.19999999999999998, 'support': 21}, 'macro avg': {'precision': 0.15555555555555556, 'recall': 0.21666666666666667, 'f1-score': 0.18095238095238098, 'support': 21}, 'weighted avg': {'precision': 0.1746031746031746, 'recall': 0.23809523809523808, 'f1-score': 0.20136054421768707, 'support': 21}}
Token level accuracy: 0.4962852897473997
Wrong BIO-Encoding 10/29 labels, 34.48%
Dev-Data: Prec: 0.263, Rec: 0.238, F1: 0.2500



{'C': {'precision': 0.09278350515463918, 'recall': 0.12807244501940493, 'f1-score': 0.10760869565217392, 'support': 773}, 'P': {'precision': 0.060903732809430254, 'recall': 0.03270042194092827, 'f1-score': 0.0425531914893617, 'support': 948}, 'micro avg': {'precision': 0.08248730964467005, 'recall': 0.07553747821034282, 'f1-score': 0.07885956930542917, 'support': 1721}, 'macro avg': {'precision': 0.07684361898203472, 'recall': 0.08038643348016661, 'f1-score': 0.0750809435707678, 'support': 1721}, 'weighted avg': {'precision': 0.0752227705914445, 'recall': 0.07553747821034285, 'f1-score': 0.07177335692681308, 'support': 1721}}
Token level accuracy: 0.5449445430916905
Wrong BIO-Encoding 9451/10516 labels, 89.87%



{'C': {'precision': 0.09278350515463918, 'recall': 0.12807244501940493, 'f1-score': 0.10760869565217392, 'support': 773}, 'P': {'precision': 0.060903732809430254, 'recall': 0.03270042194092827, 'f1-score': 0.0425531914893617, 'support': 948}, 'micro avg': {'precision': 0.08248730964467005, 'recall': 0.07553747821034282, 'f1-score': 0.07885956930542917, 'support': 1721}, 'macro avg': {'precision': 0.07684361898203472, 'recall': 0.08038643348016661, 'f1-score': 0.0750809435707678, 'support': 1721}, 'weighted avg': {'precision': 0.0752227705914445, 'recall': 0.07553747821034285, 'f1-score': 0.07177335692681308, 'support': 1721}}
Token level accuracy: 0.5449445430916905
Wrong BIO-Encoding 511/1576 labels, 32.42%
Test-Data: Prec: 0.120, Rec: 0.074, F1: 0.0919

Scores from epoch with best dev-scores:
  Dev-Score: 0.2500
  Test-Score 0.0919

8.57 sec for evaluation

--------- Epoch 7 -----------
227.98 sec for training (1651.97 total)
-- cmv_modes1 --



{'C': {'precision': 0.18181818181818182, 'recall': 0.13333333333333333, 'f1-score': 0.15384615384615383, 'support': 15}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 6}, 'micro avg': {'precision': 0.11764705882352941, 'recall': 0.09523809523809523, 'f1-score': 0.10526315789473684, 'support': 21}, 'macro avg': {'precision': 0.09090909090909091, 'recall': 0.06666666666666667, 'f1-score': 0.07692307692307691, 'support': 21}, 'weighted avg': {'precision': 0.12987012987012989, 'recall': 0.09523809523809523, 'f1-score': 0.10989010989010987, 'support': 21}}
Token level accuracy: 0.5854383358098069
Wrong BIO-Encoding 38/51 labels, 74.51%



{'C': {'precision': 0.18181818181818182, 'recall': 0.13333333333333333, 'f1-score': 0.15384615384615383, 'support': 15}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 6}, 'micro avg': {'precision': 0.11764705882352941, 'recall': 0.09523809523809523, 'f1-score': 0.10526315789473684, 'support': 21}, 'macro avg': {'precision': 0.09090909090909091, 'recall': 0.06666666666666667, 'f1-score': 0.07692307692307691, 'support': 21}, 'weighted avg': {'precision': 0.12987012987012989, 'recall': 0.09523809523809523, 'f1-score': 0.10989010989010987, 'support': 21}}
Token level accuracy: 0.5854383358098069
Wrong BIO-Encoding 4/17 labels, 23.53%
Dev-Data: Prec: 0.154, Rec: 0.095, F1: 0.1176



{'C': {'precision': 0.09859154929577464, 'recall': 0.09961190168175937, 'f1-score': 0.0990990990990991, 'support': 773}, 'P': {'precision': 0.12992125984251968, 'recall': 0.10443037974683544, 'f1-score': 0.11578947368421051, 'support': 948}, 'micro avg': {'precision': 0.11406351263771873, 'recall': 0.10226612434631029, 'f1-score': 0.10784313725490197, 'support': 1721}, 'macro avg': {'precision': 0.11425640456914715, 'recall': 0.10202114071429741, 'f1-score': 0.1074442863916548, 'support': 1721}, 'weighted avg': {'precision': 0.11584928642437098, 'recall': 0.10226612434631029, 'f1-score': 0.10829286731913723, 'support': 1721}}
Token level accuracy: 0.5564734038446691
Wrong BIO-Encoding 4138/5410 labels, 76.49%



{'C': {'precision': 0.09859154929577464, 'recall': 0.09961190168175937, 'f1-score': 0.0990990990990991, 'support': 773}, 'P': {'precision': 0.12992125984251968, 'recall': 0.10443037974683544, 'f1-score': 0.11578947368421051, 'support': 948}, 'micro avg': {'precision': 0.11406351263771873, 'recall': 0.10226612434631029, 'f1-score': 0.10784313725490197, 'support': 1721}, 'macro avg': {'precision': 0.11425640456914715, 'recall': 0.10202114071429741, 'f1-score': 0.1074442863916548, 'support': 1721}, 'weighted avg': {'precision': 0.11584928642437098, 'recall': 0.10226612434631029, 'f1-score': 0.10829286731913723, 'support': 1721}}
Token level accuracy: 0.5564734038446691
Wrong BIO-Encoding 271/1543 labels, 17.56%
Test-Data: Prec: 0.138, Rec: 0.102, F1: 0.1176

Scores from epoch with best dev-scores:
  Dev-Score: 0.2500
  Test-Score 0.0919

8.56 sec for evaluation

--------- Epoch 8 -----------
231.53 sec for training (1883.50 total)
-- cmv_modes1 --



{'C': {'precision': 0.16666666666666666, 'recall': 0.2, 'f1-score': 0.1818181818181818, 'support': 15}, 'P': {'precision': 0.1, 'recall': 0.16666666666666666, 'f1-score': 0.125, 'support': 6}, 'micro avg': {'precision': 0.14285714285714285, 'recall': 0.19047619047619047, 'f1-score': 0.16326530612244897, 'support': 21}, 'macro avg': {'precision': 0.13333333333333333, 'recall': 0.18333333333333335, 'f1-score': 0.15340909090909088, 'support': 21}, 'weighted avg': {'precision': 0.14761904761904762, 'recall': 0.19047619047619047, 'f1-score': 0.16558441558441558, 'support': 21}}
Token level accuracy: 0.5453194650817236
Wrong BIO-Encoding 13/39 labels, 33.33%



{'C': {'precision': 0.16666666666666666, 'recall': 0.2, 'f1-score': 0.1818181818181818, 'support': 15}, 'P': {'precision': 0.1, 'recall': 0.16666666666666666, 'f1-score': 0.125, 'support': 6}, 'micro avg': {'precision': 0.14285714285714285, 'recall': 0.19047619047619047, 'f1-score': 0.16326530612244897, 'support': 21}, 'macro avg': {'precision': 0.13333333333333333, 'recall': 0.18333333333333335, 'f1-score': 0.15340909090909088, 'support': 21}, 'weighted avg': {'precision': 0.14761904761904762, 'recall': 0.19047619047619047, 'f1-score': 0.16558441558441558, 'support': 21}}
Token level accuracy: 0.5453194650817236
Wrong BIO-Encoding 2/28 labels, 7.14%
Dev-Data: Prec: 0.154, Rec: 0.190, F1: 0.1702



{'C': {'precision': 0.12095808383233533, 'recall': 0.13065976714100905, 'f1-score': 0.12562189054726366, 'support': 773}, 'P': {'precision': 0.1476407914764079, 'recall': 0.10232067510548523, 'f1-score': 0.12087227414330218, 'support': 948}, 'micro avg': {'precision': 0.13270777479892762, 'recall': 0.11504938988959908, 'f1-score': 0.12324929971988795, 'support': 1721}, 'macro avg': {'precision': 0.13429943765437163, 'recall': 0.11649022112324714, 'f1-score': 0.12324708234528292, 'support': 1721}, 'weighted avg': {'precision': 0.13565605410925619, 'recall': 0.11504938988959908, 'f1-score': 0.12300559981457598, 'support': 1721}}
Token level accuracy: 0.5559072544326925
Wrong BIO-Encoding 5202/6477 labels, 80.31%



{'C': {'precision': 0.12095808383233533, 'recall': 0.13065976714100905, 'f1-score': 0.12562189054726366, 'support': 773}, 'P': {'precision': 0.1476407914764079, 'recall': 0.10232067510548523, 'f1-score': 0.12087227414330218, 'support': 948}, 'micro avg': {'precision': 0.13270777479892762, 'recall': 0.11504938988959908, 'f1-score': 0.12324929971988795, 'support': 1721}, 'macro avg': {'precision': 0.13429943765437163, 'recall': 0.11649022112324714, 'f1-score': 0.12324708234528292, 'support': 1721}, 'weighted avg': {'precision': 0.13565605410925619, 'recall': 0.11504938988959908, 'f1-score': 0.12300559981457598, 'support': 1721}}
Token level accuracy: 0.5559072544326925
Wrong BIO-Encoding 217/1492 labels, 14.54%
Test-Data: Prec: 0.155, Rec: 0.114, F1: 0.1315

Scores from epoch with best dev-scores:
  Dev-Score: 0.2500
  Test-Score 0.0919

8.66 sec for evaluation

--------- Epoch 9 -----------
235.82 sec for training (2119.32 total)
-- cmv_modes1 --



{'C': {'precision': 0.25, 'recall': 0.13333333333333333, 'f1-score': 0.1739130434782609, 'support': 15}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 6}, 'micro avg': {'precision': 0.14285714285714285, 'recall': 0.09523809523809523, 'f1-score': 0.11428571428571427, 'support': 21}, 'macro avg': {'precision': 0.125, 'recall': 0.06666666666666667, 'f1-score': 0.08695652173913045, 'support': 21}, 'weighted avg': {'precision': 0.17857142857142858, 'recall': 0.09523809523809523, 'f1-score': 0.12422360248447208, 'support': 21}}
Token level accuracy: 0.6508172362555721
Wrong BIO-Encoding 26/38 labels, 68.42%



{'C': {'precision': 0.25, 'recall': 0.13333333333333333, 'f1-score': 0.1739130434782609, 'support': 15}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 6}, 'micro avg': {'precision': 0.14285714285714285, 'recall': 0.09523809523809523, 'f1-score': 0.11428571428571427, 'support': 21}, 'macro avg': {'precision': 0.125, 'recall': 0.06666666666666667, 'f1-score': 0.08695652173913045, 'support': 21}, 'weighted avg': {'precision': 0.17857142857142858, 'recall': 0.09523809523809523, 'f1-score': 0.12422360248447208, 'support': 21}}
Token level accuracy: 0.6508172362555721
Wrong BIO-Encoding 2/14 labels, 14.29%
Dev-Data: Prec: 0.167, Rec: 0.095, F1: 0.1212



{'C': {'precision': 0.12100840336134454, 'recall': 0.09314359637774904, 'f1-score': 0.10526315789473685, 'support': 773}, 'P': {'precision': 0.19609756097560976, 'recall': 0.2120253164556962, 'f1-score': 0.20375063355296505, 'support': 948}, 'micro avg': {'precision': 0.1685185185185185, 'recall': 0.15862870424171993, 'f1-score': 0.16342412451361868, 'support': 1721}, 'macro avg': {'precision': 0.15855298216847716, 'recall': 0.1525844564167226, 'f1-score': 0.15450689572385096, 'support': 1721}, 'weighted avg': {'precision': 0.16237070517326985, 'recall': 0.15862870424171993, 'f1-score': 0.15951424849555051, 'support': 1721}}
Token level accuracy: 0.5634473352376541
Wrong BIO-Encoding 2804/4244 labels, 66.07%



{'C': {'precision': 0.12100840336134454, 'recall': 0.09314359637774904, 'f1-score': 0.10526315789473685, 'support': 773}, 'P': {'precision': 0.19609756097560976, 'recall': 0.2120253164556962, 'f1-score': 0.20375063355296505, 'support': 948}, 'micro avg': {'precision': 0.1685185185185185, 'recall': 0.15862870424171993, 'f1-score': 0.16342412451361868, 'support': 1721}, 'macro avg': {'precision': 0.15855298216847716, 'recall': 0.1525844564167226, 'f1-score': 0.15450689572385096, 'support': 1721}, 'weighted avg': {'precision': 0.16237070517326985, 'recall': 0.15862870424171993, 'f1-score': 0.15951424849555051, 'support': 1721}}
Token level accuracy: 0.5634473352376541
Wrong BIO-Encoding 180/1620 labels, 11.11%
Test-Data: Prec: 0.190, Rec: 0.159, F1: 0.1727

Scores from epoch with best dev-scores:
  Dev-Score: 0.2500
  Test-Score 0.0919

9.22 sec for evaluation

--------- Epoch 10 -----------
237.20 sec for training (2356.52 total)
-- cmv_modes1 --



{'C': {'precision': 0.11764705882352941, 'recall': 0.13333333333333333, 'f1-score': 0.125, 'support': 15}, 'P': {'precision': 0.14285714285714285, 'recall': 0.16666666666666666, 'f1-score': 0.15384615384615383, 'support': 6}, 'micro avg': {'precision': 0.125, 'recall': 0.14285714285714285, 'f1-score': 0.13333333333333333, 'support': 21}, 'macro avg': {'precision': 0.13025210084033612, 'recall': 0.15, 'f1-score': 0.13942307692307693, 'support': 21}, 'weighted avg': {'precision': 0.12484993997599039, 'recall': 0.14285714285714285, 'f1-score': 0.13324175824175824, 'support': 21}}
Token level accuracy: 0.6478454680534919
Wrong BIO-Encoding 18/40 labels, 45.00%



{'C': {'precision': 0.11764705882352941, 'recall': 0.13333333333333333, 'f1-score': 0.125, 'support': 15}, 'P': {'precision': 0.14285714285714285, 'recall': 0.16666666666666666, 'f1-score': 0.15384615384615383, 'support': 6}, 'micro avg': {'precision': 0.125, 'recall': 0.14285714285714285, 'f1-score': 0.13333333333333333, 'support': 21}, 'macro avg': {'precision': 0.13025210084033612, 'recall': 0.15, 'f1-score': 0.13942307692307693, 'support': 21}, 'weighted avg': {'precision': 0.12484993997599039, 'recall': 0.14285714285714285, 'f1-score': 0.13324175824175824, 'support': 21}}
Token level accuracy: 0.6478454680534919
Wrong BIO-Encoding 2/24 labels, 8.33%
Dev-Data: Prec: 0.136, Rec: 0.143, F1: 0.1395



{'C': {'precision': 0.13627450980392156, 'recall': 0.17981888745148772, 'f1-score': 0.15504740658114888, 'support': 773}, 'P': {'precision': 0.1963276836158192, 'recall': 0.14662447257383968, 'f1-score': 0.1678743961352657, 'support': 948}, 'micro avg': {'precision': 0.16087962962962962, 'recall': 0.16153399186519465, 'f1-score': 0.16120614670919106, 'support': 1721}, 'macro avg': {'precision': 0.16630109670987037, 'recall': 0.16322168001266368, 'f1-score': 0.1614609013582073, 'support': 1721}, 'weighted avg': {'precision': 0.1693543522058268, 'recall': 0.16153399186519465, 'f1-score': 0.16211305800317252, 'support': 1721}}
Token level accuracy: 0.5607195244344939
Wrong BIO-Encoding 2709/4277 labels, 63.34%



{'C': {'precision': 0.13627450980392156, 'recall': 0.17981888745148772, 'f1-score': 0.15504740658114888, 'support': 773}, 'P': {'precision': 0.1963276836158192, 'recall': 0.14662447257383968, 'f1-score': 0.1678743961352657, 'support': 948}, 'micro avg': {'precision': 0.16087962962962962, 'recall': 0.16153399186519465, 'f1-score': 0.16120614670919106, 'support': 1721}, 'macro avg': {'precision': 0.16630109670987037, 'recall': 0.16322168001266368, 'f1-score': 0.1614609013582073, 'support': 1721}, 'weighted avg': {'precision': 0.1693543522058268, 'recall': 0.16153399186519465, 'f1-score': 0.16211305800317252, 'support': 1721}}
Token level accuracy: 0.5607195244344939
Wrong BIO-Encoding 160/1728 labels, 9.26%
Test-Data: Prec: 0.177, Rec: 0.161, F1: 0.1684

Scores from epoch with best dev-scores:
  Dev-Score: 0.2500
  Test-Score 0.0919

9.20 sec for evaluation

--------- Epoch 11 -----------
237.72 sec for training (2594.24 total)
-- cmv_modes1 --



{'C': {'precision': 0.6666666666666666, 'recall': 0.13333333333333333, 'f1-score': 0.2222222222222222, 'support': 15}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 6}, 'micro avg': {'precision': 0.3333333333333333, 'recall': 0.09523809523809523, 'f1-score': 0.14814814814814814, 'support': 21}, 'macro avg': {'precision': 0.3333333333333333, 'recall': 0.06666666666666667, 'f1-score': 0.1111111111111111, 'support': 21}, 'weighted avg': {'precision': 0.47619047619047616, 'recall': 0.09523809523809523, 'f1-score': 0.15873015873015872, 'support': 21}}
Token level accuracy: 0.6731054977711739



{'C': {'precision': 0.6666666666666666, 'recall': 0.13333333333333333, 'f1-score': 0.2222222222222222, 'support': 15}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 6}, 'micro avg': {'precision': 0.3333333333333333, 'recall': 0.09523809523809523, 'f1-score': 0.14814814814814814, 'support': 21}, 'macro avg': {'precision': 0.3333333333333333, 'recall': 0.06666666666666667, 'f1-score': 0.1111111111111111, 'support': 21}, 'weighted avg': {'precision': 0.47619047619047616, 'recall': 0.09523809523809523, 'f1-score': 0.15873015873015872, 'support': 21}}
Token level accuracy: 0.6731054977711739
Dev-Data: Prec: 0.333, Rec: 0.095, F1: 0.1481



{'C': {'precision': 0.1759465478841871, 'recall': 0.10219922380336352, 'f1-score': 0.12929623567921442, 'support': 773}, 'P': {'precision': 0.2233712512926577, 'recall': 0.22784810126582278, 'f1-score': 0.2255874673629243, 'support': 948}, 'micro avg': {'precision': 0.20833333333333334, 'recall': 0.17141196978500872, 'f1-score': 0.18807778131973224, 'support': 1721}, 'macro avg': {'precision': 0.1996588995884224, 'recall': 0.16502366253459316, 'f1-score': 0.17744185152106934, 'support': 1721}, 'weighted avg': {'precision': 0.20207009165596518, 'recall': 0.17141196978500872, 'f1-score': 0.1823375416851162, 'support': 1721}}
Token level accuracy: 0.573895365295041
Wrong BIO-Encoding 1927/3229 labels, 59.68%



{'C': {'precision': 0.1759465478841871, 'recall': 0.10219922380336352, 'f1-score': 0.12929623567921442, 'support': 773}, 'P': {'precision': 0.2233712512926577, 'recall': 0.22784810126582278, 'f1-score': 0.2255874673629243, 'support': 948}, 'micro avg': {'precision': 0.20833333333333334, 'recall': 0.17141196978500872, 'f1-score': 0.18807778131973224, 'support': 1721}, 'macro avg': {'precision': 0.1996588995884224, 'recall': 0.16502366253459316, 'f1-score': 0.17744185152106934, 'support': 1721}, 'weighted avg': {'precision': 0.20207009165596518, 'recall': 0.17141196978500872, 'f1-score': 0.1823375416851162, 'support': 1721}}
Token level accuracy: 0.573895365295041
Wrong BIO-Encoding 114/1416 labels, 8.05%
Test-Data: Prec: 0.226, Rec: 0.171, F1: 0.1945

Scores from epoch with best dev-scores:
  Dev-Score: 0.2500
  Test-Score 0.0919

9.56 sec for evaluation

--------- Epoch 12 -----------
238.00 sec for training (2832.24 total)
-- cmv_modes1 --



{'C': {'precision': 0.16666666666666666, 'recall': 0.13333333333333333, 'f1-score': 0.14814814814814814, 'support': 15}, 'P': {'precision': 0.14285714285714285, 'recall': 0.16666666666666666, 'f1-score': 0.15384615384615383, 'support': 6}, 'micro avg': {'precision': 0.15789473684210525, 'recall': 0.14285714285714285, 'f1-score': 0.15, 'support': 21}, 'macro avg': {'precision': 0.15476190476190477, 'recall': 0.15, 'f1-score': 0.150997150997151, 'support': 21}, 'weighted avg': {'precision': 0.1598639455782313, 'recall': 0.14285714285714285, 'f1-score': 0.14977614977614978, 'support': 21}}
Token level accuracy: 0.763744427934621



{'C': {'precision': 0.16666666666666666, 'recall': 0.13333333333333333, 'f1-score': 0.14814814814814814, 'support': 15}, 'P': {'precision': 0.14285714285714285, 'recall': 0.16666666666666666, 'f1-score': 0.15384615384615383, 'support': 6}, 'micro avg': {'precision': 0.15789473684210525, 'recall': 0.14285714285714285, 'f1-score': 0.15, 'support': 21}, 'macro avg': {'precision': 0.15476190476190477, 'recall': 0.15, 'f1-score': 0.150997150997151, 'support': 21}, 'weighted avg': {'precision': 0.1598639455782313, 'recall': 0.14285714285714285, 'f1-score': 0.14977614977614978, 'support': 21}}
Token level accuracy: 0.763744427934621
Dev-Data: Prec: 0.158, Rec: 0.143, F1: 0.1500



{'C': {'precision': 0.15538290788013318, 'recall': 0.18111254851228978, 'f1-score': 0.16726403823178015, 'support': 773}, 'P': {'precision': 0.24341279799247176, 'recall': 0.20464135021097046, 'f1-score': 0.22234957020057305, 'support': 948}, 'micro avg': {'precision': 0.1967020023557126, 'recall': 0.19407321324811155, 'f1-score': 0.19537876572097104, 'support': 1721}, 'macro avg': {'precision': 0.19939785293630247, 'recall': 0.19287694936163013, 'f1-score': 0.1948068042161766, 'support': 1721}, 'weighted avg': {'precision': 0.20387351556548877, 'recall': 0.19407321324811155, 'f1-score': 0.19760749221575208, 'support': 1721}}
Token level accuracy: 0.5587894696209372
Wrong BIO-Encoding 1935/3502 labels, 55.25%



{'C': {'precision': 0.15538290788013318, 'recall': 0.18111254851228978, 'f1-score': 0.16726403823178015, 'support': 773}, 'P': {'precision': 0.24341279799247176, 'recall': 0.20464135021097046, 'f1-score': 0.22234957020057305, 'support': 948}, 'micro avg': {'precision': 0.1967020023557126, 'recall': 0.19407321324811155, 'f1-score': 0.19537876572097104, 'support': 1721}, 'macro avg': {'precision': 0.19939785293630247, 'recall': 0.19287694936163013, 'f1-score': 0.1948068042161766, 'support': 1721}, 'weighted avg': {'precision': 0.20387351556548877, 'recall': 0.19407321324811155, 'f1-score': 0.19760749221575208, 'support': 1721}}
Token level accuracy: 0.5587894696209372
Wrong BIO-Encoding 131/1698 labels, 7.71%
Test-Data: Prec: 0.213, Rec: 0.194, F1: 0.2032

Scores from epoch with best dev-scores:
  Dev-Score: 0.2500
  Test-Score 0.0919

9.68 sec for evaluation

--------- Epoch 13 -----------
237.85 sec for training (3070.08 total)
-- cmv_modes1 --



{'C': {'precision': 0.2727272727272727, 'recall': 0.2, 'f1-score': 0.23076923076923075, 'support': 15}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 6}, 'micro avg': {'precision': 0.17647058823529413, 'recall': 0.14285714285714285, 'f1-score': 0.15789473684210528, 'support': 21}, 'macro avg': {'precision': 0.13636363636363635, 'recall': 0.1, 'f1-score': 0.11538461538461538, 'support': 21}, 'weighted avg': {'precision': 0.19480519480519481, 'recall': 0.14285714285714285, 'f1-score': 0.16483516483516483, 'support': 21}}
Token level accuracy: 0.7652303120356612
Wrong BIO-Encoding 18/33 labels, 54.55%



{'C': {'precision': 0.2727272727272727, 'recall': 0.2, 'f1-score': 0.23076923076923075, 'support': 15}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 6}, 'micro avg': {'precision': 0.17647058823529413, 'recall': 0.14285714285714285, 'f1-score': 0.15789473684210528, 'support': 21}, 'macro avg': {'precision': 0.13636363636363635, 'recall': 0.1, 'f1-score': 0.11538461538461538, 'support': 21}, 'weighted avg': {'precision': 0.19480519480519481, 'recall': 0.14285714285714285, 'f1-score': 0.16483516483516483, 'support': 21}}
Token level accuracy: 0.7652303120356612
Wrong BIO-Encoding 2/17 labels, 11.76%
Dev-Data: Prec: 0.200, Rec: 0.143, F1: 0.1667



{'C': {'precision': 0.12974683544303797, 'recall': 0.1591203104786546, 'f1-score': 0.14294015107495642, 'support': 773}, 'P': {'precision': 0.2352112676056338, 'recall': 0.17616033755274263, 'f1-score': 0.2014475271411339, 'support': 948}, 'micro avg': {'precision': 0.17490952955367914, 'recall': 0.168506682161534, 'f1-score': 0.1716484166913288, 'support': 1721}, 'macro avg': {'precision': 0.18247905152433588, 'recall': 0.16764032401569862, 'f1-score': 0.17219383910804514, 'support': 1721}, 'weighted avg': {'precision': 0.18784113044021453, 'recall': 0.168506682161534, 'f1-score': 0.17516850233046846, 'support': 1721}}
Token level accuracy: 0.5583005224015029
Wrong BIO-Encoding 1940/3463 labels, 56.02%



{'C': {'precision': 0.12974683544303797, 'recall': 0.1591203104786546, 'f1-score': 0.14294015107495642, 'support': 773}, 'P': {'precision': 0.2352112676056338, 'recall': 0.17616033755274263, 'f1-score': 0.2014475271411339, 'support': 948}, 'micro avg': {'precision': 0.17490952955367914, 'recall': 0.168506682161534, 'f1-score': 0.1716484166913288, 'support': 1721}, 'macro avg': {'precision': 0.18247905152433588, 'recall': 0.16764032401569862, 'f1-score': 0.17219383910804514, 'support': 1721}, 'weighted avg': {'precision': 0.18784113044021453, 'recall': 0.168506682161534, 'f1-score': 0.17516850233046846, 'support': 1721}}
Token level accuracy: 0.5583005224015029
Wrong BIO-Encoding 135/1658 labels, 8.14%
Test-Data: Prec: 0.190, Rec: 0.168, F1: 0.1782

Scores from epoch with best dev-scores:
  Dev-Score: 0.2500
  Test-Score 0.0919

9.54 sec for evaluation

--------- Epoch 14 -----------
238.11 sec for training (3308.20 total)
-- cmv_modes1 --



{'C': {'precision': 0.3, 'recall': 0.2, 'f1-score': 0.24, 'support': 15}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 6}, 'micro avg': {'precision': 0.21428571428571427, 'recall': 0.14285714285714285, 'f1-score': 0.17142857142857143, 'support': 21}, 'macro avg': {'precision': 0.15, 'recall': 0.1, 'f1-score': 0.12, 'support': 21}, 'weighted avg': {'precision': 0.21428571428571427, 'recall': 0.14285714285714285, 'f1-score': 0.1714285714285714, 'support': 21}}
Token level accuracy: 0.7934621099554234
Wrong BIO-Encoding 16/28 labels, 57.14%



{'C': {'precision': 0.3, 'recall': 0.2, 'f1-score': 0.24, 'support': 15}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 6}, 'micro avg': {'precision': 0.21428571428571427, 'recall': 0.14285714285714285, 'f1-score': 0.17142857142857143, 'support': 21}, 'macro avg': {'precision': 0.15, 'recall': 0.1, 'f1-score': 0.12, 'support': 21}, 'weighted avg': {'precision': 0.21428571428571427, 'recall': 0.14285714285714285, 'f1-score': 0.1714285714285714, 'support': 21}}
Token level accuracy: 0.7934621099554234
Wrong BIO-Encoding 2/14 labels, 14.29%
Dev-Data: Prec: 0.250, Rec: 0.143, F1: 0.1818



{'C': {'precision': 0.1400304414003044, 'recall': 0.11901681759379043, 'f1-score': 0.12867132867132866, 'support': 773}, 'P': {'precision': 0.23039806996381182, 'recall': 0.20147679324894516, 'f1-score': 0.21496904895891952, 'support': 948}, 'micro avg': {'precision': 0.19044414535666218, 'recall': 0.16443927948866938, 'f1-score': 0.17648893046460867, 'support': 1721}, 'macro avg': {'precision': 0.18521425568205813, 'recall': 0.1602468054213678, 'f1-score': 0.1718201888151241, 'support': 1721}, 'weighted avg': {'precision': 0.1898087748565537, 'recall': 0.16443927948866938, 'f1-score': 0.17620778354212246, 'support': 1721}}
Token level accuracy: 0.5594070871612754
Wrong BIO-Encoding 2040/3392 labels, 60.14%



{'C': {'precision': 0.1400304414003044, 'recall': 0.11901681759379043, 'f1-score': 0.12867132867132866, 'support': 773}, 'P': {'precision': 0.23039806996381182, 'recall': 0.20147679324894516, 'f1-score': 0.21496904895891952, 'support': 948}, 'micro avg': {'precision': 0.19044414535666218, 'recall': 0.16443927948866938, 'f1-score': 0.17648893046460867, 'support': 1721}, 'macro avg': {'precision': 0.18521425568205813, 'recall': 0.1602468054213678, 'f1-score': 0.1718201888151241, 'support': 1721}, 'weighted avg': {'precision': 0.1898087748565537, 'recall': 0.16443927948866938, 'f1-score': 0.17620778354212246, 'support': 1721}}
Token level accuracy: 0.5594070871612754
Wrong BIO-Encoding 134/1486 labels, 9.02%
Test-Data: Prec: 0.206, Rec: 0.162, F1: 0.1816

Scores from epoch with best dev-scores:
  Dev-Score: 0.2500
  Test-Score 0.0919

9.59 sec for evaluation

--------- Epoch 15 -----------
237.73 sec for training (3545.92 total)
-- cmv_modes1 --



{'C': {'precision': 0.25, 'recall': 0.13333333333333333, 'f1-score': 0.1739130434782609, 'support': 15}, 'P': {'precision': 0.16666666666666666, 'recall': 0.5, 'f1-score': 0.25, 'support': 6}, 'micro avg': {'precision': 0.19230769230769232, 'recall': 0.23809523809523808, 'f1-score': 0.21276595744680848, 'support': 21}, 'macro avg': {'precision': 0.20833333333333331, 'recall': 0.31666666666666665, 'f1-score': 0.21195652173913043, 'support': 21}, 'weighted avg': {'precision': 0.2261904761904762, 'recall': 0.23809523809523808, 'f1-score': 0.19565217391304351, 'support': 21}}
Token level accuracy: 0.7087667161961367



{'C': {'precision': 0.25, 'recall': 0.13333333333333333, 'f1-score': 0.1739130434782609, 'support': 15}, 'P': {'precision': 0.16666666666666666, 'recall': 0.5, 'f1-score': 0.25, 'support': 6}, 'micro avg': {'precision': 0.19230769230769232, 'recall': 0.23809523809523808, 'f1-score': 0.21276595744680848, 'support': 21}, 'macro avg': {'precision': 0.20833333333333331, 'recall': 0.31666666666666665, 'f1-score': 0.21195652173913043, 'support': 21}, 'weighted avg': {'precision': 0.2261904761904762, 'recall': 0.23809523809523808, 'f1-score': 0.19565217391304351, 'support': 21}}
Token level accuracy: 0.7087667161961367
Dev-Data: Prec: 0.192, Rec: 0.238, F1: 0.2128



{'C': {'precision': 0.1713810316139767, 'recall': 0.1332470892626132, 'f1-score': 0.14992721979621543, 'support': 773}, 'P': {'precision': 0.23300970873786409, 'recall': 0.27848101265822783, 'f1-score': 0.25372417107160017, 'support': 948}, 'micro avg': {'precision': 0.2116493656286044, 'recall': 0.21324811156304474, 'f1-score': 0.21244573082489146, 'support': 1721}, 'macro avg': {'precision': 0.20219537017592037, 'recall': 0.2058640509604205, 'f1-score': 0.2018256954339078, 'support': 1721}, 'weighted avg': {'precision': 0.2053287282516555, 'recall': 0.21324811156304474, 'f1-score': 0.20710299539706653, 'support': 1721}}
Token level accuracy: 0.561671684809182
Wrong BIO-Encoding 1575/3196 labels, 49.28%



{'C': {'precision': 0.1713810316139767, 'recall': 0.1332470892626132, 'f1-score': 0.14992721979621543, 'support': 773}, 'P': {'precision': 0.23300970873786409, 'recall': 0.27848101265822783, 'f1-score': 0.25372417107160017, 'support': 948}, 'micro avg': {'precision': 0.2116493656286044, 'recall': 0.21324811156304474, 'f1-score': 0.21244573082489146, 'support': 1721}, 'macro avg': {'precision': 0.20219537017592037, 'recall': 0.2058640509604205, 'f1-score': 0.2018256954339078, 'support': 1721}, 'weighted avg': {'precision': 0.2053287282516555, 'recall': 0.21324811156304474, 'f1-score': 0.20710299539706653, 'support': 1721}}
Token level accuracy: 0.561671684809182
Wrong BIO-Encoding 113/1734 labels, 6.52%
Test-Data: Prec: 0.226, Rec: 0.213, F1: 0.2196

Scores from epoch with best dev-scores:
  Dev-Score: 0.2500
  Test-Score 0.0919

9.55 sec for evaluation

--------- Epoch 16 -----------
238.31 sec for training (3784.23 total)
-- cmv_modes1 --



{'C': {'precision': 0.5, 'recall': 0.3333333333333333, 'f1-score': 0.4, 'support': 15}, 'P': {'precision': 0.16666666666666666, 'recall': 0.16666666666666666, 'f1-score': 0.16666666666666666, 'support': 6}, 'micro avg': {'precision': 0.375, 'recall': 0.2857142857142857, 'f1-score': 0.3243243243243243, 'support': 21}, 'macro avg': {'precision': 0.3333333333333333, 'recall': 0.25, 'f1-score': 0.2833333333333333, 'support': 21}, 'weighted avg': {'precision': 0.40476190476190477, 'recall': 0.2857142857142857, 'f1-score': 0.3333333333333333, 'support': 21}}
Token level accuracy: 0.8246656760772659



{'C': {'precision': 0.5, 'recall': 0.3333333333333333, 'f1-score': 0.4, 'support': 15}, 'P': {'precision': 0.16666666666666666, 'recall': 0.16666666666666666, 'f1-score': 0.16666666666666666, 'support': 6}, 'micro avg': {'precision': 0.375, 'recall': 0.2857142857142857, 'f1-score': 0.3243243243243243, 'support': 21}, 'macro avg': {'precision': 0.3333333333333333, 'recall': 0.25, 'f1-score': 0.2833333333333333, 'support': 21}, 'weighted avg': {'precision': 0.40476190476190477, 'recall': 0.2857142857142857, 'f1-score': 0.3333333333333333, 'support': 21}}
Token level accuracy: 0.8246656760772659
Dev-Data: Prec: 0.375, Rec: 0.286, F1: 0.3243



{'C': {'precision': 0.16547788873038516, 'recall': 0.1500646830530401, 'f1-score': 0.15739484396200815, 'support': 773}, 'P': {'precision': 0.2249718785151856, 'recall': 0.2109704641350211, 'f1-score': 0.21774632553075668, 'support': 948}, 'micro avg': {'precision': 0.19874213836477989, 'recall': 0.18361417780360256, 'f1-score': 0.19087888855330717, 'support': 1721}, 'macro avg': {'precision': 0.1952248836227854, 'recall': 0.1805175735940306, 'f1-score': 0.1875705847463824, 'support': 1721}, 'weighted avg': {'precision': 0.19824970878616133, 'recall': 0.18361417780360256, 'f1-score': 0.19063900696443326, 'support': 1721}}
Token level accuracy: 0.5546462852878355
Wrong BIO-Encoding 1936/3406 labels, 56.84%



{'C': {'precision': 0.16547788873038516, 'recall': 0.1500646830530401, 'f1-score': 0.15739484396200815, 'support': 773}, 'P': {'precision': 0.2249718785151856, 'recall': 0.2109704641350211, 'f1-score': 0.21774632553075668, 'support': 948}, 'micro avg': {'precision': 0.19874213836477989, 'recall': 0.18361417780360256, 'f1-score': 0.19087888855330717, 'support': 1721}, 'macro avg': {'precision': 0.1952248836227854, 'recall': 0.1805175735940306, 'f1-score': 0.1875705847463824, 'support': 1721}, 'weighted avg': {'precision': 0.19824970878616133, 'recall': 0.18361417780360256, 'f1-score': 0.19063900696443326, 'support': 1721}}
Token level accuracy: 0.5546462852878355
Wrong BIO-Encoding 120/1590 labels, 7.55%
Test-Data: Prec: 0.214, Rec: 0.183, F1: 0.1974

Scores from epoch with best dev-scores:
  Dev-Score: 0.3243
  Test-Score 0.1974

9.57 sec for evaluation

--------- Epoch 17 -----------
237.31 sec for training (4021.54 total)
-- cmv_modes1 --



{'C': {'precision': 0.2, 'recall': 0.2, 'f1-score': 0.20000000000000004, 'support': 15}, 'P': {'precision': 0.3333333333333333, 'recall': 0.5, 'f1-score': 0.4, 'support': 6}, 'micro avg': {'precision': 0.25, 'recall': 0.2857142857142857, 'f1-score': 0.26666666666666666, 'support': 21}, 'macro avg': {'precision': 0.26666666666666666, 'recall': 0.35, 'f1-score': 0.30000000000000004, 'support': 21}, 'weighted avg': {'precision': 0.23809523809523808, 'recall': 0.2857142857142857, 'f1-score': 0.2571428571428572, 'support': 21}}
Token level accuracy: 0.8306092124814265
Wrong BIO-Encoding 11/34 labels, 32.35%



{'C': {'precision': 0.2, 'recall': 0.2, 'f1-score': 0.20000000000000004, 'support': 15}, 'P': {'precision': 0.3333333333333333, 'recall': 0.5, 'f1-score': 0.4, 'support': 6}, 'micro avg': {'precision': 0.25, 'recall': 0.2857142857142857, 'f1-score': 0.26666666666666666, 'support': 21}, 'macro avg': {'precision': 0.26666666666666666, 'recall': 0.35, 'f1-score': 0.30000000000000004, 'support': 21}, 'weighted avg': {'precision': 0.23809523809523808, 'recall': 0.2857142857142857, 'f1-score': 0.2571428571428572, 'support': 21}}
Token level accuracy: 0.8306092124814265
Wrong BIO-Encoding 1/24 labels, 4.17%
Dev-Data: Prec: 0.261, Rec: 0.286, F1: 0.2727



{'C': {'precision': 0.13654096228868662, 'recall': 0.13583441138421734, 'f1-score': 0.13618677042801555, 'support': 773}, 'P': {'precision': 0.22550052687038988, 'recall': 0.22573839662447256, 'f1-score': 0.22561939905113335, 'support': 948}, 'micro avg': {'precision': 0.18568102444703144, 'recall': 0.18535735037768739, 'f1-score': 0.18551904623437046, 'support': 1721}, 'macro avg': {'precision': 0.18102074457953826, 'recall': 0.18078640400434495, 'f1-score': 0.18090308473957445, 'support': 1721}, 'weighted avg': {'precision': 0.1855436742139944, 'recall': 0.18535735037768739, 'f1-score': 0.18545006614836165, 'support': 1721}}
Token level accuracy: 0.5569880851282843
Wrong BIO-Encoding 2865/4426 labels, 64.73%



{'C': {'precision': 0.13654096228868662, 'recall': 0.13583441138421734, 'f1-score': 0.13618677042801555, 'support': 773}, 'P': {'precision': 0.22550052687038988, 'recall': 0.22573839662447256, 'f1-score': 0.22561939905113335, 'support': 948}, 'micro avg': {'precision': 0.18568102444703144, 'recall': 0.18535735037768739, 'f1-score': 0.18551904623437046, 'support': 1721}, 'macro avg': {'precision': 0.18102074457953826, 'recall': 0.18078640400434495, 'f1-score': 0.18090308473957445, 'support': 1721}, 'weighted avg': {'precision': 0.1855436742139944, 'recall': 0.18535735037768739, 'f1-score': 0.18545006614836165, 'support': 1721}}
Token level accuracy: 0.5569880851282843
Wrong BIO-Encoding 157/1718 labels, 9.14%
Test-Data: Prec: 0.204, Rec: 0.185, F1: 0.1938

Scores from epoch with best dev-scores:
  Dev-Score: 0.3243
  Test-Score 0.1974

9.52 sec for evaluation

--------- Epoch 18 -----------
237.76 sec for training (4259.30 total)
-- cmv_modes1 --



{'C': {'precision': 0.3, 'recall': 0.2, 'f1-score': 0.24, 'support': 15}, 'P': {'precision': 0.125, 'recall': 0.16666666666666666, 'f1-score': 0.14285714285714288, 'support': 6}, 'micro avg': {'precision': 0.2222222222222222, 'recall': 0.19047619047619047, 'f1-score': 0.20512820512820512, 'support': 21}, 'macro avg': {'precision': 0.2125, 'recall': 0.18333333333333335, 'f1-score': 0.19142857142857145, 'support': 21}, 'weighted avg': {'precision': 0.25, 'recall': 0.19047619047619047, 'f1-score': 0.2122448979591837, 'support': 21}}
Token level accuracy: 0.849925705794948



{'C': {'precision': 0.3, 'recall': 0.2, 'f1-score': 0.24, 'support': 15}, 'P': {'precision': 0.125, 'recall': 0.16666666666666666, 'f1-score': 0.14285714285714288, 'support': 6}, 'micro avg': {'precision': 0.2222222222222222, 'recall': 0.19047619047619047, 'f1-score': 0.20512820512820512, 'support': 21}, 'macro avg': {'precision': 0.2125, 'recall': 0.18333333333333335, 'f1-score': 0.19142857142857145, 'support': 21}, 'weighted avg': {'precision': 0.25, 'recall': 0.19047619047619047, 'f1-score': 0.2122448979591837, 'support': 21}}
Token level accuracy: 0.849925705794948
Dev-Data: Prec: 0.222, Rec: 0.190, F1: 0.2051



{'C': {'precision': 0.14471544715447154, 'recall': 0.11513583441138421, 'f1-score': 0.1282420749279539, 'support': 773}, 'P': {'precision': 0.22551928783382788, 'recall': 0.24050632911392406, 'f1-score': 0.2327718223583461, 'support': 948}, 'micro avg': {'precision': 0.1949569495694957, 'recall': 0.1841952353282975, 'f1-score': 0.18942336420675232, 'support': 1721}, 'macro avg': {'precision': 0.1851173674941497, 'recall': 0.17782108176265413, 'f1-score': 0.18050694864314998, 'support': 1721}, 'weighted avg': {'precision': 0.18922563946361148, 'recall': 0.1841952353282975, 'f1-score': 0.185821505819303, 'support': 1721}}
Token level accuracy: 0.5612599397822898
Wrong BIO-Encoding 1304/2827 labels, 46.13%



{'C': {'precision': 0.14471544715447154, 'recall': 0.11513583441138421, 'f1-score': 0.1282420749279539, 'support': 773}, 'P': {'precision': 0.22551928783382788, 'recall': 0.24050632911392406, 'f1-score': 0.2327718223583461, 'support': 948}, 'micro avg': {'precision': 0.1949569495694957, 'recall': 0.1841952353282975, 'f1-score': 0.18942336420675232, 'support': 1721}, 'macro avg': {'precision': 0.1851173674941497, 'recall': 0.17782108176265413, 'f1-score': 0.18050694864314998, 'support': 1721}, 'weighted avg': {'precision': 0.18922563946361148, 'recall': 0.1841952353282975, 'f1-score': 0.185821505819303, 'support': 1721}}
Token level accuracy: 0.5612599397822898
Wrong BIO-Encoding 103/1626 labels, 6.33%
Test-Data: Prec: 0.207, Rec: 0.184, F1: 0.1948

Scores from epoch with best dev-scores:
  Dev-Score: 0.3243
  Test-Score 0.1974

9.70 sec for evaluation

--------- Epoch 19 -----------
235.61 sec for training (4494.91 total)
-- cmv_modes1 --



{'C': {'precision': 0.2727272727272727, 'recall': 0.2, 'f1-score': 0.23076923076923075, 'support': 15}, 'P': {'precision': 0.25, 'recall': 0.5, 'f1-score': 0.3333333333333333, 'support': 6}, 'micro avg': {'precision': 0.2608695652173913, 'recall': 0.2857142857142857, 'f1-score': 0.2727272727272727, 'support': 21}, 'macro avg': {'precision': 0.26136363636363635, 'recall': 0.35, 'f1-score': 0.28205128205128205, 'support': 21}, 'weighted avg': {'precision': 0.2662337662337662, 'recall': 0.2857142857142857, 'f1-score': 0.2600732600732601, 'support': 21}}
Token level accuracy: 0.8588410104011887
Wrong BIO-Encoding 9/31 labels, 29.03%



{'C': {'precision': 0.2727272727272727, 'recall': 0.2, 'f1-score': 0.23076923076923075, 'support': 15}, 'P': {'precision': 0.25, 'recall': 0.5, 'f1-score': 0.3333333333333333, 'support': 6}, 'micro avg': {'precision': 0.2608695652173913, 'recall': 0.2857142857142857, 'f1-score': 0.2727272727272727, 'support': 21}, 'macro avg': {'precision': 0.26136363636363635, 'recall': 0.35, 'f1-score': 0.28205128205128205, 'support': 21}, 'weighted avg': {'precision': 0.2662337662337662, 'recall': 0.2857142857142857, 'f1-score': 0.2600732600732601, 'support': 21}}
Token level accuracy: 0.8588410104011887
Wrong BIO-Encoding 1/23 labels, 4.35%
Dev-Data: Prec: 0.273, Rec: 0.286, F1: 0.2791



{'C': {'precision': 0.16973415132924335, 'recall': 0.1073738680465718, 'f1-score': 0.13153724247226625, 'support': 773}, 'P': {'precision': 0.23546234509056244, 'recall': 0.26054852320675104, 'f1-score': 0.24737105658487732, 'support': 948}, 'micro avg': {'precision': 0.21456436931079323, 'recall': 0.19174898314933178, 'f1-score': 0.20251610923596194, 'support': 1721}, 'macro avg': {'precision': 0.2025982482099029, 'recall': 0.1839611956266614, 'f1-score': 0.18945414952857179, 'support': 1721}, 'weighted avg': {'precision': 0.20594003609724482, 'recall': 0.19174898314933178, 'f1-score': 0.1953434340926935, 'support': 1721}}
Token level accuracy: 0.5479296945366582
Wrong BIO-Encoding 1056/2527 labels, 41.79%



{'C': {'precision': 0.16973415132924335, 'recall': 0.1073738680465718, 'f1-score': 0.13153724247226625, 'support': 773}, 'P': {'precision': 0.23546234509056244, 'recall': 0.26054852320675104, 'f1-score': 0.24737105658487732, 'support': 948}, 'micro avg': {'precision': 0.21456436931079323, 'recall': 0.19174898314933178, 'f1-score': 0.20251610923596194, 'support': 1721}, 'macro avg': {'precision': 0.2025982482099029, 'recall': 0.1839611956266614, 'f1-score': 0.18945414952857179, 'support': 1721}, 'weighted avg': {'precision': 0.20594003609724482, 'recall': 0.19174898314933178, 'f1-score': 0.1953434340926935, 'support': 1721}}
Token level accuracy: 0.5479296945366582
Wrong BIO-Encoding 67/1538 labels, 4.36%
Test-Data: Prec: 0.224, Rec: 0.192, F1: 0.2068

Scores from epoch with best dev-scores:
  Dev-Score: 0.3243
  Test-Score 0.1974

9.68 sec for evaluation

--------- Epoch 20 -----------
235.66 sec for training (4730.57 total)
-- cmv_modes1 --



{'C': {'precision': 0.35714285714285715, 'recall': 0.3333333333333333, 'f1-score': 0.3448275862068965, 'support': 15}, 'P': {'precision': 0.25, 'recall': 0.3333333333333333, 'f1-score': 0.28571428571428575, 'support': 6}, 'micro avg': {'precision': 0.3181818181818182, 'recall': 0.3333333333333333, 'f1-score': 0.3255813953488372, 'support': 21}, 'macro avg': {'precision': 0.3035714285714286, 'recall': 0.3333333333333333, 'f1-score': 0.31527093596059114, 'support': 21}, 'weighted avg': {'precision': 0.326530612244898, 'recall': 0.3333333333333333, 'f1-score': 0.32793807178043627, 'support': 21}}
Token level accuracy: 0.9361069836552749
Wrong BIO-Encoding 37/55 labels, 67.27%



{'C': {'precision': 0.35714285714285715, 'recall': 0.3333333333333333, 'f1-score': 0.3448275862068965, 'support': 15}, 'P': {'precision': 0.25, 'recall': 0.3333333333333333, 'f1-score': 0.28571428571428575, 'support': 6}, 'micro avg': {'precision': 0.3181818181818182, 'recall': 0.3333333333333333, 'f1-score': 0.3255813953488372, 'support': 21}, 'macro avg': {'precision': 0.3035714285714286, 'recall': 0.3333333333333333, 'f1-score': 0.31527093596059114, 'support': 21}, 'weighted avg': {'precision': 0.326530612244898, 'recall': 0.3333333333333333, 'f1-score': 0.32793807178043627, 'support': 21}}
Token level accuracy: 0.9361069836552749
Wrong BIO-Encoding 4/22 labels, 18.18%
Dev-Data: Prec: 0.389, Rec: 0.333, F1: 0.3590



{'C': {'precision': 0.1671388101983003, 'recall': 0.15265200517464425, 'f1-score': 0.15956727518593647, 'support': 773}, 'P': {'precision': 0.22624877571008814, 'recall': 0.24367088607594936, 'f1-score': 0.2346368715083799, 'support': 948}, 'micro avg': {'precision': 0.2020845396641575, 'recall': 0.20278907611853572, 'f1-score': 0.20243619489559164, 'support': 1721}, 'macro avg': {'precision': 0.1966937929541942, 'recall': 0.1981614456252968, 'f1-score': 0.19710207334715818, 'support': 1721}, 'weighted avg': {'precision': 0.19969909335063898, 'recall': 0.20278907611853572, 'f1-score': 0.20091880180631785, 'support': 1721}}
Token level accuracy: 0.5559329884968733
Wrong BIO-Encoding 1215/2845 labels, 42.71%



{'C': {'precision': 0.1671388101983003, 'recall': 0.15265200517464425, 'f1-score': 0.15956727518593647, 'support': 773}, 'P': {'precision': 0.22624877571008814, 'recall': 0.24367088607594936, 'f1-score': 0.2346368715083799, 'support': 948}, 'micro avg': {'precision': 0.2020845396641575, 'recall': 0.20278907611853572, 'f1-score': 0.20243619489559164, 'support': 1721}, 'macro avg': {'precision': 0.1966937929541942, 'recall': 0.1981614456252968, 'f1-score': 0.19710207334715818, 'support': 1721}, 'weighted avg': {'precision': 0.19969909335063898, 'recall': 0.20278907611853572, 'f1-score': 0.20091880180631785, 'support': 1721}}
Token level accuracy: 0.5559329884968733
Wrong BIO-Encoding 97/1727 labels, 5.62%
Test-Data: Prec: 0.213, Rec: 0.202, F1: 0.2077

Scores from epoch with best dev-scores:
  Dev-Score: 0.3590
  Test-Score 0.2077

9.62 sec for evaluation

--------- Epoch 21 -----------
231.58 sec for training (4962.16 total)
-- cmv_modes1 --



{'C': {'precision': 0.3333333333333333, 'recall': 0.26666666666666666, 'f1-score': 0.2962962962962963, 'support': 15}, 'P': {'precision': 0.4, 'recall': 0.3333333333333333, 'f1-score': 0.3636363636363636, 'support': 6}, 'micro avg': {'precision': 0.35294117647058826, 'recall': 0.2857142857142857, 'f1-score': 0.31578947368421056, 'support': 21}, 'macro avg': {'precision': 0.3666666666666667, 'recall': 0.3, 'f1-score': 0.3299663299663299, 'support': 21}, 'weighted avg': {'precision': 0.3523809523809524, 'recall': 0.2857142857142857, 'f1-score': 0.31553631553631556, 'support': 21}}
Token level accuracy: 0.9212481426448736
Wrong BIO-Encoding 18/33 labels, 54.55%



{'C': {'precision': 0.3333333333333333, 'recall': 0.26666666666666666, 'f1-score': 0.2962962962962963, 'support': 15}, 'P': {'precision': 0.4, 'recall': 0.3333333333333333, 'f1-score': 0.3636363636363636, 'support': 6}, 'micro avg': {'precision': 0.35294117647058826, 'recall': 0.2857142857142857, 'f1-score': 0.31578947368421056, 'support': 21}, 'macro avg': {'precision': 0.3666666666666667, 'recall': 0.3, 'f1-score': 0.3299663299663299, 'support': 21}, 'weighted avg': {'precision': 0.3523809523809524, 'recall': 0.2857142857142857, 'f1-score': 0.31553631553631556, 'support': 21}}
Token level accuracy: 0.9212481426448736
Wrong BIO-Encoding 2/17 labels, 11.76%
Dev-Data: Prec: 0.400, Rec: 0.286, F1: 0.3333



{'C': {'precision': 0.1400189214758751, 'recall': 0.19146183699870634, 'f1-score': 0.16174863387978142, 'support': 773}, 'P': {'precision': 0.2253731343283582, 'recall': 0.15928270042194093, 'f1-score': 0.18665018541409145, 'support': 948}, 'micro avg': {'precision': 0.17313259988419225, 'recall': 0.1737361998837885, 'f1-score': 0.1734338747099768, 'support': 1721}, 'macro avg': {'precision': 0.18269602790211664, 'recall': 0.17537226871032363, 'f1-score': 0.17419940964693642, 'support': 1721}, 'weighted avg': {'precision': 0.1870356523208222, 'recall': 0.1737361998837885, 'f1-score': 0.17546546761280055, 'support': 1721}}
Token level accuracy: 0.5324892560282045
Wrong BIO-Encoding 1042/2682 labels, 38.85%



{'C': {'precision': 0.1400189214758751, 'recall': 0.19146183699870634, 'f1-score': 0.16174863387978142, 'support': 773}, 'P': {'precision': 0.2253731343283582, 'recall': 0.15928270042194093, 'f1-score': 0.18665018541409145, 'support': 948}, 'micro avg': {'precision': 0.17313259988419225, 'recall': 0.1737361998837885, 'f1-score': 0.1734338747099768, 'support': 1721}, 'macro avg': {'precision': 0.18269602790211664, 'recall': 0.17537226871032363, 'f1-score': 0.17419940964693642, 'support': 1721}, 'weighted avg': {'precision': 0.1870356523208222, 'recall': 0.1737361998837885, 'f1-score': 0.17546546761280055, 'support': 1721}}
Token level accuracy: 0.5324892560282045
Wrong BIO-Encoding 87/1727 labels, 5.04%
Test-Data: Prec: 0.182, Rec: 0.174, F1: 0.1779

Scores from epoch with best dev-scores:
  Dev-Score: 0.3590
  Test-Score 0.2077

8.59 sec for evaluation

--------- Epoch 22 -----------
227.81 sec for training (5189.97 total)
-- cmv_modes1 --



{'C': {'precision': 0.6363636363636364, 'recall': 0.4666666666666667, 'f1-score': 0.5384615384615385, 'support': 15}, 'P': {'precision': 0.5, 'recall': 0.6666666666666666, 'f1-score': 0.5714285714285715, 'support': 6}, 'micro avg': {'precision': 0.5789473684210527, 'recall': 0.5238095238095238, 'f1-score': 0.5500000000000002, 'support': 21}, 'macro avg': {'precision': 0.5681818181818181, 'recall': 0.5666666666666667, 'f1-score': 0.554945054945055, 'support': 21}, 'weighted avg': {'precision': 0.5974025974025974, 'recall': 0.5238095238095238, 'f1-score': 0.5478806907378336, 'support': 21}}
Token level accuracy: 0.9435364041604755
Wrong BIO-Encoding 6/24 labels, 25.00%



{'C': {'precision': 0.6363636363636364, 'recall': 0.4666666666666667, 'f1-score': 0.5384615384615385, 'support': 15}, 'P': {'precision': 0.5, 'recall': 0.6666666666666666, 'f1-score': 0.5714285714285715, 'support': 6}, 'micro avg': {'precision': 0.5789473684210527, 'recall': 0.5238095238095238, 'f1-score': 0.5500000000000002, 'support': 21}, 'macro avg': {'precision': 0.5681818181818181, 'recall': 0.5666666666666667, 'f1-score': 0.554945054945055, 'support': 21}, 'weighted avg': {'precision': 0.5974025974025974, 'recall': 0.5238095238095238, 'f1-score': 0.5478806907378336, 'support': 21}}
Token level accuracy: 0.9435364041604755
Wrong BIO-Encoding 1/19 labels, 5.26%
Dev-Data: Prec: 0.611, Rec: 0.524, F1: 0.5641



{'C': {'precision': 0.18811881188118812, 'recall': 0.14747736093143596, 'f1-score': 0.1653372008701958, 'support': 773}, 'P': {'precision': 0.25829145728643216, 'recall': 0.27109704641350213, 'f1-score': 0.2645393721049923, 'support': 948}, 'micro avg': {'precision': 0.23173016864459714, 'recall': 0.2155723416618245, 'f1-score': 0.22335942203491874, 'support': 1721}, 'macro avg': {'precision': 0.22320513458381014, 'recall': 0.20928720367246906, 'f1-score': 0.21493828648759405, 'support': 1721}, 'weighted avg': {'precision': 0.226772889652351, 'recall': 0.2155723416618245, 'f1-score': 0.21998197619302384, 'support': 1721}}
Token level accuracy: 0.5602048431508788
Wrong BIO-Encoding 1549/3044 labels, 50.89%



{'C': {'precision': 0.18811881188118812, 'recall': 0.14747736093143596, 'f1-score': 0.1653372008701958, 'support': 773}, 'P': {'precision': 0.25829145728643216, 'recall': 0.27109704641350213, 'f1-score': 0.2645393721049923, 'support': 948}, 'micro avg': {'precision': 0.23173016864459714, 'recall': 0.2155723416618245, 'f1-score': 0.22335942203491874, 'support': 1721}, 'macro avg': {'precision': 0.22320513458381014, 'recall': 0.20928720367246906, 'f1-score': 0.21493828648759405, 'support': 1721}, 'weighted avg': {'precision': 0.226772889652351, 'recall': 0.2155723416618245, 'f1-score': 0.21998197619302384, 'support': 1721}}
Token level accuracy: 0.5602048431508788
Wrong BIO-Encoding 106/1601 labels, 6.62%
Test-Data: Prec: 0.247, Rec: 0.215, F1: 0.2301

Scores from epoch with best dev-scores:
  Dev-Score: 0.5641
  Test-Score 0.2301

8.80 sec for evaluation

--------- Epoch 23 -----------
235.58 sec for training (5425.55 total)
-- cmv_modes1 --



{'C': {'precision': 0.5, 'recall': 0.4, 'f1-score': 0.4444444444444445, 'support': 15}, 'P': {'precision': 0.5714285714285714, 'recall': 0.6666666666666666, 'f1-score': 0.6153846153846153, 'support': 6}, 'micro avg': {'precision': 0.5263157894736842, 'recall': 0.47619047619047616, 'f1-score': 0.5, 'support': 21}, 'macro avg': {'precision': 0.5357142857142857, 'recall': 0.5333333333333333, 'f1-score': 0.5299145299145299, 'support': 21}, 'weighted avg': {'precision': 0.5204081632653061, 'recall': 0.47619047619047616, 'f1-score': 0.4932844932844932, 'support': 21}}
Token level accuracy: 0.9643387815750372
Wrong BIO-Encoding 9/27 labels, 33.33%



{'C': {'precision': 0.5, 'recall': 0.4, 'f1-score': 0.4444444444444445, 'support': 15}, 'P': {'precision': 0.5714285714285714, 'recall': 0.6666666666666666, 'f1-score': 0.6153846153846153, 'support': 6}, 'micro avg': {'precision': 0.5263157894736842, 'recall': 0.47619047619047616, 'f1-score': 0.5, 'support': 21}, 'macro avg': {'precision': 0.5357142857142857, 'recall': 0.5333333333333333, 'f1-score': 0.5299145299145299, 'support': 21}, 'weighted avg': {'precision': 0.5204081632653061, 'recall': 0.47619047619047616, 'f1-score': 0.4932844932844932, 'support': 21}}
Token level accuracy: 0.9643387815750372
Wrong BIO-Encoding 1/19 labels, 5.26%
Dev-Data: Prec: 0.556, Rec: 0.476, F1: 0.5128



{'C': {'precision': 0.168944099378882, 'recall': 0.1759379042690815, 'f1-score': 0.17237008871989862, 'support': 773}, 'P': {'precision': 0.2324805339265851, 'recall': 0.22046413502109705, 'f1-score': 0.22631293990254467, 'support': 948}, 'micro avg': {'precision': 0.20246478873239437, 'recall': 0.20046484601975595, 'f1-score': 0.20145985401459857, 'support': 1721}, 'macro avg': {'precision': 0.20071231665273354, 'recall': 0.1982010196450893, 'f1-score': 0.19934151431122166, 'support': 1721}, 'weighted avg': {'precision': 0.20394266994902874, 'recall': 0.20046484601975595, 'f1-score': 0.20208410552474954, 'support': 1721}}
Token level accuracy: 0.5535911886564245
Wrong BIO-Encoding 1279/2900 labels, 44.10%



{'C': {'precision': 0.168944099378882, 'recall': 0.1759379042690815, 'f1-score': 0.17237008871989862, 'support': 773}, 'P': {'precision': 0.2324805339265851, 'recall': 0.22046413502109705, 'f1-score': 0.22631293990254467, 'support': 948}, 'micro avg': {'precision': 0.20246478873239437, 'recall': 0.20046484601975595, 'f1-score': 0.20145985401459857, 'support': 1721}, 'macro avg': {'precision': 0.20071231665273354, 'recall': 0.1982010196450893, 'f1-score': 0.19934151431122166, 'support': 1721}, 'weighted avg': {'precision': 0.20394266994902874, 'recall': 0.20046484601975595, 'f1-score': 0.20208410552474954, 'support': 1721}}
Token level accuracy: 0.5535911886564245
Wrong BIO-Encoding 83/1704 labels, 4.87%
Test-Data: Prec: 0.213, Rec: 0.200, F1: 0.2065

Scores from epoch with best dev-scores:
  Dev-Score: 0.5641
  Test-Score 0.2301

9.43 sec for evaluation

--------- Epoch 24 -----------
239.50 sec for training (5665.05 total)
-- cmv_modes1 --



{'C': {'precision': 0.38461538461538464, 'recall': 0.3333333333333333, 'f1-score': 0.3571428571428571, 'support': 15}, 'P': {'precision': 0.5, 'recall': 0.5, 'f1-score': 0.5, 'support': 6}, 'micro avg': {'precision': 0.42105263157894735, 'recall': 0.38095238095238093, 'f1-score': 0.4, 'support': 21}, 'macro avg': {'precision': 0.4423076923076923, 'recall': 0.41666666666666663, 'f1-score': 0.42857142857142855, 'support': 21}, 'weighted avg': {'precision': 0.4175824175824176, 'recall': 0.38095238095238093, 'f1-score': 0.3979591836734694, 'support': 21}}
Token level accuracy: 0.9331352154531947
Wrong BIO-Encoding 8/26 labels, 30.77%



{'C': {'precision': 0.38461538461538464, 'recall': 0.3333333333333333, 'f1-score': 0.3571428571428571, 'support': 15}, 'P': {'precision': 0.5, 'recall': 0.5, 'f1-score': 0.5, 'support': 6}, 'micro avg': {'precision': 0.42105263157894735, 'recall': 0.38095238095238093, 'f1-score': 0.4, 'support': 21}, 'macro avg': {'precision': 0.4423076923076923, 'recall': 0.41666666666666663, 'f1-score': 0.42857142857142855, 'support': 21}, 'weighted avg': {'precision': 0.4175824175824176, 'recall': 0.38095238095238093, 'f1-score': 0.3979591836734694, 'support': 21}}
Token level accuracy: 0.9331352154531947
Wrong BIO-Encoding 1/19 labels, 5.26%
Dev-Data: Prec: 0.444, Rec: 0.381, F1: 0.4103



{'C': {'precision': 0.1809090909090909, 'recall': 0.2574385510996119, 'f1-score': 0.21249332621462894, 'support': 773}, 'P': {'precision': 0.25882352941176473, 'recall': 0.18565400843881857, 'f1-score': 0.21621621621621623, 'support': 948}, 'micro avg': {'precision': 0.21067415730337077, 'recall': 0.2178965717606043, 'f1-score': 0.21422450728363326, 'support': 1721}, 'macro avg': {'precision': 0.21986631016042782, 'recall': 0.22154627976921523, 'f1-score': 0.21435477121542257, 'support': 1721}, 'weighted avg': {'precision': 0.22382767760318434, 'recall': 0.2178965717606043, 'f1-score': 0.21454405237471302, 'support': 1721}}
Token level accuracy: 0.5255925268277619
Wrong BIO-Encoding 1555/3231 labels, 48.13%



{'C': {'precision': 0.1809090909090909, 'recall': 0.2574385510996119, 'f1-score': 0.21249332621462894, 'support': 773}, 'P': {'precision': 0.25882352941176473, 'recall': 0.18565400843881857, 'f1-score': 0.21621621621621623, 'support': 948}, 'micro avg': {'precision': 0.21067415730337077, 'recall': 0.2178965717606043, 'f1-score': 0.21422450728363326, 'support': 1721}, 'macro avg': {'precision': 0.21986631016042782, 'recall': 0.22154627976921523, 'f1-score': 0.21435477121542257, 'support': 1721}, 'weighted avg': {'precision': 0.22382767760318434, 'recall': 0.2178965717606043, 'f1-score': 0.21454405237471302, 'support': 1721}}
Token level accuracy: 0.5255925268277619
Wrong BIO-Encoding 104/1780 labels, 5.84%
Test-Data: Prec: 0.223, Rec: 0.217, F1: 0.2196

Scores from epoch with best dev-scores:
  Dev-Score: 0.5641
  Test-Score 0.2301

9.64 sec for evaluation

--------- Epoch 25 -----------
240.40 sec for training (5905.45 total)
-- cmv_modes1 --



{'C': {'precision': 0.45454545454545453, 'recall': 0.3333333333333333, 'f1-score': 0.3846153846153846, 'support': 15}, 'P': {'precision': 0.6, 'recall': 0.5, 'f1-score': 0.5454545454545454, 'support': 6}, 'micro avg': {'precision': 0.5, 'recall': 0.38095238095238093, 'f1-score': 0.4324324324324324, 'support': 21}, 'macro avg': {'precision': 0.5272727272727272, 'recall': 0.41666666666666663, 'f1-score': 0.465034965034965, 'support': 21}, 'weighted avg': {'precision': 0.4961038961038961, 'recall': 0.38095238095238093, 'f1-score': 0.4305694305694305, 'support': 21}}
Token level accuracy: 0.888558692421991



{'C': {'precision': 0.45454545454545453, 'recall': 0.3333333333333333, 'f1-score': 0.3846153846153846, 'support': 15}, 'P': {'precision': 0.6, 'recall': 0.5, 'f1-score': 0.5454545454545454, 'support': 6}, 'micro avg': {'precision': 0.5, 'recall': 0.38095238095238093, 'f1-score': 0.4324324324324324, 'support': 21}, 'macro avg': {'precision': 0.5272727272727272, 'recall': 0.41666666666666663, 'f1-score': 0.465034965034965, 'support': 21}, 'weighted avg': {'precision': 0.4961038961038961, 'recall': 0.38095238095238093, 'f1-score': 0.4305694305694305, 'support': 21}}
Token level accuracy: 0.888558692421991
Dev-Data: Prec: 0.500, Rec: 0.381, F1: 0.4324



{'C': {'precision': 0.16333938294010888, 'recall': 0.11642949547218628, 'f1-score': 0.13595166163141995, 'support': 773}, 'P': {'precision': 0.19906103286384977, 'recall': 0.22362869198312235, 'f1-score': 0.21063089915548933, 'support': 948}, 'micro avg': {'precision': 0.18688118811881188, 'recall': 0.17547937245787332, 'f1-score': 0.1810008990110878, 'support': 1721}, 'macro avg': {'precision': 0.18120020790197933, 'recall': 0.17002909372765432, 'f1-score': 0.17329128039345465, 'support': 1721}, 'weighted avg': {'precision': 0.1830163870817163, 'recall': 0.17547937245787332, 'f1-score': 0.17708816202236577, 'support': 1721}}
Token level accuracy: 0.5421137960318073
Wrong BIO-Encoding 744/2299 labels, 32.36%



{'C': {'precision': 0.16333938294010888, 'recall': 0.11642949547218628, 'f1-score': 0.13595166163141995, 'support': 773}, 'P': {'precision': 0.19906103286384977, 'recall': 0.22362869198312235, 'f1-score': 0.21063089915548933, 'support': 948}, 'micro avg': {'precision': 0.18688118811881188, 'recall': 0.17547937245787332, 'f1-score': 0.1810008990110878, 'support': 1721}, 'macro avg': {'precision': 0.18120020790197933, 'recall': 0.17002909372765432, 'f1-score': 0.17329128039345465, 'support': 1721}, 'weighted avg': {'precision': 0.1830163870817163, 'recall': 0.17547937245787332, 'f1-score': 0.17708816202236577, 'support': 1721}}
Token level accuracy: 0.5421137960318073
Wrong BIO-Encoding 61/1616 labels, 3.77%
Test-Data: Prec: 0.191, Rec: 0.173, F1: 0.1813

Scores from epoch with best dev-scores:
  Dev-Score: 0.5641
  Test-Score 0.2301

9.69 sec for evaluation

--------- Epoch 26 -----------
240.62 sec for training (6146.07 total)
-- cmv_modes1 --



{'C': {'precision': 0.3333333333333333, 'recall': 0.2, 'f1-score': 0.25, 'support': 15}, 'P': {'precision': 0.375, 'recall': 0.5, 'f1-score': 0.42857142857142855, 'support': 6}, 'micro avg': {'precision': 0.35294117647058826, 'recall': 0.2857142857142857, 'f1-score': 0.31578947368421056, 'support': 21}, 'macro avg': {'precision': 0.35416666666666663, 'recall': 0.35, 'f1-score': 0.3392857142857143, 'support': 21}, 'weighted avg': {'precision': 0.34523809523809523, 'recall': 0.2857142857142857, 'f1-score': 0.3010204081632653, 'support': 21}}
Token level accuracy: 0.8558692421991084



{'C': {'precision': 0.3333333333333333, 'recall': 0.2, 'f1-score': 0.25, 'support': 15}, 'P': {'precision': 0.375, 'recall': 0.5, 'f1-score': 0.42857142857142855, 'support': 6}, 'micro avg': {'precision': 0.35294117647058826, 'recall': 0.2857142857142857, 'f1-score': 0.31578947368421056, 'support': 21}, 'macro avg': {'precision': 0.35416666666666663, 'recall': 0.35, 'f1-score': 0.3392857142857143, 'support': 21}, 'weighted avg': {'precision': 0.34523809523809523, 'recall': 0.2857142857142857, 'f1-score': 0.3010204081632653, 'support': 21}}
Token level accuracy: 0.8558692421991084
Dev-Data: Prec: 0.353, Rec: 0.286, F1: 0.3158



{'C': {'precision': 0.14548802946593, 'recall': 0.10219922380336352, 'f1-score': 0.12006079027355622, 'support': 773}, 'P': {'precision': 0.17973856209150327, 'recall': 0.2320675105485232, 'f1-score': 0.20257826887661143, 'support': 948}, 'micro avg': {'precision': 0.16921335597057158, 'recall': 0.1737361998837885, 'f1-score': 0.17144495412844038, 'support': 1721}, 'macro avg': {'precision': 0.16261329577871664, 'recall': 0.16713336717594335, 'f1-score': 0.16131952957508383, 'support': 1721}, 'weighted avg': {'precision': 0.16435467962807032, 'recall': 0.1737361998837885, 'f1-score': 0.16551492723793526, 'support': 1721}}
Token level accuracy: 0.5607452584986747
Wrong BIO-Encoding 483/2214 labels, 21.82%



{'C': {'precision': 0.14548802946593, 'recall': 0.10219922380336352, 'f1-score': 0.12006079027355622, 'support': 773}, 'P': {'precision': 0.17973856209150327, 'recall': 0.2320675105485232, 'f1-score': 0.20257826887661143, 'support': 948}, 'micro avg': {'precision': 0.16921335597057158, 'recall': 0.1737361998837885, 'f1-score': 0.17144495412844038, 'support': 1721}, 'macro avg': {'precision': 0.16261329577871664, 'recall': 0.16713336717594335, 'f1-score': 0.16131952957508383, 'support': 1721}, 'weighted avg': {'precision': 0.16435467962807032, 'recall': 0.1737361998837885, 'f1-score': 0.16551492723793526, 'support': 1721}}
Token level accuracy: 0.5607452584986747
Wrong BIO-Encoding 36/1767 labels, 2.04%
Test-Data: Prec: 0.173, Rec: 0.174, F1: 0.1732

Scores from epoch with best dev-scores:
  Dev-Score: 0.5641
  Test-Score 0.2301

9.67 sec for evaluation

--------- Epoch 27 -----------
240.57 sec for training (6386.63 total)
-- cmv_modes1 --



{'C': {'precision': 0.5384615384615384, 'recall': 0.4666666666666667, 'f1-score': 0.5, 'support': 15}, 'P': {'precision': 0.5, 'recall': 0.5, 'f1-score': 0.5, 'support': 6}, 'micro avg': {'precision': 0.5263157894736842, 'recall': 0.47619047619047616, 'f1-score': 0.5, 'support': 21}, 'macro avg': {'precision': 0.5192307692307692, 'recall': 0.48333333333333334, 'f1-score': 0.5, 'support': 21}, 'weighted avg': {'precision': 0.5274725274725275, 'recall': 0.47619047619047616, 'f1-score': 0.5, 'support': 21}}
Token level accuracy: 0.9583952451708767
Wrong BIO-Encoding 10/28 labels, 35.71%



{'C': {'precision': 0.5384615384615384, 'recall': 0.4666666666666667, 'f1-score': 0.5, 'support': 15}, 'P': {'precision': 0.5, 'recall': 0.5, 'f1-score': 0.5, 'support': 6}, 'micro avg': {'precision': 0.5263157894736842, 'recall': 0.47619047619047616, 'f1-score': 0.5, 'support': 21}, 'macro avg': {'precision': 0.5192307692307692, 'recall': 0.48333333333333334, 'f1-score': 0.5, 'support': 21}, 'weighted avg': {'precision': 0.5274725274725275, 'recall': 0.47619047619047616, 'f1-score': 0.5, 'support': 21}}
Token level accuracy: 0.9583952451708767
Wrong BIO-Encoding 1/19 labels, 5.26%
Dev-Data: Prec: 0.556, Rec: 0.476, F1: 0.5128



{'C': {'precision': 0.14442700156985872, 'recall': 0.11901681759379043, 'f1-score': 0.13049645390070924, 'support': 773}, 'P': {'precision': 0.18772893772893773, 'recall': 0.21624472573839662, 'f1-score': 0.20098039215686275, 'support': 948}, 'micro avg': {'precision': 0.1717755928282244, 'recall': 0.1725740848343986, 'f1-score': 0.17217391304347823, 'support': 1721}, 'macro avg': {'precision': 0.16607796964939822, 'recall': 0.16763077166609353, 'f1-score': 0.165738423028786, 'support': 1721}, 'weighted avg': {'precision': 0.16827954978531884, 'recall': 0.1725740848343986, 'f1-score': 0.16932200501449982, 'support': 1721}}
Token level accuracy: 0.5539514655549551
Wrong BIO-Encoding 874/2537 labels, 34.45%



{'C': {'precision': 0.14442700156985872, 'recall': 0.11901681759379043, 'f1-score': 0.13049645390070924, 'support': 773}, 'P': {'precision': 0.18772893772893773, 'recall': 0.21624472573839662, 'f1-score': 0.20098039215686275, 'support': 948}, 'micro avg': {'precision': 0.1717755928282244, 'recall': 0.1725740848343986, 'f1-score': 0.17217391304347823, 'support': 1721}, 'macro avg': {'precision': 0.16607796964939822, 'recall': 0.16763077166609353, 'f1-score': 0.165738423028786, 'support': 1721}, 'weighted avg': {'precision': 0.16827954978531884, 'recall': 0.1725740848343986, 'f1-score': 0.16932200501449982, 'support': 1721}}
Token level accuracy: 0.5539514655549551
Wrong BIO-Encoding 66/1729 labels, 3.82%
Test-Data: Prec: 0.179, Rec: 0.173, F1: 0.1755

Scores from epoch with best dev-scores:
  Dev-Score: 0.5641
  Test-Score 0.2301

9.70 sec for evaluation

--------- Epoch 28 -----------
239.84 sec for training (6626.47 total)
-- cmv_modes1 --



{'C': {'precision': 0.7692307692307693, 'recall': 0.6666666666666666, 'f1-score': 0.7142857142857142, 'support': 15}, 'P': {'precision': 0.6666666666666666, 'recall': 0.6666666666666666, 'f1-score': 0.6666666666666666, 'support': 6}, 'micro avg': {'precision': 0.7368421052631579, 'recall': 0.6666666666666666, 'f1-score': 0.7, 'support': 21}, 'macro avg': {'precision': 0.717948717948718, 'recall': 0.6666666666666666, 'f1-score': 0.6904761904761905, 'support': 21}, 'weighted avg': {'precision': 0.73992673992674, 'recall': 0.6666666666666666, 'f1-score': 0.7006802721088435, 'support': 21}}
Token level accuracy: 0.974739970282318
Wrong BIO-Encoding 12/30 labels, 40.00%



{'C': {'precision': 0.7692307692307693, 'recall': 0.6666666666666666, 'f1-score': 0.7142857142857142, 'support': 15}, 'P': {'precision': 0.6666666666666666, 'recall': 0.6666666666666666, 'f1-score': 0.6666666666666666, 'support': 6}, 'micro avg': {'precision': 0.7368421052631579, 'recall': 0.6666666666666666, 'f1-score': 0.7, 'support': 21}, 'macro avg': {'precision': 0.717948717948718, 'recall': 0.6666666666666666, 'f1-score': 0.6904761904761905, 'support': 21}, 'weighted avg': {'precision': 0.73992673992674, 'recall': 0.6666666666666666, 'f1-score': 0.7006802721088435, 'support': 21}}
Token level accuracy: 0.974739970282318
Wrong BIO-Encoding 1/19 labels, 5.26%
Dev-Data: Prec: 0.778, Rec: 0.667, F1: 0.7179



{'C': {'precision': 0.18003913894324852, 'recall': 0.11901681759379043, 'f1-score': 0.14330218068535824, 'support': 773}, 'P': {'precision': 0.21155555555555555, 'recall': 0.2510548523206751, 'f1-score': 0.22961890979257113, 'support': 948}, 'micro avg': {'precision': 0.2017114914425428, 'recall': 0.19174898314933178, 'f1-score': 0.19660411081322607, 'support': 1721}, 'macro avg': {'precision': 0.19579734724940204, 'recall': 0.18503583495723275, 'f1-score': 0.1864605452389647, 'support': 1721}, 'weighted avg': {'precision': 0.19739972171400222, 'recall': 0.19174898314933178, 'f1-score': 0.19084910642250977, 'support': 1721}}
Token level accuracy: 0.5637304099436424
Wrong BIO-Encoding 688/2268 labels, 30.34%



{'C': {'precision': 0.18003913894324852, 'recall': 0.11901681759379043, 'f1-score': 0.14330218068535824, 'support': 773}, 'P': {'precision': 0.21155555555555555, 'recall': 0.2510548523206751, 'f1-score': 0.22961890979257113, 'support': 948}, 'micro avg': {'precision': 0.2017114914425428, 'recall': 0.19174898314933178, 'f1-score': 0.19660411081322607, 'support': 1721}, 'macro avg': {'precision': 0.19579734724940204, 'recall': 0.18503583495723275, 'f1-score': 0.1864605452389647, 'support': 1721}, 'weighted avg': {'precision': 0.19739972171400222, 'recall': 0.19174898314933178, 'f1-score': 0.19084910642250977, 'support': 1721}}
Token level accuracy: 0.5637304099436424
Wrong BIO-Encoding 56/1636 labels, 3.42%
Test-Data: Prec: 0.206, Rec: 0.189, F1: 0.1969

Scores from epoch with best dev-scores:
  Dev-Score: 0.7179
  Test-Score 0.1969

9.70 sec for evaluation

--------- Epoch 29 -----------
239.68 sec for training (6866.15 total)
-- cmv_modes1 --



{'C': {'precision': 0.6153846153846154, 'recall': 0.5333333333333333, 'f1-score': 0.5714285714285715, 'support': 15}, 'P': {'precision': 0.6666666666666666, 'recall': 0.6666666666666666, 'f1-score': 0.6666666666666666, 'support': 6}, 'micro avg': {'precision': 0.631578947368421, 'recall': 0.5714285714285714, 'f1-score': 0.6, 'support': 21}, 'macro avg': {'precision': 0.641025641025641, 'recall': 0.6, 'f1-score': 0.6190476190476191, 'support': 21}, 'weighted avg': {'precision': 0.6300366300366301, 'recall': 0.5714285714285714, 'f1-score': 0.598639455782313, 'support': 21}}
Token level accuracy: 0.9687964338781575
Wrong BIO-Encoding 12/30 labels, 40.00%



{'C': {'precision': 0.6153846153846154, 'recall': 0.5333333333333333, 'f1-score': 0.5714285714285715, 'support': 15}, 'P': {'precision': 0.6666666666666666, 'recall': 0.6666666666666666, 'f1-score': 0.6666666666666666, 'support': 6}, 'micro avg': {'precision': 0.631578947368421, 'recall': 0.5714285714285714, 'f1-score': 0.6, 'support': 21}, 'macro avg': {'precision': 0.641025641025641, 'recall': 0.6, 'f1-score': 0.6190476190476191, 'support': 21}, 'weighted avg': {'precision': 0.6300366300366301, 'recall': 0.5714285714285714, 'f1-score': 0.598639455782313, 'support': 21}}
Token level accuracy: 0.9687964338781575
Wrong BIO-Encoding 1/19 labels, 5.26%
Dev-Data: Prec: 0.667, Rec: 0.571, F1: 0.6154



{'C': {'precision': 0.14035087719298245, 'recall': 0.16558861578266496, 'f1-score': 0.15192878338278934, 'support': 773}, 'P': {'precision': 0.20331491712707184, 'recall': 0.1940928270042194, 'f1-score': 0.19859686994063683, 'support': 948}, 'micro avg': {'precision': 0.1717116125481563, 'recall': 0.1812899477048228, 'f1-score': 0.17637083097795364, 'support': 1721}, 'macro avg': {'precision': 0.17183289716002714, 'recall': 0.17984072139344218, 'f1-score': 0.17526282666171308, 'support': 1721}, 'weighted avg': {'precision': 0.17503414846405552, 'recall': 0.1812899477048228, 'f1-score': 0.17763555041174892, 'support': 1721}}
Token level accuracy: 0.5407498906302273
Wrong BIO-Encoding 1585/3286 labels, 48.23%



{'C': {'precision': 0.14035087719298245, 'recall': 0.16558861578266496, 'f1-score': 0.15192878338278934, 'support': 773}, 'P': {'precision': 0.20331491712707184, 'recall': 0.1940928270042194, 'f1-score': 0.19859686994063683, 'support': 948}, 'micro avg': {'precision': 0.1717116125481563, 'recall': 0.1812899477048228, 'f1-score': 0.17637083097795364, 'support': 1721}, 'macro avg': {'precision': 0.17183289716002714, 'recall': 0.17984072139344218, 'f1-score': 0.17526282666171308, 'support': 1721}, 'weighted avg': {'precision': 0.17503414846405552, 'recall': 0.1812899477048228, 'f1-score': 0.17763555041174892, 'support': 1721}}
Token level accuracy: 0.5407498906302273
Wrong BIO-Encoding 116/1817 labels, 6.38%
Test-Data: Prec: 0.182, Rec: 0.180, F1: 0.1806

Scores from epoch with best dev-scores:
  Dev-Score: 0.7179
  Test-Score 0.1969

9.66 sec for evaluation

--------- Epoch 30 -----------
240.26 sec for training (7106.40 total)
-- cmv_modes1 --



{'C': {'precision': 0.6153846153846154, 'recall': 0.5333333333333333, 'f1-score': 0.5714285714285715, 'support': 15}, 'P': {'precision': 0.6666666666666666, 'recall': 0.6666666666666666, 'f1-score': 0.6666666666666666, 'support': 6}, 'micro avg': {'precision': 0.631578947368421, 'recall': 0.5714285714285714, 'f1-score': 0.6, 'support': 21}, 'macro avg': {'precision': 0.641025641025641, 'recall': 0.6, 'f1-score': 0.6190476190476191, 'support': 21}, 'weighted avg': {'precision': 0.6300366300366301, 'recall': 0.5714285714285714, 'f1-score': 0.598639455782313, 'support': 21}}
Token level accuracy: 0.974739970282318
Wrong BIO-Encoding 10/28 labels, 35.71%



{'C': {'precision': 0.6153846153846154, 'recall': 0.5333333333333333, 'f1-score': 0.5714285714285715, 'support': 15}, 'P': {'precision': 0.6666666666666666, 'recall': 0.6666666666666666, 'f1-score': 0.6666666666666666, 'support': 6}, 'micro avg': {'precision': 0.631578947368421, 'recall': 0.5714285714285714, 'f1-score': 0.6, 'support': 21}, 'macro avg': {'precision': 0.641025641025641, 'recall': 0.6, 'f1-score': 0.6190476190476191, 'support': 21}, 'weighted avg': {'precision': 0.6300366300366301, 'recall': 0.5714285714285714, 'f1-score': 0.598639455782313, 'support': 21}}
Token level accuracy: 0.974739970282318
Wrong BIO-Encoding 1/19 labels, 5.26%
Dev-Data: Prec: 0.667, Rec: 0.571, F1: 0.6154



{'C': {'precision': 0.16643159379407615, 'recall': 0.15265200517464425, 'f1-score': 0.1592442645074224, 'support': 773}, 'P': {'precision': 0.20789779326364694, 'recall': 0.18881856540084388, 'f1-score': 0.19789939192924266, 'support': 948}, 'micro avg': {'precision': 0.189171974522293, 'recall': 0.1725740848343986, 'f1-score': 0.18049225159525983, 'support': 1721}, 'macro avg': {'precision': 0.18716469352886156, 'recall': 0.17073528528774407, 'f1-score': 0.17857182821833253, 'support': 1721}, 'weighted avg': {'precision': 0.18927294016081242, 'recall': 0.1725740848343986, 'f1-score': 0.18053715282577545, 'support': 1721}}
Token level accuracy: 0.5306364034071901
Wrong BIO-Encoding 1209/2694 labels, 44.88%



{'C': {'precision': 0.16643159379407615, 'recall': 0.15265200517464425, 'f1-score': 0.1592442645074224, 'support': 773}, 'P': {'precision': 0.20789779326364694, 'recall': 0.18881856540084388, 'f1-score': 0.19789939192924266, 'support': 948}, 'micro avg': {'precision': 0.189171974522293, 'recall': 0.1725740848343986, 'f1-score': 0.18049225159525983, 'support': 1721}, 'macro avg': {'precision': 0.18716469352886156, 'recall': 0.17073528528774407, 'f1-score': 0.17857182821833253, 'support': 1721}, 'weighted avg': {'precision': 0.18927294016081242, 'recall': 0.1725740848343986, 'f1-score': 0.18053715282577545, 'support': 1721}}
Token level accuracy: 0.5306364034071901
Wrong BIO-Encoding 85/1570 labels, 5.41%
Test-Data: Prec: 0.200, Rec: 0.173, F1: 0.1853

Scores from epoch with best dev-scores:
  Dev-Score: 0.7179
  Test-Score 0.1969

9.55 sec for evaluation

--------- Epoch 31 -----------
220.38 sec for training (7326.79 total)
-- cmv_modes1 --



{'C': {'precision': 0.8571428571428571, 'recall': 0.8, 'f1-score': 0.8275862068965518, 'support': 15}, 'P': {'precision': 0.6666666666666666, 'recall': 0.6666666666666666, 'f1-score': 0.6666666666666666, 'support': 6}, 'micro avg': {'precision': 0.8, 'recall': 0.7619047619047619, 'f1-score': 0.7804878048780488, 'support': 21}, 'macro avg': {'precision': 0.7619047619047619, 'recall': 0.7333333333333334, 'f1-score': 0.7471264367816093, 'support': 21}, 'weighted avg': {'precision': 0.802721088435374, 'recall': 0.7619047619047619, 'f1-score': 0.7816091954022989, 'support': 21}}
Token level accuracy: 0.9910846953937593
Wrong BIO-Encoding 10/29 labels, 34.48%



{'C': {'precision': 0.8571428571428571, 'recall': 0.8, 'f1-score': 0.8275862068965518, 'support': 15}, 'P': {'precision': 0.6666666666666666, 'recall': 0.6666666666666666, 'f1-score': 0.6666666666666666, 'support': 6}, 'micro avg': {'precision': 0.8, 'recall': 0.7619047619047619, 'f1-score': 0.7804878048780488, 'support': 21}, 'macro avg': {'precision': 0.7619047619047619, 'recall': 0.7333333333333334, 'f1-score': 0.7471264367816093, 'support': 21}, 'weighted avg': {'precision': 0.802721088435374, 'recall': 0.7619047619047619, 'f1-score': 0.7816091954022989, 'support': 21}}
Token level accuracy: 0.9910846953937593
Wrong BIO-Encoding 1/20 labels, 5.00%
Dev-Data: Prec: 0.842, Rec: 0.762, F1: 0.8000



{'C': {'precision': 0.1778975741239892, 'recall': 0.17076326002587322, 'f1-score': 0.17425742574257425, 'support': 773}, 'P': {'precision': 0.19340463458110516, 'recall': 0.2289029535864979, 'f1-score': 0.20966183574879227, 'support': 948}, 'micro avg': {'precision': 0.18723175965665237, 'recall': 0.20278907611853572, 'f1-score': 0.19470013947001397, 'support': 1721}, 'macro avg': {'precision': 0.18565110435254717, 'recall': 0.19983310680618555, 'f1-score': 0.19195963074568326, 'support': 1721}, 'weighted avg': {'precision': 0.18643952259194152, 'recall': 0.20278907611853572, 'f1-score': 0.1937596806443143, 'support': 1721}}
Token level accuracy: 0.5489075889755269
Wrong BIO-Encoding 719/2536 labels, 28.35%



{'C': {'precision': 0.1778975741239892, 'recall': 0.17076326002587322, 'f1-score': 0.17425742574257425, 'support': 773}, 'P': {'precision': 0.19340463458110516, 'recall': 0.2289029535864979, 'f1-score': 0.20966183574879227, 'support': 948}, 'micro avg': {'precision': 0.18723175965665237, 'recall': 0.20278907611853572, 'f1-score': 0.19470013947001397, 'support': 1721}, 'macro avg': {'precision': 0.18565110435254717, 'recall': 0.19983310680618555, 'f1-score': 0.19195963074568326, 'support': 1721}, 'weighted avg': {'precision': 0.18643952259194152, 'recall': 0.20278907611853572, 'f1-score': 0.1937596806443143, 'support': 1721}}
Token level accuracy: 0.5489075889755269
Wrong BIO-Encoding 47/1864 labels, 2.52%
Test-Data: Prec: 0.192, Rec: 0.203, F1: 0.1973

Scores from epoch with best dev-scores:
  Dev-Score: 0.8000
  Test-Score 0.1973

7.35 sec for evaluation

--------- Epoch 32 -----------
238.16 sec for training (7564.95 total)
-- cmv_modes1 --



{'C': {'precision': 0.7857142857142857, 'recall': 0.7333333333333333, 'f1-score': 0.7586206896551724, 'support': 15}, 'P': {'precision': 0.8333333333333334, 'recall': 0.8333333333333334, 'f1-score': 0.8333333333333334, 'support': 6}, 'micro avg': {'precision': 0.8, 'recall': 0.7619047619047619, 'f1-score': 0.7804878048780488, 'support': 21}, 'macro avg': {'precision': 0.8095238095238095, 'recall': 0.7833333333333333, 'f1-score': 0.7959770114942528, 'support': 21}, 'weighted avg': {'precision': 0.7993197278911565, 'recall': 0.7619047619047619, 'f1-score': 0.7799671592775042, 'support': 21}}
Token level accuracy: 0.9910846953937593
Wrong BIO-Encoding 9/28 labels, 32.14%



{'C': {'precision': 0.7857142857142857, 'recall': 0.7333333333333333, 'f1-score': 0.7586206896551724, 'support': 15}, 'P': {'precision': 0.8333333333333334, 'recall': 0.8333333333333334, 'f1-score': 0.8333333333333334, 'support': 6}, 'micro avg': {'precision': 0.8, 'recall': 0.7619047619047619, 'f1-score': 0.7804878048780488, 'support': 21}, 'macro avg': {'precision': 0.8095238095238095, 'recall': 0.7833333333333333, 'f1-score': 0.7959770114942528, 'support': 21}, 'weighted avg': {'precision': 0.7993197278911565, 'recall': 0.7619047619047619, 'f1-score': 0.7799671592775042, 'support': 21}}
Token level accuracy: 0.9910846953937593
Wrong BIO-Encoding 1/20 labels, 5.00%
Dev-Data: Prec: 0.800, Rec: 0.762, F1: 0.7805



{'C': {'precision': 0.15193965517241378, 'recall': 0.18240620957309184, 'f1-score': 0.1657848324514991, 'support': 773}, 'P': {'precision': 0.2026431718061674, 'recall': 0.1940928270042194, 'f1-score': 0.1982758620689655, 'support': 948}, 'micro avg': {'precision': 0.1770152505446623, 'recall': 0.18884369552585706, 'f1-score': 0.18273826258082654, 'support': 1721}, 'macro avg': {'precision': 0.1772914134892906, 'recall': 0.1882495182886556, 'f1-score': 0.18203034726023232, 'support': 1721}, 'weighted avg': {'precision': 0.17986930872778767, 'recall': 0.18884369552585706, 'f1-score': 0.18368227351910987, 'support': 1721}}
Token level accuracy: 0.5371985897732829
Wrong BIO-Encoding 1042/2800 labels, 37.21%



{'C': {'precision': 0.15193965517241378, 'recall': 0.18240620957309184, 'f1-score': 0.1657848324514991, 'support': 773}, 'P': {'precision': 0.2026431718061674, 'recall': 0.1940928270042194, 'f1-score': 0.1982758620689655, 'support': 948}, 'micro avg': {'precision': 0.1770152505446623, 'recall': 0.18884369552585706, 'f1-score': 0.18273826258082654, 'support': 1721}, 'macro avg': {'precision': 0.1772914134892906, 'recall': 0.1882495182886556, 'f1-score': 0.18203034726023232, 'support': 1721}, 'weighted avg': {'precision': 0.17986930872778767, 'recall': 0.18884369552585706, 'f1-score': 0.18368227351910987, 'support': 1721}}
Token level accuracy: 0.5371985897732829
Wrong BIO-Encoding 78/1836 labels, 4.25%
Test-Data: Prec: 0.184, Rec: 0.188, F1: 0.1857

Scores from epoch with best dev-scores:
  Dev-Score: 0.8000
  Test-Score 0.1973

9.58 sec for evaluation

--------- Epoch 33 -----------
239.38 sec for training (7804.32 total)
-- cmv_modes1 --



{'C': {'precision': 0.8571428571428571, 'recall': 0.8, 'f1-score': 0.8275862068965518, 'support': 15}, 'P': {'precision': 0.6666666666666666, 'recall': 0.6666666666666666, 'f1-score': 0.6666666666666666, 'support': 6}, 'micro avg': {'precision': 0.8, 'recall': 0.7619047619047619, 'f1-score': 0.7804878048780488, 'support': 21}, 'macro avg': {'precision': 0.7619047619047619, 'recall': 0.7333333333333334, 'f1-score': 0.7471264367816093, 'support': 21}, 'weighted avg': {'precision': 0.802721088435374, 'recall': 0.7619047619047619, 'f1-score': 0.7816091954022989, 'support': 21}}
Token level accuracy: 0.9925705794947994
Wrong BIO-Encoding 10/29 labels, 34.48%



{'C': {'precision': 0.8571428571428571, 'recall': 0.8, 'f1-score': 0.8275862068965518, 'support': 15}, 'P': {'precision': 0.6666666666666666, 'recall': 0.6666666666666666, 'f1-score': 0.6666666666666666, 'support': 6}, 'micro avg': {'precision': 0.8, 'recall': 0.7619047619047619, 'f1-score': 0.7804878048780488, 'support': 21}, 'macro avg': {'precision': 0.7619047619047619, 'recall': 0.7333333333333334, 'f1-score': 0.7471264367816093, 'support': 21}, 'weighted avg': {'precision': 0.802721088435374, 'recall': 0.7619047619047619, 'f1-score': 0.7816091954022989, 'support': 21}}
Token level accuracy: 0.9925705794947994
Wrong BIO-Encoding 1/20 labels, 5.00%
Dev-Data: Prec: 0.842, Rec: 0.762, F1: 0.8000



{'C': {'precision': 0.1761006289308176, 'recall': 0.1448900388098318, 'f1-score': 0.15897799858055356, 'support': 773}, 'P': {'precision': 0.23588342440801457, 'recall': 0.2732067510548523, 'f1-score': 0.2531769305962854, 'support': 948}, 'micro avg': {'precision': 0.21395617070357556, 'recall': 0.2155723416618245, 'f1-score': 0.2147612156295224, 'support': 1721}, 'macro avg': {'precision': 0.20599202666941607, 'recall': 0.20904839493234206, 'f1-score': 0.20607746458841947, 'support': 1721}, 'weighted avg': {'precision': 0.20903153544585695, 'recall': 0.2155723416618245, 'f1-score': 0.2108667769366917, 'support': 1721}}
Token level accuracy: 0.5548264237371008
Wrong BIO-Encoding 999/2673 labels, 37.37%



{'C': {'precision': 0.1761006289308176, 'recall': 0.1448900388098318, 'f1-score': 0.15897799858055356, 'support': 773}, 'P': {'precision': 0.23588342440801457, 'recall': 0.2732067510548523, 'f1-score': 0.2531769305962854, 'support': 948}, 'micro avg': {'precision': 0.21395617070357556, 'recall': 0.2155723416618245, 'f1-score': 0.2147612156295224, 'support': 1721}, 'macro avg': {'precision': 0.20599202666941607, 'recall': 0.20904839493234206, 'f1-score': 0.20607746458841947, 'support': 1721}, 'weighted avg': {'precision': 0.20903153544585695, 'recall': 0.2155723416618245, 'f1-score': 0.2108667769366917, 'support': 1721}}
Token level accuracy: 0.5548264237371008
Wrong BIO-Encoding 60/1734 labels, 3.46%
Test-Data: Prec: 0.222, Rec: 0.216, F1: 0.2186

Scores from epoch with best dev-scores:
  Dev-Score: 0.8000
  Test-Score 0.1973

9.71 sec for evaluation

--------- Epoch 34 -----------
239.14 sec for training (8043.46 total)
-- cmv_modes1 --



{'C': {'precision': 0.8461538461538461, 'recall': 0.7333333333333333, 'f1-score': 0.7857142857142856, 'support': 15}, 'P': {'precision': 0.6666666666666666, 'recall': 0.6666666666666666, 'f1-score': 0.6666666666666666, 'support': 6}, 'micro avg': {'precision': 0.7894736842105263, 'recall': 0.7142857142857143, 'f1-score': 0.7500000000000001, 'support': 21}, 'macro avg': {'precision': 0.7564102564102564, 'recall': 0.7, 'f1-score': 0.726190476190476, 'support': 21}, 'weighted avg': {'precision': 0.7948717948717949, 'recall': 0.7142857142857143, 'f1-score': 0.7517006802721088, 'support': 21}}
Token level accuracy: 0.9821693907875185



{'C': {'precision': 0.8461538461538461, 'recall': 0.7333333333333333, 'f1-score': 0.7857142857142856, 'support': 15}, 'P': {'precision': 0.6666666666666666, 'recall': 0.6666666666666666, 'f1-score': 0.6666666666666666, 'support': 6}, 'micro avg': {'precision': 0.7894736842105263, 'recall': 0.7142857142857143, 'f1-score': 0.7500000000000001, 'support': 21}, 'macro avg': {'precision': 0.7564102564102564, 'recall': 0.7, 'f1-score': 0.726190476190476, 'support': 21}, 'weighted avg': {'precision': 0.7948717948717949, 'recall': 0.7142857142857143, 'f1-score': 0.7517006802721088, 'support': 21}}
Token level accuracy: 0.9821693907875185
Dev-Data: Prec: 0.789, Rec: 0.714, F1: 0.7500



{'C': {'precision': 0.15864022662889518, 'recall': 0.1448900388098318, 'f1-score': 0.15145368492224476, 'support': 773}, 'P': {'precision': 0.2129455909943715, 'recall': 0.23945147679324894, 'f1-score': 0.22542204568023833, 'support': 948}, 'micro avg': {'precision': 0.19130925507900678, 'recall': 0.19697850087158628, 'f1-score': 0.1941024906956771, 'support': 1721}, 'macro avg': {'precision': 0.18579290881163335, 'recall': 0.19217075780154036, 'f1-score': 0.18843786530124154, 'support': 1721}, 'weighted avg': {'precision': 0.18855393111377117, 'recall': 0.19697850087158628, 'f1-score': 0.1921986041544225, 'support': 1721}}
Token level accuracy: 0.5590725443269255
Wrong BIO-Encoding 910/2614 labels, 34.81%



{'C': {'precision': 0.15864022662889518, 'recall': 0.1448900388098318, 'f1-score': 0.15145368492224476, 'support': 773}, 'P': {'precision': 0.2129455909943715, 'recall': 0.23945147679324894, 'f1-score': 0.22542204568023833, 'support': 948}, 'micro avg': {'precision': 0.19130925507900678, 'recall': 0.19697850087158628, 'f1-score': 0.1941024906956771, 'support': 1721}, 'macro avg': {'precision': 0.18579290881163335, 'recall': 0.19217075780154036, 'f1-score': 0.18843786530124154, 'support': 1721}, 'weighted avg': {'precision': 0.18855393111377117, 'recall': 0.19697850087158628, 'f1-score': 0.1921986041544225, 'support': 1721}}
Token level accuracy: 0.5590725443269255
Wrong BIO-Encoding 68/1772 labels, 3.84%
Test-Data: Prec: 0.199, Rec: 0.197, F1: 0.1980

Scores from epoch with best dev-scores:
  Dev-Score: 0.8000
  Test-Score 0.1973

9.64 sec for evaluation

--------- Epoch 35 -----------
240.00 sec for training (8283.47 total)
-- cmv_modes1 --



{'C': {'precision': 0.9285714285714286, 'recall': 0.8666666666666667, 'f1-score': 0.896551724137931, 'support': 15}, 'P': {'precision': 0.6666666666666666, 'recall': 0.6666666666666666, 'f1-score': 0.6666666666666666, 'support': 6}, 'micro avg': {'precision': 0.85, 'recall': 0.8095238095238095, 'f1-score': 0.8292682926829269, 'support': 21}, 'macro avg': {'precision': 0.7976190476190477, 'recall': 0.7666666666666666, 'f1-score': 0.7816091954022988, 'support': 21}, 'weighted avg': {'precision': 0.8537414965986395, 'recall': 0.8095238095238095, 'f1-score': 0.8308702791461413, 'support': 21}}
Token level accuracy: 0.9836552748885586



{'C': {'precision': 0.9285714285714286, 'recall': 0.8666666666666667, 'f1-score': 0.896551724137931, 'support': 15}, 'P': {'precision': 0.6666666666666666, 'recall': 0.6666666666666666, 'f1-score': 0.6666666666666666, 'support': 6}, 'micro avg': {'precision': 0.85, 'recall': 0.8095238095238095, 'f1-score': 0.8292682926829269, 'support': 21}, 'macro avg': {'precision': 0.7976190476190477, 'recall': 0.7666666666666666, 'f1-score': 0.7816091954022988, 'support': 21}, 'weighted avg': {'precision': 0.8537414965986395, 'recall': 0.8095238095238095, 'f1-score': 0.8308702791461413, 'support': 21}}
Token level accuracy: 0.9836552748885586
Dev-Data: Prec: 0.850, Rec: 0.810, F1: 0.8293



{'C': {'precision': 0.16133333333333333, 'recall': 0.15653298835705046, 'f1-score': 0.15889691398555486, 'support': 773}, 'P': {'precision': 0.2193877551020408, 'recall': 0.22679324894514769, 'f1-score': 0.2230290456431535, 'support': 948}, 'micro avg': {'precision': 0.19421965317919074, 'recall': 0.19523532829750145, 'f1-score': 0.1947261663286004, 'support': 1721}, 'macro avg': {'precision': 0.19036054421768706, 'recall': 0.19166311865109908, 'f1-score': 0.19096297981435417, 'support': 1721}, 'weighted avg': {'precision': 0.1933121780961077, 'recall': 0.19523532829750145, 'f1-score': 0.19422361986086195, 'support': 1721}}
Token level accuracy: 0.5469775341619701
Wrong BIO-Encoding 979/2646 labels, 37.00%



{'C': {'precision': 0.16133333333333333, 'recall': 0.15653298835705046, 'f1-score': 0.15889691398555486, 'support': 773}, 'P': {'precision': 0.2193877551020408, 'recall': 0.22679324894514769, 'f1-score': 0.2230290456431535, 'support': 948}, 'micro avg': {'precision': 0.19421965317919074, 'recall': 0.19523532829750145, 'f1-score': 0.1947261663286004, 'support': 1721}, 'macro avg': {'precision': 0.19036054421768706, 'recall': 0.19166311865109908, 'f1-score': 0.19096297981435417, 'support': 1721}, 'weighted avg': {'precision': 0.1933121780961077, 'recall': 0.19523532829750145, 'f1-score': 0.19422361986086195, 'support': 1721}}
Token level accuracy: 0.5469775341619701
Wrong BIO-Encoding 63/1730 labels, 3.64%
Test-Data: Prec: 0.202, Rec: 0.195, F1: 0.1983

Scores from epoch with best dev-scores:
  Dev-Score: 0.8293
  Test-Score 0.1983

9.60 sec for evaluation

--------- Epoch 36 -----------
240.18 sec for training (8523.65 total)
-- cmv_modes1 --



{'C': {'precision': 0.9333333333333333, 'recall': 0.9333333333333333, 'f1-score': 0.9333333333333333, 'support': 15}, 'P': {'precision': 0.6666666666666666, 'recall': 0.6666666666666666, 'f1-score': 0.6666666666666666, 'support': 6}, 'micro avg': {'precision': 0.8571428571428571, 'recall': 0.8571428571428571, 'f1-score': 0.8571428571428571, 'support': 21}, 'macro avg': {'precision': 0.8, 'recall': 0.8, 'f1-score': 0.8, 'support': 21}, 'weighted avg': {'precision': 0.8571428571428571, 'recall': 0.8571428571428571, 'f1-score': 0.8571428571428571, 'support': 21}}
Token level accuracy: 0.9940564635958395
Wrong BIO-Encoding 10/30 labels, 33.33%



{'C': {'precision': 0.9333333333333333, 'recall': 0.9333333333333333, 'f1-score': 0.9333333333333333, 'support': 15}, 'P': {'precision': 0.6666666666666666, 'recall': 0.6666666666666666, 'f1-score': 0.6666666666666666, 'support': 6}, 'micro avg': {'precision': 0.8571428571428571, 'recall': 0.8571428571428571, 'f1-score': 0.8571428571428571, 'support': 21}, 'macro avg': {'precision': 0.8, 'recall': 0.8, 'f1-score': 0.8, 'support': 21}, 'weighted avg': {'precision': 0.8571428571428571, 'recall': 0.8571428571428571, 'f1-score': 0.8571428571428571, 'support': 21}}
Token level accuracy: 0.9940564635958395
Wrong BIO-Encoding 1/21 labels, 4.76%
Dev-Data: Prec: 0.900, Rec: 0.857, F1: 0.8780



{'C': {'precision': 0.18547140649149924, 'recall': 0.15523932729624837, 'f1-score': 0.16901408450704225, 'support': 773}, 'P': {'precision': 0.19982773471145565, 'recall': 0.24472573839662448, 'f1-score': 0.2200094831673779, 'support': 948}, 'micro avg': {'precision': 0.19469026548672566, 'recall': 0.20453224869262057, 'f1-score': 0.19948994049305754, 'support': 1721}, 'macro avg': {'precision': 0.19264957060147744, 'recall': 0.1999825328464364, 'f1-score': 0.19451178383721007, 'support': 1721}, 'weighted avg': {'precision': 0.1933794826986571, 'recall': 0.20453224869262057, 'f1-score': 0.19710451909739563, 'support': 1721}}
Token level accuracy: 0.5725571939576417
Wrong BIO-Encoding 961/2699 labels, 35.61%



{'C': {'precision': 0.18547140649149924, 'recall': 0.15523932729624837, 'f1-score': 0.16901408450704225, 'support': 773}, 'P': {'precision': 0.19982773471145565, 'recall': 0.24472573839662448, 'f1-score': 0.2200094831673779, 'support': 948}, 'micro avg': {'precision': 0.19469026548672566, 'recall': 0.20453224869262057, 'f1-score': 0.19948994049305754, 'support': 1721}, 'macro avg': {'precision': 0.19264957060147744, 'recall': 0.1999825328464364, 'f1-score': 0.19451178383721007, 'support': 1721}, 'weighted avg': {'precision': 0.1933794826986571, 'recall': 0.20453224869262057, 'f1-score': 0.19710451909739563, 'support': 1721}}
Token level accuracy: 0.5725571939576417
Wrong BIO-Encoding 70/1808 labels, 3.87%
Test-Data: Prec: 0.202, Rec: 0.204, F1: 0.2029

Scores from epoch with best dev-scores:
  Dev-Score: 0.8780
  Test-Score 0.2029

9.68 sec for evaluation

--------- Epoch 37 -----------
240.02 sec for training (8763.67 total)
-- cmv_modes1 --



{'C': {'precision': 0.9333333333333333, 'recall': 0.9333333333333333, 'f1-score': 0.9333333333333333, 'support': 15}, 'P': {'precision': 0.6666666666666666, 'recall': 0.6666666666666666, 'f1-score': 0.6666666666666666, 'support': 6}, 'micro avg': {'precision': 0.8571428571428571, 'recall': 0.8571428571428571, 'f1-score': 0.8571428571428571, 'support': 21}, 'macro avg': {'precision': 0.8, 'recall': 0.8, 'f1-score': 0.8, 'support': 21}, 'weighted avg': {'precision': 0.8571428571428571, 'recall': 0.8571428571428571, 'f1-score': 0.8571428571428571, 'support': 21}}
Token level accuracy: 0.9940564635958395
Wrong BIO-Encoding 10/30 labels, 33.33%



{'C': {'precision': 0.9333333333333333, 'recall': 0.9333333333333333, 'f1-score': 0.9333333333333333, 'support': 15}, 'P': {'precision': 0.6666666666666666, 'recall': 0.6666666666666666, 'f1-score': 0.6666666666666666, 'support': 6}, 'micro avg': {'precision': 0.8571428571428571, 'recall': 0.8571428571428571, 'f1-score': 0.8571428571428571, 'support': 21}, 'macro avg': {'precision': 0.8, 'recall': 0.8, 'f1-score': 0.8, 'support': 21}, 'weighted avg': {'precision': 0.8571428571428571, 'recall': 0.8571428571428571, 'f1-score': 0.8571428571428571, 'support': 21}}
Token level accuracy: 0.9940564635958395
Wrong BIO-Encoding 1/21 labels, 4.76%
Dev-Data: Prec: 0.900, Rec: 0.857, F1: 0.8780



{'C': {'precision': 0.15595075239398085, 'recall': 0.14747736093143596, 'f1-score': 0.15159574468085105, 'support': 773}, 'P': {'precision': 0.2111984282907662, 'recall': 0.22679324894514769, 'f1-score': 0.21871820956256358, 'support': 948}, 'micro avg': {'precision': 0.18810748999428245, 'recall': 0.19116792562463683, 'f1-score': 0.18962536023054755, 'support': 1721}, 'macro avg': {'precision': 0.18357459034237353, 'recall': 0.18713530493829184, 'f1-score': 0.1851569771217073, 'support': 1721}, 'weighted avg': {'precision': 0.18638352215002532, 'recall': 0.19116792562463683, 'f1-score': 0.18856965328507155, 'support': 1721}}
Token level accuracy: 0.5479554286008389
Wrong BIO-Encoding 1190/2862 labels, 41.58%



{'C': {'precision': 0.15595075239398085, 'recall': 0.14747736093143596, 'f1-score': 0.15159574468085105, 'support': 773}, 'P': {'precision': 0.2111984282907662, 'recall': 0.22679324894514769, 'f1-score': 0.21871820956256358, 'support': 948}, 'micro avg': {'precision': 0.18810748999428245, 'recall': 0.19116792562463683, 'f1-score': 0.18962536023054755, 'support': 1721}, 'macro avg': {'precision': 0.18357459034237353, 'recall': 0.18713530493829184, 'f1-score': 0.1851569771217073, 'support': 1721}, 'weighted avg': {'precision': 0.18638352215002532, 'recall': 0.19116792562463683, 'f1-score': 0.18856965328507155, 'support': 1721}}
Token level accuracy: 0.5479554286008389
Wrong BIO-Encoding 77/1749 labels, 4.40%
Test-Data: Prec: 0.197, Rec: 0.191, F1: 0.1939

Scores from epoch with best dev-scores:
  Dev-Score: 0.8780
  Test-Score 0.2029

9.55 sec for evaluation

--------- Epoch 38 -----------
240.06 sec for training (9003.72 total)
-- cmv_modes1 --



{'C': {'precision': 0.9333333333333333, 'recall': 0.9333333333333333, 'f1-score': 0.9333333333333333, 'support': 15}, 'P': {'precision': 0.6666666666666666, 'recall': 0.6666666666666666, 'f1-score': 0.6666666666666666, 'support': 6}, 'micro avg': {'precision': 0.8571428571428571, 'recall': 0.8571428571428571, 'f1-score': 0.8571428571428571, 'support': 21}, 'macro avg': {'precision': 0.8, 'recall': 0.8, 'f1-score': 0.8, 'support': 21}, 'weighted avg': {'precision': 0.8571428571428571, 'recall': 0.8571428571428571, 'f1-score': 0.8571428571428571, 'support': 21}}
Token level accuracy: 0.9910846953937593
Wrong BIO-Encoding 12/32 labels, 37.50%



{'C': {'precision': 0.9333333333333333, 'recall': 0.9333333333333333, 'f1-score': 0.9333333333333333, 'support': 15}, 'P': {'precision': 0.6666666666666666, 'recall': 0.6666666666666666, 'f1-score': 0.6666666666666666, 'support': 6}, 'micro avg': {'precision': 0.8571428571428571, 'recall': 0.8571428571428571, 'f1-score': 0.8571428571428571, 'support': 21}, 'macro avg': {'precision': 0.8, 'recall': 0.8, 'f1-score': 0.8, 'support': 21}, 'weighted avg': {'precision': 0.8571428571428571, 'recall': 0.8571428571428571, 'f1-score': 0.8571428571428571, 'support': 21}}
Token level accuracy: 0.9910846953937593
Wrong BIO-Encoding 1/21 labels, 4.76%
Dev-Data: Prec: 0.900, Rec: 0.857, F1: 0.8780



{'C': {'precision': 0.1544502617801047, 'recall': 0.22897800776196636, 'f1-score': 0.18447107868681603, 'support': 773}, 'P': {'precision': 0.20943952802359883, 'recall': 0.14978902953586498, 'f1-score': 0.17466174661746617, 'support': 948}, 'micro avg': {'precision': 0.17489035087719298, 'recall': 0.18535735037768739, 'f1-score': 0.17997179125528912, 'support': 1721}, 'macro avg': {'precision': 0.18194489490185178, 'recall': 0.18938351864891567, 'f1-score': 0.1795664126521411, 'support': 1721}, 'weighted avg': {'precision': 0.1847406885080724, 'recall': 0.18535735037768739, 'f1-score': 0.17906768135866746, 'support': 1721}}
Token level accuracy: 0.5202655755423454
Wrong BIO-Encoding 979/2735 labels, 35.80%



{'C': {'precision': 0.1544502617801047, 'recall': 0.22897800776196636, 'f1-score': 0.18447107868681603, 'support': 773}, 'P': {'precision': 0.20943952802359883, 'recall': 0.14978902953586498, 'f1-score': 0.17466174661746617, 'support': 948}, 'micro avg': {'precision': 0.17489035087719298, 'recall': 0.18535735037768739, 'f1-score': 0.17997179125528912, 'support': 1721}, 'macro avg': {'precision': 0.18194489490185178, 'recall': 0.18938351864891567, 'f1-score': 0.1795664126521411, 'support': 1721}, 'weighted avg': {'precision': 0.1847406885080724, 'recall': 0.18535735037768739, 'f1-score': 0.17906768135866746, 'support': 1721}}
Token level accuracy: 0.5202655755423454
Wrong BIO-Encoding 68/1824 labels, 3.73%
Test-Data: Prec: 0.181, Rec: 0.185, F1: 0.1829

Scores from epoch with best dev-scores:
  Dev-Score: 0.8780
  Test-Score 0.2029

9.66 sec for evaluation

--------- Epoch 39 -----------
239.37 sec for training (9243.09 total)
-- cmv_modes1 --



{'C': {'precision': 0.9333333333333333, 'recall': 0.9333333333333333, 'f1-score': 0.9333333333333333, 'support': 15}, 'P': {'precision': 0.6666666666666666, 'recall': 0.6666666666666666, 'f1-score': 0.6666666666666666, 'support': 6}, 'micro avg': {'precision': 0.8571428571428571, 'recall': 0.8571428571428571, 'f1-score': 0.8571428571428571, 'support': 21}, 'macro avg': {'precision': 0.8, 'recall': 0.8, 'f1-score': 0.8, 'support': 21}, 'weighted avg': {'precision': 0.8571428571428571, 'recall': 0.8571428571428571, 'f1-score': 0.8571428571428571, 'support': 21}}
Token level accuracy: 0.9881129271916791



{'C': {'precision': 0.9333333333333333, 'recall': 0.9333333333333333, 'f1-score': 0.9333333333333333, 'support': 15}, 'P': {'precision': 0.6666666666666666, 'recall': 0.6666666666666666, 'f1-score': 0.6666666666666666, 'support': 6}, 'micro avg': {'precision': 0.8571428571428571, 'recall': 0.8571428571428571, 'f1-score': 0.8571428571428571, 'support': 21}, 'macro avg': {'precision': 0.8, 'recall': 0.8, 'f1-score': 0.8, 'support': 21}, 'weighted avg': {'precision': 0.8571428571428571, 'recall': 0.8571428571428571, 'f1-score': 0.8571428571428571, 'support': 21}}
Token level accuracy: 0.9881129271916791
Dev-Data: Prec: 0.857, Rec: 0.857, F1: 0.8571



{'C': {'precision': 0.15772179627601315, 'recall': 0.18628719275549807, 'f1-score': 0.17081850533807832, 'support': 773}, 'P': {'precision': 0.21294363256784968, 'recall': 0.21518987341772153, 'f1-score': 0.21406086044071354, 'support': 948}, 'micro avg': {'precision': 0.18599679315873865, 'recall': 0.2022080185938408, 'f1-score': 0.19376391982182628, 'support': 1721}, 'macro avg': {'precision': 0.18533271442193142, 'recall': 0.2007385330866098, 'f1-score': 0.19243968288939595, 'support': 1721}, 'weighted avg': {'precision': 0.18814033247860526, 'recall': 0.2022080185938408, 'f1-score': 0.19463823377346365, 'support': 1721}}
Token level accuracy: 0.5485473120769964
Wrong BIO-Encoding 906/2714 labels, 33.38%



{'C': {'precision': 0.15772179627601315, 'recall': 0.18628719275549807, 'f1-score': 0.17081850533807832, 'support': 773}, 'P': {'precision': 0.21294363256784968, 'recall': 0.21518987341772153, 'f1-score': 0.21406086044071354, 'support': 948}, 'micro avg': {'precision': 0.18599679315873865, 'recall': 0.2022080185938408, 'f1-score': 0.19376391982182628, 'support': 1721}, 'macro avg': {'precision': 0.18533271442193142, 'recall': 0.2007385330866098, 'f1-score': 0.19243968288939595, 'support': 1721}, 'weighted avg': {'precision': 0.18814033247860526, 'recall': 0.2022080185938408, 'f1-score': 0.19463823377346365, 'support': 1721}}
Token level accuracy: 0.5485473120769964
Wrong BIO-Encoding 63/1871 labels, 3.37%
Test-Data: Prec: 0.192, Rec: 0.202, F1: 0.1972

Scores from epoch with best dev-scores:
  Dev-Score: 0.8780
  Test-Score 0.2029

8.61 sec for evaluation

--------- Epoch 40 -----------
234.06 sec for training (9477.15 total)
-- cmv_modes1 --



{'C': {'precision': 0.9333333333333333, 'recall': 0.9333333333333333, 'f1-score': 0.9333333333333333, 'support': 15}, 'P': {'precision': 0.6666666666666666, 'recall': 0.6666666666666666, 'f1-score': 0.6666666666666666, 'support': 6}, 'micro avg': {'precision': 0.8571428571428571, 'recall': 0.8571428571428571, 'f1-score': 0.8571428571428571, 'support': 21}, 'macro avg': {'precision': 0.8, 'recall': 0.8, 'f1-score': 0.8, 'support': 21}, 'weighted avg': {'precision': 0.8571428571428571, 'recall': 0.8571428571428571, 'f1-score': 0.8571428571428571, 'support': 21}}
Token level accuracy: 0.9940564635958395
Wrong BIO-Encoding 10/30 labels, 33.33%



{'C': {'precision': 0.9333333333333333, 'recall': 0.9333333333333333, 'f1-score': 0.9333333333333333, 'support': 15}, 'P': {'precision': 0.6666666666666666, 'recall': 0.6666666666666666, 'f1-score': 0.6666666666666666, 'support': 6}, 'micro avg': {'precision': 0.8571428571428571, 'recall': 0.8571428571428571, 'f1-score': 0.8571428571428571, 'support': 21}, 'macro avg': {'precision': 0.8, 'recall': 0.8, 'f1-score': 0.8, 'support': 21}, 'weighted avg': {'precision': 0.8571428571428571, 'recall': 0.8571428571428571, 'f1-score': 0.8571428571428571, 'support': 21}}
Token level accuracy: 0.9940564635958395
Wrong BIO-Encoding 1/21 labels, 4.76%
Dev-Data: Prec: 0.900, Rec: 0.857, F1: 0.8780



{'C': {'precision': 0.1751336898395722, 'recall': 0.16946959896507116, 'f1-score': 0.1722550953320184, 'support': 773}, 'P': {'precision': 0.20956937799043063, 'recall': 0.2310126582278481, 'f1-score': 0.21976919217260413, 'support': 948}, 'micro avg': {'precision': 0.19520356943669828, 'recall': 0.20337013364323067, 'f1-score': 0.199203187250996, 'support': 1721}, 'macro avg': {'precision': 0.19235153391500143, 'recall': 0.20024112859645965, 'f1-score': 0.19601214375231127, 'support': 1721}, 'weighted avg': {'precision': 0.19410233154033557, 'recall': 0.20337013364323067, 'f1-score': 0.19842788080841312, 'support': 1721}}
Token level accuracy: 0.5512493888159757
Wrong BIO-Encoding 740/2479 labels, 29.85%



{'C': {'precision': 0.1751336898395722, 'recall': 0.16946959896507116, 'f1-score': 0.1722550953320184, 'support': 773}, 'P': {'precision': 0.20956937799043063, 'recall': 0.2310126582278481, 'f1-score': 0.21976919217260413, 'support': 948}, 'micro avg': {'precision': 0.19520356943669828, 'recall': 0.20337013364323067, 'f1-score': 0.199203187250996, 'support': 1721}, 'macro avg': {'precision': 0.19235153391500143, 'recall': 0.20024112859645965, 'f1-score': 0.19601214375231127, 'support': 1721}, 'weighted avg': {'precision': 0.19410233154033557, 'recall': 0.20337013364323067, 'f1-score': 0.19842788080841312, 'support': 1721}}
Token level accuracy: 0.5512493888159757
Wrong BIO-Encoding 54/1793 labels, 3.01%
Test-Data: Prec: 0.201, Rec: 0.203, F1: 0.2023

Scores from epoch with best dev-scores:
  Dev-Score: 0.8780
  Test-Score 0.2029

9.50 sec for evaluation
---------RUN 2 ------------
Generate new embeddings files for a dataset
Read file: komninos_english_embeddings.gz
Added words: 10
:: Transform cmv_modes dataset ::
:: Create Train Matrix ::
Unknown-Tokens: 0.70%
:: Create Dev Matrix ::
Unknown-Tokens: 1.23%
:: Create Test Matrix ::
Unknown-Tokens: 1.06%
:: Transform cmv_modes1 dataset ::
:: Create Train Matrix ::
Unknown-Tokens: 0.70%
:: Create Dev Matrix ::
Unknown-Tokens: 1.23%
:: Create Test Matrix ::
Unknown-Tokens: 1.06%
:: Transform cmv_modes2 dataset ::
:: Create Train Matrix ::
Unknown-Tokens: 0.70%
:: Create Dev Matrix ::
Unknown-Tokens: 1.23%
:: Create Test Matrix ::
Unknown-Tokens: 1.06%
DONE - Embeddings file saved: pkl/cmv_modes_cmv_modes1_cmv_modes2_komninos_english_embeddings.pkl
--- cmv_modes ---
221 train sentences
3 dev sentences
235 test sentences
--- cmv_modes1 ---
221 train sentences
3 dev sentences
235 test sentences
--- cmv_modes2 ---
221 train sentences
3 dev sentences
235 test sentences
LSTM-Size: [100]
_____________________________________________________________________________________________________________________________
Layer (type)                             Output Shape               Param #        Connected to                              
=============================================================================================================================
words_input (InputLayer)                 (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
casing_input (InputLayer)                (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
word_embeddings (Embedding)              (None, None, 300)          66694800       words_input[0][0]                         
_____________________________________________________________________________________________________________________________
casing_emebddings (Embedding)            (None, None, 10)           80             casing_input[0][0]                        
_____________________________________________________________________________________________________________________________
concatenate_1 (Concatenate)              (None, None, 310)          0              word_embeddings[0][0]                     
                                                                                   casing_emebddings[0][0]                   
_____________________________________________________________________________________________________________________________
shared_varLSTM_1 (Bidirectional)         (None, None, 200)          328800         concatenate_1[0][0]                       
_____________________________________________________________________________________________________________________________
cmv_modes_hidden_lin_layer (TimeDistribu (None, None, 287)          57687          shared_varLSTM_1[0][0]                    
_____________________________________________________________________________________________________________________________
cmv_modes_crf (ChainCRF)                 (None, None, 287)          82943          cmv_modes_hidden_lin_layer[0][0]          
=============================================================================================================================
Total params: 67,164,310
Trainable params: 469,510
Non-trainable params: 66,694,800
_____________________________________________________________________________________________________________________________
_____________________________________________________________________________________________________________________________
Layer (type)                             Output Shape               Param #        Connected to                              
=============================================================================================================================
words_input (InputLayer)                 (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
casing_input (InputLayer)                (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
word_embeddings (Embedding)              (None, None, 300)          66694800       words_input[0][0]                         
_____________________________________________________________________________________________________________________________
casing_emebddings (Embedding)            (None, None, 10)           80             casing_input[0][0]                        
_____________________________________________________________________________________________________________________________
concatenate_1 (Concatenate)              (None, None, 310)          0              word_embeddings[0][0]                     
                                                                                   casing_emebddings[0][0]                   
_____________________________________________________________________________________________________________________________
shared_varLSTM_1 (Bidirectional)         (None, None, 200)          328800         concatenate_1[0][0]                       
_____________________________________________________________________________________________________________________________
cmv_modes1_hidden_lin_layer (TimeDistrib (None, None, 5)            1005           shared_varLSTM_1[0][0]                    
_____________________________________________________________________________________________________________________________
cmv_modes1_crf (ChainCRF)                (None, None, 5)            35             cmv_modes1_hidden_lin_layer[0][0]         
=============================================================================================================================
Total params: 67,024,720
Trainable params: 329,920
Non-trainable params: 66,694,800
_____________________________________________________________________________________________________________________________
_____________________________________________________________________________________________________________________________
Layer (type)                             Output Shape               Param #        Connected to                              
=============================================================================================================================
words_input (InputLayer)                 (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
casing_input (InputLayer)                (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
word_embeddings (Embedding)              (None, None, 300)          66694800       words_input[0][0]                         
_____________________________________________________________________________________________________________________________
casing_emebddings (Embedding)            (None, None, 10)           80             casing_input[0][0]                        
_____________________________________________________________________________________________________________________________
concatenate_1 (Concatenate)              (None, None, 310)          0              word_embeddings[0][0]                     
                                                                                   casing_emebddings[0][0]                   
_____________________________________________________________________________________________________________________________
shared_varLSTM_1 (Bidirectional)         (None, None, 200)          328800         concatenate_1[0][0]                       
_____________________________________________________________________________________________________________________________
cmv_modes2_softmax (TimeDistributed)     (None, None, 119)          23919          shared_varLSTM_1[0][0]                    
=============================================================================================================================
Total params: 67,047,599
Trainable params: 352,799
Non-trainable params: 66,694,800
_____________________________________________________________________________________________________________________________

--------- Epoch 1 -----------
237.68 sec for training (237.68 total)
-- cmv_modes1 --



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 3}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 48}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 51}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 51}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 51}}
Token level accuracy: 0.6253547776726585
Wrong BIO-Encoding 1044/1045 labels, 99.90%



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 3}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 48}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 51}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 51}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 51}}
Token level accuracy: 0.6253547776726585
Wrong BIO-Encoding 427/428 labels, 99.77%
Dev-Data: Prec: 0.000, Rec: 0.000, F1: 0.0000



{'C': {'precision': 0.001332859427759019, 'recall': 0.01935483870967742, 'f1-score': 0.002493972898827833, 'support': 775}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 1102}, 'micro avg': {'precision': 0.0006690753378830456, 'recall': 0.007991475759190196, 'f1-score': 0.0012347711557458016, 'support': 1877}, 'macro avg': {'precision': 0.0006664297138795095, 'recall': 0.00967741935483871, 'f1-score': 0.0012469864494139165, 'support': 1877}, 'weighted avg': {'precision': 0.0005503282133794565, 'recall': 0.007991475759190196, 'f1-score': 0.0010297437381947632, 'support': 1877}}
Token level accuracy: 0.40263216596029444
Wrong BIO-Encoding 44304/44417 labels, 99.75%



{'C': {'precision': 0.001332859427759019, 'recall': 0.01935483870967742, 'f1-score': 0.002493972898827833, 'support': 775}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 1102}, 'micro avg': {'precision': 0.0006690753378830456, 'recall': 0.007991475759190196, 'f1-score': 0.0012347711557458016, 'support': 1877}, 'macro avg': {'precision': 0.0006664297138795095, 'recall': 0.00967741935483871, 'f1-score': 0.0012469864494139165, 'support': 1877}, 'weighted avg': {'precision': 0.0005503282133794565, 'recall': 0.007991475759190196, 'f1-score': 0.0010297437381947632, 'support': 1877}}
Token level accuracy: 0.40263216596029444
Wrong BIO-Encoding 22306/22419 labels, 99.50%
Test-Data: Prec: 0.001, Rec: 0.008, F1: 0.0012

Scores from epoch with best dev-scores:
  Dev-Score: 0.0000
  Test-Score 0.0000

11.04 sec for evaluation

--------- Epoch 2 -----------
223.19 sec for training (460.87 total)
-- cmv_modes1 --



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 3}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 48}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 51}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 51}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 51}}
Token level accuracy: 0.09082308420056764
Wrong BIO-Encoding 814/822 labels, 99.03%



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 3}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 48}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 51}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 51}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 51}}
Token level accuracy: 0.09082308420056764
Wrong BIO-Encoding 26/34 labels, 76.47%
Dev-Data: Prec: 0.000, Rec: 0.000, F1: 0.0000



{'C': {'precision': 0.025982256020278833, 'recall': 0.05290322580645161, 'f1-score': 0.03484912877178071, 'support': 775}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 1102}, 'micro avg': {'precision': 0.025867507886435333, 'recall': 0.02184336707511987, 'f1-score': 0.02368573079145003, 'support': 1877}, 'macro avg': {'precision': 0.012991128010139416, 'recall': 0.026451612903225806, 'f1-score': 0.017424564385890354, 'support': 1877}, 'weighted avg': {'precision': 0.01072788940634848, 'recall': 0.02184336707511987, 'f1-score': 0.014388958336776798, 'support': 1877}}
Token level accuracy: 0.31755520856569264
Wrong BIO-Encoding 26054/26672 labels, 97.68%



{'C': {'precision': 0.025982256020278833, 'recall': 0.05290322580645161, 'f1-score': 0.03484912877178071, 'support': 775}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 1102}, 'micro avg': {'precision': 0.025867507886435333, 'recall': 0.02184336707511987, 'f1-score': 0.02368573079145003, 'support': 1877}, 'macro avg': {'precision': 0.012991128010139416, 'recall': 0.026451612903225806, 'f1-score': 0.017424564385890354, 'support': 1877}, 'weighted avg': {'precision': 0.01072788940634848, 'recall': 0.02184336707511987, 'f1-score': 0.014388958336776798, 'support': 1877}}
Token level accuracy: 0.31755520856569264
Wrong BIO-Encoding 967/1585 labels, 61.01%
Test-Data: Prec: 0.026, Rec: 0.022, F1: 0.0237

Scores from epoch with best dev-scores:
  Dev-Score: 0.0000
  Test-Score 0.0000

10.47 sec for evaluation

--------- Epoch 3 -----------
218.84 sec for training (679.72 total)
-- cmv_modes1 --



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 3}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 48}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 51}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 51}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 51}}
Token level accuracy: 0.7464522232734153
Wrong BIO-Encoding 939/941 labels, 99.79%



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 3}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 48}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 51}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 51}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 51}}
Token level accuracy: 0.7464522232734153
Wrong BIO-Encoding 10/12 labels, 83.33%
Dev-Data: Prec: 0.000, Rec: 0.000, F1: 0.0000



{'C': {'precision': 0.045180722891566265, 'recall': 0.01935483870967742, 'f1-score': 0.02710027100271003, 'support': 775}, 'P': {'precision': 0.004048582995951417, 'recall': 0.0018148820326678765, 'f1-score': 0.002506265664160401, 'support': 1102}, 'micro avg': {'precision': 0.020581113801452784, 'recall': 0.009057005860415556, 'f1-score': 0.012578616352201257, 'support': 1877}, 'macro avg': {'precision': 0.024614652943758843, 'recall': 0.010584860371172648, 'f1-score': 0.014803268333435215, 'support': 1877}, 'weighted avg': {'precision': 0.021031752105755096, 'recall': 0.009057005860415556, 'f1-score': 0.012660956200855106, 'support': 1877}}
Token level accuracy: 0.501070711577069
Wrong BIO-Encoding 37543/37684 labels, 99.63%



{'C': {'precision': 0.045180722891566265, 'recall': 0.01935483870967742, 'f1-score': 0.02710027100271003, 'support': 775}, 'P': {'precision': 0.004048582995951417, 'recall': 0.0018148820326678765, 'f1-score': 0.002506265664160401, 'support': 1102}, 'micro avg': {'precision': 0.020581113801452784, 'recall': 0.009057005860415556, 'f1-score': 0.012578616352201257, 'support': 1877}, 'macro avg': {'precision': 0.024614652943758843, 'recall': 0.010584860371172648, 'f1-score': 0.014803268333435215, 'support': 1877}, 'weighted avg': {'precision': 0.021031752105755096, 'recall': 0.009057005860415556, 'f1-score': 0.012660956200855106, 'support': 1877}}
Token level accuracy: 0.501070711577069
Wrong BIO-Encoding 685/826 labels, 82.93%
Test-Data: Prec: 0.021, Rec: 0.009, F1: 0.0126

Scores from epoch with best dev-scores:
  Dev-Score: 0.0000
  Test-Score 0.0000

9.57 sec for evaluation

--------- Epoch 4 -----------
218.47 sec for training (898.18 total)
-- cmv_modes1 --



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 3}, 'P': {'precision': 0.1, 'recall': 0.020833333333333332, 'f1-score': 0.034482758620689655, 'support': 48}, 'micro avg': {'precision': 0.07692307692307693, 'recall': 0.0196078431372549, 'f1-score': 0.03125, 'support': 51}, 'macro avg': {'precision': 0.05, 'recall': 0.010416666666666666, 'f1-score': 0.017241379310344827, 'support': 51}, 'weighted avg': {'precision': 0.09411764705882354, 'recall': 0.0196078431372549, 'f1-score': 0.032454361054766734, 'support': 51}}
Token level accuracy: 0.7568590350047304
Wrong BIO-Encoding 133/141 labels, 94.33%



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 3}, 'P': {'precision': 0.1, 'recall': 0.020833333333333332, 'f1-score': 0.034482758620689655, 'support': 48}, 'micro avg': {'precision': 0.07692307692307693, 'recall': 0.0196078431372549, 'f1-score': 0.03125, 'support': 51}, 'macro avg': {'precision': 0.05, 'recall': 0.010416666666666666, 'f1-score': 0.017241379310344827, 'support': 51}, 'weighted avg': {'precision': 0.09411764705882354, 'recall': 0.0196078431372549, 'f1-score': 0.032454361054766734, 'support': 51}}
Token level accuracy: 0.7568590350047304
Wrong BIO-Encoding 5/13 labels, 38.46%
Dev-Data: Prec: 0.125, Rec: 0.020, F1: 0.0339



{'C': {'precision': 0.06775067750677506, 'recall': 0.03225806451612903, 'f1-score': 0.0437062937062937, 'support': 775}, 'P': {'precision': 0.011182108626198083, 'recall': 0.006352087114337568, 'f1-score': 0.008101851851851853, 'support': 1102}, 'micro avg': {'precision': 0.032160804020100506, 'recall': 0.017048481619605753, 'f1-score': 0.022284122562674095, 'support': 1877}, 'macro avg': {'precision': 0.03946639306648657, 'recall': 0.0193050758152333, 'f1-score': 0.025904072779072775, 'support': 1877}, 'weighted avg': {'precision': 0.034538869884827364, 'recall': 0.017048481619605753, 'f1-score': 0.022802673608480744, 'support': 1877}}
Token level accuracy: 0.5089895159491412
Wrong BIO-Encoding 15277/15936 labels, 95.86%



{'C': {'precision': 0.06775067750677506, 'recall': 0.03225806451612903, 'f1-score': 0.0437062937062937, 'support': 775}, 'P': {'precision': 0.011182108626198083, 'recall': 0.006352087114337568, 'f1-score': 0.008101851851851853, 'support': 1102}, 'micro avg': {'precision': 0.032160804020100506, 'recall': 0.017048481619605753, 'f1-score': 0.022284122562674095, 'support': 1877}, 'macro avg': {'precision': 0.03946639306648657, 'recall': 0.0193050758152333, 'f1-score': 0.025904072779072775, 'support': 1877}, 'weighted avg': {'precision': 0.034538869884827364, 'recall': 0.017048481619605753, 'f1-score': 0.022802673608480744, 'support': 1877}}
Token level accuracy: 0.5089895159491412
Wrong BIO-Encoding 336/995 labels, 33.77%
Test-Data: Prec: 0.032, Rec: 0.017, F1: 0.0223

Scores from epoch with best dev-scores:
  Dev-Score: 0.0339
  Test-Score 0.0223

9.50 sec for evaluation

--------- Epoch 5 -----------
218.85 sec for training (1117.03 total)
-- cmv_modes1 --



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 3}, 'P': {'precision': 0.058823529411764705, 'recall': 0.020833333333333332, 'f1-score': 0.03076923076923077, 'support': 48}, 'micro avg': {'precision': 0.045454545454545456, 'recall': 0.0196078431372549, 'f1-score': 0.027397260273972605, 'support': 51}, 'macro avg': {'precision': 0.029411764705882353, 'recall': 0.010416666666666666, 'f1-score': 0.015384615384615385, 'support': 51}, 'weighted avg': {'precision': 0.05536332179930795, 'recall': 0.0196078431372549, 'f1-score': 0.02895927601809955, 'support': 51}}
Token level accuracy: 0.7880794701986755
Wrong BIO-Encoding 105/123 labels, 85.37%



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 3}, 'P': {'precision': 0.058823529411764705, 'recall': 0.020833333333333332, 'f1-score': 0.03076923076923077, 'support': 48}, 'micro avg': {'precision': 0.045454545454545456, 'recall': 0.0196078431372549, 'f1-score': 0.027397260273972605, 'support': 51}, 'macro avg': {'precision': 0.029411764705882353, 'recall': 0.010416666666666666, 'f1-score': 0.015384615384615385, 'support': 51}, 'weighted avg': {'precision': 0.05536332179930795, 'recall': 0.0196078431372549, 'f1-score': 0.02895927601809955, 'support': 51}}
Token level accuracy: 0.7880794701986755
Wrong BIO-Encoding 4/22 labels, 18.18%
Dev-Data: Prec: 0.056, Rec: 0.020, F1: 0.0290



{'C': {'precision': 0.09336609336609336, 'recall': 0.04903225806451613, 'f1-score': 0.06429780033840947, 'support': 775}, 'P': {'precision': 0.04994797086368366, 'recall': 0.043557168784029036, 'f1-score': 0.0465341735336888, 'support': 1102}, 'micro avg': {'precision': 0.06286549707602339, 'recall': 0.04581779435269046, 'f1-score': 0.053004622496147916, 'support': 1877}, 'macro avg': {'precision': 0.07165703211488851, 'recall': 0.046294713424272584, 'f1-score': 0.055415986936049134, 'support': 1877}, 'weighted avg': {'precision': 0.06787500599387414, 'recall': 0.04581779435269046, 'f1-score': 0.053868649172292164, 'support': 1877}}
Token level accuracy: 0.507316529109971
Wrong BIO-Encoding 5704/6807 labels, 83.80%



{'C': {'precision': 0.09336609336609336, 'recall': 0.04903225806451613, 'f1-score': 0.06429780033840947, 'support': 775}, 'P': {'precision': 0.04994797086368366, 'recall': 0.043557168784029036, 'f1-score': 0.0465341735336888, 'support': 1102}, 'micro avg': {'precision': 0.06286549707602339, 'recall': 0.04581779435269046, 'f1-score': 0.053004622496147916, 'support': 1877}, 'macro avg': {'precision': 0.07165703211488851, 'recall': 0.046294713424272584, 'f1-score': 0.055415986936049134, 'support': 1877}, 'weighted avg': {'precision': 0.06787500599387414, 'recall': 0.04581779435269046, 'f1-score': 0.053868649172292164, 'support': 1877}}
Token level accuracy: 0.507316529109971
Wrong BIO-Encoding 265/1368 labels, 19.37%
Test-Data: Prec: 0.074, Rec: 0.044, F1: 0.0550

Scores from epoch with best dev-scores:
  Dev-Score: 0.0339
  Test-Score 0.0223

9.49 sec for evaluation

--------- Epoch 6 -----------
218.73 sec for training (1335.77 total)
-- cmv_modes1 --



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 3}, 'P': {'precision': 0.375, 'recall': 0.125, 'f1-score': 0.1875, 'support': 48}, 'micro avg': {'precision': 0.25, 'recall': 0.11764705882352941, 'f1-score': 0.15999999999999998, 'support': 51}, 'macro avg': {'precision': 0.1875, 'recall': 0.0625, 'f1-score': 0.09375, 'support': 51}, 'weighted avg': {'precision': 0.35294117647058826, 'recall': 0.11764705882352941, 'f1-score': 0.17647058823529413, 'support': 51}}
Token level accuracy: 0.8183538315988647
Wrong BIO-Encoding 41/62 labels, 66.13%



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 3}, 'P': {'precision': 0.375, 'recall': 0.125, 'f1-score': 0.1875, 'support': 48}, 'micro avg': {'precision': 0.25, 'recall': 0.11764705882352941, 'f1-score': 0.15999999999999998, 'support': 51}, 'macro avg': {'precision': 0.1875, 'recall': 0.0625, 'f1-score': 0.09375, 'support': 51}, 'weighted avg': {'precision': 0.35294117647058826, 'recall': 0.11764705882352941, 'f1-score': 0.17647058823529413, 'support': 51}}
Token level accuracy: 0.8183538315988647
Wrong BIO-Encoding 3/24 labels, 12.50%
Dev-Data: Prec: 0.286, Rec: 0.118, F1: 0.1667



{'C': {'precision': 0.07300672430355427, 'recall': 0.09806451612903226, 'f1-score': 0.08370044052863436, 'support': 775}, 'P': {'precision': 0.06831395348837209, 'recall': 0.0426497277676951, 'f1-score': 0.05251396648044693, 'support': 1102}, 'micro avg': {'precision': 0.07113938692886061, 'recall': 0.06553010122535961, 'f1-score': 0.06821963394342762, 'support': 1877}, 'macro avg': {'precision': 0.07066033889596318, 'recall': 0.07035712194836369, 'f1-score': 0.06810720350454064, 'support': 1877}, 'weighted avg': {'precision': 0.07025156530604189, 'recall': 0.06553010122535961, 'f1-score': 0.06539064063459998, 'support': 1877}}
Token level accuracy: 0.4931072942226188
Wrong BIO-Encoding 11497/12737 labels, 90.26%



{'C': {'precision': 0.07300672430355427, 'recall': 0.09806451612903226, 'f1-score': 0.08370044052863436, 'support': 775}, 'P': {'precision': 0.06831395348837209, 'recall': 0.0426497277676951, 'f1-score': 0.05251396648044693, 'support': 1102}, 'micro avg': {'precision': 0.07113938692886061, 'recall': 0.06553010122535961, 'f1-score': 0.06821963394342762, 'support': 1877}, 'macro avg': {'precision': 0.07066033889596318, 'recall': 0.07035712194836369, 'f1-score': 0.06810720350454064, 'support': 1877}, 'weighted avg': {'precision': 0.07025156530604189, 'recall': 0.06553010122535961, 'f1-score': 0.06539064063459998, 'support': 1877}}
Token level accuracy: 0.4931072942226188
Wrong BIO-Encoding 489/1729 labels, 28.28%
Test-Data: Prec: 0.098, Rec: 0.064, F1: 0.0776

Scores from epoch with best dev-scores:
  Dev-Score: 0.1667
  Test-Score 0.0776

9.62 sec for evaluation

--------- Epoch 7 -----------
219.82 sec for training (1555.59 total)
-- cmv_modes1 --



{'C': {'precision': 0.125, 'recall': 0.3333333333333333, 'f1-score': 0.18181818181818182, 'support': 3}, 'P': {'precision': 0.275, 'recall': 0.22916666666666666, 'f1-score': 0.25, 'support': 48}, 'micro avg': {'precision': 0.25, 'recall': 0.23529411764705882, 'f1-score': 0.24242424242424243, 'support': 51}, 'macro avg': {'precision': 0.2, 'recall': 0.28125, 'f1-score': 0.2159090909090909, 'support': 51}, 'weighted avg': {'precision': 0.2661764705882353, 'recall': 0.23529411764705882, 'f1-score': 0.2459893048128342, 'support': 51}}
Token level accuracy: 0.815515610217597
Wrong BIO-Encoding 15/61 labels, 24.59%



{'C': {'precision': 0.125, 'recall': 0.3333333333333333, 'f1-score': 0.18181818181818182, 'support': 3}, 'P': {'precision': 0.275, 'recall': 0.22916666666666666, 'f1-score': 0.25, 'support': 48}, 'micro avg': {'precision': 0.25, 'recall': 0.23529411764705882, 'f1-score': 0.24242424242424243, 'support': 51}, 'macro avg': {'precision': 0.2, 'recall': 0.28125, 'f1-score': 0.2159090909090909, 'support': 51}, 'weighted avg': {'precision': 0.2661764705882353, 'recall': 0.23529411764705882, 'f1-score': 0.2459893048128342, 'support': 51}}
Token level accuracy: 0.815515610217597
Wrong BIO-Encoding 2/48 labels, 4.17%
Dev-Data: Prec: 0.261, Rec: 0.235, F1: 0.2474



{'C': {'precision': 0.09121621621621621, 'recall': 0.1393548387096774, 'f1-score': 0.11026033690658497, 'support': 775}, 'P': {'precision': 0.0843644544431946, 'recall': 0.06805807622504537, 'f1-score': 0.0753390256152687, 'support': 1102}, 'micro avg': {'precision': 0.08827785817655572, 'recall': 0.0974960042621204, 'f1-score': 0.09265822784810127, 'support': 1877}, 'macro avg': {'precision': 0.0877903353297054, 'recall': 0.10370645746736139, 'f1-score': 0.09279968126092683, 'support': 1877}, 'weighted avg': {'precision': 0.08719349832923176, 'recall': 0.0974960042621204, 'f1-score': 0.08975778760289263, 'support': 1877}}
Token level accuracy: 0.4981485612313183
Wrong BIO-Encoding 7449/9067 labels, 82.16%



{'C': {'precision': 0.09121621621621621, 'recall': 0.1393548387096774, 'f1-score': 0.11026033690658497, 'support': 775}, 'P': {'precision': 0.0843644544431946, 'recall': 0.06805807622504537, 'f1-score': 0.0753390256152687, 'support': 1102}, 'micro avg': {'precision': 0.08827785817655572, 'recall': 0.0974960042621204, 'f1-score': 0.09265822784810127, 'support': 1877}, 'macro avg': {'precision': 0.0877903353297054, 'recall': 0.10370645746736139, 'f1-score': 0.09279968126092683, 'support': 1877}, 'weighted avg': {'precision': 0.08719349832923176, 'recall': 0.0974960042621204, 'f1-score': 0.08975778760289263, 'support': 1877}}
Token level accuracy: 0.4981485612313183
Wrong BIO-Encoding 455/2073 labels, 21.95%
Test-Data: Prec: 0.109, Rec: 0.094, F1: 0.1013

Scores from epoch with best dev-scores:
  Dev-Score: 0.2474
  Test-Score 0.1013

9.71 sec for evaluation

--------- Epoch 8 -----------
218.70 sec for training (1774.29 total)
-- cmv_modes1 --



{'C': {'precision': 0.04, 'recall': 0.3333333333333333, 'f1-score': 0.07142857142857142, 'support': 3}, 'P': {'precision': 0.16, 'recall': 0.08333333333333333, 'f1-score': 0.1095890410958904, 'support': 48}, 'micro avg': {'precision': 0.1, 'recall': 0.09803921568627451, 'f1-score': 0.099009900990099, 'support': 51}, 'macro avg': {'precision': 0.1, 'recall': 0.20833333333333331, 'f1-score': 0.09050880626223091, 'support': 51}, 'weighted avg': {'precision': 0.15294117647058822, 'recall': 0.09803921568627451, 'f1-score': 0.10734430758604811, 'support': 51}}
Token level accuracy: 0.6234626300851467
Wrong BIO-Encoding 30/75 labels, 40.00%



{'C': {'precision': 0.04, 'recall': 0.3333333333333333, 'f1-score': 0.07142857142857142, 'support': 3}, 'P': {'precision': 0.16, 'recall': 0.08333333333333333, 'f1-score': 0.1095890410958904, 'support': 48}, 'micro avg': {'precision': 0.1, 'recall': 0.09803921568627451, 'f1-score': 0.099009900990099, 'support': 51}, 'macro avg': {'precision': 0.1, 'recall': 0.20833333333333331, 'f1-score': 0.09050880626223091, 'support': 51}, 'weighted avg': {'precision': 0.15294117647058822, 'recall': 0.09803921568627451, 'f1-score': 0.10734430758604811, 'support': 51}}
Token level accuracy: 0.6234626300851467
Wrong BIO-Encoding 5/50 labels, 10.00%
Dev-Data: Prec: 0.111, Rec: 0.098, F1: 0.1042



{'C': {'precision': 0.0891891891891892, 'recall': 0.1703225806451613, 'f1-score': 0.11707317073170732, 'support': 775}, 'P': {'precision': 0.0640495867768595, 'recall': 0.028130671506352088, 'f1-score': 0.03909205548549811, 'support': 1102}, 'micro avg': {'precision': 0.0829938900203666, 'recall': 0.08684070324986681, 'f1-score': 0.08487373079927102, 'support': 1877}, 'macro avg': {'precision': 0.07661938798302434, 'recall': 0.09922662607575669, 'f1-score': 0.07808261310860272, 'support': 1877}, 'weighted avg': {'precision': 0.0744295504793398, 'recall': 0.08684070324986681, 'f1-score': 0.0712899054140075, 'support': 1877}}
Token level accuracy: 0.44800356903859023
Wrong BIO-Encoding 6875/8424 labels, 81.61%



{'C': {'precision': 0.0891891891891892, 'recall': 0.1703225806451613, 'f1-score': 0.11707317073170732, 'support': 775}, 'P': {'precision': 0.0640495867768595, 'recall': 0.028130671506352088, 'f1-score': 0.03909205548549811, 'support': 1102}, 'micro avg': {'precision': 0.0829938900203666, 'recall': 0.08684070324986681, 'f1-score': 0.08487373079927102, 'support': 1877}, 'macro avg': {'precision': 0.07661938798302434, 'recall': 0.09922662607575669, 'f1-score': 0.07808261310860272, 'support': 1877}, 'weighted avg': {'precision': 0.0744295504793398, 'recall': 0.08684070324986681, 'f1-score': 0.0712899054140075, 'support': 1877}}
Token level accuracy: 0.44800356903859023
Wrong BIO-Encoding 415/1964 labels, 21.13%
Test-Data: Prec: 0.105, Rec: 0.087, F1: 0.0952

Scores from epoch with best dev-scores:
  Dev-Score: 0.2474
  Test-Score 0.1013

9.61 sec for evaluation

--------- Epoch 9 -----------
219.44 sec for training (1993.74 total)
-- cmv_modes1 --



{'C': {'precision': 0.09090909090909091, 'recall': 0.3333333333333333, 'f1-score': 0.14285714285714288, 'support': 3}, 'P': {'precision': 0.3090909090909091, 'recall': 0.3541666666666667, 'f1-score': 0.33009708737864074, 'support': 48}, 'micro avg': {'precision': 0.2727272727272727, 'recall': 0.35294117647058826, 'f1-score': 0.30769230769230765, 'support': 51}, 'macro avg': {'precision': 0.2, 'recall': 0.34375, 'f1-score': 0.23647711511789182, 'support': 51}, 'weighted avg': {'precision': 0.2962566844919786, 'recall': 0.35294117647058826, 'f1-score': 0.31908297299502325, 'support': 51}}
Token level accuracy: 0.7871333964049196
Wrong BIO-Encoding 17/81 labels, 20.99%



{'C': {'precision': 0.09090909090909091, 'recall': 0.3333333333333333, 'f1-score': 0.14285714285714288, 'support': 3}, 'P': {'precision': 0.3090909090909091, 'recall': 0.3541666666666667, 'f1-score': 0.33009708737864074, 'support': 48}, 'micro avg': {'precision': 0.2727272727272727, 'recall': 0.35294117647058826, 'f1-score': 0.30769230769230765, 'support': 51}, 'macro avg': {'precision': 0.2, 'recall': 0.34375, 'f1-score': 0.23647711511789182, 'support': 51}, 'weighted avg': {'precision': 0.2962566844919786, 'recall': 0.35294117647058826, 'f1-score': 0.31908297299502325, 'support': 51}}
Token level accuracy: 0.7871333964049196
Wrong BIO-Encoding 2/66 labels, 3.03%
Dev-Data: Prec: 0.281, Rec: 0.353, F1: 0.3130



{'C': {'precision': 0.1088911088911089, 'recall': 0.1406451612903226, 'f1-score': 0.12274774774774774, 'support': 775}, 'P': {'precision': 0.13823272090988625, 'recall': 0.14337568058076225, 'f1-score': 0.14075723830734965, 'support': 1102}, 'micro avg': {'precision': 0.12453358208955224, 'recall': 0.14224826851358552, 'f1-score': 0.13280278537677195, 'support': 1877}, 'macro avg': {'precision': 0.12356191490049757, 'recall': 0.14201042093554242, 'f1-score': 0.1317524930275487, 'support': 1877}, 'weighted avg': {'precision': 0.12611777721539907, 'recall': 0.14224826851358552, 'f1-score': 0.1333212472664911, 'support': 1877}}
Token level accuracy: 0.5117109078741914
Wrong BIO-Encoding 3502/5443 labels, 64.34%



{'C': {'precision': 0.1088911088911089, 'recall': 0.1406451612903226, 'f1-score': 0.12274774774774774, 'support': 775}, 'P': {'precision': 0.13823272090988625, 'recall': 0.14337568058076225, 'f1-score': 0.14075723830734965, 'support': 1102}, 'micro avg': {'precision': 0.12453358208955224, 'recall': 0.14224826851358552, 'f1-score': 0.13280278537677195, 'support': 1877}, 'macro avg': {'precision': 0.12356191490049757, 'recall': 0.14201042093554242, 'f1-score': 0.1317524930275487, 'support': 1877}, 'weighted avg': {'precision': 0.12611777721539907, 'recall': 0.14224826851358552, 'f1-score': 0.1333212472664911, 'support': 1877}}
Token level accuracy: 0.5117109078741914
Wrong BIO-Encoding 203/2144 labels, 9.47%
Test-Data: Prec: 0.138, Rec: 0.142, F1: 0.1399

Scores from epoch with best dev-scores:
  Dev-Score: 0.3130
  Test-Score 0.1399

9.61 sec for evaluation

--------- Epoch 10 -----------
219.85 sec for training (2213.59 total)
-- cmv_modes1 --



{'C': {'precision': 0.06666666666666667, 'recall': 0.3333333333333333, 'f1-score': 0.1111111111111111, 'support': 3}, 'P': {'precision': 0.33962264150943394, 'recall': 0.375, 'f1-score': 0.3564356435643565, 'support': 48}, 'micro avg': {'precision': 0.27941176470588236, 'recall': 0.37254901960784315, 'f1-score': 0.319327731092437, 'support': 51}, 'macro avg': {'precision': 0.2031446540880503, 'recall': 0.35416666666666663, 'f1-score': 0.2337733773377338, 'support': 51}, 'weighted avg': {'precision': 0.3235664076951535, 'recall': 0.37254901960784315, 'f1-score': 0.3420047887141655, 'support': 51}}
Token level accuracy: 0.760643330179754



{'C': {'precision': 0.06666666666666667, 'recall': 0.3333333333333333, 'f1-score': 0.1111111111111111, 'support': 3}, 'P': {'precision': 0.33962264150943394, 'recall': 0.375, 'f1-score': 0.3564356435643565, 'support': 48}, 'micro avg': {'precision': 0.27941176470588236, 'recall': 0.37254901960784315, 'f1-score': 0.319327731092437, 'support': 51}, 'macro avg': {'precision': 0.2031446540880503, 'recall': 0.35416666666666663, 'f1-score': 0.2337733773377338, 'support': 51}, 'weighted avg': {'precision': 0.3235664076951535, 'recall': 0.37254901960784315, 'f1-score': 0.3420047887141655, 'support': 51}}
Token level accuracy: 0.760643330179754
Dev-Data: Prec: 0.279, Rec: 0.373, F1: 0.3193



{'C': {'precision': 0.11694510739856802, 'recall': 0.12645161290322582, 'f1-score': 0.12151270923744577, 'support': 775}, 'P': {'precision': 0.16539440203562342, 'recall': 0.17695099818511797, 'f1-score': 0.17097764138535732, 'support': 1102}, 'micro avg': {'precision': 0.14526524541398117, 'recall': 0.1561001598295152, 'f1-score': 0.1504879301489471, 'support': 1877}, 'macro avg': {'precision': 0.14116975471709572, 'recall': 0.15170130554417188, 'f1-score': 0.14624517531140155, 'support': 1877}, 'weighted avg': {'precision': 0.14539003158079233, 'recall': 0.1561001598295152, 'f1-score': 0.15055392139887278, 'support': 1877}}
Token level accuracy: 0.5262324336381887
Wrong BIO-Encoding 1834/3734 labels, 49.12%



{'C': {'precision': 0.11694510739856802, 'recall': 0.12645161290322582, 'f1-score': 0.12151270923744577, 'support': 775}, 'P': {'precision': 0.16539440203562342, 'recall': 0.17695099818511797, 'f1-score': 0.17097764138535732, 'support': 1102}, 'micro avg': {'precision': 0.14526524541398117, 'recall': 0.1561001598295152, 'f1-score': 0.1504879301489471, 'support': 1877}, 'macro avg': {'precision': 0.14116975471709572, 'recall': 0.15170130554417188, 'f1-score': 0.14624517531140155, 'support': 1877}, 'weighted avg': {'precision': 0.14539003158079233, 'recall': 0.1561001598295152, 'f1-score': 0.15055392139887278, 'support': 1877}}
Token level accuracy: 0.5262324336381887
Wrong BIO-Encoding 117/2017 labels, 5.80%
Test-Data: Prec: 0.154, Rec: 0.156, F1: 0.1546

Scores from epoch with best dev-scores:
  Dev-Score: 0.3193
  Test-Score 0.1546

9.66 sec for evaluation

--------- Epoch 11 -----------
220.61 sec for training (2434.19 total)
-- cmv_modes1 --



{'C': {'precision': 0.09090909090909091, 'recall': 0.3333333333333333, 'f1-score': 0.14285714285714288, 'support': 3}, 'P': {'precision': 0.36, 'recall': 0.375, 'f1-score': 0.3673469387755102, 'support': 48}, 'micro avg': {'precision': 0.3114754098360656, 'recall': 0.37254901960784315, 'f1-score': 0.3392857142857143, 'support': 51}, 'macro avg': {'precision': 0.22545454545454546, 'recall': 0.35416666666666663, 'f1-score': 0.25510204081632654, 'support': 51}, 'weighted avg': {'precision': 0.34417112299465247, 'recall': 0.37254901960784315, 'f1-score': 0.35414165666266506, 'support': 51}}
Token level accuracy: 0.7653736991485336
Wrong BIO-Encoding 15/74 labels, 20.27%



{'C': {'precision': 0.09090909090909091, 'recall': 0.3333333333333333, 'f1-score': 0.14285714285714288, 'support': 3}, 'P': {'precision': 0.36, 'recall': 0.375, 'f1-score': 0.3673469387755102, 'support': 48}, 'micro avg': {'precision': 0.3114754098360656, 'recall': 0.37254901960784315, 'f1-score': 0.3392857142857143, 'support': 51}, 'macro avg': {'precision': 0.22545454545454546, 'recall': 0.35416666666666663, 'f1-score': 0.25510204081632654, 'support': 51}, 'weighted avg': {'precision': 0.34417112299465247, 'recall': 0.37254901960784315, 'f1-score': 0.35414165666266506, 'support': 51}}
Token level accuracy: 0.7653736991485336
Wrong BIO-Encoding 2/61 labels, 3.28%
Dev-Data: Prec: 0.322, Rec: 0.373, F1: 0.3455



{'C': {'precision': 0.1180931744312026, 'recall': 0.1406451612903226, 'f1-score': 0.12838633686690226, 'support': 775}, 'P': {'precision': 0.14752567693744165, 'recall': 0.14337568058076225, 'f1-score': 0.14542107685227795, 'support': 1102}, 'micro avg': {'precision': 0.13390170511534605, 'recall': 0.14224826851358552, 'f1-score': 0.13794885042624647, 'support': 1877}, 'macro avg': {'precision': 0.13280942568432214, 'recall': 0.14201042093554242, 'f1-score': 0.1369037068595901, 'support': 1877}, 'weighted avg': {'precision': 0.13537320520471108, 'recall': 0.14224826851358552, 'f1-score': 0.13838755341665399, 'support': 1877}}
Token level accuracy: 0.5248717376756636
Wrong BIO-Encoding 3386/5194 labels, 65.19%



{'C': {'precision': 0.1180931744312026, 'recall': 0.1406451612903226, 'f1-score': 0.12838633686690226, 'support': 775}, 'P': {'precision': 0.14752567693744165, 'recall': 0.14337568058076225, 'f1-score': 0.14542107685227795, 'support': 1102}, 'micro avg': {'precision': 0.13390170511534605, 'recall': 0.14224826851358552, 'f1-score': 0.13794885042624647, 'support': 1877}, 'macro avg': {'precision': 0.13280942568432214, 'recall': 0.14201042093554242, 'f1-score': 0.1369037068595901, 'support': 1877}, 'weighted avg': {'precision': 0.13537320520471108, 'recall': 0.14224826851358552, 'f1-score': 0.13838755341665399, 'support': 1877}}
Token level accuracy: 0.5248717376756636
Wrong BIO-Encoding 186/1994 labels, 9.33%
Test-Data: Prec: 0.144, Rec: 0.139, F1: 0.1417

Scores from epoch with best dev-scores:
  Dev-Score: 0.3455
  Test-Score 0.1417

9.52 sec for evaluation

--------- Epoch 12 -----------
218.56 sec for training (2652.75 total)
-- cmv_modes1 --



{'C': {'precision': 0.07142857142857142, 'recall': 0.3333333333333333, 'f1-score': 0.11764705882352941, 'support': 3}, 'P': {'precision': 0.5, 'recall': 0.4375, 'f1-score': 0.4666666666666667, 'support': 48}, 'micro avg': {'precision': 0.39285714285714285, 'recall': 0.43137254901960786, 'f1-score': 0.4112149532710281, 'support': 51}, 'macro avg': {'precision': 0.2857142857142857, 'recall': 0.38541666666666663, 'f1-score': 0.29215686274509806, 'support': 51}, 'weighted avg': {'precision': 0.4747899159663866, 'recall': 0.43137254901960786, 'f1-score': 0.44613610149942323, 'support': 51}}
Token level accuracy: 0.7701040681173131
Wrong BIO-Encoding 15/69 labels, 21.74%



{'C': {'precision': 0.07142857142857142, 'recall': 0.3333333333333333, 'f1-score': 0.11764705882352941, 'support': 3}, 'P': {'precision': 0.5, 'recall': 0.4375, 'f1-score': 0.4666666666666667, 'support': 48}, 'micro avg': {'precision': 0.39285714285714285, 'recall': 0.43137254901960786, 'f1-score': 0.4112149532710281, 'support': 51}, 'macro avg': {'precision': 0.2857142857142857, 'recall': 0.38541666666666663, 'f1-score': 0.29215686274509806, 'support': 51}, 'weighted avg': {'precision': 0.4747899159663866, 'recall': 0.43137254901960786, 'f1-score': 0.44613610149942323, 'support': 51}}
Token level accuracy: 0.7701040681173131
Wrong BIO-Encoding 2/56 labels, 3.57%
Dev-Data: Prec: 0.407, Rec: 0.431, F1: 0.4190



{'C': {'precision': 0.16323024054982818, 'recall': 0.12258064516129032, 'f1-score': 0.1400147383935151, 'support': 775}, 'P': {'precision': 0.15902964959568733, 'recall': 0.16061705989110708, 'f1-score': 0.1598194130925508, 'support': 1102}, 'micro avg': {'precision': 0.16047197640117994, 'recall': 0.1449120937666489, 'f1-score': 0.1522956326987682, 'support': 1877}, 'macro avg': {'precision': 0.16112994507275774, 'recall': 0.1415988525261987, 'f1-score': 0.14991707574303295, 'support': 1877}, 'weighted avg': {'precision': 0.160764043836209, 'recall': 0.1449120937666489, 'f1-score': 0.15164220324079122, 'support': 1877}}
Token level accuracy: 0.5486727637742583
Wrong BIO-Encoding 4658/6162 labels, 75.59%



{'C': {'precision': 0.16323024054982818, 'recall': 0.12258064516129032, 'f1-score': 0.1400147383935151, 'support': 775}, 'P': {'precision': 0.15902964959568733, 'recall': 0.16061705989110708, 'f1-score': 0.1598194130925508, 'support': 1102}, 'micro avg': {'precision': 0.16047197640117994, 'recall': 0.1449120937666489, 'f1-score': 0.1522956326987682, 'support': 1877}, 'macro avg': {'precision': 0.16112994507275774, 'recall': 0.1415988525261987, 'f1-score': 0.14991707574303295, 'support': 1877}, 'weighted avg': {'precision': 0.160764043836209, 'recall': 0.1449120937666489, 'f1-score': 0.15164220324079122, 'support': 1877}}
Token level accuracy: 0.5486727637742583
Wrong BIO-Encoding 191/1695 labels, 11.27%
Test-Data: Prec: 0.180, Rec: 0.144, F1: 0.1597

Scores from epoch with best dev-scores:
  Dev-Score: 0.4190
  Test-Score 0.1597

9.45 sec for evaluation

--------- Epoch 13 -----------
216.51 sec for training (2869.26 total)
-- cmv_modes1 --



{'C': {'precision': 0.09090909090909091, 'recall': 0.6666666666666666, 'f1-score': 0.16, 'support': 3}, 'P': {'precision': 0.43478260869565216, 'recall': 0.4166666666666667, 'f1-score': 0.425531914893617, 'support': 48}, 'micro avg': {'precision': 0.3235294117647059, 'recall': 0.43137254901960786, 'f1-score': 0.3697478991596639, 'support': 51}, 'macro avg': {'precision': 0.2628458498023715, 'recall': 0.5416666666666666, 'f1-score': 0.2927659574468085, 'support': 51}, 'weighted avg': {'precision': 0.4145547547082074, 'recall': 0.43137254901960786, 'f1-score': 0.4099123904881102, 'support': 51}}
Token level accuracy: 0.7407757805108799
Wrong BIO-Encoding 22/87 labels, 25.29%



{'C': {'precision': 0.09090909090909091, 'recall': 0.6666666666666666, 'f1-score': 0.16, 'support': 3}, 'P': {'precision': 0.43478260869565216, 'recall': 0.4166666666666667, 'f1-score': 0.425531914893617, 'support': 48}, 'micro avg': {'precision': 0.3235294117647059, 'recall': 0.43137254901960786, 'f1-score': 0.3697478991596639, 'support': 51}, 'macro avg': {'precision': 0.2628458498023715, 'recall': 0.5416666666666666, 'f1-score': 0.2927659574468085, 'support': 51}, 'weighted avg': {'precision': 0.4145547547082074, 'recall': 0.43137254901960786, 'f1-score': 0.4099123904881102, 'support': 51}}
Token level accuracy: 0.7407757805108799
Wrong BIO-Encoding 3/68 labels, 4.41%
Dev-Data: Prec: 0.338, Rec: 0.431, F1: 0.3793



{'C': {'precision': 0.11858974358974358, 'recall': 0.1432258064516129, 'f1-score': 0.12974868497954412, 'support': 775}, 'P': {'precision': 0.1720747295968535, 'recall': 0.1588021778584392, 'f1-score': 0.16517225106182162, 'support': 1102}, 'micro avg': {'precision': 0.14644137224782386, 'recall': 0.1523708044752264, 'f1-score': 0.14934725848563968, 'support': 1877}, 'macro avg': {'precision': 0.14533223659329852, 'recall': 0.15101399215502603, 'f1-score': 0.14746046802068286, 'support': 1877}, 'weighted avg': {'precision': 0.1499911578571038, 'recall': 0.1523708044752264, 'f1-score': 0.15054611162987433, 'support': 1877}}
Token level accuracy: 0.5273031452152577
Wrong BIO-Encoding 2522/4327 labels, 58.29%



{'C': {'precision': 0.11858974358974358, 'recall': 0.1432258064516129, 'f1-score': 0.12974868497954412, 'support': 775}, 'P': {'precision': 0.1720747295968535, 'recall': 0.1588021778584392, 'f1-score': 0.16517225106182162, 'support': 1102}, 'micro avg': {'precision': 0.14644137224782386, 'recall': 0.1523708044752264, 'f1-score': 0.14934725848563968, 'support': 1877}, 'macro avg': {'precision': 0.14533223659329852, 'recall': 0.15101399215502603, 'f1-score': 0.14746046802068286, 'support': 1877}, 'weighted avg': {'precision': 0.1499911578571038, 'recall': 0.1523708044752264, 'f1-score': 0.15054611162987433, 'support': 1877}}
Token level accuracy: 0.5273031452152577
Wrong BIO-Encoding 148/1953 labels, 7.58%
Test-Data: Prec: 0.158, Rec: 0.152, F1: 0.1554

Scores from epoch with best dev-scores:
  Dev-Score: 0.4190
  Test-Score 0.1597

9.49 sec for evaluation

--------- Epoch 14 -----------
216.73 sec for training (3085.99 total)
-- cmv_modes1 --



{'C': {'precision': 0.04, 'recall': 0.3333333333333333, 'f1-score': 0.07142857142857142, 'support': 3}, 'P': {'precision': 0.391304347826087, 'recall': 0.375, 'f1-score': 0.3829787234042554, 'support': 48}, 'micro avg': {'precision': 0.2676056338028169, 'recall': 0.37254901960784315, 'f1-score': 0.3114754098360656, 'support': 51}, 'macro avg': {'precision': 0.21565217391304348, 'recall': 0.35416666666666663, 'f1-score': 0.2272036474164134, 'support': 51}, 'weighted avg': {'precision': 0.37063938618925835, 'recall': 0.37254901960784315, 'f1-score': 0.364652243876274, 'support': 51}}
Token level accuracy: 0.674550614947966
Wrong BIO-Encoding 66/129 labels, 51.16%



{'C': {'precision': 0.04, 'recall': 0.3333333333333333, 'f1-score': 0.07142857142857142, 'support': 3}, 'P': {'precision': 0.391304347826087, 'recall': 0.375, 'f1-score': 0.3829787234042554, 'support': 48}, 'micro avg': {'precision': 0.2676056338028169, 'recall': 0.37254901960784315, 'f1-score': 0.3114754098360656, 'support': 51}, 'macro avg': {'precision': 0.21565217391304348, 'recall': 0.35416666666666663, 'f1-score': 0.2272036474164134, 'support': 51}, 'weighted avg': {'precision': 0.37063938618925835, 'recall': 0.37254901960784315, 'f1-score': 0.364652243876274, 'support': 51}}
Token level accuracy: 0.674550614947966
Wrong BIO-Encoding 8/71 labels, 11.27%
Dev-Data: Prec: 0.302, Rec: 0.373, F1: 0.3333



{'C': {'precision': 0.11911111111111111, 'recall': 0.17290322580645162, 'f1-score': 0.14105263157894737, 'support': 775}, 'P': {'precision': 0.17266949152542374, 'recall': 0.14791288566243194, 'f1-score': 0.15933528836754643, 'support': 1102}, 'micro avg': {'precision': 0.14354760753987433, 'recall': 0.1582312200319659, 'f1-score': 0.1505321844906234, 'support': 1877}, 'macro avg': {'precision': 0.1458903013182674, 'recall': 0.16040805573444178, 'f1-score': 0.15019395997324692, 'support': 1877}, 'weighted avg': {'precision': 0.15055561575499632, 'recall': 0.1582312200319659, 'f1-score': 0.15178650892632944, 'support': 1877}}
Token level accuracy: 0.5029890698193175
Wrong BIO-Encoding 3281/5133 labels, 63.92%



{'C': {'precision': 0.11911111111111111, 'recall': 0.17290322580645162, 'f1-score': 0.14105263157894737, 'support': 775}, 'P': {'precision': 0.17266949152542374, 'recall': 0.14791288566243194, 'f1-score': 0.15933528836754643, 'support': 1102}, 'micro avg': {'precision': 0.14354760753987433, 'recall': 0.1582312200319659, 'f1-score': 0.1505321844906234, 'support': 1877}, 'macro avg': {'precision': 0.1458903013182674, 'recall': 0.16040805573444178, 'f1-score': 0.15019395997324692, 'support': 1877}, 'weighted avg': {'precision': 0.15055561575499632, 'recall': 0.1582312200319659, 'f1-score': 0.15178650892632944, 'support': 1877}}
Token level accuracy: 0.5029890698193175
Wrong BIO-Encoding 217/2069 labels, 10.49%
Test-Data: Prec: 0.156, Rec: 0.153, F1: 0.1545

Scores from epoch with best dev-scores:
  Dev-Score: 0.4190
  Test-Score 0.1597

9.46 sec for evaluation

--------- Epoch 15 -----------
216.54 sec for training (3302.53 total)
-- cmv_modes1 --



{'C': {'precision': 0.1111111111111111, 'recall': 0.3333333333333333, 'f1-score': 0.16666666666666666, 'support': 3}, 'P': {'precision': 0.5185185185185185, 'recall': 0.5833333333333334, 'f1-score': 0.5490196078431373, 'support': 48}, 'micro avg': {'precision': 0.4603174603174603, 'recall': 0.5686274509803921, 'f1-score': 0.5087719298245614, 'support': 51}, 'macro avg': {'precision': 0.31481481481481477, 'recall': 0.45833333333333337, 'f1-score': 0.35784313725490197, 'support': 51}, 'weighted avg': {'precision': 0.494553376906318, 'recall': 0.5686274509803921, 'f1-score': 0.5265282583621684, 'support': 51}}
Token level accuracy: 0.8325449385052034
Wrong BIO-Encoding 9/71 labels, 12.68%



{'C': {'precision': 0.1111111111111111, 'recall': 0.3333333333333333, 'f1-score': 0.16666666666666666, 'support': 3}, 'P': {'precision': 0.5185185185185185, 'recall': 0.5833333333333334, 'f1-score': 0.5490196078431373, 'support': 48}, 'micro avg': {'precision': 0.4603174603174603, 'recall': 0.5686274509803921, 'f1-score': 0.5087719298245614, 'support': 51}, 'macro avg': {'precision': 0.31481481481481477, 'recall': 0.45833333333333337, 'f1-score': 0.35784313725490197, 'support': 51}, 'weighted avg': {'precision': 0.494553376906318, 'recall': 0.5686274509803921, 'f1-score': 0.5265282583621684, 'support': 51}}
Token level accuracy: 0.8325449385052034
Wrong BIO-Encoding 1/63 labels, 1.59%
Dev-Data: Prec: 0.468, Rec: 0.569, F1: 0.5133



{'C': {'precision': 0.13509060955518945, 'recall': 0.10580645161290322, 'f1-score': 0.11866859623733719, 'support': 775}, 'P': {'precision': 0.1736842105263158, 'recall': 0.17967332123411978, 'f1-score': 0.17662801070472792, 'support': 1102}, 'micro avg': {'precision': 0.16027475672581568, 'recall': 0.14917421417155036, 'f1-score': 0.15452538631346582, 'support': 1877}, 'macro avg': {'precision': 0.15438741004075263, 'recall': 0.1427398864235115, 'f1-score': 0.14764830347103255, 'support': 1877}, 'weighted avg': {'precision': 0.15774918615091735, 'recall': 0.14917421417155036, 'f1-score': 0.15269697915852234, 'support': 1877}}
Token level accuracy: 0.5354673209904082
Wrong BIO-Encoding 2837/4438 labels, 63.93%



{'C': {'precision': 0.13509060955518945, 'recall': 0.10580645161290322, 'f1-score': 0.11866859623733719, 'support': 775}, 'P': {'precision': 0.1736842105263158, 'recall': 0.17967332123411978, 'f1-score': 0.17662801070472792, 'support': 1102}, 'micro avg': {'precision': 0.16027475672581568, 'recall': 0.14917421417155036, 'f1-score': 0.15452538631346582, 'support': 1877}, 'macro avg': {'precision': 0.15438741004075263, 'recall': 0.1427398864235115, 'f1-score': 0.14764830347103255, 'support': 1877}, 'weighted avg': {'precision': 0.15774918615091735, 'recall': 0.14917421417155036, 'f1-score': 0.15269697915852234, 'support': 1877}}
Token level accuracy: 0.5354673209904082
Wrong BIO-Encoding 146/1747 labels, 8.36%
Test-Data: Prec: 0.173, Rec: 0.148, F1: 0.1593

Scores from epoch with best dev-scores:
  Dev-Score: 0.5133
  Test-Score 0.1593

9.41 sec for evaluation

--------- Epoch 16 -----------
217.13 sec for training (3519.66 total)
-- cmv_modes1 --



{'C': {'precision': 0.06666666666666667, 'recall': 0.3333333333333333, 'f1-score': 0.1111111111111111, 'support': 3}, 'P': {'precision': 0.5555555555555556, 'recall': 0.5208333333333334, 'f1-score': 0.5376344086021506, 'support': 48}, 'micro avg': {'precision': 0.43333333333333335, 'recall': 0.5098039215686274, 'f1-score': 0.46846846846846846, 'support': 51}, 'macro avg': {'precision': 0.3111111111111111, 'recall': 0.42708333333333337, 'f1-score': 0.32437275985663083, 'support': 51}, 'weighted avg': {'precision': 0.526797385620915, 'recall': 0.5098039215686274, 'f1-score': 0.5125448028673836, 'support': 51}}
Token level accuracy: 0.7984862819299905
Wrong BIO-Encoding 12/70 labels, 17.14%



{'C': {'precision': 0.06666666666666667, 'recall': 0.3333333333333333, 'f1-score': 0.1111111111111111, 'support': 3}, 'P': {'precision': 0.5555555555555556, 'recall': 0.5208333333333334, 'f1-score': 0.5376344086021506, 'support': 48}, 'micro avg': {'precision': 0.43333333333333335, 'recall': 0.5098039215686274, 'f1-score': 0.46846846846846846, 'support': 51}, 'macro avg': {'precision': 0.3111111111111111, 'recall': 0.42708333333333337, 'f1-score': 0.32437275985663083, 'support': 51}, 'weighted avg': {'precision': 0.526797385620915, 'recall': 0.5098039215686274, 'f1-score': 0.5125448028673836, 'support': 51}}
Token level accuracy: 0.7984862819299905
Wrong BIO-Encoding 2/60 labels, 3.33%
Dev-Data: Prec: 0.448, Rec: 0.510, F1: 0.4771



{'C': {'precision': 0.11969111969111969, 'recall': 0.16, 'f1-score': 0.13694091662065158, 'support': 775}, 'P': {'precision': 0.16535433070866143, 'recall': 0.15245009074410162, 'f1-score': 0.15864022662889518, 'support': 1102}, 'micro avg': {'precision': 0.14230019493177387, 'recall': 0.1555673947789025, 'f1-score': 0.1486383303639603, 'support': 1877}, 'macro avg': {'precision': 0.14252272519989057, 'recall': 0.1562250453720508, 'f1-score': 0.14779057162477338, 'support': 1877}, 'weighted avg': {'precision': 0.1465003144387654, 'recall': 0.1555673947789025, 'f1-score': 0.14968073528292353, 'support': 1877}}
Token level accuracy: 0.5197858576845862
Wrong BIO-Encoding 1898/3813 labels, 49.78%



{'C': {'precision': 0.11969111969111969, 'recall': 0.16, 'f1-score': 0.13694091662065158, 'support': 775}, 'P': {'precision': 0.16535433070866143, 'recall': 0.15245009074410162, 'f1-score': 0.15864022662889518, 'support': 1102}, 'micro avg': {'precision': 0.14230019493177387, 'recall': 0.1555673947789025, 'f1-score': 0.1486383303639603, 'support': 1877}, 'macro avg': {'precision': 0.14252272519989057, 'recall': 0.1562250453720508, 'f1-score': 0.14779057162477338, 'support': 1877}, 'weighted avg': {'precision': 0.1465003144387654, 'recall': 0.1555673947789025, 'f1-score': 0.14968073528292353, 'support': 1877}}
Token level accuracy: 0.5197858576845862
Wrong BIO-Encoding 137/2052 labels, 6.68%
Test-Data: Prec: 0.150, Rec: 0.153, F1: 0.1519

Scores from epoch with best dev-scores:
  Dev-Score: 0.5133
  Test-Score 0.1593

9.38 sec for evaluation

--------- Epoch 17 -----------
216.93 sec for training (3736.60 total)
-- cmv_modes1 --



{'C': {'precision': 0.1111111111111111, 'recall': 0.3333333333333333, 'f1-score': 0.16666666666666666, 'support': 3}, 'P': {'precision': 0.5283018867924528, 'recall': 0.5833333333333334, 'f1-score': 0.5544554455445545, 'support': 48}, 'micro avg': {'precision': 0.46774193548387094, 'recall': 0.5686274509803921, 'f1-score': 0.5132743362831858, 'support': 51}, 'macro avg': {'precision': 0.31970649895178194, 'recall': 0.45833333333333337, 'f1-score': 0.36056105610561057, 'support': 51}, 'weighted avg': {'precision': 0.5037612529288445, 'recall': 0.5686274509803921, 'f1-score': 0.5316443409046787, 'support': 51}}
Token level accuracy: 0.8694418164616841



{'C': {'precision': 0.1111111111111111, 'recall': 0.3333333333333333, 'f1-score': 0.16666666666666666, 'support': 3}, 'P': {'precision': 0.5283018867924528, 'recall': 0.5833333333333334, 'f1-score': 0.5544554455445545, 'support': 48}, 'micro avg': {'precision': 0.46774193548387094, 'recall': 0.5686274509803921, 'f1-score': 0.5132743362831858, 'support': 51}, 'macro avg': {'precision': 0.31970649895178194, 'recall': 0.45833333333333337, 'f1-score': 0.36056105610561057, 'support': 51}, 'weighted avg': {'precision': 0.5037612529288445, 'recall': 0.5686274509803921, 'f1-score': 0.5316443409046787, 'support': 51}}
Token level accuracy: 0.8694418164616841
Dev-Data: Prec: 0.468, Rec: 0.569, F1: 0.5133



{'C': {'precision': 0.14200298953662183, 'recall': 0.12258064516129032, 'f1-score': 0.13157894736842107, 'support': 775}, 'P': {'precision': 0.18799368088467613, 'recall': 0.2159709618874773, 'f1-score': 0.2010135135135135, 'support': 1102}, 'micro avg': {'precision': 0.17209302325581396, 'recall': 0.17741076185402238, 'f1-score': 0.17471143756558236, 'support': 1877}, 'macro avg': {'precision': 0.164998335210649, 'recall': 0.16927580352438382, 'f1-score': 0.16629623044096728, 'support': 1877}, 'weighted avg': {'precision': 0.16900445030676348, 'recall': 0.17741076185402238, 'f1-score': 0.1723444731499298, 'support': 1877}}
Token level accuracy: 0.5380325674771358
Wrong BIO-Encoding 1256/3107 labels, 40.42%



{'C': {'precision': 0.14200298953662183, 'recall': 0.12258064516129032, 'f1-score': 0.13157894736842107, 'support': 775}, 'P': {'precision': 0.18799368088467613, 'recall': 0.2159709618874773, 'f1-score': 0.2010135135135135, 'support': 1102}, 'micro avg': {'precision': 0.17209302325581396, 'recall': 0.17741076185402238, 'f1-score': 0.17471143756558236, 'support': 1877}, 'macro avg': {'precision': 0.164998335210649, 'recall': 0.16927580352438382, 'f1-score': 0.16629623044096728, 'support': 1877}, 'weighted avg': {'precision': 0.16900445030676348, 'recall': 0.17741076185402238, 'f1-score': 0.1723444731499298, 'support': 1877}}
Token level accuracy: 0.5380325674771358
Wrong BIO-Encoding 84/1935 labels, 4.34%
Test-Data: Prec: 0.179, Rec: 0.176, F1: 0.1776

Scores from epoch with best dev-scores:
  Dev-Score: 0.5133
  Test-Score 0.1593

9.51 sec for evaluation

--------- Epoch 18 -----------
217.45 sec for training (3954.04 total)
-- cmv_modes1 --



{'C': {'precision': 0.15384615384615385, 'recall': 0.6666666666666666, 'f1-score': 0.25, 'support': 3}, 'P': {'precision': 0.6, 'recall': 0.625, 'f1-score': 0.6122448979591836, 'support': 48}, 'micro avg': {'precision': 0.5079365079365079, 'recall': 0.6274509803921569, 'f1-score': 0.5614035087719298, 'support': 51}, 'macro avg': {'precision': 0.3769230769230769, 'recall': 0.6458333333333333, 'f1-score': 0.4311224489795918, 'support': 51}, 'weighted avg': {'precision': 0.5737556561085972, 'recall': 0.6274509803921569, 'f1-score': 0.5909363745498198, 'support': 51}}
Token level accuracy: 0.8230842005676443



{'C': {'precision': 0.15384615384615385, 'recall': 0.6666666666666666, 'f1-score': 0.25, 'support': 3}, 'P': {'precision': 0.6, 'recall': 0.625, 'f1-score': 0.6122448979591836, 'support': 48}, 'micro avg': {'precision': 0.5079365079365079, 'recall': 0.6274509803921569, 'f1-score': 0.5614035087719298, 'support': 51}, 'macro avg': {'precision': 0.3769230769230769, 'recall': 0.6458333333333333, 'f1-score': 0.4311224489795918, 'support': 51}, 'weighted avg': {'precision': 0.5737556561085972, 'recall': 0.6274509803921569, 'f1-score': 0.5909363745498198, 'support': 51}}
Token level accuracy: 0.8230842005676443
Dev-Data: Prec: 0.508, Rec: 0.627, F1: 0.5614



{'C': {'precision': 0.13015873015873017, 'recall': 0.15870967741935485, 'f1-score': 0.1430232558139535, 'support': 775}, 'P': {'precision': 0.16761363636363635, 'recall': 0.16061705989110708, 'f1-score': 0.16404077849860982, 'support': 1102}, 'micro avg': {'precision': 0.14992503748125938, 'recall': 0.15982951518380395, 'f1-score': 0.15471892728210418, 'support': 1877}, 'macro avg': {'precision': 0.14888618326118325, 'recall': 0.15966336865523095, 'f1-score': 0.15353201715628167, 'support': 1877}, 'weighted avg': {'precision': 0.1521487709886751, 'recall': 0.15982951518380395, 'f1-score': 0.15536279230755565, 'support': 1877}}
Token level accuracy: 0.5107294222618782
Wrong BIO-Encoding 2002/3874 labels, 51.68%



{'C': {'precision': 0.13015873015873017, 'recall': 0.15870967741935485, 'f1-score': 0.1430232558139535, 'support': 775}, 'P': {'precision': 0.16761363636363635, 'recall': 0.16061705989110708, 'f1-score': 0.16404077849860982, 'support': 1102}, 'micro avg': {'precision': 0.14992503748125938, 'recall': 0.15982951518380395, 'f1-score': 0.15471892728210418, 'support': 1877}, 'macro avg': {'precision': 0.14888618326118325, 'recall': 0.15966336865523095, 'f1-score': 0.15353201715628167, 'support': 1877}, 'weighted avg': {'precision': 0.1521487709886751, 'recall': 0.15982951518380395, 'f1-score': 0.15536279230755565, 'support': 1877}}
Token level accuracy: 0.5107294222618782
Wrong BIO-Encoding 129/2001 labels, 6.45%
Test-Data: Prec: 0.158, Rec: 0.157, F1: 0.1574

Scores from epoch with best dev-scores:
  Dev-Score: 0.5614
  Test-Score 0.1574

9.95 sec for evaluation

--------- Epoch 19 -----------
221.02 sec for training (4175.06 total)
-- cmv_modes1 --



{'C': {'precision': 0.5, 'recall': 0.6666666666666666, 'f1-score': 0.5714285714285715, 'support': 3}, 'P': {'precision': 0.5576923076923077, 'recall': 0.6041666666666666, 'f1-score': 0.5799999999999998, 'support': 48}, 'micro avg': {'precision': 0.5535714285714286, 'recall': 0.6078431372549019, 'f1-score': 0.5794392523364487, 'support': 51}, 'macro avg': {'precision': 0.5288461538461539, 'recall': 0.6354166666666666, 'f1-score': 0.5757142857142856, 'support': 51}, 'weighted avg': {'precision': 0.5542986425339367, 'recall': 0.6078431372549019, 'f1-score': 0.5794957983193276, 'support': 51}}
Token level accuracy: 0.902554399243141



{'C': {'precision': 0.5, 'recall': 0.6666666666666666, 'f1-score': 0.5714285714285715, 'support': 3}, 'P': {'precision': 0.5576923076923077, 'recall': 0.6041666666666666, 'f1-score': 0.5799999999999998, 'support': 48}, 'micro avg': {'precision': 0.5535714285714286, 'recall': 0.6078431372549019, 'f1-score': 0.5794392523364487, 'support': 51}, 'macro avg': {'precision': 0.5288461538461539, 'recall': 0.6354166666666666, 'f1-score': 0.5757142857142856, 'support': 51}, 'weighted avg': {'precision': 0.5542986425339367, 'recall': 0.6078431372549019, 'f1-score': 0.5794957983193276, 'support': 51}}
Token level accuracy: 0.902554399243141
Dev-Data: Prec: 0.554, Rec: 0.608, F1: 0.5794



{'C': {'precision': 0.13926499032882012, 'recall': 0.09290322580645162, 'f1-score': 0.11145510835913314, 'support': 775}, 'P': {'precision': 0.15314632297194844, 'recall': 0.18330308529945555, 'f1-score': 0.1668731928954977, 'support': 1102}, 'micro avg': {'precision': 0.14923747276688454, 'recall': 0.14597762386787427, 'f1-score': 0.14758955022892542, 'support': 1877}, 'macro avg': {'precision': 0.14620565665038426, 'recall': 0.13810315555295358, 'f1-score': 0.1391641506273154, 'support': 1877}, 'weighted avg': {'precision': 0.147414819083603, 'recall': 0.14597762386787427, 'f1-score': 0.14399145847052033, 'support': 1877}}
Token level accuracy: 0.5466428730760652
Wrong BIO-Encoding 1785/3511 labels, 50.84%



{'C': {'precision': 0.13926499032882012, 'recall': 0.09290322580645162, 'f1-score': 0.11145510835913314, 'support': 775}, 'P': {'precision': 0.15314632297194844, 'recall': 0.18330308529945555, 'f1-score': 0.1668731928954977, 'support': 1102}, 'micro avg': {'precision': 0.14923747276688454, 'recall': 0.14597762386787427, 'f1-score': 0.14758955022892542, 'support': 1877}, 'macro avg': {'precision': 0.14620565665038426, 'recall': 0.13810315555295358, 'f1-score': 0.1391641506273154, 'support': 1877}, 'weighted avg': {'precision': 0.147414819083603, 'recall': 0.14597762386787427, 'f1-score': 0.14399145847052033, 'support': 1877}}
Token level accuracy: 0.5466428730760652
Wrong BIO-Encoding 110/1836 labels, 5.99%
Test-Data: Prec: 0.158, Rec: 0.145, F1: 0.1510

Scores from epoch with best dev-scores:
  Dev-Score: 0.5794
  Test-Score 0.1510

9.72 sec for evaluation

--------- Epoch 20 -----------
221.26 sec for training (4396.32 total)
-- cmv_modes1 --



{'C': {'precision': 0.25, 'recall': 0.6666666666666666, 'f1-score': 0.36363636363636365, 'support': 3}, 'P': {'precision': 0.5925925925925926, 'recall': 0.6666666666666666, 'f1-score': 0.627450980392157, 'support': 48}, 'micro avg': {'precision': 0.5483870967741935, 'recall': 0.6666666666666666, 'f1-score': 0.6017699115044248, 'support': 51}, 'macro avg': {'precision': 0.4212962962962963, 'recall': 0.6666666666666666, 'f1-score': 0.4955436720142603, 'support': 51}, 'weighted avg': {'precision': 0.5724400871459695, 'recall': 0.6666666666666666, 'f1-score': 0.6119324735241691, 'support': 51}}
Token level accuracy: 0.8940397350993378



{'C': {'precision': 0.25, 'recall': 0.6666666666666666, 'f1-score': 0.36363636363636365, 'support': 3}, 'P': {'precision': 0.5925925925925926, 'recall': 0.6666666666666666, 'f1-score': 0.627450980392157, 'support': 48}, 'micro avg': {'precision': 0.5483870967741935, 'recall': 0.6666666666666666, 'f1-score': 0.6017699115044248, 'support': 51}, 'macro avg': {'precision': 0.4212962962962963, 'recall': 0.6666666666666666, 'f1-score': 0.4955436720142603, 'support': 51}, 'weighted avg': {'precision': 0.5724400871459695, 'recall': 0.6666666666666666, 'f1-score': 0.6119324735241691, 'support': 51}}
Token level accuracy: 0.8940397350993378
Dev-Data: Prec: 0.548, Rec: 0.667, F1: 0.6018



{'C': {'precision': 0.13506815365551425, 'recall': 0.1406451612903226, 'f1-score': 0.13780025284450065, 'support': 775}, 'P': {'precision': 0.1687211093990755, 'recall': 0.1987295825771325, 'f1-score': 0.1825, 'support': 1102}, 'micro avg': {'precision': 0.15581947743467933, 'recall': 0.17474693660095897, 'f1-score': 0.16474133601205423, 'support': 1877}, 'macro avg': {'precision': 0.15189463152729488, 'recall': 0.16968737193372754, 'f1-score': 0.16015012642225032, 'support': 1877}, 'weighted avg': {'precision': 0.15482604242983738, 'recall': 0.17474693660095897, 'f1-score': 0.16404379113185297, 'support': 1877}}
Token level accuracy: 0.5346865937987955
Wrong BIO-Encoding 1223/3247 labels, 37.67%



{'C': {'precision': 0.13506815365551425, 'recall': 0.1406451612903226, 'f1-score': 0.13780025284450065, 'support': 775}, 'P': {'precision': 0.1687211093990755, 'recall': 0.1987295825771325, 'f1-score': 0.1825, 'support': 1102}, 'micro avg': {'precision': 0.15581947743467933, 'recall': 0.17474693660095897, 'f1-score': 0.16474133601205423, 'support': 1877}, 'macro avg': {'precision': 0.15189463152729488, 'recall': 0.16968737193372754, 'f1-score': 0.16015012642225032, 'support': 1877}, 'weighted avg': {'precision': 0.15482604242983738, 'recall': 0.17474693660095897, 'f1-score': 0.16404379113185297, 'support': 1877}}
Token level accuracy: 0.5346865937987955
Wrong BIO-Encoding 81/2105 labels, 3.85%
Test-Data: Prec: 0.162, Rec: 0.174, F1: 0.1676

Scores from epoch with best dev-scores:
  Dev-Score: 0.6018
  Test-Score 0.1676

9.84 sec for evaluation

--------- Epoch 21 -----------
221.53 sec for training (4617.86 total)
-- cmv_modes1 --



{'C': {'precision': 0.25, 'recall': 0.6666666666666666, 'f1-score': 0.36363636363636365, 'support': 3}, 'P': {'precision': 0.68, 'recall': 0.7083333333333334, 'f1-score': 0.6938775510204083, 'support': 48}, 'micro avg': {'precision': 0.6206896551724138, 'recall': 0.7058823529411765, 'f1-score': 0.6605504587155964, 'support': 51}, 'macro avg': {'precision': 0.465, 'recall': 0.6875, 'f1-score': 0.5287569573283859, 'support': 51}, 'weighted avg': {'precision': 0.6547058823529411, 'recall': 0.7058823529411765, 'f1-score': 0.6744515988213468, 'support': 51}}
Token level accuracy: 0.8637653736991485



{'C': {'precision': 0.25, 'recall': 0.6666666666666666, 'f1-score': 0.36363636363636365, 'support': 3}, 'P': {'precision': 0.68, 'recall': 0.7083333333333334, 'f1-score': 0.6938775510204083, 'support': 48}, 'micro avg': {'precision': 0.6206896551724138, 'recall': 0.7058823529411765, 'f1-score': 0.6605504587155964, 'support': 51}, 'macro avg': {'precision': 0.465, 'recall': 0.6875, 'f1-score': 0.5287569573283859, 'support': 51}, 'weighted avg': {'precision': 0.6547058823529411, 'recall': 0.7058823529411765, 'f1-score': 0.6744515988213468, 'support': 51}}
Token level accuracy: 0.8637653736991485
Dev-Data: Prec: 0.621, Rec: 0.706, F1: 0.6606



{'C': {'precision': 0.1323529411764706, 'recall': 0.1393548387096774, 'f1-score': 0.13576367064739156, 'support': 775}, 'P': {'precision': 0.17374213836477986, 'recall': 0.20054446460980035, 'f1-score': 0.18618365627632688, 'support': 1102}, 'micro avg': {'precision': 0.15756704980842912, 'recall': 0.17527970165157167, 'f1-score': 0.1659520807061791, 'support': 1877}, 'macro avg': {'precision': 0.15304753977062524, 'recall': 0.16994965165973888, 'f1-score': 0.1609736634618592, 'support': 1877}, 'weighted avg': {'precision': 0.15665283212027284, 'recall': 0.17527970165157167, 'f1-score': 0.16536560147482188, 'support': 1877}}
Token level accuracy: 0.5333035913450814
Wrong BIO-Encoding 1378/3374 labels, 40.84%



{'C': {'precision': 0.1323529411764706, 'recall': 0.1393548387096774, 'f1-score': 0.13576367064739156, 'support': 775}, 'P': {'precision': 0.17374213836477986, 'recall': 0.20054446460980035, 'f1-score': 0.18618365627632688, 'support': 1102}, 'micro avg': {'precision': 0.15756704980842912, 'recall': 0.17527970165157167, 'f1-score': 0.1659520807061791, 'support': 1877}, 'macro avg': {'precision': 0.15304753977062524, 'recall': 0.16994965165973888, 'f1-score': 0.1609736634618592, 'support': 1877}, 'weighted avg': {'precision': 0.15665283212027284, 'recall': 0.17527970165157167, 'f1-score': 0.16536560147482188, 'support': 1877}}
Token level accuracy: 0.5333035913450814
Wrong BIO-Encoding 92/2088 labels, 4.41%
Test-Data: Prec: 0.164, Rec: 0.175, F1: 0.1694

Scores from epoch with best dev-scores:
  Dev-Score: 0.6606
  Test-Score 0.1694

9.72 sec for evaluation

--------- Epoch 22 -----------
220.46 sec for training (4838.32 total)
-- cmv_modes1 --



{'C': {'precision': 0.2, 'recall': 0.6666666666666666, 'f1-score': 0.30769230769230765, 'support': 3}, 'P': {'precision': 0.66, 'recall': 0.6875, 'f1-score': 0.673469387755102, 'support': 48}, 'micro avg': {'precision': 0.5833333333333334, 'recall': 0.6862745098039216, 'f1-score': 0.6306306306306307, 'support': 51}, 'macro avg': {'precision': 0.43000000000000005, 'recall': 0.6770833333333333, 'f1-score': 0.4905808477237048, 'support': 51}, 'weighted avg': {'precision': 0.6329411764705882, 'recall': 0.6862745098039216, 'f1-score': 0.6519530889278787, 'support': 51}}
Token level accuracy: 0.8770104068117314
Wrong BIO-Encoding 7/66 labels, 10.61%



{'C': {'precision': 0.2, 'recall': 0.6666666666666666, 'f1-score': 0.30769230769230765, 'support': 3}, 'P': {'precision': 0.66, 'recall': 0.6875, 'f1-score': 0.673469387755102, 'support': 48}, 'micro avg': {'precision': 0.5833333333333334, 'recall': 0.6862745098039216, 'f1-score': 0.6306306306306307, 'support': 51}, 'macro avg': {'precision': 0.43000000000000005, 'recall': 0.6770833333333333, 'f1-score': 0.4905808477237048, 'support': 51}, 'weighted avg': {'precision': 0.6329411764705882, 'recall': 0.6862745098039216, 'f1-score': 0.6519530889278787, 'support': 51}}
Token level accuracy: 0.8770104068117314
Wrong BIO-Encoding 1/60 labels, 1.67%
Dev-Data: Prec: 0.593, Rec: 0.686, F1: 0.6364



{'C': {'precision': 0.15028901734104047, 'recall': 0.16774193548387098, 'f1-score': 0.15853658536585366, 'support': 775}, 'P': {'precision': 0.18010291595197256, 'recall': 0.19056261343012704, 'f1-score': 0.18518518518518517, 'support': 1102}, 'micro avg': {'precision': 0.1674052191038897, 'recall': 0.18114011720831114, 'f1-score': 0.17400204708290684, 'support': 1877}, 'macro avg': {'precision': 0.16519596664650651, 'recall': 0.179152274456999, 'f1-score': 0.1718608852755194, 'support': 1877}, 'weighted avg': {'precision': 0.16779296847010128, 'recall': 0.18114011720831114, 'f1-score': 0.1741821671457702, 'support': 1877}}
Token level accuracy: 0.5217934418915905
Wrong BIO-Encoding 1981/3890 labels, 50.93%



{'C': {'precision': 0.15028901734104047, 'recall': 0.16774193548387098, 'f1-score': 0.15853658536585366, 'support': 775}, 'P': {'precision': 0.18010291595197256, 'recall': 0.19056261343012704, 'f1-score': 0.18518518518518517, 'support': 1102}, 'micro avg': {'precision': 0.1674052191038897, 'recall': 0.18114011720831114, 'f1-score': 0.17400204708290684, 'support': 1877}, 'macro avg': {'precision': 0.16519596664650651, 'recall': 0.179152274456999, 'f1-score': 0.1718608852755194, 'support': 1877}, 'weighted avg': {'precision': 0.16779296847010128, 'recall': 0.18114011720831114, 'f1-score': 0.1741821671457702, 'support': 1877}}
Token level accuracy: 0.5217934418915905
Wrong BIO-Encoding 122/2031 labels, 6.01%
Test-Data: Prec: 0.177, Rec: 0.180, F1: 0.1786

Scores from epoch with best dev-scores:
  Dev-Score: 0.6606
  Test-Score 0.1694

9.46 sec for evaluation

--------- Epoch 23 -----------
218.14 sec for training (5056.46 total)
-- cmv_modes1 --



{'C': {'precision': 0.4, 'recall': 0.6666666666666666, 'f1-score': 0.5, 'support': 3}, 'P': {'precision': 0.6206896551724138, 'recall': 0.75, 'f1-score': 0.679245283018868, 'support': 48}, 'micro avg': {'precision': 0.6031746031746031, 'recall': 0.7450980392156863, 'f1-score': 0.6666666666666666, 'support': 51}, 'macro avg': {'precision': 0.5103448275862069, 'recall': 0.7083333333333333, 'f1-score': 0.589622641509434, 'support': 51}, 'weighted avg': {'precision': 0.6077079107505071, 'recall': 0.7450980392156863, 'f1-score': 0.6687014428412876, 'support': 51}}
Token level accuracy: 0.9328287606433302



{'C': {'precision': 0.4, 'recall': 0.6666666666666666, 'f1-score': 0.5, 'support': 3}, 'P': {'precision': 0.6206896551724138, 'recall': 0.75, 'f1-score': 0.679245283018868, 'support': 48}, 'micro avg': {'precision': 0.6031746031746031, 'recall': 0.7450980392156863, 'f1-score': 0.6666666666666666, 'support': 51}, 'macro avg': {'precision': 0.5103448275862069, 'recall': 0.7083333333333333, 'f1-score': 0.589622641509434, 'support': 51}, 'weighted avg': {'precision': 0.6077079107505071, 'recall': 0.7450980392156863, 'f1-score': 0.6687014428412876, 'support': 51}}
Token level accuracy: 0.9328287606433302
Dev-Data: Prec: 0.603, Rec: 0.745, F1: 0.6667



{'C': {'precision': 0.1315240083507307, 'recall': 0.1625806451612903, 'f1-score': 0.1454125793421812, 'support': 775}, 'P': {'precision': 0.17217391304347826, 'recall': 0.17967332123411978, 'f1-score': 0.17584369449378331, 'support': 1102}, 'micro avg': {'precision': 0.15370018975332067, 'recall': 0.17261587639850826, 'f1-score': 0.16260978670012544, 'support': 1877}, 'macro avg': {'precision': 0.15184896069710446, 'recall': 0.17112698319770503, 'f1-score': 0.16062813691798225, 'support': 1877}, 'weighted avg': {'precision': 0.15538985543192826, 'recall': 0.17261587639850826, 'f1-score': 0.16327890267572703, 'support': 1877}}
Token level accuracy: 0.5181797903189829
Wrong BIO-Encoding 1745/3743 labels, 46.62%



{'C': {'precision': 0.1315240083507307, 'recall': 0.1625806451612903, 'f1-score': 0.1454125793421812, 'support': 775}, 'P': {'precision': 0.17217391304347826, 'recall': 0.17967332123411978, 'f1-score': 0.17584369449378331, 'support': 1102}, 'micro avg': {'precision': 0.15370018975332067, 'recall': 0.17261587639850826, 'f1-score': 0.16260978670012544, 'support': 1877}, 'macro avg': {'precision': 0.15184896069710446, 'recall': 0.17112698319770503, 'f1-score': 0.16062813691798225, 'support': 1877}, 'weighted avg': {'precision': 0.15538985543192826, 'recall': 0.17261587639850826, 'f1-score': 0.16327890267572703, 'support': 1877}}
Token level accuracy: 0.5181797903189829
Wrong BIO-Encoding 110/2108 labels, 5.22%
Test-Data: Prec: 0.160, Rec: 0.170, F1: 0.1646

Scores from epoch with best dev-scores:
  Dev-Score: 0.6667
  Test-Score 0.1646

9.53 sec for evaluation

--------- Epoch 24 -----------
218.89 sec for training (5275.35 total)
-- cmv_modes1 --



{'C': {'precision': 0.3333333333333333, 'recall': 0.6666666666666666, 'f1-score': 0.4444444444444444, 'support': 3}, 'P': {'precision': 0.559322033898305, 'recall': 0.6875, 'f1-score': 0.6168224299065421, 'support': 48}, 'micro avg': {'precision': 0.5384615384615384, 'recall': 0.6862745098039216, 'f1-score': 0.6034482758620688, 'support': 51}, 'macro avg': {'precision': 0.4463276836158192, 'recall': 0.6770833333333333, 'f1-score': 0.5306334371754933, 'support': 51}, 'weighted avg': {'precision': 0.546028580923895, 'recall': 0.6862745098039216, 'f1-score': 0.6066825484087717, 'support': 51}}
Token level accuracy: 0.9167455061494797



{'C': {'precision': 0.3333333333333333, 'recall': 0.6666666666666666, 'f1-score': 0.4444444444444444, 'support': 3}, 'P': {'precision': 0.559322033898305, 'recall': 0.6875, 'f1-score': 0.6168224299065421, 'support': 48}, 'micro avg': {'precision': 0.5384615384615384, 'recall': 0.6862745098039216, 'f1-score': 0.6034482758620688, 'support': 51}, 'macro avg': {'precision': 0.4463276836158192, 'recall': 0.6770833333333333, 'f1-score': 0.5306334371754933, 'support': 51}, 'weighted avg': {'precision': 0.546028580923895, 'recall': 0.6862745098039216, 'f1-score': 0.6066825484087717, 'support': 51}}
Token level accuracy: 0.9167455061494797
Dev-Data: Prec: 0.538, Rec: 0.686, F1: 0.6034



{'C': {'precision': 0.13636363636363635, 'recall': 0.15483870967741936, 'f1-score': 0.14501510574018128, 'support': 775}, 'P': {'precision': 0.1505703422053232, 'recall': 0.17967332123411978, 'f1-score': 0.1638394704178734, 'support': 1102}, 'micro avg': {'precision': 0.144874715261959, 'recall': 0.16941928609483217, 'f1-score': 0.156188605108055, 'support': 1877}, 'macro avg': {'precision': 0.14346698928447976, 'recall': 0.16725601545576957, 'f1-score': 0.15442728807902734, 'support': 1877}, 'weighted avg': {'precision': 0.14470449402881425, 'recall': 0.16941928609483217, 'f1-score': 0.1560670236276702, 'support': 1877}}
Token level accuracy: 0.5294668748605844
Wrong BIO-Encoding 1588/3673 labels, 43.23%



{'C': {'precision': 0.13636363636363635, 'recall': 0.15483870967741936, 'f1-score': 0.14501510574018128, 'support': 775}, 'P': {'precision': 0.1505703422053232, 'recall': 0.17967332123411978, 'f1-score': 0.1638394704178734, 'support': 1102}, 'micro avg': {'precision': 0.144874715261959, 'recall': 0.16941928609483217, 'f1-score': 0.156188605108055, 'support': 1877}, 'macro avg': {'precision': 0.14346698928447976, 'recall': 0.16725601545576957, 'f1-score': 0.15442728807902734, 'support': 1877}, 'weighted avg': {'precision': 0.14470449402881425, 'recall': 0.16941928609483217, 'f1-score': 0.1560670236276702, 'support': 1877}}
Token level accuracy: 0.5294668748605844
Wrong BIO-Encoding 110/2195 labels, 5.01%
Test-Data: Prec: 0.152, Rec: 0.169, F1: 0.1600

Scores from epoch with best dev-scores:
  Dev-Score: 0.6667
  Test-Score 0.1646

9.59 sec for evaluation

--------- Epoch 25 -----------
216.74 sec for training (5492.08 total)
-- cmv_modes1 --



{'C': {'precision': 0.5, 'recall': 0.6666666666666666, 'f1-score': 0.5714285714285715, 'support': 3}, 'P': {'precision': 0.6666666666666666, 'recall': 0.75, 'f1-score': 0.7058823529411765, 'support': 48}, 'micro avg': {'precision': 0.6551724137931034, 'recall': 0.7450980392156863, 'f1-score': 0.6972477064220184, 'support': 51}, 'macro avg': {'precision': 0.5833333333333333, 'recall': 0.7083333333333333, 'f1-score': 0.638655462184874, 'support': 51}, 'weighted avg': {'precision': 0.6568627450980392, 'recall': 0.7450980392156863, 'f1-score': 0.6979733069698468, 'support': 51}}
Token level accuracy: 0.9385052034058656



{'C': {'precision': 0.5, 'recall': 0.6666666666666666, 'f1-score': 0.5714285714285715, 'support': 3}, 'P': {'precision': 0.6666666666666666, 'recall': 0.75, 'f1-score': 0.7058823529411765, 'support': 48}, 'micro avg': {'precision': 0.6551724137931034, 'recall': 0.7450980392156863, 'f1-score': 0.6972477064220184, 'support': 51}, 'macro avg': {'precision': 0.5833333333333333, 'recall': 0.7083333333333333, 'f1-score': 0.638655462184874, 'support': 51}, 'weighted avg': {'precision': 0.6568627450980392, 'recall': 0.7450980392156863, 'f1-score': 0.6979733069698468, 'support': 51}}
Token level accuracy: 0.9385052034058656
Dev-Data: Prec: 0.655, Rec: 0.745, F1: 0.6972



{'C': {'precision': 0.15312916111850866, 'recall': 0.14838709677419354, 'f1-score': 0.15072083879423329, 'support': 775}, 'P': {'precision': 0.16739766081871346, 'recall': 0.20780399274047187, 'f1-score': 0.1854251012145749, 'support': 1102}, 'micro avg': {'precision': 0.16234072675790467, 'recall': 0.18327117741076185, 'f1-score': 0.17217217217217218, 'support': 1877}, 'macro avg': {'precision': 0.16026341096861108, 'recall': 0.1780955447573327, 'f1-score': 0.16807297000440408, 'support': 1877}, 'weighted avg': {'precision': 0.16150629839587982, 'recall': 0.18327117741076185, 'f1-score': 0.17109595716781692, 'support': 1877}}
Token level accuracy: 0.5365603390586661
Wrong BIO-Encoding 1974/3976 labels, 49.65%



{'C': {'precision': 0.15312916111850866, 'recall': 0.14838709677419354, 'f1-score': 0.15072083879423329, 'support': 775}, 'P': {'precision': 0.16739766081871346, 'recall': 0.20780399274047187, 'f1-score': 0.1854251012145749, 'support': 1102}, 'micro avg': {'precision': 0.16234072675790467, 'recall': 0.18327117741076185, 'f1-score': 0.17217217217217218, 'support': 1877}, 'macro avg': {'precision': 0.16026341096861108, 'recall': 0.1780955447573327, 'f1-score': 0.16807297000440408, 'support': 1877}, 'weighted avg': {'precision': 0.16150629839587982, 'recall': 0.18327117741076185, 'f1-score': 0.17109595716781692, 'support': 1877}}
Token level accuracy: 0.5365603390586661
Wrong BIO-Encoding 117/2119 labels, 5.52%
Test-Data: Prec: 0.170, Rec: 0.182, F1: 0.1758

Scores from epoch with best dev-scores:
  Dev-Score: 0.6972
  Test-Score 0.1758

9.43 sec for evaluation

--------- Epoch 26 -----------
216.91 sec for training (5708.99 total)
-- cmv_modes1 --



{'C': {'precision': 0.25, 'recall': 0.6666666666666666, 'f1-score': 0.36363636363636365, 'support': 3}, 'P': {'precision': 0.5769230769230769, 'recall': 0.625, 'f1-score': 0.6, 'support': 48}, 'micro avg': {'precision': 0.5333333333333333, 'recall': 0.6274509803921569, 'f1-score': 0.5765765765765766, 'support': 51}, 'macro avg': {'precision': 0.41346153846153844, 'recall': 0.6458333333333333, 'f1-score': 0.4818181818181818, 'support': 51}, 'weighted avg': {'precision': 0.5576923076923076, 'recall': 0.6274509803921569, 'f1-score': 0.586096256684492, 'support': 51}}
Token level accuracy: 0.9063386944181646
Wrong BIO-Encoding 41/98 labels, 41.84%



{'C': {'precision': 0.25, 'recall': 0.6666666666666666, 'f1-score': 0.36363636363636365, 'support': 3}, 'P': {'precision': 0.5769230769230769, 'recall': 0.625, 'f1-score': 0.6, 'support': 48}, 'micro avg': {'precision': 0.5333333333333333, 'recall': 0.6274509803921569, 'f1-score': 0.5765765765765766, 'support': 51}, 'macro avg': {'precision': 0.41346153846153844, 'recall': 0.6458333333333333, 'f1-score': 0.4818181818181818, 'support': 51}, 'weighted avg': {'precision': 0.5576923076923076, 'recall': 0.6274509803921569, 'f1-score': 0.586096256684492, 'support': 51}}
Token level accuracy: 0.9063386944181646
Wrong BIO-Encoding 3/60 labels, 5.00%
Dev-Data: Prec: 0.561, Rec: 0.627, F1: 0.5926



{'C': {'precision': 0.11775043936731107, 'recall': 0.17290322580645162, 'f1-score': 0.14009409304756926, 'support': 775}, 'P': {'precision': 0.1752988047808765, 'recall': 0.15970961887477314, 'f1-score': 0.1671415004748338, 'support': 1102}, 'micro avg': {'precision': 0.14472455648926238, 'recall': 0.16515716568993075, 'f1-score': 0.15426723065439166, 'support': 1877}, 'macro avg': {'precision': 0.14652462207409378, 'recall': 0.16630642234061238, 'f1-score': 0.15361779676120152, 'support': 1877}, 'weighted avg': {'precision': 0.15153749247639425, 'recall': 0.16515716568993075, 'f1-score': 0.15597381759996434, 'support': 1877}}
Token level accuracy: 0.5082534017399063
Wrong BIO-Encoding 2737/4691 labels, 58.35%



{'C': {'precision': 0.11775043936731107, 'recall': 0.17290322580645162, 'f1-score': 0.14009409304756926, 'support': 775}, 'P': {'precision': 0.1752988047808765, 'recall': 0.15970961887477314, 'f1-score': 0.1671415004748338, 'support': 1102}, 'micro avg': {'precision': 0.14472455648926238, 'recall': 0.16515716568993075, 'f1-score': 0.15426723065439166, 'support': 1877}, 'macro avg': {'precision': 0.14652462207409378, 'recall': 0.16630642234061238, 'f1-score': 0.15361779676120152, 'support': 1877}, 'weighted avg': {'precision': 0.15153749247639425, 'recall': 0.16515716568993075, 'f1-score': 0.15597381759996434, 'support': 1877}}
Token level accuracy: 0.5082534017399063
Wrong BIO-Encoding 188/2142 labels, 8.78%
Test-Data: Prec: 0.156, Rec: 0.162, F1: 0.1592

Scores from epoch with best dev-scores:
  Dev-Score: 0.6972
  Test-Score 0.1758

9.43 sec for evaluation

--------- Epoch 27 -----------
216.46 sec for training (5925.46 total)
-- cmv_modes1 --



{'C': {'precision': 0.5, 'recall': 0.6666666666666666, 'f1-score': 0.5714285714285715, 'support': 3}, 'P': {'precision': 0.8431372549019608, 'recall': 0.8958333333333334, 'f1-score': 0.8686868686868686, 'support': 48}, 'micro avg': {'precision': 0.8181818181818182, 'recall': 0.8823529411764706, 'f1-score': 0.8490566037735848, 'support': 51}, 'macro avg': {'precision': 0.6715686274509804, 'recall': 0.78125, 'f1-score': 0.7200577200577201, 'support': 51}, 'weighted avg': {'precision': 0.8229527104959631, 'recall': 0.8823529411764706, 'f1-score': 0.8512010864952041, 'support': 51}}
Token level accuracy: 0.945127719962157



{'C': {'precision': 0.5, 'recall': 0.6666666666666666, 'f1-score': 0.5714285714285715, 'support': 3}, 'P': {'precision': 0.8431372549019608, 'recall': 0.8958333333333334, 'f1-score': 0.8686868686868686, 'support': 48}, 'micro avg': {'precision': 0.8181818181818182, 'recall': 0.8823529411764706, 'f1-score': 0.8490566037735848, 'support': 51}, 'macro avg': {'precision': 0.6715686274509804, 'recall': 0.78125, 'f1-score': 0.7200577200577201, 'support': 51}, 'weighted avg': {'precision': 0.8229527104959631, 'recall': 0.8823529411764706, 'f1-score': 0.8512010864952041, 'support': 51}}
Token level accuracy: 0.945127719962157
Dev-Data: Prec: 0.818, Rec: 0.882, F1: 0.8491



{'C': {'precision': 0.14096385542168674, 'recall': 0.15096774193548387, 'f1-score': 0.14579439252336449, 'support': 775}, 'P': {'precision': 0.16666666666666666, 'recall': 0.19419237749546278, 'f1-score': 0.17937971500419111, 'support': 1102}, 'micro avg': {'precision': 0.15657521286660359, 'recall': 0.176345231752797, 'f1-score': 0.16587321473314956, 'support': 1877}, 'macro avg': {'precision': 0.1538152610441767, 'recall': 0.17258005971547333, 'f1-score': 0.1625870537637778, 'support': 1877}, 'weighted avg': {'precision': 0.15605415802795625, 'recall': 0.176345231752797, 'f1-score': 0.16551257332990202, 'support': 1877}}
Token level accuracy: 0.5316529109971001
Wrong BIO-Encoding 2021/4013 labels, 50.36%



{'C': {'precision': 0.14096385542168674, 'recall': 0.15096774193548387, 'f1-score': 0.14579439252336449, 'support': 775}, 'P': {'precision': 0.16666666666666666, 'recall': 0.19419237749546278, 'f1-score': 0.17937971500419111, 'support': 1102}, 'micro avg': {'precision': 0.15657521286660359, 'recall': 0.176345231752797, 'f1-score': 0.16587321473314956, 'support': 1877}, 'macro avg': {'precision': 0.1538152610441767, 'recall': 0.17258005971547333, 'f1-score': 0.1625870537637778, 'support': 1877}, 'weighted avg': {'precision': 0.15605415802795625, 'recall': 0.176345231752797, 'f1-score': 0.16551257332990202, 'support': 1877}}
Token level accuracy: 0.5316529109971001
Wrong BIO-Encoding 122/2114 labels, 5.77%
Test-Data: Prec: 0.165, Rec: 0.175, F1: 0.1701

Scores from epoch with best dev-scores:
  Dev-Score: 0.8491
  Test-Score 0.1701

9.42 sec for evaluation

--------- Epoch 28 -----------
217.16 sec for training (6142.62 total)
-- cmv_modes1 --



{'C': {'precision': 0.3333333333333333, 'recall': 1.0, 'f1-score': 0.5, 'support': 3}, 'P': {'precision': 0.8260869565217391, 'recall': 0.7916666666666666, 'f1-score': 0.8085106382978724, 'support': 48}, 'micro avg': {'precision': 0.7454545454545455, 'recall': 0.803921568627451, 'f1-score': 0.7735849056603775, 'support': 51}, 'macro avg': {'precision': 0.5797101449275363, 'recall': 0.8958333333333333, 'f1-score': 0.6542553191489362, 'support': 51}, 'weighted avg': {'precision': 0.7971014492753623, 'recall': 0.803921568627451, 'f1-score': 0.7903629536921152, 'support': 51}}
Token level accuracy: 0.9167455061494797
Wrong BIO-Encoding 10/64 labels, 15.62%



{'C': {'precision': 0.3333333333333333, 'recall': 1.0, 'f1-score': 0.5, 'support': 3}, 'P': {'precision': 0.8260869565217391, 'recall': 0.7916666666666666, 'f1-score': 0.8085106382978724, 'support': 48}, 'micro avg': {'precision': 0.7454545454545455, 'recall': 0.803921568627451, 'f1-score': 0.7735849056603775, 'support': 51}, 'macro avg': {'precision': 0.5797101449275363, 'recall': 0.8958333333333333, 'f1-score': 0.6542553191489362, 'support': 51}, 'weighted avg': {'precision': 0.7971014492753623, 'recall': 0.803921568627451, 'f1-score': 0.7903629536921152, 'support': 51}}
Token level accuracy: 0.9167455061494797
Wrong BIO-Encoding 1/55 labels, 1.82%
Dev-Data: Prec: 0.759, Rec: 0.804, F1: 0.7810



{'C': {'precision': 0.11793214862681745, 'recall': 0.18838709677419355, 'f1-score': 0.14505712866368606, 'support': 775}, 'P': {'precision': 0.17249698431845598, 'recall': 0.1297640653357532, 'f1-score': 0.14810978767477992, 'support': 1102}, 'micro avg': {'precision': 0.1398161586840832, 'recall': 0.15396909962706445, 'f1-score': 0.14655172413793102, 'support': 1877}, 'macro avg': {'precision': 0.1452145664726367, 'recall': 0.15907558105497338, 'f1-score': 0.146583458169233, 'support': 1877}, 'weighted avg': {'precision': 0.1499675502955365, 'recall': 0.15396909962706445, 'f1-score': 0.1468493663995547, 'support': 1877}}
Token level accuracy: 0.5030559892928842
Wrong BIO-Encoding 2706/4579 labels, 59.10%



{'C': {'precision': 0.11793214862681745, 'recall': 0.18838709677419355, 'f1-score': 0.14505712866368606, 'support': 775}, 'P': {'precision': 0.17249698431845598, 'recall': 0.1297640653357532, 'f1-score': 0.14810978767477992, 'support': 1102}, 'micro avg': {'precision': 0.1398161586840832, 'recall': 0.15396909962706445, 'f1-score': 0.14655172413793102, 'support': 1877}, 'macro avg': {'precision': 0.1452145664726367, 'recall': 0.15907558105497338, 'f1-score': 0.146583458169233, 'support': 1877}, 'weighted avg': {'precision': 0.1499675502955365, 'recall': 0.15396909962706445, 'f1-score': 0.1468493663995547, 'support': 1877}}
Token level accuracy: 0.5030559892928842
Wrong BIO-Encoding 194/2067 labels, 9.39%
Test-Data: Prec: 0.152, Rec: 0.152, F1: 0.1520

Scores from epoch with best dev-scores:
  Dev-Score: 0.8491
  Test-Score 0.1701

9.47 sec for evaluation

--------- Epoch 29 -----------
216.56 sec for training (6359.18 total)
-- cmv_modes1 --



{'C': {'precision': 0.5, 'recall': 0.6666666666666666, 'f1-score': 0.5714285714285715, 'support': 3}, 'P': {'precision': 0.8113207547169812, 'recall': 0.8958333333333334, 'f1-score': 0.8514851485148515, 'support': 48}, 'micro avg': {'precision': 0.7894736842105263, 'recall': 0.8823529411764706, 'f1-score': 0.8333333333333333, 'support': 51}, 'macro avg': {'precision': 0.6556603773584906, 'recall': 0.78125, 'f1-score': 0.7114568599717115, 'support': 51}, 'weighted avg': {'precision': 0.7930077691453941, 'recall': 0.8823529411764706, 'f1-score': 0.8350112322156585, 'support': 51}}
Token level accuracy: 0.9470198675496688



{'C': {'precision': 0.5, 'recall': 0.6666666666666666, 'f1-score': 0.5714285714285715, 'support': 3}, 'P': {'precision': 0.8113207547169812, 'recall': 0.8958333333333334, 'f1-score': 0.8514851485148515, 'support': 48}, 'micro avg': {'precision': 0.7894736842105263, 'recall': 0.8823529411764706, 'f1-score': 0.8333333333333333, 'support': 51}, 'macro avg': {'precision': 0.6556603773584906, 'recall': 0.78125, 'f1-score': 0.7114568599717115, 'support': 51}, 'weighted avg': {'precision': 0.7930077691453941, 'recall': 0.8823529411764706, 'f1-score': 0.8350112322156585, 'support': 51}}
Token level accuracy: 0.9470198675496688
Dev-Data: Prec: 0.789, Rec: 0.882, F1: 0.8333



{'C': {'precision': 0.1411917098445596, 'recall': 0.1406451612903226, 'f1-score': 0.14091790562378798, 'support': 775}, 'P': {'precision': 0.16593886462882096, 'recall': 0.20689655172413793, 'f1-score': 0.1841680129240711, 'support': 1102}, 'micro avg': {'precision': 0.1570363466915191, 'recall': 0.1795418220564731, 'f1-score': 0.1675366641809595, 'support': 1877}, 'macro avg': {'precision': 0.15356528723669027, 'recall': 0.17377085650723026, 'f1-score': 0.16254295927392953, 'support': 1877}, 'weighted avg': {'precision': 0.1557209397711744, 'recall': 0.1795418220564731, 'f1-score': 0.16631035008032075, 'support': 1877}}
Token level accuracy: 0.5437653357126924
Wrong BIO-Encoding 1615/3658 labels, 44.15%



{'C': {'precision': 0.1411917098445596, 'recall': 0.1406451612903226, 'f1-score': 0.14091790562378798, 'support': 775}, 'P': {'precision': 0.16593886462882096, 'recall': 0.20689655172413793, 'f1-score': 0.1841680129240711, 'support': 1102}, 'micro avg': {'precision': 0.1570363466915191, 'recall': 0.1795418220564731, 'f1-score': 0.1675366641809595, 'support': 1877}, 'macro avg': {'precision': 0.15356528723669027, 'recall': 0.17377085650723026, 'f1-score': 0.16254295927392953, 'support': 1877}, 'weighted avg': {'precision': 0.1557209397711744, 'recall': 0.1795418220564731, 'f1-score': 0.16631035008032075, 'support': 1877}}
Token level accuracy: 0.5437653357126924
Wrong BIO-Encoding 103/2146 labels, 4.80%
Test-Data: Prec: 0.164, Rec: 0.178, F1: 0.1709

Scores from epoch with best dev-scores:
  Dev-Score: 0.8491
  Test-Score 0.1701

9.41 sec for evaluation

--------- Epoch 30 -----------
216.23 sec for training (6575.41 total)
-- cmv_modes1 --



{'C': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 3}, 'P': {'precision': 0.7307692307692307, 'recall': 0.7916666666666666, 'f1-score': 0.76, 'support': 48}, 'micro avg': {'precision': 0.7454545454545455, 'recall': 0.803921568627451, 'f1-score': 0.7735849056603775, 'support': 51}, 'macro avg': {'precision': 0.8653846153846154, 'recall': 0.8958333333333333, 'f1-score': 0.88, 'support': 51}, 'weighted avg': {'precision': 0.7466063348416289, 'recall': 0.803921568627451, 'f1-score': 0.7741176470588236, 'support': 51}}
Token level accuracy: 0.9810785241248817



{'C': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 3}, 'P': {'precision': 0.7307692307692307, 'recall': 0.7916666666666666, 'f1-score': 0.76, 'support': 48}, 'micro avg': {'precision': 0.7454545454545455, 'recall': 0.803921568627451, 'f1-score': 0.7735849056603775, 'support': 51}, 'macro avg': {'precision': 0.8653846153846154, 'recall': 0.8958333333333333, 'f1-score': 0.88, 'support': 51}, 'weighted avg': {'precision': 0.7466063348416289, 'recall': 0.803921568627451, 'f1-score': 0.7741176470588236, 'support': 51}}
Token level accuracy: 0.9810785241248817
Dev-Data: Prec: 0.745, Rec: 0.804, F1: 0.7736



{'C': {'precision': 0.14360041623309053, 'recall': 0.17806451612903226, 'f1-score': 0.15898617511520738, 'support': 775}, 'P': {'precision': 0.16031128404669262, 'recall': 0.1869328493647913, 'f1-score': 0.17260159195643068, 'support': 1102}, 'micro avg': {'precision': 0.15316117542297417, 'recall': 0.18327117741076185, 'f1-score': 0.16686878486538928, 'support': 1877}, 'macro avg': {'precision': 0.15195585013989157, 'recall': 0.18249868274691178, 'f1-score': 0.16579388353581903, 'support': 1877}, 'weighted avg': {'precision': 0.15341148513590858, 'recall': 0.18327117741076185, 'f1-score': 0.1669798828184722, 'support': 1877}}
Token level accuracy: 0.5253401739906313
Wrong BIO-Encoding 2175/4277 labels, 50.85%



{'C': {'precision': 0.14360041623309053, 'recall': 0.17806451612903226, 'f1-score': 0.15898617511520738, 'support': 775}, 'P': {'precision': 0.16031128404669262, 'recall': 0.1869328493647913, 'f1-score': 0.17260159195643068, 'support': 1102}, 'micro avg': {'precision': 0.15316117542297417, 'recall': 0.18327117741076185, 'f1-score': 0.16686878486538928, 'support': 1877}, 'macro avg': {'precision': 0.15195585013989157, 'recall': 0.18249868274691178, 'f1-score': 0.16579388353581903, 'support': 1877}, 'weighted avg': {'precision': 0.15341148513590858, 'recall': 0.18327117741076185, 'f1-score': 0.1669798828184722, 'support': 1877}}
Token level accuracy: 0.5253401739906313
Wrong BIO-Encoding 144/2246 labels, 6.41%
Test-Data: Prec: 0.163, Rec: 0.183, F1: 0.1724

Scores from epoch with best dev-scores:
  Dev-Score: 0.8491
  Test-Score 0.1701

9.43 sec for evaluation

--------- Epoch 31 -----------
216.33 sec for training (6791.74 total)
-- cmv_modes1 --



{'C': {'precision': 0.75, 'recall': 1.0, 'f1-score': 0.8571428571428571, 'support': 3}, 'P': {'precision': 0.7924528301886793, 'recall': 0.875, 'f1-score': 0.8316831683168316, 'support': 48}, 'micro avg': {'precision': 0.7894736842105263, 'recall': 0.8823529411764706, 'f1-score': 0.8333333333333333, 'support': 51}, 'macro avg': {'precision': 0.7712264150943396, 'recall': 0.9375, 'f1-score': 0.8444130127298444, 'support': 51}, 'weighted avg': {'precision': 0.7899556048834628, 'recall': 0.8823529411764706, 'f1-score': 0.8331807970713038, 'support': 51}}
Token level accuracy: 0.9612109744560076



{'C': {'precision': 0.75, 'recall': 1.0, 'f1-score': 0.8571428571428571, 'support': 3}, 'P': {'precision': 0.7924528301886793, 'recall': 0.875, 'f1-score': 0.8316831683168316, 'support': 48}, 'micro avg': {'precision': 0.7894736842105263, 'recall': 0.8823529411764706, 'f1-score': 0.8333333333333333, 'support': 51}, 'macro avg': {'precision': 0.7712264150943396, 'recall': 0.9375, 'f1-score': 0.8444130127298444, 'support': 51}, 'weighted avg': {'precision': 0.7899556048834628, 'recall': 0.8823529411764706, 'f1-score': 0.8331807970713038, 'support': 51}}
Token level accuracy: 0.9612109744560076
Dev-Data: Prec: 0.789, Rec: 0.882, F1: 0.8333



{'C': {'precision': 0.13360323886639677, 'recall': 0.1703225806451613, 'f1-score': 0.14974475326148612, 'support': 775}, 'P': {'precision': 0.1752988047808765, 'recall': 0.1996370235934664, 'f1-score': 0.18667798048366568, 'support': 1102}, 'micro avg': {'precision': 0.15693267944716896, 'recall': 0.1875332978156633, 'f1-score': 0.17087378640776701, 'support': 1877}, 'macro avg': {'precision': 0.15445102182363663, 'recall': 0.18497980211931386, 'f1-score': 0.1682113668725759, 'support': 1877}, 'weighted avg': {'precision': 0.15808300106019363, 'recall': 0.1875332978156633, 'f1-score': 0.17142851266417228, 'support': 1877}}
Token level accuracy: 0.5274815971447692
Wrong BIO-Encoding 1649/3772 labels, 43.72%



{'C': {'precision': 0.13360323886639677, 'recall': 0.1703225806451613, 'f1-score': 0.14974475326148612, 'support': 775}, 'P': {'precision': 0.1752988047808765, 'recall': 0.1996370235934664, 'f1-score': 0.18667798048366568, 'support': 1102}, 'micro avg': {'precision': 0.15693267944716896, 'recall': 0.1875332978156633, 'f1-score': 0.17087378640776701, 'support': 1877}, 'macro avg': {'precision': 0.15445102182363663, 'recall': 0.18497980211931386, 'f1-score': 0.1682113668725759, 'support': 1877}, 'weighted avg': {'precision': 0.15808300106019363, 'recall': 0.1875332978156633, 'f1-score': 0.17142851266417228, 'support': 1877}}
Token level accuracy: 0.5274815971447692
Wrong BIO-Encoding 120/2243 labels, 5.35%
Test-Data: Prec: 0.165, Rec: 0.187, F1: 0.1755

Scores from epoch with best dev-scores:
  Dev-Score: 0.8491
  Test-Score 0.1701

9.36 sec for evaluation

--------- Epoch 32 -----------
217.38 sec for training (7009.12 total)
-- cmv_modes1 --



{'C': {'precision': 0.75, 'recall': 1.0, 'f1-score': 0.8571428571428571, 'support': 3}, 'P': {'precision': 0.7321428571428571, 'recall': 0.8541666666666666, 'f1-score': 0.7884615384615384, 'support': 48}, 'micro avg': {'precision': 0.7333333333333333, 'recall': 0.8627450980392157, 'f1-score': 0.7927927927927927, 'support': 51}, 'macro avg': {'precision': 0.7410714285714286, 'recall': 0.9270833333333333, 'f1-score': 0.8228021978021978, 'support': 51}, 'weighted avg': {'precision': 0.7331932773109243, 'recall': 0.8627450980392157, 'f1-score': 0.7925016160310278, 'support': 51}}
Token level accuracy: 0.9526963103122044
Wrong BIO-Encoding 4/63 labels, 6.35%



{'C': {'precision': 0.75, 'recall': 1.0, 'f1-score': 0.8571428571428571, 'support': 3}, 'P': {'precision': 0.7321428571428571, 'recall': 0.8541666666666666, 'f1-score': 0.7884615384615384, 'support': 48}, 'micro avg': {'precision': 0.7333333333333333, 'recall': 0.8627450980392157, 'f1-score': 0.7927927927927927, 'support': 51}, 'macro avg': {'precision': 0.7410714285714286, 'recall': 0.9270833333333333, 'f1-score': 0.8228021978021978, 'support': 51}, 'weighted avg': {'precision': 0.7331932773109243, 'recall': 0.8627450980392157, 'f1-score': 0.7925016160310278, 'support': 51}}
Token level accuracy: 0.9526963103122044
Wrong BIO-Encoding 1/60 labels, 1.67%
Dev-Data: Prec: 0.746, Rec: 0.863, F1: 0.8000



{'C': {'precision': 0.136, 'recall': 0.17548387096774193, 'f1-score': 0.1532394366197183, 'support': 775}, 'P': {'precision': 0.17566409597257926, 'recall': 0.18602540834845735, 'f1-score': 0.18069634200088144, 'support': 1102}, 'micro avg': {'precision': 0.15736040609137056, 'recall': 0.1816728822589238, 'f1-score': 0.16864490603363008, 'support': 1877}, 'macro avg': {'precision': 0.15583204798628963, 'recall': 0.18075463965809963, 'f1-score': 0.16696788931029988, 'support': 1877}, 'weighted avg': {'precision': 0.1592870717963678, 'recall': 0.1816728822589238, 'f1-score': 0.16935958032245768, 'support': 1877}}
Token level accuracy: 0.5228864599598483
Wrong BIO-Encoding 2159/4167 labels, 51.81%



{'C': {'precision': 0.136, 'recall': 0.17548387096774193, 'f1-score': 0.1532394366197183, 'support': 775}, 'P': {'precision': 0.17566409597257926, 'recall': 0.18602540834845735, 'f1-score': 0.18069634200088144, 'support': 1102}, 'micro avg': {'precision': 0.15736040609137056, 'recall': 0.1816728822589238, 'f1-score': 0.16864490603363008, 'support': 1877}, 'macro avg': {'precision': 0.15583204798628963, 'recall': 0.18075463965809963, 'f1-score': 0.16696788931029988, 'support': 1877}, 'weighted avg': {'precision': 0.1592870717963678, 'recall': 0.1816728822589238, 'f1-score': 0.16935958032245768, 'support': 1877}}
Token level accuracy: 0.5228864599598483
Wrong BIO-Encoding 159/2167 labels, 7.34%
Test-Data: Prec: 0.168, Rec: 0.180, F1: 0.1735

Scores from epoch with best dev-scores:
  Dev-Score: 0.8491
  Test-Score 0.1701

9.57 sec for evaluation

--------- Epoch 33 -----------
219.97 sec for training (7229.09 total)
-- cmv_modes1 --



{'C': {'precision': 0.75, 'recall': 1.0, 'f1-score': 0.8571428571428571, 'support': 3}, 'P': {'precision': 0.9183673469387755, 'recall': 0.9375, 'f1-score': 0.9278350515463918, 'support': 48}, 'micro avg': {'precision': 0.9056603773584906, 'recall': 0.9411764705882353, 'f1-score': 0.923076923076923, 'support': 51}, 'macro avg': {'precision': 0.8341836734693877, 'recall': 0.96875, 'f1-score': 0.8924889543446244, 'support': 51}, 'weighted avg': {'precision': 0.9084633853541417, 'recall': 0.9411764705882353, 'f1-score': 0.9236766871697132, 'support': 51}}
Token level accuracy: 0.9829706717123936



{'C': {'precision': 0.75, 'recall': 1.0, 'f1-score': 0.8571428571428571, 'support': 3}, 'P': {'precision': 0.9183673469387755, 'recall': 0.9375, 'f1-score': 0.9278350515463918, 'support': 48}, 'micro avg': {'precision': 0.9056603773584906, 'recall': 0.9411764705882353, 'f1-score': 0.923076923076923, 'support': 51}, 'macro avg': {'precision': 0.8341836734693877, 'recall': 0.96875, 'f1-score': 0.8924889543446244, 'support': 51}, 'weighted avg': {'precision': 0.9084633853541417, 'recall': 0.9411764705882353, 'f1-score': 0.9236766871697132, 'support': 51}}
Token level accuracy: 0.9829706717123936
Dev-Data: Prec: 0.906, Rec: 0.941, F1: 0.9231



{'C': {'precision': 0.13716295427901523, 'recall': 0.15096774193548387, 'f1-score': 0.14373464373464373, 'support': 775}, 'P': {'precision': 0.17193523515805706, 'recall': 0.20235934664246824, 'f1-score': 0.18591079616506875, 'support': 1102}, 'micro avg': {'precision': 0.15813953488372093, 'recall': 0.18114011720831114, 'f1-score': 0.16886019369257513, 'support': 1877}, 'macro avg': {'precision': 0.15454909471853615, 'recall': 0.17666354428897607, 'f1-score': 0.16482271994985626, 'support': 1877}, 'weighted avg': {'precision': 0.15757800677166525, 'recall': 0.18114011720831114, 'f1-score': 0.16849656167728008, 'support': 1877}}
Token level accuracy: 0.5307383448583538
Wrong BIO-Encoding 2179/4184 labels, 52.08%



{'C': {'precision': 0.13716295427901523, 'recall': 0.15096774193548387, 'f1-score': 0.14373464373464373, 'support': 775}, 'P': {'precision': 0.17193523515805706, 'recall': 0.20235934664246824, 'f1-score': 0.18591079616506875, 'support': 1102}, 'micro avg': {'precision': 0.15813953488372093, 'recall': 0.18114011720831114, 'f1-score': 0.16886019369257513, 'support': 1877}, 'macro avg': {'precision': 0.15454909471853615, 'recall': 0.17666354428897607, 'f1-score': 0.16482271994985626, 'support': 1877}, 'weighted avg': {'precision': 0.15757800677166525, 'recall': 0.18114011720831114, 'f1-score': 0.16849656167728008, 'support': 1877}}
Token level accuracy: 0.5307383448583538
Wrong BIO-Encoding 145/2150 labels, 6.74%
Test-Data: Prec: 0.169, Rec: 0.181, F1: 0.1747

Scores from epoch with best dev-scores:
  Dev-Score: 0.9231
  Test-Score 0.1747

9.46 sec for evaluation

--------- Epoch 34 -----------
219.87 sec for training (7448.97 total)
-- cmv_modes1 --



{'C': {'precision': 0.6666666666666666, 'recall': 0.6666666666666666, 'f1-score': 0.6666666666666666, 'support': 3}, 'P': {'precision': 0.7272727272727273, 'recall': 0.8333333333333334, 'f1-score': 0.7766990291262137, 'support': 48}, 'micro avg': {'precision': 0.7241379310344828, 'recall': 0.8235294117647058, 'f1-score': 0.7706422018348623, 'support': 51}, 'macro avg': {'precision': 0.696969696969697, 'recall': 0.75, 'f1-score': 0.7216828478964401, 'support': 51}, 'weighted avg': {'precision': 0.7237076648841354, 'recall': 0.8235294117647058, 'f1-score': 0.7702265372168285, 'support': 51}}
Token level accuracy: 0.956480605487228
Wrong BIO-Encoding 4/61 labels, 6.56%



{'C': {'precision': 0.6666666666666666, 'recall': 0.6666666666666666, 'f1-score': 0.6666666666666666, 'support': 3}, 'P': {'precision': 0.7272727272727273, 'recall': 0.8333333333333334, 'f1-score': 0.7766990291262137, 'support': 48}, 'micro avg': {'precision': 0.7241379310344828, 'recall': 0.8235294117647058, 'f1-score': 0.7706422018348623, 'support': 51}, 'macro avg': {'precision': 0.696969696969697, 'recall': 0.75, 'f1-score': 0.7216828478964401, 'support': 51}, 'weighted avg': {'precision': 0.7237076648841354, 'recall': 0.8235294117647058, 'f1-score': 0.7702265372168285, 'support': 51}}
Token level accuracy: 0.956480605487228
Wrong BIO-Encoding 1/58 labels, 1.72%
Dev-Data: Prec: 0.737, Rec: 0.824, F1: 0.7778



{'C': {'precision': 0.10833333333333334, 'recall': 0.13419354838709677, 'f1-score': 0.11988472622478387, 'support': 775}, 'P': {'precision': 0.15409054805401112, 'recall': 0.17604355716878403, 'f1-score': 0.1643371452774248, 'support': 1102}, 'micro avg': {'precision': 0.13429472735466427, 'recall': 0.15876398508257858, 'f1-score': 0.1455078125, 'support': 1877}, 'macro avg': {'precision': 0.13121194069367223, 'recall': 0.1551185527779404, 'f1-score': 0.14211093575110434, 'support': 1877}, 'weighted avg': {'precision': 0.13519771832117933, 'recall': 0.15876398508257858, 'f1-score': 0.14598305643043666, 'support': 1877}}
Token level accuracy: 0.5183805487396832
Wrong BIO-Encoding 1912/3981 labels, 48.03%



{'C': {'precision': 0.10833333333333334, 'recall': 0.13419354838709677, 'f1-score': 0.11988472622478387, 'support': 775}, 'P': {'precision': 0.15409054805401112, 'recall': 0.17604355716878403, 'f1-score': 0.1643371452774248, 'support': 1102}, 'micro avg': {'precision': 0.13429472735466427, 'recall': 0.15876398508257858, 'f1-score': 0.1455078125, 'support': 1877}, 'macro avg': {'precision': 0.13121194069367223, 'recall': 0.1551185527779404, 'f1-score': 0.14211093575110434, 'support': 1877}, 'weighted avg': {'precision': 0.13519771832117933, 'recall': 0.15876398508257858, 'f1-score': 0.14598305643043666, 'support': 1877}}
Token level accuracy: 0.5183805487396832
Wrong BIO-Encoding 150/2219 labels, 6.76%
Test-Data: Prec: 0.142, Rec: 0.157, F1: 0.1490

Scores from epoch with best dev-scores:
  Dev-Score: 0.9231
  Test-Score 0.1747

9.70 sec for evaluation

--------- Epoch 35 -----------
219.17 sec for training (7668.13 total)
-- cmv_modes1 --



{'C': {'precision': 0.75, 'recall': 1.0, 'f1-score': 0.8571428571428571, 'support': 3}, 'P': {'precision': 0.9166666666666666, 'recall': 0.9166666666666666, 'f1-score': 0.9166666666666666, 'support': 48}, 'micro avg': {'precision': 0.9038461538461539, 'recall': 0.9215686274509803, 'f1-score': 0.9126213592233009, 'support': 51}, 'macro avg': {'precision': 0.8333333333333333, 'recall': 0.9583333333333333, 'f1-score': 0.8869047619047619, 'support': 51}, 'weighted avg': {'precision': 0.9068627450980392, 'recall': 0.9215686274509803, 'f1-score': 0.9131652661064426, 'support': 51}}
Token level accuracy: 0.9829706717123936



{'C': {'precision': 0.75, 'recall': 1.0, 'f1-score': 0.8571428571428571, 'support': 3}, 'P': {'precision': 0.9166666666666666, 'recall': 0.9166666666666666, 'f1-score': 0.9166666666666666, 'support': 48}, 'micro avg': {'precision': 0.9038461538461539, 'recall': 0.9215686274509803, 'f1-score': 0.9126213592233009, 'support': 51}, 'macro avg': {'precision': 0.8333333333333333, 'recall': 0.9583333333333333, 'f1-score': 0.8869047619047619, 'support': 51}, 'weighted avg': {'precision': 0.9068627450980392, 'recall': 0.9215686274509803, 'f1-score': 0.9131652661064426, 'support': 51}}
Token level accuracy: 0.9829706717123936
Dev-Data: Prec: 0.904, Rec: 0.922, F1: 0.9126



{'C': {'precision': 0.11855104281009879, 'recall': 0.1393548387096774, 'f1-score': 0.1281138790035587, 'support': 775}, 'P': {'precision': 0.1634304207119741, 'recall': 0.18330308529945555, 'f1-score': 0.1727972626176219, 'support': 1102}, 'micro avg': {'precision': 0.14438751746623196, 'recall': 0.16515716568993075, 'f1-score': 0.15407554671968193, 'support': 1877}, 'macro avg': {'precision': 0.14099073176103644, 'recall': 0.16132896200456648, 'f1-score': 0.1504555708105903, 'support': 1877}, 'weighted avg': {'precision': 0.14490004358147152, 'recall': 0.16515716568993075, 'f1-score': 0.15434781013978546, 'support': 1877}}
Token level accuracy: 0.5211911666294892
Wrong BIO-Encoding 2553/4526 labels, 56.41%



{'C': {'precision': 0.11855104281009879, 'recall': 0.1393548387096774, 'f1-score': 0.1281138790035587, 'support': 775}, 'P': {'precision': 0.1634304207119741, 'recall': 0.18330308529945555, 'f1-score': 0.1727972626176219, 'support': 1102}, 'micro avg': {'precision': 0.14438751746623196, 'recall': 0.16515716568993075, 'f1-score': 0.15407554671968193, 'support': 1877}, 'macro avg': {'precision': 0.14099073176103644, 'recall': 0.16132896200456648, 'f1-score': 0.1504555708105903, 'support': 1877}, 'weighted avg': {'precision': 0.14490004358147152, 'recall': 0.16515716568993075, 'f1-score': 0.15434781013978546, 'support': 1877}}
Token level accuracy: 0.5211911666294892
Wrong BIO-Encoding 174/2147 labels, 8.10%
Test-Data: Prec: 0.154, Rec: 0.162, F1: 0.1579

Scores from epoch with best dev-scores:
  Dev-Score: 0.9231
  Test-Score 0.1747

9.58 sec for evaluation

--------- Epoch 36 -----------
219.34 sec for training (7887.47 total)
-- cmv_modes1 --



{'C': {'precision': 0.75, 'recall': 1.0, 'f1-score': 0.8571428571428571, 'support': 3}, 'P': {'precision': 0.9375, 'recall': 0.9375, 'f1-score': 0.9375, 'support': 48}, 'micro avg': {'precision': 0.9230769230769231, 'recall': 0.9411764705882353, 'f1-score': 0.9320388349514563, 'support': 51}, 'macro avg': {'precision': 0.84375, 'recall': 0.96875, 'f1-score': 0.8973214285714286, 'support': 51}, 'weighted avg': {'precision': 0.9264705882352942, 'recall': 0.9411764705882353, 'f1-score': 0.9327731092436974, 'support': 51}}
Token level accuracy: 0.9914853358561968



{'C': {'precision': 0.75, 'recall': 1.0, 'f1-score': 0.8571428571428571, 'support': 3}, 'P': {'precision': 0.9375, 'recall': 0.9375, 'f1-score': 0.9375, 'support': 48}, 'micro avg': {'precision': 0.9230769230769231, 'recall': 0.9411764705882353, 'f1-score': 0.9320388349514563, 'support': 51}, 'macro avg': {'precision': 0.84375, 'recall': 0.96875, 'f1-score': 0.8973214285714286, 'support': 51}, 'weighted avg': {'precision': 0.9264705882352942, 'recall': 0.9411764705882353, 'f1-score': 0.9327731092436974, 'support': 51}}
Token level accuracy: 0.9914853358561968
Dev-Data: Prec: 0.923, Rec: 0.941, F1: 0.9320



{'C': {'precision': 0.13053348467650397, 'recall': 0.14838709677419354, 'f1-score': 0.13888888888888887, 'support': 775}, 'P': {'precision': 0.1565362198168193, 'recall': 0.1705989110707804, 'f1-score': 0.16326530612244897, 'support': 1102}, 'micro avg': {'precision': 0.14553314121037464, 'recall': 0.161427810335642, 'f1-score': 0.15306895680727456, 'support': 1877}, 'macro avg': {'precision': 0.14353485224666163, 'recall': 0.15949300392248697, 'f1-score': 0.15107709750566892, 'support': 1877}, 'weighted avg': {'precision': 0.1457998747269182, 'recall': 0.161427810335642, 'f1-score': 0.15320045617252406, 'support': 1877}}
Token level accuracy: 0.5130046843631497
Wrong BIO-Encoding 1972/3914 labels, 50.38%



{'C': {'precision': 0.13053348467650397, 'recall': 0.14838709677419354, 'f1-score': 0.13888888888888887, 'support': 775}, 'P': {'precision': 0.1565362198168193, 'recall': 0.1705989110707804, 'f1-score': 0.16326530612244897, 'support': 1102}, 'micro avg': {'precision': 0.14553314121037464, 'recall': 0.161427810335642, 'f1-score': 0.15306895680727456, 'support': 1877}, 'macro avg': {'precision': 0.14353485224666163, 'recall': 0.15949300392248697, 'f1-score': 0.15107709750566892, 'support': 1877}, 'weighted avg': {'precision': 0.1457998747269182, 'recall': 0.161427810335642, 'f1-score': 0.15320045617252406, 'support': 1877}}
Token level accuracy: 0.5130046843631497
Wrong BIO-Encoding 140/2082 labels, 6.72%
Test-Data: Prec: 0.154, Rec: 0.160, F1: 0.1571

Scores from epoch with best dev-scores:
  Dev-Score: 0.9320
  Test-Score 0.1571

9.71 sec for evaluation

--------- Epoch 37 -----------
220.50 sec for training (8107.97 total)
-- cmv_modes1 --



{'C': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 3}, 'P': {'precision': 0.9166666666666666, 'recall': 0.9166666666666666, 'f1-score': 0.9166666666666666, 'support': 48}, 'micro avg': {'precision': 0.9215686274509803, 'recall': 0.9215686274509803, 'f1-score': 0.9215686274509803, 'support': 51}, 'macro avg': {'precision': 0.9583333333333333, 'recall': 0.9583333333333333, 'f1-score': 0.9583333333333333, 'support': 51}, 'weighted avg': {'precision': 0.9215686274509803, 'recall': 0.9215686274509803, 'f1-score': 0.9215686274509803, 'support': 51}}
Token level accuracy: 0.9612109744560076



{'C': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 3}, 'P': {'precision': 0.9166666666666666, 'recall': 0.9166666666666666, 'f1-score': 0.9166666666666666, 'support': 48}, 'micro avg': {'precision': 0.9215686274509803, 'recall': 0.9215686274509803, 'f1-score': 0.9215686274509803, 'support': 51}, 'macro avg': {'precision': 0.9583333333333333, 'recall': 0.9583333333333333, 'f1-score': 0.9583333333333333, 'support': 51}, 'weighted avg': {'precision': 0.9215686274509803, 'recall': 0.9215686274509803, 'f1-score': 0.9215686274509803, 'support': 51}}
Token level accuracy: 0.9612109744560076
Dev-Data: Prec: 0.922, Rec: 0.922, F1: 0.9216



{'C': {'precision': 0.14236902050113895, 'recall': 0.16129032258064516, 'f1-score': 0.1512401693889897, 'support': 775}, 'P': {'precision': 0.17232597623089982, 'recall': 0.18421052631578946, 'f1-score': 0.1780701754385965, 'support': 1102}, 'micro avg': {'precision': 0.15953307392996108, 'recall': 0.17474693660095897, 'f1-score': 0.16679379608441391, 'support': 1877}, 'macro avg': {'precision': 0.15734749836601938, 'recall': 0.1727504244482173, 'f1-score': 0.1646551724137931, 'support': 1877}, 'weighted avg': {'precision': 0.1599569614783347, 'recall': 0.17474693660095897, 'f1-score': 0.1669922560521046, 'support': 1877}}
Token level accuracy: 0.5273923711800134
Wrong BIO-Encoding 2646/4532 labels, 58.38%



{'C': {'precision': 0.14236902050113895, 'recall': 0.16129032258064516, 'f1-score': 0.1512401693889897, 'support': 775}, 'P': {'precision': 0.17232597623089982, 'recall': 0.18421052631578946, 'f1-score': 0.1780701754385965, 'support': 1102}, 'micro avg': {'precision': 0.15953307392996108, 'recall': 0.17474693660095897, 'f1-score': 0.16679379608441391, 'support': 1877}, 'macro avg': {'precision': 0.15734749836601938, 'recall': 0.1727504244482173, 'f1-score': 0.1646551724137931, 'support': 1877}, 'weighted avg': {'precision': 0.1599569614783347, 'recall': 0.17474693660095897, 'f1-score': 0.1669922560521046, 'support': 1877}}
Token level accuracy: 0.5273923711800134
Wrong BIO-Encoding 170/2056 labels, 8.27%
Test-Data: Prec: 0.168, Rec: 0.168, F1: 0.1680

Scores from epoch with best dev-scores:
  Dev-Score: 0.9320
  Test-Score 0.1571

9.64 sec for evaluation

--------- Epoch 38 -----------
219.76 sec for training (8327.74 total)
-- cmv_modes1 --



{'C': {'precision': 0.6, 'recall': 1.0, 'f1-score': 0.7499999999999999, 'support': 3}, 'P': {'precision': 0.9583333333333334, 'recall': 0.9583333333333334, 'f1-score': 0.9583333333333334, 'support': 48}, 'micro avg': {'precision': 0.9245283018867925, 'recall': 0.9607843137254902, 'f1-score': 0.9423076923076923, 'support': 51}, 'macro avg': {'precision': 0.7791666666666667, 'recall': 0.9791666666666667, 'f1-score': 0.8541666666666666, 'support': 51}, 'weighted avg': {'precision': 0.9372549019607842, 'recall': 0.9607843137254902, 'f1-score': 0.946078431372549, 'support': 51}}
Token level accuracy: 0.978240302743614



{'C': {'precision': 0.6, 'recall': 1.0, 'f1-score': 0.7499999999999999, 'support': 3}, 'P': {'precision': 0.9583333333333334, 'recall': 0.9583333333333334, 'f1-score': 0.9583333333333334, 'support': 48}, 'micro avg': {'precision': 0.9245283018867925, 'recall': 0.9607843137254902, 'f1-score': 0.9423076923076923, 'support': 51}, 'macro avg': {'precision': 0.7791666666666667, 'recall': 0.9791666666666667, 'f1-score': 0.8541666666666666, 'support': 51}, 'weighted avg': {'precision': 0.9372549019607842, 'recall': 0.9607843137254902, 'f1-score': 0.946078431372549, 'support': 51}}
Token level accuracy: 0.978240302743614
Dev-Data: Prec: 0.925, Rec: 0.961, F1: 0.9423



{'C': {'precision': 0.10631494804156674, 'recall': 0.17161290322580644, 'f1-score': 0.13129318854886476, 'support': 775}, 'P': {'precision': 0.17522658610271905, 'recall': 0.15789473684210525, 'f1-score': 0.16610978520286393, 'support': 1102}, 'micro avg': {'precision': 0.13680926916221034, 'recall': 0.1635588705380927, 'f1-score': 0.14899296287308905, 'support': 1877}, 'macro avg': {'precision': 0.1407707670721429, 'recall': 0.16475382003395583, 'f1-score': 0.14870148687586435, 'support': 1877}, 'weighted avg': {'precision': 0.14677345903964337, 'recall': 0.1635588705380927, 'f1-score': 0.15173425914700384, 'support': 1877}}
Token level accuracy: 0.4871737675663618
Wrong BIO-Encoding 2071/4159 labels, 49.80%



{'C': {'precision': 0.10631494804156674, 'recall': 0.17161290322580644, 'f1-score': 0.13129318854886476, 'support': 775}, 'P': {'precision': 0.17522658610271905, 'recall': 0.15789473684210525, 'f1-score': 0.16610978520286393, 'support': 1102}, 'micro avg': {'precision': 0.13680926916221034, 'recall': 0.1635588705380927, 'f1-score': 0.14899296287308905, 'support': 1877}, 'macro avg': {'precision': 0.1407707670721429, 'recall': 0.16475382003395583, 'f1-score': 0.14870148687586435, 'support': 1877}, 'weighted avg': {'precision': 0.14677345903964337, 'recall': 0.1635588705380927, 'f1-score': 0.15173425914700384, 'support': 1877}}
Token level accuracy: 0.4871737675663618
Wrong BIO-Encoding 156/2244 labels, 6.95%
Test-Data: Prec: 0.145, Rec: 0.161, F1: 0.1523

Scores from epoch with best dev-scores:
  Dev-Score: 0.9423
  Test-Score 0.1523

9.44 sec for evaluation

--------- Epoch 39 -----------
221.12 sec for training (8548.86 total)
-- cmv_modes1 --



{'C': {'precision': 0.75, 'recall': 1.0, 'f1-score': 0.8571428571428571, 'support': 3}, 'P': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 48}, 'micro avg': {'precision': 0.9807692307692307, 'recall': 1.0, 'f1-score': 0.9902912621359222, 'support': 51}, 'macro avg': {'precision': 0.875, 'recall': 1.0, 'f1-score': 0.9285714285714286, 'support': 51}, 'weighted avg': {'precision': 0.9852941176470589, 'recall': 1.0, 'f1-score': 0.9915966386554621, 'support': 51}}
Token level accuracy: 0.9952696310312205



{'C': {'precision': 0.75, 'recall': 1.0, 'f1-score': 0.8571428571428571, 'support': 3}, 'P': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 48}, 'micro avg': {'precision': 0.9807692307692307, 'recall': 1.0, 'f1-score': 0.9902912621359222, 'support': 51}, 'macro avg': {'precision': 0.875, 'recall': 1.0, 'f1-score': 0.9285714285714286, 'support': 51}, 'weighted avg': {'precision': 0.9852941176470589, 'recall': 1.0, 'f1-score': 0.9915966386554621, 'support': 51}}
Token level accuracy: 0.9952696310312205
Dev-Data: Prec: 0.981, Rec: 1.000, F1: 0.9903



{'C': {'precision': 0.1347517730496454, 'recall': 0.19612903225806452, 'f1-score': 0.15974776668418286, 'support': 775}, 'P': {'precision': 0.18683274021352314, 'recall': 0.19056261343012704, 'f1-score': 0.18867924528301885, 'support': 1102}, 'micro avg': {'precision': 0.16074600355239788, 'recall': 0.1928609483217901, 'f1-score': 0.1753451198837491, 'support': 1877}, 'macro avg': {'precision': 0.16079225663158425, 'recall': 0.1933458228440958, 'f1-score': 0.17421350598360086, 'support': 1877}, 'weighted avg': {'precision': 0.16532887790558212, 'recall': 0.1928609483217901, 'f1-score': 0.17673364277151224, 'support': 1877}}
Token level accuracy: 0.5161052866384118
Wrong BIO-Encoding 1389/3531 labels, 39.34%



{'C': {'precision': 0.1347517730496454, 'recall': 0.19612903225806452, 'f1-score': 0.15974776668418286, 'support': 775}, 'P': {'precision': 0.18683274021352314, 'recall': 0.19056261343012704, 'f1-score': 0.18867924528301885, 'support': 1102}, 'micro avg': {'precision': 0.16074600355239788, 'recall': 0.1928609483217901, 'f1-score': 0.1753451198837491, 'support': 1877}, 'macro avg': {'precision': 0.16079225663158425, 'recall': 0.1933458228440958, 'f1-score': 0.17421350598360086, 'support': 1877}, 'weighted avg': {'precision': 0.16532887790558212, 'recall': 0.1928609483217901, 'f1-score': 0.17673364277151224, 'support': 1877}}
Token level accuracy: 0.5161052866384118
Wrong BIO-Encoding 110/2252 labels, 4.88%
Test-Data: Prec: 0.166, Rec: 0.189, F1: 0.1767

Scores from epoch with best dev-scores:
  Dev-Score: 0.9903
  Test-Score 0.1767

9.53 sec for evaluation

--------- Epoch 40 -----------
221.13 sec for training (8769.99 total)
-- cmv_modes1 --



{'C': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 3}, 'P': {'precision': 0.94, 'recall': 0.9791666666666666, 'f1-score': 0.9591836734693877, 'support': 48}, 'micro avg': {'precision': 0.9433962264150944, 'recall': 0.9803921568627451, 'f1-score': 0.9615384615384616, 'support': 51}, 'macro avg': {'precision': 0.97, 'recall': 0.9895833333333333, 'f1-score': 0.9795918367346939, 'support': 51}, 'weighted avg': {'precision': 0.9435294117647058, 'recall': 0.9803921568627451, 'f1-score': 0.9615846338535414, 'support': 51}}
Token level accuracy: 0.9924314096499527



{'C': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 3}, 'P': {'precision': 0.94, 'recall': 0.9791666666666666, 'f1-score': 0.9591836734693877, 'support': 48}, 'micro avg': {'precision': 0.9433962264150944, 'recall': 0.9803921568627451, 'f1-score': 0.9615384615384616, 'support': 51}, 'macro avg': {'precision': 0.97, 'recall': 0.9895833333333333, 'f1-score': 0.9795918367346939, 'support': 51}, 'weighted avg': {'precision': 0.9435294117647058, 'recall': 0.9803921568627451, 'f1-score': 0.9615846338535414, 'support': 51}}
Token level accuracy: 0.9924314096499527
Dev-Data: Prec: 0.943, Rec: 0.980, F1: 0.9615



{'C': {'precision': 0.1511627906976744, 'recall': 0.13419354838709677, 'f1-score': 0.14217361585782637, 'support': 775}, 'P': {'precision': 0.1628222523744912, 'recall': 0.2177858439201452, 'f1-score': 0.1863354037267081, 'support': 1102}, 'micro avg': {'precision': 0.15911193339500462, 'recall': 0.18327117741076185, 'f1-score': 0.17033919286952218, 'support': 1877}, 'macro avg': {'precision': 0.15699252153608279, 'recall': 0.17598969615362098, 'f1-score': 0.16425450979226724, 'support': 1877}, 'weighted avg': {'precision': 0.1580081432644576, 'recall': 0.18327117741076185, 'f1-score': 0.1681013144361469, 'support': 1877}}
Token level accuracy: 0.5445237564131162
Wrong BIO-Encoding 1348/3404 labels, 39.60%



{'C': {'precision': 0.1511627906976744, 'recall': 0.13419354838709677, 'f1-score': 0.14217361585782637, 'support': 775}, 'P': {'precision': 0.1628222523744912, 'recall': 0.2177858439201452, 'f1-score': 0.1863354037267081, 'support': 1102}, 'micro avg': {'precision': 0.15911193339500462, 'recall': 0.18327117741076185, 'f1-score': 0.17033919286952218, 'support': 1877}, 'macro avg': {'precision': 0.15699252153608279, 'recall': 0.17598969615362098, 'f1-score': 0.16425450979226724, 'support': 1877}, 'weighted avg': {'precision': 0.1580081432644576, 'recall': 0.18327117741076185, 'f1-score': 0.1681013144361469, 'support': 1877}}
Token level accuracy: 0.5445237564131162
Wrong BIO-Encoding 106/2162 labels, 4.90%
Test-Data: Prec: 0.167, Rec: 0.183, F1: 0.1744

Scores from epoch with best dev-scores:
  Dev-Score: 0.9903
  Test-Score 0.1767

9.84 sec for evaluation
---------RUN 3 ------------
Generate new embeddings files for a dataset
Read file: komninos_english_embeddings.gz
Added words: 10
:: Transform cmv_modes dataset ::
:: Create Train Matrix ::
Unknown-Tokens: 0.90%
:: Create Dev Matrix ::
Unknown-Tokens: 1.03%
:: Create Test Matrix ::
Unknown-Tokens: 0.89%
:: Transform cmv_modes1 dataset ::
:: Create Train Matrix ::
Unknown-Tokens: 0.90%
:: Create Dev Matrix ::
Unknown-Tokens: 1.03%
:: Create Test Matrix ::
Unknown-Tokens: 0.89%
:: Transform cmv_modes2 dataset ::
:: Create Train Matrix ::
Unknown-Tokens: 0.90%
:: Create Dev Matrix ::
Unknown-Tokens: 1.03%
:: Create Test Matrix ::
Unknown-Tokens: 0.89%
DONE - Embeddings file saved: pkl/cmv_modes_cmv_modes1_cmv_modes2_komninos_english_embeddings.pkl
--- cmv_modes ---
229 train sentences
5 dev sentences
227 test sentences
--- cmv_modes1 ---
229 train sentences
5 dev sentences
227 test sentences
--- cmv_modes2 ---
229 train sentences
5 dev sentences
227 test sentences
LSTM-Size: [100]
_____________________________________________________________________________________________________________________________
Layer (type)                             Output Shape               Param #        Connected to                              
=============================================================================================================================
words_input (InputLayer)                 (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
casing_input (InputLayer)                (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
word_embeddings (Embedding)              (None, None, 300)          66694800       words_input[0][0]                         
_____________________________________________________________________________________________________________________________
casing_emebddings (Embedding)            (None, None, 10)           80             casing_input[0][0]                        
_____________________________________________________________________________________________________________________________
concatenate_1 (Concatenate)              (None, None, 310)          0              word_embeddings[0][0]                     
                                                                                   casing_emebddings[0][0]                   
_____________________________________________________________________________________________________________________________
shared_varLSTM_1 (Bidirectional)         (None, None, 200)          328800         concatenate_1[0][0]                       
_____________________________________________________________________________________________________________________________
cmv_modes_hidden_lin_layer (TimeDistribu (None, None, 287)          57687          shared_varLSTM_1[0][0]                    
_____________________________________________________________________________________________________________________________
cmv_modes_crf (ChainCRF)                 (None, None, 287)          82943          cmv_modes_hidden_lin_layer[0][0]          
=============================================================================================================================
Total params: 67,164,310
Trainable params: 469,510
Non-trainable params: 66,694,800
_____________________________________________________________________________________________________________________________
_____________________________________________________________________________________________________________________________
Layer (type)                             Output Shape               Param #        Connected to                              
=============================================================================================================================
words_input (InputLayer)                 (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
casing_input (InputLayer)                (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
word_embeddings (Embedding)              (None, None, 300)          66694800       words_input[0][0]                         
_____________________________________________________________________________________________________________________________
casing_emebddings (Embedding)            (None, None, 10)           80             casing_input[0][0]                        
_____________________________________________________________________________________________________________________________
concatenate_1 (Concatenate)              (None, None, 310)          0              word_embeddings[0][0]                     
                                                                                   casing_emebddings[0][0]                   
_____________________________________________________________________________________________________________________________
shared_varLSTM_1 (Bidirectional)         (None, None, 200)          328800         concatenate_1[0][0]                       
_____________________________________________________________________________________________________________________________
cmv_modes1_hidden_lin_layer (TimeDistrib (None, None, 5)            1005           shared_varLSTM_1[0][0]                    
_____________________________________________________________________________________________________________________________
cmv_modes1_crf (ChainCRF)                (None, None, 5)            35             cmv_modes1_hidden_lin_layer[0][0]         
=============================================================================================================================
Total params: 67,024,720
Trainable params: 329,920
Non-trainable params: 66,694,800
_____________________________________________________________________________________________________________________________
_____________________________________________________________________________________________________________________________
Layer (type)                             Output Shape               Param #        Connected to                              
=============================================================================================================================
words_input (InputLayer)                 (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
casing_input (InputLayer)                (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
word_embeddings (Embedding)              (None, None, 300)          66694800       words_input[0][0]                         
_____________________________________________________________________________________________________________________________
casing_emebddings (Embedding)            (None, None, 10)           80             casing_input[0][0]                        
_____________________________________________________________________________________________________________________________
concatenate_1 (Concatenate)              (None, None, 310)          0              word_embeddings[0][0]                     
                                                                                   casing_emebddings[0][0]                   
_____________________________________________________________________________________________________________________________
shared_varLSTM_1 (Bidirectional)         (None, None, 200)          328800         concatenate_1[0][0]                       
_____________________________________________________________________________________________________________________________
cmv_modes2_softmax (TimeDistributed)     (None, None, 119)          23919          shared_varLSTM_1[0][0]                    
=============================================================================================================================
Total params: 67,047,599
Trainable params: 352,799
Non-trainable params: 66,694,800
_____________________________________________________________________________________________________________________________

--------- Epoch 1 -----------
240.82 sec for training (240.82 total)
-- cmv_modes1 --



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 17}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 24}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 41}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 41}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 41}}
Token level accuracy: 0.5295629820051414
Wrong BIO-Encoding 573/573 labels, 100.00%



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 17}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 24}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 41}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 41}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 41}}
Token level accuracy: 0.5295629820051414
Wrong BIO-Encoding 116/116 labels, 100.00%
Dev-Data: Prec: 0.000, Rec: 0.000, F1: 0.0000



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 722}, 'P': {'precision': 0.0015812776723592662, 'recall': 0.005307855626326964, 'f1-score': 0.0024366471734892786, 'support': 942}, 'micro avg': {'precision': 0.000833472245374229, 'recall': 0.0030048076923076925, 'f1-score': 0.0013049719431032232, 'support': 1664}, 'macro avg': {'precision': 0.0007906388361796331, 'recall': 0.002653927813163482, 'f1-score': 0.0012183235867446393, 'support': 1664}, 'weighted avg': {'precision': 0.0008951704130783827, 'recall': 0.0030048076923076925, 'f1-score': 0.0013794000224921278, 'support': 1664}}
Token level accuracy: 0.4132462919886946
Wrong BIO-Encoding 27914/27958 labels, 99.84%



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 722}, 'P': {'precision': 0.0015812776723592662, 'recall': 0.005307855626326964, 'f1-score': 0.0024366471734892786, 'support': 942}, 'micro avg': {'precision': 0.000833472245374229, 'recall': 0.0030048076923076925, 'f1-score': 0.0013049719431032232, 'support': 1664}, 'macro avg': {'precision': 0.0007906388361796331, 'recall': 0.002653927813163482, 'f1-score': 0.0012183235867446393, 'support': 1664}, 'weighted avg': {'precision': 0.0008951704130783827, 'recall': 0.0030048076923076925, 'f1-score': 0.0013794000224921278, 'support': 1664}}
Token level accuracy: 0.4132462919886946
Wrong BIO-Encoding 5955/5999 labels, 99.27%
Test-Data: Prec: 0.001, Rec: 0.003, F1: 0.0013

Scores from epoch with best dev-scores:
  Dev-Score: 0.0000
  Test-Score 0.0000

9.48 sec for evaluation

--------- Epoch 2 -----------
229.12 sec for training (469.94 total)
-- cmv_modes1 --



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 17}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 24}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 41}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 41}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 41}}
Token level accuracy: 0.2879177377892031
Wrong BIO-Encoding 88/92 labels, 95.65%



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 17}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 24}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 41}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 41}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 41}}
Token level accuracy: 0.2879177377892031
Wrong BIO-Encoding 1/5 labels, 20.00%
Dev-Data: Prec: 0.000, Rec: 0.000, F1: 0.0000



{'C': {'precision': 0.011965811965811967, 'recall': 0.009695290858725761, 'f1-score': 0.010711553175210406, 'support': 722}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 942}, 'micro avg': {'precision': 0.007194244604316547, 'recall': 0.004206730769230769, 'f1-score': 0.005309063329541145, 'support': 1664}, 'macro avg': {'precision': 0.005982905982905983, 'recall': 0.004847645429362881, 'f1-score': 0.005355776587605203, 'support': 1664}, 'weighted avg': {'precision': 0.00519189677843524, 'recall': 0.004206730769230769, 'f1-score': 0.00464768112530163, 'support': 1664}}
Token level accuracy: 0.3133988644606188
Wrong BIO-Encoding 8962/9431 labels, 95.03%



{'C': {'precision': 0.011965811965811967, 'recall': 0.009695290858725761, 'f1-score': 0.010711553175210406, 'support': 722}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 942}, 'micro avg': {'precision': 0.007194244604316547, 'recall': 0.004206730769230769, 'f1-score': 0.005309063329541145, 'support': 1664}, 'macro avg': {'precision': 0.005982905982905983, 'recall': 0.004847645429362881, 'f1-score': 0.005355776587605203, 'support': 1664}, 'weighted avg': {'precision': 0.00519189677843524, 'recall': 0.004206730769230769, 'f1-score': 0.00464768112530163, 'support': 1664}}
Token level accuracy: 0.3133988644606188
Wrong BIO-Encoding 504/973 labels, 51.80%
Test-Data: Prec: 0.007, Rec: 0.004, F1: 0.0053

Scores from epoch with best dev-scores:
  Dev-Score: 0.0000
  Test-Score 0.0000

8.87 sec for evaluation

--------- Epoch 3 -----------
228.69 sec for training (698.63 total)
-- cmv_modes1 --



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 17}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 24}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 41}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 41}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 41}}
Token level accuracy: 0.6568123393316195
Wrong BIO-Encoding 653/656 labels, 99.54%



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 17}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 24}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 41}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 41}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 41}}
Token level accuracy: 0.6568123393316195
Wrong BIO-Encoding 7/10 labels, 70.00%
Dev-Data: Prec: 0.000, Rec: 0.000, F1: 0.0000



{'C': {'precision': 0.025936599423631124, 'recall': 0.012465373961218837, 'f1-score': 0.016838166510757716, 'support': 722}, 'P': {'precision': 0.0028328611898017, 'recall': 0.0010615711252653928, 'f1-score': 0.0015444015444015444, 'support': 942}, 'micro avg': {'precision': 0.014285714285714285, 'recall': 0.006009615384615385, 'f1-score': 0.008460236886632826, 'support': 1664}, 'macro avg': {'precision': 0.014384730306716413, 'recall': 0.006763472543242115, 'f1-score': 0.00919128402757963, 'support': 1664}, 'weighted avg': {'precision': 0.012857439918662783, 'recall': 0.006009615384615385, 'f1-score': 0.008180277930044066, 'support': 1664}}
Token level accuracy: 0.4456366774217753
Wrong BIO-Encoding 30970/31248 labels, 99.11%



{'C': {'precision': 0.025936599423631124, 'recall': 0.012465373961218837, 'f1-score': 0.016838166510757716, 'support': 722}, 'P': {'precision': 0.0028328611898017, 'recall': 0.0010615711252653928, 'f1-score': 0.0015444015444015444, 'support': 942}, 'micro avg': {'precision': 0.014285714285714285, 'recall': 0.006009615384615385, 'f1-score': 0.008460236886632826, 'support': 1664}, 'macro avg': {'precision': 0.014384730306716413, 'recall': 0.006763472543242115, 'f1-score': 0.00919128402757963, 'support': 1664}, 'weighted avg': {'precision': 0.012857439918662783, 'recall': 0.006009615384615385, 'f1-score': 0.008180277930044066, 'support': 1664}}
Token level accuracy: 0.4456366774217753
Wrong BIO-Encoding 422/700 labels, 60.29%
Test-Data: Prec: 0.014, Rec: 0.006, F1: 0.0085

Scores from epoch with best dev-scores:
  Dev-Score: 0.0000
  Test-Score 0.0000

8.92 sec for evaluation

--------- Epoch 4 -----------
229.11 sec for training (927.74 total)
-- cmv_modes1 --



{'C': {'precision': 0.14285714285714285, 'recall': 0.058823529411764705, 'f1-score': 0.08333333333333333, 'support': 17}, 'P': {'precision': 0.2, 'recall': 0.041666666666666664, 'f1-score': 0.06896551724137931, 'support': 24}, 'micro avg': {'precision': 0.16666666666666666, 'recall': 0.04878048780487805, 'f1-score': 0.07547169811320753, 'support': 41}, 'macro avg': {'precision': 0.17142857142857143, 'recall': 0.05024509803921569, 'f1-score': 0.07614942528735633, 'support': 41}, 'weighted avg': {'precision': 0.17630662020905927, 'recall': 0.04878048780487805, 'f1-score': 0.07492290440145781, 'support': 41}}
Token level accuracy: 0.6838046272493573
Wrong BIO-Encoding 488/494 labels, 98.79%



{'C': {'precision': 0.14285714285714285, 'recall': 0.058823529411764705, 'f1-score': 0.08333333333333333, 'support': 17}, 'P': {'precision': 0.2, 'recall': 0.041666666666666664, 'f1-score': 0.06896551724137931, 'support': 24}, 'micro avg': {'precision': 0.16666666666666666, 'recall': 0.04878048780487805, 'f1-score': 0.07547169811320753, 'support': 41}, 'macro avg': {'precision': 0.17142857142857143, 'recall': 0.05024509803921569, 'f1-score': 0.07614942528735633, 'support': 41}, 'weighted avg': {'precision': 0.17630662020905927, 'recall': 0.04878048780487805, 'f1-score': 0.07492290440145781, 'support': 41}}
Token level accuracy: 0.6838046272493573
Wrong BIO-Encoding 6/12 labels, 50.00%
Dev-Data: Prec: 0.167, Rec: 0.049, F1: 0.0755



{'C': {'precision': 0.029459901800327332, 'recall': 0.024930747922437674, 'f1-score': 0.02700675168792198, 'support': 722}, 'P': {'precision': 0.0028735632183908046, 'recall': 0.0021231422505307855, 'f1-score': 0.0024420024420024424, 'support': 942}, 'micro avg': {'precision': 0.015302218821729151, 'recall': 0.01201923076923077, 'f1-score': 0.013463480309660047, 'support': 1664}, 'macro avg': {'precision': 0.01616673250935907, 'recall': 0.01352694508648423, 'f1-score': 0.014724377064962211, 'support': 1664}, 'weighted avg': {'precision': 0.014409222146370478, 'recall': 0.01201923076923077, 'f1-score': 0.013100505420099742, 'support': 1664}}
Token level accuracy: 0.46857257197168656
Wrong BIO-Encoding 23753/24363 labels, 97.50%



{'C': {'precision': 0.029459901800327332, 'recall': 0.024930747922437674, 'f1-score': 0.02700675168792198, 'support': 722}, 'P': {'precision': 0.0028735632183908046, 'recall': 0.0021231422505307855, 'f1-score': 0.0024420024420024424, 'support': 942}, 'micro avg': {'precision': 0.015302218821729151, 'recall': 0.01201923076923077, 'f1-score': 0.013463480309660047, 'support': 1664}, 'macro avg': {'precision': 0.01616673250935907, 'recall': 0.01352694508648423, 'f1-score': 0.014724377064962211, 'support': 1664}, 'weighted avg': {'precision': 0.014409222146370478, 'recall': 0.01201923076923077, 'f1-score': 0.013100505420099742, 'support': 1664}}
Token level accuracy: 0.46857257197168656
Wrong BIO-Encoding 697/1307 labels, 53.33%
Test-Data: Prec: 0.030, Rec: 0.011, F1: 0.0158

Scores from epoch with best dev-scores:
  Dev-Score: 0.0755
  Test-Score 0.0158

8.92 sec for evaluation

--------- Epoch 5 -----------
229.60 sec for training (1157.34 total)
-- cmv_modes1 --



{'C': {'precision': 0.09090909090909091, 'recall': 0.058823529411764705, 'f1-score': 0.07142857142857142, 'support': 17}, 'P': {'precision': 0.2777777777777778, 'recall': 0.20833333333333334, 'f1-score': 0.2380952380952381, 'support': 24}, 'micro avg': {'precision': 0.20689655172413793, 'recall': 0.14634146341463414, 'f1-score': 0.1714285714285714, 'support': 41}, 'macro avg': {'precision': 0.18434343434343436, 'recall': 0.13357843137254902, 'f1-score': 0.15476190476190477, 'support': 41}, 'weighted avg': {'precision': 0.20029563932002958, 'recall': 0.14634146341463414, 'f1-score': 0.16898954703832753, 'support': 41}}
Token level accuracy: 0.7159383033419023
Wrong BIO-Encoding 135/158 labels, 85.44%



{'C': {'precision': 0.09090909090909091, 'recall': 0.058823529411764705, 'f1-score': 0.07142857142857142, 'support': 17}, 'P': {'precision': 0.2777777777777778, 'recall': 0.20833333333333334, 'f1-score': 0.2380952380952381, 'support': 24}, 'micro avg': {'precision': 0.20689655172413793, 'recall': 0.14634146341463414, 'f1-score': 0.1714285714285714, 'support': 41}, 'macro avg': {'precision': 0.18434343434343436, 'recall': 0.13357843137254902, 'f1-score': 0.15476190476190477, 'support': 41}, 'weighted avg': {'precision': 0.20029563932002958, 'recall': 0.14634146341463414, 'f1-score': 0.16898954703832753, 'support': 41}}
Token level accuracy: 0.7159383033419023
Wrong BIO-Encoding 6/29 labels, 20.69%
Dev-Data: Prec: 0.261, Rec: 0.146, F1: 0.1875



{'C': {'precision': 0.06580493537015276, 'recall': 0.07756232686980609, 'f1-score': 0.0712015257469803, 'support': 722}, 'P': {'precision': 0.023744292237442923, 'recall': 0.027600849256900213, 'f1-score': 0.025527736867943056, 'support': 942}, 'micro avg': {'precision': 0.0421377183967112, 'recall': 0.04927884615384615, 'f1-score': 0.04542936288088643, 'support': 1664}, 'macro avg': {'precision': 0.044774613803797846, 'recall': 0.052581588063353155, 'f1-score': 0.04836463130746168, 'support': 1664}, 'weighted avg': {'precision': 0.04199416263516919, 'recall': 0.04927884615384615, 'f1-score': 0.045345330359929166, 'support': 1664}}
Token level accuracy: 0.4940846902278582
Wrong BIO-Encoding 10442/11733 labels, 89.00%



{'C': {'precision': 0.06580493537015276, 'recall': 0.07756232686980609, 'f1-score': 0.0712015257469803, 'support': 722}, 'P': {'precision': 0.023744292237442923, 'recall': 0.027600849256900213, 'f1-score': 0.025527736867943056, 'support': 942}, 'micro avg': {'precision': 0.0421377183967112, 'recall': 0.04927884615384615, 'f1-score': 0.04542936288088643, 'support': 1664}, 'macro avg': {'precision': 0.044774613803797846, 'recall': 0.052581588063353155, 'f1-score': 0.04836463130746168, 'support': 1664}, 'weighted avg': {'precision': 0.04199416263516919, 'recall': 0.04927884615384615, 'f1-score': 0.045345330359929166, 'support': 1664}}
Token level accuracy: 0.4940846902278582
Wrong BIO-Encoding 655/1946 labels, 33.66%
Test-Data: Prec: 0.063, Rec: 0.049, F1: 0.0548

Scores from epoch with best dev-scores:
  Dev-Score: 0.1875
  Test-Score 0.0548

8.90 sec for evaluation

--------- Epoch 6 -----------
234.00 sec for training (1391.35 total)
-- cmv_modes1 --



{'C': {'precision': 0.25, 'recall': 0.11764705882352941, 'f1-score': 0.15999999999999998, 'support': 17}, 'P': {'precision': 0.20833333333333334, 'recall': 0.20833333333333334, 'f1-score': 0.20833333333333334, 'support': 24}, 'micro avg': {'precision': 0.21875, 'recall': 0.17073170731707318, 'f1-score': 0.19178082191780824, 'support': 41}, 'macro avg': {'precision': 0.22916666666666669, 'recall': 0.16299019607843138, 'f1-score': 0.18416666666666665, 'support': 41}, 'weighted avg': {'precision': 0.22560975609756098, 'recall': 0.17073170731707318, 'f1-score': 0.18829268292682927, 'support': 41}}
Token level accuracy: 0.6799485861182519
Wrong BIO-Encoding 42/71 labels, 59.15%



{'C': {'precision': 0.25, 'recall': 0.11764705882352941, 'f1-score': 0.15999999999999998, 'support': 17}, 'P': {'precision': 0.20833333333333334, 'recall': 0.20833333333333334, 'f1-score': 0.20833333333333334, 'support': 24}, 'micro avg': {'precision': 0.21875, 'recall': 0.17073170731707318, 'f1-score': 0.19178082191780824, 'support': 41}, 'macro avg': {'precision': 0.22916666666666669, 'recall': 0.16299019607843138, 'f1-score': 0.18416666666666665, 'support': 41}, 'weighted avg': {'precision': 0.22560975609756098, 'recall': 0.17073170731707318, 'f1-score': 0.18829268292682927, 'support': 41}}
Token level accuracy: 0.6799485861182519
Wrong BIO-Encoding 3/32 labels, 9.38%
Dev-Data: Prec: 0.241, Rec: 0.171, F1: 0.2000



{'C': {'precision': 0.1316270566727605, 'recall': 0.0997229916897507, 'f1-score': 0.11347517730496454, 'support': 722}, 'P': {'precision': 0.09843205574912892, 'recall': 0.11995753715498939, 'f1-score': 0.10813397129186603, 'support': 942}, 'micro avg': {'precision': 0.10914454277286136, 'recall': 0.11117788461538461, 'f1-score': 0.11015183090205417, 'support': 1664}, 'macro avg': {'precision': 0.11502955621094471, 'recall': 0.10984026442237005, 'f1-score': 0.11080457429841528, 'support': 1664}, 'weighted avg': {'precision': 0.11283517514027194, 'recall': 0.11117788461538461, 'f1-score': 0.1104514897662994, 'support': 1664}}
Token level accuracy: 0.5189715114679473
Wrong BIO-Encoding 5126/6538 labels, 78.40%



{'C': {'precision': 0.1316270566727605, 'recall': 0.0997229916897507, 'f1-score': 0.11347517730496454, 'support': 722}, 'P': {'precision': 0.09843205574912892, 'recall': 0.11995753715498939, 'f1-score': 0.10813397129186603, 'support': 942}, 'micro avg': {'precision': 0.10914454277286136, 'recall': 0.11117788461538461, 'f1-score': 0.11015183090205417, 'support': 1664}, 'macro avg': {'precision': 0.11502955621094471, 'recall': 0.10984026442237005, 'f1-score': 0.11080457429841528, 'support': 1664}, 'weighted avg': {'precision': 0.11283517514027194, 'recall': 0.11117788461538461, 'f1-score': 0.1104514897662994, 'support': 1664}}
Token level accuracy: 0.5189715114679473
Wrong BIO-Encoding 283/1695 labels, 16.70%
Test-Data: Prec: 0.128, Rec: 0.109, F1: 0.1177

Scores from epoch with best dev-scores:
  Dev-Score: 0.2000
  Test-Score 0.1177

8.97 sec for evaluation

--------- Epoch 7 -----------
231.98 sec for training (1623.33 total)
-- cmv_modes1 --



{'C': {'precision': 0.25, 'recall': 0.17647058823529413, 'f1-score': 0.20689655172413793, 'support': 17}, 'P': {'precision': 0.125, 'recall': 0.125, 'f1-score': 0.125, 'support': 24}, 'micro avg': {'precision': 0.16666666666666666, 'recall': 0.14634146341463414, 'f1-score': 0.15584415584415584, 'support': 41}, 'macro avg': {'precision': 0.1875, 'recall': 0.15073529411764708, 'f1-score': 0.16594827586206895, 'support': 41}, 'weighted avg': {'precision': 0.17682926829268292, 'recall': 0.14634146341463414, 'f1-score': 0.15895710681244746, 'support': 41}}
Token level accuracy: 0.7223650385604113
Wrong BIO-Encoding 32/66 labels, 48.48%



{'C': {'precision': 0.25, 'recall': 0.17647058823529413, 'f1-score': 0.20689655172413793, 'support': 17}, 'P': {'precision': 0.125, 'recall': 0.125, 'f1-score': 0.125, 'support': 24}, 'micro avg': {'precision': 0.16666666666666666, 'recall': 0.14634146341463414, 'f1-score': 0.15584415584415584, 'support': 41}, 'macro avg': {'precision': 0.1875, 'recall': 0.15073529411764708, 'f1-score': 0.16594827586206895, 'support': 41}, 'weighted avg': {'precision': 0.17682926829268292, 'recall': 0.14634146341463414, 'f1-score': 0.15895710681244746, 'support': 41}}
Token level accuracy: 0.7223650385604113
Wrong BIO-Encoding 2/36 labels, 5.56%
Dev-Data: Prec: 0.176, Rec: 0.146, F1: 0.1600



{'C': {'precision': 0.10932944606413994, 'recall': 0.1038781163434903, 'f1-score': 0.10653409090909091, 'support': 722}, 'P': {'precision': 0.14035087719298245, 'recall': 0.14437367303609341, 'f1-score': 0.1423338566195709, 'support': 942}, 'micro avg': {'precision': 0.12749244712990937, 'recall': 0.1268028846153846, 'f1-score': 0.12714673094305515, 'support': 1664}, 'macro avg': {'precision': 0.1248401616285612, 'recall': 0.12412589468979185, 'f1-score': 0.12443397376433091, 'support': 1664}, 'weighted avg': {'precision': 0.12689085719597265, 'recall': 0.1268028846153846, 'f1-score': 0.1268005448149035, 'support': 1664}}
Token level accuracy: 0.5085415572396889
Wrong BIO-Encoding 3779/5233 labels, 72.21%



{'C': {'precision': 0.10932944606413994, 'recall': 0.1038781163434903, 'f1-score': 0.10653409090909091, 'support': 722}, 'P': {'precision': 0.14035087719298245, 'recall': 0.14437367303609341, 'f1-score': 0.1423338566195709, 'support': 942}, 'micro avg': {'precision': 0.12749244712990937, 'recall': 0.1268028846153846, 'f1-score': 0.12714673094305515, 'support': 1664}, 'macro avg': {'precision': 0.1248401616285612, 'recall': 0.12412589468979185, 'f1-score': 0.12443397376433091, 'support': 1664}, 'weighted avg': {'precision': 0.12689085719597265, 'recall': 0.1268028846153846, 'f1-score': 0.1268005448149035, 'support': 1664}}
Token level accuracy: 0.5085415572396889
Wrong BIO-Encoding 201/1655 labels, 12.15%
Test-Data: Prec: 0.144, Rec: 0.126, F1: 0.1341

Scores from epoch with best dev-scores:
  Dev-Score: 0.2000
  Test-Score 0.1177

9.20 sec for evaluation

--------- Epoch 8 -----------
230.64 sec for training (1853.97 total)
-- cmv_modes1 --



{'C': {'precision': 0.16666666666666666, 'recall': 0.11764705882352941, 'f1-score': 0.13793103448275862, 'support': 17}, 'P': {'precision': 0.05555555555555555, 'recall': 0.041666666666666664, 'f1-score': 0.04761904761904762, 'support': 24}, 'micro avg': {'precision': 0.1, 'recall': 0.07317073170731707, 'f1-score': 0.08450704225352113, 'support': 41}, 'macro avg': {'precision': 0.1111111111111111, 'recall': 0.07965686274509803, 'f1-score': 0.09277504105090312, 'support': 41}, 'weighted avg': {'precision': 0.10162601626016259, 'recall': 0.07317073170731707, 'f1-score': 0.08506548119668388, 'support': 41}}
Token level accuracy: 0.712082262210797



{'C': {'precision': 0.16666666666666666, 'recall': 0.11764705882352941, 'f1-score': 0.13793103448275862, 'support': 17}, 'P': {'precision': 0.05555555555555555, 'recall': 0.041666666666666664, 'f1-score': 0.04761904761904762, 'support': 24}, 'micro avg': {'precision': 0.1, 'recall': 0.07317073170731707, 'f1-score': 0.08450704225352113, 'support': 41}, 'macro avg': {'precision': 0.1111111111111111, 'recall': 0.07965686274509803, 'f1-score': 0.09277504105090312, 'support': 41}, 'weighted avg': {'precision': 0.10162601626016259, 'recall': 0.07317073170731707, 'f1-score': 0.08506548119668388, 'support': 41}}
Token level accuracy: 0.712082262210797
Dev-Data: Prec: 0.100, Rec: 0.073, F1: 0.0845



{'C': {'precision': 0.13875, 'recall': 0.15373961218836565, 'f1-score': 0.14586070959264127, 'support': 722}, 'P': {'precision': 0.2260748959778086, 'recall': 0.173036093418259, 'f1-score': 0.19603126879134095, 'support': 942}, 'micro avg': {'precision': 0.18014464168310323, 'recall': 0.16466346153846154, 'f1-score': 0.1720565149136578, 'support': 1664}, 'macro avg': {'precision': 0.18241244798890432, 'recall': 0.16338785280331233, 'f1-score': 0.1709459891919911, 'support': 1664}, 'weighted avg': {'precision': 0.18818512741051424, 'recall': 0.16466346153846154, 'f1-score': 0.17426255260055898, 'support': 1664}}
Token level accuracy: 0.48382981916410295
Wrong BIO-Encoding 3497/4900 labels, 71.37%



{'C': {'precision': 0.13875, 'recall': 0.15373961218836565, 'f1-score': 0.14586070959264127, 'support': 722}, 'P': {'precision': 0.2260748959778086, 'recall': 0.173036093418259, 'f1-score': 0.19603126879134095, 'support': 942}, 'micro avg': {'precision': 0.18014464168310323, 'recall': 0.16466346153846154, 'f1-score': 0.1720565149136578, 'support': 1664}, 'macro avg': {'precision': 0.18241244798890432, 'recall': 0.16338785280331233, 'f1-score': 0.1709459891919911, 'support': 1664}, 'weighted avg': {'precision': 0.18818512741051424, 'recall': 0.16466346153846154, 'f1-score': 0.17426255260055898, 'support': 1664}}
Token level accuracy: 0.48382981916410295
Wrong BIO-Encoding 118/1521 labels, 7.76%
Test-Data: Prec: 0.195, Rec: 0.164, F1: 0.1780

Scores from epoch with best dev-scores:
  Dev-Score: 0.2000
  Test-Score 0.1177

8.86 sec for evaluation

--------- Epoch 9 -----------
230.99 sec for training (2084.96 total)
-- cmv_modes1 --



{'C': {'precision': 0.2, 'recall': 0.058823529411764705, 'f1-score': 0.0909090909090909, 'support': 17}, 'P': {'precision': 0.038461538461538464, 'recall': 0.041666666666666664, 'f1-score': 0.04, 'support': 24}, 'micro avg': {'precision': 0.06451612903225806, 'recall': 0.04878048780487805, 'f1-score': 0.05555555555555555, 'support': 41}, 'macro avg': {'precision': 0.11923076923076924, 'recall': 0.05024509803921569, 'f1-score': 0.06545454545454545, 'support': 41}, 'weighted avg': {'precision': 0.1054409005628518, 'recall': 0.04878048780487805, 'f1-score': 0.06110864745011085, 'support': 41}}
Token level accuracy: 0.7249357326478149



{'C': {'precision': 0.2, 'recall': 0.058823529411764705, 'f1-score': 0.0909090909090909, 'support': 17}, 'P': {'precision': 0.038461538461538464, 'recall': 0.041666666666666664, 'f1-score': 0.04, 'support': 24}, 'micro avg': {'precision': 0.06451612903225806, 'recall': 0.04878048780487805, 'f1-score': 0.05555555555555555, 'support': 41}, 'macro avg': {'precision': 0.11923076923076924, 'recall': 0.05024509803921569, 'f1-score': 0.06545454545454545, 'support': 41}, 'weighted avg': {'precision': 0.1054409005628518, 'recall': 0.04878048780487805, 'f1-score': 0.06110864745011085, 'support': 41}}
Token level accuracy: 0.7249357326478149
Dev-Data: Prec: 0.065, Rec: 0.049, F1: 0.0556



{'C': {'precision': 0.15367483296213807, 'recall': 0.09556786703601108, 'f1-score': 0.11784799316823227, 'support': 722}, 'P': {'precision': 0.21704658077304262, 'recall': 0.23248407643312102, 'f1-score': 0.22450025627883136, 'support': 942}, 'micro avg': {'precision': 0.19753086419753085, 'recall': 0.17307692307692307, 'f1-score': 0.18449711723254322, 'support': 1664}, 'macro avg': {'precision': 0.18536070686759035, 'recall': 0.16402597173456607, 'f1-score': 0.17117412472353183, 'support': 1664}, 'weighted avg': {'precision': 0.1895499450041285, 'recall': 0.17307692307692307, 'f1-score': 0.17822445461666037, 'support': 1664}}
Token level accuracy: 0.5170706085390561
Wrong BIO-Encoding 2598/3933 labels, 66.06%



{'C': {'precision': 0.15367483296213807, 'recall': 0.09556786703601108, 'f1-score': 0.11784799316823227, 'support': 722}, 'P': {'precision': 0.21704658077304262, 'recall': 0.23248407643312102, 'f1-score': 0.22450025627883136, 'support': 942}, 'micro avg': {'precision': 0.19753086419753085, 'recall': 0.17307692307692307, 'f1-score': 0.18449711723254322, 'support': 1664}, 'macro avg': {'precision': 0.18536070686759035, 'recall': 0.16402597173456607, 'f1-score': 0.17117412472353183, 'support': 1664}, 'weighted avg': {'precision': 0.1895499450041285, 'recall': 0.17307692307692307, 'f1-score': 0.17822445461666037, 'support': 1664}}
Token level accuracy: 0.5170706085390561
Wrong BIO-Encoding 123/1458 labels, 8.44%
Test-Data: Prec: 0.215, Rec: 0.172, F1: 0.1914

Scores from epoch with best dev-scores:
  Dev-Score: 0.2000
  Test-Score 0.1177

8.91 sec for evaluation

--------- Epoch 10 -----------
232.56 sec for training (2317.51 total)
-- cmv_modes1 --



{'C': {'precision': 0.26666666666666666, 'recall': 0.23529411764705882, 'f1-score': 0.25, 'support': 17}, 'P': {'precision': 0.17391304347826086, 'recall': 0.16666666666666666, 'f1-score': 0.1702127659574468, 'support': 24}, 'micro avg': {'precision': 0.21052631578947367, 'recall': 0.1951219512195122, 'f1-score': 0.20253164556962025, 'support': 41}, 'macro avg': {'precision': 0.22028985507246376, 'recall': 0.20098039215686275, 'f1-score': 0.21010638297872342, 'support': 41}, 'weighted avg': {'precision': 0.21237186284906326, 'recall': 0.1951219512195122, 'f1-score': 0.20329527763362737, 'support': 41}}
Token level accuracy: 0.7249357326478149



{'C': {'precision': 0.26666666666666666, 'recall': 0.23529411764705882, 'f1-score': 0.25, 'support': 17}, 'P': {'precision': 0.17391304347826086, 'recall': 0.16666666666666666, 'f1-score': 0.1702127659574468, 'support': 24}, 'micro avg': {'precision': 0.21052631578947367, 'recall': 0.1951219512195122, 'f1-score': 0.20253164556962025, 'support': 41}, 'macro avg': {'precision': 0.22028985507246376, 'recall': 0.20098039215686275, 'f1-score': 0.21010638297872342, 'support': 41}, 'weighted avg': {'precision': 0.21237186284906326, 'recall': 0.1951219512195122, 'f1-score': 0.20329527763362737, 'support': 41}}
Token level accuracy: 0.7249357326478149
Dev-Data: Prec: 0.211, Rec: 0.195, F1: 0.2025



{'C': {'precision': 0.1688622754491018, 'recall': 0.19529085872576177, 'f1-score': 0.1811175337186898, 'support': 722}, 'P': {'precision': 0.13917525773195877, 'recall': 0.14331210191082802, 'f1-score': 0.14121338912133888, 'support': 942}, 'micro avg': {'precision': 0.15290858725761772, 'recall': 0.1658653846153846, 'f1-score': 0.15912366676275583, 'support': 1664}, 'macro avg': {'precision': 0.15401876659053026, 'recall': 0.1693014803182949, 'f1-score': 0.16116546142001434, 'support': 1664}, 'weighted avg': {'precision': 0.15205628344817107, 'recall': 0.1658653846153846, 'f1-score': 0.1585275672459106, 'support': 1664}}
Token level accuracy: 0.5193466896775969
Wrong BIO-Encoding 1639/3358 labels, 48.81%



{'C': {'precision': 0.1688622754491018, 'recall': 0.19529085872576177, 'f1-score': 0.1811175337186898, 'support': 722}, 'P': {'precision': 0.13917525773195877, 'recall': 0.14331210191082802, 'f1-score': 0.14121338912133888, 'support': 942}, 'micro avg': {'precision': 0.15290858725761772, 'recall': 0.1658653846153846, 'f1-score': 0.15912366676275583, 'support': 1664}, 'macro avg': {'precision': 0.15401876659053026, 'recall': 0.1693014803182949, 'f1-score': 0.16116546142001434, 'support': 1664}, 'weighted avg': {'precision': 0.15205628344817107, 'recall': 0.1658653846153846, 'f1-score': 0.1585275672459106, 'support': 1664}}
Token level accuracy: 0.5193466896775969
Wrong BIO-Encoding 86/1805 labels, 4.76%
Test-Data: Prec: 0.160, Rec: 0.165, F1: 0.1626

Scores from epoch with best dev-scores:
  Dev-Score: 0.2025
  Test-Score 0.1626

9.00 sec for evaluation

--------- Epoch 11 -----------
233.09 sec for training (2550.61 total)
-- cmv_modes1 --



{'C': {'precision': 0.23076923076923078, 'recall': 0.17647058823529413, 'f1-score': 0.20000000000000004, 'support': 17}, 'P': {'precision': 0.25, 'recall': 0.25, 'f1-score': 0.25, 'support': 24}, 'micro avg': {'precision': 0.24324324324324326, 'recall': 0.21951219512195122, 'f1-score': 0.23076923076923075, 'support': 41}, 'macro avg': {'precision': 0.2403846153846154, 'recall': 0.21323529411764708, 'f1-score': 0.22500000000000003, 'support': 41}, 'weighted avg': {'precision': 0.24202626641651032, 'recall': 0.21951219512195122, 'f1-score': 0.22926829268292684, 'support': 41}}
Token level accuracy: 0.7982005141388174
Wrong BIO-Encoding 19/55 labels, 34.55%



{'C': {'precision': 0.23076923076923078, 'recall': 0.17647058823529413, 'f1-score': 0.20000000000000004, 'support': 17}, 'P': {'precision': 0.25, 'recall': 0.25, 'f1-score': 0.25, 'support': 24}, 'micro avg': {'precision': 0.24324324324324326, 'recall': 0.21951219512195122, 'f1-score': 0.23076923076923075, 'support': 41}, 'macro avg': {'precision': 0.2403846153846154, 'recall': 0.21323529411764708, 'f1-score': 0.22500000000000003, 'support': 41}, 'weighted avg': {'precision': 0.24202626641651032, 'recall': 0.21951219512195122, 'f1-score': 0.22926829268292684, 'support': 41}}
Token level accuracy: 0.7982005141388174
Wrong BIO-Encoding 1/37 labels, 2.70%
Dev-Data: Prec: 0.250, Rec: 0.220, F1: 0.2338



{'C': {'precision': 0.19575113808801214, 'recall': 0.1786703601108033, 'f1-score': 0.18682114409847936, 'support': 722}, 'P': {'precision': 0.14794215795328142, 'recall': 0.14118895966029724, 'f1-score': 0.1444866920152091, 'support': 942}, 'micro avg': {'precision': 0.1681643132220796, 'recall': 0.15745192307692307, 'f1-score': 0.16263190564866542, 'support': 1664}, 'macro avg': {'precision': 0.17184664802064678, 'recall': 0.15992965988555027, 'f1-score': 0.16565391805684423, 'support': 1664}, 'weighted avg': {'precision': 0.16868619861270184, 'recall': 0.15745192307692307, 'f1-score': 0.1628553665369165, 'support': 1664}}
Token level accuracy: 0.5249493509416973
Wrong BIO-Encoding 1850/3311 labels, 55.87%



{'C': {'precision': 0.19575113808801214, 'recall': 0.1786703601108033, 'f1-score': 0.18682114409847936, 'support': 722}, 'P': {'precision': 0.14794215795328142, 'recall': 0.14118895966029724, 'f1-score': 0.1444866920152091, 'support': 942}, 'micro avg': {'precision': 0.1681643132220796, 'recall': 0.15745192307692307, 'f1-score': 0.16263190564866542, 'support': 1664}, 'macro avg': {'precision': 0.17184664802064678, 'recall': 0.15992965988555027, 'f1-score': 0.16565391805684423, 'support': 1664}, 'weighted avg': {'precision': 0.16868619861270184, 'recall': 0.15745192307692307, 'f1-score': 0.1628553665369165, 'support': 1664}}
Token level accuracy: 0.5249493509416973
Wrong BIO-Encoding 97/1558 labels, 6.23%
Test-Data: Prec: 0.179, Rec: 0.157, F1: 0.1677

Scores from epoch with best dev-scores:
  Dev-Score: 0.2338
  Test-Score 0.1677

9.10 sec for evaluation

--------- Epoch 12 -----------
232.56 sec for training (2783.16 total)
-- cmv_modes1 --



{'C': {'precision': 0.23076923076923078, 'recall': 0.17647058823529413, 'f1-score': 0.20000000000000004, 'support': 17}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 24}, 'micro avg': {'precision': 0.09375, 'recall': 0.07317073170731707, 'f1-score': 0.08219178082191779, 'support': 41}, 'macro avg': {'precision': 0.11538461538461539, 'recall': 0.08823529411764706, 'f1-score': 0.10000000000000002, 'support': 41}, 'weighted avg': {'precision': 0.09568480300187618, 'recall': 0.07317073170731707, 'f1-score': 0.0829268292682927, 'support': 41}}
Token level accuracy: 0.7570694087403599



{'C': {'precision': 0.23076923076923078, 'recall': 0.17647058823529413, 'f1-score': 0.20000000000000004, 'support': 17}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 24}, 'micro avg': {'precision': 0.09375, 'recall': 0.07317073170731707, 'f1-score': 0.08219178082191779, 'support': 41}, 'macro avg': {'precision': 0.11538461538461539, 'recall': 0.08823529411764706, 'f1-score': 0.10000000000000002, 'support': 41}, 'weighted avg': {'precision': 0.09568480300187618, 'recall': 0.07317073170731707, 'f1-score': 0.0829268292682927, 'support': 41}}
Token level accuracy: 0.7570694087403599
Dev-Data: Prec: 0.094, Rec: 0.073, F1: 0.0822



{'C': {'precision': 0.15501905972045743, 'recall': 0.16897506925207756, 'f1-score': 0.1616964877402253, 'support': 722}, 'P': {'precision': 0.24856156501726123, 'recall': 0.22929936305732485, 'f1-score': 0.23854224185532855, 'support': 942}, 'micro avg': {'precision': 0.2041062801932367, 'recall': 0.203125, 'f1-score': 0.20361445783132529, 'support': 1664}, 'macro avg': {'precision': 0.20179031236885933, 'recall': 0.1991372161547012, 'f1-score': 0.20011936479777692, 'support': 1664}, 'weighted avg': {'precision': 0.20797401163727786, 'recall': 0.203125, 'f1-score': 0.20519931248567438, 'support': 1664}}
Token level accuracy: 0.49853680498236663
Wrong BIO-Encoding 2045/3610 labels, 56.65%



{'C': {'precision': 0.15501905972045743, 'recall': 0.16897506925207756, 'f1-score': 0.1616964877402253, 'support': 722}, 'P': {'precision': 0.24856156501726123, 'recall': 0.22929936305732485, 'f1-score': 0.23854224185532855, 'support': 942}, 'micro avg': {'precision': 0.2041062801932367, 'recall': 0.203125, 'f1-score': 0.20361445783132529, 'support': 1664}, 'macro avg': {'precision': 0.20179031236885933, 'recall': 0.1991372161547012, 'f1-score': 0.20011936479777692, 'support': 1664}, 'weighted avg': {'precision': 0.20797401163727786, 'recall': 0.203125, 'f1-score': 0.20519931248567438, 'support': 1664}}
Token level accuracy: 0.49853680498236663
Wrong BIO-Encoding 91/1656 labels, 5.50%
Test-Data: Prec: 0.216, Rec: 0.203, F1: 0.2094

Scores from epoch with best dev-scores:
  Dev-Score: 0.2338
  Test-Score 0.1677

9.11 sec for evaluation

--------- Epoch 13 -----------
231.75 sec for training (3014.91 total)
-- cmv_modes1 --



{'C': {'precision': 0.2, 'recall': 0.17647058823529413, 'f1-score': 0.18750000000000003, 'support': 17}, 'P': {'precision': 0.2608695652173913, 'recall': 0.25, 'f1-score': 0.2553191489361702, 'support': 24}, 'micro avg': {'precision': 0.23684210526315788, 'recall': 0.21951219512195122, 'f1-score': 0.2278481012658228, 'support': 41}, 'macro avg': {'precision': 0.23043478260869565, 'recall': 0.21323529411764708, 'f1-score': 0.22140957446808512, 'support': 41}, 'weighted avg': {'precision': 0.23563096500530223, 'recall': 0.21951219512195122, 'f1-score': 0.2271990140114167, 'support': 41}}
Token level accuracy: 0.7763496143958869
Wrong BIO-Encoding 35/71 labels, 49.30%



{'C': {'precision': 0.2, 'recall': 0.17647058823529413, 'f1-score': 0.18750000000000003, 'support': 17}, 'P': {'precision': 0.2608695652173913, 'recall': 0.25, 'f1-score': 0.2553191489361702, 'support': 24}, 'micro avg': {'precision': 0.23684210526315788, 'recall': 0.21951219512195122, 'f1-score': 0.2278481012658228, 'support': 41}, 'macro avg': {'precision': 0.23043478260869565, 'recall': 0.21323529411764708, 'f1-score': 0.22140957446808512, 'support': 41}, 'weighted avg': {'precision': 0.23563096500530223, 'recall': 0.21951219512195122, 'f1-score': 0.2271990140114167, 'support': 41}}
Token level accuracy: 0.7763496143958869
Wrong BIO-Encoding 2/38 labels, 5.26%
Dev-Data: Prec: 0.250, Rec: 0.220, F1: 0.2338



{'C': {'precision': 0.19852941176470587, 'recall': 0.18698060941828254, 'f1-score': 0.1925820256776034, 'support': 722}, 'P': {'precision': 0.14285714285714285, 'recall': 0.17197452229299362, 'f1-score': 0.1560693641618497, 'support': 942}, 'micro avg': {'precision': 0.1637265711135612, 'recall': 0.17848557692307693, 'f1-score': 0.17078780908568142, 'support': 1664}, 'macro avg': {'precision': 0.17069327731092437, 'recall': 0.17947756585563807, 'f1-score': 0.17432569491972655, 'support': 1664}, 'weighted avg': {'precision': 0.1670130191499677, 'recall': 0.17848557692307693, 'f1-score': 0.17191199734356494, 'support': 1664}}
Token level accuracy: 0.5382556714439358
Wrong BIO-Encoding 1075/2827 labels, 38.03%



{'C': {'precision': 0.19852941176470587, 'recall': 0.18698060941828254, 'f1-score': 0.1925820256776034, 'support': 722}, 'P': {'precision': 0.14285714285714285, 'recall': 0.17197452229299362, 'f1-score': 0.1560693641618497, 'support': 942}, 'micro avg': {'precision': 0.1637265711135612, 'recall': 0.17848557692307693, 'f1-score': 0.17078780908568142, 'support': 1664}, 'macro avg': {'precision': 0.17069327731092437, 'recall': 0.17947756585563807, 'f1-score': 0.17432569491972655, 'support': 1664}, 'weighted avg': {'precision': 0.1670130191499677, 'recall': 0.17848557692307693, 'f1-score': 0.17191199734356494, 'support': 1664}}
Token level accuracy: 0.5382556714439358
Wrong BIO-Encoding 62/1814 labels, 3.42%
Test-Data: Prec: 0.170, Rec: 0.178, F1: 0.1739

Scores from epoch with best dev-scores:
  Dev-Score: 0.2338
  Test-Score 0.1677

8.90 sec for evaluation

--------- Epoch 14 -----------
230.65 sec for training (3245.56 total)
-- cmv_modes1 --



{'C': {'precision': 0.3888888888888889, 'recall': 0.4117647058823529, 'f1-score': 0.39999999999999997, 'support': 17}, 'P': {'precision': 0.4090909090909091, 'recall': 0.375, 'f1-score': 0.3913043478260869, 'support': 24}, 'micro avg': {'precision': 0.4, 'recall': 0.3902439024390244, 'f1-score': 0.39506172839506176, 'support': 41}, 'macro avg': {'precision': 0.398989898989899, 'recall': 0.39338235294117646, 'f1-score': 0.3956521739130434, 'support': 41}, 'weighted avg': {'precision': 0.40071446169007147, 'recall': 0.3902439024390244, 'f1-score': 0.39490986214209967, 'support': 41}}
Token level accuracy: 0.8033419023136247



{'C': {'precision': 0.3888888888888889, 'recall': 0.4117647058823529, 'f1-score': 0.39999999999999997, 'support': 17}, 'P': {'precision': 0.4090909090909091, 'recall': 0.375, 'f1-score': 0.3913043478260869, 'support': 24}, 'micro avg': {'precision': 0.4, 'recall': 0.3902439024390244, 'f1-score': 0.39506172839506176, 'support': 41}, 'macro avg': {'precision': 0.398989898989899, 'recall': 0.39338235294117646, 'f1-score': 0.3956521739130434, 'support': 41}, 'weighted avg': {'precision': 0.40071446169007147, 'recall': 0.3902439024390244, 'f1-score': 0.39490986214209967, 'support': 41}}
Token level accuracy: 0.8033419023136247
Dev-Data: Prec: 0.400, Rec: 0.390, F1: 0.3951



{'C': {'precision': 0.14818880351262348, 'recall': 0.18698060941828254, 'f1-score': 0.1653398652786283, 'support': 722}, 'P': {'precision': 0.15384615384615385, 'recall': 0.15711252653927812, 'f1-score': 0.1554621848739496, 'support': 942}, 'micro avg': {'precision': 0.15109450080085424, 'recall': 0.1700721153846154, 'f1-score': 0.16002261803788523, 'support': 1664}, 'macro avg': {'precision': 0.15101747867938867, 'recall': 0.17204656797878032, 'f1-score': 0.16040102507628895, 'support': 1664}, 'weighted avg': {'precision': 0.15139146217499466, 'recall': 0.1700721153846154, 'f1-score': 0.15974805341492196, 'support': 1664}}
Token level accuracy: 0.5260998974512894
Wrong BIO-Encoding 976/2792 labels, 34.96%



{'C': {'precision': 0.14818880351262348, 'recall': 0.18698060941828254, 'f1-score': 0.1653398652786283, 'support': 722}, 'P': {'precision': 0.15384615384615385, 'recall': 0.15711252653927812, 'f1-score': 0.1554621848739496, 'support': 942}, 'micro avg': {'precision': 0.15109450080085424, 'recall': 0.1700721153846154, 'f1-score': 0.16002261803788523, 'support': 1664}, 'macro avg': {'precision': 0.15101747867938867, 'recall': 0.17204656797878032, 'f1-score': 0.16040102507628895, 'support': 1664}, 'weighted avg': {'precision': 0.15139146217499466, 'recall': 0.1700721153846154, 'f1-score': 0.15974805341492196, 'support': 1664}}
Token level accuracy: 0.5260998974512894
Wrong BIO-Encoding 57/1873 labels, 3.04%
Test-Data: Prec: 0.156, Rec: 0.170, F1: 0.1626

Scores from epoch with best dev-scores:
  Dev-Score: 0.3951
  Test-Score 0.1626

8.85 sec for evaluation

--------- Epoch 15 -----------
228.15 sec for training (3473.70 total)
-- cmv_modes1 --



{'C': {'precision': 0.23076923076923078, 'recall': 0.17647058823529413, 'f1-score': 0.20000000000000004, 'support': 17}, 'P': {'precision': 0.1, 'recall': 0.08333333333333333, 'f1-score': 0.0909090909090909, 'support': 24}, 'micro avg': {'precision': 0.15151515151515152, 'recall': 0.12195121951219512, 'f1-score': 0.13513513513513514, 'support': 41}, 'macro avg': {'precision': 0.1653846153846154, 'recall': 0.12990196078431374, 'f1-score': 0.14545454545454548, 'support': 41}, 'weighted avg': {'precision': 0.15422138836772983, 'recall': 0.12195121951219512, 'f1-score': 0.1361419068736142, 'support': 41}}
Token level accuracy: 0.7982005141388174



{'C': {'precision': 0.23076923076923078, 'recall': 0.17647058823529413, 'f1-score': 0.20000000000000004, 'support': 17}, 'P': {'precision': 0.1, 'recall': 0.08333333333333333, 'f1-score': 0.0909090909090909, 'support': 24}, 'micro avg': {'precision': 0.15151515151515152, 'recall': 0.12195121951219512, 'f1-score': 0.13513513513513514, 'support': 41}, 'macro avg': {'precision': 0.1653846153846154, 'recall': 0.12990196078431374, 'f1-score': 0.14545454545454548, 'support': 41}, 'weighted avg': {'precision': 0.15422138836772983, 'recall': 0.12195121951219512, 'f1-score': 0.1361419068736142, 'support': 41}}
Token level accuracy: 0.7982005141388174
Dev-Data: Prec: 0.152, Rec: 0.122, F1: 0.1351



{'C': {'precision': 0.16196136701337296, 'recall': 0.15096952908587258, 'f1-score': 0.15627240143369178, 'support': 722}, 'P': {'precision': 0.18243243243243243, 'recall': 0.20063694267515925, 'f1-score': 0.19110212335692622, 'support': 942}, 'micro avg': {'precision': 0.1743709771796372, 'recall': 0.17908653846153846, 'f1-score': 0.17669730210495108, 'support': 1664}, 'macro avg': {'precision': 0.1721968997229027, 'recall': 0.1758032358805159, 'f1-score': 0.17368726239530902, 'support': 1664}, 'weighted avg': {'precision': 0.17355015524940304, 'recall': 0.17908653846153846, 'f1-score': 0.17598970795513819, 'support': 1664}}
Token level accuracy: 0.5184712738550812
Wrong BIO-Encoding 1268/2895 labels, 43.80%



{'C': {'precision': 0.16196136701337296, 'recall': 0.15096952908587258, 'f1-score': 0.15627240143369178, 'support': 722}, 'P': {'precision': 0.18243243243243243, 'recall': 0.20063694267515925, 'f1-score': 0.19110212335692622, 'support': 942}, 'micro avg': {'precision': 0.1743709771796372, 'recall': 0.17908653846153846, 'f1-score': 0.17669730210495108, 'support': 1664}, 'macro avg': {'precision': 0.1721968997229027, 'recall': 0.1758032358805159, 'f1-score': 0.17368726239530902, 'support': 1664}, 'weighted avg': {'precision': 0.17355015524940304, 'recall': 0.17908653846153846, 'f1-score': 0.17598970795513819, 'support': 1664}}
Token level accuracy: 0.5184712738550812
Wrong BIO-Encoding 82/1709 labels, 4.80%
Test-Data: Prec: 0.183, Rec: 0.179, F1: 0.1811

Scores from epoch with best dev-scores:
  Dev-Score: 0.3951
  Test-Score 0.1626

8.84 sec for evaluation

--------- Epoch 16 -----------
228.34 sec for training (3702.05 total)
-- cmv_modes1 --



{'C': {'precision': 0.5, 'recall': 0.47058823529411764, 'f1-score': 0.48484848484848486, 'support': 17}, 'P': {'precision': 0.12, 'recall': 0.125, 'f1-score': 0.12244897959183673, 'support': 24}, 'micro avg': {'precision': 0.2682926829268293, 'recall': 0.2682926829268293, 'f1-score': 0.2682926829268293, 'support': 41}, 'macro avg': {'precision': 0.31, 'recall': 0.2977941176470588, 'f1-score': 0.3036487322201608, 'support': 41}, 'weighted avg': {'precision': 0.27756097560975607, 'recall': 0.2682926829268293, 'f1-score': 0.2727121890884957, 'support': 41}}
Token level accuracy: 0.7892030848329049
Wrong BIO-Encoding 12/52 labels, 23.08%



{'C': {'precision': 0.5, 'recall': 0.47058823529411764, 'f1-score': 0.48484848484848486, 'support': 17}, 'P': {'precision': 0.12, 'recall': 0.125, 'f1-score': 0.12244897959183673, 'support': 24}, 'micro avg': {'precision': 0.2682926829268293, 'recall': 0.2682926829268293, 'f1-score': 0.2682926829268293, 'support': 41}, 'macro avg': {'precision': 0.31, 'recall': 0.2977941176470588, 'f1-score': 0.3036487322201608, 'support': 41}, 'weighted avg': {'precision': 0.27756097560975607, 'recall': 0.2682926829268293, 'f1-score': 0.2727121890884957, 'support': 41}}
Token level accuracy: 0.7892030848329049
Wrong BIO-Encoding 1/41 labels, 2.44%
Dev-Data: Prec: 0.275, Rec: 0.268, F1: 0.2716



{'C': {'precision': 0.18169398907103826, 'recall': 0.18421052631578946, 'f1-score': 0.18294360385144431, 'support': 722}, 'P': {'precision': 0.16019417475728157, 'recall': 0.1751592356687898, 'f1-score': 0.16734279918864098, 'support': 942}, 'micro avg': {'precision': 0.16912599318955732, 'recall': 0.17908653846153846, 'f1-score': 0.1739638061879743, 'support': 1664}, 'macro avg': {'precision': 0.1709440819141599, 'recall': 0.17968488099228963, 'f1-score': 0.17514320152004265, 'support': 1664}, 'weighted avg': {'precision': 0.1695228201506303, 'recall': 0.17908653846153846, 'f1-score': 0.17411189832718904, 'support': 1664}}
Token level accuracy: 0.5320777369250393
Wrong BIO-Encoding 862/2583 labels, 33.37%



{'C': {'precision': 0.18169398907103826, 'recall': 0.18421052631578946, 'f1-score': 0.18294360385144431, 'support': 722}, 'P': {'precision': 0.16019417475728157, 'recall': 0.1751592356687898, 'f1-score': 0.16734279918864098, 'support': 942}, 'micro avg': {'precision': 0.16912599318955732, 'recall': 0.17908653846153846, 'f1-score': 0.1739638061879743, 'support': 1664}, 'macro avg': {'precision': 0.1709440819141599, 'recall': 0.17968488099228963, 'f1-score': 0.17514320152004265, 'support': 1664}, 'weighted avg': {'precision': 0.1695228201506303, 'recall': 0.17908653846153846, 'f1-score': 0.17411189832718904, 'support': 1664}}
Token level accuracy: 0.5320777369250393
Wrong BIO-Encoding 41/1762 labels, 2.33%
Test-Data: Prec: 0.173, Rec: 0.179, F1: 0.1761

Scores from epoch with best dev-scores:
  Dev-Score: 0.3951
  Test-Score 0.1626

8.83 sec for evaluation

--------- Epoch 17 -----------
229.93 sec for training (3931.98 total)
-- cmv_modes1 --



{'C': {'precision': 0.38095238095238093, 'recall': 0.47058823529411764, 'f1-score': 0.42105263157894735, 'support': 17}, 'P': {'precision': 0.6111111111111112, 'recall': 0.4583333333333333, 'f1-score': 0.5238095238095238, 'support': 24}, 'micro avg': {'precision': 0.48717948717948717, 'recall': 0.4634146341463415, 'f1-score': 0.47500000000000003, 'support': 41}, 'macro avg': {'precision': 0.49603174603174605, 'recall': 0.4644607843137255, 'f1-score': 0.4724310776942356, 'support': 41}, 'weighted avg': {'precision': 0.5156794425087109, 'recall': 0.4634146341463415, 'f1-score': 0.4812030075187971, 'support': 41}}
Token level accuracy: 0.8329048843187661
Wrong BIO-Encoding 21/59 labels, 35.59%



{'C': {'precision': 0.38095238095238093, 'recall': 0.47058823529411764, 'f1-score': 0.42105263157894735, 'support': 17}, 'P': {'precision': 0.6111111111111112, 'recall': 0.4583333333333333, 'f1-score': 0.5238095238095238, 'support': 24}, 'micro avg': {'precision': 0.48717948717948717, 'recall': 0.4634146341463415, 'f1-score': 0.47500000000000003, 'support': 41}, 'macro avg': {'precision': 0.49603174603174605, 'recall': 0.4644607843137255, 'f1-score': 0.4724310776942356, 'support': 41}, 'weighted avg': {'precision': 0.5156794425087109, 'recall': 0.4634146341463415, 'f1-score': 0.4812030075187971, 'support': 41}}
Token level accuracy: 0.8329048843187661
Wrong BIO-Encoding 1/39 labels, 2.56%
Dev-Data: Prec: 0.500, Rec: 0.463, F1: 0.4810



{'C': {'precision': 0.14796425024826215, 'recall': 0.20637119113573407, 'f1-score': 0.17235396182764606, 'support': 722}, 'P': {'precision': 0.1104368932038835, 'recall': 0.09660297239915075, 'f1-score': 0.10305775764439411, 'support': 942}, 'micro avg': {'precision': 0.1310759148006554, 'recall': 0.14423076923076922, 'f1-score': 0.13733905579399142, 'support': 1664}, 'macro avg': {'precision': 0.12920057172607283, 'recall': 0.1514870817674424, 'f1-score': 0.1377058597360201, 'support': 1664}, 'weighted avg': {'precision': 0.12671979692145643, 'recall': 0.14423076923076922, 'f1-score': 0.13312498085371377, 'support': 1664}}
Token level accuracy: 0.5042645256496836
Wrong BIO-Encoding 1174/2949 labels, 39.81%



{'C': {'precision': 0.14796425024826215, 'recall': 0.20637119113573407, 'f1-score': 0.17235396182764606, 'support': 722}, 'P': {'precision': 0.1104368932038835, 'recall': 0.09660297239915075, 'f1-score': 0.10305775764439411, 'support': 942}, 'micro avg': {'precision': 0.1310759148006554, 'recall': 0.14423076923076922, 'f1-score': 0.13733905579399142, 'support': 1664}, 'macro avg': {'precision': 0.12920057172607283, 'recall': 0.1514870817674424, 'f1-score': 0.1377058597360201, 'support': 1664}, 'weighted avg': {'precision': 0.12671979692145643, 'recall': 0.14423076923076922, 'f1-score': 0.13312498085371377, 'support': 1664}}
Token level accuracy: 0.5042645256496836
Wrong BIO-Encoding 56/1831 labels, 3.06%
Test-Data: Prec: 0.135, Rec: 0.144, F1: 0.1396

Scores from epoch with best dev-scores:
  Dev-Score: 0.4810
  Test-Score 0.1396

8.90 sec for evaluation

--------- Epoch 18 -----------
228.46 sec for training (4160.44 total)
-- cmv_modes1 --



{'C': {'precision': 0.3684210526315789, 'recall': 0.4117647058823529, 'f1-score': 0.3888888888888889, 'support': 17}, 'P': {'precision': 0.48148148148148145, 'recall': 0.5416666666666666, 'f1-score': 0.5098039215686274, 'support': 24}, 'micro avg': {'precision': 0.43478260869565216, 'recall': 0.4878048780487805, 'f1-score': 0.45977011494252873, 'support': 41}, 'macro avg': {'precision': 0.4249512670565302, 'recall': 0.4767156862745098, 'f1-score': 0.44934640522875813, 'support': 41}, 'weighted avg': {'precision': 0.4346027670803023, 'recall': 0.4878048780487805, 'f1-score': 0.45966842021361387, 'support': 41}}
Token level accuracy: 0.8457583547557841
Wrong BIO-Encoding 24/69 labels, 34.78%



{'C': {'precision': 0.3684210526315789, 'recall': 0.4117647058823529, 'f1-score': 0.3888888888888889, 'support': 17}, 'P': {'precision': 0.48148148148148145, 'recall': 0.5416666666666666, 'f1-score': 0.5098039215686274, 'support': 24}, 'micro avg': {'precision': 0.43478260869565216, 'recall': 0.4878048780487805, 'f1-score': 0.45977011494252873, 'support': 41}, 'macro avg': {'precision': 0.4249512670565302, 'recall': 0.4767156862745098, 'f1-score': 0.44934640522875813, 'support': 41}, 'weighted avg': {'precision': 0.4346027670803023, 'recall': 0.4878048780487805, 'f1-score': 0.45966842021361387, 'support': 41}}
Token level accuracy: 0.8457583547557841
Wrong BIO-Encoding 1/46 labels, 2.17%
Dev-Data: Prec: 0.444, Rec: 0.488, F1: 0.4651



{'C': {'precision': 0.16105263157894736, 'recall': 0.21191135734072022, 'f1-score': 0.18301435406698566, 'support': 722}, 'P': {'precision': 0.15398886827458255, 'recall': 0.1762208067940552, 'f1-score': 0.16435643564356434, 'support': 942}, 'micro avg': {'precision': 0.15729783037475345, 'recall': 0.19170673076923078, 'f1-score': 0.17280606717226435, 'support': 1664}, 'macro avg': {'precision': 0.15752074992676496, 'recall': 0.1940660820673877, 'f1-score': 0.173685394855275, 'support': 1664}, 'weighted avg': {'precision': 0.15705379441986583, 'recall': 0.19170673076923078, 'f1-score': 0.17245199880564976, 'support': 1664}}
Token level accuracy: 0.5113178759910958
Wrong BIO-Encoding 605/2599 labels, 23.28%



{'C': {'precision': 0.16105263157894736, 'recall': 0.21191135734072022, 'f1-score': 0.18301435406698566, 'support': 722}, 'P': {'precision': 0.15398886827458255, 'recall': 0.1762208067940552, 'f1-score': 0.16435643564356434, 'support': 942}, 'micro avg': {'precision': 0.15729783037475345, 'recall': 0.19170673076923078, 'f1-score': 0.17280606717226435, 'support': 1664}, 'macro avg': {'precision': 0.15752074992676496, 'recall': 0.1940660820673877, 'f1-score': 0.173685394855275, 'support': 1664}, 'weighted avg': {'precision': 0.15705379441986583, 'recall': 0.19170673076923078, 'f1-score': 0.17245199880564976, 'support': 1664}}
Token level accuracy: 0.5113178759910958
Wrong BIO-Encoding 34/2028 labels, 1.68%
Test-Data: Prec: 0.160, Rec: 0.192, F1: 0.1744

Scores from epoch with best dev-scores:
  Dev-Score: 0.4810
  Test-Score 0.1396

8.89 sec for evaluation

--------- Epoch 19 -----------
229.17 sec for training (4389.62 total)
-- cmv_modes1 --



{'C': {'precision': 0.4, 'recall': 0.47058823529411764, 'f1-score': 0.4324324324324324, 'support': 17}, 'P': {'precision': 0.45, 'recall': 0.375, 'f1-score': 0.4090909090909091, 'support': 24}, 'micro avg': {'precision': 0.425, 'recall': 0.4146341463414634, 'f1-score': 0.41975308641975306, 'support': 41}, 'macro avg': {'precision': 0.42500000000000004, 'recall': 0.4227941176470588, 'f1-score': 0.42076167076167076, 'support': 41}, 'weighted avg': {'precision': 0.4292682926829269, 'recall': 0.4146341463414634, 'f1-score': 0.4187691016959309, 'support': 41}}
Token level accuracy: 0.8470437017994858
Wrong BIO-Encoding 34/73 labels, 46.58%



{'C': {'precision': 0.4, 'recall': 0.47058823529411764, 'f1-score': 0.4324324324324324, 'support': 17}, 'P': {'precision': 0.45, 'recall': 0.375, 'f1-score': 0.4090909090909091, 'support': 24}, 'micro avg': {'precision': 0.425, 'recall': 0.4146341463414634, 'f1-score': 0.41975308641975306, 'support': 41}, 'macro avg': {'precision': 0.42500000000000004, 'recall': 0.4227941176470588, 'f1-score': 0.42076167076167076, 'support': 41}, 'weighted avg': {'precision': 0.4292682926829269, 'recall': 0.4146341463414634, 'f1-score': 0.4187691016959309, 'support': 41}}
Token level accuracy: 0.8470437017994858
Wrong BIO-Encoding 1/40 labels, 2.50%
Dev-Data: Prec: 0.436, Rec: 0.415, F1: 0.4250



{'C': {'precision': 0.15256008359456635, 'recall': 0.20221606648199447, 'f1-score': 0.17391304347826086, 'support': 722}, 'P': {'precision': 0.13738441215323646, 'recall': 0.11040339702760085, 'f1-score': 0.12242495585638612, 'support': 942}, 'micro avg': {'precision': 0.14585764294049008, 'recall': 0.1502403846153846, 'f1-score': 0.14801657785671998, 'support': 1664}, 'macro avg': {'precision': 0.1449722478739014, 'recall': 0.15630973175479768, 'f1-score': 0.1481689996673235, 'support': 1664}, 'weighted avg': {'precision': 0.1439690484396789, 'recall': 0.1502403846153846, 'f1-score': 0.1447653400288582, 'support': 1664}}
Token level accuracy: 0.5196718441259598
Wrong BIO-Encoding 1244/2881 labels, 43.18%



{'C': {'precision': 0.15256008359456635, 'recall': 0.20221606648199447, 'f1-score': 0.17391304347826086, 'support': 722}, 'P': {'precision': 0.13738441215323646, 'recall': 0.11040339702760085, 'f1-score': 0.12242495585638612, 'support': 942}, 'micro avg': {'precision': 0.14585764294049008, 'recall': 0.1502403846153846, 'f1-score': 0.14801657785671998, 'support': 1664}, 'macro avg': {'precision': 0.1449722478739014, 'recall': 0.15630973175479768, 'f1-score': 0.1481689996673235, 'support': 1664}, 'weighted avg': {'precision': 0.1439690484396789, 'recall': 0.1502403846153846, 'f1-score': 0.1447653400288582, 'support': 1664}}
Token level accuracy: 0.5196718441259598
Wrong BIO-Encoding 77/1714 labels, 4.49%
Test-Data: Prec: 0.153, Rec: 0.150, F1: 0.1515

Scores from epoch with best dev-scores:
  Dev-Score: 0.4810
  Test-Score 0.1396

8.86 sec for evaluation

--------- Epoch 20 -----------
232.37 sec for training (4621.99 total)
-- cmv_modes1 --



{'C': {'precision': 0.6, 'recall': 0.5294117647058824, 'f1-score': 0.5625, 'support': 17}, 'P': {'precision': 0.46153846153846156, 'recall': 0.5, 'f1-score': 0.48000000000000004, 'support': 24}, 'micro avg': {'precision': 0.5121951219512195, 'recall': 0.5121951219512195, 'f1-score': 0.5121951219512195, 'support': 41}, 'macro avg': {'precision': 0.5307692307692308, 'recall': 0.5147058823529411, 'f1-score': 0.52125, 'support': 41}, 'weighted avg': {'precision': 0.5189493433395872, 'recall': 0.5121951219512195, 'f1-score': 0.5142073170731708, 'support': 41}}
Token level accuracy: 0.8457583547557841



{'C': {'precision': 0.6, 'recall': 0.5294117647058824, 'f1-score': 0.5625, 'support': 17}, 'P': {'precision': 0.46153846153846156, 'recall': 0.5, 'f1-score': 0.48000000000000004, 'support': 24}, 'micro avg': {'precision': 0.5121951219512195, 'recall': 0.5121951219512195, 'f1-score': 0.5121951219512195, 'support': 41}, 'macro avg': {'precision': 0.5307692307692308, 'recall': 0.5147058823529411, 'f1-score': 0.52125, 'support': 41}, 'weighted avg': {'precision': 0.5189493433395872, 'recall': 0.5121951219512195, 'f1-score': 0.5142073170731708, 'support': 41}}
Token level accuracy: 0.8457583547557841
Dev-Data: Prec: 0.512, Rec: 0.512, F1: 0.5122



{'C': {'precision': 0.19462025316455697, 'recall': 0.1703601108033241, 'f1-score': 0.18168389955686853, 'support': 722}, 'P': {'precision': 0.1522748375116063, 'recall': 0.1740976645435244, 'f1-score': 0.16245666171371967, 'support': 942}, 'micro avg': {'precision': 0.1679344645991808, 'recall': 0.17247596153846154, 'f1-score': 0.17017491847020455, 'support': 1664}, 'macro avg': {'precision': 0.17344754533808165, 'recall': 0.17222888767342426, 'f1-score': 0.17207028063529411, 'support': 1664}, 'weighted avg': {'precision': 0.17064826906294667, 'recall': 0.17247596153846154, 'f1-score': 0.17079924928748977, 'support': 1664}}
Token level accuracy: 0.5271253845576649
Wrong BIO-Encoding 1182/2808 labels, 42.09%



{'C': {'precision': 0.19462025316455697, 'recall': 0.1703601108033241, 'f1-score': 0.18168389955686853, 'support': 722}, 'P': {'precision': 0.1522748375116063, 'recall': 0.1740976645435244, 'f1-score': 0.16245666171371967, 'support': 942}, 'micro avg': {'precision': 0.1679344645991808, 'recall': 0.17247596153846154, 'f1-score': 0.17017491847020455, 'support': 1664}, 'macro avg': {'precision': 0.17344754533808165, 'recall': 0.17222888767342426, 'f1-score': 0.17207028063529411, 'support': 1664}, 'weighted avg': {'precision': 0.17064826906294667, 'recall': 0.17247596153846154, 'f1-score': 0.17079924928748977, 'support': 1664}}
Token level accuracy: 0.5271253845576649
Wrong BIO-Encoding 83/1709 labels, 4.86%
Test-Data: Prec: 0.177, Rec: 0.172, F1: 0.1745

Scores from epoch with best dev-scores:
  Dev-Score: 0.5122
  Test-Score 0.1745

9.51 sec for evaluation

--------- Epoch 21 -----------
233.98 sec for training (4855.96 total)
-- cmv_modes1 --



{'C': {'precision': 0.5555555555555556, 'recall': 0.5882352941176471, 'f1-score': 0.5714285714285715, 'support': 17}, 'P': {'precision': 0.5238095238095238, 'recall': 0.4583333333333333, 'f1-score': 0.4888888888888889, 'support': 24}, 'micro avg': {'precision': 0.5384615384615384, 'recall': 0.5121951219512195, 'f1-score': 0.525, 'support': 41}, 'macro avg': {'precision': 0.5396825396825398, 'recall': 0.5232843137254902, 'f1-score': 0.5301587301587302, 'support': 41}, 'weighted avg': {'precision': 0.5369725125822687, 'recall': 0.5121951219512195, 'f1-score': 0.5231126596980256, 'support': 41}}
Token level accuracy: 0.8791773778920309



{'C': {'precision': 0.5555555555555556, 'recall': 0.5882352941176471, 'f1-score': 0.5714285714285715, 'support': 17}, 'P': {'precision': 0.5238095238095238, 'recall': 0.4583333333333333, 'f1-score': 0.4888888888888889, 'support': 24}, 'micro avg': {'precision': 0.5384615384615384, 'recall': 0.5121951219512195, 'f1-score': 0.525, 'support': 41}, 'macro avg': {'precision': 0.5396825396825398, 'recall': 0.5232843137254902, 'f1-score': 0.5301587301587302, 'support': 41}, 'weighted avg': {'precision': 0.5369725125822687, 'recall': 0.5121951219512195, 'f1-score': 0.5231126596980256, 'support': 41}}
Token level accuracy: 0.8791773778920309
Dev-Data: Prec: 0.538, Rec: 0.512, F1: 0.5250



{'C': {'precision': 0.14345114345114346, 'recall': 0.19113573407202217, 'f1-score': 0.163895486935867, 'support': 722}, 'P': {'precision': 0.14187643020594964, 'recall': 0.1316348195329087, 'f1-score': 0.13656387665198239, 'support': 942}, 'micro avg': {'precision': 0.14270152505446623, 'recall': 0.15745192307692307, 'f1-score': 0.14971428571428572, 'support': 1664}, 'macro avg': {'precision': 0.14266378682854655, 'recall': 0.16138527680246545, 'f1-score': 0.1502296817939247, 'support': 1664}, 'weighted avg': {'precision': 0.14255968919815512, 'recall': 0.15745192307692307, 'f1-score': 0.1484229046717929, 'support': 1664}}
Token level accuracy: 0.5118431254846052
Wrong BIO-Encoding 1173/2950 labels, 39.76%



{'C': {'precision': 0.14345114345114346, 'recall': 0.19113573407202217, 'f1-score': 0.163895486935867, 'support': 722}, 'P': {'precision': 0.14187643020594964, 'recall': 0.1316348195329087, 'f1-score': 0.13656387665198239, 'support': 942}, 'micro avg': {'precision': 0.14270152505446623, 'recall': 0.15745192307692307, 'f1-score': 0.14971428571428572, 'support': 1664}, 'macro avg': {'precision': 0.14266378682854655, 'recall': 0.16138527680246545, 'f1-score': 0.1502296817939247, 'support': 1664}, 'weighted avg': {'precision': 0.14255968919815512, 'recall': 0.15745192307692307, 'f1-score': 0.1484229046717929, 'support': 1664}}
Token level accuracy: 0.5118431254846052
Wrong BIO-Encoding 59/1836 labels, 3.21%
Test-Data: Prec: 0.147, Rec: 0.157, F1: 0.1523

Scores from epoch with best dev-scores:
  Dev-Score: 0.5250
  Test-Score 0.1523

9.20 sec for evaluation

--------- Epoch 22 -----------
233.63 sec for training (5089.59 total)
-- cmv_modes1 --



{'C': {'precision': 0.7857142857142857, 'recall': 0.6470588235294118, 'f1-score': 0.7096774193548386, 'support': 17}, 'P': {'precision': 0.6153846153846154, 'recall': 0.6666666666666666, 'f1-score': 0.64, 'support': 24}, 'micro avg': {'precision': 0.675, 'recall': 0.6585365853658537, 'f1-score': 0.6666666666666667, 'support': 41}, 'macro avg': {'precision': 0.7005494505494505, 'recall': 0.6568627450980392, 'f1-score': 0.6748387096774193, 'support': 41}, 'weighted avg': {'precision': 0.6860091128383812, 'recall': 0.6585365853658537, 'f1-score': 0.6688906372934696, 'support': 41}}
Token level accuracy: 0.8740359897172236



{'C': {'precision': 0.7857142857142857, 'recall': 0.6470588235294118, 'f1-score': 0.7096774193548386, 'support': 17}, 'P': {'precision': 0.6153846153846154, 'recall': 0.6666666666666666, 'f1-score': 0.64, 'support': 24}, 'micro avg': {'precision': 0.675, 'recall': 0.6585365853658537, 'f1-score': 0.6666666666666667, 'support': 41}, 'macro avg': {'precision': 0.7005494505494505, 'recall': 0.6568627450980392, 'f1-score': 0.6748387096774193, 'support': 41}, 'weighted avg': {'precision': 0.6860091128383812, 'recall': 0.6585365853658537, 'f1-score': 0.6688906372934696, 'support': 41}}
Token level accuracy: 0.8740359897172236
Dev-Data: Prec: 0.675, Rec: 0.659, F1: 0.6667



{'C': {'precision': 0.21292775665399238, 'recall': 0.15512465373961218, 'f1-score': 0.1794871794871795, 'support': 722}, 'P': {'precision': 0.1529698942229455, 'recall': 0.19957537154989385, 'f1-score': 0.17319207738369416, 'support': 942}, 'micro avg': {'precision': 0.17094017094017094, 'recall': 0.18028846153846154, 'f1-score': 0.17548990933021352, 'support': 1664}, 'macro avg': {'precision': 0.18294882543846894, 'recall': 0.17735001264475303, 'f1-score': 0.17633962843543682, 'support': 1664}, 'weighted avg': {'precision': 0.17898526482103191, 'recall': 0.18028846153846154, 'f1-score': 0.17592348586849968, 'support': 1664}}
Token level accuracy: 0.5367799704859808
Wrong BIO-Encoding 964/2664 labels, 36.19%



{'C': {'precision': 0.21292775665399238, 'recall': 0.15512465373961218, 'f1-score': 0.1794871794871795, 'support': 722}, 'P': {'precision': 0.1529698942229455, 'recall': 0.19957537154989385, 'f1-score': 0.17319207738369416, 'support': 942}, 'micro avg': {'precision': 0.17094017094017094, 'recall': 0.18028846153846154, 'f1-score': 0.17548990933021352, 'support': 1664}, 'macro avg': {'precision': 0.18294882543846894, 'recall': 0.17735001264475303, 'f1-score': 0.17633962843543682, 'support': 1664}, 'weighted avg': {'precision': 0.17898526482103191, 'recall': 0.18028846153846154, 'f1-score': 0.17592348586849968, 'support': 1664}}
Token level accuracy: 0.5367799704859808
Wrong BIO-Encoding 55/1755 labels, 3.13%
Test-Data: Prec: 0.176, Rec: 0.180, F1: 0.1778

Scores from epoch with best dev-scores:
  Dev-Score: 0.6667
  Test-Score 0.1778

8.98 sec for evaluation

--------- Epoch 23 -----------
232.76 sec for training (5322.35 total)
-- cmv_modes1 --



{'C': {'precision': 0.5294117647058824, 'recall': 0.5294117647058824, 'f1-score': 0.5294117647058824, 'support': 17}, 'P': {'precision': 0.5, 'recall': 0.5416666666666666, 'f1-score': 0.52, 'support': 24}, 'micro avg': {'precision': 0.5116279069767442, 'recall': 0.5365853658536586, 'f1-score': 0.5238095238095238, 'support': 41}, 'macro avg': {'precision': 0.5147058823529411, 'recall': 0.5355392156862745, 'f1-score': 0.5247058823529411, 'support': 41}, 'weighted avg': {'precision': 0.5121951219512195, 'recall': 0.5365853658536586, 'f1-score': 0.5239024390243903, 'support': 41}}
Token level accuracy: 0.8958868894601543
Wrong BIO-Encoding 8/50 labels, 16.00%



{'C': {'precision': 0.5294117647058824, 'recall': 0.5294117647058824, 'f1-score': 0.5294117647058824, 'support': 17}, 'P': {'precision': 0.5, 'recall': 0.5416666666666666, 'f1-score': 0.52, 'support': 24}, 'micro avg': {'precision': 0.5116279069767442, 'recall': 0.5365853658536586, 'f1-score': 0.5238095238095238, 'support': 41}, 'macro avg': {'precision': 0.5147058823529411, 'recall': 0.5355392156862745, 'f1-score': 0.5247058823529411, 'support': 41}, 'weighted avg': {'precision': 0.5121951219512195, 'recall': 0.5365853658536586, 'f1-score': 0.5239024390243903, 'support': 41}}
Token level accuracy: 0.8958868894601543
Wrong BIO-Encoding 1/43 labels, 2.33%
Dev-Data: Prec: 0.524, Rec: 0.537, F1: 0.5301



{'C': {'precision': 0.16591422121896163, 'recall': 0.203601108033241, 'f1-score': 0.1828358208955224, 'support': 722}, 'P': {'precision': 0.16864175022789427, 'recall': 0.19639065817409768, 'f1-score': 0.18146150073565473, 'support': 942}, 'micro avg': {'precision': 0.16742309631870902, 'recall': 0.19951923076923078, 'f1-score': 0.18206745270084998, 'support': 1664}, 'macro avg': {'precision': 0.16727798572342795, 'recall': 0.19999588310366934, 'f1-score': 0.18214866081558856, 'support': 1664}, 'weighted avg': {'precision': 0.1674582911266627, 'recall': 0.19951923076923078, 'f1-score': 0.18205781032425114, 'support': 1664}}
Token level accuracy: 0.5171206323003427
Wrong BIO-Encoding 505/2452 labels, 20.60%



{'C': {'precision': 0.16591422121896163, 'recall': 0.203601108033241, 'f1-score': 0.1828358208955224, 'support': 722}, 'P': {'precision': 0.16864175022789427, 'recall': 0.19639065817409768, 'f1-score': 0.18146150073565473, 'support': 942}, 'micro avg': {'precision': 0.16742309631870902, 'recall': 0.19951923076923078, 'f1-score': 0.18206745270084998, 'support': 1664}, 'macro avg': {'precision': 0.16727798572342795, 'recall': 0.19999588310366934, 'f1-score': 0.18214866081558856, 'support': 1664}, 'weighted avg': {'precision': 0.1674582911266627, 'recall': 0.19951923076923078, 'f1-score': 0.18205781032425114, 'support': 1664}}
Token level accuracy: 0.5171206323003427
Wrong BIO-Encoding 36/1983 labels, 1.82%
Test-Data: Prec: 0.171, Rec: 0.200, F1: 0.1839

Scores from epoch with best dev-scores:
  Dev-Score: 0.6667
  Test-Score 0.1778

9.41 sec for evaluation

--------- Epoch 24 -----------
233.23 sec for training (5555.58 total)
-- cmv_modes1 --



{'C': {'precision': 0.6111111111111112, 'recall': 0.6470588235294118, 'f1-score': 0.6285714285714287, 'support': 17}, 'P': {'precision': 0.56, 'recall': 0.5833333333333334, 'f1-score': 0.5714285714285714, 'support': 24}, 'micro avg': {'precision': 0.5813953488372093, 'recall': 0.6097560975609756, 'f1-score': 0.5952380952380952, 'support': 41}, 'macro avg': {'precision': 0.5855555555555556, 'recall': 0.6151960784313726, 'f1-score': 0.6000000000000001, 'support': 41}, 'weighted avg': {'precision': 0.5811924119241193, 'recall': 0.6097560975609756, 'f1-score': 0.5951219512195122, 'support': 41}}
Token level accuracy: 0.9177377892030848
Wrong BIO-Encoding 8/50 labels, 16.00%



{'C': {'precision': 0.6111111111111112, 'recall': 0.6470588235294118, 'f1-score': 0.6285714285714287, 'support': 17}, 'P': {'precision': 0.56, 'recall': 0.5833333333333334, 'f1-score': 0.5714285714285714, 'support': 24}, 'micro avg': {'precision': 0.5813953488372093, 'recall': 0.6097560975609756, 'f1-score': 0.5952380952380952, 'support': 41}, 'macro avg': {'precision': 0.5855555555555556, 'recall': 0.6151960784313726, 'f1-score': 0.6000000000000001, 'support': 41}, 'weighted avg': {'precision': 0.5811924119241193, 'recall': 0.6097560975609756, 'f1-score': 0.5951219512195122, 'support': 41}}
Token level accuracy: 0.9177377892030848
Wrong BIO-Encoding 1/43 labels, 2.33%
Dev-Data: Prec: 0.595, Rec: 0.610, F1: 0.6024



{'C': {'precision': 0.1461187214611872, 'recall': 0.1772853185595568, 'f1-score': 0.16020025031289112, 'support': 722}, 'P': {'precision': 0.15009746588693956, 'recall': 0.16348195329087048, 'f1-score': 0.15650406504065037, 'support': 942}, 'micro avg': {'precision': 0.14826498422712933, 'recall': 0.16947115384615385, 'f1-score': 0.15816040381379698, 'support': 1664}, 'macro avg': {'precision': 0.14810809367406338, 'recall': 0.17038363592521363, 'f1-score': 0.15835215767677074, 'support': 1664}, 'weighted avg': {'precision': 0.14837111163490035, 'recall': 0.16947115384615385, 'f1-score': 0.15810781850612982, 'support': 1664}}
Token level accuracy: 0.5138940996973562
Wrong BIO-Encoding 378/2257 labels, 16.75%



{'C': {'precision': 0.1461187214611872, 'recall': 0.1772853185595568, 'f1-score': 0.16020025031289112, 'support': 722}, 'P': {'precision': 0.15009746588693956, 'recall': 0.16348195329087048, 'f1-score': 0.15650406504065037, 'support': 942}, 'micro avg': {'precision': 0.14826498422712933, 'recall': 0.16947115384615385, 'f1-score': 0.15816040381379698, 'support': 1664}, 'macro avg': {'precision': 0.14810809367406338, 'recall': 0.17038363592521363, 'f1-score': 0.15835215767677074, 'support': 1664}, 'weighted avg': {'precision': 0.14837111163490035, 'recall': 0.16947115384615385, 'f1-score': 0.15810781850612982, 'support': 1664}}
Token level accuracy: 0.5138940996973562
Wrong BIO-Encoding 23/1902 labels, 1.21%
Test-Data: Prec: 0.150, Rec: 0.169, F1: 0.1592

Scores from epoch with best dev-scores:
  Dev-Score: 0.6667
  Test-Score 0.1778

9.31 sec for evaluation

--------- Epoch 25 -----------
232.58 sec for training (5788.16 total)
-- cmv_modes1 --



{'C': {'precision': 0.5294117647058824, 'recall': 0.5294117647058824, 'f1-score': 0.5294117647058824, 'support': 17}, 'P': {'precision': 0.5909090909090909, 'recall': 0.5416666666666666, 'f1-score': 0.5652173913043478, 'support': 24}, 'micro avg': {'precision': 0.5641025641025641, 'recall': 0.5365853658536586, 'f1-score': 0.55, 'support': 41}, 'macro avg': {'precision': 0.5601604278074866, 'recall': 0.5355392156862745, 'f1-score': 0.5473145780051151, 'support': 41}, 'weighted avg': {'precision': 0.565410199556541, 'recall': 0.5365853658536586, 'f1-score': 0.5503711558854719, 'support': 41}}
Token level accuracy: 0.903598971722365



{'C': {'precision': 0.5294117647058824, 'recall': 0.5294117647058824, 'f1-score': 0.5294117647058824, 'support': 17}, 'P': {'precision': 0.5909090909090909, 'recall': 0.5416666666666666, 'f1-score': 0.5652173913043478, 'support': 24}, 'micro avg': {'precision': 0.5641025641025641, 'recall': 0.5365853658536586, 'f1-score': 0.55, 'support': 41}, 'macro avg': {'precision': 0.5601604278074866, 'recall': 0.5355392156862745, 'f1-score': 0.5473145780051151, 'support': 41}, 'weighted avg': {'precision': 0.565410199556541, 'recall': 0.5365853658536586, 'f1-score': 0.5503711558854719, 'support': 41}}
Token level accuracy: 0.903598971722365
Dev-Data: Prec: 0.564, Rec: 0.537, F1: 0.5500



{'C': {'precision': 0.13627254509018036, 'recall': 0.1883656509695291, 'f1-score': 0.15813953488372093, 'support': 722}, 'P': {'precision': 0.1796116504854369, 'recall': 0.15711252653927812, 'f1-score': 0.16761041902604756, 'support': 942}, 'micro avg': {'precision': 0.15587266739846323, 'recall': 0.17067307692307693, 'f1-score': 0.16293746414228344, 'support': 1664}, 'macro avg': {'precision': 0.15794209778780863, 'recall': 0.1727390887544036, 'f1-score': 0.16287497695488423, 'support': 1664}, 'weighted avg': {'precision': 0.16080706268773545, 'recall': 0.17067307692307693, 'f1-score': 0.16350105703640827, 'support': 1664}}
Token level accuracy: 0.5000875415822515
Wrong BIO-Encoding 741/2511 labels, 29.51%



{'C': {'precision': 0.13627254509018036, 'recall': 0.1883656509695291, 'f1-score': 0.15813953488372093, 'support': 722}, 'P': {'precision': 0.1796116504854369, 'recall': 0.15711252653927812, 'f1-score': 0.16761041902604756, 'support': 942}, 'micro avg': {'precision': 0.15587266739846323, 'recall': 0.17067307692307693, 'f1-score': 0.16293746414228344, 'support': 1664}, 'macro avg': {'precision': 0.15794209778780863, 'recall': 0.1727390887544036, 'f1-score': 0.16287497695488423, 'support': 1664}, 'weighted avg': {'precision': 0.16080706268773545, 'recall': 0.17067307692307693, 'f1-score': 0.16350105703640827, 'support': 1664}}
Token level accuracy: 0.5000875415822515
Wrong BIO-Encoding 52/1822 labels, 2.85%
Test-Data: Prec: 0.160, Rec: 0.171, F1: 0.1654

Scores from epoch with best dev-scores:
  Dev-Score: 0.6667
  Test-Score 0.1778

9.14 sec for evaluation

--------- Epoch 26 -----------
233.26 sec for training (6021.42 total)
-- cmv_modes1 --



{'C': {'precision': 0.75, 'recall': 0.7058823529411765, 'f1-score': 0.7272727272727272, 'support': 17}, 'P': {'precision': 0.5384615384615384, 'recall': 0.5833333333333334, 'f1-score': 0.5599999999999999, 'support': 24}, 'micro avg': {'precision': 0.6190476190476191, 'recall': 0.6341463414634146, 'f1-score': 0.6265060240963854, 'support': 41}, 'macro avg': {'precision': 0.6442307692307692, 'recall': 0.6446078431372549, 'f1-score': 0.6436363636363636, 'support': 41}, 'weighted avg': {'precision': 0.626172607879925, 'recall': 0.6341463414634146, 'f1-score': 0.6293569844789355, 'support': 41}}
Token level accuracy: 0.922879177377892



{'C': {'precision': 0.75, 'recall': 0.7058823529411765, 'f1-score': 0.7272727272727272, 'support': 17}, 'P': {'precision': 0.5384615384615384, 'recall': 0.5833333333333334, 'f1-score': 0.5599999999999999, 'support': 24}, 'micro avg': {'precision': 0.6190476190476191, 'recall': 0.6341463414634146, 'f1-score': 0.6265060240963854, 'support': 41}, 'macro avg': {'precision': 0.6442307692307692, 'recall': 0.6446078431372549, 'f1-score': 0.6436363636363636, 'support': 41}, 'weighted avg': {'precision': 0.626172607879925, 'recall': 0.6341463414634146, 'f1-score': 0.6293569844789355, 'support': 41}}
Token level accuracy: 0.922879177377892
Dev-Data: Prec: 0.619, Rec: 0.634, F1: 0.6265



{'C': {'precision': 0.15750528541226216, 'recall': 0.20637119113573407, 'f1-score': 0.17865707434052755, 'support': 722}, 'P': {'precision': 0.17455621301775148, 'recall': 0.18789808917197454, 'f1-score': 0.18098159509202455, 'support': 942}, 'micro avg': {'precision': 0.1663265306122449, 'recall': 0.19591346153846154, 'f1-score': 0.17991169977924945, 'support': 1664}, 'macro avg': {'precision': 0.16603074921500682, 'recall': 0.1971346401538543, 'f1-score': 0.17981933471627604, 'support': 1664}, 'weighted avg': {'precision': 0.16715791390046583, 'recall': 0.19591346153846154, 'f1-score': 0.17997299894864666, 'support': 1664}}
Token level accuracy: 0.5266251469447988
Wrong BIO-Encoding 268/2206 labels, 12.15%



{'C': {'precision': 0.15750528541226216, 'recall': 0.20637119113573407, 'f1-score': 0.17865707434052755, 'support': 722}, 'P': {'precision': 0.17455621301775148, 'recall': 0.18789808917197454, 'f1-score': 0.18098159509202455, 'support': 942}, 'micro avg': {'precision': 0.1663265306122449, 'recall': 0.19591346153846154, 'f1-score': 0.17991169977924945, 'support': 1664}, 'macro avg': {'precision': 0.16603074921500682, 'recall': 0.1971346401538543, 'f1-score': 0.17981933471627604, 'support': 1664}, 'weighted avg': {'precision': 0.16715791390046583, 'recall': 0.19591346153846154, 'f1-score': 0.17997299894864666, 'support': 1664}}
Token level accuracy: 0.5266251469447988
Wrong BIO-Encoding 22/1960 labels, 1.12%
Test-Data: Prec: 0.168, Rec: 0.196, F1: 0.1810

Scores from epoch with best dev-scores:
  Dev-Score: 0.6667
  Test-Score 0.1778

9.04 sec for evaluation

--------- Epoch 27 -----------
232.49 sec for training (6253.92 total)
-- cmv_modes1 --



{'C': {'precision': 0.7333333333333333, 'recall': 0.6470588235294118, 'f1-score': 0.6875, 'support': 17}, 'P': {'precision': 0.6071428571428571, 'recall': 0.7083333333333334, 'f1-score': 0.6538461538461539, 'support': 24}, 'micro avg': {'precision': 0.6511627906976745, 'recall': 0.6829268292682927, 'f1-score': 0.6666666666666667, 'support': 41}, 'macro avg': {'precision': 0.6702380952380952, 'recall': 0.6776960784313726, 'f1-score': 0.6706730769230769, 'support': 41}, 'weighted avg': {'precision': 0.6594657375145179, 'recall': 0.6829268292682927, 'f1-score': 0.6678001876172608, 'support': 41}}
Token level accuracy: 0.9421593830334191



{'C': {'precision': 0.7333333333333333, 'recall': 0.6470588235294118, 'f1-score': 0.6875, 'support': 17}, 'P': {'precision': 0.6071428571428571, 'recall': 0.7083333333333334, 'f1-score': 0.6538461538461539, 'support': 24}, 'micro avg': {'precision': 0.6511627906976745, 'recall': 0.6829268292682927, 'f1-score': 0.6666666666666667, 'support': 41}, 'macro avg': {'precision': 0.6702380952380952, 'recall': 0.6776960784313726, 'f1-score': 0.6706730769230769, 'support': 41}, 'weighted avg': {'precision': 0.6594657375145179, 'recall': 0.6829268292682927, 'f1-score': 0.6678001876172608, 'support': 41}}
Token level accuracy: 0.9421593830334191
Dev-Data: Prec: 0.651, Rec: 0.683, F1: 0.6667



{'C': {'precision': 0.17525773195876287, 'recall': 0.1883656509695291, 'f1-score': 0.1815754339118825, 'support': 722}, 'P': {'precision': 0.17488789237668162, 'recall': 0.2070063694267516, 'f1-score': 0.18959649975692758, 'support': 942}, 'micro avg': {'precision': 0.17503966155473294, 'recall': 0.19891826923076922, 'f1-score': 0.18621659634317864, 'support': 1664}, 'macro avg': {'precision': 0.17507281216772225, 'recall': 0.19768601019814036, 'f1-score': 0.18558596683440504, 'support': 1664}, 'weighted avg': {'precision': 0.17504836363765677, 'recall': 0.19891826923076922, 'f1-score': 0.1861162055621424, 'support': 1664}}
Token level accuracy: 0.5221980440709337
Wrong BIO-Encoding 346/2206 labels, 15.68%



{'C': {'precision': 0.17525773195876287, 'recall': 0.1883656509695291, 'f1-score': 0.1815754339118825, 'support': 722}, 'P': {'precision': 0.17488789237668162, 'recall': 0.2070063694267516, 'f1-score': 0.18959649975692758, 'support': 942}, 'micro avg': {'precision': 0.17503966155473294, 'recall': 0.19891826923076922, 'f1-score': 0.18621659634317864, 'support': 1664}, 'macro avg': {'precision': 0.17507281216772225, 'recall': 0.19768601019814036, 'f1-score': 0.18558596683440504, 'support': 1664}, 'weighted avg': {'precision': 0.17504836363765677, 'recall': 0.19891826923076922, 'f1-score': 0.1861162055621424, 'support': 1664}}
Token level accuracy: 0.5221980440709337
Wrong BIO-Encoding 31/1891 labels, 1.64%
Test-Data: Prec: 0.178, Rec: 0.199, F1: 0.1879

Scores from epoch with best dev-scores:
  Dev-Score: 0.6667
  Test-Score 0.1778

8.88 sec for evaluation

--------- Epoch 28 -----------
228.82 sec for training (6482.73 total)
-- cmv_modes1 --



{'C': {'precision': 0.6842105263157895, 'recall': 0.7647058823529411, 'f1-score': 0.7222222222222222, 'support': 17}, 'P': {'precision': 0.6363636363636364, 'recall': 0.5833333333333334, 'f1-score': 0.6086956521739131, 'support': 24}, 'micro avg': {'precision': 0.6585365853658537, 'recall': 0.6585365853658537, 'f1-score': 0.6585365853658537, 'support': 41}, 'macro avg': {'precision': 0.6602870813397129, 'recall': 0.6740196078431373, 'f1-score': 0.6654589371980677, 'support': 41}, 'weighted avg': {'precision': 0.6562025907340413, 'recall': 0.6585365853658537, 'f1-score': 0.6557676446329681, 'support': 41}}
Token level accuracy: 0.9267352185089974



{'C': {'precision': 0.6842105263157895, 'recall': 0.7647058823529411, 'f1-score': 0.7222222222222222, 'support': 17}, 'P': {'precision': 0.6363636363636364, 'recall': 0.5833333333333334, 'f1-score': 0.6086956521739131, 'support': 24}, 'micro avg': {'precision': 0.6585365853658537, 'recall': 0.6585365853658537, 'f1-score': 0.6585365853658537, 'support': 41}, 'macro avg': {'precision': 0.6602870813397129, 'recall': 0.6740196078431373, 'f1-score': 0.6654589371980677, 'support': 41}, 'weighted avg': {'precision': 0.6562025907340413, 'recall': 0.6585365853658537, 'f1-score': 0.6557676446329681, 'support': 41}}
Token level accuracy: 0.9267352185089974
Dev-Data: Prec: 0.659, Rec: 0.659, F1: 0.6585



{'C': {'precision': 0.13043478260869565, 'recall': 0.19113573407202217, 'f1-score': 0.1550561797752809, 'support': 722}, 'P': {'precision': 0.16488730723606168, 'recall': 0.1475583864118896, 'f1-score': 0.1557422969187675, 'support': 942}, 'micro avg': {'precision': 0.1457127827459232, 'recall': 0.16646634615384615, 'f1-score': 0.15539971949509115, 'support': 1664}, 'macro avg': {'precision': 0.14766104492237866, 'recall': 0.1693470602419559, 'f1-score': 0.1553992383470242, 'support': 1664}, 'weighted avg': {'precision': 0.1499385555648127, 'recall': 0.16646634615384615, 'f1-score': 0.1554445946485768, 'support': 1664}}
Token level accuracy: 0.4886070883669743
Wrong BIO-Encoding 342/2213 labels, 15.45%



{'C': {'precision': 0.13043478260869565, 'recall': 0.19113573407202217, 'f1-score': 0.1550561797752809, 'support': 722}, 'P': {'precision': 0.16488730723606168, 'recall': 0.1475583864118896, 'f1-score': 0.1557422969187675, 'support': 942}, 'micro avg': {'precision': 0.1457127827459232, 'recall': 0.16646634615384615, 'f1-score': 0.15539971949509115, 'support': 1664}, 'macro avg': {'precision': 0.14766104492237866, 'recall': 0.1693470602419559, 'f1-score': 0.1553992383470242, 'support': 1664}, 'weighted avg': {'precision': 0.1499385555648127, 'recall': 0.16646634615384615, 'f1-score': 0.1554445946485768, 'support': 1664}}
Token level accuracy: 0.4886070883669743
Wrong BIO-Encoding 30/1901 labels, 1.58%
Test-Data: Prec: 0.148, Rec: 0.166, F1: 0.1567

Scores from epoch with best dev-scores:
  Dev-Score: 0.6667
  Test-Score 0.1778

8.85 sec for evaluation

--------- Epoch 29 -----------
229.19 sec for training (6711.92 total)
-- cmv_modes1 --



{'C': {'precision': 0.7368421052631579, 'recall': 0.8235294117647058, 'f1-score': 0.7777777777777778, 'support': 17}, 'P': {'precision': 0.7083333333333334, 'recall': 0.7083333333333334, 'f1-score': 0.7083333333333334, 'support': 24}, 'micro avg': {'precision': 0.7209302325581395, 'recall': 0.7560975609756098, 'f1-score': 0.7380952380952381, 'support': 41}, 'macro avg': {'precision': 0.7225877192982456, 'recall': 0.7659313725490196, 'f1-score': 0.7430555555555556, 'support': 41}, 'weighted avg': {'precision': 0.7201540436456997, 'recall': 0.7560975609756098, 'f1-score': 0.7371273712737128, 'support': 41}}
Token level accuracy: 0.961439588688946



{'C': {'precision': 0.7368421052631579, 'recall': 0.8235294117647058, 'f1-score': 0.7777777777777778, 'support': 17}, 'P': {'precision': 0.7083333333333334, 'recall': 0.7083333333333334, 'f1-score': 0.7083333333333334, 'support': 24}, 'micro avg': {'precision': 0.7209302325581395, 'recall': 0.7560975609756098, 'f1-score': 0.7380952380952381, 'support': 41}, 'macro avg': {'precision': 0.7225877192982456, 'recall': 0.7659313725490196, 'f1-score': 0.7430555555555556, 'support': 41}, 'weighted avg': {'precision': 0.7201540436456997, 'recall': 0.7560975609756098, 'f1-score': 0.7371273712737128, 'support': 41}}
Token level accuracy: 0.961439588688946
Dev-Data: Prec: 0.721, Rec: 0.756, F1: 0.7381



{'C': {'precision': 0.13994439295644115, 'recall': 0.20914127423822715, 'f1-score': 0.16768461965574682, 'support': 722}, 'P': {'precision': 0.1833810888252149, 'recall': 0.20382165605095542, 'f1-score': 0.19306184012066363, 'support': 942}, 'micro avg': {'precision': 0.16133584195672623, 'recall': 0.20612980769230768, 'f1-score': 0.1810026385224274, 'support': 1664}, 'macro avg': {'precision': 0.16166274089082802, 'recall': 0.2064814651445913, 'f1-score': 0.18037322988820523, 'support': 1664}, 'weighted avg': {'precision': 0.1645341570840763, 'recall': 0.20612980769230768, 'f1-score': 0.1820508105679774, 'support': 1664}}
Token level accuracy: 0.5063405117430779
Wrong BIO-Encoding 514/2604 labels, 19.74%



{'C': {'precision': 0.13994439295644115, 'recall': 0.20914127423822715, 'f1-score': 0.16768461965574682, 'support': 722}, 'P': {'precision': 0.1833810888252149, 'recall': 0.20382165605095542, 'f1-score': 0.19306184012066363, 'support': 942}, 'micro avg': {'precision': 0.16133584195672623, 'recall': 0.20612980769230768, 'f1-score': 0.1810026385224274, 'support': 1664}, 'macro avg': {'precision': 0.16166274089082802, 'recall': 0.2064814651445913, 'f1-score': 0.18037322988820523, 'support': 1664}, 'weighted avg': {'precision': 0.1645341570840763, 'recall': 0.20612980769230768, 'f1-score': 0.1820508105679774, 'support': 1664}}
Token level accuracy: 0.5063405117430779
Wrong BIO-Encoding 36/2126 labels, 1.69%
Test-Data: Prec: 0.164, Rec: 0.206, F1: 0.1827

Scores from epoch with best dev-scores:
  Dev-Score: 0.7381
  Test-Score 0.1827

8.84 sec for evaluation

--------- Epoch 30 -----------
228.24 sec for training (6940.16 total)
-- cmv_modes1 --



{'C': {'precision': 0.8235294117647058, 'recall': 0.8235294117647058, 'f1-score': 0.8235294117647058, 'support': 17}, 'P': {'precision': 0.625, 'recall': 0.625, 'f1-score': 0.625, 'support': 24}, 'micro avg': {'precision': 0.7073170731707317, 'recall': 0.7073170731707317, 'f1-score': 0.7073170731707317, 'support': 41}, 'macro avg': {'precision': 0.7242647058823529, 'recall': 0.7242647058823529, 'f1-score': 0.7242647058823529, 'support': 41}, 'weighted avg': {'precision': 0.7073170731707317, 'recall': 0.7073170731707317, 'f1-score': 0.7073170731707317, 'support': 41}}
Token level accuracy: 0.9370179948586118



{'C': {'precision': 0.8235294117647058, 'recall': 0.8235294117647058, 'f1-score': 0.8235294117647058, 'support': 17}, 'P': {'precision': 0.625, 'recall': 0.625, 'f1-score': 0.625, 'support': 24}, 'micro avg': {'precision': 0.7073170731707317, 'recall': 0.7073170731707317, 'f1-score': 0.7073170731707317, 'support': 41}, 'macro avg': {'precision': 0.7242647058823529, 'recall': 0.7242647058823529, 'f1-score': 0.7242647058823529, 'support': 41}, 'weighted avg': {'precision': 0.7073170731707317, 'recall': 0.7073170731707317, 'f1-score': 0.7073170731707317, 'support': 41}}
Token level accuracy: 0.9370179948586118
Dev-Data: Prec: 0.707, Rec: 0.707, F1: 0.7073



{'C': {'precision': 0.15517241379310345, 'recall': 0.18698060941828254, 'f1-score': 0.16959798994974876, 'support': 722}, 'P': {'precision': 0.1688055281342547, 'recall': 0.18152866242038215, 'f1-score': 0.17493606138107415, 'support': 942}, 'micro avg': {'precision': 0.16250663834306958, 'recall': 0.18389423076923078, 'f1-score': 0.1725401747956019, 'support': 1664}, 'macro avg': {'precision': 0.1619889709636791, 'recall': 0.18425463591933233, 'f1-score': 0.17226702566541147, 'support': 1664}, 'weighted avg': {'precision': 0.1628901984742119, 'recall': 0.18389423076923078, 'f1-score': 0.172619902983588, 'support': 1664}}
Token level accuracy: 0.5152447412520947
Wrong BIO-Encoding 553/2392 labels, 23.12%



{'C': {'precision': 0.15517241379310345, 'recall': 0.18698060941828254, 'f1-score': 0.16959798994974876, 'support': 722}, 'P': {'precision': 0.1688055281342547, 'recall': 0.18152866242038215, 'f1-score': 0.17493606138107415, 'support': 942}, 'micro avg': {'precision': 0.16250663834306958, 'recall': 0.18389423076923078, 'f1-score': 0.1725401747956019, 'support': 1664}, 'macro avg': {'precision': 0.1619889709636791, 'recall': 0.18425463591933233, 'f1-score': 0.17226702566541147, 'support': 1664}, 'weighted avg': {'precision': 0.1628901984742119, 'recall': 0.18389423076923078, 'f1-score': 0.172619902983588, 'support': 1664}}
Token level accuracy: 0.5152447412520947
Wrong BIO-Encoding 44/1883 labels, 2.34%
Test-Data: Prec: 0.166, Rec: 0.184, F1: 0.1747

Scores from epoch with best dev-scores:
  Dev-Score: 0.7381
  Test-Score 0.1827

8.84 sec for evaluation

--------- Epoch 31 -----------
228.08 sec for training (7168.24 total)
-- cmv_modes1 --



{'C': {'precision': 0.7368421052631579, 'recall': 0.8235294117647058, 'f1-score': 0.7777777777777778, 'support': 17}, 'P': {'precision': 0.7391304347826086, 'recall': 0.7083333333333334, 'f1-score': 0.723404255319149, 'support': 24}, 'micro avg': {'precision': 0.7380952380952381, 'recall': 0.7560975609756098, 'f1-score': 0.746987951807229, 'support': 41}, 'macro avg': {'precision': 0.7379862700228832, 'recall': 0.7659313725490196, 'f1-score': 0.7505910165484634, 'support': 41}, 'weighted avg': {'precision': 0.7381816152257633, 'recall': 0.7560975609756098, 'f1-score': 0.745949374387361, 'support': 41}}
Token level accuracy: 0.9562982005141388



{'C': {'precision': 0.7368421052631579, 'recall': 0.8235294117647058, 'f1-score': 0.7777777777777778, 'support': 17}, 'P': {'precision': 0.7391304347826086, 'recall': 0.7083333333333334, 'f1-score': 0.723404255319149, 'support': 24}, 'micro avg': {'precision': 0.7380952380952381, 'recall': 0.7560975609756098, 'f1-score': 0.746987951807229, 'support': 41}, 'macro avg': {'precision': 0.7379862700228832, 'recall': 0.7659313725490196, 'f1-score': 0.7505910165484634, 'support': 41}, 'weighted avg': {'precision': 0.7381816152257633, 'recall': 0.7560975609756098, 'f1-score': 0.745949374387361, 'support': 41}}
Token level accuracy: 0.9562982005141388
Dev-Data: Prec: 0.738, Rec: 0.756, F1: 0.7470



{'C': {'precision': 0.14619883040935672, 'recall': 0.2077562326869806, 'f1-score': 0.17162471395881007, 'support': 722}, 'P': {'precision': 0.18935516888433981, 'recall': 0.19639065817409768, 'f1-score': 0.19280875455966648, 'support': 942}, 'micro avg': {'precision': 0.1672491263105342, 'recall': 0.2013221153846154, 'f1-score': 0.18271066266703026, 'support': 1664}, 'macro avg': {'precision': 0.16777699964684828, 'recall': 0.20207344543053912, 'f1-score': 0.1822167342592383, 'support': 1664}, 'weighted avg': {'precision': 0.17062988259892048, 'recall': 0.2013221153846154, 'f1-score': 0.18361712155857374, 'support': 1664}}
Token level accuracy: 0.4956854505890298
Wrong BIO-Encoding 742/2706 labels, 27.42%



{'C': {'precision': 0.14619883040935672, 'recall': 0.2077562326869806, 'f1-score': 0.17162471395881007, 'support': 722}, 'P': {'precision': 0.18935516888433981, 'recall': 0.19639065817409768, 'f1-score': 0.19280875455966648, 'support': 942}, 'micro avg': {'precision': 0.1672491263105342, 'recall': 0.2013221153846154, 'f1-score': 0.18271066266703026, 'support': 1664}, 'macro avg': {'precision': 0.16777699964684828, 'recall': 0.20207344543053912, 'f1-score': 0.1822167342592383, 'support': 1664}, 'weighted avg': {'precision': 0.17062988259892048, 'recall': 0.2013221153846154, 'f1-score': 0.18361712155857374, 'support': 1664}}
Token level accuracy: 0.4956854505890298
Wrong BIO-Encoding 39/2003 labels, 1.95%
Test-Data: Prec: 0.171, Rec: 0.201, F1: 0.1847

Scores from epoch with best dev-scores:
  Dev-Score: 0.7470
  Test-Score 0.1847

8.87 sec for evaluation

--------- Epoch 32 -----------
230.53 sec for training (7398.78 total)
-- cmv_modes1 --



{'C': {'precision': 0.9411764705882353, 'recall': 0.9411764705882353, 'f1-score': 0.9411764705882353, 'support': 17}, 'P': {'precision': 0.76, 'recall': 0.7916666666666666, 'f1-score': 0.7755102040816326, 'support': 24}, 'micro avg': {'precision': 0.8333333333333334, 'recall': 0.8536585365853658, 'f1-score': 0.8433734939759037, 'support': 41}, 'macro avg': {'precision': 0.8505882352941176, 'recall': 0.866421568627451, 'f1-score': 0.858343337334934, 'support': 41}, 'weighted avg': {'precision': 0.8351219512195123, 'recall': 0.8536585365853658, 'f1-score': 0.8442010950721753, 'support': 41}}
Token level accuracy: 0.9897172236503856



{'C': {'precision': 0.9411764705882353, 'recall': 0.9411764705882353, 'f1-score': 0.9411764705882353, 'support': 17}, 'P': {'precision': 0.76, 'recall': 0.7916666666666666, 'f1-score': 0.7755102040816326, 'support': 24}, 'micro avg': {'precision': 0.8333333333333334, 'recall': 0.8536585365853658, 'f1-score': 0.8433734939759037, 'support': 41}, 'macro avg': {'precision': 0.8505882352941176, 'recall': 0.866421568627451, 'f1-score': 0.858343337334934, 'support': 41}, 'weighted avg': {'precision': 0.8351219512195123, 'recall': 0.8536585365853658, 'f1-score': 0.8442010950721753, 'support': 41}}
Token level accuracy: 0.9897172236503856
Dev-Data: Prec: 0.833, Rec: 0.854, F1: 0.8434



{'C': {'precision': 0.16156670746634028, 'recall': 0.18282548476454294, 'f1-score': 0.17153996101364521, 'support': 722}, 'P': {'precision': 0.16304347826086957, 'recall': 0.1751592356687898, 'f1-score': 0.16888433981576254, 'support': 942}, 'micro avg': {'precision': 0.16238381629305632, 'recall': 0.17848557692307693, 'f1-score': 0.17005439450329232, 'support': 1664}, 'macro avg': {'precision': 0.16230509286360492, 'recall': 0.17899236021666637, 'f1-score': 0.1702121504147039, 'support': 1664}, 'weighted avg': {'precision': 0.16240271593295483, 'recall': 0.17848557692307693, 'f1-score': 0.1700365985326323, 'support': 1664}}
Token level accuracy: 0.5195717966033866
Wrong BIO-Encoding 648/2432 labels, 26.64%



{'C': {'precision': 0.16156670746634028, 'recall': 0.18282548476454294, 'f1-score': 0.17153996101364521, 'support': 722}, 'P': {'precision': 0.16304347826086957, 'recall': 0.1751592356687898, 'f1-score': 0.16888433981576254, 'support': 942}, 'micro avg': {'precision': 0.16238381629305632, 'recall': 0.17848557692307693, 'f1-score': 0.17005439450329232, 'support': 1664}, 'macro avg': {'precision': 0.16230509286360492, 'recall': 0.17899236021666637, 'f1-score': 0.1702121504147039, 'support': 1664}, 'weighted avg': {'precision': 0.16240271593295483, 'recall': 0.17848557692307693, 'f1-score': 0.1700365985326323, 'support': 1664}}
Token level accuracy: 0.5195717966033866
Wrong BIO-Encoding 45/1829 labels, 2.46%
Test-Data: Prec: 0.166, Rec: 0.178, F1: 0.1723

Scores from epoch with best dev-scores:
  Dev-Score: 0.8434
  Test-Score 0.1723

9.17 sec for evaluation

--------- Epoch 33 -----------
230.42 sec for training (7629.20 total)
-- cmv_modes1 --



{'C': {'precision': 0.8421052631578947, 'recall': 0.9411764705882353, 'f1-score': 0.8888888888888888, 'support': 17}, 'P': {'precision': 0.8260869565217391, 'recall': 0.7916666666666666, 'f1-score': 0.8085106382978724, 'support': 24}, 'micro avg': {'precision': 0.8333333333333334, 'recall': 0.8536585365853658, 'f1-score': 0.8433734939759037, 'support': 41}, 'macro avg': {'precision': 0.834096109839817, 'recall': 0.866421568627451, 'f1-score': 0.8486997635933806, 'support': 41}, 'weighted avg': {'precision': 0.8327286934196573, 'recall': 0.8536585365853658, 'f1-score': 0.8418382056160987, 'support': 41}}
Token level accuracy: 0.961439588688946



{'C': {'precision': 0.8421052631578947, 'recall': 0.9411764705882353, 'f1-score': 0.8888888888888888, 'support': 17}, 'P': {'precision': 0.8260869565217391, 'recall': 0.7916666666666666, 'f1-score': 0.8085106382978724, 'support': 24}, 'micro avg': {'precision': 0.8333333333333334, 'recall': 0.8536585365853658, 'f1-score': 0.8433734939759037, 'support': 41}, 'macro avg': {'precision': 0.834096109839817, 'recall': 0.866421568627451, 'f1-score': 0.8486997635933806, 'support': 41}, 'weighted avg': {'precision': 0.8327286934196573, 'recall': 0.8536585365853658, 'f1-score': 0.8418382056160987, 'support': 41}}
Token level accuracy: 0.961439588688946
Dev-Data: Prec: 0.833, Rec: 0.854, F1: 0.8434



{'C': {'precision': 0.13019169329073482, 'recall': 0.2257617728531856, 'f1-score': 0.1651469098277609, 'support': 722}, 'P': {'precision': 0.1891891891891892, 'recall': 0.16348195329087048, 'f1-score': 0.17539863325740318, 'support': 942}, 'micro avg': {'precision': 0.15343659244917715, 'recall': 0.19050480769230768, 'f1-score': 0.16997319034852548, 'support': 1664}, 'macro avg': {'precision': 0.159690441239962, 'recall': 0.19462186307202806, 'f1-score': 0.17027277154258202, 'support': 1664}, 'weighted avg': {'precision': 0.16359051608901848, 'recall': 0.19050480769230768, 'f1-score': 0.17095046960583965, 'support': 1664}}
Token level accuracy: 0.4822040469222881
Wrong BIO-Encoding 798/2806 labels, 28.44%



{'C': {'precision': 0.13019169329073482, 'recall': 0.2257617728531856, 'f1-score': 0.1651469098277609, 'support': 722}, 'P': {'precision': 0.1891891891891892, 'recall': 0.16348195329087048, 'f1-score': 0.17539863325740318, 'support': 942}, 'micro avg': {'precision': 0.15343659244917715, 'recall': 0.19050480769230768, 'f1-score': 0.16997319034852548, 'support': 1664}, 'macro avg': {'precision': 0.159690441239962, 'recall': 0.19462186307202806, 'f1-score': 0.17027277154258202, 'support': 1664}, 'weighted avg': {'precision': 0.16359051608901848, 'recall': 0.19050480769230768, 'f1-score': 0.17095046960583965, 'support': 1664}}
Token level accuracy: 0.4822040469222881
Wrong BIO-Encoding 58/2066 labels, 2.81%
Test-Data: Prec: 0.158, Rec: 0.191, F1: 0.1727

Scores from epoch with best dev-scores:
  Dev-Score: 0.8434
  Test-Score 0.1723

8.96 sec for evaluation

--------- Epoch 34 -----------
230.78 sec for training (7859.97 total)
-- cmv_modes1 --



{'C': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 17}, 'P': {'precision': 0.8, 'recall': 0.8333333333333334, 'f1-score': 0.816326530612245, 'support': 24}, 'micro avg': {'precision': 0.8809523809523809, 'recall': 0.9024390243902439, 'f1-score': 0.8915662650602411, 'support': 41}, 'macro avg': {'precision': 0.9, 'recall': 0.9166666666666667, 'f1-score': 0.9081632653061225, 'support': 41}, 'weighted avg': {'precision': 0.8829268292682928, 'recall': 0.9024390243902439, 'f1-score': 0.8924838227974118, 'support': 41}}
Token level accuracy: 0.9922879177377892



{'C': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 17}, 'P': {'precision': 0.8, 'recall': 0.8333333333333334, 'f1-score': 0.816326530612245, 'support': 24}, 'micro avg': {'precision': 0.8809523809523809, 'recall': 0.9024390243902439, 'f1-score': 0.8915662650602411, 'support': 41}, 'macro avg': {'precision': 0.9, 'recall': 0.9166666666666667, 'f1-score': 0.9081632653061225, 'support': 41}, 'weighted avg': {'precision': 0.8829268292682928, 'recall': 0.9024390243902439, 'f1-score': 0.8924838227974118, 'support': 41}}
Token level accuracy: 0.9922879177377892
Dev-Data: Prec: 0.881, Rec: 0.902, F1: 0.8916



{'C': {'precision': 0.18241469816272965, 'recall': 0.1925207756232687, 'f1-score': 0.18733153638814015, 'support': 722}, 'P': {'precision': 0.17398945518453426, 'recall': 0.21019108280254778, 'f1-score': 0.19038461538461537, 'support': 942}, 'micro avg': {'precision': 0.1773684210526316, 'recall': 0.20252403846153846, 'f1-score': 0.18911335578002247, 'support': 1664}, 'macro avg': {'precision': 0.17820207667363197, 'recall': 0.20135592921290824, 'f1-score': 0.18885807588637776, 'support': 1664}, 'weighted avg': {'precision': 0.1776451195056022, 'recall': 0.20252403846153846, 'f1-score': 0.18905990202196205, 'support': 1664}}
Token level accuracy: 0.5406318001050499
Wrong BIO-Encoding 524/2389 labels, 21.93%



{'C': {'precision': 0.18241469816272965, 'recall': 0.1925207756232687, 'f1-score': 0.18733153638814015, 'support': 722}, 'P': {'precision': 0.17398945518453426, 'recall': 0.21019108280254778, 'f1-score': 0.19038461538461537, 'support': 942}, 'micro avg': {'precision': 0.1773684210526316, 'recall': 0.20252403846153846, 'f1-score': 0.18911335578002247, 'support': 1664}, 'macro avg': {'precision': 0.17820207667363197, 'recall': 0.20135592921290824, 'f1-score': 0.18885807588637776, 'support': 1664}, 'weighted avg': {'precision': 0.1776451195056022, 'recall': 0.20252403846153846, 'f1-score': 0.18905990202196205, 'support': 1664}}
Token level accuracy: 0.5406318001050499
Wrong BIO-Encoding 35/1900 labels, 1.84%
Test-Data: Prec: 0.181, Rec: 0.203, F1: 0.1910

Scores from epoch with best dev-scores:
  Dev-Score: 0.8916
  Test-Score 0.1910

9.04 sec for evaluation

--------- Epoch 35 -----------
233.08 sec for training (8093.06 total)
-- cmv_modes1 --



{'C': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 17}, 'P': {'precision': 0.84, 'recall': 0.875, 'f1-score': 0.8571428571428572, 'support': 24}, 'micro avg': {'precision': 0.9047619047619048, 'recall': 0.926829268292683, 'f1-score': 0.9156626506024096, 'support': 41}, 'macro avg': {'precision': 0.9199999999999999, 'recall': 0.9375, 'f1-score': 0.9285714285714286, 'support': 41}, 'weighted avg': {'precision': 0.9063414634146341, 'recall': 0.926829268292683, 'f1-score': 0.916376306620209, 'support': 41}}
Token level accuracy: 0.993573264781491



{'C': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 17}, 'P': {'precision': 0.84, 'recall': 0.875, 'f1-score': 0.8571428571428572, 'support': 24}, 'micro avg': {'precision': 0.9047619047619048, 'recall': 0.926829268292683, 'f1-score': 0.9156626506024096, 'support': 41}, 'macro avg': {'precision': 0.9199999999999999, 'recall': 0.9375, 'f1-score': 0.9285714285714286, 'support': 41}, 'weighted avg': {'precision': 0.9063414634146341, 'recall': 0.926829268292683, 'f1-score': 0.916376306620209, 'support': 41}}
Token level accuracy: 0.993573264781491
Dev-Data: Prec: 0.905, Rec: 0.927, F1: 0.9157



{'C': {'precision': 0.15766738660907129, 'recall': 0.20221606648199447, 'f1-score': 0.1771844660194175, 'support': 722}, 'P': {'precision': 0.17462039045553146, 'recall': 0.17091295116772823, 'f1-score': 0.17274678111587985, 'support': 942}, 'micro avg': {'precision': 0.16612554112554112, 'recall': 0.18449519230769232, 'f1-score': 0.17482915717539865, 'support': 1664}, 'macro avg': {'precision': 0.1661438885323014, 'recall': 0.18656450882486136, 'f1-score': 0.17496562356764866, 'support': 1664}, 'weighted avg': {'precision': 0.1672645798923438, 'recall': 0.18449519230769232, 'f1-score': 0.17467226699349653, 'support': 1664}}
Token level accuracy: 0.5265501113028689
Wrong BIO-Encoding 898/2689 labels, 33.40%



{'C': {'precision': 0.15766738660907129, 'recall': 0.20221606648199447, 'f1-score': 0.1771844660194175, 'support': 722}, 'P': {'precision': 0.17462039045553146, 'recall': 0.17091295116772823, 'f1-score': 0.17274678111587985, 'support': 942}, 'micro avg': {'precision': 0.16612554112554112, 'recall': 0.18449519230769232, 'f1-score': 0.17482915717539865, 'support': 1664}, 'macro avg': {'precision': 0.1661438885323014, 'recall': 0.18656450882486136, 'f1-score': 0.17496562356764866, 'support': 1664}, 'weighted avg': {'precision': 0.1672645798923438, 'recall': 0.18449519230769232, 'f1-score': 0.17467226699349653, 'support': 1664}}
Token level accuracy: 0.5265501113028689
Wrong BIO-Encoding 57/1848 labels, 3.08%
Test-Data: Prec: 0.171, Rec: 0.184, F1: 0.1777

Scores from epoch with best dev-scores:
  Dev-Score: 0.9157
  Test-Score 0.1777

9.91 sec for evaluation

--------- Epoch 36 -----------
234.62 sec for training (8327.68 total)
-- cmv_modes1 --



{'C': {'precision': 0.9411764705882353, 'recall': 0.9411764705882353, 'f1-score': 0.9411764705882353, 'support': 17}, 'P': {'precision': 0.88, 'recall': 0.9166666666666666, 'f1-score': 0.8979591836734694, 'support': 24}, 'micro avg': {'precision': 0.9047619047619048, 'recall': 0.926829268292683, 'f1-score': 0.9156626506024096, 'support': 41}, 'macro avg': {'precision': 0.9105882352941177, 'recall': 0.928921568627451, 'f1-score': 0.9195678271308523, 'support': 41}, 'weighted avg': {'precision': 0.9053658536585367, 'recall': 0.926829268292683, 'f1-score': 0.9158785465405676, 'support': 41}}
Token level accuracy: 0.993573264781491



{'C': {'precision': 0.9411764705882353, 'recall': 0.9411764705882353, 'f1-score': 0.9411764705882353, 'support': 17}, 'P': {'precision': 0.88, 'recall': 0.9166666666666666, 'f1-score': 0.8979591836734694, 'support': 24}, 'micro avg': {'precision': 0.9047619047619048, 'recall': 0.926829268292683, 'f1-score': 0.9156626506024096, 'support': 41}, 'macro avg': {'precision': 0.9105882352941177, 'recall': 0.928921568627451, 'f1-score': 0.9195678271308523, 'support': 41}, 'weighted avg': {'precision': 0.9053658536585367, 'recall': 0.926829268292683, 'f1-score': 0.9158785465405676, 'support': 41}}
Token level accuracy: 0.993573264781491
Dev-Data: Prec: 0.905, Rec: 0.927, F1: 0.9157



{'C': {'precision': 0.17218543046357615, 'recall': 0.21606648199445982, 'f1-score': 0.19164619164619165, 'support': 722}, 'P': {'precision': 0.150093808630394, 'recall': 0.16985138004246284, 'f1-score': 0.1593625498007968, 'support': 942}, 'micro avg': {'precision': 0.16024340770791076, 'recall': 0.18990384615384615, 'f1-score': 0.1738173817381738, 'support': 1664}, 'macro avg': {'precision': 0.16113961954698508, 'recall': 0.19295893101846134, 'f1-score': 0.17550437072349423, 'support': 1664}, 'weighted avg': {'precision': 0.1596792358921473, 'recall': 0.18990384615384615, 'f1-score': 0.17337023574573374, 'support': 1664}}
Token level accuracy: 0.526725194467372
Wrong BIO-Encoding 700/2631 labels, 26.61%



{'C': {'precision': 0.17218543046357615, 'recall': 0.21606648199445982, 'f1-score': 0.19164619164619165, 'support': 722}, 'P': {'precision': 0.150093808630394, 'recall': 0.16985138004246284, 'f1-score': 0.1593625498007968, 'support': 942}, 'micro avg': {'precision': 0.16024340770791076, 'recall': 0.18990384615384615, 'f1-score': 0.1738173817381738, 'support': 1664}, 'macro avg': {'precision': 0.16113961954698508, 'recall': 0.19295893101846134, 'f1-score': 0.17550437072349423, 'support': 1664}, 'weighted avg': {'precision': 0.1596792358921473, 'recall': 0.18990384615384615, 'f1-score': 0.17337023574573374, 'support': 1664}}
Token level accuracy: 0.526725194467372
Wrong BIO-Encoding 41/1972 labels, 2.08%
Test-Data: Prec: 0.163, Rec: 0.189, F1: 0.1752

Scores from epoch with best dev-scores:
  Dev-Score: 0.9157
  Test-Score 0.1777

9.94 sec for evaluation

--------- Epoch 37 -----------
225.67 sec for training (8553.34 total)
-- cmv_modes1 --



{'C': {'precision': 0.8888888888888888, 'recall': 0.9411764705882353, 'f1-score': 0.9142857142857143, 'support': 17}, 'P': {'precision': 0.72, 'recall': 0.75, 'f1-score': 0.7346938775510204, 'support': 24}, 'micro avg': {'precision': 0.7906976744186046, 'recall': 0.8292682926829268, 'f1-score': 0.8095238095238095, 'support': 41}, 'macro avg': {'precision': 0.8044444444444444, 'recall': 0.8455882352941176, 'f1-score': 0.8244897959183674, 'support': 41}, 'weighted avg': {'precision': 0.7900271002710029, 'recall': 0.8292682926829268, 'f1-score': 0.8091587854654056, 'support': 41}}
Token level accuracy: 0.961439588688946



{'C': {'precision': 0.8888888888888888, 'recall': 0.9411764705882353, 'f1-score': 0.9142857142857143, 'support': 17}, 'P': {'precision': 0.72, 'recall': 0.75, 'f1-score': 0.7346938775510204, 'support': 24}, 'micro avg': {'precision': 0.7906976744186046, 'recall': 0.8292682926829268, 'f1-score': 0.8095238095238095, 'support': 41}, 'macro avg': {'precision': 0.8044444444444444, 'recall': 0.8455882352941176, 'f1-score': 0.8244897959183674, 'support': 41}, 'weighted avg': {'precision': 0.7900271002710029, 'recall': 0.8292682926829268, 'f1-score': 0.8091587854654056, 'support': 41}}
Token level accuracy: 0.961439588688946
Dev-Data: Prec: 0.791, Rec: 0.829, F1: 0.8095



{'C': {'precision': 0.1326973113616652, 'recall': 0.21191135734072022, 'f1-score': 0.16319999999999998, 'support': 722}, 'P': {'precision': 0.15005599104143338, 'recall': 0.14225053078556263, 'f1-score': 0.14604904632152588, 'support': 942}, 'micro avg': {'precision': 0.1402737047898338, 'recall': 0.17247596153846154, 'f1-score': 0.15471698113207544, 'support': 1664}, 'macro avg': {'precision': 0.1413766512015493, 'recall': 0.17708094406314143, 'f1-score': 0.15462452316076292, 'support': 1664}, 'weighted avg': {'precision': 0.1425241600746109, 'recall': 0.17247596153846154, 'f1-score': 0.1534907461748061, 'support': 1664}}
Token level accuracy: 0.4984367574597934
Wrong BIO-Encoding 443/2455 labels, 18.04%



{'C': {'precision': 0.1326973113616652, 'recall': 0.21191135734072022, 'f1-score': 0.16319999999999998, 'support': 722}, 'P': {'precision': 0.15005599104143338, 'recall': 0.14225053078556263, 'f1-score': 0.14604904632152588, 'support': 942}, 'micro avg': {'precision': 0.1402737047898338, 'recall': 0.17247596153846154, 'f1-score': 0.15471698113207544, 'support': 1664}, 'macro avg': {'precision': 0.1413766512015493, 'recall': 0.17708094406314143, 'f1-score': 0.15462452316076292, 'support': 1664}, 'weighted avg': {'precision': 0.1425241600746109, 'recall': 0.17247596153846154, 'f1-score': 0.1534907461748061, 'support': 1664}}
Token level accuracy: 0.4984367574597934
Wrong BIO-Encoding 34/2046 labels, 1.66%
Test-Data: Prec: 0.143, Rec: 0.172, F1: 0.1561

Scores from epoch with best dev-scores:
  Dev-Score: 0.9157
  Test-Score 0.1777

8.89 sec for evaluation

--------- Epoch 38 -----------
222.27 sec for training (8775.62 total)
-- cmv_modes1 --



{'C': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 17}, 'P': {'precision': 0.8846153846153846, 'recall': 0.9583333333333334, 'f1-score': 0.9199999999999999, 'support': 24}, 'micro avg': {'precision': 0.9302325581395349, 'recall': 0.975609756097561, 'f1-score': 0.9523809523809524, 'support': 41}, 'macro avg': {'precision': 0.9423076923076923, 'recall': 0.9791666666666667, 'f1-score': 0.96, 'support': 41}, 'weighted avg': {'precision': 0.9324577861163226, 'recall': 0.975609756097561, 'f1-score': 0.953170731707317, 'support': 41}}
Token level accuracy: 0.993573264781491



{'C': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 17}, 'P': {'precision': 0.8846153846153846, 'recall': 0.9583333333333334, 'f1-score': 0.9199999999999999, 'support': 24}, 'micro avg': {'precision': 0.9302325581395349, 'recall': 0.975609756097561, 'f1-score': 0.9523809523809524, 'support': 41}, 'macro avg': {'precision': 0.9423076923076923, 'recall': 0.9791666666666667, 'f1-score': 0.96, 'support': 41}, 'weighted avg': {'precision': 0.9324577861163226, 'recall': 0.975609756097561, 'f1-score': 0.953170731707317, 'support': 41}}
Token level accuracy: 0.993573264781491
Dev-Data: Prec: 0.930, Rec: 0.976, F1: 0.9524



{'C': {'precision': 0.14891416752843847, 'recall': 0.1994459833795014, 'f1-score': 0.1705150976909414, 'support': 722}, 'P': {'precision': 0.18889970788704966, 'recall': 0.2059447983014862, 'f1-score': 0.19705434230573898, 'support': 942}, 'micro avg': {'precision': 0.16950852557673018, 'recall': 0.203125, 'f1-score': 0.18480043739748497, 'support': 1664}, 'macro avg': {'precision': 0.16890693770774406, 'recall': 0.20269539084049382, 'f1-score': 0.18378471999834017, 'support': 1664}, 'weighted avg': {'precision': 0.17155021261125805, 'recall': 0.203125, 'f1-score': 0.18553911717840493, 'support': 1664}}
Token level accuracy: 0.5223731272354368
Wrong BIO-Encoding 385/2341 labels, 16.45%



{'C': {'precision': 0.14891416752843847, 'recall': 0.1994459833795014, 'f1-score': 0.1705150976909414, 'support': 722}, 'P': {'precision': 0.18889970788704966, 'recall': 0.2059447983014862, 'f1-score': 0.19705434230573898, 'support': 942}, 'micro avg': {'precision': 0.16950852557673018, 'recall': 0.203125, 'f1-score': 0.18480043739748497, 'support': 1664}, 'macro avg': {'precision': 0.16890693770774406, 'recall': 0.20269539084049382, 'f1-score': 0.18378471999834017, 'support': 1664}, 'weighted avg': {'precision': 0.17155021261125805, 'recall': 0.203125, 'f1-score': 0.18553911717840493, 'support': 1664}}
Token level accuracy: 0.5223731272354368
Wrong BIO-Encoding 38/1994 labels, 1.91%
Test-Data: Prec: 0.173, Rec: 0.203, F1: 0.1867

Scores from epoch with best dev-scores:
  Dev-Score: 0.9524
  Test-Score 0.1867

8.68 sec for evaluation

--------- Epoch 39 -----------
224.03 sec for training (8999.65 total)
-- cmv_modes1 --



{'C': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 17}, 'P': {'precision': 0.84, 'recall': 0.875, 'f1-score': 0.8571428571428572, 'support': 24}, 'micro avg': {'precision': 0.9047619047619048, 'recall': 0.926829268292683, 'f1-score': 0.9156626506024096, 'support': 41}, 'macro avg': {'precision': 0.9199999999999999, 'recall': 0.9375, 'f1-score': 0.9285714285714286, 'support': 41}, 'weighted avg': {'precision': 0.9063414634146341, 'recall': 0.926829268292683, 'f1-score': 0.916376306620209, 'support': 41}}
Token level accuracy: 0.993573264781491



{'C': {'precision': 1.0, 'recall': 1.0, 'f1-score': 1.0, 'support': 17}, 'P': {'precision': 0.84, 'recall': 0.875, 'f1-score': 0.8571428571428572, 'support': 24}, 'micro avg': {'precision': 0.9047619047619048, 'recall': 0.926829268292683, 'f1-score': 0.9156626506024096, 'support': 41}, 'macro avg': {'precision': 0.9199999999999999, 'recall': 0.9375, 'f1-score': 0.9285714285714286, 'support': 41}, 'weighted avg': {'precision': 0.9063414634146341, 'recall': 0.926829268292683, 'f1-score': 0.916376306620209, 'support': 41}}
Token level accuracy: 0.993573264781491
Dev-Data: Prec: 0.905, Rec: 0.927, F1: 0.9157



{'C': {'precision': 0.1522633744855967, 'recall': 0.15373961218836565, 'f1-score': 0.15299793246037216, 'support': 722}, 'P': {'precision': 0.19585849870578084, 'recall': 0.24097664543524416, 'f1-score': 0.21608757734412185, 'support': 942}, 'micro avg': {'precision': 0.17902542372881355, 'recall': 0.203125, 'f1-score': 0.1903153153153153, 'support': 1664}, 'macro avg': {'precision': 0.17406093659568878, 'recall': 0.19735812881180492, 'f1-score': 0.184542754902247, 'support': 1664}, 'weighted avg': {'precision': 0.17694282581697499, 'recall': 0.203125, 'f1-score': 0.18871334440778337, 'support': 1664}}
Token level accuracy: 0.521647782696781
Wrong BIO-Encoding 766/2594 labels, 29.53%



{'C': {'precision': 0.1522633744855967, 'recall': 0.15373961218836565, 'f1-score': 0.15299793246037216, 'support': 722}, 'P': {'precision': 0.19585849870578084, 'recall': 0.24097664543524416, 'f1-score': 0.21608757734412185, 'support': 942}, 'micro avg': {'precision': 0.17902542372881355, 'recall': 0.203125, 'f1-score': 0.1903153153153153, 'support': 1664}, 'macro avg': {'precision': 0.17406093659568878, 'recall': 0.19735812881180492, 'f1-score': 0.184542754902247, 'support': 1664}, 'weighted avg': {'precision': 0.17694282581697499, 'recall': 0.203125, 'f1-score': 0.18871334440778337, 'support': 1664}}
Token level accuracy: 0.521647782696781
Wrong BIO-Encoding 60/1888 labels, 3.18%
Test-Data: Prec: 0.185, Rec: 0.203, F1: 0.1936

Scores from epoch with best dev-scores:
  Dev-Score: 0.9524
  Test-Score 0.1867

8.87 sec for evaluation

--------- Epoch 40 -----------
225.00 sec for training (9224.65 total)
-- cmv_modes1 --



{'C': {'precision': 0.8947368421052632, 'recall': 1.0, 'f1-score': 0.9444444444444444, 'support': 17}, 'P': {'precision': 0.9130434782608695, 'recall': 0.875, 'f1-score': 0.8936170212765957, 'support': 24}, 'micro avg': {'precision': 0.9047619047619048, 'recall': 0.926829268292683, 'f1-score': 0.9156626506024096, 'support': 41}, 'macro avg': {'precision': 0.9038901601830663, 'recall': 0.9375, 'f1-score': 0.9190307328605201, 'support': 41}, 'weighted avg': {'precision': 0.9054529218061058, 'recall': 0.926829268292683, 'f1-score': 0.9146918064925329, 'support': 41}}
Token level accuracy: 0.9781491002570694



{'C': {'precision': 0.8947368421052632, 'recall': 1.0, 'f1-score': 0.9444444444444444, 'support': 17}, 'P': {'precision': 0.9130434782608695, 'recall': 0.875, 'f1-score': 0.8936170212765957, 'support': 24}, 'micro avg': {'precision': 0.9047619047619048, 'recall': 0.926829268292683, 'f1-score': 0.9156626506024096, 'support': 41}, 'macro avg': {'precision': 0.9038901601830663, 'recall': 0.9375, 'f1-score': 0.9190307328605201, 'support': 41}, 'weighted avg': {'precision': 0.9054529218061058, 'recall': 0.926829268292683, 'f1-score': 0.9146918064925329, 'support': 41}}
Token level accuracy: 0.9781491002570694
Dev-Data: Prec: 0.905, Rec: 0.927, F1: 0.9157



{'C': {'precision': 0.13432835820895522, 'recall': 0.21191135734072022, 'f1-score': 0.1644277270284793, 'support': 722}, 'P': {'precision': 0.17084826762246116, 'recall': 0.15180467091295116, 'f1-score': 0.16076447442383363, 'support': 942}, 'micro avg': {'precision': 0.14979757085020243, 'recall': 0.1778846153846154, 'f1-score': 0.16263736263736264, 'support': 1664}, 'macro avg': {'precision': 0.15258831291570818, 'recall': 0.1818580141268357, 'f1-score': 0.16259610072615646, 'support': 1664}, 'weighted avg': {'precision': 0.155002489619726, 'recall': 0.1778846153846154, 'f1-score': 0.16235393859483974, 'support': 1664}}
Token level accuracy: 0.49728621095020137
Wrong BIO-Encoding 682/2603 labels, 26.20%



{'C': {'precision': 0.13432835820895522, 'recall': 0.21191135734072022, 'f1-score': 0.1644277270284793, 'support': 722}, 'P': {'precision': 0.17084826762246116, 'recall': 0.15180467091295116, 'f1-score': 0.16076447442383363, 'support': 942}, 'micro avg': {'precision': 0.14979757085020243, 'recall': 0.1778846153846154, 'f1-score': 0.16263736263736264, 'support': 1664}, 'macro avg': {'precision': 0.15258831291570818, 'recall': 0.1818580141268357, 'f1-score': 0.16259610072615646, 'support': 1664}, 'weighted avg': {'precision': 0.155002489619726, 'recall': 0.1778846153846154, 'f1-score': 0.16235393859483974, 'support': 1664}}
Token level accuracy: 0.49728621095020137
Wrong BIO-Encoding 55/1976 labels, 2.78%
Test-Data: Prec: 0.154, Rec: 0.178, F1: 0.1651

Scores from epoch with best dev-scores:
  Dev-Score: 0.9524
  Test-Score 0.1867

8.92 sec for evaluation
---------RUN 4 ------------
Generate new embeddings files for a dataset
Read file: komninos_english_embeddings.gz
Added words: 10
:: Transform cmv_modes dataset ::
:: Create Train Matrix ::
Unknown-Tokens: 0.79%
:: Create Dev Matrix ::
Unknown-Tokens: 1.03%
:: Create Test Matrix ::
Unknown-Tokens: 0.99%
:: Transform cmv_modes1 dataset ::
:: Create Train Matrix ::
Unknown-Tokens: 0.79%
:: Create Dev Matrix ::
Unknown-Tokens: 1.03%
:: Create Test Matrix ::
Unknown-Tokens: 0.99%
:: Transform cmv_modes2 dataset ::
:: Create Train Matrix ::
Unknown-Tokens: 0.79%
:: Create Dev Matrix ::
Unknown-Tokens: 1.03%
:: Create Test Matrix ::
Unknown-Tokens: 0.99%
DONE - Embeddings file saved: pkl/cmv_modes_cmv_modes1_cmv_modes2_komninos_english_embeddings.pkl
--- cmv_modes ---
232 train sentences
5 dev sentences
224 test sentences
--- cmv_modes1 ---
232 train sentences
5 dev sentences
224 test sentences
--- cmv_modes2 ---
232 train sentences
5 dev sentences
224 test sentences
LSTM-Size: [100]
_____________________________________________________________________________________________________________________________
Layer (type)                             Output Shape               Param #        Connected to                              
=============================================================================================================================
words_input (InputLayer)                 (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
casing_input (InputLayer)                (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
word_embeddings (Embedding)              (None, None, 300)          66694800       words_input[0][0]                         
_____________________________________________________________________________________________________________________________
casing_emebddings (Embedding)            (None, None, 10)           80             casing_input[0][0]                        
_____________________________________________________________________________________________________________________________
concatenate_1 (Concatenate)              (None, None, 310)          0              word_embeddings[0][0]                     
                                                                                   casing_emebddings[0][0]                   
_____________________________________________________________________________________________________________________________
shared_varLSTM_1 (Bidirectional)         (None, None, 200)          328800         concatenate_1[0][0]                       
_____________________________________________________________________________________________________________________________
cmv_modes_hidden_lin_layer (TimeDistribu (None, None, 287)          57687          shared_varLSTM_1[0][0]                    
_____________________________________________________________________________________________________________________________
cmv_modes_crf (ChainCRF)                 (None, None, 287)          82943          cmv_modes_hidden_lin_layer[0][0]          
=============================================================================================================================
Total params: 67,164,310
Trainable params: 469,510
Non-trainable params: 66,694,800
_____________________________________________________________________________________________________________________________
_____________________________________________________________________________________________________________________________
Layer (type)                             Output Shape               Param #        Connected to                              
=============================================================================================================================
words_input (InputLayer)                 (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
casing_input (InputLayer)                (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
word_embeddings (Embedding)              (None, None, 300)          66694800       words_input[0][0]                         
_____________________________________________________________________________________________________________________________
casing_emebddings (Embedding)            (None, None, 10)           80             casing_input[0][0]                        
_____________________________________________________________________________________________________________________________
concatenate_1 (Concatenate)              (None, None, 310)          0              word_embeddings[0][0]                     
                                                                                   casing_emebddings[0][0]                   
_____________________________________________________________________________________________________________________________
shared_varLSTM_1 (Bidirectional)         (None, None, 200)          328800         concatenate_1[0][0]                       
_____________________________________________________________________________________________________________________________
cmv_modes1_hidden_lin_layer (TimeDistrib (None, None, 5)            1005           shared_varLSTM_1[0][0]                    
_____________________________________________________________________________________________________________________________
cmv_modes1_crf (ChainCRF)                (None, None, 5)            35             cmv_modes1_hidden_lin_layer[0][0]         
=============================================================================================================================
Total params: 67,024,720
Trainable params: 329,920
Non-trainable params: 66,694,800
_____________________________________________________________________________________________________________________________
_____________________________________________________________________________________________________________________________
Layer (type)                             Output Shape               Param #        Connected to                              
=============================================================================================================================
words_input (InputLayer)                 (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
casing_input (InputLayer)                (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
word_embeddings (Embedding)              (None, None, 300)          66694800       words_input[0][0]                         
_____________________________________________________________________________________________________________________________
casing_emebddings (Embedding)            (None, None, 10)           80             casing_input[0][0]                        
_____________________________________________________________________________________________________________________________
concatenate_1 (Concatenate)              (None, None, 310)          0              word_embeddings[0][0]                     
                                                                                   casing_emebddings[0][0]                   
_____________________________________________________________________________________________________________________________
shared_varLSTM_1 (Bidirectional)         (None, None, 200)          328800         concatenate_1[0][0]                       
_____________________________________________________________________________________________________________________________
cmv_modes2_softmax (TimeDistributed)     (None, None, 119)          23919          shared_varLSTM_1[0][0]                    
=============================================================================================================================
Total params: 67,047,599
Trainable params: 352,799
Non-trainable params: 66,694,800
_____________________________________________________________________________________________________________________________

--------- Epoch 1 -----------
234.86 sec for training (234.86 total)
-- cmv_modes1 --



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 17}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 24}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 41}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 41}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 41}}
Token level accuracy: 0.2827763496143959
Wrong BIO-Encoding 773/773 labels, 100.00%



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 17}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 24}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 41}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 41}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 41}}
Token level accuracy: 0.2827763496143959
Wrong BIO-Encoding 5/5 labels, 100.00%
Dev-Data: Prec: 0.000, Rec: 0.000, F1: 0.0000



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 795}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 918}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 1713}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 1713}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 1713}}
Token level accuracy: 0.29797979797979796
Wrong BIO-Encoding 40160/40167 labels, 99.98%



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 795}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 918}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 1713}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 1713}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 1713}}
Token level accuracy: 0.29797979797979796
Wrong BIO-Encoding 352/359 labels, 98.05%
Test-Data: Prec: 0.000, Rec: 0.000, F1: 0.0000

Scores from epoch with best dev-scores:
  Dev-Score: 0.0000
  Test-Score 0.0000

9.56 sec for evaluation

--------- Epoch 2 -----------
221.76 sec for training (456.62 total)
-- cmv_modes1 --



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 17}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 24}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 41}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 41}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 41}}
Token level accuracy: 0.5501285347043702
Wrong BIO-Encoding 741/743 labels, 99.73%



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 17}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 24}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 41}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 41}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 41}}
Token level accuracy: 0.5501285347043702
Wrong BIO-Encoding 10/12 labels, 83.33%
Dev-Data: Prec: 0.000, Rec: 0.000, F1: 0.0000



{'C': {'precision': 0.016483516483516484, 'recall': 0.011320754716981131, 'f1-score': 0.013422818791946308, 'support': 795}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 918}, 'micro avg': {'precision': 0.008595988538681949, 'recall': 0.005253940455341506, 'f1-score': 0.006521739130434783, 'support': 1713}, 'macro avg': {'precision': 0.008241758241758242, 'recall': 0.005660377358490566, 'f1-score': 0.006711409395973154, 'support': 1713}, 'weighted avg': {'precision': 0.00764996824541483, 'recall': 0.005253940455341506, 'f1-score': 0.006229504343022367, 'support': 1713}}
Token level accuracy: 0.42640345765345766
Wrong BIO-Encoding 37418/37746 labels, 99.13%



{'C': {'precision': 0.016483516483516484, 'recall': 0.011320754716981131, 'f1-score': 0.013422818791946308, 'support': 795}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 918}, 'micro avg': {'precision': 0.008595988538681949, 'recall': 0.005253940455341506, 'f1-score': 0.006521739130434783, 'support': 1713}, 'macro avg': {'precision': 0.008241758241758242, 'recall': 0.005660377358490566, 'f1-score': 0.006711409395973154, 'support': 1713}, 'weighted avg': {'precision': 0.00764996824541483, 'recall': 0.005253940455341506, 'f1-score': 0.006229504343022367, 'support': 1713}}
Token level accuracy: 0.42640345765345766
Wrong BIO-Encoding 719/1047 labels, 68.67%
Test-Data: Prec: 0.009, Rec: 0.005, F1: 0.0065

Scores from epoch with best dev-scores:
  Dev-Score: 0.0000
  Test-Score 0.0000

9.04 sec for evaluation

--------- Epoch 3 -----------
222.22 sec for training (678.84 total)
-- cmv_modes1 --



{'C': {'precision': 0.5, 'recall': 0.058823529411764705, 'f1-score': 0.10526315789473684, 'support': 17}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 24}, 'micro avg': {'precision': 0.14285714285714285, 'recall': 0.024390243902439025, 'f1-score': 0.04166666666666667, 'support': 41}, 'macro avg': {'precision': 0.25, 'recall': 0.029411764705882353, 'f1-score': 0.05263157894736842, 'support': 41}, 'weighted avg': {'precision': 0.2073170731707317, 'recall': 0.024390243902439025, 'f1-score': 0.04364569961489088, 'support': 41}}
Token level accuracy: 0.5642673521850899
Wrong BIO-Encoding 719/721 labels, 99.72%



{'C': {'precision': 0.5, 'recall': 0.058823529411764705, 'f1-score': 0.10526315789473684, 'support': 17}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 24}, 'micro avg': {'precision': 0.14285714285714285, 'recall': 0.024390243902439025, 'f1-score': 0.04166666666666667, 'support': 41}, 'macro avg': {'precision': 0.25, 'recall': 0.029411764705882353, 'f1-score': 0.05263157894736842, 'support': 41}, 'weighted avg': {'precision': 0.2073170731707317, 'recall': 0.024390243902439025, 'f1-score': 0.04364569961489088, 'support': 41}}
Token level accuracy: 0.5642673521850899
Wrong BIO-Encoding 5/7 labels, 71.43%
Dev-Data: Prec: 0.500, Rec: 0.024, F1: 0.0465



{'C': {'precision': 0.035398230088495575, 'recall': 0.010062893081761006, 'f1-score': 0.015670910871694418, 'support': 795}, 'P': {'precision': 0.0026666666666666666, 'recall': 0.0010893246187363835, 'f1-score': 0.0015467904098994587, 'support': 918}, 'micro avg': {'precision': 0.014975041597337771, 'recall': 0.005253940455341506, 'f1-score': 0.007778738115816768, 'support': 1713}, 'macro avg': {'precision': 0.01903244837758112, 'recall': 0.005576108850248695, 'f1-score': 0.008608850640796938, 'support': 1713}, 'weighted avg': {'precision': 0.017857322195186213, 'recall': 0.005253940455341506, 'f1-score': 0.008101767506879607, 'support': 1713}}
Token level accuracy: 0.44233197358197357
Wrong BIO-Encoding 36529/36645 labels, 99.68%



{'C': {'precision': 0.035398230088495575, 'recall': 0.010062893081761006, 'f1-score': 0.015670910871694418, 'support': 795}, 'P': {'precision': 0.0026666666666666666, 'recall': 0.0010893246187363835, 'f1-score': 0.0015467904098994587, 'support': 918}, 'micro avg': {'precision': 0.014975041597337771, 'recall': 0.005253940455341506, 'f1-score': 0.007778738115816768, 'support': 1713}, 'macro avg': {'precision': 0.01903244837758112, 'recall': 0.005576108850248695, 'f1-score': 0.008608850640796938, 'support': 1713}, 'weighted avg': {'precision': 0.017857322195186213, 'recall': 0.005253940455341506, 'f1-score': 0.008101767506879607, 'support': 1713}}
Token level accuracy: 0.44233197358197357
Wrong BIO-Encoding 485/601 labels, 80.70%
Test-Data: Prec: 0.015, Rec: 0.005, F1: 0.0078

Scores from epoch with best dev-scores:
  Dev-Score: 0.0465
  Test-Score 0.0078

8.98 sec for evaluation

--------- Epoch 4 -----------
219.38 sec for training (898.22 total)
-- cmv_modes1 --



{'C': {'precision': 0.16, 'recall': 0.23529411764705882, 'f1-score': 0.19047619047619052, 'support': 17}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 24}, 'micro avg': {'precision': 0.13793103448275862, 'recall': 0.0975609756097561, 'f1-score': 0.1142857142857143, 'support': 41}, 'macro avg': {'precision': 0.08, 'recall': 0.11764705882352941, 'f1-score': 0.09523809523809526, 'support': 41}, 'weighted avg': {'precision': 0.06634146341463415, 'recall': 0.0975609756097561, 'f1-score': 0.07897793263646924, 'support': 41}}
Token level accuracy: 0.6118251928020566
Wrong BIO-Encoding 475/491 labels, 96.74%



{'C': {'precision': 0.16, 'recall': 0.23529411764705882, 'f1-score': 0.19047619047619052, 'support': 17}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 24}, 'micro avg': {'precision': 0.13793103448275862, 'recall': 0.0975609756097561, 'f1-score': 0.1142857142857143, 'support': 41}, 'macro avg': {'precision': 0.08, 'recall': 0.11764705882352941, 'f1-score': 0.09523809523809526, 'support': 41}, 'weighted avg': {'precision': 0.06634146341463415, 'recall': 0.0975609756097561, 'f1-score': 0.07897793263646924, 'support': 41}}
Token level accuracy: 0.6118251928020566
Wrong BIO-Encoding 13/29 labels, 44.83%
Dev-Data: Prec: 0.250, Rec: 0.098, F1: 0.1404



{'C': {'precision': 0.04793510324483776, 'recall': 0.08176100628930817, 'f1-score': 0.0604370060437006, 'support': 795}, 'P': {'precision': 0.01488833746898263, 'recall': 0.006535947712418301, 'f1-score': 0.009084027252081758, 'support': 918}, 'micro avg': {'precision': 0.04036384309266629, 'recall': 0.04144775248102744, 'f1-score': 0.04089861751152074, 'support': 1713}, 'macro avg': {'precision': 0.03141172035691019, 'recall': 0.04414847700086324, 'f1-score': 0.034760516647891176, 'support': 1713}, 'weighted avg': {'precision': 0.030225277802785798, 'recall': 0.04144775248102744, 'f1-score': 0.032916845780591376, 'support': 1713}}
Token level accuracy: 0.44794094794094796
Wrong BIO-Encoding 15466/16445 labels, 94.05%



{'C': {'precision': 0.04793510324483776, 'recall': 0.08176100628930817, 'f1-score': 0.0604370060437006, 'support': 795}, 'P': {'precision': 0.01488833746898263, 'recall': 0.006535947712418301, 'f1-score': 0.009084027252081758, 'support': 918}, 'micro avg': {'precision': 0.04036384309266629, 'recall': 0.04144775248102744, 'f1-score': 0.04089861751152074, 'support': 1713}, 'macro avg': {'precision': 0.03141172035691019, 'recall': 0.04414847700086324, 'f1-score': 0.034760516647891176, 'support': 1713}, 'weighted avg': {'precision': 0.030225277802785798, 'recall': 0.04144775248102744, 'f1-score': 0.032916845780591376, 'support': 1713}}
Token level accuracy: 0.44794094794094796
Wrong BIO-Encoding 780/1759 labels, 44.34%
Test-Data: Prec: 0.068, Rec: 0.039, F1: 0.0498

Scores from epoch with best dev-scores:
  Dev-Score: 0.1404
  Test-Score 0.0498

8.65 sec for evaluation

--------- Epoch 5 -----------
218.47 sec for training (1116.69 total)
-- cmv_modes1 --



{'C': {'precision': 0.16666666666666666, 'recall': 0.11764705882352941, 'f1-score': 0.13793103448275862, 'support': 17}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 24}, 'micro avg': {'precision': 0.07692307692307693, 'recall': 0.04878048780487805, 'f1-score': 0.059701492537313446, 'support': 41}, 'macro avg': {'precision': 0.08333333333333333, 'recall': 0.058823529411764705, 'f1-score': 0.06896551724137931, 'support': 41}, 'weighted avg': {'precision': 0.06910569105691056, 'recall': 0.04878048780487805, 'f1-score': 0.05719091673675357, 'support': 41}}
Token level accuracy: 0.6825192802056556
Wrong BIO-Encoding 62/82 labels, 75.61%



{'C': {'precision': 0.16666666666666666, 'recall': 0.11764705882352941, 'f1-score': 0.13793103448275862, 'support': 17}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 24}, 'micro avg': {'precision': 0.07692307692307693, 'recall': 0.04878048780487805, 'f1-score': 0.059701492537313446, 'support': 41}, 'macro avg': {'precision': 0.08333333333333333, 'recall': 0.058823529411764705, 'f1-score': 0.06896551724137931, 'support': 41}, 'weighted avg': {'precision': 0.06910569105691056, 'recall': 0.04878048780487805, 'f1-score': 0.05719091673675357, 'support': 41}}
Token level accuracy: 0.6825192802056556
Wrong BIO-Encoding 6/26 labels, 23.08%
Dev-Data: Prec: 0.100, Rec: 0.049, F1: 0.0656



{'C': {'precision': 0.08902691511387163, 'recall': 0.05408805031446541, 'f1-score': 0.06729264475743349, 'support': 795}, 'P': {'precision': 0.08762886597938144, 'recall': 0.07407407407407407, 'f1-score': 0.08028335301062574, 'support': 918}, 'micro avg': {'precision': 0.08816521048451152, 'recall': 0.0647985989492119, 'f1-score': 0.07469717362045761, 'support': 1713}, 'macro avg': {'precision': 0.08832789054662654, 'recall': 0.06408106219426973, 'f1-score': 0.07378799888402962, 'support': 1713}, 'weighted avg': {'precision': 0.08827769788943379, 'recall': 0.0647985989492119, 'f1-score': 0.07425439033620201, 'support': 1713}}
Token level accuracy: 0.48863636363636365
Wrong BIO-Encoding 6830/7809 labels, 87.46%



{'C': {'precision': 0.08902691511387163, 'recall': 0.05408805031446541, 'f1-score': 0.06729264475743349, 'support': 795}, 'P': {'precision': 0.08762886597938144, 'recall': 0.07407407407407407, 'f1-score': 0.08028335301062574, 'support': 918}, 'micro avg': {'precision': 0.08816521048451152, 'recall': 0.0647985989492119, 'f1-score': 0.07469717362045761, 'support': 1713}, 'macro avg': {'precision': 0.08832789054662654, 'recall': 0.06408106219426973, 'f1-score': 0.07378799888402962, 'support': 1713}, 'weighted avg': {'precision': 0.08827769788943379, 'recall': 0.0647985989492119, 'f1-score': 0.07425439033620201, 'support': 1713}}
Token level accuracy: 0.48863636363636365
Wrong BIO-Encoding 280/1259 labels, 22.24%
Test-Data: Prec: 0.109, Rec: 0.062, F1: 0.0795

Scores from epoch with best dev-scores:
  Dev-Score: 0.1404
  Test-Score 0.0498

8.88 sec for evaluation

--------- Epoch 6 -----------
217.32 sec for training (1334.01 total)
-- cmv_modes1 --



{'C': {'precision': 0.3333333333333333, 'recall': 0.11764705882352941, 'f1-score': 0.1739130434782609, 'support': 17}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 24}, 'micro avg': {'precision': 0.08, 'recall': 0.04878048780487805, 'f1-score': 0.06060606060606061, 'support': 41}, 'macro avg': {'precision': 0.16666666666666666, 'recall': 0.058823529411764705, 'f1-score': 0.08695652173913045, 'support': 41}, 'weighted avg': {'precision': 0.1382113821138211, 'recall': 0.04878048780487805, 'f1-score': 0.07211028632025451, 'support': 41}}
Token level accuracy: 0.6889460154241646
Wrong BIO-Encoding 69/92 labels, 75.00%



{'C': {'precision': 0.3333333333333333, 'recall': 0.11764705882352941, 'f1-score': 0.1739130434782609, 'support': 17}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 24}, 'micro avg': {'precision': 0.08, 'recall': 0.04878048780487805, 'f1-score': 0.06060606060606061, 'support': 41}, 'macro avg': {'precision': 0.16666666666666666, 'recall': 0.058823529411764705, 'f1-score': 0.08695652173913045, 'support': 41}, 'weighted avg': {'precision': 0.1382113821138211, 'recall': 0.04878048780487805, 'f1-score': 0.07211028632025451, 'support': 41}}
Token level accuracy: 0.6889460154241646
Wrong BIO-Encoding 2/25 labels, 8.00%
Dev-Data: Prec: 0.087, Rec: 0.049, F1: 0.0625



{'C': {'precision': 0.18503937007874016, 'recall': 0.05911949685534591, 'f1-score': 0.0896091515729266, 'support': 795}, 'P': {'precision': 0.1375770020533881, 'recall': 0.14596949891067537, 'f1-score': 0.1416490486257928, 'support': 918}, 'micro avg': {'precision': 0.1473941368078176, 'recall': 0.10566258026853473, 'f1-score': 0.12308738524311458, 'support': 1713}, 'macro avg': {'precision': 0.16130818606606412, 'recall': 0.10254449788301065, 'f1-score': 0.1156291000993597, 'support': 1713}, 'weighted avg': {'precision': 0.1596041956203203, 'recall': 0.10566258026853473, 'f1-score': 0.11749743265554842, 'support': 1713}}
Token level accuracy: 0.47984654234654234
Wrong BIO-Encoding 5654/6695 labels, 84.45%



{'C': {'precision': 0.18503937007874016, 'recall': 0.05911949685534591, 'f1-score': 0.0896091515729266, 'support': 795}, 'P': {'precision': 0.1375770020533881, 'recall': 0.14596949891067537, 'f1-score': 0.1416490486257928, 'support': 918}, 'micro avg': {'precision': 0.1473941368078176, 'recall': 0.10566258026853473, 'f1-score': 0.12308738524311458, 'support': 1713}, 'macro avg': {'precision': 0.16130818606606412, 'recall': 0.10254449788301065, 'f1-score': 0.1156291000993597, 'support': 1713}, 'weighted avg': {'precision': 0.1596041956203203, 'recall': 0.10566258026853473, 'f1-score': 0.11749743265554842, 'support': 1713}}
Token level accuracy: 0.47984654234654234
Wrong BIO-Encoding 187/1228 labels, 15.23%
Test-Data: Prec: 0.172, Rec: 0.104, F1: 0.1300

Scores from epoch with best dev-scores:
  Dev-Score: 0.1404
  Test-Score 0.0498

8.84 sec for evaluation

--------- Epoch 7 -----------
217.90 sec for training (1551.90 total)
-- cmv_modes1 --



{'C': {'precision': 0.25, 'recall': 0.11764705882352941, 'f1-score': 0.15999999999999998, 'support': 17}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 24}, 'micro avg': {'precision': 0.05555555555555555, 'recall': 0.04878048780487805, 'f1-score': 0.05194805194805195, 'support': 41}, 'macro avg': {'precision': 0.125, 'recall': 0.058823529411764705, 'f1-score': 0.07999999999999999, 'support': 41}, 'weighted avg': {'precision': 0.10365853658536585, 'recall': 0.04878048780487805, 'f1-score': 0.06634146341463414, 'support': 41}}
Token level accuracy: 0.7455012853470437
Wrong BIO-Encoding 48/81 labels, 59.26%



{'C': {'precision': 0.25, 'recall': 0.11764705882352941, 'f1-score': 0.15999999999999998, 'support': 17}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 24}, 'micro avg': {'precision': 0.05555555555555555, 'recall': 0.04878048780487805, 'f1-score': 0.05194805194805195, 'support': 41}, 'macro avg': {'precision': 0.125, 'recall': 0.058823529411764705, 'f1-score': 0.07999999999999999, 'support': 41}, 'weighted avg': {'precision': 0.10365853658536585, 'recall': 0.04878048780487805, 'f1-score': 0.06634146341463414, 'support': 41}}
Token level accuracy: 0.7455012853470437
Wrong BIO-Encoding 3/36 labels, 8.33%
Dev-Data: Prec: 0.061, Rec: 0.049, F1: 0.0541



{'C': {'precision': 0.16139240506329114, 'recall': 0.06415094339622641, 'f1-score': 0.0918091809180918, 'support': 795}, 'P': {'precision': 0.1869009584664537, 'recall': 0.2549019607843137, 'f1-score': 0.21566820276497695, 'support': 918}, 'micro avg': {'precision': 0.18176020408163265, 'recall': 0.16637478108581435, 'f1-score': 0.17372752209692166, 'support': 1713}, 'macro avg': {'precision': 0.1741466817648724, 'recall': 0.15952645209027005, 'f1-score': 0.15373869184153438, 'support': 1713}, 'weighted avg': {'precision': 0.17506248797286686, 'recall': 0.16637478108581435, 'f1-score': 0.15818546933341027, 'support': 1713}}
Token level accuracy: 0.5109508547008547
Wrong BIO-Encoding 4562/5906 labels, 77.24%



{'C': {'precision': 0.16139240506329114, 'recall': 0.06415094339622641, 'f1-score': 0.0918091809180918, 'support': 795}, 'P': {'precision': 0.1869009584664537, 'recall': 0.2549019607843137, 'f1-score': 0.21566820276497695, 'support': 918}, 'micro avg': {'precision': 0.18176020408163265, 'recall': 0.16637478108581435, 'f1-score': 0.17372752209692166, 'support': 1713}, 'macro avg': {'precision': 0.1741466817648724, 'recall': 0.15952645209027005, 'f1-score': 0.15373869184153438, 'support': 1713}, 'weighted avg': {'precision': 0.17506248797286686, 'recall': 0.16637478108581435, 'f1-score': 0.15818546933341027, 'support': 1713}}
Token level accuracy: 0.5109508547008547
Wrong BIO-Encoding 224/1568 labels, 14.29%
Test-Data: Prec: 0.210, Rec: 0.165, F1: 0.1845

Scores from epoch with best dev-scores:
  Dev-Score: 0.1404
  Test-Score 0.0498

9.14 sec for evaluation

--------- Epoch 8 -----------
221.09 sec for training (1773.00 total)
-- cmv_modes1 --



{'C': {'precision': 0.19047619047619047, 'recall': 0.23529411764705882, 'f1-score': 0.21052631578947367, 'support': 17}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 24}, 'micro avg': {'precision': 0.11764705882352941, 'recall': 0.0975609756097561, 'f1-score': 0.10666666666666667, 'support': 41}, 'macro avg': {'precision': 0.09523809523809523, 'recall': 0.11764705882352941, 'f1-score': 0.10526315789473684, 'support': 41}, 'weighted avg': {'precision': 0.07897793263646923, 'recall': 0.0975609756097561, 'f1-score': 0.08729139922978175, 'support': 41}}
Token level accuracy: 0.6799485861182519
Wrong BIO-Encoding 11/44 labels, 25.00%



{'C': {'precision': 0.19047619047619047, 'recall': 0.23529411764705882, 'f1-score': 0.21052631578947367, 'support': 17}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 24}, 'micro avg': {'precision': 0.11764705882352941, 'recall': 0.0975609756097561, 'f1-score': 0.10666666666666667, 'support': 41}, 'macro avg': {'precision': 0.09523809523809523, 'recall': 0.11764705882352941, 'f1-score': 0.10526315789473684, 'support': 41}, 'weighted avg': {'precision': 0.07897793263646923, 'recall': 0.0975609756097561, 'f1-score': 0.08729139922978175, 'support': 41}}
Token level accuracy: 0.6799485861182519
Wrong BIO-Encoding 1/34 labels, 2.94%
Dev-Data: Prec: 0.121, Rec: 0.098, F1: 0.1081



{'C': {'precision': 0.13333333333333333, 'recall': 0.17358490566037735, 'f1-score': 0.15081967213114755, 'support': 795}, 'P': {'precision': 0.20203488372093023, 'recall': 0.1514161220043573, 'f1-score': 0.17310087173100872, 'support': 918}, 'micro avg': {'precision': 0.1607661056297156, 'recall': 0.16170461179217746, 'f1-score': 0.1612339930151339, 'support': 1713}, 'macro avg': {'precision': 0.16768410852713178, 'recall': 0.16250051383236733, 'f1-score': 0.16196027193107815, 'support': 1713}, 'weighted avg': {'precision': 0.1701506265357933, 'recall': 0.16170461179217746, 'f1-score': 0.162760209920215, 'support': 1713}}
Token level accuracy: 0.4810606060606061
Wrong BIO-Encoding 3071/4660 labels, 65.90%



{'C': {'precision': 0.13333333333333333, 'recall': 0.17358490566037735, 'f1-score': 0.15081967213114755, 'support': 795}, 'P': {'precision': 0.20203488372093023, 'recall': 0.1514161220043573, 'f1-score': 0.17310087173100872, 'support': 918}, 'micro avg': {'precision': 0.1607661056297156, 'recall': 0.16170461179217746, 'f1-score': 0.1612339930151339, 'support': 1713}, 'macro avg': {'precision': 0.16768410852713178, 'recall': 0.16250051383236733, 'f1-score': 0.16196027193107815, 'support': 1713}, 'weighted avg': {'precision': 0.1701506265357933, 'recall': 0.16170461179217746, 'f1-score': 0.162760209920215, 'support': 1713}}
Token level accuracy: 0.4810606060606061
Wrong BIO-Encoding 134/1723 labels, 7.78%
Test-Data: Prec: 0.174, Rec: 0.161, F1: 0.1672

Scores from epoch with best dev-scores:
  Dev-Score: 0.1404
  Test-Score 0.0498

8.94 sec for evaluation

--------- Epoch 9 -----------
221.62 sec for training (1994.61 total)
-- cmv_modes1 --



{'C': {'precision': 0.3076923076923077, 'recall': 0.23529411764705882, 'f1-score': 0.26666666666666666, 'support': 17}, 'P': {'precision': 0.07692307692307693, 'recall': 0.08333333333333333, 'f1-score': 0.08, 'support': 24}, 'micro avg': {'precision': 0.15384615384615385, 'recall': 0.14634146341463414, 'f1-score': 0.15, 'support': 41}, 'macro avg': {'precision': 0.19230769230769232, 'recall': 0.15931372549019607, 'f1-score': 0.17333333333333334, 'support': 41}, 'weighted avg': {'precision': 0.17260787992495308, 'recall': 0.14634146341463414, 'f1-score': 0.15739837398373982, 'support': 41}}
Token level accuracy: 0.7969151670951157



{'C': {'precision': 0.3076923076923077, 'recall': 0.23529411764705882, 'f1-score': 0.26666666666666666, 'support': 17}, 'P': {'precision': 0.07692307692307693, 'recall': 0.08333333333333333, 'f1-score': 0.08, 'support': 24}, 'micro avg': {'precision': 0.15384615384615385, 'recall': 0.14634146341463414, 'f1-score': 0.15, 'support': 41}, 'macro avg': {'precision': 0.19230769230769232, 'recall': 0.15931372549019607, 'f1-score': 0.17333333333333334, 'support': 41}, 'weighted avg': {'precision': 0.17260787992495308, 'recall': 0.14634146341463414, 'f1-score': 0.15739837398373982, 'support': 41}}
Token level accuracy: 0.7969151670951157
Dev-Data: Prec: 0.154, Rec: 0.146, F1: 0.1500



{'C': {'precision': 0.13242574257425743, 'recall': 0.13459119496855346, 'f1-score': 0.13349968808484092, 'support': 795}, 'P': {'precision': 0.2002002002002002, 'recall': 0.2178649237472767, 'f1-score': 0.20865936358894105, 'support': 918}, 'micro avg': {'precision': 0.16989485334809076, 'recall': 0.17921774664331583, 'f1-score': 0.1744318181818182, 'support': 1713}, 'macro avg': {'precision': 0.16631297138722884, 'recall': 0.17622805935791508, 'f1-score': 0.17107952583689098, 'support': 1713}, 'weighted avg': {'precision': 0.16874620497975393, 'recall': 0.17921774664331583, 'f1-score': 0.17377790297845674, 'support': 1713}}
Token level accuracy: 0.5320270007770008
Wrong BIO-Encoding 2748/4405 labels, 62.38%



{'C': {'precision': 0.13242574257425743, 'recall': 0.13459119496855346, 'f1-score': 0.13349968808484092, 'support': 795}, 'P': {'precision': 0.2002002002002002, 'recall': 0.2178649237472767, 'f1-score': 0.20865936358894105, 'support': 918}, 'micro avg': {'precision': 0.16989485334809076, 'recall': 0.17921774664331583, 'f1-score': 0.1744318181818182, 'support': 1713}, 'macro avg': {'precision': 0.16631297138722884, 'recall': 0.17622805935791508, 'f1-score': 0.17107952583689098, 'support': 1713}, 'weighted avg': {'precision': 0.16874620497975393, 'recall': 0.17921774664331583, 'f1-score': 0.17377790297845674, 'support': 1713}}
Token level accuracy: 0.5320270007770008
Wrong BIO-Encoding 150/1807 labels, 8.30%
Test-Data: Prec: 0.184, Rec: 0.178, F1: 0.1810

Scores from epoch with best dev-scores:
  Dev-Score: 0.1500
  Test-Score 0.1810

9.04 sec for evaluation

--------- Epoch 10 -----------
222.38 sec for training (2216.99 total)
-- cmv_modes1 --



{'C': {'precision': 0.2727272727272727, 'recall': 0.17647058823529413, 'f1-score': 0.21428571428571427, 'support': 17}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 24}, 'micro avg': {'precision': 0.09375, 'recall': 0.07317073170731707, 'f1-score': 0.08219178082191779, 'support': 41}, 'macro avg': {'precision': 0.13636363636363635, 'recall': 0.08823529411764706, 'f1-score': 0.10714285714285714, 'support': 41}, 'weighted avg': {'precision': 0.11308203991130819, 'recall': 0.07317073170731707, 'f1-score': 0.08885017421602787, 'support': 41}}
Token level accuracy: 0.7107969151670951



{'C': {'precision': 0.2727272727272727, 'recall': 0.17647058823529413, 'f1-score': 0.21428571428571427, 'support': 17}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 24}, 'micro avg': {'precision': 0.09375, 'recall': 0.07317073170731707, 'f1-score': 0.08219178082191779, 'support': 41}, 'macro avg': {'precision': 0.13636363636363635, 'recall': 0.08823529411764706, 'f1-score': 0.10714285714285714, 'support': 41}, 'weighted avg': {'precision': 0.11308203991130819, 'recall': 0.07317073170731707, 'f1-score': 0.08885017421602787, 'support': 41}}
Token level accuracy: 0.7107969151670951
Dev-Data: Prec: 0.094, Rec: 0.073, F1: 0.0822



{'C': {'precision': 0.12239221140472879, 'recall': 0.11069182389937107, 'f1-score': 0.11624834874504623, 'support': 795}, 'P': {'precision': 0.18238993710691823, 'recall': 0.1579520697167756, 'f1-score': 0.1692936368943374, 'support': 918}, 'micro avg': {'precision': 0.15389696169088507, 'recall': 0.13601868067717454, 'f1-score': 0.14440656956925937, 'support': 1713}, 'macro avg': {'precision': 0.15239107425582352, 'recall': 0.13432194680807336, 'f1-score': 0.14277099281969183, 'support': 1713}, 'weighted avg': {'precision': 0.15454510819084083, 'recall': 0.13601868067717454, 'f1-score': 0.14467542085307267, 'support': 1713}}
Token level accuracy: 0.5015297202797203
Wrong BIO-Encoding 3670/5005 labels, 73.33%



{'C': {'precision': 0.12239221140472879, 'recall': 0.11069182389937107, 'f1-score': 0.11624834874504623, 'support': 795}, 'P': {'precision': 0.18238993710691823, 'recall': 0.1579520697167756, 'f1-score': 0.1692936368943374, 'support': 918}, 'micro avg': {'precision': 0.15389696169088507, 'recall': 0.13601868067717454, 'f1-score': 0.14440656956925937, 'support': 1713}, 'macro avg': {'precision': 0.15239107425582352, 'recall': 0.13432194680807336, 'f1-score': 0.14277099281969183, 'support': 1713}, 'weighted avg': {'precision': 0.15454510819084083, 'recall': 0.13601868067717454, 'f1-score': 0.14467542085307267, 'support': 1713}}
Token level accuracy: 0.5015297202797203
Wrong BIO-Encoding 179/1514 labels, 11.82%
Test-Data: Prec: 0.175, Rec: 0.136, F1: 0.1529

Scores from epoch with best dev-scores:
  Dev-Score: 0.1500
  Test-Score 0.1810

8.93 sec for evaluation

--------- Epoch 11 -----------
221.54 sec for training (2438.53 total)
-- cmv_modes1 --



{'C': {'precision': 0.3, 'recall': 0.17647058823529413, 'f1-score': 0.22222222222222224, 'support': 17}, 'P': {'precision': 0.041666666666666664, 'recall': 0.041666666666666664, 'f1-score': 0.041666666666666664, 'support': 24}, 'micro avg': {'precision': 0.11764705882352941, 'recall': 0.0975609756097561, 'f1-score': 0.10666666666666667, 'support': 41}, 'macro avg': {'precision': 0.17083333333333334, 'recall': 0.1090686274509804, 'f1-score': 0.13194444444444445, 'support': 41}, 'weighted avg': {'precision': 0.14878048780487804, 'recall': 0.0975609756097561, 'f1-score': 0.11653116531165314, 'support': 41}}
Token level accuracy: 0.781491002570694



{'C': {'precision': 0.3, 'recall': 0.17647058823529413, 'f1-score': 0.22222222222222224, 'support': 17}, 'P': {'precision': 0.041666666666666664, 'recall': 0.041666666666666664, 'f1-score': 0.041666666666666664, 'support': 24}, 'micro avg': {'precision': 0.11764705882352941, 'recall': 0.0975609756097561, 'f1-score': 0.10666666666666667, 'support': 41}, 'macro avg': {'precision': 0.17083333333333334, 'recall': 0.1090686274509804, 'f1-score': 0.13194444444444445, 'support': 41}, 'weighted avg': {'precision': 0.14878048780487804, 'recall': 0.0975609756097561, 'f1-score': 0.11653116531165314, 'support': 41}}
Token level accuracy: 0.781491002570694
Dev-Data: Prec: 0.118, Rec: 0.098, F1: 0.1067



{'C': {'precision': 0.1900369003690037, 'recall': 0.12955974842767295, 'f1-score': 0.15407629020194466, 'support': 795}, 'P': {'precision': 0.2176063303659743, 'recall': 0.23965141612200436, 'f1-score': 0.22809745982374285, 'support': 918}, 'micro avg': {'precision': 0.20798454603992272, 'recall': 0.18855808523058962, 'f1-score': 0.1977954684629516, 'support': 1713}, 'macro avg': {'precision': 0.203821615367489, 'recall': 0.18460558227483864, 'f1-score': 0.19108687501284377, 'support': 1713}, 'weighted avg': {'precision': 0.2048114110153662, 'recall': 0.18855808523058962, 'f1-score': 0.1937443775999661, 'support': 1713}}
Token level accuracy: 0.5177981740481741
Wrong BIO-Encoding 2757/4188 labels, 65.83%



{'C': {'precision': 0.1900369003690037, 'recall': 0.12955974842767295, 'f1-score': 0.15407629020194466, 'support': 795}, 'P': {'precision': 0.2176063303659743, 'recall': 0.23965141612200436, 'f1-score': 0.22809745982374285, 'support': 918}, 'micro avg': {'precision': 0.20798454603992272, 'recall': 0.18855808523058962, 'f1-score': 0.1977954684629516, 'support': 1713}, 'macro avg': {'precision': 0.203821615367489, 'recall': 0.18460558227483864, 'f1-score': 0.19108687501284377, 'support': 1713}, 'weighted avg': {'precision': 0.2048114110153662, 'recall': 0.18855808523058962, 'f1-score': 0.1937443775999661, 'support': 1713}}
Token level accuracy: 0.5177981740481741
Wrong BIO-Encoding 122/1553 labels, 7.86%
Test-Data: Prec: 0.225, Rec: 0.188, F1: 0.2048

Scores from epoch with best dev-scores:
  Dev-Score: 0.1500
  Test-Score 0.1810

8.95 sec for evaluation

--------- Epoch 12 -----------
220.50 sec for training (2659.03 total)
-- cmv_modes1 --



{'C': {'precision': 0.6, 'recall': 0.35294117647058826, 'f1-score': 0.4444444444444445, 'support': 17}, 'P': {'precision': 0.1, 'recall': 0.125, 'f1-score': 0.11111111111111112, 'support': 24}, 'micro avg': {'precision': 0.225, 'recall': 0.21951219512195122, 'f1-score': 0.22222222222222224, 'support': 41}, 'macro avg': {'precision': 0.35, 'recall': 0.23897058823529413, 'f1-score': 0.2777777777777778, 'support': 41}, 'weighted avg': {'precision': 0.3073170731707317, 'recall': 0.21951219512195122, 'f1-score': 0.24932249322493227, 'support': 41}}
Token level accuracy: 0.7994858611825193
Wrong BIO-Encoding 10/49 labels, 20.41%



{'C': {'precision': 0.6, 'recall': 0.35294117647058826, 'f1-score': 0.4444444444444445, 'support': 17}, 'P': {'precision': 0.1, 'recall': 0.125, 'f1-score': 0.11111111111111112, 'support': 24}, 'micro avg': {'precision': 0.225, 'recall': 0.21951219512195122, 'f1-score': 0.22222222222222224, 'support': 41}, 'macro avg': {'precision': 0.35, 'recall': 0.23897058823529413, 'f1-score': 0.2777777777777778, 'support': 41}, 'weighted avg': {'precision': 0.3073170731707317, 'recall': 0.21951219512195122, 'f1-score': 0.24932249322493227, 'support': 41}}
Token level accuracy: 0.7994858611825193
Wrong BIO-Encoding 1/40 labels, 2.50%
Dev-Data: Prec: 0.231, Rec: 0.220, F1: 0.2250



{'C': {'precision': 0.18925831202046037, 'recall': 0.0930817610062893, 'f1-score': 0.12478920741989881, 'support': 795}, 'P': {'precision': 0.19446922390722568, 'recall': 0.2374727668845316, 'f1-score': 0.21383030897498775, 'support': 918}, 'micro avg': {'precision': 0.1931216931216931, 'recall': 0.17046117921774664, 'f1-score': 0.18108527131782948, 'support': 1713}, 'macro avg': {'precision': 0.19186376796384302, 'recall': 0.16527726394541045, 'f1-score': 0.1693097581974433, 'support': 1713}, 'weighted avg': {'precision': 0.19205084973911218, 'recall': 0.17046117921774664, 'f1-score': 0.17250650527604106, 'support': 1713}}
Token level accuracy: 0.5162441724941725
Wrong BIO-Encoding 2016/3418 labels, 58.98%



{'C': {'precision': 0.18925831202046037, 'recall': 0.0930817610062893, 'f1-score': 0.12478920741989881, 'support': 795}, 'P': {'precision': 0.19446922390722568, 'recall': 0.2374727668845316, 'f1-score': 0.21383030897498775, 'support': 918}, 'micro avg': {'precision': 0.1931216931216931, 'recall': 0.17046117921774664, 'f1-score': 0.18108527131782948, 'support': 1713}, 'macro avg': {'precision': 0.19186376796384302, 'recall': 0.16527726394541045, 'f1-score': 0.1693097581974433, 'support': 1713}, 'weighted avg': {'precision': 0.19205084973911218, 'recall': 0.17046117921774664, 'f1-score': 0.17250650527604106, 'support': 1713}}
Token level accuracy: 0.5162441724941725
Wrong BIO-Encoding 110/1512 labels, 7.28%
Test-Data: Prec: 0.208, Rec: 0.170, F1: 0.1868

Scores from epoch with best dev-scores:
  Dev-Score: 0.2250
  Test-Score 0.1868

9.01 sec for evaluation

--------- Epoch 13 -----------
218.54 sec for training (2877.57 total)
-- cmv_modes1 --



{'C': {'precision': 0.5714285714285714, 'recall': 0.47058823529411764, 'f1-score': 0.5161290322580646, 'support': 17}, 'P': {'precision': 0.07692307692307693, 'recall': 0.08333333333333333, 'f1-score': 0.08, 'support': 24}, 'micro avg': {'precision': 0.25, 'recall': 0.24390243902439024, 'f1-score': 0.24691358024691357, 'support': 41}, 'macro avg': {'precision': 0.32417582417582413, 'recall': 0.2769607843137255, 'f1-score': 0.2980645161290323, 'support': 41}, 'weighted avg': {'precision': 0.28196194049852585, 'recall': 0.24390243902439024, 'f1-score': 0.26083398898505117, 'support': 41}}
Token level accuracy: 0.8367609254498715
Wrong BIO-Encoding 19/58 labels, 32.76%



{'C': {'precision': 0.5714285714285714, 'recall': 0.47058823529411764, 'f1-score': 0.5161290322580646, 'support': 17}, 'P': {'precision': 0.07692307692307693, 'recall': 0.08333333333333333, 'f1-score': 0.08, 'support': 24}, 'micro avg': {'precision': 0.25, 'recall': 0.24390243902439024, 'f1-score': 0.24691358024691357, 'support': 41}, 'macro avg': {'precision': 0.32417582417582413, 'recall': 0.2769607843137255, 'f1-score': 0.2980645161290323, 'support': 41}, 'weighted avg': {'precision': 0.28196194049852585, 'recall': 0.24390243902439024, 'f1-score': 0.26083398898505117, 'support': 41}}
Token level accuracy: 0.8367609254498715
Wrong BIO-Encoding 1/40 labels, 2.50%
Dev-Data: Prec: 0.256, Rec: 0.244, F1: 0.2500



{'C': {'precision': 0.15567282321899736, 'recall': 0.14842767295597484, 'f1-score': 0.1519639407598197, 'support': 795}, 'P': {'precision': 0.19200887902330743, 'recall': 0.18845315904139434, 'f1-score': 0.1902144035184167, 'support': 918}, 'micro avg': {'precision': 0.17540687160940324, 'recall': 0.16987740805604204, 'f1-score': 0.17259786476868327, 'support': 1713}, 'macro avg': {'precision': 0.17384085112115238, 'recall': 0.1684404159986846, 'f1-score': 0.1710891721391182, 'support': 1713}, 'weighted avg': {'precision': 0.17514538552393413, 'recall': 0.16987740805604204, 'f1-score': 0.17246243743955822, 'support': 1713}}
Token level accuracy: 0.5232371794871795
Wrong BIO-Encoding 1931/3482 labels, 55.46%



{'C': {'precision': 0.15567282321899736, 'recall': 0.14842767295597484, 'f1-score': 0.1519639407598197, 'support': 795}, 'P': {'precision': 0.19200887902330743, 'recall': 0.18845315904139434, 'f1-score': 0.1902144035184167, 'support': 918}, 'micro avg': {'precision': 0.17540687160940324, 'recall': 0.16987740805604204, 'f1-score': 0.17259786476868327, 'support': 1713}, 'macro avg': {'precision': 0.17384085112115238, 'recall': 0.1684404159986846, 'f1-score': 0.1710891721391182, 'support': 1713}, 'weighted avg': {'precision': 0.17514538552393413, 'recall': 0.16987740805604204, 'f1-score': 0.17246243743955822, 'support': 1713}}
Token level accuracy: 0.5232371794871795
Wrong BIO-Encoding 108/1659 labels, 6.51%
Test-Data: Prec: 0.188, Rec: 0.170, F1: 0.1783

Scores from epoch with best dev-scores:
  Dev-Score: 0.2500
  Test-Score 0.1783

8.86 sec for evaluation

--------- Epoch 14 -----------
217.54 sec for training (3095.11 total)
-- cmv_modes1 --



{'C': {'precision': 0.6363636363636364, 'recall': 0.4117647058823529, 'f1-score': 0.5, 'support': 17}, 'P': {'precision': 0.04, 'recall': 0.041666666666666664, 'f1-score': 0.04081632653061224, 'support': 24}, 'micro avg': {'precision': 0.2222222222222222, 'recall': 0.1951219512195122, 'f1-score': 0.2077922077922078, 'support': 41}, 'macro avg': {'precision': 0.3381818181818182, 'recall': 0.2267156862745098, 'f1-score': 0.27040816326530615, 'support': 41}, 'weighted avg': {'precision': 0.28727272727272724, 'recall': 0.1951219512195122, 'f1-score': 0.2312095569935291, 'support': 41}}
Token level accuracy: 0.8020565552699229



{'C': {'precision': 0.6363636363636364, 'recall': 0.4117647058823529, 'f1-score': 0.5, 'support': 17}, 'P': {'precision': 0.04, 'recall': 0.041666666666666664, 'f1-score': 0.04081632653061224, 'support': 24}, 'micro avg': {'precision': 0.2222222222222222, 'recall': 0.1951219512195122, 'f1-score': 0.2077922077922078, 'support': 41}, 'macro avg': {'precision': 0.3381818181818182, 'recall': 0.2267156862745098, 'f1-score': 0.27040816326530615, 'support': 41}, 'weighted avg': {'precision': 0.28727272727272724, 'recall': 0.1951219512195122, 'f1-score': 0.2312095569935291, 'support': 41}}
Token level accuracy: 0.8020565552699229
Dev-Data: Prec: 0.222, Rec: 0.195, F1: 0.2078



{'C': {'precision': 0.21588089330024815, 'recall': 0.10943396226415095, 'f1-score': 0.14524207011686144, 'support': 795}, 'P': {'precision': 0.21807628524046435, 'recall': 0.28649237472766886, 'f1-score': 0.2476459510357816, 'support': 918}, 'micro avg': {'precision': 0.2175264139216905, 'recall': 0.20431990659661411, 'f1-score': 0.2107164358819988, 'support': 1713}, 'macro avg': {'precision': 0.21697858927035624, 'recall': 0.1979631684959099, 'f1-score': 0.19644401057632152, 'support': 1713}, 'weighted avg': {'precision': 0.21705740807031146, 'recall': 0.20431990659661411, 'f1-score': 0.20012050717673807, 'support': 1713}}
Token level accuracy: 0.5212218337218337
Wrong BIO-Encoding 1818/3349 labels, 54.28%



{'C': {'precision': 0.21588089330024815, 'recall': 0.10943396226415095, 'f1-score': 0.14524207011686144, 'support': 795}, 'P': {'precision': 0.21807628524046435, 'recall': 0.28649237472766886, 'f1-score': 0.2476459510357816, 'support': 918}, 'micro avg': {'precision': 0.2175264139216905, 'recall': 0.20431990659661411, 'f1-score': 0.2107164358819988, 'support': 1713}, 'macro avg': {'precision': 0.21697858927035624, 'recall': 0.1979631684959099, 'f1-score': 0.19644401057632152, 'support': 1713}, 'weighted avg': {'precision': 0.21705740807031146, 'recall': 0.20431990659661411, 'f1-score': 0.20012050717673807, 'support': 1713}}
Token level accuracy: 0.5212218337218337
Wrong BIO-Encoding 78/1609 labels, 4.85%
Test-Data: Prec: 0.229, Rec: 0.204, F1: 0.2158

Scores from epoch with best dev-scores:
  Dev-Score: 0.2500
  Test-Score 0.1783

8.57 sec for evaluation

--------- Epoch 15 -----------
217.34 sec for training (3312.45 total)
-- cmv_modes1 --



{'C': {'precision': 0.5384615384615384, 'recall': 0.4117647058823529, 'f1-score': 0.4666666666666667, 'support': 17}, 'P': {'precision': 0.08333333333333333, 'recall': 0.08333333333333333, 'f1-score': 0.08333333333333333, 'support': 24}, 'micro avg': {'precision': 0.24324324324324326, 'recall': 0.21951219512195122, 'f1-score': 0.23076923076923075, 'support': 41}, 'macro avg': {'precision': 0.3108974358974359, 'recall': 0.24754901960784312, 'f1-score': 0.275, 'support': 41}, 'weighted avg': {'precision': 0.27204502814258913, 'recall': 0.21951219512195122, 'f1-score': 0.24227642276422764, 'support': 41}}
Token level accuracy: 0.8624678663239075



{'C': {'precision': 0.5384615384615384, 'recall': 0.4117647058823529, 'f1-score': 0.4666666666666667, 'support': 17}, 'P': {'precision': 0.08333333333333333, 'recall': 0.08333333333333333, 'f1-score': 0.08333333333333333, 'support': 24}, 'micro avg': {'precision': 0.24324324324324326, 'recall': 0.21951219512195122, 'f1-score': 0.23076923076923075, 'support': 41}, 'macro avg': {'precision': 0.3108974358974359, 'recall': 0.24754901960784312, 'f1-score': 0.275, 'support': 41}, 'weighted avg': {'precision': 0.27204502814258913, 'recall': 0.21951219512195122, 'f1-score': 0.24227642276422764, 'support': 41}}
Token level accuracy: 0.8624678663239075
Dev-Data: Prec: 0.243, Rec: 0.220, F1: 0.2308



{'C': {'precision': 0.1648, 'recall': 0.12955974842767295, 'f1-score': 0.14507042253521124, 'support': 795}, 'P': {'precision': 0.2266526757607555, 'recall': 0.23529411764705882, 'f1-score': 0.23089257081774453, 'support': 918}, 'micro avg': {'precision': 0.20215462610899873, 'recall': 0.18622300058377117, 'f1-score': 0.19386204800972348, 'support': 1713}, 'macro avg': {'precision': 0.19572633788037774, 'recall': 0.1824269330373659, 'f1-score': 0.1879814966764779, 'support': 1713}, 'weighted avg': {'precision': 0.19794696809595655, 'recall': 0.18622300058377117, 'f1-score': 0.191062677131455, 'support': 1713}}
Token level accuracy: 0.5329496891996892
Wrong BIO-Encoding 1986/3449 labels, 57.58%



{'C': {'precision': 0.1648, 'recall': 0.12955974842767295, 'f1-score': 0.14507042253521124, 'support': 795}, 'P': {'precision': 0.2266526757607555, 'recall': 0.23529411764705882, 'f1-score': 0.23089257081774453, 'support': 918}, 'micro avg': {'precision': 0.20215462610899873, 'recall': 0.18622300058377117, 'f1-score': 0.19386204800972348, 'support': 1713}, 'macro avg': {'precision': 0.19572633788037774, 'recall': 0.1824269330373659, 'f1-score': 0.1879814966764779, 'support': 1713}, 'weighted avg': {'precision': 0.19794696809595655, 'recall': 0.18622300058377117, 'f1-score': 0.191062677131455, 'support': 1713}}
Token level accuracy: 0.5329496891996892
Wrong BIO-Encoding 115/1578 labels, 7.29%
Test-Data: Prec: 0.217, Rec: 0.186, F1: 0.2003

Scores from epoch with best dev-scores:
  Dev-Score: 0.2500
  Test-Score 0.1783

8.93 sec for evaluation

--------- Epoch 16 -----------
217.93 sec for training (3530.38 total)
-- cmv_modes1 --



{'C': {'precision': 0.6923076923076923, 'recall': 0.5294117647058824, 'f1-score': 0.5999999999999999, 'support': 17}, 'P': {'precision': 0.12, 'recall': 0.125, 'f1-score': 0.12244897959183673, 'support': 24}, 'micro avg': {'precision': 0.3157894736842105, 'recall': 0.2926829268292683, 'f1-score': 0.3037974683544304, 'support': 41}, 'macro avg': {'precision': 0.40615384615384614, 'recall': 0.3272058823529412, 'f1-score': 0.3612244897959183, 'support': 41}, 'weighted avg': {'precision': 0.3572983114446529, 'recall': 0.2926829268292683, 'f1-score': 0.3204579392732702, 'support': 41}}
Token level accuracy: 0.800771208226221



{'C': {'precision': 0.6923076923076923, 'recall': 0.5294117647058824, 'f1-score': 0.5999999999999999, 'support': 17}, 'P': {'precision': 0.12, 'recall': 0.125, 'f1-score': 0.12244897959183673, 'support': 24}, 'micro avg': {'precision': 0.3157894736842105, 'recall': 0.2926829268292683, 'f1-score': 0.3037974683544304, 'support': 41}, 'macro avg': {'precision': 0.40615384615384614, 'recall': 0.3272058823529412, 'f1-score': 0.3612244897959183, 'support': 41}, 'weighted avg': {'precision': 0.3572983114446529, 'recall': 0.2926829268292683, 'f1-score': 0.3204579392732702, 'support': 41}}
Token level accuracy: 0.800771208226221
Dev-Data: Prec: 0.316, Rec: 0.293, F1: 0.3038



{'C': {'precision': 0.15500945179584122, 'recall': 0.10314465408805032, 'f1-score': 0.12386706948640483, 'support': 795}, 'P': {'precision': 0.20217391304347826, 'recall': 0.20261437908496732, 'f1-score': 0.20239390642002175, 'support': 918}, 'micro avg': {'precision': 0.1849551414768806, 'recall': 0.15645067133683596, 'f1-score': 0.16951296647691336, 'support': 1713}, 'macro avg': {'precision': 0.17859168241965973, 'recall': 0.15287951658650883, 'f1-score': 0.16313048795321328, 'support': 1713}, 'weighted avg': {'precision': 0.18028497743818261, 'recall': 0.15645067133683596, 'f1-score': 0.16594975267674944, 'support': 1713}}
Token level accuracy: 0.5343580031080031
Wrong BIO-Encoding 1914/3246 labels, 58.96%



{'C': {'precision': 0.15500945179584122, 'recall': 0.10314465408805032, 'f1-score': 0.12386706948640483, 'support': 795}, 'P': {'precision': 0.20217391304347826, 'recall': 0.20261437908496732, 'f1-score': 0.20239390642002175, 'support': 918}, 'micro avg': {'precision': 0.1849551414768806, 'recall': 0.15645067133683596, 'f1-score': 0.16951296647691336, 'support': 1713}, 'macro avg': {'precision': 0.17859168241965973, 'recall': 0.15287951658650883, 'f1-score': 0.16313048795321328, 'support': 1713}, 'weighted avg': {'precision': 0.18028497743818261, 'recall': 0.15645067133683596, 'f1-score': 0.16594975267674944, 'support': 1713}}
Token level accuracy: 0.5343580031080031
Wrong BIO-Encoding 117/1449 labels, 8.07%
Test-Data: Prec: 0.201, Rec: 0.156, F1: 0.1760

Scores from epoch with best dev-scores:
  Dev-Score: 0.3038
  Test-Score 0.1760

8.88 sec for evaluation

--------- Epoch 17 -----------
220.29 sec for training (3750.66 total)
-- cmv_modes1 --



{'C': {'precision': 0.6153846153846154, 'recall': 0.47058823529411764, 'f1-score': 0.5333333333333333, 'support': 17}, 'P': {'precision': 0.12, 'recall': 0.125, 'f1-score': 0.12244897959183673, 'support': 24}, 'micro avg': {'precision': 0.2894736842105263, 'recall': 0.2682926829268293, 'f1-score': 0.27848101265822783, 'support': 41}, 'macro avg': {'precision': 0.3676923076923077, 'recall': 0.2977941176470588, 'f1-score': 0.32789115646258504, 'support': 41}, 'weighted avg': {'precision': 0.3254033771106942, 'recall': 0.2682926829268293, 'f1-score': 0.29281566285050603, 'support': 41}}
Token level accuracy: 0.8470437017994858
Wrong BIO-Encoding 18/55 labels, 32.73%



{'C': {'precision': 0.6153846153846154, 'recall': 0.47058823529411764, 'f1-score': 0.5333333333333333, 'support': 17}, 'P': {'precision': 0.12, 'recall': 0.125, 'f1-score': 0.12244897959183673, 'support': 24}, 'micro avg': {'precision': 0.2894736842105263, 'recall': 0.2682926829268293, 'f1-score': 0.27848101265822783, 'support': 41}, 'macro avg': {'precision': 0.3676923076923077, 'recall': 0.2977941176470588, 'f1-score': 0.32789115646258504, 'support': 41}, 'weighted avg': {'precision': 0.3254033771106942, 'recall': 0.2682926829268293, 'f1-score': 0.29281566285050603, 'support': 41}}
Token level accuracy: 0.8470437017994858
Wrong BIO-Encoding 1/38 labels, 2.63%
Dev-Data: Prec: 0.297, Rec: 0.268, F1: 0.2821



{'C': {'precision': 0.1453804347826087, 'recall': 0.13459119496855346, 'f1-score': 0.13977792292619204, 'support': 795}, 'P': {'precision': 0.2015855039637599, 'recall': 0.19389978213507625, 'f1-score': 0.19766796224319824, 'support': 918}, 'micro avg': {'precision': 0.17603458925262508, 'recall': 0.16637478108581435, 'f1-score': 0.17106842737094838, 'support': 1713}, 'macro avg': {'precision': 0.1734829693731843, 'recall': 0.16424548855181487, 'f1-score': 0.16872294258469514, 'support': 1713}, 'weighted avg': {'precision': 0.17550083963275276, 'recall': 0.16637478108581435, 'f1-score': 0.17080130651814282, 'support': 1713}}
Token level accuracy: 0.5280448717948718
Wrong BIO-Encoding 1378/2911 labels, 47.34%



{'C': {'precision': 0.1453804347826087, 'recall': 0.13459119496855346, 'f1-score': 0.13977792292619204, 'support': 795}, 'P': {'precision': 0.2015855039637599, 'recall': 0.19389978213507625, 'f1-score': 0.19766796224319824, 'support': 918}, 'micro avg': {'precision': 0.17603458925262508, 'recall': 0.16637478108581435, 'f1-score': 0.17106842737094838, 'support': 1713}, 'macro avg': {'precision': 0.1734829693731843, 'recall': 0.16424548855181487, 'f1-score': 0.16872294258469514, 'support': 1713}, 'weighted avg': {'precision': 0.17550083963275276, 'recall': 0.16637478108581435, 'f1-score': 0.17080130651814282, 'support': 1713}}
Token level accuracy: 0.5280448717948718
Wrong BIO-Encoding 86/1619 labels, 5.31%
Test-Data: Prec: 0.186, Rec: 0.166, F1: 0.1756

Scores from epoch with best dev-scores:
  Dev-Score: 0.3038
  Test-Score 0.1760

8.91 sec for evaluation

--------- Epoch 18 -----------
219.97 sec for training (3970.63 total)
-- cmv_modes1 --



{'C': {'precision': 0.8333333333333334, 'recall': 0.5882352941176471, 'f1-score': 0.6896551724137931, 'support': 17}, 'P': {'precision': 0.08333333333333333, 'recall': 0.08333333333333333, 'f1-score': 0.08333333333333333, 'support': 24}, 'micro avg': {'precision': 0.3333333333333333, 'recall': 0.2926829268292683, 'f1-score': 0.3116883116883117, 'support': 41}, 'macro avg': {'precision': 0.45833333333333337, 'recall': 0.3357843137254902, 'f1-score': 0.38649425287356326, 'support': 41}, 'weighted avg': {'precision': 0.39430894308943093, 'recall': 0.2926829268292683, 'f1-score': 0.33473507148864595, 'support': 41}}
Token level accuracy: 0.8149100257069408
Wrong BIO-Encoding 15/49 labels, 30.61%



{'C': {'precision': 0.8333333333333334, 'recall': 0.5882352941176471, 'f1-score': 0.6896551724137931, 'support': 17}, 'P': {'precision': 0.08333333333333333, 'recall': 0.08333333333333333, 'f1-score': 0.08333333333333333, 'support': 24}, 'micro avg': {'precision': 0.3333333333333333, 'recall': 0.2926829268292683, 'f1-score': 0.3116883116883117, 'support': 41}, 'macro avg': {'precision': 0.45833333333333337, 'recall': 0.3357843137254902, 'f1-score': 0.38649425287356326, 'support': 41}, 'weighted avg': {'precision': 0.39430894308943093, 'recall': 0.2926829268292683, 'f1-score': 0.33473507148864595, 'support': 41}}
Token level accuracy: 0.8149100257069408
Wrong BIO-Encoding 2/36 labels, 5.56%
Dev-Data: Prec: 0.353, Rec: 0.293, F1: 0.3200



{'C': {'precision': 0.16834170854271358, 'recall': 0.08427672955974842, 'f1-score': 0.11232187761944679, 'support': 795}, 'P': {'precision': 0.2083780880773362, 'recall': 0.2113289760348584, 'f1-score': 0.20984315846403462, 'support': 918}, 'micro avg': {'precision': 0.1963882618510158, 'recall': 0.15236427320490367, 'f1-score': 0.17159763313609466, 'support': 1713}, 'macro avg': {'precision': 0.1883598983100249, 'recall': 0.1478028527973034, 'f1-score': 0.1610825180417407, 'support': 1713}, 'weighted avg': {'precision': 0.18979728146319438, 'recall': 0.15236427320490367, 'f1-score': 0.16458371989342904, 'support': 1713}}
Token level accuracy: 0.5435363247863247
Wrong BIO-Encoding 2636/3833 labels, 68.77%



{'C': {'precision': 0.16834170854271358, 'recall': 0.08427672955974842, 'f1-score': 0.11232187761944679, 'support': 795}, 'P': {'precision': 0.2083780880773362, 'recall': 0.2113289760348584, 'f1-score': 0.20984315846403462, 'support': 918}, 'micro avg': {'precision': 0.1963882618510158, 'recall': 0.15236427320490367, 'f1-score': 0.17159763313609466, 'support': 1713}, 'macro avg': {'precision': 0.1883598983100249, 'recall': 0.1478028527973034, 'f1-score': 0.1610825180417407, 'support': 1713}, 'weighted avg': {'precision': 0.18979728146319438, 'recall': 0.15236427320490367, 'f1-score': 0.16458371989342904, 'support': 1713}}
Token level accuracy: 0.5435363247863247
Wrong BIO-Encoding 132/1329 labels, 9.93%
Test-Data: Prec: 0.218, Rec: 0.152, F1: 0.1794

Scores from epoch with best dev-scores:
  Dev-Score: 0.3200
  Test-Score 0.1794

8.89 sec for evaluation

--------- Epoch 19 -----------
221.15 sec for training (4191.79 total)
-- cmv_modes1 --



{'C': {'precision': 0.6666666666666666, 'recall': 0.7058823529411765, 'f1-score': 0.6857142857142857, 'support': 17}, 'P': {'precision': 0.13636363636363635, 'recall': 0.125, 'f1-score': 0.13043478260869565, 'support': 24}, 'micro avg': {'precision': 0.375, 'recall': 0.36585365853658536, 'f1-score': 0.3703703703703704, 'support': 41}, 'macro avg': {'precision': 0.4015151515151515, 'recall': 0.41544117647058826, 'f1-score': 0.4080745341614907, 'support': 41}, 'weighted avg': {'precision': 0.3562453806356245, 'recall': 0.36585365853658536, 'f1-score': 0.36067262535979394, 'support': 41}}
Token level accuracy: 0.8354755784061697
Wrong BIO-Encoding 7/46 labels, 15.22%



{'C': {'precision': 0.6666666666666666, 'recall': 0.7058823529411765, 'f1-score': 0.6857142857142857, 'support': 17}, 'P': {'precision': 0.13636363636363635, 'recall': 0.125, 'f1-score': 0.13043478260869565, 'support': 24}, 'micro avg': {'precision': 0.375, 'recall': 0.36585365853658536, 'f1-score': 0.3703703703703704, 'support': 41}, 'macro avg': {'precision': 0.4015151515151515, 'recall': 0.41544117647058826, 'f1-score': 0.4080745341614907, 'support': 41}, 'weighted avg': {'precision': 0.3562453806356245, 'recall': 0.36585365853658536, 'f1-score': 0.36067262535979394, 'support': 41}}
Token level accuracy: 0.8354755784061697
Wrong BIO-Encoding 1/40 labels, 2.50%
Dev-Data: Prec: 0.385, Rec: 0.366, F1: 0.3750



{'C': {'precision': 0.16357688113413305, 'recall': 0.18867924528301888, 'f1-score': 0.1752336448598131, 'support': 795}, 'P': {'precision': 0.21080368906455862, 'recall': 0.17429193899782136, 'f1-score': 0.19081693500298155, 'support': 918}, 'micro avg': {'precision': 0.18496420047732698, 'recall': 0.18096906012842964, 'f1-score': 0.18294482148126293, 'support': 1713}, 'macro avg': {'precision': 0.18719028509934582, 'recall': 0.18148559214042012, 'f1-score': 0.18302528993139733, 'support': 1713}, 'weighted avg': {'precision': 0.18888581848388825, 'recall': 0.18096906012842964, 'f1-score': 0.18358476006788585, 'support': 1713}}
Token level accuracy: 0.522581585081585
Wrong BIO-Encoding 1453/3044 labels, 47.73%



{'C': {'precision': 0.16357688113413305, 'recall': 0.18867924528301888, 'f1-score': 0.1752336448598131, 'support': 795}, 'P': {'precision': 0.21080368906455862, 'recall': 0.17429193899782136, 'f1-score': 0.19081693500298155, 'support': 918}, 'micro avg': {'precision': 0.18496420047732698, 'recall': 0.18096906012842964, 'f1-score': 0.18294482148126293, 'support': 1713}, 'macro avg': {'precision': 0.18719028509934582, 'recall': 0.18148559214042012, 'f1-score': 0.18302528993139733, 'support': 1713}, 'weighted avg': {'precision': 0.18888581848388825, 'recall': 0.18096906012842964, 'f1-score': 0.18358476006788585, 'support': 1713}}
Token level accuracy: 0.522581585081585
Wrong BIO-Encoding 85/1676 labels, 5.07%
Test-Data: Prec: 0.194, Rec: 0.180, F1: 0.1870

Scores from epoch with best dev-scores:
  Dev-Score: 0.3750
  Test-Score 0.1870

9.06 sec for evaluation

--------- Epoch 20 -----------
221.28 sec for training (4413.06 total)
-- cmv_modes1 --



{'C': {'precision': 0.7272727272727273, 'recall': 0.47058823529411764, 'f1-score': 0.5714285714285714, 'support': 17}, 'P': {'precision': 0.07407407407407407, 'recall': 0.08333333333333333, 'f1-score': 0.07843137254901962, 'support': 24}, 'micro avg': {'precision': 0.2631578947368421, 'recall': 0.24390243902439024, 'f1-score': 0.25316455696202533, 'support': 41}, 'macro avg': {'precision': 0.4006734006734007, 'recall': 0.2769607843137255, 'f1-score': 0.32492997198879553, 'support': 41}, 'weighted avg': {'precision': 0.3449125400344913, 'recall': 0.24390243902439024, 'f1-score': 0.2828448452551752, 'support': 41}}
Token level accuracy: 0.8046272493573264
Wrong BIO-Encoding 11/47 labels, 23.40%



{'C': {'precision': 0.7272727272727273, 'recall': 0.47058823529411764, 'f1-score': 0.5714285714285714, 'support': 17}, 'P': {'precision': 0.07407407407407407, 'recall': 0.08333333333333333, 'f1-score': 0.07843137254901962, 'support': 24}, 'micro avg': {'precision': 0.2631578947368421, 'recall': 0.24390243902439024, 'f1-score': 0.25316455696202533, 'support': 41}, 'macro avg': {'precision': 0.4006734006734007, 'recall': 0.2769607843137255, 'f1-score': 0.32492997198879553, 'support': 41}, 'weighted avg': {'precision': 0.3449125400344913, 'recall': 0.24390243902439024, 'f1-score': 0.2828448452551752, 'support': 41}}
Token level accuracy: 0.8046272493573264
Wrong BIO-Encoding 2/38 labels, 5.26%
Dev-Data: Prec: 0.278, Rec: 0.244, F1: 0.2597



{'C': {'precision': 0.24633431085043989, 'recall': 0.10566037735849057, 'f1-score': 0.147887323943662, 'support': 795}, 'P': {'precision': 0.22149532710280373, 'recall': 0.2581699346405229, 'f1-score': 0.23843058350100602, 'support': 918}, 'micro avg': {'precision': 0.22749822820694543, 'recall': 0.18739054290718038, 'f1-score': 0.20550576184379, 'support': 1713}, 'macro avg': {'precision': 0.2339148189766218, 'recall': 0.18191515599950675, 'f1-score': 0.193158953722334, 'support': 1713}, 'weighted avg': {'precision': 0.23302305160914977, 'recall': 0.18739054290718038, 'f1-score': 0.19640963116703722, 'support': 1713}}
Token level accuracy: 0.5428321678321678
Wrong BIO-Encoding 2108/3428 labels, 61.49%



{'C': {'precision': 0.24633431085043989, 'recall': 0.10566037735849057, 'f1-score': 0.147887323943662, 'support': 795}, 'P': {'precision': 0.22149532710280373, 'recall': 0.2581699346405229, 'f1-score': 0.23843058350100602, 'support': 918}, 'micro avg': {'precision': 0.22749822820694543, 'recall': 0.18739054290718038, 'f1-score': 0.20550576184379, 'support': 1713}, 'macro avg': {'precision': 0.2339148189766218, 'recall': 0.18191515599950675, 'f1-score': 0.193158953722334, 'support': 1713}, 'weighted avg': {'precision': 0.23302305160914977, 'recall': 0.18739054290718038, 'f1-score': 0.19640963116703722, 'support': 1713}}
Token level accuracy: 0.5428321678321678
Wrong BIO-Encoding 91/1411 labels, 6.45%
Test-Data: Prec: 0.242, Rec: 0.187, F1: 0.2110

Scores from epoch with best dev-scores:
  Dev-Score: 0.3750
  Test-Score 0.1870

8.99 sec for evaluation

--------- Epoch 21 -----------
220.85 sec for training (4633.91 total)
-- cmv_modes1 --



{'C': {'precision': 0.6875, 'recall': 0.6470588235294118, 'f1-score': 0.6666666666666667, 'support': 17}, 'P': {'precision': 0.22727272727272727, 'recall': 0.20833333333333334, 'f1-score': 0.21739130434782608, 'support': 24}, 'micro avg': {'precision': 0.42105263157894735, 'recall': 0.3902439024390244, 'f1-score': 0.4050632911392405, 'support': 41}, 'macro avg': {'precision': 0.45738636363636365, 'recall': 0.4276960784313726, 'f1-score': 0.4420289855072464, 'support': 41}, 'weighted avg': {'precision': 0.41809866962305986, 'recall': 0.3902439024390244, 'f1-score': 0.40367621067515025, 'support': 41}}
Token level accuracy: 0.8920308483290489



{'C': {'precision': 0.6875, 'recall': 0.6470588235294118, 'f1-score': 0.6666666666666667, 'support': 17}, 'P': {'precision': 0.22727272727272727, 'recall': 0.20833333333333334, 'f1-score': 0.21739130434782608, 'support': 24}, 'micro avg': {'precision': 0.42105263157894735, 'recall': 0.3902439024390244, 'f1-score': 0.4050632911392405, 'support': 41}, 'macro avg': {'precision': 0.45738636363636365, 'recall': 0.4276960784313726, 'f1-score': 0.4420289855072464, 'support': 41}, 'weighted avg': {'precision': 0.41809866962305986, 'recall': 0.3902439024390244, 'f1-score': 0.40367621067515025, 'support': 41}}
Token level accuracy: 0.8920308483290489
Dev-Data: Prec: 0.421, Rec: 0.390, F1: 0.4051



{'C': {'precision': 0.17995169082125603, 'recall': 0.18742138364779873, 'f1-score': 0.1836105976586568, 'support': 795}, 'P': {'precision': 0.21843003412969283, 'recall': 0.20915032679738563, 'f1-score': 0.21368948247078465, 'support': 918}, 'micro avg': {'precision': 0.19976567076742824, 'recall': 0.19906596614127262, 'f1-score': 0.1994152046783626, 'support': 1713}, 'macro avg': {'precision': 0.19919086247547443, 'recall': 0.19828585522259218, 'f1-score': 0.19865004006472073, 'support': 1713}, 'weighted avg': {'precision': 0.20057230912665297, 'recall': 0.19906596614127262, 'f1-score': 0.19972992997478836, 'support': 1713}}
Token level accuracy: 0.5585421522921523
Wrong BIO-Encoding 1691/3306 labels, 51.15%



{'C': {'precision': 0.17995169082125603, 'recall': 0.18742138364779873, 'f1-score': 0.1836105976586568, 'support': 795}, 'P': {'precision': 0.21843003412969283, 'recall': 0.20915032679738563, 'f1-score': 0.21368948247078465, 'support': 918}, 'micro avg': {'precision': 0.19976567076742824, 'recall': 0.19906596614127262, 'f1-score': 0.1994152046783626, 'support': 1713}, 'macro avg': {'precision': 0.19919086247547443, 'recall': 0.19828585522259218, 'f1-score': 0.19865004006472073, 'support': 1713}, 'weighted avg': {'precision': 0.20057230912665297, 'recall': 0.19906596614127262, 'f1-score': 0.19972992997478836, 'support': 1713}}
Token level accuracy: 0.5585421522921523
Wrong BIO-Encoding 92/1707 labels, 5.39%
Test-Data: Prec: 0.211, Rec: 0.199, F1: 0.2049

Scores from epoch with best dev-scores:
  Dev-Score: 0.4051
  Test-Score 0.2049

9.07 sec for evaluation

--------- Epoch 22 -----------
218.78 sec for training (4852.69 total)
-- cmv_modes1 --



{'C': {'precision': 0.9230769230769231, 'recall': 0.7058823529411765, 'f1-score': 0.8000000000000002, 'support': 17}, 'P': {'precision': 0.23076923076923078, 'recall': 0.25, 'f1-score': 0.24000000000000002, 'support': 24}, 'micro avg': {'precision': 0.46153846153846156, 'recall': 0.43902439024390244, 'f1-score': 0.45, 'support': 41}, 'macro avg': {'precision': 0.576923076923077, 'recall': 0.47794117647058826, 'f1-score': 0.5200000000000001, 'support': 41}, 'weighted avg': {'precision': 0.5178236397748593, 'recall': 0.43902439024390244, 'f1-score': 0.4721951219512196, 'support': 41}}
Token level accuracy: 0.884318766066838



{'C': {'precision': 0.9230769230769231, 'recall': 0.7058823529411765, 'f1-score': 0.8000000000000002, 'support': 17}, 'P': {'precision': 0.23076923076923078, 'recall': 0.25, 'f1-score': 0.24000000000000002, 'support': 24}, 'micro avg': {'precision': 0.46153846153846156, 'recall': 0.43902439024390244, 'f1-score': 0.45, 'support': 41}, 'macro avg': {'precision': 0.576923076923077, 'recall': 0.47794117647058826, 'f1-score': 0.5200000000000001, 'support': 41}, 'weighted avg': {'precision': 0.5178236397748593, 'recall': 0.43902439024390244, 'f1-score': 0.4721951219512196, 'support': 41}}
Token level accuracy: 0.884318766066838
Dev-Data: Prec: 0.462, Rec: 0.439, F1: 0.4500



{'C': {'precision': 0.15269461077844312, 'recall': 0.12830188679245283, 'f1-score': 0.1394395078605605, 'support': 795}, 'P': {'precision': 0.2167707404103479, 'recall': 0.2647058823529412, 'f1-score': 0.23835213339872488, 'support': 918}, 'micro avg': {'precision': 0.1928451648965903, 'recall': 0.20140105078809106, 'f1-score': 0.19703026841804683, 'support': 1713}, 'macro avg': {'precision': 0.18473267559439552, 'recall': 0.19650388457269702, 'f1-score': 0.1888958206296427, 'support': 1713}, 'weighted avg': {'precision': 0.1870331320873098, 'recall': 0.20140105078809106, 'f1-score': 0.19244697443617925, 'support': 1713}}
Token level accuracy: 0.5384858197358198
Wrong BIO-Encoding 1573/3282 labels, 47.93%



{'C': {'precision': 0.15269461077844312, 'recall': 0.12830188679245283, 'f1-score': 0.1394395078605605, 'support': 795}, 'P': {'precision': 0.2167707404103479, 'recall': 0.2647058823529412, 'f1-score': 0.23835213339872488, 'support': 918}, 'micro avg': {'precision': 0.1928451648965903, 'recall': 0.20140105078809106, 'f1-score': 0.19703026841804683, 'support': 1713}, 'macro avg': {'precision': 0.18473267559439552, 'recall': 0.19650388457269702, 'f1-score': 0.1888958206296427, 'support': 1713}, 'weighted avg': {'precision': 0.1870331320873098, 'recall': 0.20140105078809106, 'f1-score': 0.19244697443617925, 'support': 1713}}
Token level accuracy: 0.5384858197358198
Wrong BIO-Encoding 80/1789 labels, 4.47%
Test-Data: Prec: 0.202, Rec: 0.201, F1: 0.2016

Scores from epoch with best dev-scores:
  Dev-Score: 0.4500
  Test-Score 0.2016

8.82 sec for evaluation

--------- Epoch 23 -----------
216.90 sec for training (5069.59 total)
-- cmv_modes1 --



{'C': {'precision': 0.6875, 'recall': 0.6470588235294118, 'f1-score': 0.6666666666666667, 'support': 17}, 'P': {'precision': 0.2916666666666667, 'recall': 0.2916666666666667, 'f1-score': 0.2916666666666667, 'support': 24}, 'micro avg': {'precision': 0.45, 'recall': 0.43902439024390244, 'f1-score': 0.4444444444444445, 'support': 41}, 'macro avg': {'precision': 0.48958333333333337, 'recall': 0.4693627450980392, 'f1-score': 0.47916666666666674, 'support': 41}, 'weighted avg': {'precision': 0.4557926829268293, 'recall': 0.43902439024390244, 'f1-score': 0.4471544715447155, 'support': 41}}
Token level accuracy: 0.9190231362467867



{'C': {'precision': 0.6875, 'recall': 0.6470588235294118, 'f1-score': 0.6666666666666667, 'support': 17}, 'P': {'precision': 0.2916666666666667, 'recall': 0.2916666666666667, 'f1-score': 0.2916666666666667, 'support': 24}, 'micro avg': {'precision': 0.45, 'recall': 0.43902439024390244, 'f1-score': 0.4444444444444445, 'support': 41}, 'macro avg': {'precision': 0.48958333333333337, 'recall': 0.4693627450980392, 'f1-score': 0.47916666666666674, 'support': 41}, 'weighted avg': {'precision': 0.4557926829268293, 'recall': 0.43902439024390244, 'f1-score': 0.4471544715447155, 'support': 41}}
Token level accuracy: 0.9190231362467867
Dev-Data: Prec: 0.450, Rec: 0.439, F1: 0.4444



{'C': {'precision': 0.15243101182654403, 'recall': 0.1459119496855346, 'f1-score': 0.14910025706940874, 'support': 795}, 'P': {'precision': 0.20501138952164008, 'recall': 0.19607843137254902, 'f1-score': 0.20044543429844097, 'support': 918}, 'micro avg': {'precision': 0.18059792556436852, 'recall': 0.1727962638645651, 'f1-score': 0.17661097852028637, 'support': 1713}, 'macro avg': {'precision': 0.17872120067409206, 'recall': 0.1709951905290418, 'f1-score': 0.17477284568392487, 'support': 1713}, 'weighted avg': {'precision': 0.18060893752654297, 'recall': 0.1727962638645651, 'f1-score': 0.1766162364600985, 'support': 1713}}
Token level accuracy: 0.5272435897435898
Wrong BIO-Encoding 1649/3183 labels, 51.81%



{'C': {'precision': 0.15243101182654403, 'recall': 0.1459119496855346, 'f1-score': 0.14910025706940874, 'support': 795}, 'P': {'precision': 0.20501138952164008, 'recall': 0.19607843137254902, 'f1-score': 0.20044543429844097, 'support': 918}, 'micro avg': {'precision': 0.18059792556436852, 'recall': 0.1727962638645651, 'f1-score': 0.17661097852028637, 'support': 1713}, 'macro avg': {'precision': 0.17872120067409206, 'recall': 0.1709951905290418, 'f1-score': 0.17477284568392487, 'support': 1713}, 'weighted avg': {'precision': 0.18060893752654297, 'recall': 0.1727962638645651, 'f1-score': 0.1766162364600985, 'support': 1713}}
Token level accuracy: 0.5272435897435898
Wrong BIO-Encoding 105/1639 labels, 6.41%
Test-Data: Prec: 0.193, Rec: 0.173, F1: 0.1823

Scores from epoch with best dev-scores:
  Dev-Score: 0.4500
  Test-Score 0.2016

8.83 sec for evaluation

--------- Epoch 24 -----------
216.74 sec for training (5286.33 total)
-- cmv_modes1 --



{'C': {'precision': 0.5882352941176471, 'recall': 0.5882352941176471, 'f1-score': 0.5882352941176471, 'support': 17}, 'P': {'precision': 0.21739130434782608, 'recall': 0.20833333333333334, 'f1-score': 0.2127659574468085, 'support': 24}, 'micro avg': {'precision': 0.375, 'recall': 0.36585365853658536, 'f1-score': 0.3703703703703704, 'support': 41}, 'macro avg': {'precision': 0.40281329923273657, 'recall': 0.3982843137254902, 'f1-score': 0.4005006257822278, 'support': 41}, 'weighted avg': {'precision': 0.3711558854718982, 'recall': 0.36585365853658536, 'f1-score': 0.3684483653347172, 'support': 41}}
Token level accuracy: 0.9125964010282777



{'C': {'precision': 0.5882352941176471, 'recall': 0.5882352941176471, 'f1-score': 0.5882352941176471, 'support': 17}, 'P': {'precision': 0.21739130434782608, 'recall': 0.20833333333333334, 'f1-score': 0.2127659574468085, 'support': 24}, 'micro avg': {'precision': 0.375, 'recall': 0.36585365853658536, 'f1-score': 0.3703703703703704, 'support': 41}, 'macro avg': {'precision': 0.40281329923273657, 'recall': 0.3982843137254902, 'f1-score': 0.4005006257822278, 'support': 41}, 'weighted avg': {'precision': 0.3711558854718982, 'recall': 0.36585365853658536, 'f1-score': 0.3684483653347172, 'support': 41}}
Token level accuracy: 0.9125964010282777
Dev-Data: Prec: 0.375, Rec: 0.366, F1: 0.3704



{'C': {'precision': 0.18191964285714285, 'recall': 0.2050314465408805, 'f1-score': 0.1927853341218214, 'support': 795}, 'P': {'precision': 0.2452153110047847, 'recall': 0.2233115468409586, 'f1-score': 0.23375142531356896, 'support': 918}, 'micro avg': {'precision': 0.21247113163972287, 'recall': 0.21482778750729714, 'f1-score': 0.21364296081277215, 'support': 1713}, 'macro avg': {'precision': 0.21356747693096378, 'recall': 0.21417149669091956, 'f1-score': 0.2132683797176952, 'support': 1713}, 'weighted avg': {'precision': 0.215839913353077, 'recall': 0.21482778750729714, 'f1-score': 0.21473914131039365, 'support': 1713}}
Token level accuracy: 0.5404040404040404
Wrong BIO-Encoding 1523/3182 labels, 47.86%



{'C': {'precision': 0.18191964285714285, 'recall': 0.2050314465408805, 'f1-score': 0.1927853341218214, 'support': 795}, 'P': {'precision': 0.2452153110047847, 'recall': 0.2233115468409586, 'f1-score': 0.23375142531356896, 'support': 918}, 'micro avg': {'precision': 0.21247113163972287, 'recall': 0.21482778750729714, 'f1-score': 0.21364296081277215, 'support': 1713}, 'macro avg': {'precision': 0.21356747693096378, 'recall': 0.21417149669091956, 'f1-score': 0.2132683797176952, 'support': 1713}, 'weighted avg': {'precision': 0.215839913353077, 'recall': 0.21482778750729714, 'f1-score': 0.21473914131039365, 'support': 1713}}
Token level accuracy: 0.5404040404040404
Wrong BIO-Encoding 73/1732 labels, 4.21%
Test-Data: Prec: 0.222, Rec: 0.215, F1: 0.2183

Scores from epoch with best dev-scores:
  Dev-Score: 0.4500
  Test-Score 0.2016

7.60 sec for evaluation

--------- Epoch 25 -----------
217.37 sec for training (5503.70 total)
-- cmv_modes1 --



{'C': {'precision': 0.875, 'recall': 0.8235294117647058, 'f1-score': 0.8484848484848485, 'support': 17}, 'P': {'precision': 0.2962962962962963, 'recall': 0.3333333333333333, 'f1-score': 0.3137254901960785, 'support': 24}, 'micro avg': {'precision': 0.5116279069767442, 'recall': 0.5365853658536586, 'f1-score': 0.5238095238095238, 'support': 41}, 'macro avg': {'precision': 0.5856481481481481, 'recall': 0.5784313725490196, 'f1-score': 0.5811051693404635, 'support': 41}, 'weighted avg': {'precision': 0.5362466124661247, 'recall': 0.5365853658536586, 'f1-score': 0.5354549802182513, 'support': 41}}
Token level accuracy: 0.9267352185089974
Wrong BIO-Encoding 7/49 labels, 14.29%



{'C': {'precision': 0.875, 'recall': 0.8235294117647058, 'f1-score': 0.8484848484848485, 'support': 17}, 'P': {'precision': 0.2962962962962963, 'recall': 0.3333333333333333, 'f1-score': 0.3137254901960785, 'support': 24}, 'micro avg': {'precision': 0.5116279069767442, 'recall': 0.5365853658536586, 'f1-score': 0.5238095238095238, 'support': 41}, 'macro avg': {'precision': 0.5856481481481481, 'recall': 0.5784313725490196, 'f1-score': 0.5811051693404635, 'support': 41}, 'weighted avg': {'precision': 0.5362466124661247, 'recall': 0.5365853658536586, 'f1-score': 0.5354549802182513, 'support': 41}}
Token level accuracy: 0.9267352185089974
Wrong BIO-Encoding 1/43 labels, 2.33%
Dev-Data: Prec: 0.524, Rec: 0.537, F1: 0.5301



{'C': {'precision': 0.13988439306358383, 'recall': 0.15220125786163521, 'f1-score': 0.14578313253012049, 'support': 795}, 'P': {'precision': 0.20527859237536658, 'recall': 0.22875816993464052, 'f1-score': 0.21638330757341578, 'support': 918}, 'micro avg': {'precision': 0.1753177966101695, 'recall': 0.1932282545242265, 'f1-score': 0.18383782282699251, 'support': 1713}, 'macro avg': {'precision': 0.1725814927194752, 'recall': 0.19047971389813786, 'f1-score': 0.18108322005176813, 'support': 1713}, 'weighted avg': {'precision': 0.17492927045308562, 'recall': 0.1932282545242265, 'f1-score': 0.18361790234316488, 'support': 1713}}
Token level accuracy: 0.5483682983682984
Wrong BIO-Encoding 1001/2819 labels, 35.51%



{'C': {'precision': 0.13988439306358383, 'recall': 0.15220125786163521, 'f1-score': 0.14578313253012049, 'support': 795}, 'P': {'precision': 0.20527859237536658, 'recall': 0.22875816993464052, 'f1-score': 0.21638330757341578, 'support': 918}, 'micro avg': {'precision': 0.1753177966101695, 'recall': 0.1932282545242265, 'f1-score': 0.18383782282699251, 'support': 1713}, 'macro avg': {'precision': 0.1725814927194752, 'recall': 0.19047971389813786, 'f1-score': 0.18108322005176813, 'support': 1713}, 'weighted avg': {'precision': 0.17492927045308562, 'recall': 0.1932282545242265, 'f1-score': 0.18361790234316488, 'support': 1713}}
Token level accuracy: 0.5483682983682984
Wrong BIO-Encoding 70/1888 labels, 3.71%
Test-Data: Prec: 0.182, Rec: 0.193, F1: 0.1875

Scores from epoch with best dev-scores:
  Dev-Score: 0.5301
  Test-Score 0.1875

9.38 sec for evaluation

--------- Epoch 26 -----------
217.38 sec for training (5721.07 total)
-- cmv_modes1 --



{'C': {'precision': 0.8, 'recall': 0.7058823529411765, 'f1-score': 0.7500000000000001, 'support': 17}, 'P': {'precision': 0.6521739130434783, 'recall': 0.625, 'f1-score': 0.6382978723404256, 'support': 24}, 'micro avg': {'precision': 0.7105263157894737, 'recall': 0.6585365853658537, 'f1-score': 0.6835443037974684, 'support': 41}, 'macro avg': {'precision': 0.7260869565217392, 'recall': 0.6654411764705883, 'f1-score': 0.6941489361702129, 'support': 41}, 'weighted avg': {'precision': 0.7134676564156945, 'recall': 0.6585365853658537, 'f1-score': 0.6846133886870784, 'support': 41}}
Token level accuracy: 0.9267352185089974



{'C': {'precision': 0.8, 'recall': 0.7058823529411765, 'f1-score': 0.7500000000000001, 'support': 17}, 'P': {'precision': 0.6521739130434783, 'recall': 0.625, 'f1-score': 0.6382978723404256, 'support': 24}, 'micro avg': {'precision': 0.7105263157894737, 'recall': 0.6585365853658537, 'f1-score': 0.6835443037974684, 'support': 41}, 'macro avg': {'precision': 0.7260869565217392, 'recall': 0.6654411764705883, 'f1-score': 0.6941489361702129, 'support': 41}, 'weighted avg': {'precision': 0.7134676564156945, 'recall': 0.6585365853658537, 'f1-score': 0.6846133886870784, 'support': 41}}
Token level accuracy: 0.9267352185089974
Dev-Data: Prec: 0.711, Rec: 0.659, F1: 0.6835



{'C': {'precision': 0.16966966966966968, 'recall': 0.1421383647798742, 'f1-score': 0.15468856947296372, 'support': 795}, 'P': {'precision': 0.2049571020019066, 'recall': 0.23420479302832245, 'f1-score': 0.21860701576004066, 'support': 918}, 'micro avg': {'precision': 0.1912536443148688, 'recall': 0.19147694103911267, 'f1-score': 0.19136522753792298, 'support': 1713}, 'macro avg': {'precision': 0.18731338583578813, 'recall': 0.18817157890409833, 'f1-score': 0.1866477926165022, 'support': 1713}, 'weighted avg': {'precision': 0.18858027263580715, 'recall': 0.19147694103911267, 'f1-score': 0.18894258797356886, 'support': 1713}}
Token level accuracy: 0.5543414918414918
Wrong BIO-Encoding 1781/3394 labels, 52.47%



{'C': {'precision': 0.16966966966966968, 'recall': 0.1421383647798742, 'f1-score': 0.15468856947296372, 'support': 795}, 'P': {'precision': 0.2049571020019066, 'recall': 0.23420479302832245, 'f1-score': 0.21860701576004066, 'support': 918}, 'micro avg': {'precision': 0.1912536443148688, 'recall': 0.19147694103911267, 'f1-score': 0.19136522753792298, 'support': 1713}, 'macro avg': {'precision': 0.18731338583578813, 'recall': 0.18817157890409833, 'f1-score': 0.1866477926165022, 'support': 1713}, 'weighted avg': {'precision': 0.18858027263580715, 'recall': 0.19147694103911267, 'f1-score': 0.18894258797356886, 'support': 1713}}
Token level accuracy: 0.5543414918414918
Wrong BIO-Encoding 102/1715 labels, 5.95%
Test-Data: Prec: 0.203, Rec: 0.191, F1: 0.1966

Scores from epoch with best dev-scores:
  Dev-Score: 0.6835
  Test-Score 0.1966

8.94 sec for evaluation

--------- Epoch 27 -----------
217.67 sec for training (5938.74 total)
-- cmv_modes1 --



{'C': {'precision': 1.0, 'recall': 0.8823529411764706, 'f1-score': 0.9375, 'support': 17}, 'P': {'precision': 0.32, 'recall': 0.3333333333333333, 'f1-score': 0.32653061224489793, 'support': 24}, 'micro avg': {'precision': 0.575, 'recall': 0.5609756097560976, 'f1-score': 0.5679012345679012, 'support': 41}, 'macro avg': {'precision': 0.66, 'recall': 0.6078431372549019, 'f1-score': 0.6320153061224489, 'support': 41}, 'weighted avg': {'precision': 0.6019512195121951, 'recall': 0.5609756097560976, 'f1-score': 0.5798593827775013, 'support': 41}}
Token level accuracy: 0.9305912596401028



{'C': {'precision': 1.0, 'recall': 0.8823529411764706, 'f1-score': 0.9375, 'support': 17}, 'P': {'precision': 0.32, 'recall': 0.3333333333333333, 'f1-score': 0.32653061224489793, 'support': 24}, 'micro avg': {'precision': 0.575, 'recall': 0.5609756097560976, 'f1-score': 0.5679012345679012, 'support': 41}, 'macro avg': {'precision': 0.66, 'recall': 0.6078431372549019, 'f1-score': 0.6320153061224489, 'support': 41}, 'weighted avg': {'precision': 0.6019512195121951, 'recall': 0.5609756097560976, 'f1-score': 0.5798593827775013, 'support': 41}}
Token level accuracy: 0.9305912596401028
Dev-Data: Prec: 0.575, Rec: 0.561, F1: 0.5679



{'C': {'precision': 0.1807465618860511, 'recall': 0.11572327044025157, 'f1-score': 0.14110429447852763, 'support': 795}, 'P': {'precision': 0.21333333333333335, 'recall': 0.2788671023965142, 'f1-score': 0.24173748819641175, 'support': 918}, 'micro avg': {'precision': 0.20362785254534815, 'recall': 0.2031523642732049, 'f1-score': 0.2033898305084746, 'support': 1713}, 'macro avg': {'precision': 0.19703994760969223, 'recall': 0.1972951864183829, 'f1-score': 0.1914208913374697, 'support': 1713}, 'weighted avg': {'precision': 0.19820987548126714, 'recall': 0.2031523642732049, 'f1-score': 0.19503381685623783, 'support': 1713}}
Token level accuracy: 0.5488296425796426
Wrong BIO-Encoding 1334/2964 labels, 45.01%



{'C': {'precision': 0.1807465618860511, 'recall': 0.11572327044025157, 'f1-score': 0.14110429447852763, 'support': 795}, 'P': {'precision': 0.21333333333333335, 'recall': 0.2788671023965142, 'f1-score': 0.24173748819641175, 'support': 918}, 'micro avg': {'precision': 0.20362785254534815, 'recall': 0.2031523642732049, 'f1-score': 0.2033898305084746, 'support': 1713}, 'macro avg': {'precision': 0.19703994760969223, 'recall': 0.1972951864183829, 'f1-score': 0.1914208913374697, 'support': 1713}, 'weighted avg': {'precision': 0.19820987548126714, 'recall': 0.2031523642732049, 'f1-score': 0.19503381685623783, 'support': 1713}}
Token level accuracy: 0.5488296425796426
Wrong BIO-Encoding 79/1709 labels, 4.62%
Test-Data: Prec: 0.213, Rec: 0.203, F1: 0.2082

Scores from epoch with best dev-scores:
  Dev-Score: 0.6835
  Test-Score 0.1966

8.44 sec for evaluation

--------- Epoch 28 -----------
217.92 sec for training (6156.66 total)
-- cmv_modes1 --



{'C': {'precision': 0.875, 'recall': 0.8235294117647058, 'f1-score': 0.8484848484848485, 'support': 17}, 'P': {'precision': 0.5, 'recall': 0.5416666666666666, 'f1-score': 0.52, 'support': 24}, 'micro avg': {'precision': 0.6428571428571429, 'recall': 0.6585365853658537, 'f1-score': 0.6506024096385543, 'support': 41}, 'macro avg': {'precision': 0.6875, 'recall': 0.6825980392156863, 'f1-score': 0.6842424242424243, 'support': 41}, 'weighted avg': {'precision': 0.6554878048780488, 'recall': 0.6585365853658537, 'f1-score': 0.6562010347376201, 'support': 41}}
Token level accuracy: 0.9434447300771208



{'C': {'precision': 0.875, 'recall': 0.8235294117647058, 'f1-score': 0.8484848484848485, 'support': 17}, 'P': {'precision': 0.5, 'recall': 0.5416666666666666, 'f1-score': 0.52, 'support': 24}, 'micro avg': {'precision': 0.6428571428571429, 'recall': 0.6585365853658537, 'f1-score': 0.6506024096385543, 'support': 41}, 'macro avg': {'precision': 0.6875, 'recall': 0.6825980392156863, 'f1-score': 0.6842424242424243, 'support': 41}, 'weighted avg': {'precision': 0.6554878048780488, 'recall': 0.6585365853658537, 'f1-score': 0.6562010347376201, 'support': 41}}
Token level accuracy: 0.9434447300771208
Dev-Data: Prec: 0.643, Rec: 0.659, F1: 0.6506



{'C': {'precision': 0.16768916155419222, 'recall': 0.20628930817610064, 'f1-score': 0.18499717992103779, 'support': 795}, 'P': {'precision': 0.22373300370828184, 'recall': 0.19716775599128541, 'f1-score': 0.2096120440069485, 'support': 918}, 'micro avg': {'precision': 0.19306099608282037, 'recall': 0.20140105078809106, 'f1-score': 0.19714285714285715, 'support': 1713}, 'macro avg': {'precision': 0.19571108263123704, 'recall': 0.201728532083693, 'f1-score': 0.19730461196399313, 'support': 1713}, 'weighted avg': {'precision': 0.19772316452993902, 'recall': 0.20140105078809106, 'f1-score': 0.19818833300385508, 'support': 1713}}
Token level accuracy: 0.5476398601398601
Wrong BIO-Encoding 1628/3317 labels, 49.08%



{'C': {'precision': 0.16768916155419222, 'recall': 0.20628930817610064, 'f1-score': 0.18499717992103779, 'support': 795}, 'P': {'precision': 0.22373300370828184, 'recall': 0.19716775599128541, 'f1-score': 0.2096120440069485, 'support': 918}, 'micro avg': {'precision': 0.19306099608282037, 'recall': 0.20140105078809106, 'f1-score': 0.19714285714285715, 'support': 1713}, 'macro avg': {'precision': 0.19571108263123704, 'recall': 0.201728532083693, 'f1-score': 0.19730461196399313, 'support': 1713}, 'weighted avg': {'precision': 0.19772316452993902, 'recall': 0.20140105078809106, 'f1-score': 0.19818833300385508, 'support': 1713}}
Token level accuracy: 0.5476398601398601
Wrong BIO-Encoding 98/1787 labels, 5.48%
Test-Data: Prec: 0.204, Rec: 0.201, F1: 0.2028

Scores from epoch with best dev-scores:
  Dev-Score: 0.6835
  Test-Score 0.1966

9.11 sec for evaluation

--------- Epoch 29 -----------
217.58 sec for training (6374.25 total)
-- cmv_modes1 --



{'C': {'precision': 0.9333333333333333, 'recall': 0.8235294117647058, 'f1-score': 0.8749999999999999, 'support': 17}, 'P': {'precision': 0.2916666666666667, 'recall': 0.2916666666666667, 'f1-score': 0.2916666666666667, 'support': 24}, 'micro avg': {'precision': 0.5384615384615384, 'recall': 0.5121951219512195, 'f1-score': 0.525, 'support': 41}, 'macro avg': {'precision': 0.6125, 'recall': 0.5575980392156863, 'f1-score': 0.5833333333333333, 'support': 41}, 'weighted avg': {'precision': 0.5577235772357724, 'recall': 0.5121951219512195, 'f1-score': 0.5335365853658537, 'support': 41}}
Token level accuracy: 0.9254498714652957



{'C': {'precision': 0.9333333333333333, 'recall': 0.8235294117647058, 'f1-score': 0.8749999999999999, 'support': 17}, 'P': {'precision': 0.2916666666666667, 'recall': 0.2916666666666667, 'f1-score': 0.2916666666666667, 'support': 24}, 'micro avg': {'precision': 0.5384615384615384, 'recall': 0.5121951219512195, 'f1-score': 0.525, 'support': 41}, 'macro avg': {'precision': 0.6125, 'recall': 0.5575980392156863, 'f1-score': 0.5833333333333333, 'support': 41}, 'weighted avg': {'precision': 0.5577235772357724, 'recall': 0.5121951219512195, 'f1-score': 0.5335365853658537, 'support': 41}}
Token level accuracy: 0.9254498714652957
Dev-Data: Prec: 0.538, Rec: 0.512, F1: 0.5250



{'C': {'precision': 0.1869031377899045, 'recall': 0.17232704402515722, 'f1-score': 0.17931937172774867, 'support': 795}, 'P': {'precision': 0.23728813559322035, 'recall': 0.27450980392156865, 'f1-score': 0.2545454545454546, 'support': 918}, 'micro avg': {'precision': 0.21671309192200558, 'recall': 0.22708698190309398, 'f1-score': 0.2217787913340935, 'support': 1713}, 'macro avg': {'precision': 0.21209563669156242, 'recall': 0.22341842397336292, 'f1-score': 0.2169324131366016, 'support': 1713}, 'weighted avg': {'precision': 0.2139045551766202, 'recall': 0.22708698190309398, 'f1-score': 0.21963317442865588, 'support': 1713}}
Token level accuracy: 0.5523747086247086
Wrong BIO-Encoding 1415/3137 labels, 45.11%



{'C': {'precision': 0.1869031377899045, 'recall': 0.17232704402515722, 'f1-score': 0.17931937172774867, 'support': 795}, 'P': {'precision': 0.23728813559322035, 'recall': 0.27450980392156865, 'f1-score': 0.2545454545454546, 'support': 918}, 'micro avg': {'precision': 0.21671309192200558, 'recall': 0.22708698190309398, 'f1-score': 0.2217787913340935, 'support': 1713}, 'macro avg': {'precision': 0.21209563669156242, 'recall': 0.22341842397336292, 'f1-score': 0.2169324131366016, 'support': 1713}, 'weighted avg': {'precision': 0.2139045551766202, 'recall': 0.22708698190309398, 'f1-score': 0.21963317442865588, 'support': 1713}}
Token level accuracy: 0.5523747086247086
Wrong BIO-Encoding 73/1795 labels, 4.07%
Test-Data: Prec: 0.226, Rec: 0.227, F1: 0.2265

Scores from epoch with best dev-scores:
  Dev-Score: 0.6835
  Test-Score 0.1966

9.05 sec for evaluation

--------- Epoch 30 -----------
217.52 sec for training (6591.77 total)
-- cmv_modes1 --



{'C': {'precision': 1.0, 'recall': 0.8823529411764706, 'f1-score': 0.9375, 'support': 17}, 'P': {'precision': 0.4230769230769231, 'recall': 0.4583333333333333, 'f1-score': 0.43999999999999995, 'support': 24}, 'micro avg': {'precision': 0.6341463414634146, 'recall': 0.6341463414634146, 'f1-score': 0.6341463414634146, 'support': 41}, 'macro avg': {'precision': 0.7115384615384616, 'recall': 0.6703431372549019, 'f1-score': 0.68875, 'support': 41}, 'weighted avg': {'precision': 0.6622889305816135, 'recall': 0.6341463414634146, 'f1-score': 0.646280487804878, 'support': 41}}
Token level accuracy: 0.929305912596401
Wrong BIO-Encoding 4/44 labels, 9.09%



{'C': {'precision': 1.0, 'recall': 0.8823529411764706, 'f1-score': 0.9375, 'support': 17}, 'P': {'precision': 0.4230769230769231, 'recall': 0.4583333333333333, 'f1-score': 0.43999999999999995, 'support': 24}, 'micro avg': {'precision': 0.6341463414634146, 'recall': 0.6341463414634146, 'f1-score': 0.6341463414634146, 'support': 41}, 'macro avg': {'precision': 0.7115384615384616, 'recall': 0.6703431372549019, 'f1-score': 0.68875, 'support': 41}, 'weighted avg': {'precision': 0.6622889305816135, 'recall': 0.6341463414634146, 'f1-score': 0.646280487804878, 'support': 41}}
Token level accuracy: 0.929305912596401
Wrong BIO-Encoding 1/41 labels, 2.44%
Dev-Data: Prec: 0.650, Rec: 0.634, F1: 0.6420



{'C': {'precision': 0.14122137404580154, 'recall': 0.0930817610062893, 'f1-score': 0.11220621683093253, 'support': 795}, 'P': {'precision': 0.2056151940545004, 'recall': 0.27124183006535946, 'f1-score': 0.23391263503992482, 'support': 918}, 'micro avg': {'precision': 0.1861671469740634, 'recall': 0.18855808523058962, 'f1-score': 0.18735498839907191, 'support': 1713}, 'macro avg': {'precision': 0.17341828405015097, 'recall': 0.18216179553582437, 'f1-score': 0.17305942593542867, 'support': 1713}, 'weighted avg': {'precision': 0.17573014623960515, 'recall': 0.18855808523058962, 'f1-score': 0.17742892080983208, 'support': 1713}}
Token level accuracy: 0.5282634032634033
Wrong BIO-Encoding 1551/3194 labels, 48.56%



{'C': {'precision': 0.14122137404580154, 'recall': 0.0930817610062893, 'f1-score': 0.11220621683093253, 'support': 795}, 'P': {'precision': 0.2056151940545004, 'recall': 0.27124183006535946, 'f1-score': 0.23391263503992482, 'support': 918}, 'micro avg': {'precision': 0.1861671469740634, 'recall': 0.18855808523058962, 'f1-score': 0.18735498839907191, 'support': 1713}, 'macro avg': {'precision': 0.17341828405015097, 'recall': 0.18216179553582437, 'f1-score': 0.17305942593542867, 'support': 1713}, 'weighted avg': {'precision': 0.17573014623960515, 'recall': 0.18855808523058962, 'f1-score': 0.17742892080983208, 'support': 1713}}
Token level accuracy: 0.5282634032634033
Wrong BIO-Encoding 92/1735 labels, 5.30%
Test-Data: Prec: 0.196, Rec: 0.188, F1: 0.1919

Scores from epoch with best dev-scores:
  Dev-Score: 0.6835
  Test-Score 0.1966

8.42 sec for evaluation

--------- Epoch 31 -----------
216.93 sec for training (6808.69 total)
-- cmv_modes1 --



{'C': {'precision': 0.9375, 'recall': 0.8823529411764706, 'f1-score': 0.9090909090909091, 'support': 17}, 'P': {'precision': 0.6, 'recall': 0.625, 'f1-score': 0.6122448979591836, 'support': 24}, 'micro avg': {'precision': 0.7317073170731707, 'recall': 0.7317073170731707, 'f1-score': 0.7317073170731707, 'support': 41}, 'macro avg': {'precision': 0.76875, 'recall': 0.7536764705882353, 'f1-score': 0.7606679035250463, 'support': 41}, 'weighted avg': {'precision': 0.7399390243902438, 'recall': 0.7317073170731707, 'f1-score': 0.7353273903796551, 'support': 41}}
Token level accuracy: 0.9305912596401028



{'C': {'precision': 0.9375, 'recall': 0.8823529411764706, 'f1-score': 0.9090909090909091, 'support': 17}, 'P': {'precision': 0.6, 'recall': 0.625, 'f1-score': 0.6122448979591836, 'support': 24}, 'micro avg': {'precision': 0.7317073170731707, 'recall': 0.7317073170731707, 'f1-score': 0.7317073170731707, 'support': 41}, 'macro avg': {'precision': 0.76875, 'recall': 0.7536764705882353, 'f1-score': 0.7606679035250463, 'support': 41}, 'weighted avg': {'precision': 0.7399390243902438, 'recall': 0.7317073170731707, 'f1-score': 0.7353273903796551, 'support': 41}}
Token level accuracy: 0.9305912596401028
Dev-Data: Prec: 0.732, Rec: 0.732, F1: 0.7317



{'C': {'precision': 0.14928649835345773, 'recall': 0.1710691823899371, 'f1-score': 0.15943728018757328, 'support': 795}, 'P': {'precision': 0.20234604105571846, 'recall': 0.22549019607843138, 'f1-score': 0.21329211746522408, 'support': 918}, 'micro avg': {'precision': 0.17735263702171664, 'recall': 0.20023350846468185, 'f1-score': 0.18809980806142035, 'support': 1713}, 'macro avg': {'precision': 0.17581626970458808, 'recall': 0.19827968923418424, 'f1-score': 0.18636469882639867, 'support': 1713}, 'weighted avg': {'precision': 0.17772120950388118, 'recall': 0.20023350846468185, 'f1-score': 0.18829819123303937, 'support': 1713}}
Token level accuracy: 0.5462801087801088
Wrong BIO-Encoding 1236/3103 labels, 39.83%



{'C': {'precision': 0.14928649835345773, 'recall': 0.1710691823899371, 'f1-score': 0.15943728018757328, 'support': 795}, 'P': {'precision': 0.20234604105571846, 'recall': 0.22549019607843138, 'f1-score': 0.21329211746522408, 'support': 918}, 'micro avg': {'precision': 0.17735263702171664, 'recall': 0.20023350846468185, 'f1-score': 0.18809980806142035, 'support': 1713}, 'macro avg': {'precision': 0.17581626970458808, 'recall': 0.19827968923418424, 'f1-score': 0.18636469882639867, 'support': 1713}, 'weighted avg': {'precision': 0.17772120950388118, 'recall': 0.20023350846468185, 'f1-score': 0.18829819123303937, 'support': 1713}}
Token level accuracy: 0.5462801087801088
Wrong BIO-Encoding 67/1934 labels, 3.46%
Test-Data: Prec: 0.183, Rec: 0.200, F1: 0.1911

Scores from epoch with best dev-scores:
  Dev-Score: 0.7317
  Test-Score 0.1911

8.88 sec for evaluation

--------- Epoch 32 -----------
216.36 sec for training (7025.06 total)
-- cmv_modes1 --



{'C': {'precision': 0.9375, 'recall': 0.8823529411764706, 'f1-score': 0.9090909090909091, 'support': 17}, 'P': {'precision': 0.64, 'recall': 0.6666666666666666, 'f1-score': 0.6530612244897959, 'support': 24}, 'micro avg': {'precision': 0.7560975609756098, 'recall': 0.7560975609756098, 'f1-score': 0.7560975609756099, 'support': 41}, 'macro avg': {'precision': 0.7887500000000001, 'recall': 0.7745098039215685, 'f1-score': 0.7810760667903525, 'support': 41}, 'weighted avg': {'precision': 0.7633536585365853, 'recall': 0.7560975609756098, 'f1-score': 0.7592198742024525, 'support': 41}}
Token level accuracy: 0.9575835475578406



{'C': {'precision': 0.9375, 'recall': 0.8823529411764706, 'f1-score': 0.9090909090909091, 'support': 17}, 'P': {'precision': 0.64, 'recall': 0.6666666666666666, 'f1-score': 0.6530612244897959, 'support': 24}, 'micro avg': {'precision': 0.7560975609756098, 'recall': 0.7560975609756098, 'f1-score': 0.7560975609756099, 'support': 41}, 'macro avg': {'precision': 0.7887500000000001, 'recall': 0.7745098039215685, 'f1-score': 0.7810760667903525, 'support': 41}, 'weighted avg': {'precision': 0.7633536585365853, 'recall': 0.7560975609756098, 'f1-score': 0.7592198742024525, 'support': 41}}
Token level accuracy: 0.9575835475578406
Dev-Data: Prec: 0.756, Rec: 0.756, F1: 0.7561



{'C': {'precision': 0.13661971830985917, 'recall': 0.1220125786163522, 'f1-score': 0.12890365448504984, 'support': 795}, 'P': {'precision': 0.2104752667313288, 'recall': 0.23638344226579522, 'f1-score': 0.2226782965623397, 'support': 918}, 'micro avg': {'precision': 0.1803561171740379, 'recall': 0.1833041447752481, 'f1-score': 0.1818181818181818, 'support': 1713}, 'macro avg': {'precision': 0.17354749252059398, 'recall': 0.1791980104410737, 'f1-score': 0.17579097552369477, 'support': 1713}, 'weighted avg': {'precision': 0.17619904898756444, 'recall': 0.1833041447752481, 'f1-score': 0.17915766582594425, 'support': 1713}}
Token level accuracy: 0.543997668997669
Wrong BIO-Encoding 1595/3239 labels, 49.24%



{'C': {'precision': 0.13661971830985917, 'recall': 0.1220125786163522, 'f1-score': 0.12890365448504984, 'support': 795}, 'P': {'precision': 0.2104752667313288, 'recall': 0.23638344226579522, 'f1-score': 0.2226782965623397, 'support': 918}, 'micro avg': {'precision': 0.1803561171740379, 'recall': 0.1833041447752481, 'f1-score': 0.1818181818181818, 'support': 1713}, 'macro avg': {'precision': 0.17354749252059398, 'recall': 0.1791980104410737, 'f1-score': 0.17579097552369477, 'support': 1713}, 'weighted avg': {'precision': 0.17619904898756444, 'recall': 0.1833041447752481, 'f1-score': 0.17915766582594425, 'support': 1713}}
Token level accuracy: 0.543997668997669
Wrong BIO-Encoding 97/1741 labels, 5.57%
Test-Data: Prec: 0.190, Rec: 0.183, F1: 0.1865

Scores from epoch with best dev-scores:
  Dev-Score: 0.7561
  Test-Score 0.1865

9.00 sec for evaluation

--------- Epoch 33 -----------
215.78 sec for training (7240.83 total)
-- cmv_modes1 --



{'C': {'precision': 0.8235294117647058, 'recall': 0.8235294117647058, 'f1-score': 0.8235294117647058, 'support': 17}, 'P': {'precision': 0.2608695652173913, 'recall': 0.25, 'f1-score': 0.2553191489361702, 'support': 24}, 'micro avg': {'precision': 0.5, 'recall': 0.4878048780487805, 'f1-score': 0.49382716049382713, 'support': 41}, 'macro avg': {'precision': 0.5421994884910486, 'recall': 0.5367647058823529, 'f1-score': 0.539424280350438, 'support': 41}, 'weighted avg': {'precision': 0.4941675503711559, 'recall': 0.4878048780487805, 'f1-score': 0.49091852620653864, 'support': 41}}
Token level accuracy: 0.9357326478149101



{'C': {'precision': 0.8235294117647058, 'recall': 0.8235294117647058, 'f1-score': 0.8235294117647058, 'support': 17}, 'P': {'precision': 0.2608695652173913, 'recall': 0.25, 'f1-score': 0.2553191489361702, 'support': 24}, 'micro avg': {'precision': 0.5, 'recall': 0.4878048780487805, 'f1-score': 0.49382716049382713, 'support': 41}, 'macro avg': {'precision': 0.5421994884910486, 'recall': 0.5367647058823529, 'f1-score': 0.539424280350438, 'support': 41}, 'weighted avg': {'precision': 0.4941675503711559, 'recall': 0.4878048780487805, 'f1-score': 0.49091852620653864, 'support': 41}}
Token level accuracy: 0.9357326478149101
Dev-Data: Prec: 0.500, Rec: 0.488, F1: 0.4938



{'C': {'precision': 0.1907790143084261, 'recall': 0.1509433962264151, 'f1-score': 0.16853932584269662, 'support': 795}, 'P': {'precision': 0.21998320738874896, 'recall': 0.28540305010893247, 'f1-score': 0.24845898530109062, 'support': 918}, 'micro avg': {'precision': 0.2098901098901099, 'recall': 0.2230005837711617, 'f1-score': 0.2162468157373337, 'support': 1713}, 'macro avg': {'precision': 0.2053811108485875, 'recall': 0.2181732231676738, 'f1-score': 0.20849915557189364, 'support': 1713}, 'weighted avg': {'precision': 0.20642959764043797, 'recall': 0.2230005837711617, 'f1-score': 0.21136842530726505, 'support': 1713}}
Token level accuracy: 0.5218288655788655
Wrong BIO-Encoding 1184/2938 labels, 40.30%



{'C': {'precision': 0.1907790143084261, 'recall': 0.1509433962264151, 'f1-score': 0.16853932584269662, 'support': 795}, 'P': {'precision': 0.21998320738874896, 'recall': 0.28540305010893247, 'f1-score': 0.24845898530109062, 'support': 918}, 'micro avg': {'precision': 0.2098901098901099, 'recall': 0.2230005837711617, 'f1-score': 0.2162468157373337, 'support': 1713}, 'macro avg': {'precision': 0.2053811108485875, 'recall': 0.2181732231676738, 'f1-score': 0.20849915557189364, 'support': 1713}, 'weighted avg': {'precision': 0.20642959764043797, 'recall': 0.2230005837711617, 'f1-score': 0.21136842530726505, 'support': 1713}}
Token level accuracy: 0.5218288655788655
Wrong BIO-Encoding 66/1820 labels, 3.63%
Test-Data: Prec: 0.217, Rec: 0.222, F1: 0.2198

Scores from epoch with best dev-scores:
  Dev-Score: 0.7561
  Test-Score 0.1865

9.03 sec for evaluation

--------- Epoch 34 -----------
217.77 sec for training (7458.60 total)
-- cmv_modes1 --



{'C': {'precision': 0.8333333333333334, 'recall': 0.8823529411764706, 'f1-score': 0.8571428571428571, 'support': 17}, 'P': {'precision': 0.7916666666666666, 'recall': 0.7916666666666666, 'f1-score': 0.7916666666666666, 'support': 24}, 'micro avg': {'precision': 0.8095238095238095, 'recall': 0.8292682926829268, 'f1-score': 0.8192771084337348, 'support': 41}, 'macro avg': {'precision': 0.8125, 'recall': 0.8370098039215685, 'f1-score': 0.8244047619047619, 'support': 41}, 'weighted avg': {'precision': 0.8089430894308944, 'recall': 0.8292682926829268, 'f1-score': 0.8188153310104529, 'support': 41}}
Token level accuracy: 0.9755784061696658



{'C': {'precision': 0.8333333333333334, 'recall': 0.8823529411764706, 'f1-score': 0.8571428571428571, 'support': 17}, 'P': {'precision': 0.7916666666666666, 'recall': 0.7916666666666666, 'f1-score': 0.7916666666666666, 'support': 24}, 'micro avg': {'precision': 0.8095238095238095, 'recall': 0.8292682926829268, 'f1-score': 0.8192771084337348, 'support': 41}, 'macro avg': {'precision': 0.8125, 'recall': 0.8370098039215685, 'f1-score': 0.8244047619047619, 'support': 41}, 'weighted avg': {'precision': 0.8089430894308944, 'recall': 0.8292682926829268, 'f1-score': 0.8188153310104529, 'support': 41}}
Token level accuracy: 0.9755784061696658
Dev-Data: Prec: 0.810, Rec: 0.829, F1: 0.8193



{'C': {'precision': 0.15472779369627507, 'recall': 0.2037735849056604, 'f1-score': 0.17589576547231273, 'support': 795}, 'P': {'precision': 0.19490586932447398, 'recall': 0.19172113289760348, 'f1-score': 0.19330038440417355, 'support': 918}, 'micro avg': {'precision': 0.17333333333333334, 'recall': 0.19731465265615877, 'f1-score': 0.18454818454818453, 'support': 1713}, 'macro avg': {'precision': 0.17481683151037453, 'recall': 0.19774735890163192, 'f1-score': 0.18459807493824315, 'support': 1713}, 'weighted avg': {'precision': 0.17625930182627308, 'recall': 0.19731465265615877, 'f1-score': 0.18522293428693518, 'support': 1713}}
Token level accuracy: 0.5250339937839937
Wrong BIO-Encoding 998/2886 labels, 34.58%



{'C': {'precision': 0.15472779369627507, 'recall': 0.2037735849056604, 'f1-score': 0.17589576547231273, 'support': 795}, 'P': {'precision': 0.19490586932447398, 'recall': 0.19172113289760348, 'f1-score': 0.19330038440417355, 'support': 918}, 'micro avg': {'precision': 0.17333333333333334, 'recall': 0.19731465265615877, 'f1-score': 0.18454818454818453, 'support': 1713}, 'macro avg': {'precision': 0.17481683151037453, 'recall': 0.19774735890163192, 'f1-score': 0.18459807493824315, 'support': 1713}, 'weighted avg': {'precision': 0.17625930182627308, 'recall': 0.19731465265615877, 'f1-score': 0.18522293428693518, 'support': 1713}}
Token level accuracy: 0.5250339937839937
Wrong BIO-Encoding 62/1950 labels, 3.18%
Test-Data: Prec: 0.179, Rec: 0.197, F1: 0.1877

Scores from epoch with best dev-scores:
  Dev-Score: 0.8193
  Test-Score 0.1877

8.99 sec for evaluation

--------- Epoch 35 -----------
217.76 sec for training (7676.36 total)
-- cmv_modes1 --



{'C': {'precision': 0.9411764705882353, 'recall': 0.9411764705882353, 'f1-score': 0.9411764705882353, 'support': 17}, 'P': {'precision': 0.8, 'recall': 0.8333333333333334, 'f1-score': 0.816326530612245, 'support': 24}, 'micro avg': {'precision': 0.8571428571428571, 'recall': 0.8780487804878049, 'f1-score': 0.8674698795180722, 'support': 41}, 'macro avg': {'precision': 0.8705882352941177, 'recall': 0.8872549019607843, 'f1-score': 0.8787515006002402, 'support': 41}, 'weighted avg': {'precision': 0.8585365853658538, 'recall': 0.8780487804878049, 'f1-score': 0.8680935788949729, 'support': 41}}
Token level accuracy: 0.9884318766066839



{'C': {'precision': 0.9411764705882353, 'recall': 0.9411764705882353, 'f1-score': 0.9411764705882353, 'support': 17}, 'P': {'precision': 0.8, 'recall': 0.8333333333333334, 'f1-score': 0.816326530612245, 'support': 24}, 'micro avg': {'precision': 0.8571428571428571, 'recall': 0.8780487804878049, 'f1-score': 0.8674698795180722, 'support': 41}, 'macro avg': {'precision': 0.8705882352941177, 'recall': 0.8872549019607843, 'f1-score': 0.8787515006002402, 'support': 41}, 'weighted avg': {'precision': 0.8585365853658538, 'recall': 0.8780487804878049, 'f1-score': 0.8680935788949729, 'support': 41}}
Token level accuracy: 0.9884318766066839
Dev-Data: Prec: 0.857, Rec: 0.878, F1: 0.8675



{'C': {'precision': 0.12086659064994298, 'recall': 0.13333333333333333, 'f1-score': 0.12679425837320574, 'support': 795}, 'P': {'precision': 0.19693654266958424, 'recall': 0.19607843137254902, 'f1-score': 0.1965065502183406, 'support': 918}, 'micro avg': {'precision': 0.15968732551647125, 'recall': 0.16695855224751896, 'f1-score': 0.16324200913242007, 'support': 1713}, 'macro avg': {'precision': 0.15890156665976363, 'recall': 0.16470588235294117, 'f1-score': 0.16165040429577315, 'support': 1713}, 'weighted avg': {'precision': 0.1616326244818348, 'recall': 0.16695855224751896, 'f1-score': 0.16415320986989798, 'support': 1713}}
Token level accuracy: 0.5319784382284383
Wrong BIO-Encoding 870/2592 labels, 33.56%



{'C': {'precision': 0.12086659064994298, 'recall': 0.13333333333333333, 'f1-score': 0.12679425837320574, 'support': 795}, 'P': {'precision': 0.19693654266958424, 'recall': 0.19607843137254902, 'f1-score': 0.1965065502183406, 'support': 918}, 'micro avg': {'precision': 0.15968732551647125, 'recall': 0.16695855224751896, 'f1-score': 0.16324200913242007, 'support': 1713}, 'macro avg': {'precision': 0.15890156665976363, 'recall': 0.16470588235294117, 'f1-score': 0.16165040429577315, 'support': 1713}, 'weighted avg': {'precision': 0.1616326244818348, 'recall': 0.16695855224751896, 'f1-score': 0.16415320986989798, 'support': 1713}}
Token level accuracy: 0.5319784382284383
Wrong BIO-Encoding 69/1791 labels, 3.85%
Test-Data: Prec: 0.166, Rec: 0.166, F1: 0.1659

Scores from epoch with best dev-scores:
  Dev-Score: 0.8675
  Test-Score 0.1659

8.73 sec for evaluation

--------- Epoch 36 -----------
257.66 sec for training (7934.02 total)
-- cmv_modes1 --



{'C': {'precision': 1.0, 'recall': 0.8823529411764706, 'f1-score': 0.9375, 'support': 17}, 'P': {'precision': 0.36, 'recall': 0.375, 'f1-score': 0.3673469387755102, 'support': 24}, 'micro avg': {'precision': 0.6, 'recall': 0.5853658536585366, 'f1-score': 0.5925925925925926, 'support': 41}, 'macro avg': {'precision': 0.6799999999999999, 'recall': 0.6286764705882353, 'f1-score': 0.6524234693877551, 'support': 41}, 'weighted avg': {'precision': 0.6253658536585366, 'recall': 0.5853658536585366, 'f1-score': 0.6037518666002987, 'support': 41}}
Token level accuracy: 0.9305912596401028



{'C': {'precision': 1.0, 'recall': 0.8823529411764706, 'f1-score': 0.9375, 'support': 17}, 'P': {'precision': 0.36, 'recall': 0.375, 'f1-score': 0.3673469387755102, 'support': 24}, 'micro avg': {'precision': 0.6, 'recall': 0.5853658536585366, 'f1-score': 0.5925925925925926, 'support': 41}, 'macro avg': {'precision': 0.6799999999999999, 'recall': 0.6286764705882353, 'f1-score': 0.6524234693877551, 'support': 41}, 'weighted avg': {'precision': 0.6253658536585366, 'recall': 0.5853658536585366, 'f1-score': 0.6037518666002987, 'support': 41}}
Token level accuracy: 0.9305912596401028
Dev-Data: Prec: 0.600, Rec: 0.585, F1: 0.5926



{'C': {'precision': 0.19224283305227655, 'recall': 0.14339622641509434, 'f1-score': 0.1642651296829971, 'support': 795}, 'P': {'precision': 0.2239057239057239, 'recall': 0.289760348583878, 'f1-score': 0.2526115859449193, 'support': 918}, 'micro avg': {'precision': 0.2133632790567097, 'recall': 0.22183304144775248, 'f1-score': 0.21751574127074985, 'support': 1713}, 'macro avg': {'precision': 0.20807427847900023, 'recall': 0.21657828749948616, 'f1-score': 0.2084383578139582, 'support': 1713}, 'weighted avg': {'precision': 0.2092110372574515, 'recall': 0.22183304144775248, 'f1-score': 0.21161016578833544, 'support': 1713}}
Token level accuracy: 0.5467900155400155
Wrong BIO-Encoding 1082/2796 labels, 38.70%



{'C': {'precision': 0.19224283305227655, 'recall': 0.14339622641509434, 'f1-score': 0.1642651296829971, 'support': 795}, 'P': {'precision': 0.2239057239057239, 'recall': 0.289760348583878, 'f1-score': 0.2526115859449193, 'support': 918}, 'micro avg': {'precision': 0.2133632790567097, 'recall': 0.22183304144775248, 'f1-score': 0.21751574127074985, 'support': 1713}, 'macro avg': {'precision': 0.20807427847900023, 'recall': 0.21657828749948616, 'f1-score': 0.2084383578139582, 'support': 1713}, 'weighted avg': {'precision': 0.2092110372574515, 'recall': 0.22183304144775248, 'f1-score': 0.21161016578833544, 'support': 1713}}
Token level accuracy: 0.5467900155400155
Wrong BIO-Encoding 67/1781 labels, 3.76%
Test-Data: Prec: 0.222, Rec: 0.222, F1: 0.2218

Scores from epoch with best dev-scores:
  Dev-Score: 0.8675
  Test-Score 0.1659

12.54 sec for evaluation

--------- Epoch 37 -----------
232.71 sec for training (8166.73 total)
-- cmv_modes1 --



{'C': {'precision': 0.8888888888888888, 'recall': 0.9411764705882353, 'f1-score': 0.9142857142857143, 'support': 17}, 'P': {'precision': 0.6538461538461539, 'recall': 0.7083333333333334, 'f1-score': 0.68, 'support': 24}, 'micro avg': {'precision': 0.75, 'recall': 0.8048780487804879, 'f1-score': 0.7764705882352942, 'support': 41}, 'macro avg': {'precision': 0.7713675213675213, 'recall': 0.8247549019607843, 'f1-score': 0.7971428571428572, 'support': 41}, 'weighted avg': {'precision': 0.7513028976443611, 'recall': 0.8048780487804879, 'f1-score': 0.7771428571428571, 'support': 41}}
Token level accuracy: 0.9704370179948586



{'C': {'precision': 0.8888888888888888, 'recall': 0.9411764705882353, 'f1-score': 0.9142857142857143, 'support': 17}, 'P': {'precision': 0.6538461538461539, 'recall': 0.7083333333333334, 'f1-score': 0.68, 'support': 24}, 'micro avg': {'precision': 0.75, 'recall': 0.8048780487804879, 'f1-score': 0.7764705882352942, 'support': 41}, 'macro avg': {'precision': 0.7713675213675213, 'recall': 0.8247549019607843, 'f1-score': 0.7971428571428572, 'support': 41}, 'weighted avg': {'precision': 0.7513028976443611, 'recall': 0.8048780487804879, 'f1-score': 0.7771428571428571, 'support': 41}}
Token level accuracy: 0.9704370179948586
Dev-Data: Prec: 0.750, Rec: 0.805, F1: 0.7765



{'C': {'precision': 0.13829787234042554, 'recall': 0.1471698113207547, 'f1-score': 0.1425959780621572, 'support': 795}, 'P': {'precision': 0.20319432120674358, 'recall': 0.2494553376906318, 'f1-score': 0.223960880195599, 'support': 918}, 'micro avg': {'precision': 0.17536746071971618, 'recall': 0.20198482194979567, 'f1-score': 0.18773738469886056, 'support': 1713}, 'macro avg': {'precision': 0.17074609677358454, 'recall': 0.19831257450569326, 'f1-score': 0.1832784291288781, 'support': 1713}, 'weighted avg': {'precision': 0.173076004307314, 'recall': 0.20198482194979567, 'f1-score': 0.186199585860464, 'support': 1713}}
Token level accuracy: 0.5447261072261073
Wrong BIO-Encoding 856/2767 labels, 30.94%



{'C': {'precision': 0.13829787234042554, 'recall': 0.1471698113207547, 'f1-score': 0.1425959780621572, 'support': 795}, 'P': {'precision': 0.20319432120674358, 'recall': 0.2494553376906318, 'f1-score': 0.223960880195599, 'support': 918}, 'micro avg': {'precision': 0.17536746071971618, 'recall': 0.20198482194979567, 'f1-score': 0.18773738469886056, 'support': 1713}, 'macro avg': {'precision': 0.17074609677358454, 'recall': 0.19831257450569326, 'f1-score': 0.1832784291288781, 'support': 1713}, 'weighted avg': {'precision': 0.173076004307314, 'recall': 0.20198482194979567, 'f1-score': 0.186199585860464, 'support': 1713}}
Token level accuracy: 0.5447261072261073
Wrong BIO-Encoding 62/1973 labels, 3.14%
Test-Data: Prec: 0.181, Rec: 0.202, F1: 0.1909

Scores from epoch with best dev-scores:
  Dev-Score: 0.8675
  Test-Score 0.1659

9.03 sec for evaluation

--------- Epoch 38 -----------
215.97 sec for training (8382.70 total)
-- cmv_modes1 --



{'C': {'precision': 1.0, 'recall': 0.9411764705882353, 'f1-score': 0.9696969696969697, 'support': 17}, 'P': {'precision': 0.76, 'recall': 0.7916666666666666, 'f1-score': 0.7755102040816326, 'support': 24}, 'micro avg': {'precision': 0.8536585365853658, 'recall': 0.8536585365853658, 'f1-score': 0.8536585365853658, 'support': 41}, 'macro avg': {'precision': 0.88, 'recall': 0.866421568627451, 'f1-score': 0.8726035868893012, 'support': 41}, 'weighted avg': {'precision': 0.8595121951219513, 'recall': 0.8536585365853658, 'f1-score': 0.8560266678733578, 'support': 41}}
Token level accuracy: 0.9717223650385605



{'C': {'precision': 1.0, 'recall': 0.9411764705882353, 'f1-score': 0.9696969696969697, 'support': 17}, 'P': {'precision': 0.76, 'recall': 0.7916666666666666, 'f1-score': 0.7755102040816326, 'support': 24}, 'micro avg': {'precision': 0.8536585365853658, 'recall': 0.8536585365853658, 'f1-score': 0.8536585365853658, 'support': 41}, 'macro avg': {'precision': 0.88, 'recall': 0.866421568627451, 'f1-score': 0.8726035868893012, 'support': 41}, 'weighted avg': {'precision': 0.8595121951219513, 'recall': 0.8536585365853658, 'f1-score': 0.8560266678733578, 'support': 41}}
Token level accuracy: 0.9717223650385605
Dev-Data: Prec: 0.854, Rec: 0.854, F1: 0.8537



{'C': {'precision': 0.16098484848484848, 'recall': 0.1069182389937107, 'f1-score': 0.12849584278155707, 'support': 795}, 'P': {'precision': 0.20575783234546993, 'recall': 0.2647058823529412, 'f1-score': 0.2315388280133397, 'support': 918}, 'micro avg': {'precision': 0.19192510239906377, 'recall': 0.19147694103911267, 'f1-score': 0.19170075978959675, 'support': 1713}, 'macro avg': {'precision': 0.1833713404151592, 'recall': 0.18581206067332595, 'f1-score': 0.18001733539744838, 'support': 1713}, 'weighted avg': {'precision': 0.18497877678843896, 'recall': 0.19147694103911267, 'f1-score': 0.18371677707389591, 'support': 1713}}
Token level accuracy: 0.5290889665889665
Wrong BIO-Encoding 1180/2801 labels, 42.13%



{'C': {'precision': 0.16098484848484848, 'recall': 0.1069182389937107, 'f1-score': 0.12849584278155707, 'support': 795}, 'P': {'precision': 0.20575783234546993, 'recall': 0.2647058823529412, 'f1-score': 0.2315388280133397, 'support': 918}, 'micro avg': {'precision': 0.19192510239906377, 'recall': 0.19147694103911267, 'f1-score': 0.19170075978959675, 'support': 1713}, 'macro avg': {'precision': 0.1833713404151592, 'recall': 0.18581206067332595, 'f1-score': 0.18001733539744838, 'support': 1713}, 'weighted avg': {'precision': 0.18497877678843896, 'recall': 0.19147694103911267, 'f1-score': 0.18371677707389591, 'support': 1713}}
Token level accuracy: 0.5290889665889665
Wrong BIO-Encoding 88/1709 labels, 5.15%
Test-Data: Prec: 0.202, Rec: 0.191, F1: 0.1968

Scores from epoch with best dev-scores:
  Dev-Score: 0.8675
  Test-Score 0.1659

9.07 sec for evaluation

--------- Epoch 39 -----------
216.28 sec for training (8598.97 total)
-- cmv_modes1 --



{'C': {'precision': 1.0, 'recall': 0.8823529411764706, 'f1-score': 0.9375, 'support': 17}, 'P': {'precision': 0.72, 'recall': 0.75, 'f1-score': 0.7346938775510204, 'support': 24}, 'micro avg': {'precision': 0.825, 'recall': 0.8048780487804879, 'f1-score': 0.8148148148148149, 'support': 41}, 'macro avg': {'precision': 0.86, 'recall': 0.8161764705882353, 'f1-score': 0.8360969387755102, 'support': 41}, 'weighted avg': {'precision': 0.8360975609756098, 'recall': 0.8048780487804879, 'f1-score': 0.8187842210054753, 'support': 41}}
Token level accuracy: 0.9447300771208226



{'C': {'precision': 1.0, 'recall': 0.8823529411764706, 'f1-score': 0.9375, 'support': 17}, 'P': {'precision': 0.72, 'recall': 0.75, 'f1-score': 0.7346938775510204, 'support': 24}, 'micro avg': {'precision': 0.825, 'recall': 0.8048780487804879, 'f1-score': 0.8148148148148149, 'support': 41}, 'macro avg': {'precision': 0.86, 'recall': 0.8161764705882353, 'f1-score': 0.8360969387755102, 'support': 41}, 'weighted avg': {'precision': 0.8360975609756098, 'recall': 0.8048780487804879, 'f1-score': 0.8187842210054753, 'support': 41}}
Token level accuracy: 0.9447300771208226
Dev-Data: Prec: 0.825, Rec: 0.805, F1: 0.8148



{'C': {'precision': 0.1625, 'recall': 0.11446540880503145, 'f1-score': 0.13431734317343175, 'support': 795}, 'P': {'precision': 0.2037643207855974, 'recall': 0.27124183006535946, 'f1-score': 0.23271028037383176, 'support': 918}, 'micro avg': {'precision': 0.19079685746352412, 'recall': 0.198482194979568, 'f1-score': 0.19456366237482117, 'support': 1713}, 'macro avg': {'precision': 0.1831321603927987, 'recall': 0.19285361943519547, 'f1-score': 0.18351381177363174, 'support': 1713}, 'weighted avg': {'precision': 0.18461362900243924, 'recall': 0.198482194979568, 'f1-score': 0.18704630776769166, 'support': 1713}}
Token level accuracy: 0.5253253690753691
Wrong BIO-Encoding 738/2464 labels, 29.95%



{'C': {'precision': 0.1625, 'recall': 0.11446540880503145, 'f1-score': 0.13431734317343175, 'support': 795}, 'P': {'precision': 0.2037643207855974, 'recall': 0.27124183006535946, 'f1-score': 0.23271028037383176, 'support': 918}, 'micro avg': {'precision': 0.19079685746352412, 'recall': 0.198482194979568, 'f1-score': 0.19456366237482117, 'support': 1713}, 'macro avg': {'precision': 0.1831321603927987, 'recall': 0.19285361943519547, 'f1-score': 0.18351381177363174, 'support': 1713}, 'weighted avg': {'precision': 0.18461362900243924, 'recall': 0.198482194979568, 'f1-score': 0.18704630776769166, 'support': 1713}}
Token level accuracy: 0.5253253690753691
Wrong BIO-Encoding 56/1782 labels, 3.14%
Test-Data: Prec: 0.197, Rec: 0.198, F1: 0.1977

Scores from epoch with best dev-scores:
  Dev-Score: 0.8675
  Test-Score 0.1659

9.06 sec for evaluation

--------- Epoch 40 -----------
215.07 sec for training (8814.05 total)
-- cmv_modes1 --



{'C': {'precision': 1.0, 'recall': 0.8823529411764706, 'f1-score': 0.9375, 'support': 17}, 'P': {'precision': 0.8076923076923077, 'recall': 0.875, 'f1-score': 0.8400000000000001, 'support': 24}, 'micro avg': {'precision': 0.8780487804878049, 'recall': 0.8780487804878049, 'f1-score': 0.8780487804878049, 'support': 41}, 'macro avg': {'precision': 0.9038461538461539, 'recall': 0.8786764705882353, 'f1-score': 0.88875, 'support': 41}, 'weighted avg': {'precision': 0.8874296435272045, 'recall': 0.8780487804878049, 'f1-score': 0.8804268292682927, 'support': 41}}
Token level accuracy: 0.9511568123393316



{'C': {'precision': 1.0, 'recall': 0.8823529411764706, 'f1-score': 0.9375, 'support': 17}, 'P': {'precision': 0.8076923076923077, 'recall': 0.875, 'f1-score': 0.8400000000000001, 'support': 24}, 'micro avg': {'precision': 0.8780487804878049, 'recall': 0.8780487804878049, 'f1-score': 0.8780487804878049, 'support': 41}, 'macro avg': {'precision': 0.9038461538461539, 'recall': 0.8786764705882353, 'f1-score': 0.88875, 'support': 41}, 'weighted avg': {'precision': 0.8874296435272045, 'recall': 0.8780487804878049, 'f1-score': 0.8804268292682927, 'support': 41}}
Token level accuracy: 0.9511568123393316
Dev-Data: Prec: 0.878, Rec: 0.878, F1: 0.8780



{'C': {'precision': 0.14884393063583815, 'recall': 0.12955974842767295, 'f1-score': 0.13853396099529253, 'support': 795}, 'P': {'precision': 0.18212765957446808, 'recall': 0.23311546840958605, 'f1-score': 0.20449116101290013, 'support': 918}, 'micro avg': {'precision': 0.1697911087305838, 'recall': 0.18505545826036193, 'f1-score': 0.17709497206703909, 'support': 1713}, 'macro avg': {'precision': 0.1654857951051531, 'recall': 0.1813376084186295, 'f1-score': 0.17151256100409634, 'support': 1713}, 'weighted avg': {'precision': 0.1666807450933176, 'recall': 0.18505545826036193, 'f1-score': 0.17388055154763565, 'support': 1713}}
Token level accuracy: 0.5481254856254856
Wrong BIO-Encoding 698/2512 labels, 27.79%



{'C': {'precision': 0.14884393063583815, 'recall': 0.12955974842767295, 'f1-score': 0.13853396099529253, 'support': 795}, 'P': {'precision': 0.18212765957446808, 'recall': 0.23311546840958605, 'f1-score': 0.20449116101290013, 'support': 918}, 'micro avg': {'precision': 0.1697911087305838, 'recall': 0.18505545826036193, 'f1-score': 0.17709497206703909, 'support': 1713}, 'macro avg': {'precision': 0.1654857951051531, 'recall': 0.1813376084186295, 'f1-score': 0.17151256100409634, 'support': 1713}, 'weighted avg': {'precision': 0.1666807450933176, 'recall': 0.18505545826036193, 'f1-score': 0.17388055154763565, 'support': 1713}}
Token level accuracy: 0.5481254856254856
Wrong BIO-Encoding 53/1867 labels, 2.84%
Test-Data: Prec: 0.175, Rec: 0.185, F1: 0.1798

Scores from epoch with best dev-scores:
  Dev-Score: 0.8780
  Test-Score 0.1798

9.01 sec for evaluation
---------RUN 5 ------------
Generate new embeddings files for a dataset
Read file: komninos_english_embeddings.gz
Added words: 9
:: Transform cmv_modes dataset ::
:: Create Train Matrix ::
Unknown-Tokens: 0.97%
:: Create Dev Matrix ::
Unknown-Tokens: 0.71%
:: Create Test Matrix ::
Unknown-Tokens: 0.88%
:: Transform cmv_modes1 dataset ::
:: Create Train Matrix ::
Unknown-Tokens: 0.97%
:: Create Dev Matrix ::
Unknown-Tokens: 0.71%
:: Create Test Matrix ::
Unknown-Tokens: 0.88%
:: Transform cmv_modes2 dataset ::
:: Create Train Matrix ::
Unknown-Tokens: 0.97%
:: Create Dev Matrix ::
Unknown-Tokens: 0.71%
:: Create Test Matrix ::
Unknown-Tokens: 0.88%
DONE - Embeddings file saved: pkl/cmv_modes_cmv_modes1_cmv_modes2_komninos_english_embeddings.pkl
--- cmv_modes ---
211 train sentences
3 dev sentences
245 test sentences
--- cmv_modes1 ---
211 train sentences
3 dev sentences
245 test sentences
--- cmv_modes2 ---
211 train sentences
3 dev sentences
245 test sentences
LSTM-Size: [100]
_____________________________________________________________________________________________________________________________
Layer (type)                             Output Shape               Param #        Connected to                              
=============================================================================================================================
words_input (InputLayer)                 (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
casing_input (InputLayer)                (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
word_embeddings (Embedding)              (None, None, 300)          66694500       words_input[0][0]                         
_____________________________________________________________________________________________________________________________
casing_emebddings (Embedding)            (None, None, 10)           80             casing_input[0][0]                        
_____________________________________________________________________________________________________________________________
concatenate_1 (Concatenate)              (None, None, 310)          0              word_embeddings[0][0]                     
                                                                                   casing_emebddings[0][0]                   
_____________________________________________________________________________________________________________________________
shared_varLSTM_1 (Bidirectional)         (None, None, 200)          328800         concatenate_1[0][0]                       
_____________________________________________________________________________________________________________________________
cmv_modes_hidden_lin_layer (TimeDistribu (None, None, 287)          57687          shared_varLSTM_1[0][0]                    
_____________________________________________________________________________________________________________________________
cmv_modes_crf (ChainCRF)                 (None, None, 287)          82943          cmv_modes_hidden_lin_layer[0][0]          
=============================================================================================================================
Total params: 67,164,010
Trainable params: 469,510
Non-trainable params: 66,694,500
_____________________________________________________________________________________________________________________________
_____________________________________________________________________________________________________________________________
Layer (type)                             Output Shape               Param #        Connected to                              
=============================================================================================================================
words_input (InputLayer)                 (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
casing_input (InputLayer)                (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
word_embeddings (Embedding)              (None, None, 300)          66694500       words_input[0][0]                         
_____________________________________________________________________________________________________________________________
casing_emebddings (Embedding)            (None, None, 10)           80             casing_input[0][0]                        
_____________________________________________________________________________________________________________________________
concatenate_1 (Concatenate)              (None, None, 310)          0              word_embeddings[0][0]                     
                                                                                   casing_emebddings[0][0]                   
_____________________________________________________________________________________________________________________________
shared_varLSTM_1 (Bidirectional)         (None, None, 200)          328800         concatenate_1[0][0]                       
_____________________________________________________________________________________________________________________________
cmv_modes1_hidden_lin_layer (TimeDistrib (None, None, 5)            1005           shared_varLSTM_1[0][0]                    
_____________________________________________________________________________________________________________________________
cmv_modes1_crf (ChainCRF)                (None, None, 5)            35             cmv_modes1_hidden_lin_layer[0][0]         
=============================================================================================================================
Total params: 67,024,420
Trainable params: 329,920
Non-trainable params: 66,694,500
_____________________________________________________________________________________________________________________________
_____________________________________________________________________________________________________________________________
Layer (type)                             Output Shape               Param #        Connected to                              
=============================================================================================================================
words_input (InputLayer)                 (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
casing_input (InputLayer)                (None, None)               0                                                        
_____________________________________________________________________________________________________________________________
word_embeddings (Embedding)              (None, None, 300)          66694500       words_input[0][0]                         
_____________________________________________________________________________________________________________________________
casing_emebddings (Embedding)            (None, None, 10)           80             casing_input[0][0]                        
_____________________________________________________________________________________________________________________________
concatenate_1 (Concatenate)              (None, None, 310)          0              word_embeddings[0][0]                     
                                                                                   casing_emebddings[0][0]                   
_____________________________________________________________________________________________________________________________
shared_varLSTM_1 (Bidirectional)         (None, None, 200)          328800         concatenate_1[0][0]                       
_____________________________________________________________________________________________________________________________
cmv_modes2_softmax (TimeDistributed)     (None, None, 119)          23919          shared_varLSTM_1[0][0]                    
=============================================================================================================================
Total params: 67,047,299
Trainable params: 352,799
Non-trainable params: 66,694,500
_____________________________________________________________________________________________________________________________

--------- Epoch 1 -----------
203.05 sec for training (203.05 total)
-- cmv_modes1 --



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 26}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 20}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 46}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 46}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 46}}
Token level accuracy: 0.3021978021978022
Wrong BIO-Encoding 1267/1267 labels, 100.00%



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 26}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 20}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 46}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 46}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 46}}
Token level accuracy: 0.3021978021978022
Wrong BIO-Encoding 5/5 labels, 100.00%
Dev-Data: Prec: 0.000, Rec: 0.000, F1: 0.0000



{'C': {'precision': 0.05084745762711865, 'recall': 0.0032822757111597373, 'f1-score': 0.006166495375128468, 'support': 914}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 1046}, 'micro avg': {'precision': 0.007537688442211055, 'recall': 0.001530612244897959, 'f1-score': 0.002544529262086514, 'support': 1960}, 'macro avg': {'precision': 0.025423728813559324, 'recall': 0.0016411378555798686, 'f1-score': 0.003083247687564234, 'support': 1960}, 'weighted avg': {'precision': 0.02371151850570737, 'recall': 0.001530612244897959, 'f1-score': 0.002875600394320112, 'support': 1960}}
Token level accuracy: 0.40380371283915356
Wrong BIO-Encoding 45740/45762 labels, 99.95%



{'C': {'precision': 0.05084745762711865, 'recall': 0.0032822757111597373, 'f1-score': 0.006166495375128468, 'support': 914}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 1046}, 'micro avg': {'precision': 0.007537688442211055, 'recall': 0.001530612244897959, 'f1-score': 0.002544529262086514, 'support': 1960}, 'macro avg': {'precision': 0.025423728813559324, 'recall': 0.0016411378555798686, 'f1-score': 0.003083247687564234, 'support': 1960}, 'weighted avg': {'precision': 0.02371151850570737, 'recall': 0.001530612244897959, 'f1-score': 0.002875600394320112, 'support': 1960}}
Token level accuracy: 0.40380371283915356
Wrong BIO-Encoding 376/398 labels, 94.47%
Test-Data: Prec: 0.008, Rec: 0.002, F1: 0.0025

Scores from epoch with best dev-scores:
  Dev-Score: 0.0000
  Test-Score 0.0000

11.23 sec for evaluation

--------- Epoch 2 -----------
189.78 sec for training (392.83 total)
-- cmv_modes1 --



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 26}, 'P': {'precision': 0.125, 'recall': 0.4, 'f1-score': 0.19047619047619047, 'support': 20}, 'micro avg': {'precision': 0.12307692307692308, 'recall': 0.17391304347826086, 'f1-score': 0.14414414414414414, 'support': 46}, 'macro avg': {'precision': 0.0625, 'recall': 0.2, 'f1-score': 0.09523809523809523, 'support': 46}, 'weighted avg': {'precision': 0.05434782608695652, 'recall': 0.17391304347826086, 'f1-score': 0.08281573498964803, 'support': 46}}
Token level accuracy: 0.4638932496075353
Wrong BIO-Encoding 900/900 labels, 100.00%



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 26}, 'P': {'precision': 0.125, 'recall': 0.4, 'f1-score': 0.19047619047619047, 'support': 20}, 'micro avg': {'precision': 0.12307692307692308, 'recall': 0.17391304347826086, 'f1-score': 0.14414414414414414, 'support': 46}, 'macro avg': {'precision': 0.0625, 'recall': 0.2, 'f1-score': 0.09523809523809523, 'support': 46}, 'weighted avg': {'precision': 0.05434782608695652, 'recall': 0.17391304347826086, 'f1-score': 0.08281573498964803, 'support': 46}}
Token level accuracy: 0.4638932496075353
Wrong BIO-Encoding 65/65 labels, 100.00%
Dev-Data: Prec: 0.123, Rec: 0.174, F1: 0.1441



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 914}, 'P': {'precision': 0.015324165029469547, 'recall': 0.0372848948374761, 'f1-score': 0.02172096908939014, 'support': 1046}, 'micro avg': {'precision': 0.01495398773006135, 'recall': 0.01989795918367347, 'f1-score': 0.017075306479859893, 'support': 1960}, 'macro avg': {'precision': 0.007662082514734774, 'recall': 0.01864244741873805, 'f1-score': 0.01086048454469507, 'support': 1960}, 'weighted avg': {'precision': 0.008178100316747525, 'recall': 0.01989795918367347, 'f1-score': 0.011591904932399024, 'support': 1960}}
Token level accuracy: 0.4334242070189104
Wrong BIO-Encoding 28436/28474 labels, 99.87%



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 914}, 'P': {'precision': 0.015324165029469547, 'recall': 0.0372848948374761, 'f1-score': 0.02172096908939014, 'support': 1046}, 'micro avg': {'precision': 0.01495398773006135, 'recall': 0.01989795918367347, 'f1-score': 0.017075306479859893, 'support': 1960}, 'macro avg': {'precision': 0.007662082514734774, 'recall': 0.01864244741873805, 'f1-score': 0.01086048454469507, 'support': 1960}, 'weighted avg': {'precision': 0.008178100316747525, 'recall': 0.01989795918367347, 'f1-score': 0.011591904932399024, 'support': 1960}}
Token level accuracy: 0.4334242070189104
Wrong BIO-Encoding 2570/2608 labels, 98.54%
Test-Data: Prec: 0.015, Rec: 0.020, F1: 0.0171

Scores from epoch with best dev-scores:
  Dev-Score: 0.1441
  Test-Score 0.0171

9.75 sec for evaluation

--------- Epoch 3 -----------
190.22 sec for training (583.04 total)
-- cmv_modes1 --



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 26}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 20}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 46}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 46}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 46}}
Token level accuracy: 0.4089481946624804
Wrong BIO-Encoding 901/906 labels, 99.45%



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 26}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 20}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 46}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 46}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 46}}
Token level accuracy: 0.4089481946624804
Wrong BIO-Encoding 24/29 labels, 82.76%
Dev-Data: Prec: 0.000, Rec: 0.000, F1: 0.0000



{'C': {'precision': 0.01675041876046901, 'recall': 0.010940919037199124, 'f1-score': 0.013236267372600924, 'support': 914}, 'P': {'precision': 0.005758157389635317, 'recall': 0.0057361376673040155, 'f1-score': 0.005747126436781609, 'support': 1046}, 'micro avg': {'precision': 0.009762050030506406, 'recall': 0.00816326530612245, 'f1-score': 0.008891358710752988, 'support': 1960}, 'macro avg': {'precision': 0.011254288075052164, 'recall': 0.00833852835225157, 'f1-score': 0.009491696904691267, 'support': 1960}, 'weighted avg': {'precision': 0.010884140498279193, 'recall': 0.00816326530612245, 'f1-score': 0.009239511546648373, 'support': 1960}}
Token level accuracy: 0.47585356354667013
Wrong BIO-Encoding 22549/23069 labels, 97.75%



{'C': {'precision': 0.01675041876046901, 'recall': 0.010940919037199124, 'f1-score': 0.013236267372600924, 'support': 914}, 'P': {'precision': 0.005758157389635317, 'recall': 0.0057361376673040155, 'f1-score': 0.005747126436781609, 'support': 1046}, 'micro avg': {'precision': 0.009762050030506406, 'recall': 0.00816326530612245, 'f1-score': 0.008891358710752988, 'support': 1960}, 'macro avg': {'precision': 0.011254288075052164, 'recall': 0.00833852835225157, 'f1-score': 0.009491696904691267, 'support': 1960}, 'weighted avg': {'precision': 0.010884140498279193, 'recall': 0.00816326530612245, 'f1-score': 0.009239511546648373, 'support': 1960}}
Token level accuracy: 0.47585356354667013
Wrong BIO-Encoding 1119/1639 labels, 68.27%
Test-Data: Prec: 0.027, Rec: 0.007, F1: 0.0113

Scores from epoch with best dev-scores:
  Dev-Score: 0.1441
  Test-Score 0.0171

10.17 sec for evaluation

--------- Epoch 4 -----------
189.90 sec for training (772.95 total)
-- cmv_modes1 --



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 26}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 20}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 46}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 46}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 46}}
Token level accuracy: 0.34065934065934067
Wrong BIO-Encoding 580/592 labels, 97.97%



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 26}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 20}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 46}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 46}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 46}}
Token level accuracy: 0.34065934065934067
Wrong BIO-Encoding 3/15 labels, 20.00%
Dev-Data: Prec: 0.000, Rec: 0.000, F1: 0.0000



{'C': {'precision': 0.03325942350332594, 'recall': 0.016411378555798686, 'f1-score': 0.02197802197802198, 'support': 914}, 'P': {'precision': 0.0048543689320388345, 'recall': 0.0019120458891013384, 'f1-score': 0.0027434842249657062, 'support': 1046}, 'micro avg': {'precision': 0.019698725376593278, 'recall': 0.008673469387755102, 'f1-score': 0.012043924902585901, 'support': 1960}, 'macro avg': {'precision': 0.019056896217682386, 'recall': 0.009161712222450012, 'f1-score': 0.012360753101493843, 'support': 1960}, 'weighted avg': {'precision': 0.018100399482118636, 'recall': 0.008673469387755102, 'f1-score': 0.011713059483278684, 'support': 1960}}
Token level accuracy: 0.45661863343286163
Wrong BIO-Encoding 24452/24970 labels, 97.93%



{'C': {'precision': 0.03325942350332594, 'recall': 0.016411378555798686, 'f1-score': 0.02197802197802198, 'support': 914}, 'P': {'precision': 0.0048543689320388345, 'recall': 0.0019120458891013384, 'f1-score': 0.0027434842249657062, 'support': 1046}, 'micro avg': {'precision': 0.019698725376593278, 'recall': 0.008673469387755102, 'f1-score': 0.012043924902585901, 'support': 1960}, 'macro avg': {'precision': 0.019056896217682386, 'recall': 0.009161712222450012, 'f1-score': 0.012360753101493843, 'support': 1960}, 'weighted avg': {'precision': 0.018100399482118636, 'recall': 0.008673469387755102, 'f1-score': 0.011713059483278684, 'support': 1960}}
Token level accuracy: 0.45661863343286163
Wrong BIO-Encoding 345/863 labels, 39.98%
Test-Data: Prec: 0.020, Rec: 0.009, F1: 0.0120

Scores from epoch with best dev-scores:
  Dev-Score: 0.1441
  Test-Score 0.0171

10.14 sec for evaluation

--------- Epoch 5 -----------
189.23 sec for training (962.18 total)
-- cmv_modes1 --



{'C': {'precision': 0.06666666666666667, 'recall': 0.07692307692307693, 'f1-score': 0.07142857142857144, 'support': 26}, 'P': {'precision': 0.09523809523809523, 'recall': 0.1, 'f1-score': 0.0975609756097561, 'support': 20}, 'micro avg': {'precision': 0.0784313725490196, 'recall': 0.08695652173913043, 'f1-score': 0.08247422680412371, 'support': 46}, 'macro avg': {'precision': 0.08095238095238094, 'recall': 0.08846153846153847, 'f1-score': 0.08449477351916376, 'support': 46}, 'weighted avg': {'precision': 0.07908902691511387, 'recall': 0.08695652173913043, 'f1-score': 0.08279048628995608, 'support': 46}}
Token level accuracy: 0.45682888540031397
Wrong BIO-Encoding 558/591 labels, 94.42%



{'C': {'precision': 0.06666666666666667, 'recall': 0.07692307692307693, 'f1-score': 0.07142857142857144, 'support': 26}, 'P': {'precision': 0.09523809523809523, 'recall': 0.1, 'f1-score': 0.0975609756097561, 'support': 20}, 'micro avg': {'precision': 0.0784313725490196, 'recall': 0.08695652173913043, 'f1-score': 0.08247422680412371, 'support': 46}, 'macro avg': {'precision': 0.08095238095238094, 'recall': 0.08846153846153847, 'f1-score': 0.08449477351916376, 'support': 46}, 'weighted avg': {'precision': 0.07908902691511387, 'recall': 0.08695652173913043, 'f1-score': 0.08279048628995608, 'support': 46}}
Token level accuracy: 0.45682888540031397
Wrong BIO-Encoding 18/51 labels, 35.29%
Dev-Data: Prec: 0.121, Rec: 0.087, F1: 0.1013



{'C': {'precision': 0.042986425339366516, 'recall': 0.06236323851203501, 'f1-score': 0.05089285714285714, 'support': 914}, 'P': {'precision': 0.012585812356979404, 'recall': 0.010516252390057362, 'f1-score': 0.011458333333333333, 'support': 1046}, 'micro avg': {'precision': 0.03090909090909091, 'recall': 0.03469387755102041, 'f1-score': 0.032692307692307694, 'support': 1960}, 'macro avg': {'precision': 0.02778611884817296, 'recall': 0.03643974545104619, 'f1-score': 0.03117559523809524, 'support': 1960}, 'weighted avg': {'precision': 0.02676242473754156, 'recall': 0.03469387755102041, 'f1-score': 0.029847698007774537, 'support': 1960}}
Token level accuracy: 0.4649703578692284
Wrong BIO-Encoding 15760/17102 labels, 92.15%



{'C': {'precision': 0.042986425339366516, 'recall': 0.06236323851203501, 'f1-score': 0.05089285714285714, 'support': 914}, 'P': {'precision': 0.012585812356979404, 'recall': 0.010516252390057362, 'f1-score': 0.011458333333333333, 'support': 1046}, 'micro avg': {'precision': 0.03090909090909091, 'recall': 0.03469387755102041, 'f1-score': 0.032692307692307694, 'support': 1960}, 'macro avg': {'precision': 0.02778611884817296, 'recall': 0.03643974545104619, 'f1-score': 0.03117559523809524, 'support': 1960}, 'weighted avg': {'precision': 0.02676242473754156, 'recall': 0.03469387755102041, 'f1-score': 0.029847698007774537, 'support': 1960}}
Token level accuracy: 0.4649703578692284
Wrong BIO-Encoding 858/2200 labels, 39.00%
Test-Data: Prec: 0.048, Rec: 0.033, F1: 0.0394

Scores from epoch with best dev-scores:
  Dev-Score: 0.1441
  Test-Score 0.0171

10.71 sec for evaluation

--------- Epoch 6 -----------
191.20 sec for training (1153.38 total)
-- cmv_modes1 --



{'C': {'precision': 0.16666666666666666, 'recall': 0.038461538461538464, 'f1-score': 0.0625, 'support': 26}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 20}, 'micro avg': {'precision': 0.027777777777777776, 'recall': 0.021739130434782608, 'f1-score': 0.024390243902439025, 'support': 46}, 'macro avg': {'precision': 0.08333333333333333, 'recall': 0.019230769230769232, 'f1-score': 0.03125, 'support': 46}, 'weighted avg': {'precision': 0.09420289855072463, 'recall': 0.021739130434782608, 'f1-score': 0.035326086956521736, 'support': 46}}
Token level accuracy: 0.37755102040816324
Wrong BIO-Encoding 94/124 labels, 75.81%



{'C': {'precision': 0.16666666666666666, 'recall': 0.038461538461538464, 'f1-score': 0.0625, 'support': 26}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 20}, 'micro avg': {'precision': 0.027777777777777776, 'recall': 0.021739130434782608, 'f1-score': 0.024390243902439025, 'support': 46}, 'macro avg': {'precision': 0.08333333333333333, 'recall': 0.019230769230769232, 'f1-score': 0.03125, 'support': 46}, 'weighted avg': {'precision': 0.09420289855072463, 'recall': 0.021739130434782608, 'f1-score': 0.035326086956521736, 'support': 46}}
Token level accuracy: 0.37755102040816324
Wrong BIO-Encoding 6/36 labels, 16.67%
Dev-Data: Prec: 0.028, Rec: 0.022, F1: 0.0244



{'C': {'precision': 0.03505154639175258, 'recall': 0.018599562363238512, 'f1-score': 0.024303073624017155, 'support': 914}, 'P': {'precision': 0.03970826580226904, 'recall': 0.04684512428298279, 'f1-score': 0.04298245614035087, 'support': 1046}, 'micro avg': {'precision': 0.038394415357766144, 'recall': 0.0336734693877551, 'f1-score': 0.03587931503125849, 'support': 1960}, 'macro avg': {'precision': 0.03737990609701081, 'recall': 0.03272234332311065, 'f1-score': 0.03364276488218401, 'support': 1960}, 'weighted avg': {'precision': 0.0375367139955282, 'recall': 0.0336734693877551, 'f1-score': 0.034271764497529944, 'support': 1960}}
Token level accuracy: 0.48530875416504393
Wrong BIO-Encoding 6409/7807 labels, 82.09%



{'C': {'precision': 0.03505154639175258, 'recall': 0.018599562363238512, 'f1-score': 0.024303073624017155, 'support': 914}, 'P': {'precision': 0.03970826580226904, 'recall': 0.04684512428298279, 'f1-score': 0.04298245614035087, 'support': 1046}, 'micro avg': {'precision': 0.038394415357766144, 'recall': 0.0336734693877551, 'f1-score': 0.03587931503125849, 'support': 1960}, 'macro avg': {'precision': 0.03737990609701081, 'recall': 0.03272234332311065, 'f1-score': 0.03364276488218401, 'support': 1960}, 'weighted avg': {'precision': 0.0375367139955282, 'recall': 0.0336734693877551, 'f1-score': 0.034271764497529944, 'support': 1960}}
Token level accuracy: 0.48530875416504393
Wrong BIO-Encoding 321/1719 labels, 18.67%
Test-Data: Prec: 0.047, Rec: 0.034, F1: 0.0393

Scores from epoch with best dev-scores:
  Dev-Score: 0.1441
  Test-Score 0.0171

11.64 sec for evaluation

--------- Epoch 7 -----------
196.53 sec for training (1349.91 total)
-- cmv_modes1 --



{'C': {'precision': 0.07142857142857142, 'recall': 0.038461538461538464, 'f1-score': 0.05, 'support': 26}, 'P': {'precision': 0.04081632653061224, 'recall': 0.1, 'f1-score': 0.05797101449275362, 'support': 20}, 'micro avg': {'precision': 0.047619047619047616, 'recall': 0.06521739130434782, 'f1-score': 0.055045871559633024, 'support': 46}, 'macro avg': {'precision': 0.05612244897959183, 'recall': 0.06923076923076923, 'f1-score': 0.05398550724637681, 'support': 46}, 'weighted avg': {'precision': 0.05811889973380656, 'recall': 0.06521739130434782, 'f1-score': 0.05346565847511026, 'support': 46}}
Token level accuracy: 0.5007849293563579
Wrong BIO-Encoding 123/173 labels, 71.10%



{'C': {'precision': 0.07142857142857142, 'recall': 0.038461538461538464, 'f1-score': 0.05, 'support': 26}, 'P': {'precision': 0.04081632653061224, 'recall': 0.1, 'f1-score': 0.05797101449275362, 'support': 20}, 'micro avg': {'precision': 0.047619047619047616, 'recall': 0.06521739130434782, 'f1-score': 0.055045871559633024, 'support': 46}, 'macro avg': {'precision': 0.05612244897959183, 'recall': 0.06923076923076923, 'f1-score': 0.05398550724637681, 'support': 46}, 'weighted avg': {'precision': 0.05811889973380656, 'recall': 0.06521739130434782, 'f1-score': 0.05346565847511026, 'support': 46}}
Token level accuracy: 0.5007849293563579
Wrong BIO-Encoding 13/63 labels, 20.63%
Dev-Data: Prec: 0.060, Rec: 0.065, F1: 0.0625



{'C': {'precision': 0.09320695102685624, 'recall': 0.06455142231947483, 'f1-score': 0.07627666451195862, 'support': 914}, 'P': {'precision': 0.054102259215219974, 'recall': 0.0869980879541109, 'f1-score': 0.06671554252199413, 'support': 1046}, 'micro avg': {'precision': 0.06479481641468683, 'recall': 0.07653061224489796, 'f1-score': 0.07017543859649122, 'support': 1960}, 'macro avg': {'precision': 0.07365460512103811, 'recall': 0.07577475513679287, 'f1-score': 0.07149610351697638, 'support': 1960}, 'weighted avg': {'precision': 0.07233781447840137, 'recall': 0.07653061224489796, 'f1-score': 0.07117414736833472, 'support': 1960}}
Token level accuracy: 0.5228915141286945
Wrong BIO-Encoding 5816/7683 labels, 75.70%



{'C': {'precision': 0.09320695102685624, 'recall': 0.06455142231947483, 'f1-score': 0.07627666451195862, 'support': 914}, 'P': {'precision': 0.054102259215219974, 'recall': 0.0869980879541109, 'f1-score': 0.06671554252199413, 'support': 1046}, 'micro avg': {'precision': 0.06479481641468683, 'recall': 0.07653061224489796, 'f1-score': 0.07017543859649122, 'support': 1960}, 'macro avg': {'precision': 0.07365460512103811, 'recall': 0.07577475513679287, 'f1-score': 0.07149610351697638, 'support': 1960}, 'weighted avg': {'precision': 0.07233781447840137, 'recall': 0.07653061224489796, 'f1-score': 0.07117414736833472, 'support': 1960}}
Token level accuracy: 0.5228915141286945
Wrong BIO-Encoding 448/2315 labels, 19.35%
Test-Data: Prec: 0.079, Rec: 0.076, F1: 0.0773

Scores from epoch with best dev-scores:
  Dev-Score: 0.1441
  Test-Score 0.0171

10.66 sec for evaluation

--------- Epoch 8 -----------
191.64 sec for training (1541.55 total)
-- cmv_modes1 --



{'C': {'precision': 0.14285714285714285, 'recall': 0.038461538461538464, 'f1-score': 0.060606060606060615, 'support': 26}, 'P': {'precision': 0.05263157894736842, 'recall': 0.1, 'f1-score': 0.06896551724137931, 'support': 20}, 'micro avg': {'precision': 0.06666666666666667, 'recall': 0.06521739130434782, 'f1-score': 0.06593406593406594, 'support': 46}, 'macro avg': {'precision': 0.09774436090225563, 'recall': 0.06923076923076923, 'f1-score': 0.06478578892371996, 'support': 46}, 'weighted avg': {'precision': 0.10362863680941484, 'recall': 0.06521739130434782, 'f1-score': 0.06424060696924266, 'support': 46}}
Token level accuracy: 0.5102040816326531
Wrong BIO-Encoding 121/159 labels, 76.10%



{'C': {'precision': 0.14285714285714285, 'recall': 0.038461538461538464, 'f1-score': 0.060606060606060615, 'support': 26}, 'P': {'precision': 0.05263157894736842, 'recall': 0.1, 'f1-score': 0.06896551724137931, 'support': 20}, 'micro avg': {'precision': 0.06666666666666667, 'recall': 0.06521739130434782, 'f1-score': 0.06593406593406594, 'support': 46}, 'macro avg': {'precision': 0.09774436090225563, 'recall': 0.06923076923076923, 'f1-score': 0.06478578892371996, 'support': 46}, 'weighted avg': {'precision': 0.10362863680941484, 'recall': 0.06521739130434782, 'f1-score': 0.06424060696924266, 'support': 46}}
Token level accuracy: 0.5102040816326531
Wrong BIO-Encoding 7/45 labels, 15.56%
Dev-Data: Prec: 0.079, Rec: 0.065, F1: 0.0714



{'C': {'precision': 0.1002710027100271, 'recall': 0.04048140043763676, 'f1-score': 0.05767731878409977, 'support': 914}, 'P': {'precision': 0.09195402298850575, 'recall': 0.13001912045889102, 'f1-score': 0.10772277227722772, 'support': 1046}, 'micro avg': {'precision': 0.09361471861471861, 'recall': 0.08826530612244898, 'f1-score': 0.09086134453781512, 'support': 1960}, 'macro avg': {'precision': 0.09611251284926642, 'recall': 0.08525026044826389, 'f1-score': 0.08270004553066375, 'support': 1960}, 'weighted avg': {'precision': 0.0958324512872152, 'recall': 0.08826530612244898, 'f1-score': 0.08438524957686092, 'support': 1960}}
Token level accuracy: 0.5175256393612878
Wrong BIO-Encoding 4656/6238 labels, 74.64%



{'C': {'precision': 0.1002710027100271, 'recall': 0.04048140043763676, 'f1-score': 0.05767731878409977, 'support': 914}, 'P': {'precision': 0.09195402298850575, 'recall': 0.13001912045889102, 'f1-score': 0.10772277227722772, 'support': 1046}, 'micro avg': {'precision': 0.09361471861471861, 'recall': 0.08826530612244898, 'f1-score': 0.09086134453781512, 'support': 1960}, 'macro avg': {'precision': 0.09611251284926642, 'recall': 0.08525026044826389, 'f1-score': 0.08270004553066375, 'support': 1960}, 'weighted avg': {'precision': 0.0958324512872152, 'recall': 0.08826530612244898, 'f1-score': 0.08438524957686092, 'support': 1960}}
Token level accuracy: 0.5175256393612878
Wrong BIO-Encoding 266/1848 labels, 14.39%
Test-Data: Prec: 0.109, Rec: 0.088, F1: 0.0971

Scores from epoch with best dev-scores:
  Dev-Score: 0.1441
  Test-Score 0.0171

10.63 sec for evaluation

--------- Epoch 9 -----------
197.81 sec for training (1739.36 total)
-- cmv_modes1 --



{'C': {'precision': 0.10526315789473684, 'recall': 0.07692307692307693, 'f1-score': 0.08888888888888889, 'support': 26}, 'P': {'precision': 0.03571428571428571, 'recall': 0.05, 'f1-score': 0.041666666666666664, 'support': 20}, 'micro avg': {'precision': 0.06382978723404255, 'recall': 0.06521739130434782, 'f1-score': 0.06451612903225806, 'support': 46}, 'macro avg': {'precision': 0.07048872180451127, 'recall': 0.06346153846153846, 'f1-score': 0.06527777777777778, 'support': 46}, 'weighted avg': {'precision': 0.07502451781627982, 'recall': 0.06521739130434782, 'f1-score': 0.06835748792270532, 'support': 46}}
Token level accuracy: 0.5941915227629513
Wrong BIO-Encoding 223/261 labels, 85.44%



{'C': {'precision': 0.10526315789473684, 'recall': 0.07692307692307693, 'f1-score': 0.08888888888888889, 'support': 26}, 'P': {'precision': 0.03571428571428571, 'recall': 0.05, 'f1-score': 0.041666666666666664, 'support': 20}, 'micro avg': {'precision': 0.06382978723404255, 'recall': 0.06521739130434782, 'f1-score': 0.06451612903225806, 'support': 46}, 'macro avg': {'precision': 0.07048872180451127, 'recall': 0.06346153846153846, 'f1-score': 0.06527777777777778, 'support': 46}, 'weighted avg': {'precision': 0.07502451781627982, 'recall': 0.06521739130434782, 'f1-score': 0.06835748792270532, 'support': 46}}
Token level accuracy: 0.5941915227629513
Wrong BIO-Encoding 9/47 labels, 19.15%
Dev-Data: Prec: 0.079, Rec: 0.065, F1: 0.0714



{'C': {'precision': 0.07509386733416772, 'recall': 0.06564551422319474, 'f1-score': 0.07005253940455342, 'support': 914}, 'P': {'precision': 0.1529051987767584, 'recall': 0.14340344168260039, 'f1-score': 0.1480019733596448, 'support': 1046}, 'micro avg': {'precision': 0.11797752808988764, 'recall': 0.10714285714285714, 'f1-score': 0.11229946524064172, 'support': 1960}, 'macro avg': {'precision': 0.11399953305546306, 'recall': 0.10452447795289757, 'f1-score': 0.1090272563820991, 'support': 1960}, 'weighted avg': {'precision': 0.1166197105428156, 'recall': 0.10714285714285714, 'f1-score': 0.11165208426017871, 'support': 1960}}
Token level accuracy: 0.5086546367216236
Wrong BIO-Encoding 5553/6953 labels, 79.86%



{'C': {'precision': 0.07509386733416772, 'recall': 0.06564551422319474, 'f1-score': 0.07005253940455342, 'support': 914}, 'P': {'precision': 0.1529051987767584, 'recall': 0.14340344168260039, 'f1-score': 0.1480019733596448, 'support': 1046}, 'micro avg': {'precision': 0.11797752808988764, 'recall': 0.10714285714285714, 'f1-score': 0.11229946524064172, 'support': 1960}, 'macro avg': {'precision': 0.11399953305546306, 'recall': 0.10452447795289757, 'f1-score': 0.1090272563820991, 'support': 1960}, 'weighted avg': {'precision': 0.1166197105428156, 'recall': 0.10714285714285714, 'f1-score': 0.11165208426017871, 'support': 1960}}
Token level accuracy: 0.5086546367216236
Wrong BIO-Encoding 380/1780 labels, 21.35%
Test-Data: Prec: 0.148, Rec: 0.106, F1: 0.1232

Scores from epoch with best dev-scores:
  Dev-Score: 0.1441
  Test-Score 0.0171

11.62 sec for evaluation

--------- Epoch 10 -----------
200.18 sec for training (1939.54 total)
-- cmv_modes1 --



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 26}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 20}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 46}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 46}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 46}}
Token level accuracy: 0.4764521193092622



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 26}, 'P': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 20}, 'micro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 46}, 'macro avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 46}, 'weighted avg': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 46}}
Token level accuracy: 0.4764521193092622
Dev-Data: Prec: 0.000, Rec: 0.000, F1: 0.0000



{'C': {'precision': 0.1829787234042553, 'recall': 0.09409190371991247, 'f1-score': 0.12427745664739885, 'support': 914}, 'P': {'precision': 0.1993103448275862, 'recall': 0.2762906309751434, 'f1-score': 0.2315705128205128, 'support': 1046}, 'micro avg': {'precision': 0.1953125, 'recall': 0.1913265306122449, 'f1-score': 0.19329896907216493, 'support': 1960}, 'macro avg': {'precision': 0.19114453411592075, 'recall': 0.18519126734752794, 'f1-score': 0.17792398473395582, 'support': 1960}, 'weighted avg': {'precision': 0.1916944764699717, 'recall': 0.1913265306122449, 'f1-score': 0.18153691417651988, 'support': 1960}}
Token level accuracy: 0.5125708598381583
Wrong BIO-Encoding 2368/4157 labels, 56.96%



{'C': {'precision': 0.1829787234042553, 'recall': 0.09409190371991247, 'f1-score': 0.12427745664739885, 'support': 914}, 'P': {'precision': 0.1993103448275862, 'recall': 0.2762906309751434, 'f1-score': 0.2315705128205128, 'support': 1046}, 'micro avg': {'precision': 0.1953125, 'recall': 0.1913265306122449, 'f1-score': 0.19329896907216493, 'support': 1960}, 'macro avg': {'precision': 0.19114453411592075, 'recall': 0.18519126734752794, 'f1-score': 0.17792398473395582, 'support': 1960}, 'weighted avg': {'precision': 0.1916944764699717, 'recall': 0.1913265306122449, 'f1-score': 0.18153691417651988, 'support': 1960}}
Token level accuracy: 0.5125708598381583
Wrong BIO-Encoding 131/1920 labels, 6.82%
Test-Data: Prec: 0.209, Rec: 0.191, F1: 0.1995

Scores from epoch with best dev-scores:
  Dev-Score: 0.1441
  Test-Score 0.0171

11.93 sec for evaluation

--------- Epoch 11 -----------
201.14 sec for training (2140.68 total)
-- cmv_modes1 --



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 26}, 'P': {'precision': 0.10256410256410256, 'recall': 0.2, 'f1-score': 0.13559322033898302, 'support': 20}, 'micro avg': {'precision': 0.09302325581395349, 'recall': 0.08695652173913043, 'f1-score': 0.08988764044943821, 'support': 46}, 'macro avg': {'precision': 0.05128205128205128, 'recall': 0.1, 'f1-score': 0.06779661016949151, 'support': 46}, 'weighted avg': {'precision': 0.04459308807134894, 'recall': 0.08695652173913043, 'f1-score': 0.0589535740604274, 'support': 46}}
Token level accuracy: 0.5416012558869702
Wrong BIO-Encoding 27/68 labels, 39.71%



{'C': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 26}, 'P': {'precision': 0.10256410256410256, 'recall': 0.2, 'f1-score': 0.13559322033898302, 'support': 20}, 'micro avg': {'precision': 0.09302325581395349, 'recall': 0.08695652173913043, 'f1-score': 0.08988764044943821, 'support': 46}, 'macro avg': {'precision': 0.05128205128205128, 'recall': 0.1, 'f1-score': 0.06779661016949151, 'support': 46}, 'weighted avg': {'precision': 0.04459308807134894, 'recall': 0.08695652173913043, 'f1-score': 0.0589535740604274, 'support': 46}}
Token level accuracy: 0.5416012558869702
Wrong BIO-Encoding 2/43 labels, 4.65%
Dev-Data: Prec: 0.098, Rec: 0.087, F1: 0.0920



{'C': {'precision': 0.11979166666666667, 'recall': 0.02516411378555799, 'f1-score': 0.04159132007233273, 'support': 914}, 'P': {'precision': 0.09096422073984232, 'recall': 0.14340344168260039, 'f1-score': 0.11131725417439703, 'support': 1046}, 'micro avg': {'precision': 0.09397066811515481, 'recall': 0.08826530612244898, 'f1-score': 0.09102867666403577, 'support': 1960}, 'macro avg': {'precision': 0.1053779437032545, 'recall': 0.08428377773407919, 'f1-score': 0.07645428712336488, 'support': 1960}, 'weighted avg': {'precision': 0.10440722358531042, 'recall': 0.08826530612244898, 'f1-score': 0.07880220123088337, 'support': 1960}}
Token level accuracy: 0.5081353585183261
Wrong BIO-Encoding 3683/5302 labels, 69.46%



{'C': {'precision': 0.11979166666666667, 'recall': 0.02516411378555799, 'f1-score': 0.04159132007233273, 'support': 914}, 'P': {'precision': 0.09096422073984232, 'recall': 0.14340344168260039, 'f1-score': 0.11131725417439703, 'support': 1046}, 'micro avg': {'precision': 0.09397066811515481, 'recall': 0.08826530612244898, 'f1-score': 0.09102867666403577, 'support': 1960}, 'macro avg': {'precision': 0.1053779437032545, 'recall': 0.08428377773407919, 'f1-score': 0.07645428712336488, 'support': 1960}, 'weighted avg': {'precision': 0.10440722358531042, 'recall': 0.08826530612244898, 'f1-score': 0.07880220123088337, 'support': 1960}}
Token level accuracy: 0.5081353585183261
Wrong BIO-Encoding 222/1841 labels, 12.06%
Test-Data: Prec: 0.107, Rec: 0.088, F1: 0.0967

Scores from epoch with best dev-scores:
  Dev-Score: 0.1441
  Test-Score 0.0171

11.88 sec for evaluation

--------- Epoch 12 -----------
198.03 sec for training (2338.71 total)
-- cmv_modes1 --



{'C': {'precision': 0.08333333333333333, 'recall': 0.038461538461538464, 'f1-score': 0.05263157894736842, 'support': 26}, 'P': {'precision': 0.1388888888888889, 'recall': 0.25, 'f1-score': 0.17857142857142858, 'support': 20}, 'micro avg': {'precision': 0.125, 'recall': 0.13043478260869565, 'f1-score': 0.1276595744680851, 'support': 46}, 'macro avg': {'precision': 0.1111111111111111, 'recall': 0.14423076923076922, 'f1-score': 0.1156015037593985, 'support': 46}, 'weighted avg': {'precision': 0.10748792270531402, 'recall': 0.13043478260869565, 'f1-score': 0.10738803530565544, 'support': 46}}
Token level accuracy: 0.5792778649921507
Wrong BIO-Encoding 16/62 labels, 25.81%



{'C': {'precision': 0.08333333333333333, 'recall': 0.038461538461538464, 'f1-score': 0.05263157894736842, 'support': 26}, 'P': {'precision': 0.1388888888888889, 'recall': 0.25, 'f1-score': 0.17857142857142858, 'support': 20}, 'micro avg': {'precision': 0.125, 'recall': 0.13043478260869565, 'f1-score': 0.1276595744680851, 'support': 46}, 'macro avg': {'precision': 0.1111111111111111, 'recall': 0.14423076923076922, 'f1-score': 0.1156015037593985, 'support': 46}, 'weighted avg': {'precision': 0.10748792270531402, 'recall': 0.13043478260869565, 'f1-score': 0.10738803530565544, 'support': 46}}
Token level accuracy: 0.5792778649921507
Wrong BIO-Encoding 2/48 labels, 4.17%
Dev-Data: Prec: 0.130, Rec: 0.130, F1: 0.1304



{'C': {'precision': 0.15444015444015444, 'recall': 0.087527352297593, 'f1-score': 0.111731843575419, 'support': 914}, 'P': {'precision': 0.1360824742268041, 'recall': 0.18929254302103252, 'f1-score': 0.15833666533386645, 'support': 1046}, 'micro avg': {'precision': 0.1409021794221997, 'recall': 0.14183673469387756, 'f1-score': 0.1413679125349606, 'support': 1960}, 'macro avg': {'precision': 0.14526131433347927, 'recall': 0.13840994765931275, 'f1-score': 0.13503425445464273, 'support': 1960}, 'weighted avg': {'precision': 0.14464314755078483, 'recall': 0.14183673469387756, 'f1-score': 0.13660360049344758, 'support': 1960}}
Token level accuracy: 0.5323250681552641
Wrong BIO-Encoding 2969/4767 labels, 62.28%



{'C': {'precision': 0.15444015444015444, 'recall': 0.087527352297593, 'f1-score': 0.111731843575419, 'support': 914}, 'P': {'precision': 0.1360824742268041, 'recall': 0.18929254302103252, 'f1-score': 0.15833666533386645, 'support': 1046}, 'micro avg': {'precision': 0.1409021794221997, 'recall': 0.14183673469387756, 'f1-score': 0.1413679125349606, 'support': 1960}, 'macro avg': {'precision': 0.14526131433347927, 'recall': 0.13840994765931275, 'f1-score': 0.13503425445464273, 'support': 1960}, 'weighted avg': {'precision': 0.14464314755078483, 'recall': 0.14183673469387756, 'f1-score': 0.13660360049344758, 'support': 1960}}
Token level accuracy: 0.5323250681552641
Wrong BIO-Encoding 175/1973 labels, 8.87%
Test-Data: Prec: 0.154, Rec: 0.141, F1: 0.1474

Scores from epoch with best dev-scores:
  Dev-Score: 0.1441
  Test-Score 0.0171

10.58 sec for evaluation

--------- Epoch 13 -----------
191.56 sec for training (2530.27 total)
-- cmv_modes1 --



{'C': {'precision': 0.3076923076923077, 'recall': 0.15384615384615385, 'f1-score': 0.20512820512820515, 'support': 26}, 'P': {'precision': 0.08823529411764706, 'recall': 0.15, 'f1-score': 0.11111111111111112, 'support': 20}, 'micro avg': {'precision': 0.14893617021276595, 'recall': 0.15217391304347827, 'f1-score': 0.15053763440860216, 'support': 46}, 'macro avg': {'precision': 0.1979638009049774, 'recall': 0.15192307692307694, 'f1-score': 0.15811965811965814, 'support': 46}, 'weighted avg': {'precision': 0.2122762148337596, 'recall': 0.15217391304347827, 'f1-score': 0.1642512077294686, 'support': 46}}
Token level accuracy: 0.6514913657770801
Wrong BIO-Encoding 22/67 labels, 32.84%



{'C': {'precision': 0.3076923076923077, 'recall': 0.15384615384615385, 'f1-score': 0.20512820512820515, 'support': 26}, 'P': {'precision': 0.08823529411764706, 'recall': 0.15, 'f1-score': 0.11111111111111112, 'support': 20}, 'micro avg': {'precision': 0.14893617021276595, 'recall': 0.15217391304347827, 'f1-score': 0.15053763440860216, 'support': 46}, 'macro avg': {'precision': 0.1979638009049774, 'recall': 0.15192307692307694, 'f1-score': 0.15811965811965814, 'support': 46}, 'weighted avg': {'precision': 0.2122762148337596, 'recall': 0.15217391304347827, 'f1-score': 0.1642512077294686, 'support': 46}}
Token level accuracy: 0.6514913657770801
Wrong BIO-Encoding 2/47 labels, 4.26%
Dev-Data: Prec: 0.156, Rec: 0.152, F1: 0.1538



{'C': {'precision': 0.2069767441860465, 'recall': 0.09737417943107221, 'f1-score': 0.13244047619047622, 'support': 914}, 'P': {'precision': 0.17436250861474845, 'recall': 0.2418738049713193, 'f1-score': 0.20264317180616742, 'support': 1046}, 'micro avg': {'precision': 0.18181818181818182, 'recall': 0.17448979591836736, 'f1-score': 0.17807862535797966, 'support': 1960}, 'macro avg': {'precision': 0.19066962640039747, 'recall': 0.16962399220119576, 'f1-score': 0.16754182399832182, 'support': 1960}, 'weighted avg': {'precision': 0.18957139193728237, 'recall': 0.17448979591836736, 'f1-score': 0.1699057923200747, 'support': 1960}}
Token level accuracy: 0.5371067549439612
Wrong BIO-Encoding 3538/5193 labels, 68.13%



{'C': {'precision': 0.2069767441860465, 'recall': 0.09737417943107221, 'f1-score': 0.13244047619047622, 'support': 914}, 'P': {'precision': 0.17436250861474845, 'recall': 0.2418738049713193, 'f1-score': 0.20264317180616742, 'support': 1046}, 'micro avg': {'precision': 0.18181818181818182, 'recall': 0.17448979591836736, 'f1-score': 0.17807862535797966, 'support': 1960}, 'macro avg': {'precision': 0.19066962640039747, 'recall': 0.16962399220119576, 'f1-score': 0.16754182399832182, 'support': 1960}, 'weighted avg': {'precision': 0.18957139193728237, 'recall': 0.17448979591836736, 'f1-score': 0.1699057923200747, 'support': 1960}}
Token level accuracy: 0.5371067549439612
Wrong BIO-Encoding 226/1881 labels, 12.01%
Test-Data: Prec: 0.206, Rec: 0.174, F1: 0.1887

Scores from epoch with best dev-scores:
  Dev-Score: 0.1538
  Test-Score 0.1887

10.58 sec for evaluation

--------- Epoch 14 -----------
197.47 sec for training (2727.74 total)
-- cmv_modes1 --



{'C': {'precision': 0.3, 'recall': 0.23076923076923078, 'f1-score': 0.2608695652173913, 'support': 26}, 'P': {'precision': 0.13793103448275862, 'recall': 0.2, 'f1-score': 0.16326530612244897, 'support': 20}, 'micro avg': {'precision': 0.20408163265306123, 'recall': 0.21739130434782608, 'f1-score': 0.2105263157894737, 'support': 46}, 'macro avg': {'precision': 0.2189655172413793, 'recall': 0.2153846153846154, 'f1-score': 0.21206743566992015, 'support': 46}, 'weighted avg': {'precision': 0.22953523238380807, 'recall': 0.21739130434782608, 'f1-score': 0.21843293082828594, 'support': 46}}
Token level accuracy: 0.7260596546310832
Wrong BIO-Encoding 23/70 labels, 32.86%



{'C': {'precision': 0.3, 'recall': 0.23076923076923078, 'f1-score': 0.2608695652173913, 'support': 26}, 'P': {'precision': 0.13793103448275862, 'recall': 0.2, 'f1-score': 0.16326530612244897, 'support': 20}, 'micro avg': {'precision': 0.20408163265306123, 'recall': 0.21739130434782608, 'f1-score': 0.2105263157894737, 'support': 46}, 'macro avg': {'precision': 0.2189655172413793, 'recall': 0.2153846153846154, 'f1-score': 0.21206743566992015, 'support': 46}, 'weighted avg': {'precision': 0.22953523238380807, 'recall': 0.21739130434782608, 'f1-score': 0.21843293082828594, 'support': 46}}
Token level accuracy: 0.7260596546310832
Wrong BIO-Encoding 2/49 labels, 4.08%
Dev-Data: Prec: 0.213, Rec: 0.217, F1: 0.2151



{'C': {'precision': 0.19661733615221988, 'recall': 0.10175054704595186, 'f1-score': 0.13410237923576063, 'support': 914}, 'P': {'precision': 0.13715046604527298, 'recall': 0.19694072657743786, 'f1-score': 0.16169544740973313, 'support': 1046}, 'micro avg': {'precision': 0.15139240506329113, 'recall': 0.15255102040816326, 'f1-score': 0.15196950444726812, 'support': 1960}, 'macro avg': {'precision': 0.16688390109874643, 'recall': 0.14934563681169485, 'f1-score': 0.14789891332274688, 'support': 1960}, 'weighted avg': {'precision': 0.16488144526861453, 'recall': 0.15255102040816326, 'f1-score': 0.14882806765921738, 'support': 1960}}
Token level accuracy: 0.528581937773162
Wrong BIO-Encoding 2250/4074 labels, 55.23%



{'C': {'precision': 0.19661733615221988, 'recall': 0.10175054704595186, 'f1-score': 0.13410237923576063, 'support': 914}, 'P': {'precision': 0.13715046604527298, 'recall': 0.19694072657743786, 'f1-score': 0.16169544740973313, 'support': 1046}, 'micro avg': {'precision': 0.15139240506329113, 'recall': 0.15255102040816326, 'f1-score': 0.15196950444726812, 'support': 1960}, 'macro avg': {'precision': 0.16688390109874643, 'recall': 0.14934563681169485, 'f1-score': 0.14789891332274688, 'support': 1960}, 'weighted avg': {'precision': 0.16488144526861453, 'recall': 0.15255102040816326, 'f1-score': 0.14882806765921738, 'support': 1960}}
Token level accuracy: 0.528581937773162
Wrong BIO-Encoding 151/1975 labels, 7.65%
Test-Data: Prec: 0.163, Rec: 0.152, F1: 0.1575

Scores from epoch with best dev-scores:
  Dev-Score: 0.2151
  Test-Score 0.1575

11.61 sec for evaluation

--------- Epoch 15 -----------
201.26 sec for training (2929.00 total)
-- cmv_modes1 --



{'C': {'precision': 0.25, 'recall': 0.15384615384615385, 'f1-score': 0.1904761904761905, 'support': 26}, 'P': {'precision': 0.28125, 'recall': 0.45, 'f1-score': 0.34615384615384615, 'support': 20}, 'micro avg': {'precision': 0.2708333333333333, 'recall': 0.2826086956521739, 'f1-score': 0.2765957446808511, 'support': 46}, 'macro avg': {'precision': 0.265625, 'recall': 0.30192307692307696, 'f1-score': 0.2683150183150183, 'support': 46}, 'weighted avg': {'precision': 0.26358695652173914, 'recall': 0.2826086956521739, 'f1-score': 0.25816212772734515, 'support': 46}}
Token level accuracy: 0.7456828885400314
Wrong BIO-Encoding 56/100 labels, 56.00%



{'C': {'precision': 0.25, 'recall': 0.15384615384615385, 'f1-score': 0.1904761904761905, 'support': 26}, 'P': {'precision': 0.28125, 'recall': 0.45, 'f1-score': 0.34615384615384615, 'support': 20}, 'micro avg': {'precision': 0.2708333333333333, 'recall': 0.2826086956521739, 'f1-score': 0.2765957446808511, 'support': 46}, 'macro avg': {'precision': 0.265625, 'recall': 0.30192307692307696, 'f1-score': 0.2683150183150183, 'support': 46}, 'weighted avg': {'precision': 0.26358695652173914, 'recall': 0.2826086956521739, 'f1-score': 0.25816212772734515, 'support': 46}}
Token level accuracy: 0.7456828885400314
Wrong BIO-Encoding 4/48 labels, 8.33%
Dev-Data: Prec: 0.295, Rec: 0.283, F1: 0.2889



{'C': {'precision': 0.2086021505376344, 'recall': 0.1061269146608315, 'f1-score': 0.1406816533720087, 'support': 914}, 'P': {'precision': 0.12755519215044972, 'recall': 0.1491395793499044, 'f1-score': 0.1375055090348171, 'support': 1046}, 'micro avg': {'precision': 0.14988151658767773, 'recall': 0.12908163265306122, 'f1-score': 0.1387061403508772, 'support': 1960}, 'macro avg': {'precision': 0.16807867134404206, 'recall': 0.12763324700536796, 'f1-score': 0.1390935812034129, 'support': 1960}, 'weighted avg': {'precision': 0.1653495390718205, 'recall': 0.12908163265306122, 'f1-score': 0.1389866294043034, 'support': 1960}}
Token level accuracy: 0.5323034315634602
Wrong BIO-Encoding 1966/3526 labels, 55.76%



{'C': {'precision': 0.2086021505376344, 'recall': 0.1061269146608315, 'f1-score': 0.1406816533720087, 'support': 914}, 'P': {'precision': 0.12755519215044972, 'recall': 0.1491395793499044, 'f1-score': 0.1375055090348171, 'support': 1046}, 'micro avg': {'precision': 0.14988151658767773, 'recall': 0.12908163265306122, 'f1-score': 0.1387061403508772, 'support': 1960}, 'macro avg': {'precision': 0.16807867134404206, 'recall': 0.12763324700536796, 'f1-score': 0.1390935812034129, 'support': 1960}, 'weighted avg': {'precision': 0.1653495390718205, 'recall': 0.12908163265306122, 'f1-score': 0.1389866294043034, 'support': 1960}}
Token level accuracy: 0.5323034315634602
Wrong BIO-Encoding 128/1688 labels, 7.58%
Test-Data: Prec: 0.162, Rec: 0.129, F1: 0.1432

Scores from epoch with best dev-scores:
  Dev-Score: 0.2889
  Test-Score 0.1432

11.69 sec for evaluation

--------- Epoch 16 -----------
201.32 sec for training (3130.32 total)
-- cmv_modes1 --



{'C': {'precision': 0.25, 'recall': 0.4230769230769231, 'f1-score': 0.3142857142857143, 'support': 26}, 'P': {'precision': 0.1, 'recall': 0.05, 'f1-score': 0.06666666666666667, 'support': 20}, 'micro avg': {'precision': 0.2222222222222222, 'recall': 0.2608695652173913, 'f1-score': 0.24, 'support': 46}, 'macro avg': {'precision': 0.175, 'recall': 0.23653846153846153, 'f1-score': 0.19047619047619047, 'support': 46}, 'weighted avg': {'precision': 0.18478260869565216, 'recall': 0.2608695652173913, 'f1-score': 0.20662525879917185, 'support': 46}}
Token level accuracy: 0.6295133437990581
Wrong BIO-Encoding 22/75 labels, 29.33%



{'C': {'precision': 0.25, 'recall': 0.4230769230769231, 'f1-score': 0.3142857142857143, 'support': 26}, 'P': {'precision': 0.1, 'recall': 0.05, 'f1-score': 0.06666666666666667, 'support': 20}, 'micro avg': {'precision': 0.2222222222222222, 'recall': 0.2608695652173913, 'f1-score': 0.24, 'support': 46}, 'macro avg': {'precision': 0.175, 'recall': 0.23653846153846153, 'f1-score': 0.19047619047619047, 'support': 46}, 'weighted avg': {'precision': 0.18478260869565216, 'recall': 0.2608695652173913, 'f1-score': 0.20662525879917185, 'support': 46}}
Token level accuracy: 0.6295133437990581
Wrong BIO-Encoding 1/54 labels, 1.85%
Dev-Data: Prec: 0.226, Rec: 0.261, F1: 0.2424



{'C': {'precision': 0.09657102869139259, 'recall': 0.15098468271334792, 'f1-score': 0.117797695262484, 'support': 914}, 'P': {'precision': 0.0936768149882904, 'recall': 0.07648183556405354, 'f1-score': 0.08421052631578947, 'support': 1046}, 'micro avg': {'precision': 0.09548839246605344, 'recall': 0.11122448979591837, 'f1-score': 0.10275748291303323, 'support': 1960}, 'macro avg': {'precision': 0.0951239218398415, 'recall': 0.11373325913870072, 'f1-score': 0.10100411078913674, 'support': 1960}, 'weighted avg': {'precision': 0.09502646362330847, 'recall': 0.11122448979591837, 'f1-score': 0.09987311428378887, 'support': 1960}}
Token level accuracy: 0.5051711454411701
Wrong BIO-Encoding 2768/4855 labels, 57.01%



{'C': {'precision': 0.09657102869139259, 'recall': 0.15098468271334792, 'f1-score': 0.117797695262484, 'support': 914}, 'P': {'precision': 0.0936768149882904, 'recall': 0.07648183556405354, 'f1-score': 0.08421052631578947, 'support': 1046}, 'micro avg': {'precision': 0.09548839246605344, 'recall': 0.11122448979591837, 'f1-score': 0.10275748291303323, 'support': 1960}, 'macro avg': {'precision': 0.0951239218398415, 'recall': 0.11373325913870072, 'f1-score': 0.10100411078913674, 'support': 1960}, 'weighted avg': {'precision': 0.09502646362330847, 'recall': 0.11122448979591837, 'f1-score': 0.09987311428378887, 'support': 1960}}
Token level accuracy: 0.5051711454411701
Wrong BIO-Encoding 196/2283 labels, 8.59%
Test-Data: Prec: 0.104, Rec: 0.111, F1: 0.1072

Scores from epoch with best dev-scores:
  Dev-Score: 0.2889
  Test-Score 0.1432

11.58 sec for evaluation

--------- Epoch 17 -----------
197.91 sec for training (3328.23 total)
-- cmv_modes1 --



{'C': {'precision': 0.26666666666666666, 'recall': 0.3076923076923077, 'f1-score': 0.28571428571428575, 'support': 26}, 'P': {'precision': 0.36, 'recall': 0.45, 'f1-score': 0.39999999999999997, 'support': 20}, 'micro avg': {'precision': 0.3090909090909091, 'recall': 0.3695652173913043, 'f1-score': 0.33663366336633666, 'support': 46}, 'macro avg': {'precision': 0.31333333333333335, 'recall': 0.37884615384615383, 'f1-score': 0.34285714285714286, 'support': 46}, 'weighted avg': {'precision': 0.30724637681159417, 'recall': 0.3695652173913043, 'f1-score': 0.33540372670807456, 'support': 46}}
Token level accuracy: 0.7048665620094191
Wrong BIO-Encoding 53/105 labels, 50.48%



{'C': {'precision': 0.26666666666666666, 'recall': 0.3076923076923077, 'f1-score': 0.28571428571428575, 'support': 26}, 'P': {'precision': 0.36, 'recall': 0.45, 'f1-score': 0.39999999999999997, 'support': 20}, 'micro avg': {'precision': 0.3090909090909091, 'recall': 0.3695652173913043, 'f1-score': 0.33663366336633666, 'support': 46}, 'macro avg': {'precision': 0.31333333333333335, 'recall': 0.37884615384615383, 'f1-score': 0.34285714285714286, 'support': 46}, 'weighted avg': {'precision': 0.30724637681159417, 'recall': 0.3695652173913043, 'f1-score': 0.33540372670807456, 'support': 46}}
Token level accuracy: 0.7048665620094191
Wrong BIO-Encoding 3/55 labels, 5.45%
Dev-Data: Prec: 0.327, Rec: 0.370, F1: 0.3469



{'C': {'precision': 0.11543450064850844, 'recall': 0.09737417943107221, 'f1-score': 0.1056379821958457, 'support': 914}, 'P': {'precision': 0.10234113712374582, 'recall': 0.1462715105162524, 'f1-score': 0.1204250295159386, 'support': 1046}, 'micro avg': {'precision': 0.10679611650485436, 'recall': 0.12346938775510204, 'f1-score': 0.11452910553715095, 'support': 1960}, 'macro avg': {'precision': 0.10888781888612713, 'recall': 0.1218228449736623, 'f1-score': 0.11303150585589215, 'support': 1960}, 'weighted avg': {'precision': 0.10844691991029329, 'recall': 0.12346938775510204, 'f1-score': 0.11352943704116059, 'support': 1960}}
Token level accuracy: 0.5204682158466398
Wrong BIO-Encoding 2636/4708 labels, 55.99%



{'C': {'precision': 0.11543450064850844, 'recall': 0.09737417943107221, 'f1-score': 0.1056379821958457, 'support': 914}, 'P': {'precision': 0.10234113712374582, 'recall': 0.1462715105162524, 'f1-score': 0.1204250295159386, 'support': 1046}, 'micro avg': {'precision': 0.10679611650485436, 'recall': 0.12346938775510204, 'f1-score': 0.11452910553715095, 'support': 1960}, 'macro avg': {'precision': 0.10888781888612713, 'recall': 0.1218228449736623, 'f1-score': 0.11303150585589215, 'support': 1960}, 'weighted avg': {'precision': 0.10844691991029329, 'recall': 0.12346938775510204, 'f1-score': 0.11352943704116059, 'support': 1960}}
Token level accuracy: 0.5204682158466398
Wrong BIO-Encoding 194/2266 labels, 8.56%
Test-Data: Prec: 0.116, Rec: 0.123, F1: 0.1195

Scores from epoch with best dev-scores:
  Dev-Score: 0.3469
  Test-Score 0.1195

10.66 sec for evaluation

--------- Epoch 18 -----------
191.95 sec for training (3520.18 total)
-- cmv_modes1 --



{'C': {'precision': 0.2413793103448276, 'recall': 0.2692307692307692, 'f1-score': 0.2545454545454545, 'support': 26}, 'P': {'precision': 0.1, 'recall': 0.1, 'f1-score': 0.10000000000000002, 'support': 20}, 'micro avg': {'precision': 0.1836734693877551, 'recall': 0.1956521739130435, 'f1-score': 0.18947368421052632, 'support': 46}, 'macro avg': {'precision': 0.1706896551724138, 'recall': 0.18461538461538463, 'f1-score': 0.17727272727272728, 'support': 46}, 'weighted avg': {'precision': 0.17991004497751126, 'recall': 0.1956521739130435, 'f1-score': 0.18735177865612646, 'support': 46}}
Token level accuracy: 0.7700156985871272
Wrong BIO-Encoding 102/146 labels, 69.86%



{'C': {'precision': 0.2413793103448276, 'recall': 0.2692307692307692, 'f1-score': 0.2545454545454545, 'support': 26}, 'P': {'precision': 0.1, 'recall': 0.1, 'f1-score': 0.10000000000000002, 'support': 20}, 'micro avg': {'precision': 0.1836734693877551, 'recall': 0.1956521739130435, 'f1-score': 0.18947368421052632, 'support': 46}, 'macro avg': {'precision': 0.1706896551724138, 'recall': 0.18461538461538463, 'f1-score': 0.17727272727272728, 'support': 46}, 'weighted avg': {'precision': 0.17991004497751126, 'recall': 0.1956521739130435, 'f1-score': 0.18735177865612646, 'support': 46}}
Token level accuracy: 0.7700156985871272
Wrong BIO-Encoding 5/49 labels, 10.20%
Dev-Data: Prec: 0.205, Rec: 0.196, F1: 0.2000



{'C': {'precision': 0.17918313570487485, 'recall': 0.1487964989059081, 'f1-score': 0.1625821876867902, 'support': 914}, 'P': {'precision': 0.200652528548124, 'recall': 0.23518164435946462, 'f1-score': 0.21654929577464788, 'support': 1046}, 'micro avg': {'precision': 0.1924433249370277, 'recall': 0.19489795918367347, 'f1-score': 0.19366286438529784, 'support': 1960}, 'macro avg': {'precision': 0.18991783212649943, 'recall': 0.19198907163268636, 'f1-score': 0.18956574173071905, 'support': 1960}, 'weighted avg': {'precision': 0.19064078106918025, 'recall': 0.19489795918367347, 'f1-score': 0.1913830014928612, 'support': 1960}}
Token level accuracy: 0.522372235925397
Wrong BIO-Encoding 3282/5069 labels, 64.75%



{'C': {'precision': 0.17918313570487485, 'recall': 0.1487964989059081, 'f1-score': 0.1625821876867902, 'support': 914}, 'P': {'precision': 0.200652528548124, 'recall': 0.23518164435946462, 'f1-score': 0.21654929577464788, 'support': 1046}, 'micro avg': {'precision': 0.1924433249370277, 'recall': 0.19489795918367347, 'f1-score': 0.19366286438529784, 'support': 1960}, 'macro avg': {'precision': 0.18991783212649943, 'recall': 0.19198907163268636, 'f1-score': 0.18956574173071905, 'support': 1960}, 'weighted avg': {'precision': 0.19064078106918025, 'recall': 0.19489795918367347, 'f1-score': 0.1913830014928612, 'support': 1960}}
Token level accuracy: 0.522372235925397
Wrong BIO-Encoding 198/1985 labels, 9.97%
Test-Data: Prec: 0.213, Rec: 0.194, F1: 0.2028

Scores from epoch with best dev-scores:
  Dev-Score: 0.3469
  Test-Score 0.1195

10.56 sec for evaluation

--------- Epoch 19 -----------
197.37 sec for training (3717.55 total)
-- cmv_modes1 --



{'C': {'precision': 0.2727272727272727, 'recall': 0.34615384615384615, 'f1-score': 0.3050847457627119, 'support': 26}, 'P': {'precision': 0.2222222222222222, 'recall': 0.2, 'f1-score': 0.2105263157894737, 'support': 20}, 'micro avg': {'precision': 0.2549019607843137, 'recall': 0.2826086956521739, 'f1-score': 0.26804123711340205, 'support': 46}, 'macro avg': {'precision': 0.24747474747474746, 'recall': 0.2730769230769231, 'f1-score': 0.2578055307760928, 'support': 46}, 'weighted avg': {'precision': 0.2507685551163812, 'recall': 0.2826086956521739, 'f1-score': 0.26397238490478225, 'support': 46}}
Token level accuracy: 0.7700156985871272
Wrong BIO-Encoding 47/95 labels, 49.47%



{'C': {'precision': 0.2727272727272727, 'recall': 0.34615384615384615, 'f1-score': 0.3050847457627119, 'support': 26}, 'P': {'precision': 0.2222222222222222, 'recall': 0.2, 'f1-score': 0.2105263157894737, 'support': 20}, 'micro avg': {'precision': 0.2549019607843137, 'recall': 0.2826086956521739, 'f1-score': 0.26804123711340205, 'support': 46}, 'macro avg': {'precision': 0.24747474747474746, 'recall': 0.2730769230769231, 'f1-score': 0.2578055307760928, 'support': 46}, 'weighted avg': {'precision': 0.2507685551163812, 'recall': 0.2826086956521739, 'f1-score': 0.26397238490478225, 'support': 46}}
Token level accuracy: 0.7700156985871272
Wrong BIO-Encoding 3/51 labels, 5.88%
Dev-Data: Prec: 0.271, Rec: 0.283, F1: 0.2766



{'C': {'precision': 0.13310185185185186, 'recall': 0.12582056892778992, 'f1-score': 0.12935883014623173, 'support': 914}, 'P': {'precision': 0.13620689655172413, 'recall': 0.15105162523900573, 'f1-score': 0.14324569356300995, 'support': 1046}, 'micro avg': {'precision': 0.13488142292490118, 'recall': 0.1392857142857143, 'f1-score': 0.13704819277108432, 'support': 1960}, 'macro avg': {'precision': 0.134654374201788, 'recall': 0.13843609708339782, 'f1-score': 0.13630226185462085, 'support': 1960}, 'weighted avg': {'precision': 0.13475893182943677, 'recall': 0.1392857142857143, 'f1-score': 0.13676988072477766, 'support': 1960}}
Token level accuracy: 0.5156216192825306
Wrong BIO-Encoding 2904/4744 labels, 61.21%



{'C': {'precision': 0.13310185185185186, 'recall': 0.12582056892778992, 'f1-score': 0.12935883014623173, 'support': 914}, 'P': {'precision': 0.13620689655172413, 'recall': 0.15105162523900573, 'f1-score': 0.14324569356300995, 'support': 1046}, 'micro avg': {'precision': 0.13488142292490118, 'recall': 0.1392857142857143, 'f1-score': 0.13704819277108432, 'support': 1960}, 'macro avg': {'precision': 0.134654374201788, 'recall': 0.13843609708339782, 'f1-score': 0.13630226185462085, 'support': 1960}, 'weighted avg': {'precision': 0.13475893182943677, 'recall': 0.1392857142857143, 'f1-score': 0.13676988072477766, 'support': 1960}}
Token level accuracy: 0.5156216192825306
Wrong BIO-Encoding 184/2024 labels, 9.09%
Test-Data: Prec: 0.148, Rec: 0.139, F1: 0.1432

Scores from epoch with best dev-scores:
  Dev-Score: 0.3469
  Test-Score 0.1195

11.74 sec for evaluation

--------- Epoch 20 -----------
200.92 sec for training (3918.47 total)
-- cmv_modes1 --



{'C': {'precision': 0.2894736842105263, 'recall': 0.4230769230769231, 'f1-score': 0.34375, 'support': 26}, 'P': {'precision': 0.06666666666666667, 'recall': 0.05, 'f1-score': 0.05714285714285715, 'support': 20}, 'micro avg': {'precision': 0.22641509433962265, 'recall': 0.2608695652173913, 'f1-score': 0.2424242424242424, 'support': 46}, 'macro avg': {'precision': 0.1780701754385965, 'recall': 0.23653846153846153, 'f1-score': 0.20044642857142858, 'support': 46}, 'weighted avg': {'precision': 0.1926010678871091, 'recall': 0.2608695652173913, 'f1-score': 0.21913819875776397, 'support': 46}}
Token level accuracy: 0.6938775510204082
Wrong BIO-Encoding 24/75 labels, 32.00%



{'C': {'precision': 0.2894736842105263, 'recall': 0.4230769230769231, 'f1-score': 0.34375, 'support': 26}, 'P': {'precision': 0.06666666666666667, 'recall': 0.05, 'f1-score': 0.05714285714285715, 'support': 20}, 'micro avg': {'precision': 0.22641509433962265, 'recall': 0.2608695652173913, 'f1-score': 0.2424242424242424, 'support': 46}, 'macro avg': {'precision': 0.1780701754385965, 'recall': 0.23653846153846153, 'f1-score': 0.20044642857142858, 'support': 46}, 'weighted avg': {'precision': 0.1926010678871091, 'recall': 0.2608695652173913, 'f1-score': 0.21913819875776397, 'support': 46}}
Token level accuracy: 0.6938775510204082
Wrong BIO-Encoding 2/53 labels, 3.77%
Dev-Data: Prec: 0.235, Rec: 0.261, F1: 0.2474



{'C': {'precision': 0.1533135509396637, 'recall': 0.16958424507658643, 'f1-score': 0.16103896103896104, 'support': 914}, 'P': {'precision': 0.1607773851590106, 'recall': 0.1739961759082218, 'f1-score': 0.16712580348943987, 'support': 1046}, 'micro avg': {'precision': 0.1572561829211386, 'recall': 0.1719387755102041, 'f1-score': 0.16427004630757983, 'support': 1960}, 'macro avg': {'precision': 0.15704546804933717, 'recall': 0.17179021049240412, 'f1-score': 0.16408238226420047, 'support': 1960}, 'weighted avg': {'precision': 0.1572968012424376, 'recall': 0.1719387755102041, 'f1-score': 0.16428734736712472, 'support': 1960}}
Token level accuracy: 0.5320870656454195
Wrong BIO-Encoding 2903/4860 labels, 59.73%



{'C': {'precision': 0.1533135509396637, 'recall': 0.16958424507658643, 'f1-score': 0.16103896103896104, 'support': 914}, 'P': {'precision': 0.1607773851590106, 'recall': 0.1739961759082218, 'f1-score': 0.16712580348943987, 'support': 1046}, 'micro avg': {'precision': 0.1572561829211386, 'recall': 0.1719387755102041, 'f1-score': 0.16427004630757983, 'support': 1960}, 'macro avg': {'precision': 0.15704546804933717, 'recall': 0.17179021049240412, 'f1-score': 0.16408238226420047, 'support': 1960}, 'weighted avg': {'precision': 0.1572968012424376, 'recall': 0.1719387755102041, 'f1-score': 0.16428734736712472, 'support': 1960}}
Token level accuracy: 0.5320870656454195
Wrong BIO-Encoding 186/2143 labels, 8.68%
Test-Data: Prec: 0.172, Rec: 0.171, F1: 0.1716

Scores from epoch with best dev-scores:
  Dev-Score: 0.3469
  Test-Score 0.1195

11.82 sec for evaluation

--------- Epoch 21 -----------
200.48 sec for training (4118.95 total)
-- cmv_modes1 --



{'C': {'precision': 0.21212121212121213, 'recall': 0.2692307692307692, 'f1-score': 0.23728813559322037, 'support': 26}, 'P': {'precision': 0.15, 'recall': 0.15, 'f1-score': 0.15, 'support': 20}, 'micro avg': {'precision': 0.18867924528301888, 'recall': 0.21739130434782608, 'f1-score': 0.20202020202020202, 'support': 46}, 'macro avg': {'precision': 0.18106060606060606, 'recall': 0.2096153846153846, 'f1-score': 0.1936440677966102, 'support': 46}, 'weighted avg': {'precision': 0.18511198945981555, 'recall': 0.21739130434782608, 'f1-score': 0.19933677229182023, 'support': 46}}
Token level accuracy: 0.749607535321821
Wrong BIO-Encoding 68/118 labels, 57.63%



{'C': {'precision': 0.21212121212121213, 'recall': 0.2692307692307692, 'f1-score': 0.23728813559322037, 'support': 26}, 'P': {'precision': 0.15, 'recall': 0.15, 'f1-score': 0.15, 'support': 20}, 'micro avg': {'precision': 0.18867924528301888, 'recall': 0.21739130434782608, 'f1-score': 0.20202020202020202, 'support': 46}, 'macro avg': {'precision': 0.18106060606060606, 'recall': 0.2096153846153846, 'f1-score': 0.1936440677966102, 'support': 46}, 'weighted avg': {'precision': 0.18511198945981555, 'recall': 0.21739130434782608, 'f1-score': 0.19933677229182023, 'support': 46}}
Token level accuracy: 0.749607535321821
Wrong BIO-Encoding 3/53 labels, 5.66%
Dev-Data: Prec: 0.200, Rec: 0.217, F1: 0.2083



{'C': {'precision': 0.1700404858299595, 'recall': 0.13785557986870897, 'f1-score': 0.15226586102719036, 'support': 914}, 'P': {'precision': 0.15699404761904762, 'recall': 0.20172084130019122, 'f1-score': 0.17656903765690377, 'support': 1046}, 'micro avg': {'precision': 0.16163069544364508, 'recall': 0.1719387755102041, 'f1-score': 0.1666254635352287, 'support': 1960}, 'macro avg': {'precision': 0.16351726672450356, 'recall': 0.1697882105844501, 'f1-score': 0.16441744934204705, 'support': 1960}, 'weighted avg': {'precision': 0.1630779478867892, 'recall': 0.1719387755102041, 'f1-score': 0.16523582161631295, 'support': 1960}}
Token level accuracy: 0.5249686269418841
Wrong BIO-Encoding 2119/4068 labels, 52.09%



{'C': {'precision': 0.1700404858299595, 'recall': 0.13785557986870897, 'f1-score': 0.15226586102719036, 'support': 914}, 'P': {'precision': 0.15699404761904762, 'recall': 0.20172084130019122, 'f1-score': 0.17656903765690377, 'support': 1046}, 'micro avg': {'precision': 0.16163069544364508, 'recall': 0.1719387755102041, 'f1-score': 0.1666254635352287, 'support': 1960}, 'macro avg': {'precision': 0.16351726672450356, 'recall': 0.1697882105844501, 'f1-score': 0.16441744934204705, 'support': 1960}, 'weighted avg': {'precision': 0.1630779478867892, 'recall': 0.1719387755102041, 'f1-score': 0.16523582161631295, 'support': 1960}}
Token level accuracy: 0.5249686269418841
Wrong BIO-Encoding 136/2085 labels, 6.52%
Test-Data: Prec: 0.172, Rec: 0.171, F1: 0.1719

Scores from epoch with best dev-scores:
  Dev-Score: 0.3469
  Test-Score 0.1195

11.96 sec for evaluation

--------- Epoch 22 -----------
197.55 sec for training (4316.50 total)
-- cmv_modes1 --



{'C': {'precision': 0.4074074074074074, 'recall': 0.4230769230769231, 'f1-score': 0.4150943396226415, 'support': 26}, 'P': {'precision': 0.4, 'recall': 0.4, 'f1-score': 0.4000000000000001, 'support': 20}, 'micro avg': {'precision': 0.40425531914893614, 'recall': 0.41304347826086957, 'f1-score': 0.4086021505376344, 'support': 46}, 'macro avg': {'precision': 0.4037037037037037, 'recall': 0.4115384615384615, 'f1-score': 0.4075471698113208, 'support': 46}, 'weighted avg': {'precision': 0.4041867954911433, 'recall': 0.41304347826086957, 'f1-score': 0.4085315832649713, 'support': 46}}
Token level accuracy: 0.8139717425431711
Wrong BIO-Encoding 34/79 labels, 43.04%



{'C': {'precision': 0.4074074074074074, 'recall': 0.4230769230769231, 'f1-score': 0.4150943396226415, 'support': 26}, 'P': {'precision': 0.4, 'recall': 0.4, 'f1-score': 0.4000000000000001, 'support': 20}, 'micro avg': {'precision': 0.40425531914893614, 'recall': 0.41304347826086957, 'f1-score': 0.4086021505376344, 'support': 46}, 'macro avg': {'precision': 0.4037037037037037, 'recall': 0.4115384615384615, 'f1-score': 0.4075471698113208, 'support': 46}, 'weighted avg': {'precision': 0.4041867954911433, 'recall': 0.41304347826086957, 'f1-score': 0.4085315832649713, 'support': 46}}
Token level accuracy: 0.8139717425431711
Wrong BIO-Encoding 2/47 labels, 4.26%
Dev-Data: Prec: 0.422, Rec: 0.413, F1: 0.4176



{'C': {'precision': 0.14981617647058823, 'recall': 0.17833698030634573, 'f1-score': 0.16283716283716282, 'support': 914}, 'P': {'precision': 0.13615023474178403, 'recall': 0.13862332695984703, 'f1-score': 0.13737565135007107, 'support': 1046}, 'micro avg': {'precision': 0.14305620065025546, 'recall': 0.15714285714285714, 'f1-score': 0.149769025042548, 'support': 1960}, 'macro avg': {'precision': 0.14298320560618613, 'recall': 0.15848015363309637, 'f1-score': 0.15010640709361694, 'support': 1960}, 'weighted avg': {'precision': 0.14252302593572638, 'recall': 0.15714285714285714, 'f1-score': 0.14924902966599038, 'support': 1960}}
Token level accuracy: 0.529707040546973
Wrong BIO-Encoding 2547/4512 labels, 56.45%



{'C': {'precision': 0.14981617647058823, 'recall': 0.17833698030634573, 'f1-score': 0.16283716283716282, 'support': 914}, 'P': {'precision': 0.13615023474178403, 'recall': 0.13862332695984703, 'f1-score': 0.13737565135007107, 'support': 1046}, 'micro avg': {'precision': 0.14305620065025546, 'recall': 0.15714285714285714, 'f1-score': 0.149769025042548, 'support': 1960}, 'macro avg': {'precision': 0.14298320560618613, 'recall': 0.15848015363309637, 'f1-score': 0.15010640709361694, 'support': 1960}, 'weighted avg': {'precision': 0.14252302593572638, 'recall': 0.15714285714285714, 'f1-score': 0.14924902966599038, 'support': 1960}}
Token level accuracy: 0.529707040546973
Wrong BIO-Encoding 188/2153 labels, 8.73%
Test-Data: Prec: 0.156, Rec: 0.156, F1: 0.1559

Scores from epoch with best dev-scores:
  Dev-Score: 0.4176
  Test-Score 0.1559

10.60 sec for evaluation

--------- Epoch 23 -----------
192.00 sec for training (4508.51 total)
-- cmv_modes1 --



{'C': {'precision': 0.5238095238095238, 'recall': 0.4230769230769231, 'f1-score': 0.4680851063829788, 'support': 26}, 'P': {'precision': 0.4, 'recall': 0.5, 'f1-score': 0.4444444444444445, 'support': 20}, 'micro avg': {'precision': 0.45652173913043476, 'recall': 0.45652173913043476, 'f1-score': 0.45652173913043476, 'support': 46}, 'macro avg': {'precision': 0.46190476190476193, 'recall': 0.46153846153846156, 'f1-score': 0.45626477541371163, 'support': 46}, 'weighted avg': {'precision': 0.4699792960662526, 'recall': 0.45652173913043476, 'f1-score': 0.4578065577140508, 'support': 46}}
Token level accuracy: 0.8163265306122449
Wrong BIO-Encoding 11/56 labels, 19.64%



{'C': {'precision': 0.5238095238095238, 'recall': 0.4230769230769231, 'f1-score': 0.4680851063829788, 'support': 26}, 'P': {'precision': 0.4, 'recall': 0.5, 'f1-score': 0.4444444444444445, 'support': 20}, 'micro avg': {'precision': 0.45652173913043476, 'recall': 0.45652173913043476, 'f1-score': 0.45652173913043476, 'support': 46}, 'macro avg': {'precision': 0.46190476190476193, 'recall': 0.46153846153846156, 'f1-score': 0.45626477541371163, 'support': 46}, 'weighted avg': {'precision': 0.4699792960662526, 'recall': 0.45652173913043476, 'f1-score': 0.4578065577140508, 'support': 46}}
Token level accuracy: 0.8163265306122449
Wrong BIO-Encoding 1/46 labels, 2.17%
Dev-Data: Prec: 0.467, Rec: 0.457, F1: 0.4615



{'C': {'precision': 0.17327459618208516, 'recall': 0.12910284463894967, 'f1-score': 0.1479623824451411, 'support': 914}, 'P': {'precision': 0.15991763898421413, 'recall': 0.22275334608030592, 'f1-score': 0.18617658809428686, 'support': 1046}, 'micro avg': {'precision': 0.16417212347988774, 'recall': 0.17908163265306123, 'f1-score': 0.17130307467057102, 'support': 1960}, 'macro avg': {'precision': 0.16659611758314963, 'recall': 0.17592809535962778, 'f1-score': 0.167069485269714, 'support': 1960}, 'weighted avg': {'precision': 0.1661463424938336, 'recall': 0.17908163265306123, 'f1-score': 0.16835629015381787, 'support': 1960}}
Token level accuracy: 0.5444631961573413
Wrong BIO-Encoding 1787/3802 labels, 47.00%



{'C': {'precision': 0.17327459618208516, 'recall': 0.12910284463894967, 'f1-score': 0.1479623824451411, 'support': 914}, 'P': {'precision': 0.15991763898421413, 'recall': 0.22275334608030592, 'f1-score': 0.18617658809428686, 'support': 1046}, 'micro avg': {'precision': 0.16417212347988774, 'recall': 0.17908163265306123, 'f1-score': 0.17130307467057102, 'support': 1960}, 'macro avg': {'precision': 0.16659611758314963, 'recall': 0.17592809535962778, 'f1-score': 0.167069485269714, 'support': 1960}, 'weighted avg': {'precision': 0.1661463424938336, 'recall': 0.17908163265306123, 'f1-score': 0.16835629015381787, 'support': 1960}}
Token level accuracy: 0.5444631961573413
Wrong BIO-Encoding 123/2138 labels, 5.75%
Test-Data: Prec: 0.173, Rec: 0.178, F1: 0.1751

Scores from epoch with best dev-scores:
  Dev-Score: 0.4615
  Test-Score 0.1751

10.72 sec for evaluation

--------- Epoch 24 -----------
199.11 sec for training (4707.62 total)
-- cmv_modes1 --



{'C': {'precision': 0.38095238095238093, 'recall': 0.3076923076923077, 'f1-score': 0.3404255319148936, 'support': 26}, 'P': {'precision': 0.38461538461538464, 'recall': 0.5, 'f1-score': 0.4347826086956522, 'support': 20}, 'micro avg': {'precision': 0.3829787234042553, 'recall': 0.391304347826087, 'f1-score': 0.3870967741935484, 'support': 46}, 'macro avg': {'precision': 0.38278388278388276, 'recall': 0.40384615384615385, 'f1-score': 0.3876040703052729, 'support': 46}, 'weighted avg': {'precision': 0.38254499124064345, 'recall': 0.391304347826087, 'f1-score': 0.3814503479065278, 'support': 46}}
Token level accuracy: 0.7739403453689168
Wrong BIO-Encoding 58/102 labels, 56.86%



{'C': {'precision': 0.38095238095238093, 'recall': 0.3076923076923077, 'f1-score': 0.3404255319148936, 'support': 26}, 'P': {'precision': 0.38461538461538464, 'recall': 0.5, 'f1-score': 0.4347826086956522, 'support': 20}, 'micro avg': {'precision': 0.3829787234042553, 'recall': 0.391304347826087, 'f1-score': 0.3870967741935484, 'support': 46}, 'macro avg': {'precision': 0.38278388278388276, 'recall': 0.40384615384615385, 'f1-score': 0.3876040703052729, 'support': 46}, 'weighted avg': {'precision': 0.38254499124064345, 'recall': 0.391304347826087, 'f1-score': 0.3814503479065278, 'support': 46}}
Token level accuracy: 0.7739403453689168
Wrong BIO-Encoding 3/47 labels, 6.38%
Dev-Data: Prec: 0.409, Rec: 0.391, F1: 0.4000



{'C': {'precision': 0.17492260061919504, 'recall': 0.12363238512035012, 'f1-score': 0.14487179487179488, 'support': 914}, 'P': {'precision': 0.13120830244625648, 'recall': 0.16921606118546845, 'f1-score': 0.14780793319415447, 'support': 1046}, 'micro avg': {'precision': 0.14536340852130325, 'recall': 0.14795918367346939, 'f1-score': 0.14664981036662453, 'support': 1960}, 'macro avg': {'precision': 0.15306545153272577, 'recall': 0.1464242231529093, 'f1-score': 0.14633986403297466, 'support': 1960}, 'weighted avg': {'precision': 0.15159343945139211, 'recall': 0.14795918367346939, 'f1-score': 0.14643873399689086, 'support': 1960}}
Token level accuracy: 0.5377991258816911
Wrong BIO-Encoding 2798/4607 labels, 60.73%



{'C': {'precision': 0.17492260061919504, 'recall': 0.12363238512035012, 'f1-score': 0.14487179487179488, 'support': 914}, 'P': {'precision': 0.13120830244625648, 'recall': 0.16921606118546845, 'f1-score': 0.14780793319415447, 'support': 1046}, 'micro avg': {'precision': 0.14536340852130325, 'recall': 0.14795918367346939, 'f1-score': 0.14664981036662453, 'support': 1960}, 'macro avg': {'precision': 0.15306545153272577, 'recall': 0.1464242231529093, 'f1-score': 0.14633986403297466, 'support': 1960}, 'weighted avg': {'precision': 0.15159343945139211, 'recall': 0.14795918367346939, 'f1-score': 0.14643873399689086, 'support': 1960}}
Token level accuracy: 0.5377991258816911
Wrong BIO-Encoding 186/1995 labels, 9.32%
Test-Data: Prec: 0.160, Rec: 0.147, F1: 0.1534

Scores from epoch with best dev-scores:
  Dev-Score: 0.4615
  Test-Score 0.1751

11.86 sec for evaluation

--------- Epoch 25 -----------
201.35 sec for training (4908.97 total)
-- cmv_modes1 --



{'C': {'precision': 0.4, 'recall': 0.38461538461538464, 'f1-score': 0.39215686274509803, 'support': 26}, 'P': {'precision': 0.25, 'recall': 0.2, 'f1-score': 0.22222222222222224, 'support': 20}, 'micro avg': {'precision': 0.34146341463414637, 'recall': 0.30434782608695654, 'f1-score': 0.3218390804597701, 'support': 46}, 'macro avg': {'precision': 0.325, 'recall': 0.2923076923076923, 'f1-score': 0.30718954248366015, 'support': 46}, 'weighted avg': {'precision': 0.3347826086956522, 'recall': 0.30434782608695654, 'f1-score': 0.3182722364308042, 'support': 46}}
Token level accuracy: 0.8328100470957613
Wrong BIO-Encoding 9/49 labels, 18.37%



{'C': {'precision': 0.4, 'recall': 0.38461538461538464, 'f1-score': 0.39215686274509803, 'support': 26}, 'P': {'precision': 0.25, 'recall': 0.2, 'f1-score': 0.22222222222222224, 'support': 20}, 'micro avg': {'precision': 0.34146341463414637, 'recall': 0.30434782608695654, 'f1-score': 0.3218390804597701, 'support': 46}, 'macro avg': {'precision': 0.325, 'recall': 0.2923076923076923, 'f1-score': 0.30718954248366015, 'support': 46}, 'weighted avg': {'precision': 0.3347826086956522, 'recall': 0.30434782608695654, 'f1-score': 0.3182722364308042, 'support': 46}}
Token level accuracy: 0.8328100470957613
Wrong BIO-Encoding 1/41 labels, 2.44%
Dev-Data: Prec: 0.350, Rec: 0.304, F1: 0.3256



{'C': {'precision': 0.13006993006993006, 'recall': 0.10175054704595186, 'f1-score': 0.1141804788213628, 'support': 914}, 'P': {'precision': 0.20270270270270271, 'recall': 0.2294455066921606, 'f1-score': 0.21524663677130046, 'support': 1046}, 'micro avg': {'precision': 0.17535545023696683, 'recall': 0.16989795918367348, 'f1-score': 0.17258357087328324, 'support': 1960}, 'macro avg': {'precision': 0.1663863163863164, 'recall': 0.16559802686905623, 'f1-score': 0.16471355779633162, 'support': 1960}, 'weighted avg': {'precision': 0.16883211383211383, 'recall': 0.16989795918367348, 'f1-score': 0.1681168059721969, 'support': 1960}}
Token level accuracy: 0.5273702886321346
Wrong BIO-Encoding 2914/4638 labels, 62.83%



{'C': {'precision': 0.13006993006993006, 'recall': 0.10175054704595186, 'f1-score': 0.1141804788213628, 'support': 914}, 'P': {'precision': 0.20270270270270271, 'recall': 0.2294455066921606, 'f1-score': 0.21524663677130046, 'support': 1046}, 'micro avg': {'precision': 0.17535545023696683, 'recall': 0.16989795918367348, 'f1-score': 0.17258357087328324, 'support': 1960}, 'macro avg': {'precision': 0.1663863163863164, 'recall': 0.16559802686905623, 'f1-score': 0.16471355779633162, 'support': 1960}, 'weighted avg': {'precision': 0.16883211383211383, 'recall': 0.16989795918367348, 'f1-score': 0.1681168059721969, 'support': 1960}}
Token level accuracy: 0.5273702886321346
Wrong BIO-Encoding 175/1899 labels, 9.22%
Test-Data: Prec: 0.191, Rec: 0.168, F1: 0.1786

Scores from epoch with best dev-scores:
  Dev-Score: 0.4615
  Test-Score 0.1751

11.41 sec for evaluation

--------- Epoch 26 -----------
200.66 sec for training (5109.64 total)
-- cmv_modes1 --



{'C': {'precision': 0.4482758620689655, 'recall': 0.5, 'f1-score': 0.4727272727272727, 'support': 26}, 'P': {'precision': 0.3157894736842105, 'recall': 0.3, 'f1-score': 0.3076923076923077, 'support': 20}, 'micro avg': {'precision': 0.3958333333333333, 'recall': 0.41304347826086957, 'f1-score': 0.4042553191489362, 'support': 46}, 'macro avg': {'precision': 0.382032667876588, 'recall': 0.4, 'f1-score': 0.3902097902097902, 'support': 46}, 'weighted avg': {'precision': 0.3906730845103764, 'recall': 0.41304347826086957, 'f1-score': 0.4009729401033749, 'support': 46}}
Token level accuracy: 0.8500784929356358
Wrong BIO-Encoding 15/62 labels, 24.19%



{'C': {'precision': 0.4482758620689655, 'recall': 0.5, 'f1-score': 0.4727272727272727, 'support': 26}, 'P': {'precision': 0.3157894736842105, 'recall': 0.3, 'f1-score': 0.3076923076923077, 'support': 20}, 'micro avg': {'precision': 0.3958333333333333, 'recall': 0.41304347826086957, 'f1-score': 0.4042553191489362, 'support': 46}, 'macro avg': {'precision': 0.382032667876588, 'recall': 0.4, 'f1-score': 0.3902097902097902, 'support': 46}, 'weighted avg': {'precision': 0.3906730845103764, 'recall': 0.41304347826086957, 'f1-score': 0.4009729401033749, 'support': 46}}
Token level accuracy: 0.8500784929356358
Wrong BIO-Encoding 1/48 labels, 2.08%
Dev-Data: Prec: 0.404, Rec: 0.413, F1: 0.4086



{'C': {'precision': 0.14915693904020752, 'recall': 0.12582056892778992, 'f1-score': 0.13649851632047477, 'support': 914}, 'P': {'precision': 0.14989590562109645, 'recall': 0.20650095602294455, 'f1-score': 0.17370325693606753, 'support': 1046}, 'micro avg': {'precision': 0.14963833634719712, 'recall': 0.16887755102040816, 'f1-score': 0.15867689357622244, 'support': 1960}, 'macro avg': {'precision': 0.149526422330652, 'recall': 0.16616076247536724, 'f1-score': 0.15510088662827115, 'support': 1960}, 'weighted avg': {'precision': 0.14955130589919213, 'recall': 0.16887755102040816, 'f1-score': 0.15635369932246967, 'support': 1960}}
Token level accuracy: 0.5336881734389199
Wrong BIO-Encoding 1876/3944 labels, 47.57%



{'C': {'precision': 0.14915693904020752, 'recall': 0.12582056892778992, 'f1-score': 0.13649851632047477, 'support': 914}, 'P': {'precision': 0.14989590562109645, 'recall': 0.20650095602294455, 'f1-score': 0.17370325693606753, 'support': 1046}, 'micro avg': {'precision': 0.14963833634719712, 'recall': 0.16887755102040816, 'f1-score': 0.15867689357622244, 'support': 1960}, 'macro avg': {'precision': 0.149526422330652, 'recall': 0.16616076247536724, 'f1-score': 0.15510088662827115, 'support': 1960}, 'weighted avg': {'precision': 0.14955130589919213, 'recall': 0.16887755102040816, 'f1-score': 0.15635369932246967, 'support': 1960}}
Token level accuracy: 0.5336881734389199
Wrong BIO-Encoding 144/2212 labels, 6.51%
Test-Data: Prec: 0.160, Rec: 0.168, F1: 0.1639

Scores from epoch with best dev-scores:
  Dev-Score: 0.4615
  Test-Score 0.1751

11.58 sec for evaluation

--------- Epoch 27 -----------
197.03 sec for training (5306.66 total)
-- cmv_modes1 --



{'C': {'precision': 0.4117647058823529, 'recall': 0.5384615384615384, 'f1-score': 0.4666666666666667, 'support': 26}, 'P': {'precision': 0.29411764705882354, 'recall': 0.25, 'f1-score': 0.27027027027027023, 'support': 20}, 'micro avg': {'precision': 0.37254901960784315, 'recall': 0.41304347826086957, 'f1-score': 0.39175257731958757, 'support': 46}, 'macro avg': {'precision': 0.3529411764705882, 'recall': 0.3942307692307692, 'f1-score': 0.3684684684684685, 'support': 46}, 'weighted avg': {'precision': 0.3606138107416879, 'recall': 0.41304347826086957, 'f1-score': 0.381276929103016, 'support': 46}}
Token level accuracy: 0.8375196232339089
Wrong BIO-Encoding 6/56 labels, 10.71%



{'C': {'precision': 0.4117647058823529, 'recall': 0.5384615384615384, 'f1-score': 0.4666666666666667, 'support': 26}, 'P': {'precision': 0.29411764705882354, 'recall': 0.25, 'f1-score': 0.27027027027027023, 'support': 20}, 'micro avg': {'precision': 0.37254901960784315, 'recall': 0.41304347826086957, 'f1-score': 0.39175257731958757, 'support': 46}, 'macro avg': {'precision': 0.3529411764705882, 'recall': 0.3942307692307692, 'f1-score': 0.3684684684684685, 'support': 46}, 'weighted avg': {'precision': 0.3606138107416879, 'recall': 0.41304347826086957, 'f1-score': 0.381276929103016, 'support': 46}}
Token level accuracy: 0.8375196232339089
Wrong BIO-Encoding 1/51 labels, 1.96%
Dev-Data: Prec: 0.380, Rec: 0.413, F1: 0.3958



{'C': {'precision': 0.16279069767441862, 'recall': 0.1761487964989059, 'f1-score': 0.16920651602732528, 'support': 914}, 'P': {'precision': 0.15696784073506892, 'recall': 0.1959847036328872, 'f1-score': 0.17431972789115646, 'support': 1046}, 'micro avg': {'precision': 0.15947712418300652, 'recall': 0.186734693877551, 'f1-score': 0.17203290246768504, 'support': 1960}, 'macro avg': {'precision': 0.15987926920474377, 'recall': 0.18606675006589657, 'f1-score': 0.17176312195924087, 'support': 1960}, 'weighted avg': {'precision': 0.15968319340984732, 'recall': 0.186734693877551, 'f1-score': 0.17193530154241068, 'support': 1960}}
Token level accuracy: 0.5302046821584664
Wrong BIO-Encoding 1666/3821 labels, 43.60%



{'C': {'precision': 0.16279069767441862, 'recall': 0.1761487964989059, 'f1-score': 0.16920651602732528, 'support': 914}, 'P': {'precision': 0.15696784073506892, 'recall': 0.1959847036328872, 'f1-score': 0.17431972789115646, 'support': 1046}, 'micro avg': {'precision': 0.15947712418300652, 'recall': 0.186734693877551, 'f1-score': 0.17203290246768504, 'support': 1960}, 'macro avg': {'precision': 0.15987926920474377, 'recall': 0.18606675006589657, 'f1-score': 0.17176312195924087, 'support': 1960}, 'weighted avg': {'precision': 0.15968319340984732, 'recall': 0.186734693877551, 'f1-score': 0.17193530154241068, 'support': 1960}}
Token level accuracy: 0.5302046821584664
Wrong BIO-Encoding 140/2295 labels, 6.10%
Test-Data: Prec: 0.169, Rec: 0.186, F1: 0.1774

Scores from epoch with best dev-scores:
  Dev-Score: 0.4615
  Test-Score 0.1751

10.64 sec for evaluation

--------- Epoch 28 -----------
191.51 sec for training (5498.17 total)
-- cmv_modes1 --



{'C': {'precision': 0.3235294117647059, 'recall': 0.4230769230769231, 'f1-score': 0.3666666666666667, 'support': 26}, 'P': {'precision': 0.45454545454545453, 'recall': 0.25, 'f1-score': 0.3225806451612903, 'support': 20}, 'micro avg': {'precision': 0.35555555555555557, 'recall': 0.34782608695652173, 'f1-score': 0.3516483516483516, 'support': 46}, 'macro avg': {'precision': 0.3890374331550802, 'recall': 0.33653846153846156, 'f1-score': 0.3446236559139785, 'support': 46}, 'weighted avg': {'precision': 0.3804929086259009, 'recall': 0.34782608695652173, 'f1-score': 0.34749883122954656, 'support': 46}}
Token level accuracy: 0.7888540031397174



{'C': {'precision': 0.3235294117647059, 'recall': 0.4230769230769231, 'f1-score': 0.3666666666666667, 'support': 26}, 'P': {'precision': 0.45454545454545453, 'recall': 0.25, 'f1-score': 0.3225806451612903, 'support': 20}, 'micro avg': {'precision': 0.35555555555555557, 'recall': 0.34782608695652173, 'f1-score': 0.3516483516483516, 'support': 46}, 'macro avg': {'precision': 0.3890374331550802, 'recall': 0.33653846153846156, 'f1-score': 0.3446236559139785, 'support': 46}, 'weighted avg': {'precision': 0.3804929086259009, 'recall': 0.34782608695652173, 'f1-score': 0.34749883122954656, 'support': 46}}
Token level accuracy: 0.7888540031397174
Dev-Data: Prec: 0.356, Rec: 0.348, F1: 0.3516



{'C': {'precision': 0.1511111111111111, 'recall': 0.1487964989059081, 'f1-score': 0.1499448732083793, 'support': 914}, 'P': {'precision': 0.16978066612510154, 'recall': 0.19980879541108987, 'f1-score': 0.18357487922705312, 'support': 1046}, 'micro avg': {'precision': 0.16189582355701548, 'recall': 0.1760204081632653, 'f1-score': 0.16866291860180885, 'support': 1960}, 'macro avg': {'precision': 0.16044588861810632, 'recall': 0.17430264715849897, 'f1-score': 0.1667598762177162, 'support': 1960}, 'weighted avg': {'precision': 0.16107455730735293, 'recall': 0.1760204081632653, 'f1-score': 0.16789231519589604, 'support': 1960}}
Token level accuracy: 0.5210091306417413
Wrong BIO-Encoding 2141/4117 labels, 52.00%



{'C': {'precision': 0.1511111111111111, 'recall': 0.1487964989059081, 'f1-score': 0.1499448732083793, 'support': 914}, 'P': {'precision': 0.16978066612510154, 'recall': 0.19980879541108987, 'f1-score': 0.18357487922705312, 'support': 1046}, 'micro avg': {'precision': 0.16189582355701548, 'recall': 0.1760204081632653, 'f1-score': 0.16866291860180885, 'support': 1960}, 'macro avg': {'precision': 0.16044588861810632, 'recall': 0.17430264715849897, 'f1-score': 0.1667598762177162, 'support': 1960}, 'weighted avg': {'precision': 0.16107455730735293, 'recall': 0.1760204081632653, 'f1-score': 0.16789231519589604, 'support': 1960}}
Token level accuracy: 0.5210091306417413
Wrong BIO-Encoding 155/2131 labels, 7.27%
Test-Data: Prec: 0.174, Rec: 0.175, F1: 0.1743

Scores from epoch with best dev-scores:
  Dev-Score: 0.4615
  Test-Score 0.1751

10.59 sec for evaluation

--------- Epoch 29 -----------
198.62 sec for training (5696.79 total)
-- cmv_modes1 --



{'C': {'precision': 0.3793103448275862, 'recall': 0.4230769230769231, 'f1-score': 0.4, 'support': 26}, 'P': {'precision': 0.5294117647058824, 'recall': 0.45, 'f1-score': 0.48648648648648646, 'support': 20}, 'micro avg': {'precision': 0.43478260869565216, 'recall': 0.43478260869565216, 'f1-score': 0.43478260869565216, 'support': 46}, 'macro avg': {'precision': 0.4543610547667343, 'recall': 0.43653846153846154, 'f1-score': 0.44324324324324327, 'support': 46}, 'weighted avg': {'precision': 0.4445718317311932, 'recall': 0.43478260869565216, 'f1-score': 0.4376028202115159, 'support': 46}}
Token level accuracy: 0.8540031397174255



{'C': {'precision': 0.3793103448275862, 'recall': 0.4230769230769231, 'f1-score': 0.4, 'support': 26}, 'P': {'precision': 0.5294117647058824, 'recall': 0.45, 'f1-score': 0.48648648648648646, 'support': 20}, 'micro avg': {'precision': 0.43478260869565216, 'recall': 0.43478260869565216, 'f1-score': 0.43478260869565216, 'support': 46}, 'macro avg': {'precision': 0.4543610547667343, 'recall': 0.43653846153846154, 'f1-score': 0.44324324324324327, 'support': 46}, 'weighted avg': {'precision': 0.4445718317311932, 'recall': 0.43478260869565216, 'f1-score': 0.4376028202115159, 'support': 46}}
Token level accuracy: 0.8540031397174255
Dev-Data: Prec: 0.435, Rec: 0.435, F1: 0.4348



{'C': {'precision': 0.1462655601659751, 'recall': 0.15426695842450766, 'f1-score': 0.15015974440894567, 'support': 914}, 'P': {'precision': 0.18496110630942092, 'recall': 0.2045889101338432, 'f1-score': 0.1942805265546981, 'support': 1046}, 'micro avg': {'precision': 0.16737388024516736, 'recall': 0.18112244897959184, 'f1-score': 0.1739769664297966, 'support': 1960}, 'macro avg': {'precision': 0.165613333237698, 'recall': 0.17942793427917542, 'f1-score': 0.17222013548182188, 'support': 1960}, 'weighted avg': {'precision': 0.1669163465262018, 'recall': 0.18112244897959184, 'f1-score': 0.17370583528877068, 'support': 1960}}
Token level accuracy: 0.5158379852005712
Wrong BIO-Encoding 2125/4098 labels, 51.85%



{'C': {'precision': 0.1462655601659751, 'recall': 0.15426695842450766, 'f1-score': 0.15015974440894567, 'support': 914}, 'P': {'precision': 0.18496110630942092, 'recall': 0.2045889101338432, 'f1-score': 0.1942805265546981, 'support': 1046}, 'micro avg': {'precision': 0.16737388024516736, 'recall': 0.18112244897959184, 'f1-score': 0.1739769664297966, 'support': 1960}, 'macro avg': {'precision': 0.165613333237698, 'recall': 0.17942793427917542, 'f1-score': 0.17222013548182188, 'support': 1960}, 'weighted avg': {'precision': 0.1669163465262018, 'recall': 0.18112244897959184, 'f1-score': 0.17370583528877068, 'support': 1960}}
Token level accuracy: 0.5158379852005712
Wrong BIO-Encoding 148/2121 labels, 6.98%
Test-Data: Prec: 0.179, Rec: 0.181, F1: 0.1800

Scores from epoch with best dev-scores:
  Dev-Score: 0.4615
  Test-Score 0.1751

11.52 sec for evaluation

--------- Epoch 30 -----------
200.19 sec for training (5896.98 total)
-- cmv_modes1 --



{'C': {'precision': 0.6190476190476191, 'recall': 0.5, 'f1-score': 0.5531914893617021, 'support': 26}, 'P': {'precision': 0.4166666666666667, 'recall': 0.5, 'f1-score': 0.45454545454545453, 'support': 20}, 'micro avg': {'precision': 0.5111111111111111, 'recall': 0.5, 'f1-score': 0.5054945054945055, 'support': 46}, 'macro avg': {'precision': 0.5178571428571429, 'recall': 0.5, 'f1-score': 0.5038684719535783, 'support': 46}, 'weighted avg': {'precision': 0.5310559006211181, 'recall': 0.5, 'f1-score': 0.5103019090068118, 'support': 46}}
Token level accuracy: 0.8775510204081632
Wrong BIO-Encoding 12/56 labels, 21.43%



{'C': {'precision': 0.6190476190476191, 'recall': 0.5, 'f1-score': 0.5531914893617021, 'support': 26}, 'P': {'precision': 0.4166666666666667, 'recall': 0.5, 'f1-score': 0.45454545454545453, 'support': 20}, 'micro avg': {'precision': 0.5111111111111111, 'recall': 0.5, 'f1-score': 0.5054945054945055, 'support': 46}, 'macro avg': {'precision': 0.5178571428571429, 'recall': 0.5, 'f1-score': 0.5038684719535783, 'support': 46}, 'weighted avg': {'precision': 0.5310559006211181, 'recall': 0.5, 'f1-score': 0.5103019090068118, 'support': 46}}
Token level accuracy: 0.8775510204081632
Wrong BIO-Encoding 1/45 labels, 2.22%
Dev-Data: Prec: 0.523, Rec: 0.500, F1: 0.5111



{'C': {'precision': 0.16176470588235295, 'recall': 0.0962800875273523, 'f1-score': 0.12071330589849108, 'support': 914}, 'P': {'precision': 0.15157612340710933, 'recall': 0.21606118546845124, 'f1-score': 0.1781631848640126, 'support': 1046}, 'micro avg': {'precision': 0.1542997542997543, 'recall': 0.16020408163265307, 'f1-score': 0.1571964956195244, 'support': 1960}, 'macro avg': {'precision': 0.15667041464473114, 'recall': 0.15617063649790178, 'f1-score': 0.14943824538125183, 'support': 1960}, 'weighted avg': {'precision': 0.15632732972464639, 'recall': 0.16020408163265307, 'f1-score': 0.15137278212192756, 'support': 1960}}
Token level accuracy: 0.5294690380371284
Wrong BIO-Encoding 1909/3808 labels, 50.13%



{'C': {'precision': 0.16176470588235295, 'recall': 0.0962800875273523, 'f1-score': 0.12071330589849108, 'support': 914}, 'P': {'precision': 0.15157612340710933, 'recall': 0.21606118546845124, 'f1-score': 0.1781631848640126, 'support': 1046}, 'micro avg': {'precision': 0.1542997542997543, 'recall': 0.16020408163265307, 'f1-score': 0.1571964956195244, 'support': 1960}, 'macro avg': {'precision': 0.15667041464473114, 'recall': 0.15617063649790178, 'f1-score': 0.14943824538125183, 'support': 1960}, 'weighted avg': {'precision': 0.15632732972464639, 'recall': 0.16020408163265307, 'f1-score': 0.15137278212192756, 'support': 1960}}
Token level accuracy: 0.5294690380371284
Wrong BIO-Encoding 136/2035 labels, 6.68%
Test-Data: Prec: 0.165, Rec: 0.160, F1: 0.1622

Scores from epoch with best dev-scores:
  Dev-Score: 0.5111
  Test-Score 0.1622

11.80 sec for evaluation

--------- Epoch 31 -----------
200.69 sec for training (6097.66 total)
-- cmv_modes1 --



{'C': {'precision': 0.5357142857142857, 'recall': 0.5769230769230769, 'f1-score': 0.5555555555555555, 'support': 26}, 'P': {'precision': 0.47058823529411764, 'recall': 0.4, 'f1-score': 0.4324324324324324, 'support': 20}, 'micro avg': {'precision': 0.5111111111111111, 'recall': 0.5, 'f1-score': 0.5054945054945055, 'support': 46}, 'macro avg': {'precision': 0.5031512605042017, 'recall': 0.48846153846153845, 'f1-score': 0.4939939939939939, 'support': 46}, 'weighted avg': {'precision': 0.5073986116185605, 'recall': 0.5, 'f1-score': 0.5020237628933281, 'support': 46}}
Token level accuracy: 0.8854003139717426
Wrong BIO-Encoding 19/63 labels, 30.16%



{'C': {'precision': 0.5357142857142857, 'recall': 0.5769230769230769, 'f1-score': 0.5555555555555555, 'support': 26}, 'P': {'precision': 0.47058823529411764, 'recall': 0.4, 'f1-score': 0.4324324324324324, 'support': 20}, 'micro avg': {'precision': 0.5111111111111111, 'recall': 0.5, 'f1-score': 0.5054945054945055, 'support': 46}, 'macro avg': {'precision': 0.5031512605042017, 'recall': 0.48846153846153845, 'f1-score': 0.4939939939939939, 'support': 46}, 'weighted avg': {'precision': 0.5073986116185605, 'recall': 0.5, 'f1-score': 0.5020237628933281, 'support': 46}}
Token level accuracy: 0.8854003139717426
Wrong BIO-Encoding 1/45 labels, 2.22%
Dev-Data: Prec: 0.523, Rec: 0.500, F1: 0.5111



{'C': {'precision': 0.15148063781321183, 'recall': 0.14551422319474835, 'f1-score': 0.1484375, 'support': 914}, 'P': {'precision': 0.17186108637577915, 'recall': 0.18451242829827916, 'f1-score': 0.1779621945597049, 'support': 1046}, 'micro avg': {'precision': 0.1629185407296352, 'recall': 0.1663265306122449, 'f1-score': 0.16460489775309267, 'support': 1960}, 'macro avg': {'precision': 0.1616708620944955, 'recall': 0.16501332574651376, 'f1-score': 0.16319984727985246, 'support': 1960}, 'weighted avg': {'precision': 0.16235714250527583, 'recall': 0.1663265306122449, 'f1-score': 0.16419404617829148, 'support': 1960}}
Token level accuracy: 0.5232809727811675
Wrong BIO-Encoding 2849/4654 labels, 61.22%



{'C': {'precision': 0.15148063781321183, 'recall': 0.14551422319474835, 'f1-score': 0.1484375, 'support': 914}, 'P': {'precision': 0.17186108637577915, 'recall': 0.18451242829827916, 'f1-score': 0.1779621945597049, 'support': 1046}, 'micro avg': {'precision': 0.1629185407296352, 'recall': 0.1663265306122449, 'f1-score': 0.16460489775309267, 'support': 1960}, 'macro avg': {'precision': 0.1616708620944955, 'recall': 0.16501332574651376, 'f1-score': 0.16319984727985246, 'support': 1960}, 'weighted avg': {'precision': 0.16235714250527583, 'recall': 0.1663265306122449, 'f1-score': 0.16419404617829148, 'support': 1960}}
Token level accuracy: 0.5232809727811675
Wrong BIO-Encoding 196/2001 labels, 9.80%
Test-Data: Prec: 0.180, Rec: 0.165, F1: 0.1721

Scores from epoch with best dev-scores:
  Dev-Score: 0.5111
  Test-Score 0.1622

11.60 sec for evaluation

--------- Epoch 32 -----------
197.90 sec for training (6295.56 total)
-- cmv_modes1 --



{'C': {'precision': 0.56, 'recall': 0.5384615384615384, 'f1-score': 0.5490196078431373, 'support': 26}, 'P': {'precision': 0.4090909090909091, 'recall': 0.45, 'f1-score': 0.4285714285714286, 'support': 20}, 'micro avg': {'precision': 0.48936170212765956, 'recall': 0.5, 'f1-score': 0.4946236559139785, 'support': 46}, 'macro avg': {'precision': 0.4845454545454546, 'recall': 0.49423076923076925, 'f1-score': 0.48879551820728295, 'support': 46}, 'weighted avg': {'precision': 0.4943873517786561, 'recall': 0.5, 'f1-score': 0.4966508342467423, 'support': 46}}
Token level accuracy: 0.8877551020408163
Wrong BIO-Encoding 12/58 labels, 20.69%



{'C': {'precision': 0.56, 'recall': 0.5384615384615384, 'f1-score': 0.5490196078431373, 'support': 26}, 'P': {'precision': 0.4090909090909091, 'recall': 0.45, 'f1-score': 0.4285714285714286, 'support': 20}, 'micro avg': {'precision': 0.48936170212765956, 'recall': 0.5, 'f1-score': 0.4946236559139785, 'support': 46}, 'macro avg': {'precision': 0.4845454545454546, 'recall': 0.49423076923076925, 'f1-score': 0.48879551820728295, 'support': 46}, 'weighted avg': {'precision': 0.4943873517786561, 'recall': 0.5, 'f1-score': 0.4966508342467423, 'support': 46}}
Token level accuracy: 0.8877551020408163
Wrong BIO-Encoding 1/47 labels, 2.13%
Dev-Data: Prec: 0.500, Rec: 0.500, F1: 0.5000



{'C': {'precision': 0.17846153846153845, 'recall': 0.12691466083150985, 'f1-score': 0.14833759590792842, 'support': 914}, 'P': {'precision': 0.14582023884349465, 'recall': 0.22179732313575526, 'f1-score': 0.17595752749336366, 'support': 1046}, 'micro avg': {'precision': 0.15528781793842034, 'recall': 0.17755102040816326, 'f1-score': 0.16567483932397048, 'support': 1960}, 'macro avg': {'precision': 0.16214088865251655, 'recall': 0.17435599198363255, 'f1-score': 0.16214756170064604, 'support': 1960}, 'weighted avg': {'precision': 0.16104174284905182, 'recall': 0.17755102040816326, 'f1-score': 0.1630776206213801, 'support': 1960}}
Token level accuracy: 0.542515902894976
Wrong BIO-Encoding 1439/3567 labels, 40.34%



{'C': {'precision': 0.17846153846153845, 'recall': 0.12691466083150985, 'f1-score': 0.14833759590792842, 'support': 914}, 'P': {'precision': 0.14582023884349465, 'recall': 0.22179732313575526, 'f1-score': 0.17595752749336366, 'support': 1046}, 'micro avg': {'precision': 0.15528781793842034, 'recall': 0.17755102040816326, 'f1-score': 0.16567483932397048, 'support': 1960}, 'macro avg': {'precision': 0.16214088865251655, 'recall': 0.17435599198363255, 'f1-score': 0.16214756170064604, 'support': 1960}, 'weighted avg': {'precision': 0.16104174284905182, 'recall': 0.17755102040816326, 'f1-score': 0.1630776206213801, 'support': 1960}}
Token level accuracy: 0.542515902894976
Wrong BIO-Encoding 113/2241 labels, 5.04%
Test-Data: Prec: 0.163, Rec: 0.177, F1: 0.1693

Scores from epoch with best dev-scores:
  Dev-Score: 0.5111
  Test-Score 0.1622

10.57 sec for evaluation

--------- Epoch 33 -----------
191.32 sec for training (6486.89 total)
-- cmv_modes1 --



{'C': {'precision': 0.48, 'recall': 0.46153846153846156, 'f1-score': 0.47058823529411764, 'support': 26}, 'P': {'precision': 0.4, 'recall': 0.4, 'f1-score': 0.4000000000000001, 'support': 20}, 'micro avg': {'precision': 0.4444444444444444, 'recall': 0.43478260869565216, 'f1-score': 0.4395604395604396, 'support': 46}, 'macro avg': {'precision': 0.44, 'recall': 0.4307692307692308, 'f1-score': 0.43529411764705883, 'support': 46}, 'weighted avg': {'precision': 0.44521739130434784, 'recall': 0.43478260869565216, 'f1-score': 0.43989769820971864, 'support': 46}}
Token level accuracy: 0.9042386185243328
Wrong BIO-Encoding 20/64 labels, 31.25%



{'C': {'precision': 0.48, 'recall': 0.46153846153846156, 'f1-score': 0.47058823529411764, 'support': 26}, 'P': {'precision': 0.4, 'recall': 0.4, 'f1-score': 0.4000000000000001, 'support': 20}, 'micro avg': {'precision': 0.4444444444444444, 'recall': 0.43478260869565216, 'f1-score': 0.4395604395604396, 'support': 46}, 'macro avg': {'precision': 0.44, 'recall': 0.4307692307692308, 'f1-score': 0.43529411764705883, 'support': 46}, 'weighted avg': {'precision': 0.44521739130434784, 'recall': 0.43478260869565216, 'f1-score': 0.43989769820971864, 'support': 46}}
Token level accuracy: 0.9042386185243328
Wrong BIO-Encoding 1/45 labels, 2.22%
Dev-Data: Prec: 0.455, Rec: 0.435, F1: 0.4444



{'C': {'precision': 0.17433414043583534, 'recall': 0.1575492341356674, 'f1-score': 0.16551724137931034, 'support': 914}, 'P': {'precision': 0.1978021978021978, 'recall': 0.24091778202676864, 'f1-score': 0.21724137931034482, 'support': 1046}, 'micro avg': {'precision': 0.18857142857142858, 'recall': 0.20204081632653062, 'f1-score': 0.19507389162561575, 'support': 1960}, 'macro avg': {'precision': 0.18606816911901658, 'recall': 0.19923350808121804, 'f1-score': 0.19137931034482758, 'support': 1960}, 'weighted avg': {'precision': 0.18685842003033287, 'recall': 0.20204081632653062, 'f1-score': 0.1931210415200563, 'support': 1960}}
Token level accuracy: 0.5358518326193258
Wrong BIO-Encoding 2393/4317 labels, 55.43%



{'C': {'precision': 0.17433414043583534, 'recall': 0.1575492341356674, 'f1-score': 0.16551724137931034, 'support': 914}, 'P': {'precision': 0.1978021978021978, 'recall': 0.24091778202676864, 'f1-score': 0.21724137931034482, 'support': 1046}, 'micro avg': {'precision': 0.18857142857142858, 'recall': 0.20204081632653062, 'f1-score': 0.19507389162561575, 'support': 1960}, 'macro avg': {'precision': 0.18606816911901658, 'recall': 0.19923350808121804, 'f1-score': 0.19137931034482758, 'support': 1960}, 'weighted avg': {'precision': 0.18685842003033287, 'recall': 0.20204081632653062, 'f1-score': 0.1931210415200563, 'support': 1960}}
Token level accuracy: 0.5358518326193258
Wrong BIO-Encoding 176/2100 labels, 8.38%
Test-Data: Prec: 0.204, Rec: 0.201, F1: 0.2024

Scores from epoch with best dev-scores:
  Dev-Score: 0.5111
  Test-Score 0.1622

10.57 sec for evaluation

--------- Epoch 34 -----------
196.27 sec for training (6683.16 total)
-- cmv_modes1 --



{'C': {'precision': 0.52, 'recall': 0.5, 'f1-score': 0.5098039215686274, 'support': 26}, 'P': {'precision': 0.6190476190476191, 'recall': 0.65, 'f1-score': 0.6341463414634146, 'support': 20}, 'micro avg': {'precision': 0.5652173913043478, 'recall': 0.5652173913043478, 'f1-score': 0.5652173913043478, 'support': 46}, 'macro avg': {'precision': 0.5695238095238095, 'recall': 0.575, 'f1-score': 0.5719751315160211, 'support': 46}, 'weighted avg': {'precision': 0.5630641821946171, 'recall': 0.5652173913043478, 'f1-score': 0.5638658432620132, 'support': 46}}
Token level accuracy: 0.9160125588697017



{'C': {'precision': 0.52, 'recall': 0.5, 'f1-score': 0.5098039215686274, 'support': 26}, 'P': {'precision': 0.6190476190476191, 'recall': 0.65, 'f1-score': 0.6341463414634146, 'support': 20}, 'micro avg': {'precision': 0.5652173913043478, 'recall': 0.5652173913043478, 'f1-score': 0.5652173913043478, 'support': 46}, 'macro avg': {'precision': 0.5695238095238095, 'recall': 0.575, 'f1-score': 0.5719751315160211, 'support': 46}, 'weighted avg': {'precision': 0.5630641821946171, 'recall': 0.5652173913043478, 'f1-score': 0.5638658432620132, 'support': 46}}
Token level accuracy: 0.9160125588697017
Dev-Data: Prec: 0.565, Rec: 0.565, F1: 0.5652



{'C': {'precision': 0.15480225988700566, 'recall': 0.14989059080962802, 'f1-score': 0.15230683713173987, 'support': 914}, 'P': {'precision': 0.16143497757847533, 'recall': 0.20650095602294455, 'f1-score': 0.18120805369127518, 'support': 1046}, 'micro avg': {'precision': 0.1587944219523167, 'recall': 0.18010204081632653, 'f1-score': 0.16877838871623238, 'support': 1960}, 'macro avg': {'precision': 0.1581186187327405, 'recall': 0.17819577341628628, 'f1-score': 0.16675744541150753, 'support': 1960}, 'weighted avg': {'precision': 0.1583419653488818, 'recall': 0.18010204081632653, 'f1-score': 0.16773064964259393, 'support': 1960}}
Token level accuracy: 0.5205763988056601
Wrong BIO-Encoding 2000/4060 labels, 49.26%



{'C': {'precision': 0.15480225988700566, 'recall': 0.14989059080962802, 'f1-score': 0.15230683713173987, 'support': 914}, 'P': {'precision': 0.16143497757847533, 'recall': 0.20650095602294455, 'f1-score': 0.18120805369127518, 'support': 1046}, 'micro avg': {'precision': 0.1587944219523167, 'recall': 0.18010204081632653, 'f1-score': 0.16877838871623238, 'support': 1960}, 'macro avg': {'precision': 0.1581186187327405, 'recall': 0.17819577341628628, 'f1-score': 0.16675744541150753, 'support': 1960}, 'weighted avg': {'precision': 0.1583419653488818, 'recall': 0.18010204081632653, 'f1-score': 0.16773064964259393, 'support': 1960}}
Token level accuracy: 0.5205763988056601
Wrong BIO-Encoding 163/2223 labels, 7.33%
Test-Data: Prec: 0.171, Rec: 0.180, F1: 0.1751

Scores from epoch with best dev-scores:
  Dev-Score: 0.5652
  Test-Score 0.1751

11.87 sec for evaluation

--------- Epoch 35 -----------
200.24 sec for training (6883.40 total)
-- cmv_modes1 --



{'C': {'precision': 0.5, 'recall': 0.4230769230769231, 'f1-score': 0.4583333333333333, 'support': 26}, 'P': {'precision': 0.6, 'recall': 0.75, 'f1-score': 0.6666666666666665, 'support': 20}, 'micro avg': {'precision': 0.5531914893617021, 'recall': 0.5652173913043478, 'f1-score': 0.5591397849462365, 'support': 46}, 'macro avg': {'precision': 0.55, 'recall': 0.5865384615384616, 'f1-score': 0.5624999999999999, 'support': 46}, 'weighted avg': {'precision': 0.5434782608695652, 'recall': 0.5652173913043478, 'f1-score': 0.5489130434782608, 'support': 46}}
Token level accuracy: 0.869701726844584
Wrong BIO-Encoding 24/70 labels, 34.29%



{'C': {'precision': 0.5, 'recall': 0.4230769230769231, 'f1-score': 0.4583333333333333, 'support': 26}, 'P': {'precision': 0.6, 'recall': 0.75, 'f1-score': 0.6666666666666665, 'support': 20}, 'micro avg': {'precision': 0.5531914893617021, 'recall': 0.5652173913043478, 'f1-score': 0.5591397849462365, 'support': 46}, 'macro avg': {'precision': 0.55, 'recall': 0.5865384615384616, 'f1-score': 0.5624999999999999, 'support': 46}, 'weighted avg': {'precision': 0.5434782608695652, 'recall': 0.5652173913043478, 'f1-score': 0.5489130434782608, 'support': 46}}
Token level accuracy: 0.869701726844584
Wrong BIO-Encoding 1/47 labels, 2.13%
Dev-Data: Prec: 0.565, Rec: 0.565, F1: 0.5652



{'C': {'precision': 0.16488222698072805, 'recall': 0.16849015317286653, 'f1-score': 0.16666666666666666, 'support': 914}, 'P': {'precision': 0.15144927536231884, 'recall': 0.19980879541108987, 'f1-score': 0.17230008244023082, 'support': 1046}, 'micro avg': {'precision': 0.15687121866897147, 'recall': 0.18520408163265306, 'f1-score': 0.16986429574169395, 'support': 1960}, 'macro avg': {'precision': 0.15816575117152343, 'recall': 0.1841494742919782, 'f1-score': 0.16948337455344875, 'support': 1960}, 'weighted avg': {'precision': 0.15771341708641376, 'recall': 0.18520408163265306, 'f1-score': 0.16967307120704833, 'support': 1960}}
Token level accuracy: 0.5314812410749059
Wrong BIO-Encoding 1876/4043 labels, 46.40%



{'C': {'precision': 0.16488222698072805, 'recall': 0.16849015317286653, 'f1-score': 0.16666666666666666, 'support': 914}, 'P': {'precision': 0.15144927536231884, 'recall': 0.19980879541108987, 'f1-score': 0.17230008244023082, 'support': 1046}, 'micro avg': {'precision': 0.15687121866897147, 'recall': 0.18520408163265306, 'f1-score': 0.16986429574169395, 'support': 1960}, 'macro avg': {'precision': 0.15816575117152343, 'recall': 0.1841494742919782, 'f1-score': 0.16948337455344875, 'support': 1960}, 'weighted avg': {'precision': 0.15771341708641376, 'recall': 0.18520408163265306, 'f1-score': 0.16967307120704833, 'support': 1960}}
Token level accuracy: 0.5314812410749059
Wrong BIO-Encoding 147/2314 labels, 6.35%
Test-Data: Prec: 0.167, Rec: 0.184, F1: 0.1749

Scores from epoch with best dev-scores:
  Dev-Score: 0.5652
  Test-Score 0.1751

11.76 sec for evaluation

--------- Epoch 36 -----------
200.11 sec for training (7083.50 total)
-- cmv_modes1 --



{'C': {'precision': 0.5652173913043478, 'recall': 0.5, 'f1-score': 0.5306122448979592, 'support': 26}, 'P': {'precision': 0.6470588235294118, 'recall': 0.55, 'f1-score': 0.5945945945945946, 'support': 20}, 'micro avg': {'precision': 0.6, 'recall': 0.5217391304347826, 'f1-score': 0.5581395348837209, 'support': 46}, 'macro avg': {'precision': 0.6061381074168798, 'recall': 0.525, 'f1-score': 0.5626034197462769, 'support': 46}, 'weighted avg': {'precision': 0.6008006227065495, 'recall': 0.5217391304347826, 'f1-score': 0.5584306578095398, 'support': 46}}
Token level accuracy: 0.8610675039246468



{'C': {'precision': 0.5652173913043478, 'recall': 0.5, 'f1-score': 0.5306122448979592, 'support': 26}, 'P': {'precision': 0.6470588235294118, 'recall': 0.55, 'f1-score': 0.5945945945945946, 'support': 20}, 'micro avg': {'precision': 0.6, 'recall': 0.5217391304347826, 'f1-score': 0.5581395348837209, 'support': 46}, 'macro avg': {'precision': 0.6061381074168798, 'recall': 0.525, 'f1-score': 0.5626034197462769, 'support': 46}, 'weighted avg': {'precision': 0.6008006227065495, 'recall': 0.5217391304347826, 'f1-score': 0.5584306578095398, 'support': 46}}
Token level accuracy: 0.8610675039246468
Dev-Data: Prec: 0.600, Rec: 0.522, F1: 0.5581



{'C': {'precision': 0.15625, 'recall': 0.11487964989059081, 'f1-score': 0.13240857503152587, 'support': 914}, 'P': {'precision': 0.12837285363859363, 'recall': 0.15009560229445507, 'f1-score': 0.13838695460555311, 'support': 1046}, 'micro avg': {'precision': 0.13825857519788917, 'recall': 0.1336734693877551, 'f1-score': 0.13592736705577171, 'support': 1960}, 'macro avg': {'precision': 0.14231142681929682, 'recall': 0.13248762609252293, 'f1-score': 0.1353977648185395, 'support': 1960}, 'weighted avg': {'precision': 0.14137270658467804, 'recall': 0.1336734693877551, 'f1-score': 0.1355990776001139, 'support': 1960}}
Token level accuracy: 0.517958371197369
Wrong BIO-Encoding 1627/3392 labels, 47.97%



{'C': {'precision': 0.15625, 'recall': 0.11487964989059081, 'f1-score': 0.13240857503152587, 'support': 914}, 'P': {'precision': 0.12837285363859363, 'recall': 0.15009560229445507, 'f1-score': 0.13838695460555311, 'support': 1046}, 'micro avg': {'precision': 0.13825857519788917, 'recall': 0.1336734693877551, 'f1-score': 0.13592736705577171, 'support': 1960}, 'macro avg': {'precision': 0.14231142681929682, 'recall': 0.13248762609252293, 'f1-score': 0.1353977648185395, 'support': 1960}, 'weighted avg': {'precision': 0.14137270658467804, 'recall': 0.1336734693877551, 'f1-score': 0.1355990776001139, 'support': 1960}}
Token level accuracy: 0.517958371197369
Wrong BIO-Encoding 130/1895 labels, 6.86%
Test-Data: Prec: 0.148, Rec: 0.133, F1: 0.1401

Scores from epoch with best dev-scores:
  Dev-Score: 0.5652
  Test-Score 0.1751

11.51 sec for evaluation

--------- Epoch 37 -----------
198.28 sec for training (7281.78 total)
-- cmv_modes1 --



{'C': {'precision': 0.4230769230769231, 'recall': 0.4230769230769231, 'f1-score': 0.4230769230769231, 'support': 26}, 'P': {'precision': 0.45454545454545453, 'recall': 0.5, 'f1-score': 0.47619047619047616, 'support': 20}, 'micro avg': {'precision': 0.4375, 'recall': 0.45652173913043476, 'f1-score': 0.44680851063829785, 'support': 46}, 'macro avg': {'precision': 0.4388111888111888, 'recall': 0.46153846153846156, 'f1-score': 0.4496336996336996, 'support': 46}, 'weighted avg': {'precision': 0.4367588932806324, 'recall': 0.45652173913043476, 'f1-score': 0.4461697722567288, 'support': 46}}
Token level accuracy: 0.9105180533751962



{'C': {'precision': 0.4230769230769231, 'recall': 0.4230769230769231, 'f1-score': 0.4230769230769231, 'support': 26}, 'P': {'precision': 0.45454545454545453, 'recall': 0.5, 'f1-score': 0.47619047619047616, 'support': 20}, 'micro avg': {'precision': 0.4375, 'recall': 0.45652173913043476, 'f1-score': 0.44680851063829785, 'support': 46}, 'macro avg': {'precision': 0.4388111888111888, 'recall': 0.46153846153846156, 'f1-score': 0.4496336996336996, 'support': 46}, 'weighted avg': {'precision': 0.4367588932806324, 'recall': 0.45652173913043476, 'f1-score': 0.4461697722567288, 'support': 46}}
Token level accuracy: 0.9105180533751962
Dev-Data: Prec: 0.438, Rec: 0.457, F1: 0.4468



{'C': {'precision': 0.1638477801268499, 'recall': 0.16958424507658643, 'f1-score': 0.16666666666666669, 'support': 914}, 'P': {'precision': 0.16643741403026135, 'recall': 0.23135755258126195, 'f1-score': 0.19360000000000002, 'support': 1046}, 'micro avg': {'precision': 0.16541666666666666, 'recall': 0.20255102040816325, 'f1-score': 0.18211009174311926, 'support': 1960}, 'macro avg': {'precision': 0.1651425970785556, 'recall': 0.2004708988289242, 'f1-score': 0.18013333333333337, 'support': 1960}, 'weighted avg': {'precision': 0.16522979903652762, 'recall': 0.20255102040816325, 'f1-score': 0.18104027210884355, 'support': 1960}}
Token level accuracy: 0.5292310355272838
Wrong BIO-Encoding 1342/3642 labels, 36.85%



{'C': {'precision': 0.1638477801268499, 'recall': 0.16958424507658643, 'f1-score': 0.16666666666666669, 'support': 914}, 'P': {'precision': 0.16643741403026135, 'recall': 0.23135755258126195, 'f1-score': 0.19360000000000002, 'support': 1046}, 'micro avg': {'precision': 0.16541666666666666, 'recall': 0.20255102040816325, 'f1-score': 0.18211009174311926, 'support': 1960}, 'macro avg': {'precision': 0.1651425970785556, 'recall': 0.2004708988289242, 'f1-score': 0.18013333333333337, 'support': 1960}, 'weighted avg': {'precision': 0.16522979903652762, 'recall': 0.20255102040816325, 'f1-score': 0.18104027210884355, 'support': 1960}}
Token level accuracy: 0.5292310355272838
Wrong BIO-Encoding 100/2400 labels, 4.17%
Test-Data: Prec: 0.172, Rec: 0.202, F1: 0.1859

Scores from epoch with best dev-scores:
  Dev-Score: 0.5652
  Test-Score 0.1751

10.79 sec for evaluation

--------- Epoch 38 -----------
191.49 sec for training (7473.27 total)
-- cmv_modes1 --



{'C': {'precision': 0.4, 'recall': 0.38461538461538464, 'f1-score': 0.39215686274509803, 'support': 26}, 'P': {'precision': 0.3333333333333333, 'recall': 0.35, 'f1-score': 0.3414634146341463, 'support': 20}, 'micro avg': {'precision': 0.3695652173913043, 'recall': 0.3695652173913043, 'f1-score': 0.36956521739130427, 'support': 46}, 'macro avg': {'precision': 0.3666666666666667, 'recall': 0.36730769230769234, 'f1-score': 0.3668101386896222, 'support': 46}, 'weighted avg': {'precision': 0.3710144927536232, 'recall': 0.3695652173913043, 'f1-score': 0.3701162331316407, 'support': 46}}
Token level accuracy: 0.9058084772370487



{'C': {'precision': 0.4, 'recall': 0.38461538461538464, 'f1-score': 0.39215686274509803, 'support': 26}, 'P': {'precision': 0.3333333333333333, 'recall': 0.35, 'f1-score': 0.3414634146341463, 'support': 20}, 'micro avg': {'precision': 0.3695652173913043, 'recall': 0.3695652173913043, 'f1-score': 0.36956521739130427, 'support': 46}, 'macro avg': {'precision': 0.3666666666666667, 'recall': 0.36730769230769234, 'f1-score': 0.3668101386896222, 'support': 46}, 'weighted avg': {'precision': 0.3710144927536232, 'recall': 0.3695652173913043, 'f1-score': 0.3701162331316407, 'support': 46}}
Token level accuracy: 0.9058084772370487
Dev-Data: Prec: 0.370, Rec: 0.370, F1: 0.3696



{'C': {'precision': 0.16477272727272727, 'recall': 0.1586433260393873, 'f1-score': 0.1616499442586399, 'support': 914}, 'P': {'precision': 0.19700551615445233, 'recall': 0.2390057361376673, 'f1-score': 0.21598272138228944, 'support': 1046}, 'micro avg': {'precision': 0.18380642159143787, 'recall': 0.20153061224489796, 'f1-score': 0.19226089072767094, 'support': 1960}, 'macro avg': {'precision': 0.18088912171358978, 'recall': 0.1988245310885273, 'f1-score': 0.18881633282046467, 'support': 1960}, 'weighted avg': {'precision': 0.18197451154328054, 'recall': 0.20153061224489796, 'f1-score': 0.19064590592768962, 'support': 1960}}
Token level accuracy: 0.5302912285256827
Wrong BIO-Encoding 1619/3646 labels, 44.40%



{'C': {'precision': 0.16477272727272727, 'recall': 0.1586433260393873, 'f1-score': 0.1616499442586399, 'support': 914}, 'P': {'precision': 0.19700551615445233, 'recall': 0.2390057361376673, 'f1-score': 0.21598272138228944, 'support': 1046}, 'micro avg': {'precision': 0.18380642159143787, 'recall': 0.20153061224489796, 'f1-score': 0.19226089072767094, 'support': 1960}, 'macro avg': {'precision': 0.18088912171358978, 'recall': 0.1988245310885273, 'f1-score': 0.18881633282046467, 'support': 1960}, 'weighted avg': {'precision': 0.18197451154328054, 'recall': 0.20153061224489796, 'f1-score': 0.19064590592768962, 'support': 1960}}
Token level accuracy: 0.5302912285256827
Wrong BIO-Encoding 122/2149 labels, 5.68%
Test-Data: Prec: 0.195, Rec: 0.202, F1: 0.1981

Scores from epoch with best dev-scores:
  Dev-Score: 0.5652
  Test-Score 0.1751

10.55 sec for evaluation

--------- Epoch 39 -----------
197.17 sec for training (7670.44 total)
-- cmv_modes1 --



{'C': {'precision': 0.5909090909090909, 'recall': 0.5, 'f1-score': 0.5416666666666667, 'support': 26}, 'P': {'precision': 0.42857142857142855, 'recall': 0.45, 'f1-score': 0.4390243902439024, 'support': 20}, 'micro avg': {'precision': 0.5116279069767442, 'recall': 0.4782608695652174, 'f1-score': 0.49438202247191015, 'support': 46}, 'macro avg': {'precision': 0.5097402597402597, 'recall': 0.475, 'f1-score': 0.49034552845528456, 'support': 46}, 'weighted avg': {'precision': 0.5203274985883681, 'recall': 0.4782608695652174, 'f1-score': 0.4970395899611171, 'support': 46}}
Token level accuracy: 0.9230769230769231
Wrong BIO-Encoding 10/52 labels, 19.23%



{'C': {'precision': 0.5909090909090909, 'recall': 0.5, 'f1-score': 0.5416666666666667, 'support': 26}, 'P': {'precision': 0.42857142857142855, 'recall': 0.45, 'f1-score': 0.4390243902439024, 'support': 20}, 'micro avg': {'precision': 0.5116279069767442, 'recall': 0.4782608695652174, 'f1-score': 0.49438202247191015, 'support': 46}, 'macro avg': {'precision': 0.5097402597402597, 'recall': 0.475, 'f1-score': 0.49034552845528456, 'support': 46}, 'weighted avg': {'precision': 0.5203274985883681, 'recall': 0.4782608695652174, 'f1-score': 0.4970395899611171, 'support': 46}}
Token level accuracy: 0.9230769230769231
Wrong BIO-Encoding 1/43 labels, 2.33%
Dev-Data: Prec: 0.524, Rec: 0.478, F1: 0.5000



{'C': {'precision': 0.18277945619335348, 'recall': 0.1323851203501094, 'f1-score': 0.1535532994923858, 'support': 914}, 'P': {'precision': 0.18274111675126903, 'recall': 0.24091778202676864, 'f1-score': 0.20783505154639176, 'support': 1046}, 'micro avg': {'precision': 0.18275355218030379, 'recall': 0.1903061224489796, 'f1-score': 0.1864533866533367, 'support': 1960}, 'macro avg': {'precision': 0.18276028647231124, 'recall': 0.186651451188439, 'f1-score': 0.18069417551938877, 'support': 1960}, 'weighted avg': {'precision': 0.18275899545028185, 'recall': 0.1903061224489796, 'f1-score': 0.18252203043549303, 'support': 1960}}
Token level accuracy: 0.5338612661733524
Wrong BIO-Encoding 2678/4536 labels, 59.04%



{'C': {'precision': 0.18277945619335348, 'recall': 0.1323851203501094, 'f1-score': 0.1535532994923858, 'support': 914}, 'P': {'precision': 0.18274111675126903, 'recall': 0.24091778202676864, 'f1-score': 0.20783505154639176, 'support': 1046}, 'micro avg': {'precision': 0.18275355218030379, 'recall': 0.1903061224489796, 'f1-score': 0.1864533866533367, 'support': 1960}, 'macro avg': {'precision': 0.18276028647231124, 'recall': 0.186651451188439, 'f1-score': 0.18069417551938877, 'support': 1960}, 'weighted avg': {'precision': 0.18275899545028185, 'recall': 0.1903061224489796, 'f1-score': 0.18252203043549303, 'support': 1960}}
Token level accuracy: 0.5338612661733524
Wrong BIO-Encoding 183/2041 labels, 8.97%
Test-Data: Prec: 0.200, Rec: 0.189, F1: 0.1943

Scores from epoch with best dev-scores:
  Dev-Score: 0.5652
  Test-Score 0.1751

11.91 sec for evaluation

--------- Epoch 40 -----------
200.82 sec for training (7871.26 total)
-- cmv_modes1 --



{'C': {'precision': 0.6538461538461539, 'recall': 0.6538461538461539, 'f1-score': 0.6538461538461539, 'support': 26}, 'P': {'precision': 0.5652173913043478, 'recall': 0.65, 'f1-score': 0.6046511627906976, 'support': 20}, 'micro avg': {'precision': 0.6122448979591837, 'recall': 0.6521739130434783, 'f1-score': 0.631578947368421, 'support': 46}, 'macro avg': {'precision': 0.6095317725752508, 'recall': 0.6519230769230769, 'f1-score': 0.6292486583184258, 'support': 46}, 'weighted avg': {'precision': 0.6153119092627598, 'recall': 0.6521739130434783, 'f1-score': 0.6324570273003033, 'support': 46}}
Token level accuracy: 0.9513343799058085
Wrong BIO-Encoding 7/55 labels, 12.73%



{'C': {'precision': 0.6538461538461539, 'recall': 0.6538461538461539, 'f1-score': 0.6538461538461539, 'support': 26}, 'P': {'precision': 0.5652173913043478, 'recall': 0.65, 'f1-score': 0.6046511627906976, 'support': 20}, 'micro avg': {'precision': 0.6122448979591837, 'recall': 0.6521739130434783, 'f1-score': 0.631578947368421, 'support': 46}, 'macro avg': {'precision': 0.6095317725752508, 'recall': 0.6519230769230769, 'f1-score': 0.6292486583184258, 'support': 46}, 'weighted avg': {'precision': 0.6153119092627598, 'recall': 0.6521739130434783, 'f1-score': 0.6324570273003033, 'support': 46}}
Token level accuracy: 0.9513343799058085
Wrong BIO-Encoding 1/49 labels, 2.04%
Dev-Data: Prec: 0.625, Rec: 0.652, F1: 0.6383



{'C': {'precision': 0.14614614614614616, 'recall': 0.15973741794310722, 'f1-score': 0.152639832723471, 'support': 914}, 'P': {'precision': 0.17102315160567588, 'recall': 0.21892925430210325, 'f1-score': 0.19203354297693923, 'support': 1046}, 'micro avg': {'precision': 0.16039349871685202, 'recall': 0.1913265306122449, 'f1-score': 0.17449976733364356, 'support': 1960}, 'macro avg': {'precision': 0.158584648875911, 'recall': 0.18933333612260522, 'f1-score': 0.17233668785020512, 'support': 1960}, 'weighted avg': {'precision': 0.15942234395771152, 'recall': 0.1913265306122449, 'f1-score': 0.17366321074649535, 'support': 1960}}
Token level accuracy: 0.5238651607598771
Wrong BIO-Encoding 1652/3861 labels, 42.79%



{'C': {'precision': 0.14614614614614616, 'recall': 0.15973741794310722, 'f1-score': 0.152639832723471, 'support': 914}, 'P': {'precision': 0.17102315160567588, 'recall': 0.21892925430210325, 'f1-score': 0.19203354297693923, 'support': 1046}, 'micro avg': {'precision': 0.16039349871685202, 'recall': 0.1913265306122449, 'f1-score': 0.17449976733364356, 'support': 1960}, 'macro avg': {'precision': 0.158584648875911, 'recall': 0.18933333612260522, 'f1-score': 0.17233668785020512, 'support': 1960}, 'weighted avg': {'precision': 0.15942234395771152, 'recall': 0.1913265306122449, 'f1-score': 0.17366321074649535, 'support': 1960}}
Token level accuracy: 0.5238651607598771
Wrong BIO-Encoding 129/2338 labels, 5.52%
Test-Data: Prec: 0.170, Rec: 0.191, F1: 0.1799

Scores from epoch with best dev-scores:
  Dev-Score: 0.6383
  Test-Score 0.1799

11.59 sec for evaluation
Cleaning up...
