[30/09/2020 16:06:19 PM]: INFO - Running command 'run'
[30/09/2020 16:06:19 PM]: INFO - Started run with ID "79"
[30/09/2020 16:06:19 PM]: DEBUG - Starting Heartbeat
[30/09/2020 16:06:19 PM]: DEBUG - Started
[30/09/2020 16:06:19 PM]: INFO - Running experiments with config_name=telicty_tr and with vector_file=/Users/thomas/research/data/fastText/fasttext_wiki-tr-align_dim-300.kvec and evaluation_mode=cross_validation and drop_target=atelic...
[30/09/2020 16:06:20 PM]: INFO - fastText embeddings loaded!
[30/09/2020 16:06:20 PM]: INFO - Preparing data for experiment from /Users/thomas/research/data/verb_telicity/telicity_wikipedia/tr/annotated_500_turkish_wiki_sentences.tsv...
[30/09/2020 16:06:21 PM]: DEBUG - Loading data with data_index=0; target_index=3; skip_header=True; drop_target=atelic
[30/09/2020 16:06:31 PM]: DEBUG - Loaded data with len=443 and len(targets)=443!
[30/09/2020 16:06:31 PM]: INFO - Starting 10-cross validation...
[30/09/2020 16:06:31 PM]: INFO - Encoding labels...
[30/09/2020 16:06:31 PM]: INFO - 2 Labels (['stative' 'telic']) encoded!
[30/09/2020 16:06:31 PM]: INFO - Encoding data...
[30/09/2020 16:06:31 PM]: INFO - Encoded data with shape X.shape=(443, 300) and labels with shape=(443,) and OOVs=2316!
[30/09/2020 16:06:31 PM]: DEBUG - K-Fold split 1/10...
[30/09/2020 16:06:31 PM]: DEBUG - 	Fitting model...
[30/09/2020 16:06:31 PM]: DEBUG - 	Accuracy=0.8
[30/09/2020 16:06:31 PM]: DEBUG - 	---------------------------------------------
[30/09/2020 16:06:31 PM]: DEBUG - K-Fold split 2/10...
[30/09/2020 16:06:31 PM]: DEBUG - 	Fitting model...
[30/09/2020 16:06:31 PM]: DEBUG - 	Accuracy=0.7777777777777778
[30/09/2020 16:06:31 PM]: DEBUG - 	---------------------------------------------
[30/09/2020 16:06:31 PM]: DEBUG - K-Fold split 3/10...
[30/09/2020 16:06:31 PM]: DEBUG - 	Fitting model...
[30/09/2020 16:06:31 PM]: DEBUG - 	Accuracy=0.7111111111111111
[30/09/2020 16:06:31 PM]: DEBUG - 	---------------------------------------------
[30/09/2020 16:06:31 PM]: DEBUG - K-Fold split 4/10...
[30/09/2020 16:06:31 PM]: DEBUG - 	Fitting model...
[30/09/2020 16:06:31 PM]: DEBUG - 	Accuracy=0.75
[30/09/2020 16:06:31 PM]: DEBUG - 	---------------------------------------------
[30/09/2020 16:06:31 PM]: DEBUG - K-Fold split 5/10...
[30/09/2020 16:06:31 PM]: DEBUG - 	Fitting model...
[30/09/2020 16:06:32 PM]: DEBUG - 	Accuracy=0.75
[30/09/2020 16:06:32 PM]: DEBUG - 	---------------------------------------------
[30/09/2020 16:06:32 PM]: DEBUG - K-Fold split 6/10...
[30/09/2020 16:06:32 PM]: DEBUG - 	Fitting model...
[30/09/2020 16:06:32 PM]: DEBUG - 	Accuracy=0.7954545454545454
[30/09/2020 16:06:32 PM]: DEBUG - 	---------------------------------------------
[30/09/2020 16:06:32 PM]: DEBUG - K-Fold split 7/10...
[30/09/2020 16:06:32 PM]: DEBUG - 	Fitting model...
[30/09/2020 16:06:32 PM]: DEBUG - 	Accuracy=0.7954545454545454
[30/09/2020 16:06:32 PM]: DEBUG - 	---------------------------------------------
[30/09/2020 16:06:32 PM]: DEBUG - K-Fold split 8/10...
[30/09/2020 16:06:32 PM]: DEBUG - 	Fitting model...
[30/09/2020 16:06:32 PM]: DEBUG - 	Accuracy=0.6136363636363636
[30/09/2020 16:06:32 PM]: DEBUG - 	---------------------------------------------
[30/09/2020 16:06:32 PM]: DEBUG - K-Fold split 9/10...
[30/09/2020 16:06:32 PM]: DEBUG - 	Fitting model...
[30/09/2020 16:06:32 PM]: DEBUG - 	Accuracy=0.7954545454545454
[30/09/2020 16:06:32 PM]: DEBUG - 	---------------------------------------------
[30/09/2020 16:06:32 PM]: DEBUG - K-Fold split 10/10...
[30/09/2020 16:06:32 PM]: DEBUG - 	Fitting model...
[30/09/2020 16:06:32 PM]: DEBUG - 	Accuracy=0.6363636363636364
[30/09/2020 16:06:32 PM]: DEBUG - 	---------------------------------------------
[30/09/2020 16:06:32 PM]: INFO - Average Accuracy: 0.7425252525252526 +/- 0.06475480189871592; Majority class baseline Accuracy: 0.6320541760722348; Total F1["['stative']"]=0.8054607508532423; Total F1["['telic']"]=0.62
[30/09/2020 16:06:32 PM]: INFO - Running analysis...
[30/09/2020 16:06:32 PM]: INFO - Storing analysis resources at /Users/thomas/research/experiments/verb_telicity/tr/...
[30/09/2020 16:06:32 PM]: INFO - Finished!
[30/09/2020 16:06:32 PM]: DEBUG - Finished after 0:00:13.
[30/09/2020 16:06:32 PM]: INFO - Result: 0.7425252525252526
[30/09/2020 16:06:32 PM]: INFO - Completed after 0:00:13
