Language : DE
Systems : ERMI.closed,Seen2Seen.closed
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 368/582=0.6323 368/824=0.4466 0.5235                
* (comp) MWE-based    : 475/551=0.8621 475/824=0.5765 0.6909                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 300/491=0.6110 300/490=0.6122 0.6116                
* (comp) Continuous   : 320/365=0.8767 320/490=0.6531 0.7485                
p-value=(P=0.0000, R=0.0430, F1=0.0000)
* (pred) Discontinuous: 68/91=0.7473  68/334=0.2036 0.3200                
* (comp) Discontinuous: 155/186=0.8333 155/334=0.4641 0.5962                
p-value=(P=0.0540, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 183/253=0.7233 183/559=0.3274 0.4507                
* (comp) Multi-token  : 284/336=0.8452 284/559=0.5081 0.6346                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 185/329=0.5623 185/265=0.6981 0.6229                
* (comp) Single-token : 191/215=0.8884 191/265=0.7208 0.7958                
p-value=(P=0.0000, R=0.2390, F1=0.0000)
* (pred) Seen-in-train: 297/318=0.9340 297/507=0.5858 0.7200                
* (comp) Seen-in-train: 474/543=0.8729 474/507=0.9349 0.9029                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 71/264=0.2689 71/317=0.2240 0.2444                
* (comp) Unseen-in-train: 1/8=0.1250    1/317=0.0032  0.0062                
p-value=(P=0.0860, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 190/198=0.9596 190/227=0.8370 0.8941                
* (comp) Variant-of-train: 226/245=0.9224 226/227=0.9956 0.9576                
p-value=(P=0.0020, R=0.0000, F1=0.0010)
* (pred) Identical-to-train: 107/120=0.8917 107/280=0.3821 0.5350                
* (comp) Identical-to-train: 248/298=0.8322 248/280=0.8857 0.8581                
p-value=(P=0.0120, R=0.0000, F1=0.0000)



Language : DE
Systems : FipsCo.open,HMSid.open


Language : DE
Systems : FipsCo.open,MTLB-STRUCT.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 274/470=0.5830 274/824=0.3325 0.4235                
* (comp) MWE-based    : 620/804=0.7711 620/824=0.7524 0.7617                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 219/368=0.5951 219/490=0.4469 0.5105                
* (comp) Continuous   : 389/501=0.7764 389/490=0.7939 0.7851                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 55/102=0.5392 55/334=0.1647 0.2523                
* (comp) Discontinuous: 231/303=0.7624 231/334=0.6916 0.7253                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 61/119=0.5126 61/559=0.1091 0.1799                
* (comp) Multi-token  : 392/500=0.7840 392/559=0.7013 0.7403                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 213/351=0.6068 213/265=0.8038 0.6916                
* (comp) Single-token : 228/304=0.7500 228/265=0.8604 0.8014                
p-value=(P=0.0000, R=0.0330, F1=0.0000)
* (pred) Seen-in-train: 198/225=0.8800 198/507=0.3905 0.5410                
* (comp) Seen-in-train: 455/485=0.9381 455/507=0.8974 0.9173                
p-value=(P=0.0030, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 76/245=0.3102 76/317=0.2397 0.2705                
* (comp) Unseen-in-train: 165/319=0.5172 165/317=0.5205 0.5189                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 118/126=0.9365 118/227=0.5198 0.6686                
* (comp) Variant-of-train: 217/227=0.9559 217/227=0.9559 0.9559                
p-value=(P=0.0990, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 80/99=0.8081  80/280=0.2857 0.4222                
* (comp) Identical-to-train: 238/258=0.9225 238/280=0.8500 0.8848                
p-value=(P=0.0040, R=0.0000, F1=0.0000)


Language : DE
Systems : FipsCo.open,Seen2Unseen.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 274/470=0.5830 274/824=0.3325 0.4235                
* (comp) MWE-based    : 492/652=0.7546 492/824=0.5971 0.6667                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 219/368=0.5951 219/490=0.4469 0.5105                
* (comp) Continuous   : 326/427=0.7635 326/490=0.6653 0.7110                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 55/102=0.5392 55/334=0.1647 0.2523                
* (comp) Discontinuous: 166/225=0.7378 166/334=0.4970 0.5939                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 61/119=0.5126 61/559=0.1091 0.1799                
* (comp) Multi-token  : 301/437=0.6888 301/559=0.5385 0.6044                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 213/351=0.6068 213/265=0.8038 0.6916                
* (comp) Single-token : 191/215=0.8884 191/265=0.7208 0.7958                
p-value=(P=0.0000, R=0.0130, F1=0.0010)
* (pred) Seen-in-train: 198/225=0.8800 198/507=0.3905 0.5410                
* (comp) Seen-in-train: 474/543=0.8729 474/507=0.9349 0.9029                
p-value=(P=0.3570, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 76/245=0.3102 76/317=0.2397 0.2705                
* (comp) Unseen-in-train: 18/109=0.1651 18/317=0.0568 0.0845                
p-value=(P=0.0010, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 118/126=0.9365 118/227=0.5198 0.6686                
* (comp) Variant-of-train: 226/245=0.9224 226/227=0.9956 0.9576                
p-value=(P=0.2000, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 80/99=0.8081  80/280=0.2857 0.4222                
* (comp) Identical-to-train: 248/298=0.8322 248/280=0.8857 0.8581                
p-value=(P=0.2980, R=0.0000, F1=0.0000)


Language : DE
Systems : FipsCo.open,TRAVIS-mono.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 274/470=0.5830 274/824=0.3325 0.4235                
* (comp) MWE-based    : 577/796=0.7249 577/824=0.7002 0.7123                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 219/368=0.5951 219/490=0.4469 0.5105                
* (comp) Continuous   : 370/501=0.7385 370/490=0.7551 0.7467                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 55/102=0.5392 55/334=0.1647 0.2523                
* (comp) Discontinuous: 207/295=0.7017 207/334=0.6198 0.6582                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 61/119=0.5126 61/559=0.1091 0.1799                
* (comp) Multi-token  : 367/493=0.7444 367/559=0.6565 0.6977                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 213/351=0.6068 213/265=0.8038 0.6916                
* (comp) Single-token : 210/303=0.6931 210/265=0.7925 0.7394                
p-value=(P=0.0020, R=0.3420, F1=0.0410)
* (pred) Seen-in-train: 198/225=0.8800 198/507=0.3905 0.5410                
* (comp) Seen-in-train: 415/442=0.9389 415/507=0.8185 0.8746                
p-value=(P=0.0010, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 76/245=0.3102 76/317=0.2397 0.2705                
* (comp) Unseen-in-train: 162/354=0.4576 162/317=0.5110 0.4829                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 118/126=0.9365 118/227=0.5198 0.6686                
* (comp) Variant-of-train: 209/217=0.9631 209/227=0.9207 0.9414                
p-value=(P=0.0530, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 80/99=0.8081  80/280=0.2857 0.4222                
* (comp) Identical-to-train: 206/225=0.9156 206/280=0.7357 0.8158                
p-value=(P=0.0090, R=0.0000, F1=0.0000)


Language : DE
Systems : FipsCo.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 274/470=0.5830 274/824=0.3325 0.4235                
* (comp) MWE-based    : 537/785=0.6841 537/824=0.6517 0.6675                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 219/368=0.5951 219/490=0.4469 0.5105                
* (comp) Continuous   : 355/498=0.7129 355/490=0.7245 0.7186                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 55/102=0.5392 55/334=0.1647 0.2523                
* (comp) Discontinuous: 182/287=0.6341 182/334=0.5449 0.5862                
p-value=(P=0.0270, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 61/119=0.5126 61/559=0.1091 0.1799                
* (comp) Multi-token  : 323/464=0.6961 323/559=0.5778 0.6315                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 213/351=0.6068 213/265=0.8038 0.6916                
* (comp) Single-token : 214/321=0.6667 214/265=0.8075 0.7304                
p-value=(P=0.0090, R=0.4480, F1=0.0580)
* (pred) Seen-in-train: 198/225=0.8800 198/507=0.3905 0.5410                
* (comp) Seen-in-train: 409/438=0.9338 409/507=0.8067 0.8656                
p-value=(P=0.0030, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 76/245=0.3102 76/317=0.2397 0.2705                
* (comp) Unseen-in-train: 128/347=0.3689 128/317=0.4038 0.3855                
p-value=(P=0.0280, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 118/126=0.9365 118/227=0.5198 0.6686                
* (comp) Variant-of-train: 209/219=0.9543 209/227=0.9207 0.9372                
p-value=(P=0.1200, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 80/99=0.8081  80/280=0.2857 0.4222                
* (comp) Identical-to-train: 200/219=0.9132 200/280=0.7143 0.8016                
p-value=(P=0.0020, R=0.0000, F1=0.0000)


Language : DE
Systems : HMSid.open,MTLB-STRUCT.open


Language : DE
Systems : HMSid.open,Seen2Unseen.open


Language : DE
Systems : HMSid.open,TRAVIS-mono.open


Language : DE
Systems : HMSid.open,TRAVIS-multi.open


Language : DE
Systems : MTLB-STRUCT.open,Seen2Unseen.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 620/804=0.7711 620/824=0.7524 0.7617                
* (comp) MWE-based    : 492/652=0.7546 492/824=0.5971 0.6667                
p-value=(P=0.2190, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 389/501=0.7764 389/490=0.7939 0.7851                
* (comp) Continuous   : 326/427=0.7635 326/490=0.6653 0.7110                
p-value=(P=0.3060, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 231/303=0.7624 231/334=0.6916 0.7253                
* (comp) Discontinuous: 166/225=0.7378 166/334=0.4970 0.5939                
p-value=(P=0.2210, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 392/500=0.7840 392/559=0.7013 0.7403                
* (comp) Multi-token  : 301/437=0.6888 301/559=0.5385 0.6044                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 228/304=0.7500 228/265=0.8604 0.8014                
* (comp) Single-token : 191/215=0.8884 191/265=0.7208 0.7958                
p-value=(P=0.0000, R=0.0000, F1=0.4270)
* (pred) Seen-in-train: 455/485=0.9381 455/507=0.8974 0.9173                
* (comp) Seen-in-train: 474/543=0.8729 474/507=0.9349 0.9029                
p-value=(P=0.0000, R=0.0040, F1=0.0710)
* (pred) Unseen-in-train: 165/319=0.5172 165/317=0.5205 0.5189                
* (comp) Unseen-in-train: 18/109=0.1651 18/317=0.0568 0.0845                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 217/227=0.9559 217/227=0.9559 0.9559                
* (comp) Variant-of-train: 226/245=0.9224 226/227=0.9956 0.9576                
p-value=(P=0.0060, R=0.0070, F1=0.4350)
* (pred) Identical-to-train: 238/258=0.9225 238/280=0.8500 0.8848                
* (comp) Identical-to-train: 248/298=0.8322 248/280=0.8857 0.8581                
p-value=(P=0.0000, R=0.0710, F1=0.0640)


Language : DE
Systems : MTLB-STRUCT.open,TRAVIS-mono.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 620/804=0.7711 620/824=0.7524 0.7617                
* (comp) MWE-based    : 577/796=0.7249 577/824=0.7002 0.7123                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 389/501=0.7764 389/490=0.7939 0.7851                
* (comp) Continuous   : 370/501=0.7385 370/490=0.7551 0.7467                
p-value=(P=0.0110, R=0.0070, F1=0.0020)
* (pred) Discontinuous: 231/303=0.7624 231/334=0.6916 0.7253                
* (comp) Discontinuous: 207/295=0.7017 207/334=0.6198 0.6582                
p-value=(P=0.0010, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 392/500=0.7840 392/559=0.7013 0.7403                
* (comp) Multi-token  : 367/493=0.7444 367/559=0.6565 0.6977                
p-value=(P=0.0100, R=0.0020, F1=0.0010)
* (pred) Single-token : 228/304=0.7500 228/265=0.8604 0.8014                
* (comp) Single-token : 210/303=0.6931 210/265=0.7925 0.7394                
p-value=(P=0.0060, R=0.0000, F1=0.0000)
* (pred) Seen-in-train: 455/485=0.9381 455/507=0.8974 0.9173                
* (comp) Seen-in-train: 415/442=0.9389 415/507=0.8185 0.8746                
p-value=(P=0.4470, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 165/319=0.5172 165/317=0.5205 0.5189                
* (comp) Unseen-in-train: 162/354=0.4576 162/317=0.5110 0.4829                
p-value=(P=0.0030, R=0.3440, F1=0.0540)
* (pred) Variant-of-train: 217/227=0.9559 217/227=0.9559 0.9559                
* (comp) Variant-of-train: 209/217=0.9631 209/227=0.9207 0.9414                
p-value=(P=0.2300, R=0.0240, F1=0.1030)
* (pred) Identical-to-train: 238/258=0.9225 238/280=0.8500 0.8848                
* (comp) Identical-to-train: 206/225=0.9156 206/280=0.7357 0.8158                
p-value=(P=0.3020, R=0.0000, F1=0.0000)


Language : DE
Systems : MTLB-STRUCT.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 620/804=0.7711 620/824=0.7524 0.7617                
* (comp) MWE-based    : 537/785=0.6841 537/824=0.6517 0.6675                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 389/501=0.7764 389/490=0.7939 0.7851                
* (comp) Continuous   : 355/498=0.7129 355/490=0.7245 0.7186                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 231/303=0.7624 231/334=0.6916 0.7253                
* (comp) Discontinuous: 182/287=0.6341 182/334=0.5449 0.5862                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 392/500=0.7840 392/559=0.7013 0.7403                
* (comp) Multi-token  : 323/464=0.6961 323/559=0.5778 0.6315                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 228/304=0.7500 228/265=0.8604 0.8014                
* (comp) Single-token : 214/321=0.6667 214/265=0.8075 0.7304                
p-value=(P=0.0010, R=0.0120, F1=0.0000)
* (pred) Seen-in-train: 455/485=0.9381 455/507=0.8974 0.9173                
* (comp) Seen-in-train: 409/438=0.9338 409/507=0.8067 0.8656                
p-value=(P=0.3240, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 165/319=0.5172 165/317=0.5205 0.5189                
* (comp) Unseen-in-train: 128/347=0.3689 128/317=0.4038 0.3855                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 217/227=0.9559 217/227=0.9559 0.9559                
* (comp) Variant-of-train: 209/219=0.9543 209/227=0.9207 0.9372                
p-value=(P=0.4350, R=0.0260, F1=0.0430)
* (pred) Identical-to-train: 238/258=0.9225 238/280=0.8500 0.8848                
* (comp) Identical-to-train: 200/219=0.9132 200/280=0.7143 0.8016                
p-value=(P=0.2770, R=0.0000, F1=0.0000)


Language : DE
Systems : Seen2Unseen.open,TRAVIS-mono.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 492/652=0.7546 492/824=0.5971 0.6667                
* (comp) MWE-based    : 577/796=0.7249 577/824=0.7002 0.7123                
p-value=(P=0.0650, R=0.0000, F1=0.0060)

## MWE continuity (partition of Global)
* (pred) Continuous   : 326/427=0.7635 326/490=0.6653 0.7110                
* (comp) Continuous   : 370/501=0.7385 370/490=0.7551 0.7467                
p-value=(P=0.1410, R=0.0000, F1=0.0310)
* (pred) Discontinuous: 166/225=0.7378 166/334=0.4970 0.5939                
* (comp) Discontinuous: 207/295=0.7017 207/334=0.6198 0.6582                
p-value=(P=0.1290, R=0.0000, F1=0.0220)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 301/437=0.6888 301/559=0.5385 0.6044                
* (comp) Multi-token  : 367/493=0.7444 367/559=0.6565 0.6977                
p-value=(P=0.0160, R=0.0000, F1=0.0000)
* (pred) Single-token : 191/215=0.8884 191/265=0.7208 0.7958                
* (comp) Single-token : 210/303=0.6931 210/265=0.7925 0.7394                
p-value=(P=0.0000, R=0.0050, F1=0.0080)
* (pred) Seen-in-train: 474/543=0.8729 474/507=0.9349 0.9029                
* (comp) Seen-in-train: 415/442=0.9389 415/507=0.8185 0.8746                
p-value=(P=0.0000, R=0.0000, F1=0.0200)
* (pred) Unseen-in-train: 18/109=0.1651 18/317=0.0568 0.0845                
* (comp) Unseen-in-train: 162/354=0.4576 162/317=0.5110 0.4829                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 226/245=0.9224 226/227=0.9956 0.9576                
* (comp) Variant-of-train: 209/217=0.9631 209/227=0.9207 0.9414                
p-value=(P=0.0010, R=0.0000, F1=0.1000)
* (pred) Identical-to-train: 248/298=0.8322 248/280=0.8857 0.8581                
* (comp) Identical-to-train: 206/225=0.9156 206/280=0.7357 0.8158                
p-value=(P=0.0000, R=0.0000, F1=0.0280)


Language : DE
Systems : Seen2Unseen.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 492/652=0.7546 492/824=0.5971 0.6667                
* (comp) MWE-based    : 537/785=0.6841 537/824=0.6517 0.6675                
p-value=(P=0.0000, R=0.0000, F1=0.4650)

## MWE continuity (partition of Global)
* (pred) Continuous   : 326/427=0.7635 326/490=0.6653 0.7110                
* (comp) Continuous   : 355/498=0.7129 355/490=0.7245 0.7186                
p-value=(P=0.0230, R=0.0010, F1=0.3440)
* (pred) Discontinuous: 166/225=0.7378 166/334=0.4970 0.5939                
* (comp) Discontinuous: 182/287=0.6341 182/334=0.5449 0.5862                
p-value=(P=0.0000, R=0.0540, F1=0.4060)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 301/437=0.6888 301/559=0.5385 0.6044                
* (comp) Multi-token  : 323/464=0.6961 323/559=0.5778 0.6315                
p-value=(P=0.3900, R=0.0380, F1=0.0890)
* (pred) Single-token : 191/215=0.8884 191/265=0.7208 0.7958                
* (comp) Single-token : 214/321=0.6667 214/265=0.8075 0.7304                
p-value=(P=0.0000, R=0.0000, F1=0.0030)
* (pred) Seen-in-train: 474/543=0.8729 474/507=0.9349 0.9029                
* (comp) Seen-in-train: 409/438=0.9338 409/507=0.8067 0.8656                
p-value=(P=0.0000, R=0.0000, F1=0.0010)
* (pred) Unseen-in-train: 18/109=0.1651 18/317=0.0568 0.0845                
* (comp) Unseen-in-train: 128/347=0.3689 128/317=0.4038 0.3855                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 226/245=0.9224 226/227=0.9956 0.9576                
* (comp) Variant-of-train: 209/219=0.9543 209/227=0.9207 0.9372                
p-value=(P=0.0100, R=0.0010, F1=0.0510)
* (pred) Identical-to-train: 248/298=0.8322 248/280=0.8857 0.8581                
* (comp) Identical-to-train: 200/219=0.9132 200/280=0.7143 0.8016                
p-value=(P=0.0000, R=0.0000, F1=0.0050)


Language : DE
Systems : TRAVIS-mono.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 577/796=0.7249 577/824=0.7002 0.7123                
* (comp) MWE-based    : 537/785=0.6841 537/824=0.6517 0.6675                
p-value=(P=0.0040, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 370/501=0.7385 370/490=0.7551 0.7467                
* (comp) Continuous   : 355/498=0.7129 355/490=0.7245 0.7186                
p-value=(P=0.0830, R=0.0460, F1=0.0330)
* (pred) Discontinuous: 207/295=0.7017 207/334=0.6198 0.6582                
* (comp) Discontinuous: 182/287=0.6341 182/334=0.5449 0.5862                
p-value=(P=0.0070, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 367/493=0.7444 367/559=0.6565 0.6977                
* (comp) Multi-token  : 323/464=0.6961 323/559=0.5778 0.6315                
p-value=(P=0.0080, R=0.0000, F1=0.0000)
* (pred) Single-token : 210/303=0.6931 210/265=0.7925 0.7394                
* (comp) Single-token : 214/321=0.6667 214/265=0.8075 0.7304                
p-value=(P=0.1260, R=0.2610, F1=0.3150)
* (pred) Seen-in-train: 415/442=0.9389 415/507=0.8185 0.8746                
* (comp) Seen-in-train: 409/438=0.9338 409/507=0.8067 0.8656                
p-value=(P=0.2700, R=0.2150, F1=0.1960)
* (pred) Unseen-in-train: 162/354=0.4576 162/317=0.5110 0.4829                
* (comp) Unseen-in-train: 128/347=0.3689 128/317=0.4038 0.3855                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 209/217=0.9631 209/227=0.9207 0.9414                
* (comp) Variant-of-train: 209/219=0.9543 209/227=0.9207 0.9372                
p-value=(P=0.1940, R=1.0000, F1=0.3450)
* (pred) Identical-to-train: 206/225=0.9156 206/280=0.7357 0.8158                
* (comp) Identical-to-train: 200/219=0.9132 200/280=0.7143 0.8016                
p-value=(P=0.4020, R=0.1890, F1=0.2080)



Language : EL
Systems : ERMI.closed,Seen2Seen.closed
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 547/814=0.6720 547/974=0.5616 0.6119                
* (comp) MWE-based    : 598/813=0.7355 598/974=0.6140 0.6693                
p-value=(P=0.0000, R=0.0020, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 352/535=0.6579 352/519=0.6782 0.6679                
* (comp) Continuous   : 328/398=0.8241 328/519=0.6320 0.7154                
p-value=(P=0.0000, R=0.0250, F1=0.0080)
* (pred) Discontinuous: 195/279=0.6989 195/455=0.4286 0.5313                
* (comp) Discontinuous: 270/415=0.6506 270/455=0.5934 0.6207                
p-value=(P=0.0530, R=0.0000, F1=0.0020)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 547/772=0.7085 547/974=0.5616 0.6266                
* (comp) Multi-token  : 598/813=0.7355 598/974=0.6140 0.6693                
p-value=(P=0.0870, R=0.0020, F1=0.0000)
* (pred) Single-token : 0/42=0.0000   0/0=0.0000    0.0000                
* (comp) Single-token : 0/0=0.0000    0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 448/481=0.9314 448/666=0.6727 0.7812                
* (comp) Seen-in-train: 593/804=0.7376 593/666=0.8904 0.8068                
p-value=(P=0.0000, R=0.0000, F1=0.0520)
* (pred) Unseen-in-train: 99/333=0.2973 99/308=0.3214 0.3089                
* (comp) Unseen-in-train: 5/9=0.5556    5/308=0.0162  0.0315                
p-value=(P=0.0610, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 237/245=0.9673 237/285=0.8316 0.8943                
* (comp) Variant-of-train: 267/283=0.9435 267/285=0.9368 0.9401                
p-value=(P=0.0430, R=0.0000, F1=0.0040)
* (pred) Identical-to-train: 211/236=0.8941 211/381=0.5538 0.6840                
* (comp) Identical-to-train: 326/521=0.6257 326/381=0.8556 0.7228                
p-value=(P=0.0000, R=0.0000, F1=0.0610)



Language : EL
Systems : FipsCo.open,HMSid.open


Language : EL
Systems : FipsCo.open,MTLB-STRUCT.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 300/494=0.6073 300/974=0.3080 0.4087                
* (comp) MWE-based    : 708/976=0.7254 708/974=0.7269 0.7262                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 184/241=0.7635 184/519=0.3545 0.4842                
* (comp) Continuous   : 398/541=0.7357 398/519=0.7669 0.7509                
p-value=(P=0.2090, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 116/253=0.4585 116/455=0.2549 0.3277                
* (comp) Discontinuous: 310/435=0.7126 310/455=0.6813 0.6966                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 300/493=0.6085 300/974=0.3080 0.4090                
* (comp) Multi-token  : 708/946=0.7484 708/974=0.7269 0.7375                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/1=0.0000    0/0=0.0000    0.0000                
* (comp) Single-token : 0/30=0.0000   0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 260/302=0.8609 260/666=0.3904 0.5372                
* (comp) Seen-in-train: 562/604=0.9305 562/666=0.8438 0.8850                
p-value=(P=0.0010, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 40/192=0.2083 40/308=0.1299 0.1600                
* (comp) Unseen-in-train: 146/372=0.3925 146/308=0.4740 0.4294                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 146/152=0.9605 146/285=0.5123 0.6682                
* (comp) Variant-of-train: 272/281=0.9680 272/285=0.9544 0.9611                
p-value=(P=0.2340, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 114/150=0.7600 114/381=0.2992 0.4294                
* (comp) Identical-to-train: 290/323=0.8978 290/381=0.7612 0.8239                
p-value=(P=0.0000, R=0.0000, F1=0.0000)


Language : EL
Systems : FipsCo.open,Seen2Unseen.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 300/494=0.6073 300/974=0.3080 0.4087                
* (comp) MWE-based    : 622/1084=0.5738 622/974=0.6386 0.6045                
p-value=(P=0.0600, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 184/241=0.7635 184/519=0.3545 0.4842                
* (comp) Continuous   : 337/466=0.7232 337/519=0.6493 0.6843                
p-value=(P=0.0840, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 116/253=0.4585 116/455=0.2549 0.3277                
* (comp) Discontinuous: 285/618=0.4612 285/455=0.6264 0.5312                
p-value=(P=0.4730, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 300/493=0.6085 300/974=0.3080 0.4090                
* (comp) Multi-token  : 622/1084=0.5738 622/974=0.6386 0.6045                
p-value=(P=0.0530, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/1=0.0000    0/0=0.0000    0.0000                
* (comp) Single-token : 0/0=0.0000    0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 260/302=0.8609 260/666=0.3904 0.5372                
* (comp) Seen-in-train: 593/805=0.7366 593/666=0.8904 0.8063                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 40/192=0.2083 40/308=0.1299 0.1600                
* (comp) Unseen-in-train: 29/279=0.1039 29/308=0.0942 0.0988                
p-value=(P=0.0020, R=0.0610, F1=0.0090)
* (pred) Variant-of-train: 146/152=0.9605 146/285=0.5123 0.6682                
* (comp) Variant-of-train: 267/283=0.9435 267/285=0.9368 0.9401                
p-value=(P=0.1150, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 114/150=0.7600 114/381=0.2992 0.4294                
* (comp) Identical-to-train: 326/522=0.6245 326/381=0.8556 0.7220                
p-value=(P=0.0000, R=0.0000, F1=0.0000)


Language : EL
Systems : FipsCo.open,TRAVIS-mono.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 300/494=0.6073 300/974=0.3080 0.4087                
* (comp) MWE-based    : 78/234=0.3333 78/974=0.0801 0.1291                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 184/241=0.7635 184/519=0.3545 0.4842                
* (comp) Continuous   : 64/185=0.3459 64/519=0.1233 0.1818                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 116/253=0.4585 116/455=0.2549 0.3277                
* (comp) Discontinuous: 14/49=0.2857  14/455=0.0308 0.0556                
p-value=(P=0.0060, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 300/493=0.6085 300/974=0.3080 0.4090                
* (comp) Multi-token  : 78/184=0.4239 78/974=0.0801 0.1347                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/1=0.0000    0/0=0.0000    0.0000                
* (comp) Single-token : 0/50=0.0000   0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 260/302=0.8609 260/666=0.3904 0.5372                
* (comp) Seen-in-train: 61/65=0.9385  61/666=0.0916 0.1669                
p-value=(P=0.0120, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 40/192=0.2083 40/308=0.1299 0.1600                
* (comp) Unseen-in-train: 17/169=0.1006 17/308=0.0552 0.0713                
p-value=(P=0.0010, R=0.0020, F1=0.0010)
* (pred) Variant-of-train: 146/152=0.9605 146/285=0.5123 0.6682                
* (comp) Variant-of-train: 48/50=0.9600  48/285=0.1684 0.2866                
p-value=(P=0.4800, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 114/150=0.7600 114/381=0.2992 0.4294                
* (comp) Identical-to-train: 13/15=0.8667  13/381=0.0341 0.0657                
p-value=(P=0.1330, R=0.0000, F1=0.0000)


Language : EL
Systems : FipsCo.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 300/494=0.6073 300/974=0.3080 0.4087                
* (comp) MWE-based    : 693/959=0.7226 693/974=0.7115 0.7170                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 184/241=0.7635 184/519=0.3545 0.4842                
* (comp) Continuous   : 389/520=0.7481 389/519=0.7495 0.7488                
p-value=(P=0.3300, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 116/253=0.4585 116/455=0.2549 0.3277                
* (comp) Discontinuous: 304/439=0.6925 304/455=0.6681 0.6801                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 300/493=0.6085 300/974=0.3080 0.4090                
* (comp) Multi-token  : 693/928=0.7468 693/974=0.7115 0.7287                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/1=0.0000    0/0=0.0000    0.0000                
* (comp) Single-token : 0/31=0.0000   0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 260/302=0.8609 260/666=0.3904 0.5372                
* (comp) Seen-in-train: 563/596=0.9446 563/666=0.8453 0.8922                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 40/192=0.2083 40/308=0.1299 0.1600                
* (comp) Unseen-in-train: 130/363=0.3581 130/308=0.4221 0.3875                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 146/152=0.9605 146/285=0.5123 0.6682                
* (comp) Variant-of-train: 271/276=0.9819 271/285=0.9509 0.9661                
p-value=(P=0.0620, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 114/150=0.7600 114/381=0.2992 0.4294                
* (comp) Identical-to-train: 292/320=0.9125 292/381=0.7664 0.8331                
p-value=(P=0.0000, R=0.0000, F1=0.0000)


Language : EL
Systems : HMSid.open,MTLB-STRUCT.open


Language : EL
Systems : HMSid.open,Seen2Unseen.open


Language : EL
Systems : HMSid.open,TRAVIS-mono.open


Language : EL
Systems : HMSid.open,TRAVIS-multi.open


Language : EL
Systems : MTLB-STRUCT.open,Seen2Unseen.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 708/976=0.7254 708/974=0.7269 0.7262                
* (comp) MWE-based    : 622/1084=0.5738 622/974=0.6386 0.6045                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 398/541=0.7357 398/519=0.7669 0.7509                
* (comp) Continuous   : 337/466=0.7232 337/519=0.6493 0.6843                
p-value=(P=0.2960, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 310/435=0.7126 310/455=0.6813 0.6966                
* (comp) Discontinuous: 285/618=0.4612 285/455=0.6264 0.5312                
p-value=(P=0.0000, R=0.0130, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 708/946=0.7484 708/974=0.7269 0.7375                
* (comp) Multi-token  : 622/1084=0.5738 622/974=0.6386 0.6045                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/30=0.0000   0/0=0.0000    0.0000                
* (comp) Single-token : 0/0=0.0000    0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 562/604=0.9305 562/666=0.8438 0.8850                
* (comp) Seen-in-train: 593/805=0.7366 593/666=0.8904 0.8063                
p-value=(P=0.0000, R=0.0030, F1=0.0000)
* (pred) Unseen-in-train: 146/372=0.3925 146/308=0.4740 0.4294                
* (comp) Unseen-in-train: 29/279=0.1039 29/308=0.0942 0.0988                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 272/281=0.9680 272/285=0.9544 0.9611                
* (comp) Variant-of-train: 267/283=0.9435 267/285=0.9368 0.9401                
p-value=(P=0.0120, R=0.1670, F1=0.0340)
* (pred) Identical-to-train: 290/323=0.8978 290/381=0.7612 0.8239                
* (comp) Identical-to-train: 326/522=0.6245 326/381=0.8556 0.7220                
p-value=(P=0.0000, R=0.0000, F1=0.0000)


Language : EL
Systems : MTLB-STRUCT.open,TRAVIS-mono.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 708/976=0.7254 708/974=0.7269 0.7262                
* (comp) MWE-based    : 78/234=0.3333 78/974=0.0801 0.1291                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 398/541=0.7357 398/519=0.7669 0.7509                
* (comp) Continuous   : 64/185=0.3459 64/519=0.1233 0.1818                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 310/435=0.7126 310/455=0.6813 0.6966                
* (comp) Discontinuous: 14/49=0.2857  14/455=0.0308 0.0556                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 708/946=0.7484 708/974=0.7269 0.7375                
* (comp) Multi-token  : 78/184=0.4239 78/974=0.0801 0.1347                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/30=0.0000   0/0=0.0000    0.0000                
* (comp) Single-token : 0/50=0.0000   0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 562/604=0.9305 562/666=0.8438 0.8850                
* (comp) Seen-in-train: 61/65=0.9385  61/666=0.0916 0.1669                
p-value=(P=0.4320, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 146/372=0.3925 146/308=0.4740 0.4294                
* (comp) Unseen-in-train: 17/169=0.1006 17/308=0.0552 0.0713                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 272/281=0.9680 272/285=0.9544 0.9611                
* (comp) Variant-of-train: 48/50=0.9600  48/285=0.1684 0.2866                
p-value=(P=0.3460, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 290/323=0.8978 290/381=0.7612 0.8239                
* (comp) Identical-to-train: 13/15=0.8667  13/381=0.0341 0.0657                
p-value=(P=0.3490, R=0.0000, F1=0.0000)


Language : EL
Systems : MTLB-STRUCT.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 708/976=0.7254 708/974=0.7269 0.7262                
* (comp) MWE-based    : 693/959=0.7226 693/974=0.7115 0.7170                
p-value=(P=0.4230, R=0.0840, F1=0.1930)

## MWE continuity (partition of Global)
* (pred) Continuous   : 398/541=0.7357 398/519=0.7669 0.7509                
* (comp) Continuous   : 389/520=0.7481 389/519=0.7495 0.7488                
p-value=(P=0.2390, R=0.1100, F1=0.4170)
* (pred) Discontinuous: 310/435=0.7126 310/455=0.6813 0.6966                
* (comp) Discontinuous: 304/439=0.6925 304/455=0.6681 0.6801                
p-value=(P=0.1290, R=0.2180, F1=0.1400)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 708/946=0.7484 708/974=0.7269 0.7375                
* (comp) Multi-token  : 693/928=0.7468 693/974=0.7115 0.7287                
p-value=(P=0.4290, R=0.0840, F1=0.1680)
* (pred) Single-token : 0/30=0.0000   0/0=0.0000    0.0000                
* (comp) Single-token : 0/31=0.0000   0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 562/604=0.9305 562/666=0.8438 0.8850                
* (comp) Seen-in-train: 563/596=0.9446 563/666=0.8453 0.8922                
p-value=(P=0.0350, R=0.4900, F1=0.2500)
* (pred) Unseen-in-train: 146/372=0.3925 146/308=0.4740 0.4294                
* (comp) Unseen-in-train: 130/363=0.3581 130/308=0.4221 0.3875                
p-value=(P=0.0460, R=0.0140, F1=0.0150)
* (pred) Variant-of-train: 272/281=0.9680 272/285=0.9544 0.9611                
* (comp) Variant-of-train: 271/276=0.9819 271/285=0.9509 0.9661                
p-value=(P=0.0330, R=0.3840, F1=0.2930)
* (pred) Identical-to-train: 290/323=0.8978 290/381=0.7612 0.8239                
* (comp) Identical-to-train: 292/320=0.9125 292/381=0.7664 0.8331                
p-value=(P=0.1410, R=0.4270, F1=0.2970)


Language : EL
Systems : Seen2Unseen.open,TRAVIS-mono.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 622/1084=0.5738 622/974=0.6386 0.6045                
* (comp) MWE-based    : 78/234=0.3333 78/974=0.0801 0.1291                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 337/466=0.7232 337/519=0.6493 0.6843                
* (comp) Continuous   : 64/185=0.3459 64/519=0.1233 0.1818                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 285/618=0.4612 285/455=0.6264 0.5312                
* (comp) Discontinuous: 14/49=0.2857  14/455=0.0308 0.0556                
p-value=(P=0.0030, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 622/1084=0.5738 622/974=0.6386 0.6045                
* (comp) Multi-token  : 78/184=0.4239 78/974=0.0801 0.1347                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/0=0.0000    0/0=0.0000    0.0000                
* (comp) Single-token : 0/50=0.0000   0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 593/805=0.7366 593/666=0.8904 0.8063                
* (comp) Seen-in-train: 61/65=0.9385  61/666=0.0916 0.1669                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 29/279=0.1039 29/308=0.0942 0.0988                
* (comp) Unseen-in-train: 17/169=0.1006 17/308=0.0552 0.0713                
p-value=(P=0.4710, R=0.0380, F1=0.1360)
* (pred) Variant-of-train: 267/283=0.9435 267/285=0.9368 0.9401                
* (comp) Variant-of-train: 48/50=0.9600  48/285=0.1684 0.2866                
p-value=(P=0.2950, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 326/522=0.6245 326/381=0.8556 0.7220                
* (comp) Identical-to-train: 13/15=0.8667  13/381=0.0341 0.0657                
p-value=(P=0.0000, R=0.0000, F1=0.0000)


Language : EL
Systems : Seen2Unseen.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 622/1084=0.5738 622/974=0.6386 0.6045                
* (comp) MWE-based    : 693/959=0.7226 693/974=0.7115 0.7170                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 337/466=0.7232 337/519=0.6493 0.6843                
* (comp) Continuous   : 389/520=0.7481 389/519=0.7495 0.7488                
p-value=(P=0.1300, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 285/618=0.4612 285/455=0.6264 0.5312                
* (comp) Discontinuous: 304/439=0.6925 304/455=0.6681 0.6801                
p-value=(P=0.0000, R=0.0280, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 622/1084=0.5738 622/974=0.6386 0.6045                
* (comp) Multi-token  : 693/928=0.7468 693/974=0.7115 0.7287                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/0=0.0000    0/0=0.0000    0.0000                
* (comp) Single-token : 0/31=0.0000   0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 593/805=0.7366 593/666=0.8904 0.8063                
* (comp) Seen-in-train: 563/596=0.9446 563/666=0.8453 0.8922                
p-value=(P=0.0000, R=0.0040, F1=0.0000)
* (pred) Unseen-in-train: 29/279=0.1039 29/308=0.0942 0.0988                
* (comp) Unseen-in-train: 130/363=0.3581 130/308=0.4221 0.3875                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 267/283=0.9435 267/285=0.9368 0.9401                
* (comp) Variant-of-train: 271/276=0.9819 271/285=0.9509 0.9661                
p-value=(P=0.0010, R=0.2490, F1=0.0140)
* (pred) Identical-to-train: 326/522=0.6245 326/381=0.8556 0.7220                
* (comp) Identical-to-train: 292/320=0.9125 292/381=0.7664 0.8331                
p-value=(P=0.0000, R=0.0000, F1=0.0000)


Language : EL
Systems : TRAVIS-mono.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 78/234=0.3333 78/974=0.0801 0.1291                
* (comp) MWE-based    : 693/959=0.7226 693/974=0.7115 0.7170                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 64/185=0.3459 64/519=0.1233 0.1818                
* (comp) Continuous   : 389/520=0.7481 389/519=0.7495 0.7488                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 14/49=0.2857  14/455=0.0308 0.0556                
* (comp) Discontinuous: 304/439=0.6925 304/455=0.6681 0.6801                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 78/184=0.4239 78/974=0.0801 0.1347                
* (comp) Multi-token  : 693/928=0.7468 693/974=0.7115 0.7287                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/50=0.0000   0/0=0.0000    0.0000                
* (comp) Single-token : 0/31=0.0000   0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 61/65=0.9385  61/666=0.0916 0.1669                
* (comp) Seen-in-train: 563/596=0.9446 563/666=0.8453 0.8922                
p-value=(P=0.3870, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 17/169=0.1006 17/308=0.0552 0.0713                
* (comp) Unseen-in-train: 130/363=0.3581 130/308=0.4221 0.3875                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 48/50=0.9600  48/285=0.1684 0.2866                
* (comp) Variant-of-train: 271/276=0.9819 271/285=0.9509 0.9661                
p-value=(P=0.2240, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 13/15=0.8667  13/381=0.0341 0.0657                
* (comp) Identical-to-train: 292/320=0.9125 292/381=0.7664 0.8331                
p-value=(P=0.2840, R=0.0000, F1=0.0000)



Language : EU
Systems : ERMI.closed,Seen2Seen.closed
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 1421/1871=0.7595 1421/2020=0.7035 0.7304                
* (comp) MWE-based    : 1446/1739=0.8315 1446/2020=0.7158 0.7694                
p-value=(P=0.0000, R=0.1330, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 1270/1614=0.7869 1270/1606=0.7908 0.7888                
* (comp) Continuous   : 1227/1406=0.8727 1227/1606=0.7640 0.8147                
p-value=(P=0.0000, R=0.0250, F1=0.0030)
* (pred) Discontinuous: 151/257=0.5875 151/414=0.3647 0.4501                
* (comp) Discontinuous: 219/333=0.6577 219/414=0.5290 0.5863                
p-value=(P=0.0180, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 1421/1812=0.7842 1421/2020=0.7035 0.7416                
* (comp) Multi-token  : 1446/1739=0.8315 1446/2020=0.7158 0.7694                
p-value=(P=0.0000, R=0.1330, F1=0.0010)
* (pred) Single-token : 0/59=0.0000   0/0=0.0000    0.0000                
* (comp) Single-token : 0/0=0.0000    0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 1275/1306=0.9763 1275/1667=0.7648 0.8577                
* (comp) Seen-in-train: 1446/1739=0.8315 1446/1667=0.8674 0.8491                
p-value=(P=0.0000, R=0.0000, F1=0.1610)
* (pred) Unseen-in-train: 146/565=0.2584 146/353=0.4136 0.3181                
* (comp) Unseen-in-train: 0/0=0.0000    0/353=0.0000  0.0000                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 770/778=0.9897 770/827=0.9311 0.9595                
* (comp) Variant-of-train: 774/787=0.9835 774/827=0.9359 0.9591                
p-value=(P=0.0650, R=0.3470, F1=0.4780)
* (pred) Identical-to-train: 505/528=0.9564 505/840=0.6012 0.7383                
* (comp) Identical-to-train: 672/952=0.7059 672/840=0.8000 0.7500                
p-value=(P=0.0000, R=0.0000, F1=0.2340)



Language : EU
Systems : FipsCo.open,HMSid.open


Language : EU
Systems : FipsCo.open,MTLB-STRUCT.open


Language : EU
Systems : FipsCo.open,Seen2Unseen.open


Language : EU
Systems : FipsCo.open,TRAVIS-mono.open


Language : EU
Systems : FipsCo.open,TRAVIS-multi.open


Language : EU
Systems : HMSid.open,MTLB-STRUCT.open


Language : EU
Systems : HMSid.open,Seen2Unseen.open


Language : EU
Systems : HMSid.open,TRAVIS-mono.open


Language : EU
Systems : HMSid.open,TRAVIS-multi.open


Language : EU
Systems : MTLB-STRUCT.open,Seen2Unseen.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 1603/1986=0.8072 1603/2020=0.7936 0.8003                
* (comp) MWE-based    : 1537/2174=0.7070 1537/2020=0.7609 0.7330                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 1373/1664=0.8251 1373/1606=0.8549 0.8398                
* (comp) Continuous   : 1306/1796=0.7272 1306/1606=0.8132 0.7678                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 230/322=0.7143 230/414=0.5556 0.6250                
* (comp) Discontinuous: 231/378=0.6111 231/414=0.5580 0.5833                
p-value=(P=0.0000, R=0.4790, F1=0.0410)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 1603/1912=0.8384 1603/2020=0.7936 0.8154                
* (comp) Multi-token  : 1537/2174=0.7070 1537/2020=0.7609 0.7330                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/74=0.0000   0/0=0.0000    0.0000                
* (comp) Single-token : 0/0=0.0000    0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 1430/1472=0.9715 1430/1667=0.8578 0.9111                
* (comp) Seen-in-train: 1489/1793=0.8305 1489/1667=0.8932 0.8607                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 173/514=0.3366 173/353=0.4901 0.3991                
* (comp) Unseen-in-train: 48/381=0.1260 48/353=0.1360 0.1308                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 806/814=0.9902 806/827=0.9746 0.9823                
* (comp) Variant-of-train: 775/788=0.9835 775/827=0.9371 0.9598                
p-value=(P=0.0310, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 624/658=0.9483 624/840=0.7429 0.8331                
* (comp) Identical-to-train: 714/1005=0.7104 714/840=0.8500 0.7740                
p-value=(P=0.0000, R=0.0000, F1=0.0000)


Language : EU
Systems : MTLB-STRUCT.open,TRAVIS-mono.open


Language : EU
Systems : MTLB-STRUCT.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 1603/1986=0.8072 1603/2020=0.7936 0.8003                
* (comp) MWE-based    : 1536/2055=0.7474 1536/2020=0.7604 0.7539                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 1373/1664=0.8251 1373/1606=0.8549 0.8398                
* (comp) Continuous   : 1327/1743=0.7613 1327/1606=0.8263 0.7925                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 230/322=0.7143 230/414=0.5556 0.6250                
* (comp) Discontinuous: 209/312=0.6699 209/414=0.5048 0.5758                
p-value=(P=0.0560, R=0.0150, F1=0.0110)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 1603/1912=0.8384 1603/2020=0.7936 0.8154                
* (comp) Multi-token  : 1536/1904=0.8067 1536/2020=0.7604 0.7829                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/74=0.0000   0/0=0.0000    0.0000                
* (comp) Single-token : 0/151=0.0000  0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 1430/1472=0.9715 1430/1667=0.8578 0.9111                
* (comp) Seen-in-train: 1375/1427=0.9636 1375/1667=0.8248 0.8888                
p-value=(P=0.0130, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 173/514=0.3366 173/353=0.4901 0.3991                
* (comp) Unseen-in-train: 161/628=0.2564 161/353=0.4561 0.3282                
p-value=(P=0.0000, R=0.0860, F1=0.0000)
* (pred) Variant-of-train: 806/814=0.9902 806/827=0.9746 0.9823                
* (comp) Variant-of-train: 792/801=0.9888 792/827=0.9577 0.9730                
p-value=(P=0.1140, R=0.0130, F1=0.0080)
* (pred) Identical-to-train: 624/658=0.9483 624/840=0.7429 0.8331                
* (comp) Identical-to-train: 583/626=0.9313 583/840=0.6940 0.7954                
p-value=(P=0.0120, R=0.0010, F1=0.0010)


Language : EU
Systems : Seen2Unseen.open,TRAVIS-mono.open


Language : EU
Systems : Seen2Unseen.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 1537/2174=0.7070 1537/2020=0.7609 0.7330                
* (comp) MWE-based    : 1536/2055=0.7474 1536/2020=0.7604 0.7539                
p-value=(P=0.0000, R=0.4970, F1=0.0120)

## MWE continuity (partition of Global)
* (pred) Continuous   : 1306/1796=0.7272 1306/1606=0.8132 0.7678                
* (comp) Continuous   : 1327/1743=0.7613 1327/1606=0.8263 0.7925                
p-value=(P=0.0040, R=0.1300, F1=0.0050)
* (pred) Discontinuous: 231/378=0.6111 231/414=0.5580 0.5833                
* (comp) Discontinuous: 209/312=0.6699 209/414=0.5048 0.5758                
p-value=(P=0.0310, R=0.0410, F1=0.4000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 1537/2174=0.7070 1537/2020=0.7609 0.7330                
* (comp) Multi-token  : 1536/1904=0.8067 1536/2020=0.7604 0.7829                
p-value=(P=0.0000, R=0.4970, F1=0.0000)
* (pred) Single-token : 0/0=0.0000    0/0=0.0000    0.0000                
* (comp) Single-token : 0/151=0.0000  0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 1489/1793=0.8305 1489/1667=0.8932 0.8607                
* (comp) Seen-in-train: 1375/1427=0.9636 1375/1667=0.8248 0.8888                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 48/381=0.1260 48/353=0.1360 0.1308                
* (comp) Unseen-in-train: 161/628=0.2564 161/353=0.4561 0.3282                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 775/788=0.9835 775/827=0.9371 0.9598                
* (comp) Variant-of-train: 792/801=0.9888 792/827=0.9577 0.9730                
p-value=(P=0.1040, R=0.0200, F1=0.0140)
* (pred) Identical-to-train: 714/1005=0.7104 714/840=0.8500 0.7740                
* (comp) Identical-to-train: 583/626=0.9313 583/840=0.6940 0.7954                
p-value=(P=0.0000, R=0.0000, F1=0.0560)


Language : EU
Systems : TRAVIS-mono.open,TRAVIS-multi.open



Language : FR
Systems : ERMI.closed,Seen2Seen.closed
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 833/1354=0.6152 833/1359=0.6130 0.6141                
* (comp) MWE-based    : 999/1182=0.8452 999/1359=0.7351 0.7863                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 571/920=0.6207 571/787=0.7255 0.6690                
* (comp) Continuous   : 663/750=0.8840 663/787=0.8424 0.8627                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 262/434=0.6037 262/572=0.4580 0.5209                
* (comp) Discontinuous: 336/432=0.7778 336/572=0.5874 0.6693                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 833/1200=0.6942 833/1358=0.6134 0.6513                
* (comp) Multi-token  : 999/1182=0.8452 999/1358=0.7356 0.7866                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/154=0.0000  0/1=0.0000    0.0000                
* (comp) Single-token : 0/0=0.0000    0/1=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 720/769=0.9363 720/1047=0.6877 0.7930                
* (comp) Seen-in-train: 993/1155=0.8597 993/1047=0.9484 0.9019                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 113/585=0.1932 113/312=0.3622 0.2520                
* (comp) Unseen-in-train: 6/27=0.2222   6/312=0.0192  0.0354                
p-value=(P=0.3600, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 475/492=0.9654 475/584=0.8134 0.8829                
* (comp) Variant-of-train: 567/600=0.9450 567/584=0.9709 0.9578                
p-value=(P=0.0300, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 245/277=0.8845 245/463=0.5292 0.6622                
* (comp) Identical-to-train: 426/555=0.7676 426/463=0.9201 0.8369                
p-value=(P=0.0000, R=0.0000, F1=0.0000)



Language : FR
Systems : FipsCo.open,HMSid.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 795/1779=0.4469 795/1359=0.5850 0.5067                
* (comp) MWE-based    : 922/1444=0.6385 922/1359=0.6784 0.6579                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 487/865=0.5630 487/787=0.6188 0.5896                
* (comp) Continuous   : 584/1042=0.5605 584/787=0.7421 0.6386                
p-value=(P=0.4160, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 308/914=0.3370 308/572=0.5385 0.4145                
* (comp) Discontinuous: 338/402=0.8408 338/572=0.5909 0.6940                
p-value=(P=0.0000, R=0.0130, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 795/1729=0.4598 795/1358=0.5854 0.5151                
* (comp) Multi-token  : 922/1433=0.6434 922/1358=0.6789 0.6607                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/50=0.0000   0/1=0.0000    0.0000                
* (comp) Single-token : 0/11=0.0000   0/1=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 673/795=0.8465 673/1047=0.6428 0.7307                
* (comp) Seen-in-train: 750/852=0.8803 750/1047=0.7163 0.7899                
p-value=(P=0.0040, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 122/984=0.1240 122/312=0.3910 0.1883                
* (comp) Unseen-in-train: 169/592=0.2855 169/312=0.5417 0.3739                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 395/429=0.9207 395/584=0.6764 0.7799                
* (comp) Variant-of-train: 350/389=0.8997 350/584=0.5993 0.7194                
p-value=(P=0.0090, R=0.0010, F1=0.0010)
* (pred) Identical-to-train: 278/366=0.7596 278/463=0.6004 0.6707                
* (comp) Identical-to-train: 295/463=0.6371 295/463=0.6371 0.6371                
p-value=(P=0.0000, R=0.0680, F1=0.0560)


Language : FR
Systems : FipsCo.open,MTLB-STRUCT.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 795/1779=0.4469 795/1359=0.5850 0.5067                
* (comp) MWE-based    : 1071/1338=0.8004 1071/1359=0.7881 0.7942                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 487/865=0.5630 487/787=0.6188 0.5896                
* (comp) Continuous   : 667/798=0.8358 667/787=0.8475 0.8416                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 308/914=0.3370 308/572=0.5385 0.4145                
* (comp) Discontinuous: 404/540=0.7481 404/572=0.7063 0.7266                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 795/1729=0.4598 795/1358=0.5854 0.5151                
* (comp) Multi-token  : 1070/1301=0.8224 1070/1358=0.7879 0.8048                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/50=0.0000   0/1=0.0000    0.0000                
* (comp) Single-token : 1/37=0.0270   1/1=1.0000    0.0526                
p-value=(P=0.1710, R=0.0000, F1=0.1540)
* (pred) Seen-in-train: 673/795=0.8465 673/1047=0.6428 0.7307                
* (comp) Seen-in-train: 926/977=0.9478 926/1047=0.8844 0.9150                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 122/984=0.1240 122/312=0.3910 0.1883                
* (comp) Unseen-in-train: 145/361=0.4017 145/312=0.4647 0.4309                
p-value=(P=0.0000, R=0.0210, F1=0.0000)
* (pred) Variant-of-train: 395/429=0.9207 395/584=0.6764 0.7799                
* (comp) Variant-of-train: 556/571=0.9737 556/584=0.9521 0.9628                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 278/366=0.7596 278/463=0.6004 0.6707                
* (comp) Identical-to-train: 370/406=0.9113 370/463=0.7991 0.8516                
p-value=(P=0.0000, R=0.0000, F1=0.0000)


Language : FR
Systems : FipsCo.open,Seen2Unseen.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 795/1779=0.4469 795/1359=0.5850 0.5067                
* (comp) MWE-based    : 1066/1418=0.7518 1066/1359=0.7844 0.7677                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 487/865=0.5630 487/787=0.6188 0.5896                
* (comp) Continuous   : 680/780=0.8718 680/787=0.8640 0.8679                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 308/914=0.3370 308/572=0.5385 0.4145                
* (comp) Discontinuous: 386/638=0.6050 386/572=0.6748 0.6380                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 795/1729=0.4598 795/1358=0.5854 0.5151                
* (comp) Multi-token  : 1066/1418=0.7518 1066/1358=0.7850 0.7680                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/50=0.0000   0/1=0.0000    0.0000                
* (comp) Single-token : 0/0=0.0000    0/1=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 673/795=0.8465 673/1047=0.6428 0.7307                
* (comp) Seen-in-train: 995/1158=0.8592 995/1047=0.9503 0.9025                
p-value=(P=0.1510, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 122/984=0.1240 122/312=0.3910 0.1883                
* (comp) Unseen-in-train: 71/260=0.2731 71/312=0.2276 0.2483                
p-value=(P=0.0000, R=0.0000, F1=0.0100)
* (pred) Variant-of-train: 395/429=0.9207 395/584=0.6764 0.7799                
* (comp) Variant-of-train: 567/600=0.9450 567/584=0.9709 0.9578                
p-value=(P=0.0130, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 278/366=0.7596 278/463=0.6004 0.6707                
* (comp) Identical-to-train: 428/558=0.7670 428/463=0.9244 0.8384                
p-value=(P=0.3710, R=0.0000, F1=0.0000)


Language : FR
Systems : FipsCo.open,TRAVIS-mono.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 795/1779=0.4469 795/1359=0.5850 0.5067                
* (comp) MWE-based    : 1130/1377=0.8206 1130/1359=0.8315 0.8260                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 487/865=0.5630 487/787=0.6188 0.5896                
* (comp) Continuous   : 708/824=0.8592 708/787=0.8996 0.8790                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 308/914=0.3370 308/572=0.5385 0.4145                
* (comp) Discontinuous: 422/553=0.7631 422/572=0.7378 0.7502                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 795/1729=0.4598 795/1358=0.5854 0.5151                
* (comp) Multi-token  : 1130/1333=0.8477 1130/1358=0.8321 0.8398                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/50=0.0000   0/1=0.0000    0.0000                
* (comp) Single-token : 0/44=0.0000   0/1=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 673/795=0.8465 673/1047=0.6428 0.7307                
* (comp) Seen-in-train: 967/1015=0.9527 967/1047=0.9236 0.9379                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 122/984=0.1240 122/312=0.3910 0.1883                
* (comp) Unseen-in-train: 163/362=0.4503 163/312=0.5224 0.4837                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 395/429=0.9207 395/584=0.6764 0.7799                
* (comp) Variant-of-train: 569/583=0.9760 569/584=0.9743 0.9751                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 278/366=0.7596 278/463=0.6004 0.6707                
* (comp) Identical-to-train: 398/432=0.9213 398/463=0.8596 0.8894                
p-value=(P=0.0000, R=0.0000, F1=0.0000)


Language : FR
Systems : FipsCo.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 795/1779=0.4469 795/1359=0.5850 0.5067                
* (comp) MWE-based    : 1025/1307=0.7842 1025/1359=0.7542 0.7689                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 487/865=0.5630 487/787=0.6188 0.5896                
* (comp) Continuous   : 658/806=0.8164 658/787=0.8361 0.8261                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 308/914=0.3370 308/572=0.5385 0.4145                
* (comp) Discontinuous: 367/501=0.7325 367/572=0.6416 0.6841                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 795/1729=0.4598 795/1358=0.5854 0.5151                
* (comp) Multi-token  : 1024/1265=0.8095 1024/1358=0.7541 0.7808                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/50=0.0000   0/1=0.0000    0.0000                
* (comp) Single-token : 1/42=0.0238   1/1=1.0000    0.0465                
p-value=(P=0.1430, R=0.0000, F1=0.1380)
* (pred) Seen-in-train: 673/795=0.8465 673/1047=0.6428 0.7307                
* (comp) Seen-in-train: 900/957=0.9404 900/1047=0.8596 0.8982                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 122/984=0.1240 122/312=0.3910 0.1883                
* (comp) Unseen-in-train: 125/350=0.3571 125/312=0.4006 0.3776                
p-value=(P=0.0000, R=0.3970, F1=0.0000)
* (pred) Variant-of-train: 395/429=0.9207 395/584=0.6764 0.7799                
* (comp) Variant-of-train: 558/578=0.9654 558/584=0.9555 0.9604                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 278/366=0.7596 278/463=0.6004 0.6707                
* (comp) Identical-to-train: 342/379=0.9024 342/463=0.7387 0.8124                
p-value=(P=0.0000, R=0.0000, F1=0.0000)


Language : FR
Systems : HMSid.open,MTLB-STRUCT.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 922/1444=0.6385 922/1359=0.6784 0.6579                
* (comp) MWE-based    : 1071/1338=0.8004 1071/1359=0.7881 0.7942                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 584/1042=0.5605 584/787=0.7421 0.6386                
* (comp) Continuous   : 667/798=0.8358 667/787=0.8475 0.8416                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 338/402=0.8408 338/572=0.5909 0.6940                
* (comp) Discontinuous: 404/540=0.7481 404/572=0.7063 0.7266                
p-value=(P=0.0000, R=0.0000, F1=0.0580)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 922/1433=0.6434 922/1358=0.6789 0.6607                
* (comp) Multi-token  : 1070/1301=0.8224 1070/1358=0.7879 0.8048                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/11=0.0000   0/1=0.0000    0.0000                
* (comp) Single-token : 1/37=0.0270   1/1=1.0000    0.0526                
p-value=(P=0.1470, R=0.0000, F1=0.1340)
* (pred) Seen-in-train: 750/852=0.8803 750/1047=0.7163 0.7899                
* (comp) Seen-in-train: 926/977=0.9478 926/1047=0.8844 0.9150                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 169/592=0.2855 169/312=0.5417 0.3739                
* (comp) Unseen-in-train: 145/361=0.4017 145/312=0.4647 0.4309                
p-value=(P=0.0000, R=0.0180, F1=0.0150)
* (pred) Variant-of-train: 350/389=0.8997 350/584=0.5993 0.7194                
* (comp) Variant-of-train: 556/571=0.9737 556/584=0.9521 0.9628                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 295/463=0.6371 295/463=0.6371 0.6371                
* (comp) Identical-to-train: 370/406=0.9113 370/463=0.7991 0.8516                
p-value=(P=0.0000, R=0.0000, F1=0.0000)


Language : FR
Systems : HMSid.open,Seen2Unseen.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 922/1444=0.6385 922/1359=0.6784 0.6579                
* (comp) MWE-based    : 1066/1418=0.7518 1066/1359=0.7844 0.7677                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 584/1042=0.5605 584/787=0.7421 0.6386                
* (comp) Continuous   : 680/780=0.8718 680/787=0.8640 0.8679                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 338/402=0.8408 338/572=0.5909 0.6940                
* (comp) Discontinuous: 386/638=0.6050 386/572=0.6748 0.6380                
p-value=(P=0.0000, R=0.0000, F1=0.0040)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 922/1433=0.6434 922/1358=0.6789 0.6607                
* (comp) Multi-token  : 1066/1418=0.7518 1066/1358=0.7850 0.7680                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/11=0.0000   0/1=0.0000    0.0000                
* (comp) Single-token : 0/0=0.0000    0/1=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 750/852=0.8803 750/1047=0.7163 0.7899                
* (comp) Seen-in-train: 995/1158=0.8592 995/1047=0.9503 0.9025                
p-value=(P=0.0240, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 169/592=0.2855 169/312=0.5417 0.3739                
* (comp) Unseen-in-train: 71/260=0.2731 71/312=0.2276 0.2483                
p-value=(P=0.3390, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 350/389=0.8997 350/584=0.5993 0.7194                
* (comp) Variant-of-train: 567/600=0.9450 567/584=0.9709 0.9578                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 295/463=0.6371 295/463=0.6371 0.6371                
* (comp) Identical-to-train: 428/558=0.7670 428/463=0.9244 0.8384                
p-value=(P=0.0000, R=0.0000, F1=0.0000)


Language : FR
Systems : HMSid.open,TRAVIS-mono.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 922/1444=0.6385 922/1359=0.6784 0.6579                
* (comp) MWE-based    : 1130/1377=0.8206 1130/1359=0.8315 0.8260                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 584/1042=0.5605 584/787=0.7421 0.6386                
* (comp) Continuous   : 708/824=0.8592 708/787=0.8996 0.8790                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 338/402=0.8408 338/572=0.5909 0.6940                
* (comp) Discontinuous: 422/553=0.7631 422/572=0.7378 0.7502                
p-value=(P=0.0000, R=0.0000, F1=0.0040)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 922/1433=0.6434 922/1358=0.6789 0.6607                
* (comp) Multi-token  : 1130/1333=0.8477 1130/1358=0.8321 0.8398                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/11=0.0000   0/1=0.0000    0.0000                
* (comp) Single-token : 0/44=0.0000   0/1=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 750/852=0.8803 750/1047=0.7163 0.7899                
* (comp) Seen-in-train: 967/1015=0.9527 967/1047=0.9236 0.9379                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 169/592=0.2855 169/312=0.5417 0.3739                
* (comp) Unseen-in-train: 163/362=0.4503 163/312=0.5224 0.4837                
p-value=(P=0.0000, R=0.3020, F1=0.0000)
* (pred) Variant-of-train: 350/389=0.8997 350/584=0.5993 0.7194                
* (comp) Variant-of-train: 569/583=0.9760 569/584=0.9743 0.9751                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 295/463=0.6371 295/463=0.6371 0.6371                
* (comp) Identical-to-train: 398/432=0.9213 398/463=0.8596 0.8894                
p-value=(P=0.0000, R=0.0000, F1=0.0000)


Language : FR
Systems : HMSid.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 922/1444=0.6385 922/1359=0.6784 0.6579                
* (comp) MWE-based    : 1025/1307=0.7842 1025/1359=0.7542 0.7689                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 584/1042=0.5605 584/787=0.7421 0.6386                
* (comp) Continuous   : 658/806=0.8164 658/787=0.8361 0.8261                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 338/402=0.8408 338/572=0.5909 0.6940                
* (comp) Discontinuous: 367/501=0.7325 367/572=0.6416 0.6841                
p-value=(P=0.0000, R=0.0370, F1=0.3310)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 922/1433=0.6434 922/1358=0.6789 0.6607                
* (comp) Multi-token  : 1024/1265=0.8095 1024/1358=0.7541 0.7808                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/11=0.0000   0/1=0.0000    0.0000                
* (comp) Single-token : 1/42=0.0238   1/1=1.0000    0.0465                
p-value=(P=0.1440, R=0.0000, F1=0.1380)
* (pred) Seen-in-train: 750/852=0.8803 750/1047=0.7163 0.7899                
* (comp) Seen-in-train: 900/957=0.9404 900/1047=0.8596 0.8982                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 169/592=0.2855 169/312=0.5417 0.3739                
* (comp) Unseen-in-train: 125/350=0.3571 125/312=0.4006 0.3776                
p-value=(P=0.0020, R=0.0000, F1=0.4470)
* (pred) Variant-of-train: 350/389=0.8997 350/584=0.5993 0.7194                
* (comp) Variant-of-train: 558/578=0.9654 558/584=0.9555 0.9604                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 295/463=0.6371 295/463=0.6371 0.6371                
* (comp) Identical-to-train: 342/379=0.9024 342/463=0.7387 0.8124                
p-value=(P=0.0000, R=0.0000, F1=0.0000)


Language : FR
Systems : MTLB-STRUCT.open,Seen2Unseen.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 1071/1338=0.8004 1071/1359=0.7881 0.7942                
* (comp) MWE-based    : 1066/1418=0.7518 1066/1359=0.7844 0.7677                
p-value=(P=0.0000, R=0.3800, F1=0.0090)

## MWE continuity (partition of Global)
* (pred) Continuous   : 667/798=0.8358 667/787=0.8475 0.8416                
* (comp) Continuous   : 680/780=0.8718 680/787=0.8640 0.8679                
p-value=(P=0.0120, R=0.1080, F1=0.0110)
* (pred) Discontinuous: 404/540=0.7481 404/572=0.7063 0.7266                
* (comp) Discontinuous: 386/638=0.6050 386/572=0.6748 0.6380                
p-value=(P=0.0000, R=0.0840, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 1070/1301=0.8224 1070/1358=0.7879 0.8048                
* (comp) Multi-token  : 1066/1418=0.7518 1066/1358=0.7850 0.7680                
p-value=(P=0.0000, R=0.4030, F1=0.0000)
* (pred) Single-token : 1/37=0.0270   1/1=1.0000    0.0526                
* (comp) Single-token : 0/0=0.0000    0/1=0.0000    0.0000                
p-value=(P=0.1470, R=0.0000, F1=0.1360)
* (pred) Seen-in-train: 926/977=0.9478 926/1047=0.8844 0.9150                
* (comp) Seen-in-train: 995/1158=0.8592 995/1047=0.9503 0.9025                
p-value=(P=0.0000, R=0.0000, F1=0.0660)
* (pred) Unseen-in-train: 145/361=0.4017 145/312=0.4647 0.4309                
* (comp) Unseen-in-train: 71/260=0.2731 71/312=0.2276 0.2483                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 556/571=0.9737 556/584=0.9521 0.9628                
* (comp) Variant-of-train: 567/600=0.9450 567/584=0.9709 0.9578                
p-value=(P=0.0000, R=0.0380, F1=0.2190)
* (pred) Identical-to-train: 370/406=0.9113 370/463=0.7991 0.8516                
* (comp) Identical-to-train: 428/558=0.7670 428/463=0.9244 0.8384                
p-value=(P=0.0000, R=0.0000, F1=0.2050)


Language : FR
Systems : MTLB-STRUCT.open,TRAVIS-mono.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 1071/1338=0.8004 1071/1359=0.7881 0.7942                
* (comp) MWE-based    : 1130/1377=0.8206 1130/1359=0.8315 0.8260                
p-value=(P=0.0320, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 667/798=0.8358 667/787=0.8475 0.8416                
* (comp) Continuous   : 708/824=0.8592 708/787=0.8996 0.8790                
p-value=(P=0.0470, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 404/540=0.7481 404/572=0.7063 0.7266                
* (comp) Discontinuous: 422/553=0.7631 422/572=0.7378 0.7502                
p-value=(P=0.2000, R=0.0410, F1=0.0600)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 1070/1301=0.8224 1070/1358=0.7879 0.8048                
* (comp) Multi-token  : 1130/1333=0.8477 1130/1358=0.8321 0.8398                
p-value=(P=0.0030, R=0.0000, F1=0.0000)
* (pred) Single-token : 1/37=0.0270   1/1=1.0000    0.0526                
* (comp) Single-token : 0/44=0.0000   0/1=0.0000    0.0000                
p-value=(P=0.1620, R=0.0000, F1=0.1500)
* (pred) Seen-in-train: 926/977=0.9478 926/1047=0.8844 0.9150                
* (comp) Seen-in-train: 967/1015=0.9527 967/1047=0.9236 0.9379                
p-value=(P=0.1540, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 145/361=0.4017 145/312=0.4647 0.4309                
* (comp) Unseen-in-train: 163/362=0.4503 163/312=0.5224 0.4837                
p-value=(P=0.0410, R=0.0420, F1=0.0300)
* (pred) Variant-of-train: 556/571=0.9737 556/584=0.9521 0.9628                
* (comp) Variant-of-train: 569/583=0.9760 569/584=0.9743 0.9751                
p-value=(P=0.2690, R=0.0080, F1=0.0140)
* (pred) Identical-to-train: 370/406=0.9113 370/463=0.7991 0.8516                
* (comp) Identical-to-train: 398/432=0.9213 398/463=0.8596 0.8894                
p-value=(P=0.1720, R=0.0000, F1=0.0010)


Language : FR
Systems : MTLB-STRUCT.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 1071/1338=0.8004 1071/1359=0.7881 0.7942                
* (comp) MWE-based    : 1025/1307=0.7842 1025/1359=0.7542 0.7689                
p-value=(P=0.0610, R=0.0000, F1=0.0030)

## MWE continuity (partition of Global)
* (pred) Continuous   : 667/798=0.8358 667/787=0.8475 0.8416                
* (comp) Continuous   : 658/806=0.8164 658/787=0.8361 0.8261                
p-value=(P=0.0690, R=0.1760, F1=0.0610)
* (pred) Discontinuous: 404/540=0.7481 404/572=0.7063 0.7266                
* (comp) Discontinuous: 367/501=0.7325 367/572=0.6416 0.6841                
p-value=(P=0.2010, R=0.0000, F1=0.0030)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 1070/1301=0.8224 1070/1358=0.7879 0.8048                
* (comp) Multi-token  : 1024/1265=0.8095 1024/1358=0.7541 0.7808                
p-value=(P=0.1000, R=0.0000, F1=0.0020)
* (pred) Single-token : 1/37=0.0270   1/1=1.0000    0.0526                
* (comp) Single-token : 1/42=0.0238   1/1=1.0000    0.0465                
p-value=(P=0.2560, R=1.0000, F1=0.2550)
* (pred) Seen-in-train: 926/977=0.9478 926/1047=0.8844 0.9150                
* (comp) Seen-in-train: 900/957=0.9404 900/1047=0.8596 0.8982                
p-value=(P=0.0410, R=0.0130, F1=0.0030)
* (pred) Unseen-in-train: 145/361=0.4017 145/312=0.4647 0.4309                
* (comp) Unseen-in-train: 125/350=0.3571 125/312=0.4006 0.3776                
p-value=(P=0.0300, R=0.0100, F1=0.0120)
* (pred) Variant-of-train: 556/571=0.9737 556/584=0.9521 0.9628                
* (comp) Variant-of-train: 558/578=0.9654 558/584=0.9555 0.9604                
p-value=(P=0.0170, R=0.3800, F1=0.3420)
* (pred) Identical-to-train: 370/406=0.9113 370/463=0.7991 0.8516                
* (comp) Identical-to-train: 342/379=0.9024 342/463=0.7387 0.8124                
p-value=(P=0.1670, R=0.0020, F1=0.0020)


Language : FR
Systems : Seen2Unseen.open,TRAVIS-mono.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 1066/1418=0.7518 1066/1359=0.7844 0.7677                
* (comp) MWE-based    : 1130/1377=0.8206 1130/1359=0.8315 0.8260                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 680/780=0.8718 680/787=0.8640 0.8679                
* (comp) Continuous   : 708/824=0.8592 708/787=0.8996 0.8790                
p-value=(P=0.2040, R=0.0010, F1=0.1460)
* (pred) Discontinuous: 386/638=0.6050 386/572=0.6748 0.6380                
* (comp) Discontinuous: 422/553=0.7631 422/572=0.7378 0.7502                
p-value=(P=0.0000, R=0.0010, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 1066/1418=0.7518 1066/1358=0.7850 0.7680                
* (comp) Multi-token  : 1130/1333=0.8477 1130/1358=0.8321 0.8398                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/0=0.0000    0/1=0.0000    0.0000                
* (comp) Single-token : 0/44=0.0000   0/1=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 995/1158=0.8592 995/1047=0.9503 0.9025                
* (comp) Seen-in-train: 967/1015=0.9527 967/1047=0.9236 0.9379                
p-value=(P=0.0000, R=0.0050, F1=0.0000)
* (pred) Unseen-in-train: 71/260=0.2731 71/312=0.2276 0.2483                
* (comp) Unseen-in-train: 163/362=0.4503 163/312=0.5224 0.4837                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 567/600=0.9450 567/584=0.9709 0.9578                
* (comp) Variant-of-train: 569/583=0.9760 569/584=0.9743 0.9751                
p-value=(P=0.0000, R=0.3450, F1=0.0020)
* (pred) Identical-to-train: 428/558=0.7670 428/463=0.9244 0.8384                
* (comp) Identical-to-train: 398/432=0.9213 398/463=0.8596 0.8894                
p-value=(P=0.0000, R=0.0010, F1=0.0000)


Language : FR
Systems : Seen2Unseen.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 1066/1418=0.7518 1066/1359=0.7844 0.7677                
* (comp) MWE-based    : 1025/1307=0.7842 1025/1359=0.7542 0.7689                
p-value=(P=0.0050, R=0.0020, F1=0.4700)

## MWE continuity (partition of Global)
* (pred) Continuous   : 680/780=0.8718 680/787=0.8640 0.8679                
* (comp) Continuous   : 658/806=0.8164 658/787=0.8361 0.8261                
p-value=(P=0.0010, R=0.0170, F1=0.0000)
* (pred) Discontinuous: 386/638=0.6050 386/572=0.6748 0.6380                
* (comp) Discontinuous: 367/501=0.7325 367/572=0.6416 0.6841                
p-value=(P=0.0000, R=0.0480, F1=0.0050)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 1066/1418=0.7518 1066/1358=0.7850 0.7680                
* (comp) Multi-token  : 1024/1265=0.8095 1024/1358=0.7541 0.7808                
p-value=(P=0.0000, R=0.0020, F1=0.0850)
* (pred) Single-token : 0/0=0.0000    0/1=0.0000    0.0000                
* (comp) Single-token : 1/42=0.0238   1/1=1.0000    0.0465                
p-value=(P=0.1480, R=0.0000, F1=0.1370)
* (pred) Seen-in-train: 995/1158=0.8592 995/1047=0.9503 0.9025                
* (comp) Seen-in-train: 900/957=0.9404 900/1047=0.8596 0.8982                
p-value=(P=0.0000, R=0.0000, F1=0.2720)
* (pred) Unseen-in-train: 71/260=0.2731 71/312=0.2276 0.2483                
* (comp) Unseen-in-train: 125/350=0.3571 125/312=0.4006 0.3776                
p-value=(P=0.0030, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 567/600=0.9450 567/584=0.9709 0.9578                
* (comp) Variant-of-train: 558/578=0.9654 558/584=0.9555 0.9604                
p-value=(P=0.0100, R=0.0320, F1=0.3490)
* (pred) Identical-to-train: 428/558=0.7670 428/463=0.9244 0.8384                
* (comp) Identical-to-train: 342/379=0.9024 342/463=0.7387 0.8124                
p-value=(P=0.0000, R=0.0000, F1=0.0570)


Language : FR
Systems : TRAVIS-mono.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 1130/1377=0.8206 1130/1359=0.8315 0.8260                
* (comp) MWE-based    : 1025/1307=0.7842 1025/1359=0.7542 0.7689                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 708/824=0.8592 708/787=0.8996 0.8790                
* (comp) Continuous   : 658/806=0.8164 658/787=0.8361 0.8261                
p-value=(P=0.0010, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 422/553=0.7631 422/572=0.7378 0.7502                
* (comp) Discontinuous: 367/501=0.7325 367/572=0.6416 0.6841                
p-value=(P=0.0450, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 1130/1333=0.8477 1130/1358=0.8321 0.8398                
* (comp) Multi-token  : 1024/1265=0.8095 1024/1358=0.7541 0.7808                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/44=0.0000   0/1=0.0000    0.0000                
* (comp) Single-token : 1/42=0.0238   1/1=1.0000    0.0465                
p-value=(P=0.1430, R=0.0000, F1=0.1360)
* (pred) Seen-in-train: 967/1015=0.9527 967/1047=0.9236 0.9379                
* (comp) Seen-in-train: 900/957=0.9404 900/1047=0.8596 0.8982                
p-value=(P=0.0290, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 163/362=0.4503 163/312=0.5224 0.4837                
* (comp) Unseen-in-train: 125/350=0.3571 125/312=0.4006 0.3776                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 569/583=0.9760 569/584=0.9743 0.9751                
* (comp) Variant-of-train: 558/578=0.9654 558/584=0.9555 0.9604                
p-value=(P=0.0180, R=0.0220, F1=0.0030)
* (pred) Identical-to-train: 398/432=0.9213 398/463=0.8596 0.8894                
* (comp) Identical-to-train: 342/379=0.9024 342/463=0.7387 0.8124                
p-value=(P=0.0840, R=0.0000, F1=0.0000)



Language : GA
Systems : ERMI.closed,Seen2Seen.closed
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 61/187=0.3262 61/436=0.1399 0.1958                
* (comp) MWE-based    : 71/92=0.7717  71/436=0.1628 0.2689                
p-value=(P=0.0000, R=0.1260, F1=0.0040)

## MWE continuity (partition of Global)
* (pred) Continuous   : 46/162=0.2840 46/194=0.2371 0.2584                
* (comp) Continuous   : 48/54=0.8889  48/194=0.2474 0.3871                
p-value=(P=0.0000, R=0.3680, F1=0.0010)
* (pred) Discontinuous: 15/25=0.6000  15/242=0.0620 0.1124                
* (comp) Discontinuous: 23/38=0.6053  23/242=0.0950 0.1643                
p-value=(P=0.4830, R=0.0590, F1=0.0590)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 61/99=0.6162  61/435=0.1402 0.2285                
* (comp) Multi-token  : 71/92=0.7717  71/435=0.1632 0.2694                
p-value=(P=0.0010, R=0.1260, F1=0.0770)
* (pred) Single-token : 0/88=0.0000   0/1=0.0000    0.0000                
* (comp) Single-token : 0/0=0.0000    0/1=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 30/34=0.8824  30/83=0.3614  0.5128                
* (comp) Seen-in-train: 65/86=0.7558  65/83=0.7831  0.7692                
p-value=(P=0.0140, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 31/153=0.2026 31/353=0.0878 0.1225                
* (comp) Unseen-in-train: 6/6=1.0000    6/353=0.0170  0.0334                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 9/11=0.8182   9/15=0.6000   0.6923                
* (comp) Variant-of-train: 14/18=0.7778  14/15=0.9333  0.8485                
p-value=(P=0.2870, R=0.0030, F1=0.0600)
* (pred) Identical-to-train: 21/23=0.9130  21/68=0.3088  0.4615                
* (comp) Identical-to-train: 51/68=0.7500  51/68=0.7500  0.7500                
p-value=(P=0.0070, R=0.0000, F1=0.0000)



Language : GA
Systems : FipsCo.open,HMSid.open


Language : GA
Systems : FipsCo.open,MTLB-STRUCT.open


Language : GA
Systems : FipsCo.open,Seen2Unseen.open


Language : GA
Systems : FipsCo.open,TRAVIS-mono.open


Language : GA
Systems : FipsCo.open,TRAVIS-multi.open


Language : GA
Systems : HMSid.open,MTLB-STRUCT.open


Language : GA
Systems : HMSid.open,Seen2Unseen.open


Language : GA
Systems : HMSid.open,TRAVIS-mono.open


Language : GA
Systems : HMSid.open,TRAVIS-multi.open


Language : GA
Systems : MTLB-STRUCT.open,Seen2Unseen.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 109/289=0.3772 109/436=0.2500 0.3007                
* (comp) MWE-based    : 102/231=0.4416 102/436=0.2339 0.3058                
p-value=(P=0.0520, R=0.2340, F1=0.4230)

## MWE continuity (partition of Global)
* (pred) Continuous   : 66/202=0.3267 66/194=0.3402 0.3333                
* (comp) Continuous   : 62/98=0.6327  62/194=0.3196 0.4247                
p-value=(P=0.0000, R=0.2840, F1=0.0100)
* (pred) Discontinuous: 43/87=0.4943  43/242=0.1777 0.2614                
* (comp) Discontinuous: 40/133=0.3008 40/242=0.1653 0.2133                
p-value=(P=0.0000, R=0.3180, F1=0.0880)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 109/194=0.5619 109/435=0.2506 0.3466                
* (comp) Multi-token  : 102/231=0.4416 102/435=0.2345 0.3063                
p-value=(P=0.0040, R=0.2330, F1=0.0660)
* (pred) Single-token : 0/95=0.0000   0/1=0.0000    0.0000                
* (comp) Single-token : 0/0=0.0000    0/1=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 44/50=0.8800  44/83=0.5301  0.6617                
* (comp) Seen-in-train: 66/87=0.7586  66/83=0.7952  0.7765                
p-value=(P=0.0130, R=0.0010, F1=0.0140)
* (pred) Unseen-in-train: 65/239=0.2720 65/353=0.1841 0.2196                
* (comp) Unseen-in-train: 36/144=0.2500 36/353=0.1020 0.1449                
p-value=(P=0.3050, R=0.0000, F1=0.0050)
* (pred) Variant-of-train: 12/14=0.8571  12/15=0.8000  0.8276                
* (comp) Variant-of-train: 14/18=0.7778  14/15=0.9333  0.8485                
p-value=(P=0.1360, R=0.0610, F1=0.3670)
* (pred) Identical-to-train: 32/36=0.8889  32/68=0.4706  0.6154                
* (comp) Identical-to-train: 52/69=0.7536  52/68=0.7647  0.7591                
p-value=(P=0.0170, R=0.0000, F1=0.0120)


Language : GA
Systems : MTLB-STRUCT.open,TRAVIS-mono.open


Language : GA
Systems : MTLB-STRUCT.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 109/289=0.3772 109/436=0.2500 0.3007                
* (comp) MWE-based    : 22/178=0.1236 22/436=0.0505 0.0717                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 66/202=0.3267 66/194=0.3402 0.3333                
* (comp) Continuous   : 11/146=0.0753 11/194=0.0567 0.0647                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 43/87=0.4943  43/242=0.1777 0.2614                
* (comp) Discontinuous: 11/32=0.3438  11/242=0.0455 0.0803                
p-value=(P=0.0310, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 109/194=0.5619 109/435=0.2506 0.3466                
* (comp) Multi-token  : 22/49=0.4490  22/435=0.0506 0.0909                
p-value=(P=0.0460, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/95=0.0000   0/1=0.0000    0.0000                
* (comp) Single-token : 0/129=0.0000  0/1=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 44/50=0.8800  44/83=0.5301  0.6617                
* (comp) Seen-in-train: 13/15=0.8667  13/83=0.1566  0.2653                
p-value=(P=0.4230, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 65/239=0.2720 65/353=0.1841 0.2196                
* (comp) Unseen-in-train: 9/163=0.0552  9/353=0.0255  0.0349                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 12/14=0.8571  12/15=0.8000  0.8276                
* (comp) Variant-of-train: 7/7=1.0000    7/15=0.4667   0.6364                
p-value=(P=0.0710, R=0.0180, F1=0.1200)
* (pred) Identical-to-train: 32/36=0.8889  32/68=0.4706  0.6154                
* (comp) Identical-to-train: 6/8=0.7500    6/68=0.0882   0.1579                
p-value=(P=0.1990, R=0.0000, F1=0.0000)


Language : GA
Systems : Seen2Unseen.open,TRAVIS-mono.open


Language : GA
Systems : Seen2Unseen.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 102/231=0.4416 102/436=0.2339 0.3058                
* (comp) MWE-based    : 22/178=0.1236 22/436=0.0505 0.0717                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 62/98=0.6327  62/194=0.3196 0.4247                
* (comp) Continuous   : 11/146=0.0753 11/194=0.0567 0.0647                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 40/133=0.3008 40/242=0.1653 0.2133                
* (comp) Discontinuous: 11/32=0.3438  11/242=0.0455 0.0803                
p-value=(P=0.2670, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 102/231=0.4416 102/435=0.2345 0.3063                
* (comp) Multi-token  : 22/49=0.4490  22/435=0.0506 0.0909                
p-value=(P=0.4260, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/0=0.0000    0/1=0.0000    0.0000                
* (comp) Single-token : 0/129=0.0000  0/1=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 66/87=0.7586  66/83=0.7952  0.7765                
* (comp) Seen-in-train: 13/15=0.8667  13/83=0.1566  0.2653                
p-value=(P=0.1260, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 36/144=0.2500 36/353=0.1020 0.1449                
* (comp) Unseen-in-train: 9/163=0.0552  9/353=0.0255  0.0349                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 14/18=0.7778  14/15=0.9333  0.8485                
* (comp) Variant-of-train: 7/7=1.0000    7/15=0.4667   0.6364                
p-value=(P=0.0280, R=0.0010, F1=0.0680)
* (pred) Identical-to-train: 52/69=0.7536  52/68=0.7647  0.7591                
* (comp) Identical-to-train: 6/8=0.7500    6/68=0.0882   0.1579                
p-value=(P=0.4950, R=0.0000, F1=0.0000)


Language : GA
Systems : TRAVIS-mono.open,TRAVIS-multi.open



Language : HE
Systems : ERMI.closed,Seen2Seen.closed
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 125/299=0.4181 125/503=0.2485 0.3117                
* (comp) MWE-based    : 160/243=0.6584 160/503=0.3181 0.4290                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 112/269=0.4164 112/383=0.2924 0.3436                
* (comp) Continuous   : 129/179=0.7207 129/383=0.3368 0.4591                
p-value=(P=0.0000, R=0.0230, F1=0.0000)
* (pred) Discontinuous: 13/30=0.4333  13/120=0.1083 0.1733                
* (comp) Discontinuous: 31/64=0.4844  31/120=0.2583 0.3370                
p-value=(P=0.2860, R=0.0000, F1=0.0010)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 125/270=0.4630 125/492=0.2541 0.3281                
* (comp) Multi-token  : 160/243=0.6584 160/492=0.3252 0.4354                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/29=0.0000   0/11=0.0000   0.0000                
* (comp) Single-token : 0/0=0.0000    0/11=0.0000   0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 101/122=0.8279 101/193=0.5233 0.6413                
* (comp) Seen-in-train: 160/243=0.6584 160/193=0.8290 0.7339                
p-value=(P=0.0000, R=0.0000, F1=0.0080)
* (pred) Unseen-in-train: 24/177=0.1356 24/310=0.0774 0.0986                
* (comp) Unseen-in-train: 0/0=0.0000    0/310=0.0000  0.0000                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 86/88=0.9773  86/136=0.6324 0.7679                
* (comp) Variant-of-train: 113/119=0.9496 113/136=0.8309 0.8863                
p-value=(P=0.0640, R=0.0000, F1=0.0020)
* (pred) Identical-to-train: 15/34=0.4412  15/57=0.2632  0.3297                
* (comp) Identical-to-train: 47/124=0.3790 47/57=0.8246  0.5193                
p-value=(P=0.1870, R=0.0000, F1=0.0030)



Language : HE
Systems : FipsCo.open,HMSid.open


Language : HE
Systems : FipsCo.open,MTLB-STRUCT.open


Language : HE
Systems : FipsCo.open,Seen2Unseen.open


Language : HE
Systems : FipsCo.open,TRAVIS-mono.open


Language : HE
Systems : FipsCo.open,TRAVIS-multi.open


Language : HE
Systems : HMSid.open,MTLB-STRUCT.open


Language : HE
Systems : HMSid.open,Seen2Unseen.open


Language : HE
Systems : HMSid.open,TRAVIS-mono.open


Language : HE
Systems : HMSid.open,TRAVIS-multi.open


Language : HE
Systems : MTLB-STRUCT.open,Seen2Unseen.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 213/379=0.5620 213/503=0.4235 0.4830                
* (comp) MWE-based    : 169/381=0.4436 169/503=0.3360 0.3824                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 176/314=0.5605 176/383=0.4595 0.5050                
* (comp) Continuous   : 138/309=0.4466 138/383=0.3603 0.3988                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 37/65=0.5692  37/120=0.3083 0.4000                
* (comp) Discontinuous: 31/72=0.4306  31/120=0.2583 0.3229                
p-value=(P=0.0290, R=0.1520, F1=0.0770)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 212/349=0.6074 212/492=0.4309 0.5042                
* (comp) Multi-token  : 169/381=0.4436 169/492=0.3435 0.3872                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 1/30=0.0333   1/11=0.0909   0.0488                
* (comp) Single-token : 0/0=0.0000    0/11=0.0000   0.0000                
p-value=(P=0.1190, R=0.1340, F1=0.1120)
* (pred) Seen-in-train: 159/186=0.8548 159/193=0.8238 0.8391                
* (comp) Seen-in-train: 164/252=0.6508 164/193=0.8497 0.7371                
p-value=(P=0.0000, R=0.2420, F1=0.0000)
* (pred) Unseen-in-train: 54/193=0.2798 54/310=0.1742 0.2147                
* (comp) Unseen-in-train: 5/129=0.0388  5/310=0.0161  0.0228                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 119/123=0.9675 119/136=0.8750 0.9189                
* (comp) Variant-of-train: 116/122=0.9508 116/136=0.8529 0.8992                
p-value=(P=0.1830, R=0.2380, F1=0.1440)
* (pred) Identical-to-train: 40/63=0.6349  40/57=0.7018  0.6667                
* (comp) Identical-to-train: 48/130=0.3692 48/57=0.8421  0.5134                
p-value=(P=0.0000, R=0.0450, F1=0.0020)


Language : HE
Systems : MTLB-STRUCT.open,TRAVIS-mono.open


Language : HE
Systems : MTLB-STRUCT.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 213/379=0.5620 213/503=0.4235 0.4830                
* (comp) MWE-based    : 178/343=0.5190 178/503=0.3539 0.4208                
p-value=(P=0.0500, R=0.0000, F1=0.0010)

## MWE continuity (partition of Global)
* (pred) Continuous   : 176/314=0.5605 176/383=0.4595 0.5050                
* (comp) Continuous   : 150/294=0.5102 150/383=0.3916 0.4431                
p-value=(P=0.0260, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 37/65=0.5692  37/120=0.3083 0.4000                
* (comp) Discontinuous: 28/49=0.5714  28/120=0.2333 0.3314                
p-value=(P=0.4950, R=0.0150, F1=0.0360)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 212/349=0.6074 212/492=0.4309 0.5042                
* (comp) Multi-token  : 177/299=0.5920 177/492=0.3598 0.4475                
p-value=(P=0.2700, R=0.0000, F1=0.0010)
* (pred) Single-token : 1/30=0.0333   1/11=0.0909   0.0488                
* (comp) Single-token : 1/44=0.0227   1/11=0.0909   0.0364                
p-value=(P=0.3950, R=1.0000, F1=0.3960)
* (pred) Seen-in-train: 159/186=0.8548 159/193=0.8238 0.8391                
* (comp) Seen-in-train: 141/169=0.8343 141/193=0.7306 0.7790                
p-value=(P=0.1760, R=0.0010, F1=0.0010)
* (pred) Unseen-in-train: 54/193=0.2798 54/310=0.1742 0.2147                
* (comp) Unseen-in-train: 37/174=0.2126 37/310=0.1194 0.1529                
p-value=(P=0.0260, R=0.0040, F1=0.0040)
* (pred) Variant-of-train: 119/123=0.9675 119/136=0.8750 0.9189                
* (comp) Variant-of-train: 105/108=0.9722 105/136=0.7721 0.8607                
p-value=(P=0.3560, R=0.0000, F1=0.0060)
* (pred) Identical-to-train: 40/63=0.6349  40/57=0.7018  0.6667                
* (comp) Identical-to-train: 36/61=0.5902  36/57=0.6316  0.6102                
p-value=(P=0.1630, R=0.1250, F1=0.1140)


Language : HE
Systems : Seen2Unseen.open,TRAVIS-mono.open


Language : HE
Systems : Seen2Unseen.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 169/381=0.4436 169/503=0.3360 0.3824                
* (comp) MWE-based    : 178/343=0.5190 178/503=0.3539 0.4208                
p-value=(P=0.0070, R=0.2280, F1=0.0390)

## MWE continuity (partition of Global)
* (pred) Continuous   : 138/309=0.4466 138/383=0.3603 0.3988                
* (comp) Continuous   : 150/294=0.5102 150/383=0.3916 0.4431                
p-value=(P=0.0160, R=0.0880, F1=0.0240)
* (pred) Discontinuous: 31/72=0.4306  31/120=0.2583 0.3229                
* (comp) Discontinuous: 28/49=0.5714  28/120=0.2333 0.3314                
p-value=(P=0.0380, R=0.2900, F1=0.4420)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 169/381=0.4436 169/492=0.3435 0.3872                
* (comp) Multi-token  : 177/299=0.5920 177/492=0.3598 0.4475                
p-value=(P=0.0000, R=0.2480, F1=0.0040)
* (pred) Single-token : 0/0=0.0000    0/11=0.0000   0.0000                
* (comp) Single-token : 1/44=0.0227   1/11=0.0909   0.0364                
p-value=(P=0.1610, R=0.1540, F1=0.1560)
* (pred) Seen-in-train: 164/252=0.6508 164/193=0.8497 0.7371                
* (comp) Seen-in-train: 141/169=0.8343 141/193=0.7306 0.7790                
p-value=(P=0.0000, R=0.0030, F1=0.0820)
* (pred) Unseen-in-train: 5/129=0.0388  5/310=0.0161  0.0228                
* (comp) Unseen-in-train: 37/174=0.2126 37/310=0.1194 0.1529                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 116/122=0.9508 116/136=0.8529 0.8992                
* (comp) Variant-of-train: 105/108=0.9722 105/136=0.7721 0.8607                
p-value=(P=0.1140, R=0.0270, F1=0.0760)
* (pred) Identical-to-train: 48/130=0.3692 48/57=0.8421  0.5134                
* (comp) Identical-to-train: 36/61=0.5902  36/57=0.6316  0.6102                
p-value=(P=0.0000, R=0.0050, F1=0.0600)


Language : HE
Systems : TRAVIS-mono.open,TRAVIS-multi.open



Language : HI
Systems : ERMI.closed,Seen2Seen.closed
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 379/597=0.6348 379/673=0.5632 0.5969                
* (comp) MWE-based    : 264/305=0.8656 264/673=0.3923 0.5399                
p-value=(P=0.0000, R=0.0000, F1=0.0110)

## MWE continuity (partition of Global)
* (pred) Continuous   : 366/560=0.6536 366/623=0.5875 0.6188                
* (comp) Continuous   : 253/265=0.9547 253/623=0.4061 0.5698                
p-value=(P=0.0000, R=0.0000, F1=0.0190)
* (pred) Discontinuous: 13/37=0.3514  13/50=0.2600  0.2989                
* (comp) Discontinuous: 11/40=0.2750  11/50=0.2200  0.2444                
p-value=(P=0.2050, R=0.2980, F1=0.2480)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 379/479=0.7912 379/673=0.5632 0.6580                
* (comp) Multi-token  : 264/305=0.8656 264/673=0.3923 0.5399                
p-value=(P=0.0060, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/118=0.0000  0/0=0.0000    0.0000                
* (comp) Single-token : 0/0=0.0000    0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 204/207=0.9855 204/303=0.6733 0.8000                
* (comp) Seen-in-train: 264/292=0.9041 264/303=0.8713 0.8874                
p-value=(P=0.0000, R=0.0000, F1=0.0010)
* (pred) Unseen-in-train: 175/390=0.4487 175/370=0.4730 0.4605                
* (comp) Unseen-in-train: 0/13=0.0000   0/370=0.0000  0.0000                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 123/125=0.9840 123/157=0.7834 0.8723                
* (comp) Variant-of-train: 142/144=0.9861 142/157=0.9045 0.9435                
p-value=(P=0.1190, R=0.0020, F1=0.0040)
* (pred) Identical-to-train: 81/82=0.9878  81/146=0.5548 0.7105                
* (comp) Identical-to-train: 122/148=0.8243 122/146=0.8356 0.8299                
p-value=(P=0.0000, R=0.0000, F1=0.0010)



Language : HI
Systems : FipsCo.open,HMSid.open


Language : HI
Systems : FipsCo.open,MTLB-STRUCT.open


Language : HI
Systems : FipsCo.open,Seen2Unseen.open


Language : HI
Systems : FipsCo.open,TRAVIS-mono.open


Language : HI
Systems : FipsCo.open,TRAVIS-multi.open


Language : HI
Systems : HMSid.open,MTLB-STRUCT.open


Language : HI
Systems : HMSid.open,Seen2Unseen.open


Language : HI
Systems : HMSid.open,TRAVIS-mono.open


Language : HI
Systems : HMSid.open,TRAVIS-multi.open


Language : HI
Systems : MTLB-STRUCT.open,Seen2Unseen.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 505/699=0.7225 505/673=0.7504 0.7362                
* (comp) MWE-based    : 397/587=0.6763 397/673=0.5899 0.6302                
p-value=(P=0.0120, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 486/664=0.7319 486/623=0.7801 0.7552                
* (comp) Continuous   : 381/524=0.7271 381/623=0.6116 0.6643                
p-value=(P=0.4120, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 19/35=0.5429  19/50=0.3800  0.4471                
* (comp) Discontinuous: 16/63=0.2540  16/50=0.3200  0.2832                
p-value=(P=0.0000, R=0.2460, F1=0.0130)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 505/626=0.8067 505/673=0.7504 0.7775                
* (comp) Multi-token  : 397/587=0.6763 397/673=0.5899 0.6302                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/73=0.0000   0/0=0.0000    0.0000                
* (comp) Single-token : 0/0=0.0000    0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 272/277=0.9819 272/303=0.8977 0.9379                
* (comp) Seen-in-train: 271/299=0.9064 271/303=0.8944 0.9003                
p-value=(P=0.0000, R=0.4390, F1=0.0060)
* (pred) Unseen-in-train: 233/422=0.5521 233/370=0.6297 0.5884                
* (comp) Unseen-in-train: 126/288=0.4375 126/370=0.3405 0.3830                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 152/154=0.9870 152/157=0.9682 0.9775                
* (comp) Variant-of-train: 144/146=0.9863 144/157=0.9172 0.9505                
p-value=(P=0.1330, R=0.0190, F1=0.0220)
* (pred) Identical-to-train: 120/123=0.9756 120/146=0.8219 0.8922                
* (comp) Identical-to-train: 127/153=0.8301 127/146=0.8699 0.8495                
p-value=(P=0.0000, R=0.0980, F1=0.0560)


Language : HI
Systems : MTLB-STRUCT.open,TRAVIS-mono.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 505/699=0.7225 505/673=0.7504 0.7362                
* (comp) MWE-based    : 17/28=0.6071  17/673=0.0253 0.0485                
p-value=(P=0.1130, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 486/664=0.7319 486/623=0.7801 0.7552                
* (comp) Continuous   : 17/28=0.6071  17/623=0.0273 0.0522                
p-value=(P=0.0950, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 19/35=0.5429  19/50=0.3800  0.4471                
* (comp) Discontinuous: 0/0=0.0000    0/50=0.0000   0.0000                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 505/626=0.8067 505/673=0.7504 0.7775                
* (comp) Multi-token  : 17/18=0.9444  17/673=0.0253 0.0492                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/73=0.0000   0/0=0.0000    0.0000                
* (comp) Single-token : 0/10=0.0000   0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 272/277=0.9819 272/303=0.8977 0.9379                
* (comp) Seen-in-train: 16/16=1.0000  16/303=0.0528 0.1003                
p-value=(P=0.0260, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 233/422=0.5521 233/370=0.6297 0.5884                
* (comp) Unseen-in-train: 1/12=0.0833   1/370=0.0027  0.0052                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 152/154=0.9870 152/157=0.9682 0.9775                
* (comp) Variant-of-train: 5/5=1.0000    5/157=0.0318  0.0617                
p-value=(P=0.0900, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 120/123=0.9756 120/146=0.8219 0.8922                
* (comp) Identical-to-train: 11/11=1.0000  11/146=0.0753 0.1401                
p-value=(P=0.0510, R=0.0000, F1=0.0000)


Language : HI
Systems : MTLB-STRUCT.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 505/699=0.7225 505/673=0.7504 0.7362                
* (comp) MWE-based    : 342/665=0.5143 342/673=0.5082 0.5112                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 486/664=0.7319 486/623=0.7801 0.7552                
* (comp) Continuous   : 323/621=0.5201 323/623=0.5185 0.5193                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 19/35=0.5429  19/50=0.3800  0.4471                
* (comp) Discontinuous: 19/44=0.4318  19/50=0.3800  0.4043                
p-value=(P=0.0620, R=1.0000, F1=0.2260)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 505/626=0.8067 505/673=0.7504 0.7775                
* (comp) Multi-token  : 342/500=0.6840 342/673=0.5082 0.5831                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/73=0.0000   0/0=0.0000    0.0000                
* (comp) Single-token : 0/165=0.0000  0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 272/277=0.9819 272/303=0.8977 0.9379                
* (comp) Seen-in-train: 165/168=0.9821 165/303=0.5446 0.7006                
p-value=(P=0.4940, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 233/422=0.5521 233/370=0.6297 0.5884                
* (comp) Unseen-in-train: 177/497=0.3561 177/370=0.4784 0.4083                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 152/154=0.9870 152/157=0.9682 0.9775                
* (comp) Variant-of-train: 87/88=0.9886  87/157=0.5541 0.7102                
p-value=(P=0.4010, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 120/123=0.9756 120/146=0.8219 0.8922                
* (comp) Identical-to-train: 78/80=0.9750  78/146=0.5342 0.6903                
p-value=(P=0.4780, R=0.0000, F1=0.0000)


Language : HI
Systems : Seen2Unseen.open,TRAVIS-mono.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 397/587=0.6763 397/673=0.5899 0.6302                
* (comp) MWE-based    : 17/28=0.6071  17/673=0.0253 0.0485                
p-value=(P=0.2330, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 381/524=0.7271 381/623=0.6116 0.6643                
* (comp) Continuous   : 17/28=0.6071  17/623=0.0273 0.0522                
p-value=(P=0.1130, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 16/63=0.2540  16/50=0.3200  0.2832                
* (comp) Discontinuous: 0/0=0.0000    0/50=0.0000   0.0000                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 397/587=0.6763 397/673=0.5899 0.6302                
* (comp) Multi-token  : 17/18=0.9444  17/673=0.0253 0.0492                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/0=0.0000    0/0=0.0000    0.0000                
* (comp) Single-token : 0/10=0.0000   0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 271/299=0.9064 271/303=0.8944 0.9003                
* (comp) Seen-in-train: 16/16=1.0000  16/303=0.0528 0.1003                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 126/288=0.4375 126/370=0.3405 0.3830                
* (comp) Unseen-in-train: 1/12=0.0833   1/370=0.0027  0.0052                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 144/146=0.9863 144/157=0.9172 0.9505                
* (comp) Variant-of-train: 5/5=1.0000    5/157=0.0318  0.0617                
p-value=(P=0.0810, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 127/153=0.8301 127/146=0.8699 0.8495                
* (comp) Identical-to-train: 11/11=1.0000  11/146=0.0753 0.1401                
p-value=(P=0.0000, R=0.0000, F1=0.0000)


Language : HI
Systems : Seen2Unseen.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 397/587=0.6763 397/673=0.5899 0.6302                
* (comp) MWE-based    : 342/665=0.5143 342/673=0.5082 0.5112                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 381/524=0.7271 381/623=0.6116 0.6643                
* (comp) Continuous   : 323/621=0.5201 323/623=0.5185 0.5193                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 16/63=0.2540  16/50=0.3200  0.2832                
* (comp) Discontinuous: 19/44=0.4318  19/50=0.3800  0.4043                
p-value=(P=0.0090, R=0.2320, F1=0.0340)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 397/587=0.6763 397/673=0.5899 0.6302                
* (comp) Multi-token  : 342/500=0.6840 342/673=0.5082 0.5831                
p-value=(P=0.3620, R=0.0000, F1=0.0110)
* (pred) Single-token : 0/0=0.0000    0/0=0.0000    0.0000                
* (comp) Single-token : 0/165=0.0000  0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 271/299=0.9064 271/303=0.8944 0.9003                
* (comp) Seen-in-train: 165/168=0.9821 165/303=0.5446 0.7006                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 126/288=0.4375 126/370=0.3405 0.3830                
* (comp) Unseen-in-train: 177/497=0.3561 177/370=0.4784 0.4083                
p-value=(P=0.0040, R=0.0000, F1=0.2010)
* (pred) Variant-of-train: 144/146=0.9863 144/157=0.9172 0.9505                
* (comp) Variant-of-train: 87/88=0.9886  87/157=0.5541 0.7102                
p-value=(P=0.3370, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 127/153=0.8301 127/146=0.8699 0.8495                
* (comp) Identical-to-train: 78/80=0.9750  78/146=0.5342 0.6903                
p-value=(P=0.0000, R=0.0000, F1=0.0000)


Language : HI
Systems : TRAVIS-mono.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 17/28=0.6071  17/673=0.0253 0.0485                
* (comp) MWE-based    : 342/665=0.5143 342/673=0.5082 0.5112                
p-value=(P=0.1760, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 17/28=0.6071  17/623=0.0273 0.0522                
* (comp) Continuous   : 323/621=0.5201 323/623=0.5185 0.5193                
p-value=(P=0.1920, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 0/0=0.0000    0/50=0.0000   0.0000                
* (comp) Discontinuous: 19/44=0.4318  19/50=0.3800  0.4043                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 17/18=0.9444  17/673=0.0253 0.0492                
* (comp) Multi-token  : 342/500=0.6840 342/673=0.5082 0.5831                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/10=0.0000   0/0=0.0000    0.0000                
* (comp) Single-token : 0/165=0.0000  0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 16/16=1.0000  16/303=0.0528 0.1003                
* (comp) Seen-in-train: 165/168=0.9821 165/303=0.5446 0.7006                
p-value=(P=0.0500, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 1/12=0.0833   1/370=0.0027  0.0052                
* (comp) Unseen-in-train: 177/497=0.3561 177/370=0.4784 0.4083                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 5/5=1.0000    5/157=0.0318  0.0617                
* (comp) Variant-of-train: 87/88=0.9886  87/157=0.5541 0.7102                
p-value=(P=0.1380, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 11/11=1.0000  11/146=0.0753 0.1401                
* (comp) Identical-to-train: 78/80=0.9750  78/146=0.5342 0.6903                
p-value=(P=0.0850, R=0.0000, F1=0.0000)



Language : IT
Systems : ERMI.closed,Seen2Seen.closed
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 338/510=0.6627 338/1032=0.3275 0.4384                
* (comp) MWE-based    : 643/949=0.6776 643/1032=0.6231 0.6492                
p-value=(P=0.2760, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 309/466=0.6631 309/733=0.4216 0.5154                
* (comp) Continuous   : 501/735=0.6816 501/733=0.6835 0.6826                
p-value=(P=0.2360, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 29/44=0.6591  29/299=0.0970 0.1691                
* (comp) Discontinuous: 142/214=0.6636 142/299=0.4749 0.5536                
p-value=(P=0.4890, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 338/469=0.7207 338/1030=0.3282 0.4510                
* (comp) Multi-token  : 643/949=0.6776 643/1030=0.6243 0.6498                
p-value=(P=0.0260, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/41=0.0000   0/2=0.0000    0.0000                
* (comp) Single-token : 0/0=0.0000    0/2=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 305/334=0.9132 305/712=0.4284 0.5832                
* (comp) Seen-in-train: 642/944=0.6801 642/712=0.9017 0.7754                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 33/176=0.1875 33/320=0.1031 0.1331                
* (comp) Unseen-in-train: 1/5=0.2000    1/320=0.0031  0.0062                
p-value=(P=0.4440, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 195/212=0.9198 195/310=0.6290 0.7471                
* (comp) Variant-of-train: 297/392=0.7577 297/310=0.9581 0.8462                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 110/122=0.9016 110/402=0.2736 0.4198                
* (comp) Identical-to-train: 345/552=0.6250 345/402=0.8582 0.7233                
p-value=(P=0.0000, R=0.0000, F1=0.0000)



Language : IT
Systems : FipsCo.open,HMSid.open


Language : IT
Systems : FipsCo.open,MTLB-STRUCT.open


Language : IT
Systems : FipsCo.open,Seen2Unseen.open


Language : IT
Systems : FipsCo.open,TRAVIS-mono.open


Language : IT
Systems : FipsCo.open,TRAVIS-multi.open


Language : IT
Systems : HMSid.open,MTLB-STRUCT.open


Language : IT
Systems : HMSid.open,Seen2Unseen.open


Language : IT
Systems : HMSid.open,TRAVIS-mono.open


Language : IT
Systems : HMSid.open,TRAVIS-multi.open


Language : IT
Systems : MTLB-STRUCT.open,Seen2Unseen.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 622/919=0.6768 622/1032=0.6027 0.6376                
* (comp) MWE-based    : 667/1128=0.5913 667/1032=0.6463 0.6176                
p-value=(P=0.0000, R=0.0000, F1=0.0630)

## MWE continuity (partition of Global)
* (pred) Continuous   : 496/701=0.7076 496/733=0.6767 0.6918                
* (comp) Continuous   : 520/883=0.5889 520/733=0.7094 0.6436                
p-value=(P=0.0000, R=0.0230, F1=0.0000)
* (pred) Discontinuous: 126/218=0.5780 126/299=0.4214 0.4874                
* (comp) Discontinuous: 147/245=0.6000 147/299=0.4916 0.5404                
p-value=(P=0.2640, R=0.0090, F1=0.0320)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 620/869=0.7135 620/1030=0.6019 0.6530                
* (comp) Multi-token  : 667/1128=0.5913 667/1030=0.6476 0.6182                
p-value=(P=0.0000, R=0.0000, F1=0.0050)
* (pred) Single-token : 2/50=0.0400   2/2=1.0000    0.0769                
* (comp) Single-token : 0/0=0.0000    0/2=0.0000    0.0000                
p-value=(P=0.0920, R=0.0000, F1=0.0770)
* (pred) Seen-in-train: 549/592=0.9274 549/712=0.7711 0.8420                
* (comp) Seen-in-train: 646/949=0.6807 646/712=0.9073 0.7778                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 73/327=0.2232 73/320=0.2281 0.2257                
* (comp) Unseen-in-train: 21/179=0.1173 21/320=0.0656 0.0842                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 287/308=0.9318 287/310=0.9258 0.9288                
* (comp) Variant-of-train: 297/392=0.7577 297/310=0.9581 0.8462                
p-value=(P=0.0000, R=0.0300, F1=0.0000)
* (pred) Identical-to-train: 262/284=0.9225 262/402=0.6517 0.7638                
* (comp) Identical-to-train: 349/557=0.6266 349/402=0.8682 0.7278                
p-value=(P=0.0000, R=0.0000, F1=0.0480)


Language : IT
Systems : MTLB-STRUCT.open,TRAVIS-mono.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 622/919=0.6768 622/1032=0.6027 0.6376                
* (comp) MWE-based    : 615/973=0.6321 615/1032=0.5959 0.6135                
p-value=(P=0.0040, R=0.2960, F1=0.0330)

## MWE continuity (partition of Global)
* (pred) Continuous   : 496/701=0.7076 496/733=0.6767 0.6918                
* (comp) Continuous   : 487/735=0.6626 487/733=0.6644 0.6635                
p-value=(P=0.0070, R=0.2300, F1=0.0170)
* (pred) Discontinuous: 126/218=0.5780 126/299=0.4214 0.4874                
* (comp) Discontinuous: 128/238=0.5378 128/299=0.4281 0.4767                
p-value=(P=0.1050, R=0.4210, F1=0.3260)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 620/869=0.7135 620/1030=0.6019 0.6530                
* (comp) Multi-token  : 614/879=0.6985 614/1030=0.5961 0.6433                
p-value=(P=0.1640, R=0.3270, F1=0.2170)
* (pred) Single-token : 2/50=0.0400   2/2=1.0000    0.0769                
* (comp) Single-token : 1/94=0.0106   1/2=0.5000    0.0208                
p-value=(P=0.1120, R=0.0000, F1=0.0980)
* (pred) Seen-in-train: 549/592=0.9274 549/712=0.7711 0.8420                
* (comp) Seen-in-train: 517/556=0.9299 517/712=0.7261 0.8155                
p-value=(P=0.3890, R=0.0060, F1=0.0120)
* (pred) Unseen-in-train: 73/327=0.2232 73/320=0.2281 0.2257                
* (comp) Unseen-in-train: 98/417=0.2350 98/320=0.3063 0.2659                
p-value=(P=0.3180, R=0.0010, F1=0.0370)
* (pred) Variant-of-train: 287/308=0.9318 287/310=0.9258 0.9288                
* (comp) Variant-of-train: 270/292=0.9247 270/310=0.8710 0.8970                
p-value=(P=0.2700, R=0.0030, F1=0.0070)
* (pred) Identical-to-train: 262/284=0.9225 262/402=0.6517 0.7638                
* (comp) Identical-to-train: 247/264=0.9356 247/402=0.6144 0.7417                
p-value=(P=0.1930, R=0.0780, F1=0.1350)


Language : IT
Systems : MTLB-STRUCT.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 622/919=0.6768 622/1032=0.6027 0.6376                
* (comp) MWE-based    : 574/928=0.6185 574/1032=0.5562 0.5857                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 496/701=0.7076 496/733=0.6767 0.6918                
* (comp) Continuous   : 456/723=0.6307 456/733=0.6221 0.6264                
p-value=(P=0.0000, R=0.0010, F1=0.0000)
* (pred) Discontinuous: 126/218=0.5780 126/299=0.4214 0.4874                
* (comp) Discontinuous: 118/205=0.5756 118/299=0.3946 0.4683                
p-value=(P=0.4490, R=0.1150, F1=0.1950)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 620/869=0.7135 620/1030=0.6019 0.6530                
* (comp) Multi-token  : 573/826=0.6937 573/1030=0.5563 0.6175                
p-value=(P=0.0770, R=0.0000, F1=0.0010)
* (pred) Single-token : 2/50=0.0400   2/2=1.0000    0.0769                
* (comp) Single-token : 1/102=0.0098  1/2=0.5000    0.0192                
p-value=(P=0.1140, R=0.0000, F1=0.0980)
* (pred) Seen-in-train: 549/592=0.9274 549/712=0.7711 0.8420                
* (comp) Seen-in-train: 493/529=0.9319 493/712=0.6924 0.7945                
p-value=(P=0.3300, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 73/327=0.2232 73/320=0.2281 0.2257                
* (comp) Unseen-in-train: 81/399=0.2030 81/320=0.2531 0.2253                
p-value=(P=0.1560, R=0.1210, F1=0.4650)
* (pred) Variant-of-train: 287/308=0.9318 287/310=0.9258 0.9288                
* (comp) Variant-of-train: 260/283=0.9187 260/310=0.8387 0.8769                
p-value=(P=0.0890, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 262/284=0.9225 262/402=0.6517 0.7638                
* (comp) Identical-to-train: 233/246=0.9472 233/402=0.5796 0.7191                
p-value=(P=0.0540, R=0.0000, F1=0.0060)


Language : IT
Systems : Seen2Unseen.open,TRAVIS-mono.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 667/1128=0.5913 667/1032=0.6463 0.6176                
* (comp) MWE-based    : 615/973=0.6321 615/1032=0.5959 0.6135                
p-value=(P=0.0070, R=0.0020, F1=0.3720)

## MWE continuity (partition of Global)
* (pred) Continuous   : 520/883=0.5889 520/733=0.7094 0.6436                
* (comp) Continuous   : 487/735=0.6626 487/733=0.6644 0.6635                
p-value=(P=0.0000, R=0.0030, F1=0.1170)
* (pred) Discontinuous: 147/245=0.6000 147/299=0.4916 0.5404                
* (comp) Discontinuous: 128/238=0.5378 128/299=0.4281 0.4767                
p-value=(P=0.0540, R=0.0240, F1=0.0160)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 667/1128=0.5913 667/1030=0.6476 0.6182                
* (comp) Multi-token  : 614/879=0.6985 614/1030=0.5961 0.6433                
p-value=(P=0.0000, R=0.0020, F1=0.0440)
* (pred) Single-token : 0/0=0.0000    0/2=0.0000    0.0000                
* (comp) Single-token : 1/94=0.0106   1/2=0.5000    0.0208                
p-value=(P=0.1570, R=0.0000, F1=0.1510)
* (pred) Seen-in-train: 646/949=0.6807 646/712=0.9073 0.7778                
* (comp) Seen-in-train: 517/556=0.9299 517/712=0.7261 0.8155                
p-value=(P=0.0000, R=0.0000, F1=0.0050)
* (pred) Unseen-in-train: 21/179=0.1173 21/320=0.0656 0.0842                
* (comp) Unseen-in-train: 98/417=0.2350 98/320=0.3063 0.2659                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 297/392=0.7577 297/310=0.9581 0.8462                
* (comp) Variant-of-train: 270/292=0.9247 270/310=0.8710 0.8970                
p-value=(P=0.0000, R=0.0000, F1=0.0070)
* (pred) Identical-to-train: 349/557=0.6266 349/402=0.8682 0.7278                
* (comp) Identical-to-train: 247/264=0.9356 247/402=0.6144 0.7417                
p-value=(P=0.0000, R=0.0000, F1=0.2900)


Language : IT
Systems : Seen2Unseen.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 667/1128=0.5913 667/1032=0.6463 0.6176                
* (comp) MWE-based    : 574/928=0.6185 574/1032=0.5562 0.5857                
p-value=(P=0.0500, R=0.0000, F1=0.0100)

## MWE continuity (partition of Global)
* (pred) Continuous   : 520/883=0.5889 520/733=0.7094 0.6436                
* (comp) Continuous   : 456/723=0.6307 456/733=0.6221 0.6264                
p-value=(P=0.0140, R=0.0000, F1=0.1320)
* (pred) Discontinuous: 147/245=0.6000 147/299=0.4916 0.5404                
* (comp) Discontinuous: 118/205=0.5756 118/299=0.3946 0.4683                
p-value=(P=0.2910, R=0.0000, F1=0.0090)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 667/1128=0.5913 667/1030=0.6476 0.6182                
* (comp) Multi-token  : 573/826=0.6937 573/1030=0.5563 0.6175                
p-value=(P=0.0000, R=0.0000, F1=0.5020)
* (pred) Single-token : 0/0=0.0000    0/2=0.0000    0.0000                
* (comp) Single-token : 1/102=0.0098  1/2=0.5000    0.0192                
p-value=(P=0.1600, R=0.0000, F1=0.1530)
* (pred) Seen-in-train: 646/949=0.6807 646/712=0.9073 0.7778                
* (comp) Seen-in-train: 493/529=0.9319 493/712=0.6924 0.7945                
p-value=(P=0.0000, R=0.0000, F1=0.1190)
* (pred) Unseen-in-train: 21/179=0.1173 21/320=0.0656 0.0842                
* (comp) Unseen-in-train: 81/399=0.2030 81/320=0.2531 0.2253                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 297/392=0.7577 297/310=0.9581 0.8462                
* (comp) Variant-of-train: 260/283=0.9187 260/310=0.8387 0.8769                
p-value=(P=0.0000, R=0.0000, F1=0.0400)
* (pred) Identical-to-train: 349/557=0.6266 349/402=0.8682 0.7278                
* (comp) Identical-to-train: 233/246=0.9472 233/402=0.5796 0.7191                
p-value=(P=0.0000, R=0.0000, F1=0.3840)


Language : IT
Systems : TRAVIS-mono.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 615/973=0.6321 615/1032=0.5959 0.6135                
* (comp) MWE-based    : 574/928=0.6185 574/1032=0.5562 0.5857                
p-value=(P=0.2180, R=0.0010, F1=0.0250)

## MWE continuity (partition of Global)
* (pred) Continuous   : 487/735=0.6626 487/733=0.6644 0.6635                
* (comp) Continuous   : 456/723=0.6307 456/733=0.6221 0.6264                
p-value=(P=0.0330, R=0.0030, F1=0.0070)
* (pred) Discontinuous: 128/238=0.5378 128/299=0.4281 0.4767                
* (comp) Discontinuous: 118/205=0.5756 118/299=0.3946 0.4683                
p-value=(P=0.1460, R=0.1240, F1=0.4040)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 614/879=0.6985 614/1030=0.5961 0.6433                
* (comp) Multi-token  : 573/826=0.6937 573/1030=0.5563 0.6175                
p-value=(P=0.3630, R=0.0020, F1=0.0270)
* (pred) Single-token : 1/94=0.0106   1/2=0.5000    0.0208                
* (comp) Single-token : 1/102=0.0098  1/2=0.5000    0.0192                
p-value=(P=0.4060, R=1.0000, F1=0.4050)
* (pred) Seen-in-train: 517/556=0.9299 517/712=0.7261 0.8155                
* (comp) Seen-in-train: 493/529=0.9319 493/712=0.6924 0.7945                
p-value=(P=0.4070, R=0.0190, F1=0.0370)
* (pred) Unseen-in-train: 98/417=0.2350 98/320=0.3063 0.2659                
* (comp) Unseen-in-train: 81/399=0.2030 81/320=0.2531 0.2253                
p-value=(P=0.0700, R=0.0190, F1=0.0370)
* (pred) Variant-of-train: 270/292=0.9247 270/310=0.8710 0.8970                
* (comp) Variant-of-train: 260/283=0.9187 260/310=0.8387 0.8769                
p-value=(P=0.2810, R=0.0280, F1=0.0370)
* (pred) Identical-to-train: 247/264=0.9356 247/402=0.6144 0.7417                
* (comp) Identical-to-train: 233/246=0.9472 233/402=0.5796 0.7191                
p-value=(P=0.1900, R=0.1130, F1=0.1640)



Language : PL
Systems : ERMI.closed,Seen2Seen.closed
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 873/1181=0.7392 873/1345=0.6491 0.6912                
* (comp) MWE-based    : 999/1096=0.9115 999/1345=0.7428 0.8185                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 720/979=0.7354 720/978=0.7362 0.7358                
* (comp) Continuous   : 790/846=0.9338 790/978=0.8078 0.8662                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 153/202=0.7574 153/367=0.4169 0.5378                
* (comp) Discontinuous: 209/250=0.8360 209/367=0.5695 0.6775                
p-value=(P=0.0100, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 873/1130=0.7726 873/1345=0.6491 0.7055                
* (comp) Multi-token  : 999/1096=0.9115 999/1345=0.7428 0.8185                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/51=0.0000   0/0=0.0000    0.0000                
* (comp) Single-token : 0/0=0.0000    0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 781/799=0.9775 781/1033=0.7561 0.8526                
* (comp) Seen-in-train: 998/1095=0.9114 998/1033=0.9661 0.9380                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 92/382=0.2408 92/312=0.2949 0.2651                
* (comp) Unseen-in-train: 1/1=1.0000    1/312=0.0032  0.0064                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 455/460=0.9891 455/501=0.9082 0.9469                
* (comp) Variant-of-train: 498/517=0.9632 498/501=0.9940 0.9784                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 326/339=0.9617 326/532=0.6128 0.7486                
* (comp) Identical-to-train: 500/578=0.8651 500/532=0.9398 0.9009                
p-value=(P=0.0000, R=0.0000, F1=0.0000)



Language : PL
Systems : FipsCo.open,HMSid.open


Language : PL
Systems : FipsCo.open,MTLB-STRUCT.open


Language : PL
Systems : FipsCo.open,Seen2Unseen.open


Language : PL
Systems : FipsCo.open,TRAVIS-mono.open


Language : PL
Systems : FipsCo.open,TRAVIS-multi.open


Language : PL
Systems : HMSid.open,MTLB-STRUCT.open


Language : PL
Systems : HMSid.open,Seen2Unseen.open


Language : PL
Systems : HMSid.open,TRAVIS-mono.open


Language : PL
Systems : HMSid.open,TRAVIS-multi.open


Language : PL
Systems : MTLB-STRUCT.open,Seen2Unseen.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 1065/1284=0.8294 1065/1345=0.7918 0.8102                
* (comp) MWE-based    : 1035/1288=0.8036 1035/1345=0.7695 0.7862                
p-value=(P=0.0130, R=0.0250, F1=0.0050)

## MWE continuity (partition of Global)
* (pred) Continuous   : 827/975=0.8482 827/978=0.8456 0.8469                
* (comp) Continuous   : 818/987=0.8288 818/978=0.8364 0.8326                
p-value=(P=0.0800, R=0.1900, F1=0.0650)
* (pred) Discontinuous: 238/309=0.7702 238/367=0.6485 0.7041                
* (comp) Discontinuous: 217/301=0.7209 217/367=0.5913 0.6497                
p-value=(P=0.0470, R=0.0150, F1=0.0030)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 1065/1256=0.8479 1065/1345=0.7918 0.8189                
* (comp) Multi-token  : 1035/1288=0.8036 1035/1345=0.7695 0.7862                
p-value=(P=0.0010, R=0.0250, F1=0.0000)
* (pred) Single-token : 0/28=0.0000   0/0=0.0000    0.0000                
* (comp) Single-token : 0/0=0.0000    0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 930/949=0.9800 930/1033=0.9003 0.9384                
* (comp) Seen-in-train: 999/1096=0.9115 999/1033=0.9671 0.9385                
p-value=(P=0.0000, R=0.0000, F1=0.5140)
* (pred) Unseen-in-train: 135/335=0.4030 135/312=0.4327 0.4173                
* (comp) Unseen-in-train: 36/192=0.1875 36/312=0.1154 0.1429                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 485/491=0.9878 485/501=0.9681 0.9778                
* (comp) Variant-of-train: 498/517=0.9632 498/501=0.9940 0.9784                
p-value=(P=0.0010, R=0.0020, F1=0.4670)
* (pred) Identical-to-train: 445/458=0.9716 445/532=0.8365 0.8990                
* (comp) Identical-to-train: 501/579=0.8653 501/532=0.9417 0.9019                
p-value=(P=0.0000, R=0.0000, F1=0.4170)


Language : PL
Systems : MTLB-STRUCT.open,TRAVIS-mono.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 1065/1284=0.8294 1065/1345=0.7918 0.8102                
* (comp) MWE-based    : 1098/1318=0.8331 1098/1345=0.8164 0.8246                
p-value=(P=0.3690, R=0.0060, F1=0.0450)

## MWE continuity (partition of Global)
* (pred) Continuous   : 827/975=0.8482 827/978=0.8456 0.8469                
* (comp) Continuous   : 848/1000=0.8480 848/978=0.8671 0.8574                
p-value=(P=0.4850, R=0.0220, F1=0.1220)
* (pred) Discontinuous: 238/309=0.7702 238/367=0.6485 0.7041                
* (comp) Discontinuous: 250/318=0.7862 250/367=0.6812 0.7299                
p-value=(P=0.2610, R=0.0530, F1=0.0730)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 1065/1256=0.8479 1065/1345=0.7918 0.8189                
* (comp) Multi-token  : 1098/1262=0.8700 1098/1345=0.8164 0.8423                
p-value=(P=0.0210, R=0.0060, F1=0.0020)
* (pred) Single-token : 0/28=0.0000   0/0=0.0000    0.0000                
* (comp) Single-token : 0/56=0.0000   0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 930/949=0.9800 930/1033=0.9003 0.9384                
* (comp) Seen-in-train: 951/971=0.9794 951/1033=0.9206 0.9491                
p-value=(P=0.4130, R=0.0120, F1=0.0230)
* (pred) Unseen-in-train: 135/335=0.4030 135/312=0.4327 0.4173                
* (comp) Unseen-in-train: 147/347=0.4236 147/312=0.4712 0.4461                
p-value=(P=0.2260, R=0.1070, F1=0.1340)
* (pred) Variant-of-train: 485/491=0.9878 485/501=0.9681 0.9778                
* (comp) Variant-of-train: 492/498=0.9880 492/501=0.9820 0.9850                
p-value=(P=0.4170, R=0.0490, F1=0.0660)
* (pred) Identical-to-train: 445/458=0.9716 445/532=0.8365 0.8990                
* (comp) Identical-to-train: 459/473=0.9704 459/532=0.8628 0.9134                
p-value=(P=0.4100, R=0.0260, F1=0.0630)


Language : PL
Systems : MTLB-STRUCT.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 1065/1284=0.8294 1065/1345=0.7918 0.8102                
* (comp) MWE-based    : 1047/1290=0.8116 1047/1345=0.7784 0.7947                
p-value=(P=0.0500, R=0.0650, F1=0.0280)

## MWE continuity (partition of Global)
* (pred) Continuous   : 827/975=0.8482 827/978=0.8456 0.8469                
* (comp) Continuous   : 817/995=0.8211 817/978=0.8354 0.8282                
p-value=(P=0.0110, R=0.1220, F1=0.0090)
* (pred) Discontinuous: 238/309=0.7702 238/367=0.6485 0.7041                
* (comp) Discontinuous: 230/295=0.7797 230/367=0.6267 0.6949                
p-value=(P=0.3500, R=0.1480, F1=0.2950)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 1065/1256=0.8479 1065/1345=0.7918 0.8189                
* (comp) Multi-token  : 1047/1240=0.8444 1047/1345=0.7784 0.8101                
p-value=(P=0.3530, R=0.0650, F1=0.1110)
* (pred) Single-token : 0/28=0.0000   0/0=0.0000    0.0000                
* (comp) Single-token : 0/50=0.0000   0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 930/949=0.9800 930/1033=0.9003 0.9384                
* (comp) Seen-in-train: 912/935=0.9754 912/1033=0.8829 0.9268                
p-value=(P=0.0750, R=0.0100, F1=0.0050)
* (pred) Unseen-in-train: 135/335=0.4030 135/312=0.4327 0.4173                
* (comp) Unseen-in-train: 135/355=0.3803 135/312=0.4327 0.4048                
p-value=(P=0.1700, R=1.0000, F1=0.2870)
* (pred) Variant-of-train: 485/491=0.9878 485/501=0.9681 0.9778                
* (comp) Variant-of-train: 487/492=0.9898 487/501=0.9721 0.9809                
p-value=(P=0.2830, R=0.2910, F1=0.2430)
* (pred) Identical-to-train: 445/458=0.9716 445/532=0.8365 0.8990                
* (comp) Identical-to-train: 425/443=0.9594 425/532=0.7989 0.8718                
p-value=(P=0.0200, R=0.0030, F1=0.0010)


Language : PL
Systems : Seen2Unseen.open,TRAVIS-mono.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 1035/1288=0.8036 1035/1345=0.7695 0.7862                
* (comp) MWE-based    : 1098/1318=0.8331 1098/1345=0.8164 0.8246                
p-value=(P=0.0150, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 818/987=0.8288 818/978=0.8364 0.8326                
* (comp) Continuous   : 848/1000=0.8480 848/978=0.8671 0.8574                
p-value=(P=0.0790, R=0.0050, F1=0.0070)
* (pred) Discontinuous: 217/301=0.7209 217/367=0.5913 0.6497                
* (comp) Discontinuous: 250/318=0.7862 250/367=0.6812 0.7299                
p-value=(P=0.0170, R=0.0010, F1=0.0010)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 1035/1288=0.8036 1035/1345=0.7695 0.7862                
* (comp) Multi-token  : 1098/1262=0.8700 1098/1345=0.8164 0.8423                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/0=0.0000    0/0=0.0000    0.0000                
* (comp) Single-token : 0/56=0.0000   0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 999/1096=0.9115 999/1033=0.9671 0.9385                
* (comp) Seen-in-train: 951/971=0.9794 951/1033=0.9206 0.9491                
p-value=(P=0.0000, R=0.0000, F1=0.0370)
* (pred) Unseen-in-train: 36/192=0.1875 36/312=0.1154 0.1429                
* (comp) Unseen-in-train: 147/347=0.4236 147/312=0.4712 0.4461                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 498/517=0.9632 498/501=0.9940 0.9784                
* (comp) Variant-of-train: 492/498=0.9880 492/501=0.9820 0.9850                
p-value=(P=0.0020, R=0.0430, F1=0.0840)
* (pred) Identical-to-train: 501/579=0.8653 501/532=0.9417 0.9019                
* (comp) Identical-to-train: 459/473=0.9704 459/532=0.8628 0.9134                
p-value=(P=0.0000, R=0.0000, F1=0.1640)


Language : PL
Systems : Seen2Unseen.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 1035/1288=0.8036 1035/1345=0.7695 0.7862                
* (comp) MWE-based    : 1047/1290=0.8116 1047/1345=0.7784 0.7947                
p-value=(P=0.2410, R=0.2230, F1=0.1930)

## MWE continuity (partition of Global)
* (pred) Continuous   : 818/987=0.8288 818/978=0.8364 0.8326                
* (comp) Continuous   : 817/995=0.8211 817/978=0.8354 0.8282                
p-value=(P=0.2950, R=0.4760, F1=0.3240)
* (pred) Discontinuous: 217/301=0.7209 217/367=0.5913 0.6497                
* (comp) Discontinuous: 230/295=0.7797 230/367=0.6267 0.6949                
p-value=(P=0.0220, R=0.1060, F1=0.0270)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 1035/1288=0.8036 1035/1345=0.7695 0.7862                
* (comp) Multi-token  : 1047/1240=0.8444 1047/1345=0.7784 0.8101                
p-value=(P=0.0000, R=0.2230, F1=0.0010)
* (pred) Single-token : 0/0=0.0000    0/0=0.0000    0.0000                
* (comp) Single-token : 0/50=0.0000   0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 999/1096=0.9115 999/1033=0.9671 0.9385                
* (comp) Seen-in-train: 912/935=0.9754 912/1033=0.8829 0.9268                
p-value=(P=0.0000, R=0.0000, F1=0.0500)
* (pred) Unseen-in-train: 36/192=0.1875 36/312=0.1154 0.1429                
* (comp) Unseen-in-train: 135/355=0.3803 135/312=0.4327 0.4048                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 498/517=0.9632 498/501=0.9940 0.9784                
* (comp) Variant-of-train: 487/492=0.9898 487/501=0.9721 0.9809                
p-value=(P=0.0000, R=0.0020, F1=0.2960)
* (pred) Identical-to-train: 501/579=0.8653 501/532=0.9417 0.9019                
* (comp) Identical-to-train: 425/443=0.9594 425/532=0.7989 0.8718                
p-value=(P=0.0000, R=0.0000, F1=0.0120)


Language : PL
Systems : TRAVIS-mono.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 1098/1318=0.8331 1098/1345=0.8164 0.8246                
* (comp) MWE-based    : 1047/1290=0.8116 1047/1345=0.7784 0.7947                
p-value=(P=0.0280, R=0.0000, F1=0.0010)

## MWE continuity (partition of Global)
* (pred) Continuous   : 848/1000=0.8480 848/978=0.8671 0.8574                
* (comp) Continuous   : 817/995=0.8211 817/978=0.8354 0.8282                
p-value=(P=0.0150, R=0.0010, F1=0.0000)
* (pred) Discontinuous: 250/318=0.7862 250/367=0.6812 0.7299                
* (comp) Discontinuous: 230/295=0.7797 230/367=0.6267 0.6949                
p-value=(P=0.3950, R=0.0080, F1=0.0350)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 1098/1262=0.8700 1098/1345=0.8164 0.8423                
* (comp) Multi-token  : 1047/1240=0.8444 1047/1345=0.7784 0.8101                
p-value=(P=0.0040, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/56=0.0000   0/0=0.0000    0.0000                
* (comp) Single-token : 0/50=0.0000   0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 951/971=0.9794 951/1033=0.9206 0.9491                
* (comp) Seen-in-train: 912/935=0.9754 912/1033=0.8829 0.9268                
p-value=(P=0.1390, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 147/347=0.4236 147/312=0.4712 0.4461                
* (comp) Unseen-in-train: 135/355=0.3803 135/312=0.4327 0.4048                
p-value=(P=0.0520, R=0.1250, F1=0.0630)
* (pred) Variant-of-train: 492/498=0.9880 492/501=0.9820 0.9850                
* (comp) Variant-of-train: 487/492=0.9898 487/501=0.9721 0.9809                
p-value=(P=0.1920, R=0.0700, F1=0.1410)
* (pred) Identical-to-train: 459/473=0.9704 459/532=0.8628 0.9134                
* (comp) Identical-to-train: 425/443=0.9594 425/532=0.7989 0.8718                
p-value=(P=0.0680, R=0.0000, F1=0.0010)



Language : PT
Systems : ERMI.closed,Seen2Seen.closed
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 751/1091=0.6884 751/1263=0.5946 0.6381                
* (comp) MWE-based    : 884/1166=0.7581 884/1263=0.6999 0.7279                
p-value=(P=0.0010, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 457/650=0.7031 457/741=0.6167 0.6571                
* (comp) Continuous   : 546/683=0.7994 546/741=0.7368 0.7669                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 294/441=0.6667 294/522=0.5632 0.6106                
* (comp) Discontinuous: 338/483=0.6998 338/522=0.6475 0.6726                
p-value=(P=0.0990, R=0.0000, F1=0.0010)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 751/1047=0.7173 751/1263=0.5946 0.6502                
* (comp) Multi-token  : 884/1166=0.7581 884/1263=0.6999 0.7279                
p-value=(P=0.0030, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/44=0.0000   0/0=0.0000    0.0000                
* (comp) Single-token : 0/0=0.0000    0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 645/675=0.9556 645/944=0.6833 0.7968                
* (comp) Seen-in-train: 878/1156=0.7595 878/944=0.9301 0.8362                
p-value=(P=0.0000, R=0.0000, F1=0.0010)
* (pred) Unseen-in-train: 106/416=0.2548 106/319=0.3323 0.2884                
* (comp) Unseen-in-train: 6/10=0.6000   6/319=0.0188  0.0365                
p-value=(P=0.0190, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 284/291=0.9759 284/365=0.7781 0.8659                
* (comp) Variant-of-train: 350/367=0.9537 350/365=0.9589 0.9563                
p-value=(P=0.0130, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 361/384=0.9401 361/579=0.6235 0.7497                
* (comp) Identical-to-train: 528/789=0.6692 528/579=0.9119 0.7719                
p-value=(P=0.0000, R=0.0000, F1=0.1010)



Language : PT
Systems : FipsCo.open,HMSid.open


Language : PT
Systems : FipsCo.open,MTLB-STRUCT.open


Language : PT
Systems : FipsCo.open,Seen2Unseen.open


Language : PT
Systems : FipsCo.open,TRAVIS-mono.open


Language : PT
Systems : FipsCo.open,TRAVIS-multi.open


Language : PT
Systems : HMSid.open,MTLB-STRUCT.open


Language : PT
Systems : HMSid.open,Seen2Unseen.open


Language : PT
Systems : HMSid.open,TRAVIS-mono.open


Language : PT
Systems : HMSid.open,TRAVIS-multi.open


Language : PT
Systems : MTLB-STRUCT.open,Seen2Unseen.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 919/1243=0.7393 919/1263=0.7276 0.7334                
* (comp) MWE-based    : 919/1449=0.6342 919/1263=0.7276 0.6777                
p-value=(P=0.0000, R=1.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 559/732=0.7637 559/741=0.7544 0.7590                
* (comp) Continuous   : 572/904=0.6327 572/741=0.7719 0.6954                
p-value=(P=0.0000, R=0.1420, F1=0.0000)
* (pred) Discontinuous: 360/511=0.7045 360/522=0.6897 0.6970                
* (comp) Discontinuous: 347/545=0.6367 347/522=0.6648 0.6504                
p-value=(P=0.0060, R=0.1430, F1=0.0090)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 919/1203=0.7639 919/1263=0.7276 0.7453                
* (comp) Multi-token  : 919/1449=0.6342 919/1263=0.7276 0.6777                
p-value=(P=0.0000, R=1.0000, F1=0.0000)
* (pred) Single-token : 0/40=0.0000   0/0=0.0000    0.0000                
* (comp) Single-token : 0/0=0.0000    0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 787/828=0.9505 787/944=0.8337 0.8883                
* (comp) Seen-in-train: 879/1158=0.7591 879/944=0.9311 0.8363                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 132/415=0.3181 132/319=0.4138 0.3597                
* (comp) Unseen-in-train: 40/291=0.1375 40/319=0.1254 0.1311                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 328/339=0.9676 328/365=0.8986 0.9318                
* (comp) Variant-of-train: 350/367=0.9537 350/365=0.9589 0.9563                
p-value=(P=0.0430, R=0.0000, F1=0.0110)
* (pred) Identical-to-train: 459/489=0.9387 459/579=0.7927 0.8596                
* (comp) Identical-to-train: 529/791=0.6688 529/579=0.9136 0.7723                
p-value=(P=0.0000, R=0.0000, F1=0.0000)


Language : PT
Systems : MTLB-STRUCT.open,TRAVIS-mono.open


Language : PT
Systems : MTLB-STRUCT.open,TRAVIS-multi.open


Language : PT
Systems : Seen2Unseen.open,TRAVIS-mono.open


Language : PT
Systems : Seen2Unseen.open,TRAVIS-multi.open


Language : PT
Systems : TRAVIS-mono.open,TRAVIS-multi.open



Language : RO
Systems : ERMI.closed,Seen2Seen.closed
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 3373/3937=0.8567 3373/4135=0.8157 0.8357                
* (comp) MWE-based    : 3383/4091=0.8269 3383/4135=0.8181 0.8225                
p-value=(P=0.0000, R=0.3580, F1=0.0110)

## MWE continuity (partition of Global)
* (pred) Continuous   : 2461/2939=0.8374 2461/2883=0.8536 0.8454                
* (comp) Continuous   : 2404/2800=0.8586 2404/2883=0.8339 0.8460                
p-value=(P=0.0100, R=0.0020, F1=0.4650)
* (pred) Discontinuous: 912/998=0.9138 912/1252=0.7284 0.8107                
* (comp) Discontinuous: 979/1291=0.7583 979/1252=0.7819 0.7700                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 3373/3808=0.8858 3373/4135=0.8157 0.8493                
* (comp) Multi-token  : 3383/4091=0.8269 3383/4135=0.8181 0.8225                
p-value=(P=0.0000, R=0.3580, F1=0.0000)
* (pred) Single-token : 0/129=0.0000  0/0=0.0000    0.0000                
* (comp) Single-token : 0/0=0.0000    0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 3167/3266=0.9697 3167/3630=0.8725 0.9185                
* (comp) Seen-in-train: 3382/4090=0.8269 3382/3630=0.9317 0.8762                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 206/671=0.3070 206/505=0.4079 0.3503                
* (comp) Unseen-in-train: 1/1=1.0000    1/505=0.0020  0.0040                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 2693/2748=0.9800 2693/2893=0.9309 0.9548                
* (comp) Variant-of-train: 2705/2893=0.9350 2705/2893=0.9350 0.9350                
p-value=(P=0.0000, R=0.2610, F1=0.0000)
* (pred) Identical-to-train: 474/518=0.9151 474/737=0.6431 0.7554                
* (comp) Identical-to-train: 677/1197=0.5656 677/737=0.9186 0.7001                
p-value=(P=0.0000, R=0.0000, F1=0.0000)



Language : RO
Systems : FipsCo.open,HMSid.open


Language : RO
Systems : FipsCo.open,MTLB-STRUCT.open


Language : RO
Systems : FipsCo.open,Seen2Unseen.open


Language : RO
Systems : FipsCo.open,TRAVIS-mono.open


Language : RO
Systems : FipsCo.open,TRAVIS-multi.open


Language : RO
Systems : HMSid.open,MTLB-STRUCT.open


Language : RO
Systems : HMSid.open,Seen2Unseen.open


Language : RO
Systems : HMSid.open,TRAVIS-mono.open


Language : RO
Systems : HMSid.open,TRAVIS-multi.open


Language : RO
Systems : MTLB-STRUCT.open,Seen2Unseen.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 3765/4189=0.8988 3765/4135=0.9105 0.9046                
* (comp) MWE-based    : 3395/4513=0.7523 3395/4135=0.8210 0.7852                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 2625/2910=0.9021 2625/2883=0.9105 0.9063                
* (comp) Continuous   : 2414/3197=0.7551 2414/2883=0.8373 0.7941                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 1140/1279=0.8913 1140/1252=0.9105 0.9008                
* (comp) Discontinuous: 981/1316=0.7454 981/1252=0.7835 0.7640                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 3765/4140=0.9094 3765/4135=0.9105 0.9100                
* (comp) Multi-token  : 3395/4513=0.7523 3395/4135=0.8210 0.7852                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/49=0.0000   0/0=0.0000    0.0000                
* (comp) Single-token : 0/0=0.0000    0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 3484/3597=0.9686 3484/3630=0.9598 0.9642                
* (comp) Seen-in-train: 3382/4090=0.8269 3382/3630=0.9317 0.8762                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 281/592=0.4747 281/505=0.5564 0.5123                
* (comp) Unseen-in-train: 13/423=0.0307 13/505=0.0257 0.0280                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 2862/2918=0.9808 2862/2893=0.9893 0.9850                
* (comp) Variant-of-train: 2705/2893=0.9350 2705/2893=0.9350 0.9350                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 622/679=0.9161 622/737=0.8440 0.8785                
* (comp) Identical-to-train: 677/1197=0.5656 677/737=0.9186 0.7001                
p-value=(P=0.0000, R=0.0000, F1=0.0000)


Language : RO
Systems : MTLB-STRUCT.open,TRAVIS-mono.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 3765/4189=0.8988 3765/4135=0.9105 0.9046                
* (comp) MWE-based    : 3779/4162=0.9080 3779/4135=0.9139 0.9109                
p-value=(P=0.0380, R=0.1960, F1=0.0460)

## MWE continuity (partition of Global)
* (pred) Continuous   : 2625/2910=0.9021 2625/2883=0.9105 0.9063                
* (comp) Continuous   : 2657/2948=0.9013 2657/2883=0.9216 0.9113                
p-value=(P=0.4320, R=0.0080, F1=0.1250)
* (pred) Discontinuous: 1140/1279=0.8913 1140/1252=0.9105 0.9008                
* (comp) Discontinuous: 1122/1214=0.9242 1122/1252=0.8962 0.9100                
p-value=(P=0.0000, R=0.0220, F1=0.0710)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 3765/4140=0.9094 3765/4135=0.9105 0.9100                
* (comp) Multi-token  : 3779/4079=0.9265 3779/4135=0.9139 0.9201                
p-value=(P=0.0000, R=0.1960, F1=0.0000)
* (pred) Single-token : 0/49=0.0000   0/0=0.0000    0.0000                
* (comp) Single-token : 0/83=0.0000   0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 3484/3597=0.9686 3484/3630=0.9598 0.9642                
* (comp) Seen-in-train: 3499/3566=0.9812 3499/3630=0.9639 0.9725                
p-value=(P=0.0000, R=0.1170, F1=0.0000)
* (pred) Unseen-in-train: 281/592=0.4747 281/505=0.5564 0.5123                
* (comp) Unseen-in-train: 280/596=0.4698 280/505=0.5545 0.5086                
p-value=(P=0.4020, R=0.4650, F1=0.4210)
* (pred) Variant-of-train: 2862/2918=0.9808 2862/2893=0.9893 0.9850                
* (comp) Variant-of-train: 2856/2893=0.9872 2856/2893=0.9872 0.9872                
p-value=(P=0.0000, R=0.1670, F1=0.0550)
* (pred) Identical-to-train: 622/679=0.9161 622/737=0.8440 0.8785                
* (comp) Identical-to-train: 643/673=0.9554 643/737=0.8725 0.9121                
p-value=(P=0.0000, R=0.0220, F1=0.0000)


Language : RO
Systems : MTLB-STRUCT.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 3765/4189=0.8988 3765/4135=0.9105 0.9046                
* (comp) MWE-based    : 3517/3957=0.8888 3517/4135=0.8505 0.8693                
p-value=(P=0.0270, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 2625/2910=0.9021 2625/2883=0.9105 0.9063                
* (comp) Continuous   : 2500/2818=0.8872 2500/2883=0.8672 0.8770                
p-value=(P=0.0100, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 1140/1279=0.8913 1140/1252=0.9105 0.9008                
* (comp) Discontinuous: 1017/1139=0.8929 1017/1252=0.8123 0.8507                
p-value=(P=0.4160, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 3765/4140=0.9094 3765/4135=0.9105 0.9100                
* (comp) Multi-token  : 3517/3893=0.9034 3517/4135=0.8505 0.8762                
p-value=(P=0.0820, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/49=0.0000   0/0=0.0000    0.0000                
* (comp) Single-token : 0/64=0.0000   0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 3484/3597=0.9686 3484/3630=0.9598 0.9642                
* (comp) Seen-in-train: 3363/3477=0.9672 3363/3630=0.9264 0.9464                
p-value=(P=0.2770, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 281/592=0.4747 281/505=0.5564 0.5123                
* (comp) Unseen-in-train: 154/480=0.3208 154/505=0.3050 0.3127                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 2862/2918=0.9808 2862/2893=0.9893 0.9850                
* (comp) Variant-of-train: 2829/2892=0.9782 2829/2893=0.9779 0.9780                
p-value=(P=0.0570, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 622/679=0.9161 622/737=0.8440 0.8785                
* (comp) Identical-to-train: 534/585=0.9128 534/737=0.7246 0.8079                
p-value=(P=0.3720, R=0.0000, F1=0.0000)


Language : RO
Systems : Seen2Unseen.open,TRAVIS-mono.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 3395/4513=0.7523 3395/4135=0.8210 0.7852                
* (comp) MWE-based    : 3779/4162=0.9080 3779/4135=0.9139 0.9109                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 2414/3197=0.7551 2414/2883=0.8373 0.7941                
* (comp) Continuous   : 2657/2948=0.9013 2657/2883=0.9216 0.9113                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 981/1316=0.7454 981/1252=0.7835 0.7640                
* (comp) Discontinuous: 1122/1214=0.9242 1122/1252=0.8962 0.9100                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 3395/4513=0.7523 3395/4135=0.8210 0.7852                
* (comp) Multi-token  : 3779/4079=0.9265 3779/4135=0.9139 0.9201                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/0=0.0000    0/0=0.0000    0.0000                
* (comp) Single-token : 0/83=0.0000   0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 3382/4090=0.8269 3382/3630=0.9317 0.8762                
* (comp) Seen-in-train: 3499/3566=0.9812 3499/3630=0.9639 0.9725                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 13/423=0.0307 13/505=0.0257 0.0280                
* (comp) Unseen-in-train: 280/596=0.4698 280/505=0.5545 0.5086                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 2705/2893=0.9350 2705/2893=0.9350 0.9350                
* (comp) Variant-of-train: 2856/2893=0.9872 2856/2893=0.9872 0.9872                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 677/1197=0.5656 677/737=0.9186 0.7001                
* (comp) Identical-to-train: 643/673=0.9554 643/737=0.8725 0.9121                
p-value=(P=0.0000, R=0.0000, F1=0.0000)


Language : RO
Systems : Seen2Unseen.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 3395/4513=0.7523 3395/4135=0.8210 0.7852                
* (comp) MWE-based    : 3517/3957=0.8888 3517/4135=0.8505 0.8693                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 2414/3197=0.7551 2414/2883=0.8373 0.7941                
* (comp) Continuous   : 2500/2818=0.8872 2500/2883=0.8672 0.8770                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 981/1316=0.7454 981/1252=0.7835 0.7640                
* (comp) Discontinuous: 1017/1139=0.8929 1017/1252=0.8123 0.8507                
p-value=(P=0.0000, R=0.0040, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 3395/4513=0.7523 3395/4135=0.8210 0.7852                
* (comp) Multi-token  : 3517/3893=0.9034 3517/4135=0.8505 0.8762                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/0=0.0000    0/0=0.0000    0.0000                
* (comp) Single-token : 0/64=0.0000   0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 3382/4090=0.8269 3382/3630=0.9317 0.8762                
* (comp) Seen-in-train: 3363/3477=0.9672 3363/3630=0.9264 0.9464                
p-value=(P=0.0000, R=0.1950, F1=0.0000)
* (pred) Unseen-in-train: 13/423=0.0307 13/505=0.0257 0.0280                
* (comp) Unseen-in-train: 154/480=0.3208 154/505=0.3050 0.3127                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 2705/2893=0.9350 2705/2893=0.9350 0.9350                
* (comp) Variant-of-train: 2829/2892=0.9782 2829/2893=0.9779 0.9780                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 677/1197=0.5656 677/737=0.9186 0.7001                
* (comp) Identical-to-train: 534/585=0.9128 534/737=0.7246 0.8079                
p-value=(P=0.0000, R=0.0000, F1=0.0000)


Language : RO
Systems : TRAVIS-mono.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 3779/4162=0.9080 3779/4135=0.9139 0.9109                
* (comp) MWE-based    : 3517/3957=0.8888 3517/4135=0.8505 0.8693                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 2657/2948=0.9013 2657/2883=0.9216 0.9113                
* (comp) Continuous   : 2500/2818=0.8872 2500/2883=0.8672 0.8770                
p-value=(P=0.0160, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 1122/1214=0.9242 1122/1252=0.8962 0.9100                
* (comp) Discontinuous: 1017/1139=0.8929 1017/1252=0.8123 0.8507                
p-value=(P=0.0010, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 3779/4079=0.9265 3779/4135=0.9139 0.9201                
* (comp) Multi-token  : 3517/3893=0.9034 3517/4135=0.8505 0.8762                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 0/83=0.0000   0/0=0.0000    0.0000                
* (comp) Single-token : 0/64=0.0000   0/0=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 3499/3566=0.9812 3499/3630=0.9639 0.9725                
* (comp) Seen-in-train: 3363/3477=0.9672 3363/3630=0.9264 0.9464                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 280/596=0.4698 280/505=0.5545 0.5086                
* (comp) Unseen-in-train: 154/480=0.3208 154/505=0.3050 0.3127                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 2856/2893=0.9872 2856/2893=0.9872 0.9872                
* (comp) Variant-of-train: 2829/2892=0.9782 2829/2893=0.9779 0.9780                
p-value=(P=0.0000, R=0.0010, F1=0.0000)
* (pred) Identical-to-train: 643/673=0.9554 643/737=0.8725 0.9121                
* (comp) Identical-to-train: 534/585=0.9128 534/737=0.7246 0.8079                
p-value=(P=0.0000, R=0.0000, F1=0.0000)



Language : SV
Systems : ERMI.closed,Seen2Seen.closed
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 540/743=0.7268 540/969=0.5573 0.6308                
* (comp) MWE-based    : 581/675=0.8607 581/969=0.5996 0.7068                
p-value=(P=0.0000, R=0.0070, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 499/692=0.7211 499/788=0.6332 0.6743                
* (comp) Continuous   : 505/590=0.8559 505/788=0.6409 0.7329                
p-value=(P=0.0000, R=0.3530, F1=0.0000)
* (pred) Discontinuous: 41/51=0.8039  41/181=0.2265 0.3534                
* (comp) Discontinuous: 76/85=0.8941  76/181=0.4199 0.5714                
p-value=(P=0.0630, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 207/280=0.7393 207/499=0.4148 0.5315                
* (comp) Multi-token  : 218/242=0.9008 218/499=0.4369 0.5884                
p-value=(P=0.0000, R=0.1780, F1=0.0130)
* (pred) Single-token : 333/463=0.7192 333/470=0.7085 0.7138                
* (comp) Single-token : 363/433=0.8383 363/470=0.7723 0.8040                
p-value=(P=0.0000, R=0.0040, F1=0.0000)
* (pred) Seen-in-train: 426/437=0.9748 426/612=0.6961 0.8122                
* (comp) Seen-in-train: 581/675=0.8607 581/612=0.9493 0.9029                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 114/306=0.3725 114/357=0.3193 0.3439                
* (comp) Unseen-in-train: 0/0=0.0000    0/357=0.0000  0.0000                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 258/263=0.9810 258/293=0.8805 0.9281                
* (comp) Variant-of-train: 287/305=0.9410 287/293=0.9795 0.9599                
p-value=(P=0.0010, R=0.0000, F1=0.0070)
* (pred) Identical-to-train: 168/174=0.9655 168/319=0.5266 0.6815                
* (comp) Identical-to-train: 294/370=0.7946 294/319=0.9216 0.8534                
p-value=(P=0.0000, R=0.0000, F1=0.0000)



Language : SV
Systems : FipsCo.open,HMSid.open


Language : SV
Systems : FipsCo.open,MTLB-STRUCT.open


Language : SV
Systems : FipsCo.open,Seen2Unseen.open


Language : SV
Systems : FipsCo.open,TRAVIS-mono.open


Language : SV
Systems : FipsCo.open,TRAVIS-multi.open


Language : SV
Systems : HMSid.open,MTLB-STRUCT.open


Language : SV
Systems : HMSid.open,Seen2Unseen.open


Language : SV
Systems : HMSid.open,TRAVIS-mono.open


Language : SV
Systems : HMSid.open,TRAVIS-multi.open


Language : SV
Systems : MTLB-STRUCT.open,Seen2Unseen.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 714/1026=0.6959 714/969=0.7368 0.7158                
* (comp) MWE-based    : 602/778=0.7738 602/969=0.6213 0.6892                
p-value=(P=0.0000, R=0.0000, F1=0.0380)

## MWE continuity (partition of Global)
* (pred) Continuous   : 618/867=0.7128 618/788=0.7843 0.7468                
* (comp) Continuous   : 517/642=0.8053 517/788=0.6561 0.7231                
p-value=(P=0.0000, R=0.0000, F1=0.0820)
* (pred) Discontinuous: 96/159=0.6038 96/181=0.5304 0.5647                
* (comp) Discontinuous: 85/136=0.6250 85/181=0.4696 0.5363                
p-value=(P=0.3090, R=0.0680, F1=0.2340)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 300/468=0.6410 300/499=0.6012 0.6205                
* (comp) Multi-token  : 239/345=0.6928 239/499=0.4790 0.5664                
p-value=(P=0.0320, R=0.0000, F1=0.0080)
* (pred) Single-token : 414/558=0.7419 414/470=0.8809 0.8054                
* (comp) Single-token : 363/433=0.8383 363/470=0.7723 0.8040                
p-value=(P=0.0000, R=0.0000, F1=0.4930)
* (pred) Seen-in-train: 516/535=0.9645 516/612=0.8431 0.8997                
* (comp) Seen-in-train: 582/676=0.8609 582/612=0.9510 0.9037                
p-value=(P=0.0000, R=0.0000, F1=0.3850)
* (pred) Unseen-in-train: 198/491=0.4033 198/357=0.5546 0.4670                
* (comp) Unseen-in-train: 20/102=0.1961 20/357=0.0560 0.0871                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 275/280=0.9821 275/293=0.9386 0.9599                
* (comp) Variant-of-train: 287/305=0.9410 287/293=0.9795 0.9599                
p-value=(P=0.0000, R=0.0020, F1=0.4970)
* (pred) Identical-to-train: 241/255=0.9451 241/319=0.7555 0.8397                
* (comp) Identical-to-train: 295/371=0.7951 295/319=0.9248 0.8551                
p-value=(P=0.0000, R=0.0000, F1=0.2410)


Language : SV
Systems : MTLB-STRUCT.open,TRAVIS-mono.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 714/1026=0.6959 714/969=0.7368 0.7158                
* (comp) MWE-based    : 634/921=0.6884 634/969=0.6543 0.6709                
p-value=(P=0.3170, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 618/867=0.7128 618/788=0.7843 0.7468                
* (comp) Continuous   : 546/786=0.6947 546/788=0.6929 0.6938                
p-value=(P=0.1320, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 96/159=0.6038 96/181=0.5304 0.5647                
* (comp) Discontinuous: 88/135=0.6519 88/181=0.4862 0.5570                
p-value=(P=0.1510, R=0.1400, F1=0.4120)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 300/468=0.6410 300/499=0.6012 0.6205                
* (comp) Multi-token  : 281/394=0.7132 281/499=0.5631 0.6293                
p-value=(P=0.0010, R=0.0420, F1=0.3420)
* (pred) Single-token : 414/558=0.7419 414/470=0.8809 0.8054                
* (comp) Single-token : 353/527=0.6698 353/470=0.7511 0.7081                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Seen-in-train: 516/535=0.9645 516/612=0.8431 0.8997                
* (comp) Seen-in-train: 471/484=0.9731 471/612=0.7696 0.8595                
p-value=(P=0.0920, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 198/491=0.4033 198/357=0.5546 0.4670                
* (comp) Unseen-in-train: 163/437=0.3730 163/357=0.4566 0.4106                
p-value=(P=0.1070, R=0.0010, F1=0.0140)
* (pred) Variant-of-train: 275/280=0.9821 275/293=0.9386 0.9599                
* (comp) Variant-of-train: 263/268=0.9813 263/293=0.8976 0.9376                
p-value=(P=0.3930, R=0.0230, F1=0.0270)
* (pred) Identical-to-train: 241/255=0.9451 241/319=0.7555 0.8397                
* (comp) Identical-to-train: 208/216=0.9630 208/319=0.6520 0.7776                
p-value=(P=0.0930, R=0.0000, F1=0.0000)


Language : SV
Systems : MTLB-STRUCT.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 714/1026=0.6959 714/969=0.7368 0.7158                
* (comp) MWE-based    : 641/886=0.7235 641/969=0.6615 0.6911                
p-value=(P=0.0270, R=0.0000, F1=0.0250)

## MWE continuity (partition of Global)
* (pred) Continuous   : 618/867=0.7128 618/788=0.7843 0.7468                
* (comp) Continuous   : 574/778=0.7378 574/788=0.7284 0.7331                
p-value=(P=0.0630, R=0.0000, F1=0.1470)
* (pred) Discontinuous: 96/159=0.6038 96/181=0.5304 0.5647                
* (comp) Discontinuous: 67/108=0.6204 67/181=0.3702 0.4637                
p-value=(P=0.3520, R=0.0000, F1=0.0030)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 300/468=0.6410 300/499=0.6012 0.6205                
* (comp) Multi-token  : 247/348=0.7098 247/499=0.4950 0.5832                
p-value=(P=0.0000, R=0.0000, F1=0.0340)
* (pred) Single-token : 414/558=0.7419 414/470=0.8809 0.8054                
* (comp) Single-token : 394/538=0.7323 394/470=0.8383 0.7817                
p-value=(P=0.2860, R=0.0020, F1=0.0450)
* (pred) Seen-in-train: 516/535=0.9645 516/612=0.8431 0.8997                
* (comp) Seen-in-train: 484/505=0.9584 484/612=0.7908 0.8666                
p-value=(P=0.1340, R=0.0020, F1=0.0010)
* (pred) Unseen-in-train: 198/491=0.4033 198/357=0.5546 0.4670                
* (comp) Unseen-in-train: 157/381=0.4121 157/357=0.4398 0.4255                
p-value=(P=0.3670, R=0.0000, F1=0.0270)
* (pred) Variant-of-train: 275/280=0.9821 275/293=0.9386 0.9599                
* (comp) Variant-of-train: 272/278=0.9784 272/293=0.9283 0.9527                
p-value=(P=0.1360, R=0.2620, F1=0.2070)
* (pred) Identical-to-train: 241/255=0.9451 241/319=0.7555 0.8397                
* (comp) Identical-to-train: 212/227=0.9339 212/319=0.6646 0.7766                
p-value=(P=0.1650, R=0.0000, F1=0.0000)


Language : SV
Systems : Seen2Unseen.open,TRAVIS-mono.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 602/778=0.7738 602/969=0.6213 0.6892                
* (comp) MWE-based    : 634/921=0.6884 634/969=0.6543 0.6709                
p-value=(P=0.0000, R=0.0240, F1=0.1030)

## MWE continuity (partition of Global)
* (pred) Continuous   : 517/642=0.8053 517/788=0.6561 0.7231                
* (comp) Continuous   : 546/786=0.6947 546/788=0.6929 0.6938                
p-value=(P=0.0000, R=0.0270, F1=0.0270)
* (pred) Discontinuous: 85/136=0.6250 85/181=0.4696 0.5363                
* (comp) Discontinuous: 88/135=0.6519 88/181=0.4862 0.5570                
p-value=(P=0.3050, R=0.3460, F1=0.3090)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 239/345=0.6928 239/499=0.4790 0.5664                
* (comp) Multi-token  : 281/394=0.7132 281/499=0.5631 0.6293                
p-value=(P=0.2350, R=0.0000, F1=0.0020)
* (pred) Single-token : 363/433=0.8383 363/470=0.7723 0.8040                
* (comp) Single-token : 353/527=0.6698 353/470=0.7511 0.7081                
p-value=(P=0.0000, R=0.2010, F1=0.0000)
* (pred) Seen-in-train: 582/676=0.8609 582/612=0.9510 0.9037                
* (comp) Seen-in-train: 471/484=0.9731 471/612=0.7696 0.8595                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 20/102=0.1961 20/357=0.0560 0.0871                
* (comp) Unseen-in-train: 163/437=0.3730 163/357=0.4566 0.4106                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 287/305=0.9410 287/293=0.9795 0.9599                
* (comp) Variant-of-train: 263/268=0.9813 263/293=0.8976 0.9376                
p-value=(P=0.0000, R=0.0000, F1=0.0280)
* (pred) Identical-to-train: 295/371=0.7951 295/319=0.9248 0.8551                
* (comp) Identical-to-train: 208/216=0.9630 208/319=0.6520 0.7776                
p-value=(P=0.0000, R=0.0000, F1=0.0000)


Language : SV
Systems : Seen2Unseen.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 602/778=0.7738 602/969=0.6213 0.6892                
* (comp) MWE-based    : 641/886=0.7235 641/969=0.6615 0.6911                
p-value=(P=0.0020, R=0.0110, F1=0.4640)

## MWE continuity (partition of Global)
* (pred) Continuous   : 517/642=0.8053 517/788=0.6561 0.7231                
* (comp) Continuous   : 574/778=0.7378 574/788=0.7284 0.7331                
p-value=(P=0.0000, R=0.0000, F1=0.2680)
* (pred) Discontinuous: 85/136=0.6250 85/181=0.4696 0.5363                
* (comp) Discontinuous: 67/108=0.6204 67/181=0.3702 0.4637                
p-value=(P=0.4780, R=0.0110, F1=0.0350)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 239/345=0.6928 239/499=0.4790 0.5664                
* (comp) Multi-token  : 247/348=0.7098 247/499=0.4950 0.5832                
p-value=(P=0.3020, R=0.2800, F1=0.2580)
* (pred) Single-token : 363/433=0.8383 363/470=0.7723 0.8040                
* (comp) Single-token : 394/538=0.7323 394/470=0.8383 0.7817                
p-value=(P=0.0000, R=0.0030, F1=0.1300)
* (pred) Seen-in-train: 582/676=0.8609 582/612=0.9510 0.9037                
* (comp) Seen-in-train: 484/505=0.9584 484/612=0.7908 0.8666                
p-value=(P=0.0000, R=0.0000, F1=0.0010)
* (pred) Unseen-in-train: 20/102=0.1961 20/357=0.0560 0.0871                
* (comp) Unseen-in-train: 157/381=0.4121 157/357=0.4398 0.4255                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 287/305=0.9410 287/293=0.9795 0.9599                
* (comp) Variant-of-train: 272/278=0.9784 272/293=0.9283 0.9527                
p-value=(P=0.0000, R=0.0020, F1=0.2350)
* (pred) Identical-to-train: 295/371=0.7951 295/319=0.9248 0.8551                
* (comp) Identical-to-train: 212/227=0.9339 212/319=0.6646 0.7766                
p-value=(P=0.0000, R=0.0000, F1=0.0000)


Language : SV
Systems : TRAVIS-mono.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 634/921=0.6884 634/969=0.6543 0.6709                
* (comp) MWE-based    : 641/886=0.7235 641/969=0.6615 0.6911                
p-value=(P=0.0150, R=0.3340, F1=0.0810)

## MWE continuity (partition of Global)
* (pred) Continuous   : 546/786=0.6947 546/788=0.6929 0.6938                
* (comp) Continuous   : 574/778=0.7378 574/788=0.7284 0.7331                
p-value=(P=0.0060, R=0.0450, F1=0.0070)
* (pred) Discontinuous: 88/135=0.6519 88/181=0.4862 0.5570                
* (comp) Discontinuous: 67/108=0.6204 67/181=0.3702 0.4637                
p-value=(P=0.2630, R=0.0010, F1=0.0050)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 281/394=0.7132 281/499=0.5631 0.6293                
* (comp) Multi-token  : 247/348=0.7098 247/499=0.4950 0.5832                
p-value=(P=0.4480, R=0.0000, F1=0.0090)
* (pred) Single-token : 353/527=0.6698 353/470=0.7511 0.7081                
* (comp) Single-token : 394/538=0.7323 394/470=0.8383 0.7817                
p-value=(P=0.0030, R=0.0010, F1=0.0000)
* (pred) Seen-in-train: 471/484=0.9731 471/612=0.7696 0.8595                
* (comp) Seen-in-train: 484/505=0.9584 484/612=0.7908 0.8666                
p-value=(P=0.0100, R=0.1200, F1=0.2800)
* (pred) Unseen-in-train: 163/437=0.3730 163/357=0.4566 0.4106                
* (comp) Unseen-in-train: 157/381=0.4121 157/357=0.4398 0.4255                
p-value=(P=0.0780, R=0.3080, F1=0.3100)
* (pred) Variant-of-train: 263/268=0.9813 263/293=0.8976 0.9376                
* (comp) Variant-of-train: 272/278=0.9784 272/293=0.9283 0.9527                
p-value=(P=0.2220, R=0.0660, F1=0.0800)
* (pred) Identical-to-train: 208/216=0.9630 208/319=0.6520 0.7776                
* (comp) Identical-to-train: 212/227=0.9339 212/319=0.6646 0.7766                
p-value=(P=0.0080, R=0.3310, F1=0.4780)



Language : TR
Systems : ERMI.closed,Seen2Seen.closed
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 712/1061=0.6711 712/1151=0.6186 0.6438                
* (comp) MWE-based    : 752/1219=0.6169 752/1151=0.6533 0.6346                
p-value=(P=0.0000, R=0.0170, F1=0.2540)

## MWE continuity (partition of Global)
* (pred) Continuous   : 705/1047=0.6734 705/1102=0.6397 0.6561                
* (comp) Continuous   : 735/1154=0.6369 735/1102=0.6670 0.6516                
p-value=(P=0.0040, R=0.0490, F1=0.3820)
* (pred) Discontinuous: 7/14=0.5000   7/49=0.1429   0.2222                
* (comp) Discontinuous: 17/65=0.2615  17/49=0.3469  0.2982                
p-value=(P=0.0350, R=0.0030, F1=0.1320)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 712/1054=0.6755 712/1150=0.6191 0.6461                
* (comp) Multi-token  : 752/1219=0.6169 752/1150=0.6539 0.6349                
p-value=(P=0.0000, R=0.0170, F1=0.2110)
* (pred) Single-token : 0/7=0.0000    0/1=0.0000    0.0000                
* (comp) Single-token : 0/0=0.0000    0/1=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 599/767=0.7810 599/844=0.7097 0.7436                
* (comp) Seen-in-train: 749/1212=0.6180 749/844=0.8874 0.7286                
p-value=(P=0.0000, R=0.0000, F1=0.1360)
* (pred) Unseen-in-train: 113/294=0.3844 113/307=0.3681 0.3760                
* (comp) Unseen-in-train: 3/7=0.4286    3/307=0.0098  0.0191                
p-value=(P=0.4290, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 295/355=0.8310 295/350=0.8429 0.8369                
* (comp) Variant-of-train: 322/415=0.7759 322/350=0.9200 0.8418                
p-value=(P=0.0000, R=0.0000, F1=0.3630)
* (pred) Identical-to-train: 304/412=0.7379 304/494=0.6154 0.6711                
* (comp) Identical-to-train: 427/797=0.5358 427/494=0.8644 0.6615                
p-value=(P=0.0000, R=0.0000, F1=0.3150)



Language : TR
Systems : FipsCo.open,HMSid.open


Language : TR
Systems : FipsCo.open,MTLB-STRUCT.open


Language : TR
Systems : FipsCo.open,Seen2Unseen.open


Language : TR
Systems : FipsCo.open,TRAVIS-mono.open


Language : TR
Systems : FipsCo.open,TRAVIS-multi.open


Language : TR
Systems : HMSid.open,MTLB-STRUCT.open


Language : TR
Systems : HMSid.open,Seen2Unseen.open


Language : TR
Systems : HMSid.open,TRAVIS-mono.open


Language : TR
Systems : HMSid.open,TRAVIS-multi.open


Language : TR
Systems : MTLB-STRUCT.open,Seen2Unseen.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 812/1187=0.6841 812/1151=0.7055 0.6946                
* (comp) MWE-based    : 804/1498=0.5367 804/1151=0.6985 0.6070                
p-value=(P=0.0000, R=0.3280, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 801/1163=0.6887 801/1102=0.7269 0.7073                
* (comp) Continuous   : 785/1398=0.5615 785/1102=0.7123 0.6280                
p-value=(P=0.0000, R=0.1940, F1=0.0000)
* (pred) Discontinuous: 11/24=0.4583  11/49=0.2245  0.3014                
* (comp) Discontinuous: 19/100=0.1900 19/49=0.3878  0.2550                
p-value=(P=0.0070, R=0.0060, F1=0.2230)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 812/1163=0.6982 812/1150=0.7061 0.7021                
* (comp) Multi-token  : 804/1498=0.5367 804/1150=0.6991 0.6073                
p-value=(P=0.0000, R=0.3280, F1=0.0000)
* (pred) Single-token : 0/24=0.0000   0/1=0.0000    0.0000                
* (comp) Single-token : 0/0=0.0000    0/1=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 670/856=0.7827 670/844=0.7938 0.7882                
* (comp) Seen-in-train: 757/1250=0.6056 757/844=0.8969 0.7230                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 142/331=0.4290 142/307=0.4625 0.4451                
* (comp) Unseen-in-train: 47/248=0.1895 47/307=0.1531 0.1694                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 317/388=0.8170 317/350=0.9057 0.8591                
* (comp) Variant-of-train: 323/416=0.7764 323/350=0.9229 0.8433                
p-value=(P=0.0020, R=0.2010, F1=0.1130)
* (pred) Identical-to-train: 353/468=0.7543 353/494=0.7146 0.7339                
* (comp) Identical-to-train: 434/834=0.5204 434/494=0.8785 0.6536                
p-value=(P=0.0000, R=0.0000, F1=0.0000)


Language : TR
Systems : MTLB-STRUCT.open,TRAVIS-mono.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 812/1187=0.6841 812/1151=0.7055 0.6946                
* (comp) MWE-based    : 820/1174=0.6985 820/1151=0.7124 0.7054                
p-value=(P=0.1140, R=0.3000, F1=0.1540)

## MWE continuity (partition of Global)
* (pred) Continuous   : 801/1163=0.6887 801/1102=0.7269 0.7073                
* (comp) Continuous   : 803/1132=0.7094 803/1102=0.7287 0.7189                
p-value=(P=0.0420, R=0.4530, F1=0.1420)
* (pred) Discontinuous: 11/24=0.4583  11/49=0.2245  0.3014                
* (comp) Discontinuous: 17/42=0.4048  17/49=0.3469  0.3736                
p-value=(P=0.2850, R=0.0210, F1=0.1490)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 812/1163=0.6982 812/1150=0.7061 0.7021                
* (comp) Multi-token  : 820/1138=0.7206 820/1150=0.7130 0.7168                
p-value=(P=0.0200, R=0.3000, F1=0.0710)
* (pred) Single-token : 0/24=0.0000   0/1=0.0000    0.0000                
* (comp) Single-token : 0/36=0.0000   0/1=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 670/856=0.7827 670/844=0.7938 0.7882                
* (comp) Seen-in-train: 663/843=0.7865 663/844=0.7855 0.7860                
p-value=(P=0.3450, R=0.2820, F1=0.4300)
* (pred) Unseen-in-train: 142/331=0.4290 142/307=0.4625 0.4451                
* (comp) Unseen-in-train: 157/331=0.4743 157/307=0.5114 0.4922                
p-value=(P=0.0380, R=0.0340, F1=0.0170)
* (pred) Variant-of-train: 317/388=0.8170 317/350=0.9057 0.8591                
* (comp) Variant-of-train: 315/379=0.8311 315/350=0.9000 0.8642                
p-value=(P=0.1260, R=0.3590, F1=0.3010)
* (pred) Identical-to-train: 353/468=0.7543 353/494=0.7146 0.7339                
* (comp) Identical-to-train: 348/464=0.7500 348/494=0.7045 0.7265                
p-value=(P=0.3910, R=0.3240, F1=0.3320)


Language : TR
Systems : MTLB-STRUCT.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 812/1187=0.6841 812/1151=0.7055 0.6946                
* (comp) MWE-based    : 852/1327=0.6420 852/1151=0.7402 0.6877                
p-value=(P=0.0000, R=0.0000, F1=0.1870)

## MWE continuity (partition of Global)
* (pred) Continuous   : 801/1163=0.6887 801/1102=0.7269 0.7073                
* (comp) Continuous   : 837/1291=0.6483 837/1102=0.7595 0.6995                
p-value=(P=0.0000, R=0.0000, F1=0.1700)
* (pred) Discontinuous: 11/24=0.4583  11/49=0.2245  0.3014                
* (comp) Discontinuous: 15/36=0.4167  15/49=0.3061  0.3529                
p-value=(P=0.3430, R=0.0580, F1=0.1820)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 812/1163=0.6982 812/1150=0.7061 0.7021                
* (comp) Multi-token  : 852/1275=0.6682 852/1150=0.7409 0.7027                
p-value=(P=0.0020, R=0.0000, F1=0.4960)
* (pred) Single-token : 0/24=0.0000   0/1=0.0000    0.0000                
* (comp) Single-token : 0/52=0.0000   0/1=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 670/856=0.7827 670/844=0.7938 0.7882                
* (comp) Seen-in-train: 699/908=0.7698 699/844=0.8282 0.7979                
p-value=(P=0.0860, R=0.0020, F1=0.1130)
* (pred) Unseen-in-train: 142/331=0.4290 142/307=0.4625 0.4451                
* (comp) Unseen-in-train: 153/419=0.3652 153/307=0.4984 0.4215                
p-value=(P=0.0010, R=0.0470, F1=0.0870)
* (pred) Variant-of-train: 317/388=0.8170 317/350=0.9057 0.8591                
* (comp) Variant-of-train: 327/399=0.8195 327/350=0.9343 0.8732                
p-value=(P=0.4130, R=0.0430, F1=0.1100)
* (pred) Identical-to-train: 353/468=0.7543 353/494=0.7146 0.7339                
* (comp) Identical-to-train: 372/509=0.7308 372/494=0.7530 0.7418                
p-value=(P=0.0480, R=0.0070, F1=0.2450)


Language : TR
Systems : Seen2Unseen.open,TRAVIS-mono.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 804/1498=0.5367 804/1151=0.6985 0.6070                
* (comp) MWE-based    : 820/1174=0.6985 820/1151=0.7124 0.7054                
p-value=(P=0.0000, R=0.1960, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 785/1398=0.5615 785/1102=0.7123 0.6280                
* (comp) Continuous   : 803/1132=0.7094 803/1102=0.7287 0.7189                
p-value=(P=0.0000, R=0.1630, F1=0.0000)
* (pred) Discontinuous: 19/100=0.1900 19/49=0.3878  0.2550                
* (comp) Discontinuous: 17/42=0.4048  17/49=0.3469  0.3736                
p-value=(P=0.0020, R=0.2990, F1=0.0320)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 804/1498=0.5367 804/1150=0.6991 0.6073                
* (comp) Multi-token  : 820/1138=0.7206 820/1150=0.7130 0.7168                
p-value=(P=0.0000, R=0.1970, F1=0.0000)
* (pred) Single-token : 0/0=0.0000    0/1=0.0000    0.0000                
* (comp) Single-token : 0/36=0.0000   0/1=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 757/1250=0.6056 757/844=0.8969 0.7230                
* (comp) Seen-in-train: 663/843=0.7865 663/844=0.7855 0.7860                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 47/248=0.1895 47/307=0.1531 0.1694                
* (comp) Unseen-in-train: 157/331=0.4743 157/307=0.5114 0.4922                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 323/416=0.7764 323/350=0.9229 0.8433                
* (comp) Variant-of-train: 315/379=0.8311 315/350=0.9000 0.8642                
p-value=(P=0.0000, R=0.1200, F1=0.0530)
* (pred) Identical-to-train: 434/834=0.5204 434/494=0.8785 0.6536                
* (comp) Identical-to-train: 348/464=0.7500 348/494=0.7045 0.7265                
p-value=(P=0.0000, R=0.0000, F1=0.0000)


Language : TR
Systems : Seen2Unseen.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 804/1498=0.5367 804/1151=0.6985 0.6070                
* (comp) MWE-based    : 852/1327=0.6420 852/1151=0.7402 0.6877                
p-value=(P=0.0000, R=0.0050, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 785/1398=0.5615 785/1102=0.7123 0.6280                
* (comp) Continuous   : 837/1291=0.6483 837/1102=0.7595 0.6995                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 19/100=0.1900 19/49=0.3878  0.2550                
* (comp) Discontinuous: 15/36=0.4167  15/49=0.3061  0.3529                
p-value=(P=0.0000, R=0.1110, F1=0.0610)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 804/1498=0.5367 804/1150=0.6991 0.6073                
* (comp) Multi-token  : 852/1275=0.6682 852/1150=0.7409 0.7027                
p-value=(P=0.0000, R=0.0050, F1=0.0000)
* (pred) Single-token : 0/0=0.0000    0/1=0.0000    0.0000                
* (comp) Single-token : 0/52=0.0000   0/1=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 757/1250=0.6056 757/844=0.8969 0.7230                
* (comp) Seen-in-train: 699/908=0.7698 699/844=0.8282 0.7979                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 47/248=0.1895 47/307=0.1531 0.1694                
* (comp) Unseen-in-train: 153/419=0.3652 153/307=0.4984 0.4215                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 323/416=0.7764 323/350=0.9229 0.8433                
* (comp) Variant-of-train: 327/399=0.8195 327/350=0.9343 0.8732                
p-value=(P=0.0000, R=0.2700, F1=0.0020)
* (pred) Identical-to-train: 434/834=0.5204 434/494=0.8785 0.6536                
* (comp) Identical-to-train: 372/509=0.7308 372/494=0.7530 0.7418                
p-value=(P=0.0000, R=0.0000, F1=0.0000)


Language : TR
Systems : TRAVIS-mono.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 820/1174=0.6985 820/1151=0.7124 0.7054                
* (comp) MWE-based    : 852/1327=0.6420 852/1151=0.7402 0.6877                
p-value=(P=0.0000, R=0.0090, F1=0.0470)

## MWE continuity (partition of Global)
* (pred) Continuous   : 803/1132=0.7094 803/1102=0.7287 0.7189                
* (comp) Continuous   : 837/1291=0.6483 837/1102=0.7595 0.6995                
p-value=(P=0.0000, R=0.0090, F1=0.0310)
* (pred) Discontinuous: 17/42=0.4048  17/49=0.3469  0.3736                
* (comp) Discontinuous: 15/36=0.4167  15/49=0.3061  0.3529                
p-value=(P=0.4330, R=0.2470, F1=0.3730)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 820/1138=0.7206 820/1150=0.7130 0.7168                
* (comp) Multi-token  : 852/1275=0.6682 852/1150=0.7409 0.7027                
p-value=(P=0.0000, R=0.0090, F1=0.0820)
* (pred) Single-token : 0/36=0.0000   0/1=0.0000    0.0000                
* (comp) Single-token : 0/52=0.0000   0/1=0.0000    0.0000                
p-value=(P=1.0000, R=1.0000, F1=1.0000)
* (pred) Seen-in-train: 663/843=0.7865 663/844=0.7855 0.7860                
* (comp) Seen-in-train: 699/908=0.7698 699/844=0.8282 0.7979                
p-value=(P=0.0530, R=0.0010, F1=0.1240)
* (pred) Unseen-in-train: 157/331=0.4743 157/307=0.5114 0.4922                
* (comp) Unseen-in-train: 153/419=0.3652 153/307=0.4984 0.4215                
p-value=(P=0.0000, R=0.3120, F1=0.0020)
* (pred) Variant-of-train: 315/379=0.8311 315/350=0.9000 0.8642                
* (comp) Variant-of-train: 327/399=0.8195 327/350=0.9343 0.8732                
p-value=(P=0.1620, R=0.0210, F1=0.2210)
* (pred) Identical-to-train: 348/464=0.7500 348/494=0.7045 0.7265                
* (comp) Identical-to-train: 372/509=0.7308 372/494=0.7530 0.7418                
p-value=(P=0.0960, R=0.0070, F1=0.1740)



Language : ZH
Systems : ERMI.closed,Seen2Seen.closed
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 440/660=0.6667 440/786=0.5598 0.6086                
* (comp) MWE-based    : 430/959=0.4484 430/786=0.5471 0.4928                
p-value=(P=0.0000, R=0.2680, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 412/609=0.6765 412/678=0.6077 0.6402                
* (comp) Continuous   : 401/882=0.4546 401/678=0.5914 0.5141                
p-value=(P=0.0000, R=0.2360, F1=0.0000)
* (pred) Discontinuous: 28/51=0.5490  28/108=0.2593 0.3522                
* (comp) Discontinuous: 29/77=0.3766  29/108=0.2685 0.3135                
p-value=(P=0.0110, R=0.4390, F1=0.2460)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 252/345=0.7304 252/424=0.5943 0.6554                
* (comp) Multi-token  : 183/338=0.5414 183/424=0.4316 0.4803                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 188/315=0.5968 188/362=0.5193 0.5554                
* (comp) Single-token : 247/621=0.3977 247/362=0.6823 0.5025                
p-value=(P=0.0000, R=0.0000, F1=0.0190)
* (pred) Seen-in-train: 341/455=0.7495 341/500=0.6820 0.7141                
* (comp) Seen-in-train: 427/947=0.4509 427/500=0.8540 0.5902                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Unseen-in-train: 99/205=0.4829 99/286=0.3462 0.4033                
* (comp) Unseen-in-train: 3/12=0.2500   3/286=0.0105  0.0201                
p-value=(P=0.0300, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 310/401=0.7731 310/430=0.7209 0.7461                
* (comp) Variant-of-train: 393/844=0.4656 393/430=0.9140 0.6170                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 31/54=0.5741  31/70=0.4429  0.5000                
* (comp) Identical-to-train: 34/103=0.3301 34/70=0.4857  0.3931                
p-value=(P=0.0010, R=0.2290, F1=0.0170)



Language : ZH
Systems : FipsCo.open,HMSid.open


Language : ZH
Systems : FipsCo.open,MTLB-STRUCT.open


Language : ZH
Systems : FipsCo.open,Seen2Unseen.open


Language : ZH
Systems : FipsCo.open,TRAVIS-mono.open


Language : ZH
Systems : FipsCo.open,TRAVIS-multi.open


Language : ZH
Systems : HMSid.open,MTLB-STRUCT.open


Language : ZH
Systems : HMSid.open,Seen2Unseen.open


Language : ZH
Systems : HMSid.open,TRAVIS-mono.open


Language : ZH
Systems : HMSid.open,TRAVIS-multi.open


Language : ZH
Systems : MTLB-STRUCT.open,Seen2Unseen.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 556/811=0.6856 556/786=0.7074 0.6963                
* (comp) MWE-based    : 434/1011=0.4293 434/786=0.5522 0.4830                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 494/711=0.6948 494/678=0.7286 0.7113                
* (comp) Continuous   : 401/913=0.4392 401/678=0.5914 0.5041                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 62/100=0.6200 62/108=0.5741 0.5962                
* (comp) Discontinuous: 33/98=0.3367  33/108=0.3056 0.3204                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 309/399=0.7744 309/424=0.7288 0.7509                
* (comp) Multi-token  : 187/390=0.4795 187/424=0.4410 0.4595                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 247/412=0.5995 247/362=0.6823 0.6382                
* (comp) Single-token : 247/621=0.3977 247/362=0.6823 0.5025                
p-value=(P=0.0000, R=1.0000, F1=0.0000)
* (pred) Seen-in-train: 400/552=0.7246 400/500=0.8000 0.7605                
* (comp) Seen-in-train: 429/959=0.4473 429/500=0.8580 0.5881                
p-value=(P=0.0000, R=0.0050, F1=0.0000)
* (pred) Unseen-in-train: 156/259=0.6023 156/286=0.5455 0.5725                
* (comp) Unseen-in-train: 5/52=0.0962   5/286=0.0175  0.0296                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 355/478=0.7427 355/430=0.8256 0.7819                
* (comp) Variant-of-train: 393/846=0.4645 393/430=0.9140 0.6160                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 45/74=0.6081  45/70=0.6429  0.6250                
* (comp) Identical-to-train: 36/113=0.3186 36/70=0.5143  0.3934                
p-value=(P=0.0000, R=0.0560, F1=0.0000)


Language : ZH
Systems : MTLB-STRUCT.open,TRAVIS-mono.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 556/811=0.6856 556/786=0.7074 0.6963                
* (comp) MWE-based    : 595/870=0.6839 595/786=0.7570 0.7186                
p-value=(P=0.4420, R=0.0010, F1=0.0450)

## MWE continuity (partition of Global)
* (pred) Continuous   : 494/711=0.6948 494/678=0.7286 0.7113                
* (comp) Continuous   : 540/784=0.6888 540/678=0.7965 0.7387                
p-value=(P=0.3200, R=0.0000, F1=0.0270)
* (pred) Discontinuous: 62/100=0.6200 62/108=0.5741 0.5962                
* (comp) Discontinuous: 55/86=0.6395  55/108=0.5093 0.5670                
p-value=(P=0.3060, R=0.1010, F1=0.2410)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 309/399=0.7744 309/424=0.7288 0.7509                
* (comp) Multi-token  : 315/404=0.7797 315/424=0.7429 0.7609                
p-value=(P=0.3890, R=0.2350, F1=0.2590)
* (pred) Single-token : 247/412=0.5995 247/362=0.6823 0.6382                
* (comp) Single-token : 280/466=0.6009 280/362=0.7735 0.6763                
p-value=(P=0.4920, R=0.0000, F1=0.0210)
* (pred) Seen-in-train: 400/552=0.7246 400/500=0.8000 0.7605                
* (comp) Seen-in-train: 414/568=0.7289 414/500=0.8280 0.7753                
p-value=(P=0.3950, R=0.0640, F1=0.1360)
* (pred) Unseen-in-train: 156/259=0.6023 156/286=0.5455 0.5725                
* (comp) Unseen-in-train: 181/302=0.5993 181/286=0.6329 0.6156                
p-value=(P=0.4590, R=0.0040, F1=0.0410)
* (pred) Variant-of-train: 355/478=0.7427 355/430=0.8256 0.7819                
* (comp) Variant-of-train: 369/497=0.7425 369/430=0.8581 0.7961                
p-value=(P=0.4820, R=0.0480, F1=0.1490)
* (pred) Identical-to-train: 45/74=0.6081  45/70=0.6429  0.6250                
* (comp) Identical-to-train: 45/71=0.6338  45/70=0.6429  0.6383                
p-value=(P=0.2560, R=1.0000, F1=0.3640)


Language : ZH
Systems : MTLB-STRUCT.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 556/811=0.6856 556/786=0.7074 0.6963                
* (comp) MWE-based    : 542/762=0.7113 542/786=0.6896 0.7003                
p-value=(P=0.0280, R=0.0970, F1=0.3620)

## MWE continuity (partition of Global)
* (pred) Continuous   : 494/711=0.6948 494/678=0.7286 0.7113                
* (comp) Continuous   : 486/682=0.7126 486/678=0.7168 0.7147                
p-value=(P=0.0940, R=0.1810, F1=0.3960)
* (pred) Discontinuous: 62/100=0.6200 62/108=0.5741 0.5962                
* (comp) Discontinuous: 56/80=0.7000  56/108=0.5185 0.5957                
p-value=(P=0.0390, R=0.0770, F1=0.5170)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 309/399=0.7744 309/424=0.7288 0.7509                
* (comp) Multi-token  : 300/375=0.8000 300/424=0.7075 0.7509                
p-value=(P=0.0750, R=0.1120, F1=0.5240)
* (pred) Single-token : 247/412=0.5995 247/362=0.6823 0.6382                
* (comp) Single-token : 242/387=0.6253 242/362=0.6685 0.6462                
p-value=(P=0.0900, R=0.2400, F1=0.3180)
* (pred) Seen-in-train: 400/552=0.7246 400/500=0.8000 0.7605                
* (comp) Seen-in-train: 397/524=0.7576 397/500=0.7940 0.7754                
p-value=(P=0.0040, R=0.3310, F1=0.1070)
* (pred) Unseen-in-train: 156/259=0.6023 156/286=0.5455 0.5725                
* (comp) Unseen-in-train: 145/238=0.6092 145/286=0.5070 0.5534                
p-value=(P=0.4120, R=0.0520, F1=0.1760)
* (pred) Variant-of-train: 355/478=0.7427 355/430=0.8256 0.7819                
* (comp) Variant-of-train: 356/461=0.7722 356/430=0.8279 0.7991                
p-value=(P=0.0190, R=0.4570, F1=0.0820)
* (pred) Identical-to-train: 45/74=0.6081  45/70=0.6429  0.6250                
* (comp) Identical-to-train: 41/63=0.6508  41/70=0.5857  0.6165                
p-value=(P=0.1700, R=0.0990, F1=0.4130)


Language : ZH
Systems : Seen2Unseen.open,TRAVIS-mono.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 434/1011=0.4293 434/786=0.5522 0.4830                
* (comp) MWE-based    : 595/870=0.6839 595/786=0.7570 0.7186                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 401/913=0.4392 401/678=0.5914 0.5041                
* (comp) Continuous   : 540/784=0.6888 540/678=0.7965 0.7387                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 33/98=0.3367  33/108=0.3056 0.3204                
* (comp) Discontinuous: 55/86=0.6395  55/108=0.5093 0.5670                
p-value=(P=0.0000, R=0.0010, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 187/390=0.4795 187/424=0.4410 0.4595                
* (comp) Multi-token  : 315/404=0.7797 315/424=0.7429 0.7609                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 247/621=0.3977 247/362=0.6823 0.5025                
* (comp) Single-token : 280/466=0.6009 280/362=0.7735 0.6763                
p-value=(P=0.0000, R=0.0010, F1=0.0000)
* (pred) Seen-in-train: 429/959=0.4473 429/500=0.8580 0.5881                
* (comp) Seen-in-train: 414/568=0.7289 414/500=0.8280 0.7753                
p-value=(P=0.0000, R=0.0760, F1=0.0000)
* (pred) Unseen-in-train: 5/52=0.0962   5/286=0.0175  0.0296                
* (comp) Unseen-in-train: 181/302=0.5993 181/286=0.6329 0.6156                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 393/846=0.4645 393/430=0.9140 0.6160                
* (comp) Variant-of-train: 369/497=0.7425 369/430=0.8581 0.7961                
p-value=(P=0.0000, R=0.0040, F1=0.0000)
* (pred) Identical-to-train: 36/113=0.3186 36/70=0.5143  0.3934                
* (comp) Identical-to-train: 45/71=0.6338  45/70=0.6429  0.6383                
p-value=(P=0.0000, R=0.0380, F1=0.0000)


Language : ZH
Systems : Seen2Unseen.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 434/1011=0.4293 434/786=0.5522 0.4830                
* (comp) MWE-based    : 542/762=0.7113 542/786=0.6896 0.7003                
p-value=(P=0.0000, R=0.0000, F1=0.0000)

## MWE continuity (partition of Global)
* (pred) Continuous   : 401/913=0.4392 401/678=0.5914 0.5041                
* (comp) Continuous   : 486/682=0.7126 486/678=0.7168 0.7147                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Discontinuous: 33/98=0.3367  33/108=0.3056 0.3204                
* (comp) Discontinuous: 56/80=0.7000  56/108=0.5185 0.5957                
p-value=(P=0.0000, R=0.0010, F1=0.0000)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 187/390=0.4795 187/424=0.4410 0.4595                
* (comp) Multi-token  : 300/375=0.8000 300/424=0.7075 0.7509                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Single-token : 247/621=0.3977 247/362=0.6823 0.5025                
* (comp) Single-token : 242/387=0.6253 242/362=0.6685 0.6462                
p-value=(P=0.0000, R=0.3130, F1=0.0000)
* (pred) Seen-in-train: 429/959=0.4473 429/500=0.8580 0.5881                
* (comp) Seen-in-train: 397/524=0.7576 397/500=0.7940 0.7754                
p-value=(P=0.0000, R=0.0040, F1=0.0000)
* (pred) Unseen-in-train: 5/52=0.0962   5/286=0.0175  0.0296                
* (comp) Unseen-in-train: 145/238=0.6092 145/286=0.5070 0.5534                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Variant-of-train: 393/846=0.4645 393/430=0.9140 0.6160                
* (comp) Variant-of-train: 356/461=0.7722 356/430=0.8279 0.7991                
p-value=(P=0.0000, R=0.0000, F1=0.0000)
* (pred) Identical-to-train: 36/113=0.3186 36/70=0.5143  0.3934                
* (comp) Identical-to-train: 41/63=0.6508  41/70=0.5857  0.6165                
p-value=(P=0.0000, R=0.1690, F1=0.0000)


Language : ZH
Systems : TRAVIS-mono.open,TRAVIS-multi.open
## Global evaluation
*                     : Precision                      Recall                         F-score                       
* (pred) MWE-based    : 595/870=0.6839 595/786=0.7570 0.7186                
* (comp) MWE-based    : 542/762=0.7113 542/786=0.6896 0.7003                
p-value=(P=0.0080, R=0.0000, F1=0.0520)

## MWE continuity (partition of Global)
* (pred) Continuous   : 540/784=0.6888 540/678=0.7965 0.7387                
* (comp) Continuous   : 486/682=0.7126 486/678=0.7168 0.7147                
p-value=(P=0.0200, R=0.0000, F1=0.0200)
* (pred) Discontinuous: 55/86=0.6395  55/108=0.5093 0.5670                
* (comp) Discontinuous: 56/80=0.7000  56/108=0.5185 0.5957                
p-value=(P=0.0740, R=0.4070, F1=0.2040)

## Number of tokens (partition of Global)
* (pred) Multi-token  : 315/404=0.7797 315/424=0.7429 0.7609                
* (comp) Multi-token  : 300/375=0.8000 300/424=0.7075 0.7509                
p-value=(P=0.1250, R=0.0380, F1=0.2670)
* (pred) Single-token : 280/466=0.6009 280/362=0.7735 0.6763                
* (comp) Single-token : 242/387=0.6253 242/362=0.6685 0.6462                
p-value=(P=0.0810, R=0.0000, F1=0.0300)
* (pred) Seen-in-train: 414/568=0.7289 414/500=0.8280 0.7753                
* (comp) Seen-in-train: 397/524=0.7576 397/500=0.7940 0.7754                
p-value=(P=0.0050, R=0.0080, F1=0.4700)
* (pred) Unseen-in-train: 181/302=0.5993 181/286=0.6329 0.6156                
* (comp) Unseen-in-train: 145/238=0.6092 145/286=0.5070 0.5534                
p-value=(P=0.3670, R=0.0000, F1=0.0040)
* (pred) Variant-of-train: 369/497=0.7425 369/430=0.8581 0.7961                
* (comp) Variant-of-train: 356/461=0.7722 356/430=0.8279 0.7991                
p-value=(P=0.0020, R=0.0190, F1=0.3790)
* (pred) Identical-to-train: 45/71=0.6338  45/70=0.6429  0.6383                
* (comp) Identical-to-train: 41/63=0.6508  41/70=0.5857  0.6165                
p-value=(P=0.3500, R=0.1060, F1=0.2860)



