----------- Examples ------------
0
i need a cheap food place for 3 people tomorrow at 1 ##pm in seattle
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O B-pricing O O O B-numberofpeople O B-date O B-starttime I-starttime O B-city
Real slot label: O O O B-pricing O O O B-numberofpeople O B-date O B-starttime I-starttime O B-city
Score: 
Word 3 score: [9.9993789e-01 3.1857653e-07 2.9046332e-09 5.3277854e-05 8.4909389e-06]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [5.4396212e-02 7.1716188e-03 9.3998204e-07 4.8238630e-06 9.3842643e-01]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [2.7231378e-02 1.4423729e-04 8.9946859e-02 8.7449819e-01 8.1793377e-03]
------
1
sure ! do you have a specific restaurant or cuisine in mind ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O
Score: 
------
2
american please
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-cuisine O
Real slot label: B-cuisine O
Score: 
Word 0 score: [9.2722047e-03 3.3595267e-01 3.9177504e-03 6.5085649e-01 8.6925678e-07]
------
3
here are 3 of the top rated american restaurants that are cheap : beach ##house - madison park , bing ' s and blue star cafe and pub . would you like to try one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [3.6985750e-09 2.7546728e-01 6.9021964e-01 2.7316451e-02 6.9966158e-03]
Word 19 score: [2.3551099e-04 6.6959906e-01 2.3551099e-04 2.2106472e-06 3.2992768e-01]
Word 20 score: [0.26820523 0.002042   0.6055372  0.00080314 0.12341247]
Word 21 score: [9.9838984e-01 3.1434799e-06 1.6459241e-07 2.0161142e-06 1.6049393e-03]
Word 23 score: [3.8961494e-01 4.7050020e-11 6.9848546e-05 6.1031502e-01 2.1944490e-07]
Word 24 score: [2.1726241e-07 7.4416004e-02 2.3023398e-01 6.3317215e-01 6.2177610e-02]
Word 25 score: [1.5933931e-01 5.9755626e-03 9.1132917e-04 4.5591485e-11 8.3377385e-01]
Word 26 score: [0.44540477 0.03127796 0.03894825 0.11644214 0.3679269 ]
Word 27 score: [9.2062350e-05 6.7571080e-03 1.4210859e-03 2.6313888e-04 9.9146652e-01]
------
4
blue star cafe
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [9.9348491e-01 1.1534271e-09 6.8323780e-04 5.8306954e-03 1.2222740e-06]
Word 1 score: [1.6544480e-05 4.1711733e-02 6.4211071e-01 1.0117355e-01 2.1498744e-01]
Word 2 score: [6.0611065e-02 3.4309139e-03 5.6604820e-04 8.2764125e-14 9.3539202e-01]
------
5
your reservation has been confirmed . please enjoy your meal , and thank you for using our service !
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O B-closing I-closing I-closing O O O O O O O O O
Real slot label: O O O O O O O B-closing I-closing I-closing O O O O O O O O O
Score: 
Word 7 score: [8.3917668e-03 4.2783711e-02 9.4645780e-01 2.3655172e-03 1.1454551e-06]
Word 8 score: [1.0600486e-03 9.9802494e-01 9.1503456e-04 3.4081837e-16 3.4081837e-16]
Word 9 score: [3.3438010e-07 9.1732710e-07 5.1969728e-06 4.6020442e-01 5.3978914e-01]
------
6
i ' d like to reserve a table for 1 at bar ##olo ri ##stor ##ante in seattle for march 15th , i prefer 6 : 00 pm if available .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-city O B-date I-date O O O O O O O O O O
Real slot label: O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-city O B-date I-date O O O O O O O O O O
Score: 
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [4.0397071e-03 6.4486816e-09 1.7660875e-02 9.3364352e-01 4.4655923e-02]
Word 12 score: [3.8927662e-01 5.3505186e-08 7.4740425e-03 6.0141194e-01 1.8372574e-03]
Word 13 score: [9.8911834e-01 1.0881579e-02 4.5161627e-08 4.5161627e-08 4.5161627e-08]
Word 14 score: [9.8962337e-01 1.0376615e-02 1.1581878e-08 1.1581878e-08 1.1581878e-08]
Word 15 score: [9.9086529e-01 9.1346437e-03 4.2636678e-08 4.2636678e-08 4.2636678e-08]
Word 17 score: [8.0363519e-02 4.4532350e-04 4.2650327e-01 4.9140909e-01 1.2787558e-03]
Word 19 score: [8.7053841e-06 7.7889776e-01 7.2659813e-02 5.7460118e-02 9.0973608e-02]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
------
7
i have successfully completed your reservation . enjoy your meal !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-closing I-closing I-closing I-closing
Real slot label: O O O O O O O B-closing I-closing I-closing I-closing
Score: 
Word 7 score: [4.2373493e-02 2.3406044e-02 9.3308407e-01 5.8525260e-05 1.0778275e-03]
Word 8 score: [6.8508052e-05 9.9821329e-01 1.7181949e-03 8.9796833e-18 8.9796833e-18]
Word 9 score: [2.8774294e-04 2.3432812e-04 4.0474236e-03 6.8987620e-01 3.0555433e-01]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
------
8
locate a french bis ##tro with a 3 star or higher rating in the seattle are for reservation on monday night .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O B-city O O O O B-date I-date O
Real slot label: O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O B-city O O O O B-date I-date O
Score: 
Word 2 score: [0.6545534  0.00436021 0.02037508 0.00701357 0.31369776]
Word 3 score: [9.9725014e-01 1.2307332e-03 4.0400548e-07 1.5170912e-03 1.6933939e-06]
Word 4 score: [9.8821402e-01 9.1329766e-03 1.3040355e-06 2.6480916e-03 3.5987521e-06]
Word 14 score: [6.1913249e-03 8.0879960e-05 3.8739763e-02 9.5385736e-01 1.1306661e-03]
Word 19 score: [2.61052424e-04 1.11342524e-04 9.72132802e-01 1.37474323e-02
 1.37474323e-02]
Word 20 score: [2.6753226e-12 5.0000000e-01 3.0677520e-12 5.0000000e-01 3.6463769e-15]
------
9
sound good ! may i have the number of guests and the approximate time you ' d like to din ##e ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
10
three people for sure maybe four and around 6 : 30 would be good
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O B-starttime I-starttime I-starttime O O O
Real slot label: O O O O O O O O B-starttime I-starttime I-starttime O O O
Score: 
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
------
11
great ! mare ##e bis ##tro & bar , bas ##till ##e cafe & bar , and cafe camp ##agne all have tables available . which would you like to book ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O
Real slot label: O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O
Score: 
Word 2 score: [4.5309871e-06 1.6374166e-07 3.4975201e-08 9.9998701e-01 8.2576526e-06]
Word 3 score: [3.8730160e-03 3.4417535e-05 3.4959191e-09 9.9609250e-01 1.2501131e-09]
Word 4 score: [7.2739583e-01 2.5223568e-01 1.0216354e-04 2.0263949e-02 2.3814907e-06]
Word 5 score: [7.1978307e-01 2.6262301e-01 8.7025743e-05 1.7504703e-02 2.2455868e-06]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [2.2078771e-03 6.2770816e-08 2.7114017e-06 2.3823173e-03 9.9540710e-01]
Word 9 score: [5.6643232e-05 3.9409930e-01 1.0185591e-07 2.5010168e-06 6.0584152e-01]
Word 10 score: [3.2939263e-02 9.6032125e-01 3.5201261e-08 1.4148706e-04 6.5978752e-03]
Word 11 score: [9.8513871e-01 9.9722783e-06 3.2863750e-07 9.5765790e-05 1.4755252e-02]
Word 12 score: [1.5843756e-01 2.5346731e-03 8.3306443e-04 1.0766549e-12 8.3819467e-01]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [2.0164999e-03 4.9200516e-08 2.2791924e-06 1.8775603e-03 9.9610364e-01]
Word 17 score: [9.2099996e-05 8.0143765e-04 5.6222612e-03 1.3221732e-12 9.9348420e-01]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
------
12
i wan na try bas ##till ##e cafe & bar . can you let me know the price ranges of the en ##tree ##s and also if there is a dress code ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O O O O O O
Score: 
Word 4 score: [3.8121588e-04 1.8914646e-01 1.4925566e-06 2.9610672e-05 8.1044120e-01]
Word 5 score: [6.3947320e-01 3.3547100e-01 3.2243437e-07 1.6560756e-03 2.3399409e-02]
Word 6 score: [9.8903078e-01 3.1045386e-06 7.8939598e-07 2.0599648e-04 1.0759268e-02]
Word 7 score: [1.8096168e-01 7.7597890e-03 1.5689794e-03 4.1301313e-11 8.0970949e-01]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [7.2224840e-04 8.2693013e-08 3.1560248e-06 6.6816685e-04 9.9860626e-01]
------
13
the suggested dress code is business casual , and the en ##tree prices are $ 30 and under . your reservation has been confirmed . please enjoy your meal , and thank you for using our service !
Predicted label: ['inform', 'thanks']
Real label: ['inform']
Predicted slot label: O O O O O B-dress_code I-dress_code O O O O O O O B-pricing I-pricing I-pricing I-pricing O O O O O O O O B-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing
Real slot label: O O O O O B-dress_code I-dress_code O O O O O O O B-pricing I-pricing I-pricing I-pricing O O O O O O O O B-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing
Score: 
Word 5 score: [5.8825780e-04 4.7048521e-09 9.9941051e-01 1.1355917e-06 3.1986503e-15]
Word 6 score: [2.0434459e-04 8.2076949e-11 9.9110389e-01 8.6917384e-03 5.9876619e-08]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [6.3653272e-01 3.5030058e-01 4.1830197e-05 8.9028719e-05 1.3035803e-02]
Word 17 score: [3.5853728e-07 2.9487468e-03 6.1730884e-11 7.0578800e-11 9.9705088e-01]
Word 26 score: [1.5063241e-01 1.9824887e-02 8.2813865e-01 1.3910548e-03 1.3001060e-05]
Word 27 score: [3.1543805e-05 9.9918061e-01 7.8777887e-04 2.9292335e-17 2.9292335e-17]
Word 28 score: [9.02365082e-06 1.49130565e-05 3.77597666e-04 6.65110230e-01
 3.34488183e-01]
Word 29 score: [0.2 0.2 0.2 0.2 0.2]
Word 30 score: [9.9833894e-01 8.5414431e-05 4.1937779e-04 7.7304874e-05 1.0789167e-03]
Word 31 score: [2.6756709e-02 7.2449860e-05 9.7167081e-01 8.8501496e-05 1.4114695e-03]
Word 32 score: [3.8471738e-01 2.5148585e-03 9.1757681e-03 5.4752961e-04 6.0304445e-01]
Word 33 score: [5.0701413e-08 5.6222652e-06 1.0287904e-06 9.9993873e-01 5.4536042e-05]
Word 34 score: [1.5718954e-02 2.3876166e-04 1.5718954e-02 9.6832341e-01 2.3619673e-14]
Word 35 score: [2.00527282e-07 4.17374931e-02 6.29729271e-01 1.07250325e-01
 2.21282721e-01]
Word 36 score: [6.0870228e-03 7.9881765e-06 6.8925391e-04 6.5303603e-03 9.8668528e-01]
Word 37 score: [0.2 0.2 0.2 0.2 0.2]
------
14
book me a table for 2 in seattle for tomorrow at 7 : 00 pm at la med ##usa
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname
Real slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [2.3904976e-02 2.1839602e-04 3.5264768e-02 9.4022208e-01 3.8969037e-04]
Word 9 score: [7.4463814e-01 1.1494962e-01 1.2445830e-06 4.4266253e-06 1.4040659e-01]
Word 16 score: [8.7052888e-01 4.8233537e-04 7.0711858e-06 6.8648346e-02 6.0333449e-02]
Word 17 score: [5.1907423e-11 4.1739904e-07 2.3840363e-07 2.0332163e-11 9.9999928e-01]
Word 18 score: [4.1009760e-09 1.4743077e-06 1.8089553e-05 1.2074636e-11 9.9998045e-01]
------
15
your table is booked for tomorrow . thank you .
Predicted label: ['inform', 'thanks']
Real label: ['inform']
Predicted slot label: O O O O O B-date O O O O
Real slot label: O O O O O B-date O O O O
Score: 
Word 5 score: [6.3782322e-01 3.6170086e-01 2.2010489e-08 1.2364085e-06 4.7470396e-04]
------
16
i need a su ##shi restaurant that serves octopus .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O B-restauranttype I-restauranttype I-restauranttype O O B-food O
Real slot label: O O O B-restauranttype I-restauranttype I-restauranttype O O B-food O
Score: 
Word 3 score: [2.6499122e-10 9.9999285e-01 6.5114150e-11 9.1849977e-08 6.9865719e-06]
Word 4 score: [2.1082263e-03 3.8610879e-04 3.0154253e-05 1.6657423e-02 9.8081803e-01]
Word 5 score: [6.0855443e-10 9.2422253e-01 3.5895649e-02 3.9881833e-02 2.6085227e-22]
Word 8 score: [1.46102358e-18 1.17853084e-07 3.04544449e-16 3.18959893e-18
 9.99999881e-01]
------
17
in what city are you looking to eat this octopus ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
18
seattle
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city
Real slot label: B-city
Score: 
Word 0 score: [7.9427874e-01 4.5521632e-05 1.5781310e-01 4.7664065e-02 1.9858642e-04]
------
19
sure , i found a few options for you ! 1 ) ja ##pone ##ssa su ##shi co ##cina , 2 ) su ##shi ka ##pp ##o tam ##ura , or 3 ) ni ##jo su ##hi bar & grill restaurant . would you like to book one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [4.1738161e-07 8.3241469e-01 1.2082255e-08 1.6591802e-01 1.6668499e-03]
Word 16 score: [3.1061242e-07 9.0415764e-01 1.2306030e-08 9.4434068e-02 1.4080366e-03]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [5.20433939e-11 9.99998450e-01 1.07401144e-10 7.60415091e-08
 1.41170779e-06]
Word 23 score: [3.6254085e-05 7.2752931e-03 6.5697741e-06 9.5456713e-01 3.8114797e-02]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
Word 26 score: [0.2 0.2 0.2 0.2 0.2]
Word 27 score: [0.2 0.2 0.2 0.2 0.2]
Word 28 score: [0.2 0.2 0.2 0.2 0.2]
Word 33 score: [1.000000e+00 6.752646e-16 6.752646e-16 6.752646e-16 6.752646e-16]
Word 34 score: [1.000000e+00 4.538652e-12 4.538652e-12 4.538652e-12 4.538652e-12]
Word 35 score: [0.2 0.2 0.2 0.2 0.2]
Word 36 score: [0.2 0.2 0.2 0.2 0.2]
Word 37 score: [1.1434050e-02 1.7944669e-07 3.6101760e-06 6.2568998e-03 9.8230517e-01]
Word 38 score: [0.2 0.2 0.2 0.2 0.2]
Word 39 score: [4.637194e-19 5.424426e-20 3.045825e-04 1.355534e-16 9.996954e-01]
Word 40 score: [4.7805197e-15 8.1301355e-01 1.3340288e-03 1.8565245e-01 1.4833876e-18]
------
20
1
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-choice
Real slot label: B-choice
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
21
when should i make the reservation for ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
22
i ' d like to reserve for a party of 6 at br ##ez ##za cu ##cina in atlanta on march 18th
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O B-occasion O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-city O B-date I-date
Real slot label: O O O O O O O O B-occasion O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-city O B-date I-date
Score: 
Word 8 score: [9.9984300e-01 2.6694470e-05 1.2665238e-04 1.4074381e-12 3.5961352e-06]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [4.0000275e-02 9.5997095e-01 9.8468481e-06 1.5351552e-05 3.5866403e-06]
Word 20 score: [5.4549864e-06 7.7095431e-01 6.6670246e-02 5.2682493e-02 1.0968756e-01]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
------
23
and for what time were you looking to make that reservation ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O
Score: 
------
24
12 : 00 pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-starttime I-starttime I-starttime I-starttime
Real slot label: B-starttime I-starttime I-starttime I-starttime
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [1.3944426e-06 4.5416057e-01 5.4557723e-01 2.5273440e-04 8.1028093e-06]
------
25
thank you so much for booking with us ! your reservation has been confirmed as requested . please enjoy your meal !
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks', 'closing']
Predicted slot label: O O O O O O O O O O O O O O O O O B-closing I-closing I-closing I-closing O
Real slot label: O O O O O O O O O O O O O O O O O B-closing I-closing I-closing I-closing O
Score: 
Word 17 score: [4.9782717e-01 9.5746025e-02 4.0607527e-01 3.4912076e-04 2.4438448e-06]
Word 18 score: [2.4858067e-02 5.5289060e-02 9.1626596e-01 3.5819232e-03 5.0297203e-06]
Word 19 score: [1.3355586e-05 9.9624372e-01 3.7429784e-03 1.0010627e-15 1.0010627e-15]
Word 20 score: [0.00147862 0.00056341 0.01778721 0.4652154  0.51495534]
------
26
please book a table for 4 in seattle for tomorrow at 9 : 00 pm at il terra ##zzo carmine under the name mary berry
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-personfullname I-personfullname
Real slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-personfullname I-personfullname
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [9.0837605e-02 6.7076669e-04 5.0357717e-01 4.0477768e-01 1.3674946e-04]
Word 9 score: [5.98382771e-01 1.01100236e-01 2.16467519e-08 5.69379324e-07
 3.00516397e-01]
Word 16 score: [1.0000000e+00 1.7419458e-14 1.2545251e-11 3.8661647e-14 6.7329535e-13]
Word 17 score: [9.9677342e-01 7.0508173e-07 1.6688807e-07 3.2257303e-03 1.5814389e-15]
Word 18 score: [1.5536910e-01 3.9689592e-04 6.5759121e-04 8.4357637e-01 2.1282020e-08]
Word 19 score: [2.6345615e-05 8.9784662e-05 1.1924521e-04 9.8549746e-05 9.9966609e-01]
Word 23 score: [1.4967871e-09 7.5865313e-07 7.5480057e-04 1.0463763e-08 9.9924445e-01]
Word 24 score: [5.5038971e-08 2.3951661e-03 9.9747121e-01 2.7266480e-05 1.0640264e-04]
------
27
i have reserved that table for you , mary ! they will see you at il terra ##zzo carmine tomorrow at 9 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname B-date O O O O
Real slot label: O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname B-date O O O O
Score: 
Word 15 score: [1.0000000e+00 1.4731009e-14 3.5089265e-11 5.0996205e-14 7.2797812e-13]
Word 16 score: [9.9938369e-01 7.5099115e-07 5.1534647e-07 6.1510399e-04 2.4052186e-16]
Word 17 score: [4.7233871e-01 1.0798611e-03 4.2624050e-03 5.2231896e-01 3.0037186e-09]
Word 18 score: [9.7734483e-06 2.5149520e-05 4.8069974e-06 2.7251579e-05 9.9993300e-01]
Word 19 score: [1.8435843e-07 1.6448998e-06 2.1977793e-14 6.0413957e-12 9.9999809e-01]
------
28
reserve a table for 4 at a elegant restaurant with ocean view in wright ##sville beach , nc on saturday at 6 ##pm
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O B-numberofpeople O B-restauranttype I-restauranttype I-restauranttype O O O O B-address I-address I-address O O O B-date O B-starttime I-starttime
Real slot label: O O O O B-numberofpeople O B-restauranttype I-restauranttype I-restauranttype O O O O B-address I-address I-address O O O B-date O B-starttime I-starttime
Score: 
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.5433232  0.03372031 0.26938033 0.05462552 0.09895065]
Word 7 score: [0.04915341 0.58766377 0.00342131 0.31060815 0.04915341]
Word 8 score: [1.4771646e-06 9.5549458e-01 3.5849962e-02 8.6539267e-03 1.4216121e-19]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [1.41508935e-04 2.10929727e-08 1.05115796e-04 1.33678690e-02
 9.86385524e-01]
Word 19 score: [2.0057237e-02 9.6209196e-04 2.3098929e-04 2.6311404e-01 7.1563566e-01]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
------
29
per ##si ##mmon ##s waterfront restaurant is available for booking . would you like to book that or should i search for some alternatives ?
Predicted label: ['inform']
Real label: ['inform', 'confirm_question']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O O O
Score: 
Word 0 score: [0.33764789 0.16558805 0.16558805 0.16558805 0.16558805]
Word 1 score: [1.0000000e+00 2.8725655e-09 2.8725655e-09 2.8725655e-09 2.8725655e-09]
Word 2 score: [9.997172e-01 7.070428e-05 7.070428e-05 7.070428e-05 7.070428e-05]
Word 3 score: [9.996239e-01 9.403160e-05 9.403160e-05 9.403160e-05 9.403160e-05]
Word 4 score: [0.03775888 0.8419353  0.01300809 0.06986772 0.03743004]
------
30
book that
Predicted label: ['request']
Real label: ['confirm_answer']
Predicted slot label: O O
Real slot label: O O
Score: 
------
31
6 : 00pm is unavailable , un ##fort ##unt ##ael ##y . but 5 : 45 ##pm and 6 : 15 ##pm are open . would one of those work for you ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O B-starttime I-starttime I-starttime I-starttime O B-starttime I-starttime I-starttime I-starttime O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O B-starttime I-starttime I-starttime I-starttime O B-starttime I-starttime I-starttime I-starttime O O O O O O O O O O O
Score: 
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
------
32
0 . 260 ##41 ##66 ##6 ##7
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
33
i have successfully completed your reservation for per ##si ##mmon ##s waterfront restaurant at 6 : 15 ##pm on saturday ! enjoy !
Predicted label: ['inform']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-starttime I-starttime I-starttime I-starttime O B-date O B-closing O
Real slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-starttime I-starttime I-starttime I-starttime O B-date O B-closing O
Score: 
Word 7 score: [1.0000000e+00 1.2053179e-10 1.2053179e-10 1.2053179e-10 1.2053179e-10]
Word 8 score: [1.0000000e+00 1.6829055e-10 1.6829055e-10 1.6829055e-10 1.6829055e-10]
Word 9 score: [9.9997485e-01 6.2679337e-06 6.2679337e-06 6.2679337e-06 6.2679337e-06]
Word 10 score: [9.9997425e-01 6.4084848e-06 6.4084848e-06 6.4084848e-06 6.4084848e-06]
Word 11 score: [0.09486798 0.78283036 0.00754374 0.10229013 0.0124678 ]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.28192016 0.02261268 0.00088761 0.2313825  0.46319705]
Word 21 score: [1.3692184e-01 8.9175915e-03 8.4941536e-01 3.8950235e-05 4.7061471e-03]
------
34
is there a place to eat in the space needle in seattle ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O B-restauranttype I-restauranttype O B-city O
Real slot label: O O O O O O O O B-restauranttype I-restauranttype O B-city O
Score: 
Word 8 score: [4.7138360e-04 2.0595425e-04 1.7142061e-06 9.9919289e-01 1.2803683e-04]
Word 9 score: [9.9999869e-01 1.5008984e-11 1.3037353e-06 4.5915662e-09 3.2195180e-12]
Word 11 score: [9.0367328e-03 2.6924079e-04 1.7717682e-02 9.7252345e-01 4.5290263e-04]
------
35
yes , sky ##city restaurant is what you ' re looking for . when would you like to go ?
Predicted label: ['inform', 'confirm_question']
Real label: ['request', 'inform']
Predicted slot label: O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O
Real slot label: O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O
Score: 
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [4.0642057e-14 9.2346334e-01 2.2422806e-03 7.4294381e-02 2.4199665e-17]
------
36
give me the first available table for 2 please
Predicted label: ['confirm_answer']
Real label: ['inform']
Predicted slot label: O O O O O O O B-numberofpeople O
Real slot label: O O O O O O O B-numberofpeople O
Score: 
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
------
37
i ' m happy to assist you ! what time and date would you like your reservation for ?
Predicted label: ['confirm_answer']
Real label: ['request', 'greeting']
Predicted slot label: B-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting O O O O O O O O O O O O
Real slot label: B-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting O O O O O O O O O O O O
Score: 
Word 0 score: [9.0386468e-01 2.6805751e-07 4.1566747e-03 2.8529605e-02 6.3448839e-02]
Word 1 score: [4.0916772e-09 9.3622661e-01 3.6926701e-04 6.3404076e-02 2.8290600e-08]
Word 2 score: [7.7107325e-09 9.4905907e-01 2.7630809e-03 4.8177663e-02 1.1048850e-07]
Word 3 score: [6.197791e-03 9.258019e-02 6.011228e-04 1.273540e-01 7.732669e-01]
Word 4 score: [1.5031388e-04 1.2431758e-04 9.7949731e-01 5.4178383e-08 2.0228062e-02]
Word 5 score: [0.3592541  0.09196401 0.50904816 0.00612444 0.03360926]
Word 6 score: [0.03931973 0.0032932  0.00653877 0.02351972 0.9273286 ]
------
38
march 21st at 8 ##pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date I-date O B-starttime I-starttime
Real slot label: B-date I-date O B-starttime I-starttime
Score: 
Word 0 score: [2.1260481e-05 1.8904975e-02 5.0688805e-03 5.1877964e-01 4.5722520e-01]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
------
39
unfortunately sky ##city restaurant is not available for booking through this service . if you have a specific cuisine in mind , i ' m happy to offer alternate suggestions .
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [2.6951614e-14 8.6643589e-01 2.7508882e-03 1.3081326e-01 7.2161202e-18]
------
40
seafood
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-cuisine
Real slot label: B-cuisine
Score: 
Word 0 score: [3.6230657e-04 9.9922073e-01 3.8204590e-04 2.1948352e-05 1.2995314e-05]
------
41
i have found 3 other restaurants to suggest . 1 . mccormick & sc ##hmi ##ck ' s harbor ##side 2 . an ##cho ##vies & olive ##s 3 . anthony ' s pier 66 . would you like to try any of these choices ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O
Score: 
Word 11 score: [9.6381985e-02 1.1047372e-03 7.2446817e-01 1.7765135e-01 3.9375594e-04]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [9.9720132e-01 3.6671111e-06 1.7491455e-07 1.8681454e-05 2.7762223e-03]
Word 17 score: [9.9671137e-01 6.0702614e-06 1.6296113e-07 1.7793556e-05 3.2645906e-03]
Word 18 score: [9.5074022e-01 1.9079176e-05 3.0904528e-02 4.1228143e-04 1.7923871e-02]
Word 19 score: [9.3152046e-01 1.6785934e-05 4.6003066e-02 5.5270840e-04 2.1907032e-02]
Word 22 score: [9.9999964e-01 8.3027757e-08 8.3027757e-08 8.3027757e-08 8.3027757e-08]
Word 23 score: [9.9999964e-01 6.2923093e-08 6.2923093e-08 6.2923093e-08 6.2923093e-08]
Word 24 score: [9.9999774e-01 5.4457502e-07 5.4457502e-07 5.4457502e-07 5.4457502e-07]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
Word 26 score: [1.4826959e-03 1.8517321e-03 8.1215865e-07 4.3947348e-01 5.5719131e-01]
Word 27 score: [5.6556740e-04 6.9219148e-04 3.2463200e-07 4.0089768e-01 5.9784418e-01]
------
42
mccormick & sc ##hmi ##ck ' s harbor ##side
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [4.8893541e-01 5.8811252e-06 2.3625885e-01 1.8120598e-02 2.5667930e-01]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [9.9954247e-01 7.1945763e-08 2.2125336e-07 1.6324105e-06 4.5570257e-04]
Word 6 score: [9.9921465e-01 1.6475431e-07 1.7390308e-07 2.0208477e-06 7.8310753e-04]
Word 7 score: [6.7478657e-01 1.0252235e-05 2.6242194e-01 4.4224487e-04 6.2338997e-02]
Word 8 score: [6.5062672e-01 3.9848146e-06 3.0783060e-01 5.1517342e-04 4.1023538e-02]
------
43
i have secured that table for you ! what name shall i put on the reservation ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O
Score: 
------
44
jenny , i ' m looking for a reservation in milwaukee for 2 people for tomorrow night at 7 ##pm for mexican food . thanks
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O B-restaurantname O B-numberofpeople O O B-date I-date O B-starttime I-starttime O B-restauranttype O O O
Real slot label: O O O O O O O O O O B-restaurantname O B-numberofpeople O O B-date I-date O B-starttime I-starttime O B-restauranttype O O O
Score: 
Word 10 score: [4.5772051e-03 8.9525670e-01 7.7773936e-02 2.7754364e-05 2.2364400e-02]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [3.4442514e-01 6.5513301e-01 7.2009656e-09 5.5927251e-07 4.4129186e-04]
Word 16 score: [5.44067708e-11 5.00000000e-01 1.06548225e-11 5.00000000e-01
 8.18865646e-14]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [3.4649885e-05 2.6904318e-01 8.0774436e-03 3.7176334e-04 7.2247303e-01]
------
45
here are the restaurants i found matching your request . please select one : 1 ) ri ##vier ##a maya - rating : 4 out of 5 . 2 ) antigua latin restaurant - rating : 4 out of 5 .
Predicted label: ['inform', 'multiple_choice']
Real label: ['multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
46
ri ##vier ##a maya please
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 0 score: [0.05343792 0.00810203 0.02162457 0.7621217  0.1547138 ]
Word 1 score: [2.6080688e-05 3.5709438e-06 6.9771449e-05 8.3416522e-01 1.6573535e-01]
Word 2 score: [2.4853436e-05 1.1374951e-02 1.5526223e-03 2.8528270e-01 7.0176494e-01]
Word 3 score: [4.9390423e-04 2.5338796e-01 3.2911172e-05 1.1079932e-07 7.4608511e-01]
------
47
your reservation at ri ##vier ##a maya for 02 / 16 / 2016 07 : 00pm for 2 people under john smith has been confirmed .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O B-date I-date I-date I-date I-date O O O O B-numberofpeople O O B-personfullname I-personfullname O O O O
Real slot label: O O O O O O O O B-date I-date I-date I-date I-date O O O O B-numberofpeople O O B-personfullname I-personfullname O O O O
Score: 
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [5.1716669e-03 7.1667909e-04 1.7995927e-09 9.9291891e-01 1.1926582e-03]
Word 21 score: [1.7298976e-03 1.0359512e-05 2.4596180e-03 2.2242557e-06 9.9579787e-01]
------
48
book me a table for 1 at bar ##olo in seattle for tomorrow at 7 : 00 pm .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-restaurantname I-restaurantname O B-city O B-date O O O O O O
Real slot label: O O O O O B-numberofpeople O B-restaurantname I-restaurantname O B-city O B-date O O O O O O
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [7.2864187e-03 4.8100013e-09 5.0797425e-02 9.0243304e-01 3.9483055e-02]
Word 8 score: [3.3776620e-01 3.0953700e-08 9.4385026e-03 6.5117562e-01 1.6196695e-03]
Word 10 score: [5.4712787e-02 1.5978169e-04 1.1671960e-01 8.2723397e-01 1.1739107e-03]
Word 12 score: [7.6300389e-01 7.1944222e-02 4.5959203e-07 4.3901591e-06 1.6504703e-01]
------
49
i have successfully booked your table for tomorrow at 7 ##pm at bar ##olo . enjoy !
Predicted label: ['inform']
Real label: ['inform', 'closing']
Predicted slot label: O O O O O O O B-date O B-starttime I-starttime O B-restaurantname I-restaurantname O B-closing I-closing
Real slot label: O O O O O O O B-date O B-starttime I-starttime O B-restaurantname I-restaurantname O B-closing I-closing
Score: 
Word 7 score: [8.2362020e-01 1.4768979e-01 3.7322341e-08 4.4270901e-06 2.8685575e-02]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [1.28750794e-03 1.35885445e-08 1.02424286e-01 8.51234019e-01
 4.50542420e-02]
Word 13 score: [1.5529574e-01 7.3090143e-07 1.3280761e-02 8.2706046e-01 4.3622819e-03]
Word 15 score: [1.3112485e-01 1.3959866e-02 8.2821953e-01 4.1527936e-05 2.6654217e-02]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
------
50
i want to book a table at long john silver ##s tomorrow evening around 8 pm in washington dc please
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname B-date I-date B-starttime I-starttime I-starttime O B-city I-city O
Real slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname B-date I-date B-starttime I-starttime I-starttime O B-city I-city O
Score: 
Word 7 score: [2.5142633e-08 1.0723508e-07 5.7440400e-05 1.3137670e-06 9.9994111e-01]
Word 8 score: [0.0137261  0.7005654  0.07578223 0.20024845 0.0096778 ]
Word 9 score: [9.9997199e-01 7.0013803e-06 7.0013803e-06 7.0013803e-06 7.0013803e-06]
Word 10 score: [9.9993086e-01 1.7297558e-05 1.7297558e-05 1.7297558e-05 1.7297558e-05]
Word 11 score: [2.9948251e-07 1.7268841e-06 4.4212583e-13 1.0909611e-11 9.9999797e-01]
Word 12 score: [0.0094393  0.00155798 0.14587009 0.70015705 0.1429756 ]
Word 13 score: [0.10783905 0.02243485 0.3529505  0.3529505  0.16382508]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [2.4389359e-03 9.8970407e-01 7.8520169e-03 1.0980278e-07 4.8384300e-06]
Word 17 score: [2.7475786e-12 8.3557442e-03 1.7521407e-03 9.8989213e-01 6.4309758e-09]
Word 18 score: [1.0095396e-07 4.9996608e-01 1.4864187e-07 6.7572284e-05 4.9996608e-01]
------
51
hi . how many guests will you have ?
Predicted label: ['request', 'greeting']
Real label: ['request', 'greeting']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
52
4
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
53
sorry , i can not make reservations at long john silver ##s . would you like to try a different restaurant ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 8 score: [9.3511045e-07 2.3193127e-06 8.1309967e-04 1.7160788e-05 9.9916649e-01]
Word 9 score: [0.00965385 0.3776465  0.47117165 0.13881236 0.00271556]
Word 10 score: [9.9947852e-01 1.3040355e-04 1.3040355e-04 1.3040355e-04 1.3040355e-04]
Word 11 score: [9.978963e-01 5.259018e-04 5.259018e-04 5.259018e-04 5.259018e-04]
------
54
ok fine , how about a highly rated steak ##house
Predicted label: ['inform']
Real label: ['request']
Predicted slot label: O O O O O O O O B-restauranttype I-restauranttype
Real slot label: O O O O O O O O B-restauranttype I-restauranttype
Score: 
Word 8 score: [1.2289348e-12 3.3122941e-27 1.4845480e-24 5.3293509e-22 1.0000000e+00]
Word 9 score: [6.9632527e-08 9.7638952e-20 1.4374243e-17 7.7137051e-16 9.9999988e-01]
------
55
here are 3 of the top rated steak ##houses in the dc area : charlie palmer steak , bobby van ' s grill , claudia ' s steak ##house . would you like to try one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O B-rating I-rating O O O O B-city O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O B-rating I-rating O O O O B-city O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 5 score: [9.6761425e-05 1.6156037e-04 3.9357872e-07 4.9987063e-01 4.9987063e-01]
Word 6 score: [3.7654203e-01 7.6768054e-03 1.9619241e-05 7.8015391e-06 6.1575377e-01]
Word 11 score: [4.0034324e-04 6.1403587e-03 3.3074102e-04 9.8698819e-01 6.1403587e-03]
Word 14 score: [4.2963967e-01 5.6134635e-01 2.4652209e-03 1.5364637e-04 6.3951379e-03]
Word 15 score: [9.9466264e-01 4.7361488e-03 4.2399918e-04 1.7718895e-04 5.3960982e-09]
Word 16 score: [1.04535505e-01 2.24991969e-10 1.50998192e-15 9.07529867e-12
 8.95464480e-01]
Word 18 score: [6.4762407e-10 9.9988019e-01 9.5999741e-05 1.9562858e-11 2.3824819e-05]
Word 19 score: [5.3653290e-05 1.1005809e-01 1.4055347e-04 2.8897724e-01 6.0077041e-01]
Word 20 score: [9.9930096e-01 3.8788338e-07 3.5225806e-08 1.2219367e-06 6.9733744e-04]
Word 21 score: [9.9918360e-01 6.2734864e-07 3.0993149e-08 1.4065490e-06 8.1437081e-04]
Word 22 score: [1.5578627e-16 2.1918981e-17 3.7968831e-04 4.4135302e-14 9.9962032e-01]
Word 24 score: [1.1225344e-04 9.5566648e-01 4.4221308e-02 5.8781480e-10 5.8781480e-10]
Word 25 score: [0.5915256  0.00241893 0.28018433 0.00285087 0.1230202 ]
Word 26 score: [9.9913567e-01 7.0077942e-07 3.5160511e-08 1.8242478e-06 8.6179381e-04]
Word 27 score: [2.5875456e-16 1.2488577e-22 6.0961184e-21 2.7352622e-19 1.0000000e+00]
Word 28 score: [1.8961241e-16 7.2268690e-23 4.1866818e-21 1.2285413e-19 1.0000000e+00]
------
56
charlie palmer steak please
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname O
Real slot label: B-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 0 score: [1.3950253e-06 8.4377974e-03 8.4125958e-02 1.1508671e-03 9.0628397e-01]
Word 1 score: [9.9956483e-01 2.9895268e-04 3.7932321e-05 9.8305485e-05 2.0240941e-10]
Word 2 score: [1.0059560e-01 1.8812080e-10 1.0489982e-15 5.0313347e-12 8.9940441e-01]
------
57
what name would you like to book the reservation under ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
58
master user
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname I-personfullname
Real slot label: B-personfullname I-personfullname
Score: 
Word 0 score: [0.01231867 0.00393587 0.5955277  0.3872841  0.00093368]
Word 1 score: [8.1071844e-03 3.2587516e-01 1.2883724e-11 2.4992039e-06 6.6601509e-01]
------
59
i have successfully completed your reservation . enjoy your meal !
Predicted label: ['inform']
Real label: ['inform', 'closing']
Predicted slot label: O O O O O O O B-closing I-closing I-closing I-closing
Real slot label: O O O O O O O B-closing I-closing I-closing I-closing
Score: 
Word 7 score: [4.7175712e-03 2.4177918e-02 9.7082382e-01 3.4837209e-05 2.4592908e-04]
Word 8 score: [1.17770005e-05 9.97775972e-01 2.21225806e-03 9.77659076e-18
 9.77659076e-18]
Word 9 score: [1.0063634e-04 2.1577718e-05 1.1123253e-03 8.0677015e-01 1.9199531e-01]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
------
60
i would like to book mexican in seattle for two on 03 / 25 at 1 ##pm
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-cuisine O B-city O O O B-date I-date I-date O B-starttime I-starttime
Real slot label: O O O O O B-cuisine O B-city O O O B-date I-date I-date O B-starttime I-starttime
Score: 
Word 5 score: [3.7818707e-05 2.8822809e-01 9.5736701e-03 3.0977968e-05 7.0212942e-01]
Word 7 score: [1.0920089e-01 1.2525920e-04 2.2309510e-01 6.6616094e-01 1.4178717e-03]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
------
61
i found the following restaurants that fit your criteria : po ##qui ##tos , la ##redo ##s grill , little water can ##tina . which one would you like to book ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O
Real slot label: O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O
Score: 
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [1.4354226e-15 2.1847194e-16 1.8775015e-03 1.8967014e-13 9.9812251e-01]
Word 19 score: [1.0625478e-08 1.3782256e-02 9.8621517e-01 1.6723966e-07 2.4031774e-06]
Word 20 score: [5.9305169e-03 2.1910435e-11 9.8432344e-01 5.0562788e-17 9.7460048e-03]
Word 21 score: [2.6906157e-02 9.5521933e-01 1.7853521e-02 2.0935769e-05 1.7842829e-10]
Word 22 score: [2.4970410e-02 9.5779860e-01 1.7209787e-02 2.1265752e-05 1.1824647e-10]
------
62
la ##redo ##s grill
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [1.8057355e-18 2.4910084e-19 8.0788916e-04 2.2406679e-16 9.9919206e-01]
------
63
i have successfully booked your reservation . enjoy your meal !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-closing I-closing I-closing I-closing
Real slot label: O O O O O O O B-closing I-closing I-closing I-closing
Score: 
Word 7 score: [2.3284694e-02 1.8500516e-02 9.5757884e-01 3.4066437e-05 6.0192629e-04]
Word 8 score: [1.2332189e-04 9.9580574e-01 4.0709656e-03 5.1887048e-17 5.1887048e-17]
Word 9 score: [2.0868915e-04 1.3388217e-04 3.1305330e-03 8.3207381e-01 1.6445307e-01]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
------
64
book me a table for 1 in seattle for tomorrow at 7 : 00 pm at ely ##sian bar
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname
Real slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [2.6863664e-02 1.4904911e-04 3.4524299e-02 9.3772566e-01 7.3730963e-04]
Word 9 score: [7.3909020e-01 1.1319106e-01 1.7436106e-06 6.0696216e-06 1.4771093e-01]
Word 16 score: [0.03758391 0.86517566 0.00880613 0.03758391 0.05085036]
Word 17 score: [0.00935838 0.21294816 0.00437877 0.00935838 0.7639564 ]
Word 18 score: [1.5775717e-03 1.6684834e-07 5.2690712e-06 1.9816358e-03 9.9643540e-01]
------
65
i have booked your reservation . thank you .
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O B-closing I-closing I-closing
Real slot label: O O O O O O B-closing I-closing I-closing
Score: 
Word 6 score: [1.0107327e-03 7.6768067e-08 9.9891317e-01 1.6703247e-10 7.5946926e-05]
Word 7 score: [8.5219634e-01 2.9132075e-03 1.6247017e-02 3.3444952e-04 1.2830901e-01]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
------
66
hi , looking for reservations at a vega ##n pizza place for 2 on friday .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O B-numberofpeople O B-date O
Real slot label: O O O O O O O O O O O O B-numberofpeople O B-date O
Score: 
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [2.1107322e-01 1.5988426e-03 2.5534840e-05 7.8641301e-01 8.8931300e-04]
------
67
hello ! i ' ll need your desired time and city to help complete your request .
Predicted label: ['inform']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O
Score: 
------
68
7 ##pm in portland , or
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-starttime I-starttime O B-city O B-state
Real slot label: B-starttime I-starttime O B-city O B-state
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [1.2088596e-04 5.6754343e-06 5.6552067e-02 3.9935023e-02 9.0338624e-01]
Word 5 score: [4.0467864e-01 2.3242331e-01 1.7339528e-02 2.9511086e-06 3.4555554e-01]
------
69
3 doors down , acc ##anto and bug ##att ##i ' s ri ##stor ##ante are italian restaurants with vega ##n options . would you like to book one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [1.9650015e-03 3.3351579e-01 2.0105895e-01 6.8356468e-07 4.6345961e-01]
Word 2 score: [7.6771030e-05 5.3573712e-07 8.8040921e-05 9.9983466e-01 5.2434307e-10]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [1.7677601e-06 1.1405227e-02 1.4553636e-05 9.8857856e-01 4.7730601e-14]
Word 8 score: [6.5838383e-03 8.2422169e-03 1.2521993e-01 8.5995412e-01 1.3178145e-12]
Word 9 score: [1.06244525e-02 1.23604998e-01 2.90050596e-01 5.75719893e-01
 5.98323098e-08]
Word 10 score: [9.9911195e-01 2.1926767e-06 3.6371787e-08 1.9627305e-06 8.8385533e-04]
Word 11 score: [9.9912447e-01 2.9888222e-06 3.4183099e-08 1.9549743e-06 8.7059487e-04]
Word 12 score: [9.9341923e-01 6.5804925e-03 6.2564020e-08 6.2564020e-08 6.2564020e-08]
Word 13 score: [9.9424344e-01 5.7565556e-03 4.2773962e-08 4.2773962e-08 4.2773962e-08]
Word 14 score: [9.9526703e-01 4.7326623e-03 8.7940982e-08 8.7940982e-08 8.7940982e-08]
------
70
please book 3 doors down .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O B-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O B-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [1.8465567e-03 3.1274480e-01 3.3941504e-02 3.0336636e-07 6.5146685e-01]
Word 4 score: [2.9949618e-03 3.7353289e-05 2.0189849e-03 9.9494666e-01 2.0662967e-06]
------
71
your reservation has been confirmed . please enjoy your meal , and thank you for using our service !
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O B-closing I-closing I-closing O O O O O O O O O
Real slot label: O O O O O O O B-closing I-closing I-closing O O O O O O O O O
Score: 
Word 7 score: [6.1476836e-03 4.8153531e-02 9.4226879e-01 3.4298820e-03 1.1685175e-07]
Word 8 score: [1.1514394e-05 9.9825186e-01 1.7366398e-03 3.4313696e-18 3.4313696e-18]
Word 9 score: [2.1754840e-07 6.3980153e-08 2.0653176e-06 6.3811350e-01 3.6188412e-01]
------
72
i ' d like to reserve a table for 1 at bar ##olo ri ##stor ##ante in seattle for march 15th , i prefer 6 : 00 pm if available .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-city O B-date I-date O O O O O O O O O O
Real slot label: O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-city O B-date I-date O O O O O O O O O O
Score: 
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [4.0397071e-03 6.4486816e-09 1.7660875e-02 9.3364352e-01 4.4655923e-02]
Word 12 score: [3.8927662e-01 5.3505186e-08 7.4740425e-03 6.0141194e-01 1.8372574e-03]
Word 13 score: [9.8911834e-01 1.0881579e-02 4.5161627e-08 4.5161627e-08 4.5161627e-08]
Word 14 score: [9.8962337e-01 1.0376615e-02 1.1581878e-08 1.1581878e-08 1.1581878e-08]
Word 15 score: [9.9086529e-01 9.1346437e-03 4.2636678e-08 4.2636678e-08 4.2636678e-08]
Word 17 score: [8.0363519e-02 4.4532350e-04 4.2650327e-01 4.9140909e-01 1.2787558e-03]
Word 19 score: [8.7053841e-06 7.7889776e-01 7.2659813e-02 5.7460118e-02 9.0973608e-02]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
------
73
i have successfully booked your reservation . enjoy !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-closing O
Real slot label: O O O O O O O B-closing O
Score: 
Word 7 score: [1.3810225e-01 4.6913922e-03 8.5208237e-01 1.9893476e-05 5.1040491e-03]
------
74
i am looking for chinese food saturday night .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O B-cuisine I-cuisine B-date I-date O
Real slot label: O O O O B-cuisine I-cuisine B-date I-date O
Score: 
Word 4 score: [9.9266630e-01 3.7023369e-06 3.4722674e-04 6.9721071e-03 1.0598561e-05]
Word 5 score: [7.1868277e-04 6.9118897e-07 9.9201363e-01 7.1426909e-03 1.2432982e-04]
Word 6 score: [6.5261861e-03 2.6794948e-04 5.3664797e-04 2.8042676e-02 9.6462649e-01]
Word 7 score: [2.5501034e-13 5.0000000e-01 5.4880834e-13 5.0000000e-01 5.8033991e-16]
------
75
could you please provide a location ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
76
baltimore . for 2 people at 8 pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city O O B-numberofpeople O O O O O
Real slot label: B-city O O B-numberofpeople O O O O O
Score: 
Word 0 score: [1.3493178e-03 1.1536420e-01 3.1679214e-03 5.9499190e-04 8.7952358e-01]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
------
77
unfortunately , no chinese restaurants in baltimore are available for online booking . would you like to change your search terms ?
Predicted label: ['inform', 'confirm_question']
Real label: ['request', 'inform']
Predicted slot label: O O O B-cuisine I-cuisine O B-city O O O O O O O O O O O O O O O
Real slot label: O O O B-cuisine I-cuisine O B-city O O O O O O O O O O O O O O O
Score: 
Word 3 score: [9.9779224e-01 5.5251283e-05 2.0363317e-03 1.1308083e-04 3.0611154e-06]
Word 4 score: [9.8106843e-01 3.2604432e-06 1.1374211e-04 1.8814547e-02 1.3211734e-09]
Word 6 score: [9.2588231e-04 4.5748842e-03 7.2665577e-04 5.2713170e-03 9.8850119e-01]
------
78
yes . italian .
Predicted label: ['inform', 'confirm_answer']
Real label: ['inform']
Predicted slot label: O O B-cuisine O
Real slot label: O O B-cuisine O
Score: 
Word 2 score: [9.9501413e-01 5.2309911e-08 2.7294875e-06 8.3606701e-06 4.9747122e-03]
------
79
here are three restaurants i found : aldo ' s , donna ' s , ami ##cci ' s .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 7 score: [2.5482751e-16 4.0310510e-16 2.0962682e-10 1.2933177e-13 1.0000000e+00]
Word 8 score: [0.8371277  0.00143254 0.04562716 0.00084667 0.11496601]
Word 9 score: [9.9954021e-01 1.2752030e-06 1.0331370e-08 1.0616542e-06 4.5747118e-04]
Word 11 score: [0.11049882 0.03410503 0.00309565 0.79423004 0.05807041]
Word 12 score: [8.8618165e-01 8.2943356e-04 2.6100211e-02 6.2265719e-04 8.6265966e-02]
Word 13 score: [9.9967444e-01 7.4355046e-07 8.0016731e-09 7.7004120e-07 3.2400567e-04]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [9.9956661e-01 1.2847582e-06 1.1714701e-08 1.2132820e-06 4.3085244e-04]
Word 18 score: [9.9941468e-01 1.4703307e-06 9.6501251e-09 1.0957689e-06 5.8265345e-04]
------
80
donna ' s
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [9.4473159e-01 5.2163474e-02 3.1398460e-05 3.0274251e-03 4.6066954e-05]
Word 1 score: [7.6578391e-01 1.3140688e-04 1.3483106e-01 5.5946410e-04 9.8694190e-02]
Word 2 score: [9.9946553e-01 2.5282614e-07 2.5217824e-08 1.1100389e-06 5.3317560e-04]
------
81
great , i have made a reservation for you under the name jane doe at donna ' s - cross keys for 3 / 12 at 8 : 00pm for 2 people .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O B-personfullname I-personfullname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime I-starttime O B-numberofpeople O O
Real slot label: O O O O O O O O O O O O B-personfullname I-personfullname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime I-starttime O B-numberofpeople O O
Score: 
Word 12 score: [2.45921034e-03 1.11454355e-07 3.11138894e-04 9.97037053e-01
 1.92533160e-04]
Word 13 score: [1.3410875e-02 4.7671729e-09 4.9934920e-07 2.8528910e-10 9.8658866e-01]
Word 15 score: [0.44874945 0.19588451 0.02828666 0.26198396 0.06509541]
Word 16 score: [8.1846404e-01 4.6346740e-05 3.2341223e-02 4.0570745e-04 1.4874268e-01]
Word 17 score: [9.9968123e-01 3.1664413e-08 2.8574552e-09 2.4818354e-07 3.1860216e-04]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [5.2639611e-02 2.2237966e-10 9.1098285e-01 3.0379834e-07 3.6377229e-02]
Word 20 score: [3.6344274e-09 6.9275724e-05 9.9993074e-01 1.8213916e-12 2.5383810e-13]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 26 score: [0.2 0.2 0.2 0.2 0.2]
Word 27 score: [0.2 0.2 0.2 0.2 0.2]
Word 28 score: [0.2 0.2 0.2 0.2 0.2]
Word 30 score: [0.2 0.2 0.2 0.2 0.2]
------
82
hi i was looking to make some restaurant reservations
Predicted label: ['request', 'greeting']
Real label: ['request', 'greeting']
Predicted slot label: B-greeting O O O O O O O O
Real slot label: B-greeting O O O O O O O O
Score: 
Word 0 score: [5.0038652e-06 2.2343977e-01 5.3710323e-03 2.2343977e-01 5.4774445e-01]
------
83
great . in what city would you like to make reservations ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O
Score: 
------
84
i will be on vacation in new york city and looking for a restaurant
Predicted label: ['request']
Real label: ['inform']
Predicted slot label: O O O O O O B-city I-city I-city O O O O O
Real slot label: O O O O O O B-city I-city I-city O O O O O
Score: 
Word 6 score: [4.9110712e-04 1.7727165e-02 1.8622888e-10 5.7151298e-11 9.8178172e-01]
Word 7 score: [5.8766896e-01 3.2949165e-04 2.2850726e-02 3.8909134e-01 5.9434671e-05]
Word 8 score: [0.06181911 0.07338625 0.10818472 0.08726709 0.6693429 ]
------
85
sure ! what date ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
86
i am looking for something this saturday
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O B-date I-date
Real slot label: O O O O O B-date I-date
Score: 
Word 5 score: [1.0922954e-01 8.9017051e-01 6.0000923e-04 7.7154455e-12 2.8667724e-11]
Word 6 score: [1.5735411e-06 9.1752064e-09 9.7054310e-02 5.4955170e-03 8.9744860e-01]
------
87
how many would be attending ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O
Real slot label: O O O O O O
Score: 
------
88
there will be just 2 of us my wife and me
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O B-numberofpeople O O O O O O
Real slot label: O O O O B-numberofpeople O O O O O O
Score: 
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
------
89
what time would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
90
would like something around 7 : 30 ##pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O B-starttime I-starttime I-starttime I-starttime I-starttime
Real slot label: O O O B-starttime I-starttime I-starttime I-starttime I-starttime
Score: 
Word 3 score: [9.9486876e-01 5.0798338e-03 2.2924898e-05 2.2924898e-05 5.5332739e-06]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
------
91
here are 3 of the top rated restaurants in new york city : ate ##ra , bo ##ule ##y , and daniel . would you like to try one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O B-rating I-rating O O B-city I-city I-city O B-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname O O O O O O O O O O
Real slot label: O O O O O B-rating I-rating O O B-city I-city I-city O B-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname O O O O O O O O O O
Score: 
Word 5 score: [2.2628647e-04 2.7877706e-04 3.0912398e-07 4.9974734e-01 4.9974734e-01]
Word 6 score: [5.1710695e-01 3.0076262e-03 4.6031093e-07 3.3527719e-08 4.7988498e-01]
Word 9 score: [1.10107096e-04 3.01824673e-03 6.58101407e-10 7.09414055e-11
 9.96871650e-01]
Word 10 score: [6.47918582e-01 1.89530823e-04 3.29836570e-02 3.18893403e-01
 1.47945475e-05]
Word 11 score: [0.16606574 0.35653803 0.03623391 0.02672292 0.41443947]
Word 13 score: [1.0000000e+00 6.3344030e-10 5.8075584e-09 1.8673698e-11 8.8154525e-11]
Word 14 score: [9.5384628e-01 8.0398075e-07 6.8927743e-03 3.9224904e-02 3.5097200e-05]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [1.0717025e-06 9.8401731e-01 1.1201902e-07 8.5193086e-08 1.5981426e-02]
------
92
what is the dress code for those restaurants ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
93
ate ##ra is dress ##y , bo ##ule ##y is formal ( with jacket ) , daniel is formal ( with jacket ) .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
94
can you please book me for daniel
Predicted label: ['request']
Real label: ['inform']
Predicted slot label: O O O O O O B-restaurantname
Real slot label: O O O O O O B-restaurantname
Score: 
Word 6 score: [3.0739059e-06 9.9339253e-01 1.1591719e-07 7.3412671e-08 6.6041625e-03]
------
95
what name would you like to reserve under ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
96
please put the reservation under the name matt
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-personfullname
Real slot label: O O O O O O O B-personfullname
Score: 
Word 7 score: [4.7614816e-07 9.9999654e-01 6.6357893e-07 1.8476836e-06 5.3742048e-07]
------
97
unfortunately the only reservation currently open at daniel for your date is 10 ##pm . would you like to book or change the date ?
Predicted label: ['request', 'inform']
Real label: ['inform', 'confirm_question']
Predicted slot label: O O O O O O O B-restaurantname O O O O B-starttime I-starttime O O O O O O O O O O O
Real slot label: O O O O O O O B-restaurantname O O O O B-starttime I-starttime O O O O O O O O O O O
Score: 
Word 7 score: [4.6379483e-07 9.9059230e-01 7.4585827e-08 5.9827343e-08 9.4070360e-03]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
------
98
yes please book the reservation for 10 pm
Predicted label: ['confirm_answer']
Real label: ['confirm_answer']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
99
your booking at daniel for 03 / 12 / 2016 was confirmed for 10 ##pm for two guests under matt . enjoy your meal !
Predicted label: ['inform']
Real label: ['inform', 'closing']
Predicted slot label: O O O B-restaurantname O B-date I-date I-date I-date I-date O O O B-starttime I-starttime O O O O B-personfullname O B-closing I-closing I-closing I-closing
Real slot label: O O O B-restaurantname O B-date I-date I-date I-date I-date O O O B-starttime I-starttime O O O O B-personfullname O B-closing I-closing I-closing I-closing
Score: 
Word 3 score: [2.8406382e-06 9.5319414e-01 3.0809879e-08 2.4070403e-07 4.6802692e-02]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [1.8138343e-06 9.9999475e-01 5.8378527e-07 2.3941382e-06 4.3891444e-07]
Word 21 score: [1.9577770e-02 1.0539922e-02 9.6934277e-01 3.0148147e-05 5.0949823e-04]
Word 22 score: [3.6478543e-06 9.9450523e-01 5.4910635e-03 3.0654351e-20 3.0654351e-20]
Word 23 score: [1.1807793e-05 1.7177966e-06 7.1206305e-05 7.7465957e-01 2.2525568e-01]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
------
100
book a table for 4 at ho ##ote ##rs in wilmington
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O B-city
Real slot label: O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O B-city
Score: 
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [8.5208410e-01 1.2157348e-01 2.6342353e-02 5.3860525e-09 5.3860525e-09]
Word 7 score: [1.4278929e-01 2.7400875e-04 8.5693675e-01 2.2319536e-10 2.2319536e-10]
Word 8 score: [4.5003250e-02 1.9856750e-06 9.5499444e-01 1.2409225e-07 1.2409225e-07]
Word 10 score: [6.7841393e-05 8.8797077e-07 2.4370892e-02 9.5855609e-02 8.7970477e-01]
------
101
what date , please ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
102
3 \ / 15 \ / 2016
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date I-date I-date I-date I-date I-date I-date
Real slot label: B-date I-date I-date I-date I-date I-date I-date
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
------
103
what time would you like me to search for ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
104
8 ##pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-starttime I-starttime
Real slot label: B-starttime I-starttime
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
------
105
unfortunately i can not book the ho ##ote ##rs location in wilmington , nc through this service . would you like a different restaurant ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O B-restaurantname I-restaurantname I-restaurantname O O B-city O B-state O O O O O O O O O O O
Real slot label: O O O O O O B-restaurantname I-restaurantname I-restaurantname O O B-city O B-state O O O O O O O O O O O
Score: 
Word 6 score: [8.8544381e-01 5.2649837e-02 6.1906416e-02 1.6932347e-09 1.6932347e-09]
Word 7 score: [4.5762870e-02 2.3630101e-04 9.5400077e-01 1.6264706e-10 1.6264706e-10]
Word 8 score: [1.9557791e-02 3.4695222e-05 9.8040754e-01 2.5402269e-10 2.5402269e-10]
Word 11 score: [1.7074685e-04 1.0203745e-06 6.5076590e-02 2.1675415e-02 9.1307616e-01]
Word 13 score: [1.0000000e+00 5.6215793e-10 5.6215793e-10 5.6215793e-10 5.6215793e-10]
------
106
recommend something
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O
Real slot label: O O
Score: 
------
107
do you have a cuisine in mind ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
108
american
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O
Real slot label: O
Score: 
------
109
i found the following restaurants available : au ##bria ##na ' s fine dining , port land grille
Predicted label: ['inform']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname
Real slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname
Score: 
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [9.9968421e-01 1.0186652e-06 2.8157944e-08 1.2320352e-06 3.1356551e-04]
Word 11 score: [9.9958426e-01 2.1132696e-06 2.0503990e-08 1.3554599e-06 4.1225241e-04]
Word 12 score: [4.4809479e-11 7.7555909e-05 6.4094201e-09 8.2351357e-01 1.7640892e-01]
Word 13 score: [1.5854774e-04 1.2313432e-04 3.2219561e-03 9.9649638e-01 1.0496243e-09]
Word 15 score: [6.6899911e-02 1.3426098e-02 4.0042770e-04 6.0945082e-11 9.1927350e-01]
Word 16 score: [1.4517255e-08 3.2598625e-14 1.1601513e-18 1.4030808e-12 1.0000000e+00]
Word 17 score: [1.4773129e-14 8.6145954e-14 9.9999988e-01 2.6632281e-09 1.5430955e-07]
------
110
au ##bria ##na ' s fine dining
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [9.9983668e-01 1.5239995e-07 3.7346783e-08 5.3284089e-07 1.6262197e-04]
Word 4 score: [9.9973541e-01 4.9576602e-07 3.1745770e-08 7.7970839e-07 2.6329973e-04]
Word 5 score: [2.9157097e-11 5.4424294e-05 1.4406134e-08 7.0513755e-01 2.9480803e-01]
Word 6 score: [1.6587367e-04 8.9754772e-05 2.0413215e-03 9.9770302e-01 3.5093387e-10]
------
111
i ' ve secured that table for you . may i have your name ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O
Score: 
------
112
dad dil ##linger
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname I-personfullname I-personfullname
Real slot label: B-personfullname I-personfullname I-personfullname
Score: 
Word 0 score: [2.1315611e-05 6.6044904e-02 1.1271286e-01 7.5517595e-01 6.6044904e-02]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
------
113
your reservation at au ##bria ##na ' s fine dining was confirmed for 03 / 15 / 2016 for 4 at 8 ##pm . enjoy your meal !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-date I-date I-date I-date I-date O B-numberofpeople O B-starttime I-starttime O O O O O
Real slot label: O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-date I-date I-date I-date I-date O B-numberofpeople O B-starttime I-starttime O O O O O
Score: 
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [9.9974471e-01 3.9130121e-08 8.6037018e-09 1.9257030e-07 2.5500418e-04]
Word 7 score: [9.9969757e-01 5.9324766e-08 8.5453209e-09 1.9104485e-07 3.0217486e-04]
Word 8 score: [1.1758036e-10 3.4702889e-04 3.8431942e-08 3.8824847e-01 6.1140442e-01]
Word 9 score: [2.0296287e-04 1.9857489e-05 1.8904704e-03 9.9788672e-01 3.3253936e-10]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
------
114
book me a table for 2 in seattle for tomorrow at 7 : 00 pm at bar ##olo
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname
Real slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [2.0987578e-02 1.5469734e-04 3.6364127e-02 9.4201314e-01 4.8040255e-04]
Word 9 score: [6.4205879e-01 1.2272900e-01 1.3742339e-06 4.9933365e-06 2.3520578e-01]
Word 16 score: [1.5885411e-02 1.5347245e-08 7.4248672e-02 8.7156922e-01 3.8296711e-02]
Word 17 score: [5.4248208e-01 5.0303441e-08 1.0705312e-02 4.4537479e-01 1.4377127e-03]
------
115
i apologize for the inc ##on ##ven ##ience , 7 pm is n ' t available , but 8 : 30 pm is . would that be acceptable ?
Predicted label: ['inform', 'confirm_question']
Real label: ['inform', 'confirm_question']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
116
yes please book 8 : 30 pm for 2 in seattle for tomorrow at 7 : 00 pm at bar ##olo
Predicted label: ['confirm_answer']
Real label: ['request']
Predicted slot label: O O O O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname
Real slot label: O O O O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname
Score: 
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [3.6523880e-03 4.2372462e-04 1.5585068e-01 8.3999360e-01 7.9496000e-05]
Word 12 score: [4.4721550e-01 5.4414475e-01 3.1019822e-06 5.2124146e-06 8.6314343e-03]
Word 19 score: [5.6529492e-03 1.0770419e-07 7.0776083e-02 8.6079639e-01 6.2774502e-02]
Word 20 score: [2.0133634e-01 8.8874492e-07 1.2949651e-02 7.7908528e-01 6.6278381e-03]
------
117
just to be clear , we ' re booking for 8 : 30 pm tomorrow night at bar ##olo for two ?
Predicted label: ['confirm_question']
Real label: ['confirm_question']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
118
yes please book 8 : 30 pm for 2 in seattle for tomorrow at bar ##olo
Predicted label: ['confirm_answer']
Real label: ['confirm_answer']
Predicted slot label: O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O
Score: 
------
119
your reservation at bar ##olo on 03 / 09 / 2016 at 8 : 30 ##pm for two was confirmed . enjoy your meal .
Predicted label: ['inform']
Real label: ['inform', 'closing']
Predicted slot label: O O O B-restaurantname I-restaurantname O B-date I-date I-date I-date I-date O B-starttime I-starttime I-starttime I-starttime O O O O O B-closing I-closing I-closing I-closing
Real slot label: O O O B-restaurantname I-restaurantname O B-date I-date I-date I-date I-date O B-starttime I-starttime I-starttime I-starttime O O O O O B-closing I-closing I-closing I-closing
Score: 
Word 3 score: [7.7713985e-04 1.2371504e-09 4.9685989e-02 8.9513415e-01 5.4402791e-02]
Word 4 score: [6.7199259e-03 4.3795532e-09 3.4699474e-02 9.4289893e-01 1.5681678e-02]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [1.1172326e-01 6.9233966e-03 8.5367811e-01 5.4038948e-05 2.7621238e-02]
Word 22 score: [9.9931685e-06 9.9314392e-01 6.8460526e-03 1.5303422e-19 1.5303422e-19]
Word 23 score: [4.4597746e-05 1.0451826e-05 4.6642954e-04 8.8057911e-01 1.1889939e-01]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
------
120
i need a table at harold black in washington , dc for tonight at 7 . we have 4 people but two would work , i ' m not sure i want them to come
Predicted label: ['request']
Real label: ['request', 'Not_Sure']
Predicted slot label: O O O O O B-restaurantname I-restaurantname O O O O O B-date O O O O O B-numberofpeople O O O O O O O O O O O O O O O O
Real slot label: O O O O O B-restaurantname I-restaurantname O O O O O B-date O O O O O B-numberofpeople O O O O O O O O O O O O O O O O
Score: 
Word 5 score: [1.6621576e-05 4.7351310e-11 7.6244800e-07 9.9998224e-01 3.9291572e-07]
Word 6 score: [9.9999988e-01 1.5715476e-07 1.0568473e-11 1.9742850e-11 7.0945494e-09]
Word 12 score: [0.00655115 0.3547643  0.09151508 0.03537546 0.511794  ]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
------
121
i confirmed the details with the restaurant . there is a table for four available that can be used for two people . enjoy your meal .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O B-closing I-closing I-closing O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O B-closing I-closing I-closing O
Score: 
Word 23 score: [1.1929325e-01 7.3985974e-03 8.7191004e-01 4.9511833e-05 1.3486008e-03]
Word 24 score: [7.9094925e-06 9.9591631e-01 4.0758466e-03 6.2507725e-20 6.2507725e-20]
Word 25 score: [1.2538617e-05 1.0875263e-05 2.4930132e-04 7.2065777e-01 2.7906942e-01]
------
122
i ' ve joined the group of people fei ##gni ##ng g ##lu ##ten into ##ler ##ance , can you find me a restaurant that has a good menu for people like me ? it would be in san diego
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O B-city I-city
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O B-city I-city
Score: 
Word 38 score: [1.0018454e-07 2.9529235e-01 7.0470673e-01 7.5141276e-07 4.8343853e-08]
Word 39 score: [0.2 0.2 0.2 0.2 0.2]
------
123
i can try ! what date and time would you like to go ?
Predicted label: ['request', 'greeting']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O
Score: 
------
124
this saturday around lunch ##time , 11 ##am to 1 : 30 ##pm . 4 people
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date I-date O O O O B-starttime I-starttime I-starttime I-starttime I-starttime I-starttime I-starttime O B-numberofpeople O
Real slot label: B-date I-date O O O O B-starttime I-starttime I-starttime I-starttime I-starttime I-starttime I-starttime O B-numberofpeople O
Score: 
Word 0 score: [1.6363251e-01 7.6289731e-01 5.8116399e-02 7.6547054e-05 1.5277200e-02]
Word 1 score: [2.27050054e-06 4.69878136e-09 1.11973256e-01 1.00372890e-02
 8.77987146e-01]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [1.6174993e-06 7.3816061e-01 2.5035399e-01 4.5466558e-07 1.1483350e-02]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
------
125
i ' m happy to assist you ! do you have any preference on cuisine to help me narrow down the results ?
Predicted label: ['request', 'greeting']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
126
as long as i can bra ##g to my friends about how healthy it was , i ' d be fine . something with green decor and over ##pr ##ice ##d food , most likely
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O B-food O O O O O O O O O O O O O O B-pricing I-pricing I-pricing I-pricing O O O O
Real slot label: O O O O O O O O O O O O B-food O O O O O O O O O O O O O O B-pricing I-pricing I-pricing I-pricing O O O O
Score: 
Word 12 score: [9.8883420e-01 1.6802316e-05 1.3573776e-05 3.7079652e-05 1.1098344e-02]
Word 27 score: [1.000000e+00 7.752251e-11 7.752251e-11 7.752251e-11 7.752251e-11]
Word 28 score: [1.0000000e+00 1.4930268e-17 1.4930268e-17 1.4930268e-17 1.4930268e-17]
Word 29 score: [1.000000e+00 1.112037e-15 1.112037e-15 1.112037e-15 1.112037e-15]
Word 30 score: [1.0000000e+00 3.1660264e-15 3.1660264e-15 3.1660264e-15 3.1660264e-15]
------
127
i will not be able to confirm the decor through this service . would you like to be shown the top three options across all cuisine ##s ?
Predicted label: ['request', 'inform']
Real label: ['inform', 'confirm_question']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
128
sure , that works
Predicted label: ['confirm_answer']
Real label: ['confirm_answer']
Predicted slot label: O O O O
Real slot label: O O O O
Score: 
------
129
eddie v ' s - la jo ##lla , pa ##on restaurant & wine bar , and ve ##lad ##ora are the top 3 restaurants in this area with pri ##cier menu ##s and available seating . may i book one of these options for you ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O O B-rating I-rating O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O O B-rating I-rating O O O O O O O O O O O O O O O O O O O O O O O
Score: 
Word 0 score: [0.0187007  0.6329875  0.00860358 0.33370462 0.00600355]
Word 1 score: [2.5858474e-03 3.6185958e-07 9.8667204e-01 9.0417424e-03 1.7000082e-03]
Word 2 score: [9.9869460e-01 4.2337078e-06 9.9918829e-08 5.0405570e-06 1.2960583e-03]
Word 3 score: [9.9855703e-01 4.0626874e-06 1.0943520e-07 5.6380409e-06 1.4332377e-03]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [2.2083987e-04 2.2360690e-01 2.9773199e-09 7.1495950e-01 6.1212741e-02]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [2.0294237e-13 5.8586526e-01 4.3102326e-03 4.0982449e-01 3.2192903e-16]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [4.1466391e-01 5.8506328e-01 1.7095754e-05 2.5716685e-05 2.3000693e-04]
Word 14 score: [4.0289261e-03 1.7229553e-07 3.7426846e-06 5.1853796e-03 9.9078172e-01]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [1.8983643e-05 2.8664857e-05 2.3364602e-07 4.9997604e-01 4.9997604e-01]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
------
130
sure , i ' ll go with ve ##lad ##ora
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname
Real slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname
Score: 
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
------
131
ve ##lad ##ora is located a bit north of san diego , in santa fe , ca . is this a suitable lc ##ation ?
Predicted label: ['inform', 'confirm_question']
Real label: ['inform', 'confirm_question']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname O O O O O O B-city I-city O O O O O B-state O O O O O O O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname O O O O O O B-city I-city O O O O O B-state O O O O O O O O
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [1.5149078e-06 1.9954123e-01 8.0044800e-01 5.5929822e-06 3.6268386e-06]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [1.0408568e-08 9.8961699e-01 8.4743573e-07 1.0381378e-02 7.8278936e-07]
------
132
i ' d like to find a english / irish restaurant in atlanta , please
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O B-cuisine I-cuisine I-cuisine O O B-city O O
Real slot label: O O O O O O O B-cuisine I-cuisine I-cuisine O O B-city O O
Score: 
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [1.4749693e-02 9.8522967e-01 3.4661196e-06 1.5353620e-05 1.7353710e-06]
------
133
sure thing , what date and time would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O
Score: 
------
134
this saturday 8 : 00
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date I-date B-starttime I-starttime I-starttime
Real slot label: B-date I-date B-starttime I-starttime I-starttime
Score: 
Word 0 score: [2.1263058e-01 7.3787975e-01 4.9224619e-02 1.1135244e-06 2.6390183e-04]
Word 1 score: [5.4621415e-07 1.3636586e-09 3.8706191e-02 2.9691658e-03 9.5832413e-01]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
------
135
how many guests are in your party ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
136
2
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
137
unfortunately there are not english or irish restaurants in atlanta that may be reserved through this service . would you like to try a different cuisine ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O B-city O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O B-city O O O O O O O O O O O O O O O O O
Score: 
Word 9 score: [1.23069696e-01 8.76665890e-01 1.17252901e-04 1.28751592e-04
 1.83749671e-05]
------
138
please book a table for 2 in seattle for tomorrow at 7 : 30 pm at row house cafe under the name rudy gal ##ind ##o
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O B-personfullname I-personfullname I-personfullname I-personfullname
Real slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O B-personfullname I-personfullname I-personfullname I-personfullname
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [1.20709546e-01 1.73260178e-03 2.93767244e-01 5.83594382e-01
 1.96262001e-04]
Word 9 score: [8.28526497e-01 1.23319879e-01 1.26779325e-08 2.51804835e-07
 4.81534153e-02]
Word 16 score: [2.2965103e-09 5.3846719e-08 9.9997628e-01 2.3706936e-05 3.0002703e-08]
Word 17 score: [4.9164728e-03 2.5255877e-01 9.7639233e-05 1.1643558e-02 7.3078352e-01]
Word 18 score: [2.0811306e-01 8.6088786e-03 5.5647985e-04 1.9314316e-12 7.8272158e-01]
Word 22 score: [9.6715438e-01 4.6252620e-07 1.4069341e-06 1.2335884e-07 3.2843679e-02]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
------
139
your reservation has been set as requested , mr . gal ##ind ##o . i ' m sure you ' ll love it !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
140
can you find a burger place for tomorrow at 3 pm for 8 people in seattle ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O B-restauranttype O O B-date O O O O B-numberofpeople O O B-city O
Real slot label: O O O O B-restauranttype O O B-date O O O O B-numberofpeople O O B-city O
Score: 
Word 4 score: [2.6370498e-04 4.2810520e-06 2.1615662e-04 4.6827285e-05 9.9946910e-01]
Word 7 score: [5.1478279e-01 4.3810103e-02 1.5922872e-06 2.2296523e-05 4.4138324e-01]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [8.4233806e-02 1.0043430e-04 8.1185348e-02 8.3128881e-01 3.1916206e-03]
------
141
hello . do you have a price point in mind ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
142
no
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O
Real slot label: O
Score: 
------
143
here are three restaurants that i found . do any of these interest you : 1 ) hard rock cafe , 2 ) jimmy ' s on first , and 3 ) local burger ?
Predicted label: ['multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O B-restaurantname I-restaurantname O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O B-restaurantname I-restaurantname O
Score: 
Word 23 score: [0.01133932 0.13990414 0.04922891 0.63297886 0.16654877]
Word 24 score: [0.15060636 0.00907797 0.14335153 0.00555567 0.69140846]
Word 25 score: [9.9441355e-01 4.5963143e-06 4.8598356e-08 9.8804157e-06 5.5720080e-03]
Word 26 score: [0.00318124 0.00110935 0.00517772 0.8752388  0.11529295]
Word 27 score: [0.15240072 0.0128835  0.00201217 0.00180109 0.8309026 ]
Word 32 score: [2.9586744e-04 6.0743010e-03 7.4231015e-03 9.8620659e-01 6.4608095e-08]
Word 33 score: [0.06156787 0.1312052  0.23378523 0.11745465 0.45598698]
------
144
hard rock cafe
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [1.8170729e-04 3.0404735e-02 7.8742777e-04 9.2716962e-01 4.1456573e-02]
Word 1 score: [6.2653667e-01 8.9936461e-11 3.7346336e-01 1.6932649e-13 1.3602893e-08]
Word 2 score: [1.7481405e-02 4.4264365e-03 2.0077720e-03 6.7048663e-12 9.7608441e-01]
------
145
your reservation at the hard rock cafe on 03 / 08 / 2016 at 3 ##pm for 8 guests was confirmed . enjoy your meal .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O B-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date I-date I-date O B-starttime I-starttime O B-numberofpeople O O O O B-closing I-closing I-closing O
Real slot label: O O O O B-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date I-date I-date O B-starttime I-starttime O B-numberofpeople O O O O B-closing I-closing I-closing O
Score: 
Word 4 score: [3.0510023e-06 1.3579485e-08 4.0895026e-03 4.8236832e-01 5.1353914e-01]
Word 5 score: [7.8278315e-01 1.0293035e-09 2.1721685e-01 4.3871898e-12 1.6974077e-08]
Word 6 score: [6.7818784e-03 1.3464134e-03 1.1982468e-03 1.9087349e-12 9.9067348e-01]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [1.7155522e-01 4.8592081e-03 8.1898296e-01 2.5575549e-05 4.5770705e-03]
Word 23 score: [1.0682120e-04 9.8946035e-01 1.0432809e-02 1.0503404e-18 1.0503404e-18]
Word 24 score: [1.6784948e-05 1.3615103e-05 2.3588375e-04 8.7680709e-01 1.2292668e-01]
------
146
i need a cheap food place for 3 people tomorrow at 1 ##pm in seattle
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O B-pricing O O O B-numberofpeople O B-date O B-starttime I-starttime O B-city
Real slot label: O O O B-pricing O O O B-numberofpeople O B-date O B-starttime I-starttime O B-city
Score: 
Word 3 score: [9.9993789e-01 3.1857653e-07 2.9046332e-09 5.3277854e-05 8.4909389e-06]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [5.4396212e-02 7.1716188e-03 9.3998204e-07 4.8238630e-06 9.3842643e-01]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [2.7231378e-02 1.4423729e-04 8.9946859e-02 8.7449819e-01 8.1793377e-03]
------
147
tel ##io and casa nos ##tra ri ##stor ##ante are two moderately inexpensive restaurants in seattle with availability tomorrow . would you like to book one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: B-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-pricing I-pricing O O B-city O O B-date O O O O O O O O O O
Real slot label: B-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-pricing I-pricing O O B-city O O B-date O O O O O O O O O O
Score: 
Word 0 score: [4.7626831e-02 5.1445687e-01 3.6782954e-02 2.3945146e-05 4.0110940e-01]
Word 1 score: [2.6446746e-03 1.0049499e-01 4.5701155e-01 1.6229172e-04 4.3968651e-01]
Word 3 score: [9.8128074e-01 1.7617598e-02 1.1016775e-03 3.4008043e-11 3.4008043e-11]
Word 4 score: [1.3741947e-03 1.0557931e-05 9.9849272e-01 1.2240392e-04 6.6407743e-08]
Word 5 score: [8.4484469e-05 7.3058191e-09 9.9983752e-01 7.2427880e-05 5.5524147e-06]
Word 6 score: [9.8939031e-01 1.0609658e-02 1.7385736e-09 1.7385736e-09 1.7385736e-09]
Word 7 score: [9.8860812e-01 1.1391849e-02 1.1180253e-09 1.1180253e-09 1.1180253e-09]
Word 8 score: [9.9100506e-01 8.9949109e-03 2.4204090e-09 2.4204090e-09 2.4204090e-09]
Word 11 score: [9.8048210e-01 1.9517912e-02 8.4803713e-11 8.4803713e-11 8.4803713e-11]
Word 12 score: [6.1771773e-02 9.3822825e-01 2.7227234e-09 1.1952395e-09 2.7227234e-09]
Word 15 score: [3.2823384e-02 1.6586637e-04 1.5710849e-02 9.4865769e-01 2.6422301e-03]
Word 18 score: [4.2864271e-02 1.3574420e-03 1.8065771e-06 8.2350525e-06 9.5576829e-01]
------
148
yes how about tel ##io please !
Predicted label: ['confirm_answer']
Real label: ['inform']
Predicted slot label: O O O B-restaurantname I-restaurantname O O
Real slot label: O O O B-restaurantname I-restaurantname O O
Score: 
Word 3 score: [8.9980507e-01 6.1537296e-02 2.8604500e-03 1.5494305e-04 3.5642236e-02]
Word 4 score: [2.0473984e-03 6.3535079e-02 6.5315557e-01 1.3395197e-04 2.8112802e-01]
------
149
your reservation has been confirmed . please enjoy your meal , and thank you for using our service !
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O B-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing
Real slot label: O O O O O O B-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing
Score: 
Word 6 score: [5.3344283e-04 1.0661518e-03 9.9784791e-01 5.5250077e-04 1.7552748e-10]
Word 7 score: [1.1761302e-02 5.2277964e-02 9.3325090e-01 2.7095582e-03 2.9033242e-07]
Word 8 score: [2.3678826e-05 9.9873918e-01 1.2372108e-03 1.1053169e-17 1.1053169e-17]
Word 9 score: [2.2089102e-07 5.8703364e-08 1.5835834e-06 6.0499597e-01 3.9500216e-01]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [9.9538690e-01 4.3168245e-04 2.3279719e-03 2.1779804e-04 1.6356631e-03]
Word 12 score: [5.8794074e-02 5.4085022e-04 9.3789059e-01 3.3729090e-04 2.4371669e-03]
Word 13 score: [2.3216218e-01 9.0028968e-04 1.1429200e-02 6.2811992e-04 7.5488031e-01]
Word 14 score: [1.1228220e-08 1.1196216e-06 1.7008091e-07 9.9998355e-01 1.5219443e-05]
Word 15 score: [1.8415572e-02 9.8316791e-04 1.8415572e-02 9.6218568e-01 1.8688032e-13]
Word 16 score: [2.2142176e-06 4.0043790e-02 5.7169843e-01 1.7350523e-01 2.1475032e-01]
Word 17 score: [1.7619768e-02 3.5863741e-05 6.1581875e-03 4.0681191e-02 9.3550503e-01]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
------
150
book a table for 3 at a japanese restaurant in sunset beach , nc on friday at 6 ##pm
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O B-numberofpeople O O B-cuisine O O O O O B-state O B-date O B-starttime I-starttime
Real slot label: O O O O B-numberofpeople O O B-cuisine O O O O O B-state O B-date O B-starttime I-starttime
Score: 
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [1.5231833e-14 9.9999118e-01 4.9143578e-09 1.3590896e-11 8.7689286e-06]
Word 13 score: [1.0000000e+00 1.7404132e-12 1.7404132e-12 1.7404132e-12 1.7404132e-12]
Word 15 score: [2.2220505e-02 4.8418975e-04 2.5906766e-05 9.7624093e-01 1.0284118e-03]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
------
151
unfortunately open ##table does not serve the sunset beach area yet . would you like to try a different city in north carolina ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O B-city I-city I-city O O O O O O O O O O O O O O
Real slot label: O O O O O O O B-city I-city I-city O O O O O O O O O O O O O O
Score: 
Word 7 score: [8.0332153e-05 8.3112572e-11 1.6924962e-12 5.5964748e-08 9.9991965e-01]
Word 8 score: [7.0131116e-04 2.6892459e-07 3.6113639e-07 5.8554736e-04 9.9871242e-01]
Word 9 score: [2.4552696e-07 2.2156599e-04 5.1847699e-09 1.5624285e-02 9.8415393e-01]
------
152
wright ##sville beach , nc
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city I-city I-city O B-state
Real slot label: B-city I-city I-city O B-state
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [1.17176256e-04 1.28804970e-07 1.39877438e-05 3.91562469e-02
 9.60712492e-01]
Word 4 score: [1.0000000e+00 3.4577408e-12 3.4577408e-12 3.4577408e-12 3.4577408e-12]
------
153
here is the top rated japanese restaurant in the area : gen ##ki su ##shi bar and japanese restaurant . would you like to book it ?
Predicted label: ['inform', 'confirm_question']
Real label: ['inform', 'confirm_question']
Predicted slot label: O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O
Real slot label: O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O
Score: 
Word 11 score: [0.04098752 0.01054493 0.00263643 0.8830736  0.06275748]
Word 12 score: [0.01033314 0.00784768 0.37393934 0.42973876 0.17814104]
Word 13 score: [4.4760773e-06 8.3485216e-01 1.7412956e-08 1.6456610e-01 5.7718152e-04]
Word 14 score: [3.1085822e-06 8.9462394e-01 1.3646588e-08 1.0487925e-01 4.9367506e-04]
Word 15 score: [4.4150748e-03 1.5771523e-07 2.7726821e-06 1.3039913e-03 9.9427807e-01]
Word 16 score: [0.520816   0.03082325 0.10082988 0.11346604 0.23406477]
Word 17 score: [6.7466466e-08 9.9953640e-01 2.8596201e-05 1.3353696e-04 3.0138192e-04]
Word 18 score: [1.4244368e-08 8.9123362e-01 5.3759489e-02 5.5006862e-02 8.8387603e-17]
------
154
yes
Predicted label: ['confirm_answer']
Real label: ['confirm_answer']
Predicted slot label: O
Real slot label: O
Score: 
------
155
i have successfully completed your reservation at gen ##ki su ##shi var and japanese restaurant . enjoy !
Predicted label: ['inform']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O O O O O O O O O B-closing I-closing
Real slot label: O O O O O O O O O O O O O O O O B-closing I-closing
Score: 
Word 16 score: [4.1327190e-02 9.3474966e-03 9.4627440e-01 4.0435978e-05 3.0104686e-03]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
------
156
i ' m looking for a po ##sh place where the only dress allowed is formal for an upscale dinner with my girls . this would be in las vegas and there will be 5 - 7 of us .
Predicted label: ['request']
Real label: ['inform']
Predicted slot label: O O O O O O B-restauranttype I-restauranttype I-restauranttype O O O O O O O O O B-mealtype I-mealtype O O O O O O O O B-city I-city O O O O B-numberofpeople I-numberofpeople I-numberofpeople O O O
Real slot label: O O O O O O B-restauranttype I-restauranttype I-restauranttype O O O O O O O O O B-mealtype I-mealtype O O O O O O O O B-city I-city O O O O B-numberofpeople I-numberofpeople I-numberofpeople O O O
Score: 
Word 6 score: [2.5134794e-03 1.9996759e-02 9.7720647e-01 9.4275347e-06 2.7380098e-04]
Word 7 score: [9.9878484e-01 5.3963216e-04 2.4494357e-04 3.9377081e-11 4.3070680e-04]
Word 8 score: [3.5693829e-14 2.8477648e-17 8.1374013e-13 1.0000000e+00 5.6449463e-11]
Word 18 score: [1.8737413e-04 2.1327044e-04 6.8812673e-03 9.9271011e-01 7.9305419e-06]
Word 19 score: [9.9999022e-01 9.7636475e-06 8.4672471e-15 7.0499939e-09 1.5586511e-11]
Word 28 score: [6.0406099e-05 3.4118784e-06 4.6929400e-02 9.5272785e-01 2.7891033e-04]
Word 29 score: [1.0000000e+00 4.8032304e-14 4.8032304e-14 4.8032304e-14 4.8032304e-14]
Word 34 score: [0.2 0.2 0.2 0.2 0.2]
Word 35 score: [0.2 0.2 0.2 0.2 0.2]
Word 36 score: [0.2 0.2 0.2 0.2 0.2]
------
157
i ' m happy to assist you ! do you have a specific restaurant or cuisine in mind ?
Predicted label: ['request', 'greeting']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O
Score: 
------
158
a very nice steak ##house and the closer to the strip the better .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O B-cuisine I-cuisine O O O O O O O O O
Real slot label: O O O B-cuisine I-cuisine O O O O O O O O O
Score: 
Word 3 score: [3.3642408e-17 1.3693530e-23 7.7962516e-21 1.9383119e-19 1.0000000e+00]
Word 4 score: [2.2623025e-08 1.9556224e-21 8.3729119e-19 4.5579948e-17 1.0000000e+00]
------
159
what date would you like me to look ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
160
march 17th at 8 pm . we expect it to be at least $ 50 per person can you confirm ? the more expensive is always better .
Predicted label: ['inform']
Real label: ['inform', 'confirm_question']
Predicted slot label: O O O B-starttime I-starttime O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O B-starttime I-starttime O O O O O O O O O O O O O O O O O O O O O O O
Score: 
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [4.0318184e-03 6.9179416e-01 3.0412611e-01 6.3563823e-07 4.7263620e-05]
------
161
del fr ##is ##co ' s double eagle steak house and no ##bu las vegas sound right up your alley . they are both $ $ $ $ rated . would you like to try either of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
Word 0 score: [2.9648583e-02 9.6461439e-01 3.0647209e-03 5.2287115e-04 2.1494112e-03]
Word 1 score: [1.6296514e-08 1.0152893e-05 9.9998987e-01 7.0100517e-19 7.0100517e-19]
Word 2 score: [1.30374955e-08 8.51883925e-03 9.91481185e-01 4.21858762e-14
 4.21858762e-14]
Word 3 score: [1.33658515e-08 8.97453167e-03 9.91025448e-01 4.65941711e-14
 4.65941711e-14]
Word 4 score: [9.9924541e-01 1.5671878e-06 1.0780317e-07 1.4864519e-06 7.5142708e-04]
Word 5 score: [9.9913615e-01 1.9240254e-06 7.9663870e-08 1.2455538e-06 8.6052786e-04]
Word 6 score: [0.6077737  0.09153304 0.23369278 0.05071913 0.0162813 ]
Word 7 score: [1.5053513e-07 7.1923910e-07 2.0847030e-10 9.9995708e-01 4.2066589e-05]
Word 8 score: [7.0473827e-02 3.1258478e-11 9.1796071e-17 4.5773357e-13 9.2952615e-01]
Word 9 score: [0.00427852 0.8434203  0.00238665 0.07396861 0.07594591]
Word 11 score: [9.9865961e-01 1.0927945e-09 1.1046740e-03 1.8942084e-04 4.6299228e-05]
Word 12 score: [9.9945444e-01 2.1391015e-10 4.3323406e-04 9.7687189e-05 1.4619280e-05]
Word 13 score: [1.1306470e-09 3.3122580e-10 2.5215233e-04 9.9862719e-01 1.1207182e-03]
Word 14 score: [1.0000000e+00 3.6324887e-13 3.6324887e-13 3.6324887e-13 3.6324887e-13]
------
162
looking for g ##lu ##ten free meals so reserve a table for 4 at any restaurant in wilmington , nc that can provide that
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O B-restauranttype I-restauranttype I-restauranttype I-restauranttype O O O O O O B-numberofpeople O O O O B-city O B-state O O O O
Real slot label: O O B-restauranttype I-restauranttype I-restauranttype I-restauranttype O O O O O O B-numberofpeople O O O O B-city O B-state O O O O
Score: 
Word 2 score: [8.4768826e-01 8.7624945e-02 6.8010227e-04 2.7259940e-04 6.3734092e-02]
Word 3 score: [1.2006977e-06 1.5169289e-11 3.2191098e-14 5.1784110e-10 9.9999881e-01]
Word 4 score: [3.1518193e-05 7.9150212e-08 2.6827799e-11 6.0304529e-08 9.9996841e-01]
Word 5 score: [9.8909760e-01 1.2969027e-03 4.4382672e-04 2.0255111e-06 9.1596609e-03]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [3.0436267e-05 1.7603487e-07 2.4093322e-02 1.2668671e-01 8.4918934e-01]
Word 19 score: [1.0000000e+00 2.3935953e-12 2.3935953e-12 2.3935953e-12 2.3935953e-12]
------
163
i ' m happy to assist you ! what time and date would you like your reservation for ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O
Score: 
------
164
monday at 8 ##pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date O B-starttime I-starttime
Real slot label: B-date O B-starttime I-starttime
Score: 
Word 0 score: [0.02875058 0.0408471  0.9160596  0.00717138 0.00717138]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
------
165
do you have a specific cuisine in mind ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
166
no
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O
Real slot label: O
Score: 
------
167
i ' m unable to confirm whether the restaurants in our system offer g ##lu ##ten - free options . however , there are some steak ##house and seafood restaurants that would have protein - heavy meals . would you like to choose from those ?
Predicted label: ['inform', 'confirm_question']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
168
yes a steak house
Predicted label: ['confirm_answer']
Real label: ['inform']
Predicted slot label: O O B-restauranttype I-restauranttype
Real slot label: O O B-restauranttype I-restauranttype
Score: 
Word 2 score: [2.8872434e-03 8.3557551e-04 4.3041293e-11 5.7908667e-11 9.9627715e-01]
Word 3 score: [1.6296635e-03 9.8728544e-01 1.5261318e-06 8.7074051e-03 2.3758817e-03]
------
169
ruth ' s chris steak house - wilmington , nc has a table available at your requested time . would you like to book ?
Predicted label: ['inform', 'confirm_question']
Real label: ['inform', 'confirm_question']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-city O B-state O O O O O O O O O O O O O O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-city O B-state O O O O O O O O O O O O O O O
Score: 
Word 0 score: [5.9322351e-06 2.5504935e-04 9.9886107e-01 1.7263550e-07 8.7779178e-04]
Word 1 score: [2.1878707e-01 4.7305593e-04 8.0132805e-02 3.4946504e-03 6.9711244e-01]
Word 2 score: [9.9349904e-01 1.0382884e-06 7.0286973e-08 1.0196846e-05 6.4896219e-03]
Word 3 score: [8.4787607e-01 1.0714207e-01 8.2115497e-05 5.2597495e-03 3.9639961e-02]
Word 4 score: [2.5391931e-02 6.1058508e-10 4.6955041e-14 1.8104508e-10 9.7460812e-01]
Word 5 score: [0.01379185 0.80616057 0.00631999 0.13380232 0.03992525]
Word 7 score: [2.2883364e-03 4.1919775e-05 2.1329579e-01 5.0028622e-02 7.3434538e-01]
Word 9 score: [1.000000e+00 5.088819e-09 5.088819e-09 5.088819e-09 5.088819e-09]
------
170
yes
Predicted label: ['confirm_answer']
Real label: ['confirm_answer']
Predicted slot label: O
Real slot label: O
Score: 
------
171
your reservation is confirmed ! please enjoy your meal , and thank you for using our service .
Predicted label: ['inform', 'thanks']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O B-closing I-closing I-closing I-closing I-closing I-closing O
Real slot label: O O O O O O O O O O O B-closing I-closing I-closing I-closing I-closing I-closing O
Score: 
Word 11 score: [2.3921486e-02 2.3194899e-04 9.7424555e-01 4.5743294e-05 1.5552407e-03]
Word 12 score: [5.1172048e-01 1.2451385e-03 1.4225740e-02 4.5356265e-04 4.7235504e-01]
Word 13 score: [3.0888203e-09 2.3345746e-07 8.1623330e-09 9.9999392e-01 5.8322194e-06]
Word 14 score: [5.8776494e-03 2.5297483e-04 5.8776494e-03 9.8799175e-01 2.0829097e-13]
Word 15 score: [5.1129143e-07 3.6867239e-02 8.2386369e-01 7.1564414e-02 6.7704156e-02]
Word 16 score: [2.0503705e-02 2.8698993e-05 7.9603642e-03 8.1391238e-02 8.9011598e-01]
------
172
i need to book a table for 3 / 21 at 7 pm for dinner at the afghanistan khyber pass in san diego for four guests .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O B-mealtype O O B-restaurantname I-restaurantname I-restaurantname O B-city I-city O O O O
Real slot label: O O O O O O O O O O O O O O B-mealtype O O B-restaurantname I-restaurantname I-restaurantname O B-city I-city O O O O
Score: 
Word 14 score: [9.9985766e-01 4.1157764e-05 1.0084713e-10 1.0110359e-04 3.5573715e-09]
Word 17 score: [7.7196074e-07 8.5663254e-09 3.7720781e-08 9.9995148e-01 4.7660513e-05]
Word 18 score: [5.2965414e-02 9.4703376e-01 8.7051751e-07 5.6939231e-10 5.6939231e-10]
Word 19 score: [9.3360353e-01 1.9293732e-04 5.9751817e-03 6.6631363e-04 5.9561938e-02]
Word 21 score: [3.3991142e-07 4.8176906e-01 5.1822996e-01 4.6417378e-07 2.0990203e-07]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
------
173
thank you so much for booking with us ! your reservation has been confirmed as requested . please enjoy your meal !
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O O O O O O O O O O B-closing I-closing I-closing I-closing I-closing
Real slot label: O O O O O O O O O O O O O O O O O B-closing I-closing I-closing I-closing I-closing
Score: 
Word 17 score: [1.6448385e-01 3.7547801e-02 7.9743242e-01 5.3583476e-04 6.4054497e-08]
Word 18 score: [2.3547122e-02 5.1203191e-02 9.2161661e-01 3.6325525e-03 5.0776890e-07]
Word 19 score: [3.1552581e-06 9.9372631e-01 6.2705036e-03 2.8212007e-17 2.8212007e-17]
Word 20 score: [2.6814817e-04 6.5149688e-05 2.8514473e-03 5.6715214e-01 4.2966312e-01]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
------
174
i would like an italian restaurant in portland oregon
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O B-cuisine O O B-city I-city
Real slot label: O O O O B-cuisine O O B-city I-city
Score: 
Word 4 score: [9.8659652e-01 2.6337524e-10 1.9300421e-07 1.1374822e-07 1.3403158e-02]
Word 7 score: [3.3219007e-05 6.8834429e-06 1.0620365e-02 1.2354477e-02 9.7698510e-01]
Word 8 score: [1.8498521e-04 2.6855258e-07 4.9990693e-01 4.9990693e-01 8.4164770e-07]
------
175
sure , what day would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
176
sunday at 6 ##pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date O B-starttime I-starttime
Real slot label: B-date O B-starttime I-starttime
Score: 
Word 0 score: [1.8464998e-09 9.9465841e-01 1.0724876e-05 1.8499969e-07 5.3306115e-03]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
------
177
how many people will be go ##ign ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
178
6
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
179
a ce ##na ri ##stor ##ante , bug ##att ##i ' s ri ##stor ##ante , and ming ##o west are the top 3 restaurants in your preferred cuisine with available seating . may i book one of these options for you ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O O O O O O
Score: 
Word 0 score: [1.5530524e-05 2.5574565e-03 3.1221619e-01 6.8521088e-01 6.2637595e-10]
Word 1 score: [9.4626630e-03 7.6445657e-01 2.2608070e-01 6.8839867e-08 1.6365236e-10]
Word 2 score: [1.3697569e-01 3.9329705e-05 8.6296976e-01 8.6261534e-06 6.6113912e-06]
Word 3 score: [9.9307358e-01 6.9263806e-03 3.9320645e-09 3.9320645e-09 3.9320645e-09]
Word 4 score: [9.9355257e-01 6.4473939e-03 1.9548390e-09 1.9548390e-09 1.9548390e-09]
Word 5 score: [9.9449098e-01 5.5090073e-03 3.4719461e-09 3.4719461e-09 3.4719461e-09]
Word 7 score: [2.9151411e-07 1.3933820e-04 3.1199604e-06 9.9985719e-01 3.1687241e-17]
Word 8 score: [9.22074774e-04 1.15583454e-04 1.92391872e-02 9.79723155e-01
 7.09769395e-15]
Word 9 score: [3.6151982e-03 6.2737023e-03 1.1010065e-01 8.8001055e-01 1.1523160e-09]
Word 10 score: [9.9906927e-01 6.4556539e-06 1.3156138e-07 1.6208837e-06 9.2252326e-04]
Word 11 score: [9.9898535e-01 9.1942875e-06 1.3599333e-07 1.6679974e-06 1.0037071e-03]
Word 12 score: [9.9398273e-01 6.0172696e-03 6.5296217e-09 6.5296217e-09 6.5296217e-09]
Word 13 score: [9.9443853e-01 5.5615245e-03 4.9642006e-09 4.9642006e-09 4.9642006e-09]
Word 14 score: [9.9462408e-01 5.3758533e-03 8.5960208e-09 8.5960208e-09 8.5960208e-09]
Word 17 score: [1.0000000e+00 1.5016541e-10 1.5016541e-10 1.5016541e-10 1.5016541e-10]
Word 18 score: [1.0000000e+00 4.1095422e-10 4.1095422e-10 4.1095422e-10 4.1095422e-10]
Word 19 score: [6.9379076e-02 1.2686485e-06 3.8644092e-07 8.9389384e-01 3.6725424e-02]
------
180
ce ##na ri ##stor ##ante would be great
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O
Score: 
Word 0 score: [2.3642855e-04 2.9544759e-07 9.9854052e-01 9.8175144e-05 1.1246003e-03]
Word 1 score: [3.1389587e-02 9.5223016e-01 1.6380088e-02 1.0200287e-07 2.8764946e-10]
Word 2 score: [9.8771882e-01 1.2281168e-02 6.3294059e-10 6.3294059e-10 6.3294059e-10]
Word 3 score: [9.8725021e-01 1.2749786e-02 5.7826577e-10 5.7826577e-10 5.7826577e-10]
Word 4 score: [9.8917496e-01 1.0825064e-02 1.0292083e-09 1.0292083e-09 1.0292083e-09]
------
181
6 ##pm is unavailable but both 5 : 45 and 6 : 15 are available . which time would you prefer ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform', 'multiple_choice']
Predicted slot label: B-starttime I-starttime O O O O B-starttime I-starttime I-starttime O B-starttime I-starttime I-starttime O O O O O O O O O
Real slot label: B-starttime I-starttime O O O O B-starttime I-starttime I-starttime O B-starttime I-starttime I-starttime O O O O O O O O O
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
------
182
please book a table for 4 in seattle for tomorrow at 7 : 00 pm at al bo ##cca ##lino under the name beau ren ##fr ##o
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O O O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-personfullname I-personfullname I-personfullname I-personfullname
Real slot label: O O O O O B-numberofpeople O O O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-personfullname I-personfullname I-personfullname I-personfullname
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [8.0422455e-01 1.4079000e-01 1.0184669e-08 3.8105850e-07 5.4985136e-02]
Word 16 score: [5.2724790e-04 8.5211643e-05 4.5682517e-01 1.5250472e-05 5.4254711e-01]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [1.1758686e-03 1.8585504e-04 9.3301475e-02 8.9308882e-01 1.2247947e-02]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
Word 26 score: [0.2 0.2 0.2 0.2 0.2]
------
183
success ! your reservation has been confirmed . please enjoy your meal !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O
Score: 
------
184
book me a table for 1 in seattle for tomorrow at 7 : 00 pm at flying fish
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-city O B-date O B-starttime I-starttime I-starttime I-starttime O B-restaurantname I-restaurantname
Real slot label: O O O O O B-numberofpeople O B-city O B-date O B-starttime I-starttime I-starttime I-starttime O B-restaurantname I-restaurantname
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [2.2741005e-02 1.5471161e-04 3.6568709e-02 9.3996596e-01 5.6957168e-04]
Word 9 score: [6.6654778e-01 7.9306945e-02 1.2814647e-06 4.2567140e-06 2.5413972e-01]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [1.36986305e-03 9.97287393e-01 1.32745842e-03 2.07264293e-07
 1.50968135e-05]
Word 16 score: [2.1718274e-04 2.1718274e-04 3.6437814e-06 1.6732333e-04 9.9939466e-01]
Word 17 score: [2.7818595e-08 7.4076152e-01 1.2104186e-08 1.5278274e-10 2.5923839e-01]
------
185
i have booked your restaurant for tomorrow . thank you .
Predicted label: ['inform', 'thanks']
Real label: ['inform']
Predicted slot label: O O O O O O B-date O B-closing I-closing O
Real slot label: O O O O O O B-date O B-closing I-closing O
Score: 
Word 6 score: [4.2577842e-01 5.7395923e-01 2.4981482e-08 7.2702488e-07 2.6157612e-04]
Word 8 score: [1.2486905e-03 5.0407884e-08 9.9865580e-01 1.4852547e-10 9.5537158e-05]
Word 9 score: [9.1962582e-01 2.3209134e-03 4.4425903e-03 8.9225199e-05 7.3521420e-02]
------
186
i have 10 people for a birthday party who can handle that many ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O B-numberofpeople O O O B-occasion I-occasion O O O O O O
Real slot label: O O B-numberofpeople O O O B-occasion I-occasion O O O O O O
Score: 
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [3.9763676e-04 9.9583507e-01 5.1872787e-04 1.6165737e-06 3.2468608e-03]
Word 7 score: [9.9926692e-01 1.1867559e-04 6.0582964e-04 2.2764858e-11 8.6213968e-06]
------
187
what city are you in ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O
Real slot label: O O O O O O
Score: 
------
188
myrtle beach
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city I-city
Real slot label: B-city I-city
Score: 
Word 0 score: [9.9895310e-01 8.1478345e-04 2.3058397e-04 1.5825029e-06 2.0183636e-08]
Word 1 score: [1.9104540e-03 1.1663270e-08 2.8501008e-02 3.6426097e-02 9.3316245e-01]
------
189
what date would you like the reservation for ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
190
42 ##45 ##9
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O
Real slot label: O O O
Score: 
------
191
what time would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
192
5 ##pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-starttime I-starttime
Real slot label: B-starttime I-starttime
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
------
193
here are 3 of the top rated restaurants in myrtle beach : mrs fish seafood grill , captain george ' s seafood restaurant , and no ##iz ##y oyster . would you like to try one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O B-rating I-rating O O B-city I-city O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O B-rating I-rating O O B-city I-city O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 5 score: [8.1061851e-05 5.3239692e-05 1.9354283e-07 4.9993277e-01 4.9993277e-01]
Word 6 score: [5.2485627e-01 3.4401056e-03 4.1579373e-05 1.2332192e-05 4.7164971e-01]
Word 9 score: [9.7209585e-01 3.0655488e-03 1.8773500e-02 7.1432243e-07 6.0643833e-03]
Word 10 score: [1.5275694e-02 1.1974548e-07 6.4948881e-03 7.8428417e-02 8.9980090e-01]
Word 12 score: [4.8409131e-01 1.8135244e-02 4.8409131e-01 1.3679805e-02 2.2718507e-06]
Word 13 score: [9.6236420e-08 5.5163866e-01 2.3872093e-07 1.1333182e-09 4.4836104e-01]
Word 14 score: [1.2634220e-04 9.2986894e-01 6.8997391e-02 7.9924670e-05 9.2741655e-04]
Word 15 score: [5.932220e-16 6.938323e-17 7.438077e-04 1.225042e-13 9.992562e-01]
Word 17 score: [1.1048515e-10 1.3400115e-01 2.3190134e-05 1.7143233e-04 8.6580420e-01]
Word 18 score: [4.0231561e-04 6.9655985e-02 9.2979938e-01 1.4192870e-04 3.6462225e-07]
Word 19 score: [9.9916482e-01 6.4313059e-07 3.7320550e-08 1.1968623e-06 8.3338440e-04]
Word 20 score: [9.9873501e-01 1.0954654e-06 3.4778111e-08 1.5097814e-06 1.2623681e-03]
Word 21 score: [1.1542073e-04 9.5145094e-01 4.7932353e-02 5.0187111e-05 4.5115149e-04]
Word 22 score: [2.2106260e-13 6.3640100e-01 2.3568135e-03 3.6124212e-01 6.5713123e-16]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
Word 26 score: [0.2 0.2 0.2 0.2 0.2]
Word 27 score: [0.2 0.2 0.2 0.2 0.2]
Word 28 score: [9.74138677e-01 1.28703956e-02 1.29790595e-02 9.07335451e-09
 1.18507769e-05]
------
194
no ##iz ##y oyster
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [9.8195422e-01 5.5119133e-04 1.7494394e-02 1.5137570e-09 1.2986831e-07]
------
195
unfortunately that restaurant is not available for booking . would you like to try gulf ##stream cafe , or carolina seafood & steak instead ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O
Real slot label: O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O
Score: 
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [1.4970544e-01 4.2314865e-03 1.2531700e-03 6.7688162e-13 8.4480995e-01]
Word 19 score: [1.2470943e-05 2.7693514e-04 1.0067525e-05 4.3183509e-06 9.9969625e-01]
Word 20 score: [1.5436698e-04 8.4480932e-03 9.2142675e-04 2.9120479e-06 9.9047321e-01]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [7.8695854e-03 1.6661689e-10 4.7563732e-16 1.4457478e-12 9.9213046e-01]
------
196
what is the best restaurant for st . valentine day in seattle ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O B-date I-date I-date I-date O B-city O
Real slot label: O O O O O O B-date I-date I-date I-date O B-city O
Score: 
Word 6 score: [8.8932598e-03 6.0552088e-07 9.4576734e-07 8.8932598e-03 9.8221201e-01]
Word 7 score: [3.0662930e-01 1.9340062e-07 2.9774127e-04 3.0662930e-01 3.8644350e-01]
Word 8 score: [8.8286907e-07 9.8095768e-07 1.1705523e-04 9.9988115e-01 8.3183425e-11]
Word 9 score: [1.5845084e-06 9.2809578e-06 9.9998820e-01 1.8649915e-07 8.2878120e-07]
Word 11 score: [2.5705844e-02 1.4131966e-04 4.6148933e-02 9.2674762e-01 1.2563101e-03]
------
197
here are the restaurants i found matching your request . please select one : 1 ) elliott ' s oyster house - rating : 4 out of 5 . 2 ) the pink door - rating : 4 out of 5 . 3 ) ja ##pone ##ssa - rating : 4 out of 5 .
Predicted label: ['multiple_choice']
Real label: ['multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
198
can you book me elliott ' s oyster house today at 6 . 00pm ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname B-date O O O O O
Real slot label: O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname B-date O O O O O
Score: 
Word 4 score: [7.1618003e-01 5.2380757e-03 2.7858186e-01 2.2220785e-08 2.2220785e-08]
Word 5 score: [5.0856280e-01 3.5509243e-04 4.6461585e-01 3.4686938e-04 2.6119357e-02]
Word 6 score: [9.9914396e-01 3.7289356e-06 1.3619874e-07 2.5740026e-06 8.4954768e-04]
Word 7 score: [9.8307484e-01 4.5770314e-03 1.2347877e-02 1.0748649e-09 2.2897541e-07]
Word 8 score: [0.00381009 0.7694639  0.00570125 0.0634326  0.15759213]
Word 9 score: [0.02546526 0.15328386 0.09514989 0.07047834 0.6556226 ]
------
199
how many people are going ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O
Real slot label: O O O O O O
Score: 
------
200
5
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
201
i need a fine dining place with a party of 3 for monday at 6 ##pm in seattle
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O B-mealtype O O O O O B-numberofpeople O B-date O B-starttime I-starttime O B-city
Real slot label: O O O O B-mealtype O O O O O B-numberofpeople O B-date O B-starttime I-starttime O B-city
Score: 
Word 4 score: [7.5471905e-07 5.1666444e-07 9.9977857e-01 2.1123809e-04 8.9077757e-06]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [1.1022960e-04 1.7013490e-05 9.9412596e-01 2.8734028e-03 2.8734028e-03]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [1.7688721e-01 1.8378183e-04 3.9444959e-01 4.2544305e-01 3.0363288e-03]
------
202
here are 3 of the top rated fine dining restaurants in seattle : art of the table , aqua by el ga ##uch ##o , metropolitan grill . would you like to book one of those or would you prefer more options ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O B-city O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O B-city O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname O O O O O O O O O O O O O O O O
Score: 
Word 11 score: [5.2653179e-02 2.6445577e-04 5.5052824e-03 9.4043332e-01 1.1437607e-03]
Word 13 score: [0.00203025 0.0100203  0.20142655 0.25471494 0.53180796]
Word 14 score: [0.9177574  0.00280914 0.02360841 0.03993713 0.01588799]
Word 15 score: [0.0044193  0.03312787 0.01124313 0.00955267 0.94165695]
Word 16 score: [8.1748342e-14 9.9993229e-01 2.0932507e-09 8.7157623e-08 6.7540685e-05]
Word 18 score: [3.0087354e-05 1.0773314e-05 2.9976428e-07 2.7332676e-06 9.9995613e-01]
Word 19 score: [0.6700223  0.00644274 0.01639421 0.30459085 0.00254995]
Word 20 score: [9.9895418e-01 1.9979660e-04 5.7275292e-07 8.4443524e-04 9.5832286e-07]
Word 21 score: [9.75607157e-01 2.02650117e-05 1.81051400e-02 6.16599433e-03
 1.01404716e-04]
Word 22 score: [9.7100079e-01 1.5098121e-05 1.9769687e-02 9.1385646e-03 7.5838128e-05]
Word 23 score: [9.7654825e-01 1.2994751e-05 1.6655967e-02 6.7181205e-03 6.4662221e-05]
Word 25 score: [9.4548970e-02 4.5138121e-01 3.1936169e-04 2.3693226e-03 4.5138121e-01]
Word 26 score: [9.9436776e-16 4.1106660e-19 5.2072657e-03 2.3335690e-14 9.9479276e-01]
------
203
aqua by el ga ##uch ##o
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [1.0264495e-06 4.3206468e-02 2.9045748e-06 8.8054867e-04 9.5590907e-01]
Word 1 score: [0.16520728 0.01034183 0.03592402 0.7865081  0.0020188 ]
Word 2 score: [9.9831355e-01 3.3498119e-04 7.3750037e-08 1.3510562e-03 3.5806133e-07]
Word 3 score: [9.3996274e-01 9.6677086e-06 5.4690585e-02 5.2466048e-03 9.0384972e-05]
Word 4 score: [9.2725277e-01 7.5166395e-06 6.6788875e-02 5.8657546e-03 8.5132990e-05]
Word 5 score: [9.4188470e-01 7.5261960e-06 5.3732187e-02 4.2980439e-03 7.7534598e-05]
------
204
great - i have made a reservation for you at aqua by el ga ##uch ##o for 3 / 14 at 6 ##pm for 3 people .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O B-numberofpeople O O
Real slot label: O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O B-numberofpeople O O
Score: 
Word 10 score: [4.5413049e-06 1.2024885e-06 1.1217290e-08 4.4941945e-07 9.9999380e-01]
Word 11 score: [0.09241872 0.00827086 0.0329558  0.8649874  0.00136725]
Word 12 score: [9.9699163e-01 5.4003973e-04 7.5467909e-08 2.4677906e-03 3.9363525e-07]
Word 13 score: [8.3732408e-01 1.0217332e-05 1.5071438e-01 1.1714873e-02 2.3650049e-04]
Word 14 score: [7.2001189e-01 6.2088993e-06 2.6954651e-01 1.0171560e-02 2.6385253e-04]
Word 15 score: [8.1374341e-01 6.4978967e-06 1.7736156e-01 8.7088784e-03 1.7963690e-04]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
------
205
hello , i was wondering if you can tell me where a good restaurant is to book ? hello , i was wondering if you can tell me where a good restaurant is to book ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
206
i ' d be happy to help ! what city , please ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O
Score: 
------
207
may i book a five star place for wednesday at 1 : 30 ##pm for 2 people in seattle ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O B-rating I-rating O O B-date O B-starttime I-starttime I-starttime I-starttime O B-numberofpeople O O B-city O
Real slot label: O O O O B-rating I-rating O O B-date O B-starttime I-starttime I-starttime I-starttime O B-numberofpeople O O B-city O
Score: 
Word 4 score: [2.7103350e-04 1.7862655e-09 9.9972743e-01 5.0856619e-07 1.0194499e-06]
Word 5 score: [6.5567961e-05 9.6063040e-02 3.7137622e-01 5.2250212e-05 5.3244293e-01]
Word 8 score: [1.0747598e-06 1.8604754e-02 9.5883220e-01 1.1280975e-02 1.1280975e-02]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [3.7423048e-02 2.0411723e-04 2.8382623e-01 6.7795324e-01 5.9335405e-04]
------
208
i ' m happy to assist you ! do you have a specific restaurant or cuisine in mind ?
Predicted label: ['request']
Real label: ['request', 'greeting']
Predicted slot label: O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O
Score: 
------
209
su ##shi !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-cuisine I-cuisine I-cuisine
Real slot label: B-cuisine I-cuisine I-cuisine
Score: 
Word 0 score: [6.7153742e-06 9.9982160e-01 1.8218627e-05 1.1275609e-04 4.0685012e-05]
Word 1 score: [2.1251549e-03 6.0824928e-05 7.8589692e-05 1.5269607e-01 8.4503937e-01]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
------
210
here are 3 of the top rated su ##shi places in seattle : ja ##pone ##ssa , fuji su ##shi , and kan ##ame i ##zak ##aya . would you like to book one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O B-city O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O O O O O B-city O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 11 score: [1.9368011e-01 3.4101744e-04 7.5301491e-02 7.2826225e-01 2.4152037e-03]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [5.2085782e-22 1.2806711e-09 8.7448312e-11 1.4336243e-13 1.0000000e+00]
Word 18 score: [3.1958942e-05 1.0073932e-01 2.0861341e-06 6.7446941e-01 2.2475721e-01]
Word 19 score: [3.8211317e-07 9.2212105e-01 2.1324524e-09 7.5299479e-02 2.5791437e-03]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [8.7381396e-03 9.8952764e-01 1.7341601e-03 2.4838287e-10 2.4838287e-10]
Word 25 score: [8.4925406e-03 9.8969752e-01 1.8099190e-03 2.7846215e-11 2.7846215e-11]
Word 26 score: [6.4333729e-03 9.9268615e-01 8.8045507e-04 2.2722262e-10 2.2722262e-10]
------
211
ja ##pone ##ssa
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
------
212
i have successfully completed your reservation for ja ##pone ##ssa on march 16th at 1 : 30 ##pm for 2 people . enjoy !
Predicted label: ['inform']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O O B-starttime I-starttime I-starttime I-starttime O B-numberofpeople O O B-closing I-closing
Real slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O O B-starttime I-starttime I-starttime I-starttime O B-numberofpeople O O B-closing I-closing
Score: 
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [8.6406276e-02 8.0388151e-03 8.9506781e-01 2.4055249e-05 1.0462995e-02]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
------
213
i need a good italian restaurant in the seattle area .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O B-restauranttype O O O B-city O O
Real slot label: O O O O B-restauranttype O O O B-city O O
Score: 
Word 4 score: [9.7181332e-01 1.6293806e-09 1.1516076e-07 2.0859603e-07 2.8186370e-02]
Word 8 score: [4.20994461e-02 1.07289045e-04 1.13160156e-01 8.41572344e-01
 3.06082726e-03]
------
214
at what date would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
215
tuesday , february 16
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O
Real slot label: O O O O
Score: 
------
216
at what time would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
217
0 . 70 ##8 ##33 ##33 ##33
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
218
how many people are going ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O
Real slot label: O O O O O O
Score: 
------
219
two
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O
Real slot label: O
Score: 
------
220
here are the restaurants i found matching your request . please select one : 1 ) the pink door - rating : 4 out of 5 . 2 ) il terra ##zzo carmine - rating : 4 out of 5 . 3 ) tu ##lio ri ##stor ##ante - rating : 4 out of 5 .
Predicted label: ['inform', 'multiple_choice']
Real label: ['multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
221
3
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O
Real slot label: O
Score: 
------
222
book me a table for 1 in seattle for tomorrow at 7 : 00 pm at el cam ##ino
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-city O B-date O B-starttime I-starttime I-starttime I-starttime O B-restaurantname I-restaurantname I-restaurantname
Real slot label: O O O O O B-numberofpeople O B-city O B-date O B-starttime I-starttime I-starttime I-starttime O B-restaurantname I-restaurantname I-restaurantname
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [5.0527919e-02 3.2867450e-04 1.0678740e-01 8.4172505e-01 6.3092238e-04]
Word 9 score: [4.1056859e-01 4.2564627e-02 2.1342818e-07 1.3794377e-06 5.4686517e-01]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [1.8909094e-06 9.3803871e-01 6.1951123e-02 6.9709199e-06 1.3680528e-06]
Word 16 score: [1.1845822e-05 2.5372597e-04 3.5083758e-07 9.9973410e-01 7.8807938e-09]
Word 17 score: [2.0726996e-02 9.7927296e-01 2.5116866e-13 2.1359656e-18 2.1359656e-18]
Word 18 score: [9.0391897e-03 9.9096078e-01 1.0729997e-11 9.3774787e-14 9.3774787e-14]
------
223
your reservation for el cam ##ino is confirmed for 7 : 00pm tomorrow . please enjoy !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O B-restaurantname I-restaurantname I-restaurantname O O O B-starttime I-starttime I-starttime B-date O O B-closing O
Real slot label: O O O B-restaurantname I-restaurantname I-restaurantname O O O B-starttime I-starttime I-starttime B-date O O B-closing O
Score: 
Word 3 score: [1.1054718e-05 1.0599502e-03 2.9288693e-05 9.9889970e-01 3.2060708e-08]
Word 4 score: [1.4813912e-01 8.5186088e-01 1.4781633e-11 7.9100099e-17 7.9100099e-17]
Word 5 score: [1.4481299e-01 8.5518700e-01 1.3321901e-09 5.8235886e-12 5.8235886e-12]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [2.4005045e-04 9.9989986e-03 1.4404680e-10 3.3921957e-08 9.8976082e-01]
Word 15 score: [3.8169166e-01 9.0382034e-03 5.7220727e-01 4.1321979e-05 3.7021559e-02]
------
224
would like to book an indian restaurant in seattle on 03 / 17 / 16 at 1 : 30 ##pm for 2 people
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-cuisine O O B-city O B-date I-date I-date I-date I-date O B-starttime I-starttime I-starttime I-starttime O B-numberofpeople O
Real slot label: O O O O O B-cuisine O O B-city O B-date I-date I-date I-date I-date O B-starttime I-starttime I-starttime I-starttime O B-numberofpeople O
Score: 
Word 5 score: [1.5163438e-01 5.4277098e-01 6.9646823e-04 4.7521326e-06 3.0489346e-01]
Word 8 score: [2.74162851e-02 1.86980789e-04 1.03644356e-01 8.68051887e-01
 7.00500619e-04]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
------
225
here are three restaurants that i found . do any of these interest you : 1 ) sha ##lim ##ar restaurant 2 ) chun ##ey ' s , or 3 ) ni ##rma ##l ' s ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [2.9062110e-13 8.5478467e-01 2.0293447e-03 1.4318600e-01 5.1388333e-15]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [9.9710804e-01 9.3048830e-06 2.9739525e-07 6.5360473e-06 2.8757735e-03]
Word 26 score: [9.9639231e-01 1.2154283e-05 2.7527761e-07 6.9432099e-06 3.5883668e-03]
Word 31 score: [0.2 0.2 0.2 0.2 0.2]
Word 32 score: [0.2 0.2 0.2 0.2 0.2]
Word 33 score: [0.2 0.2 0.2 0.2 0.2]
Word 34 score: [9.9688148e-01 1.0455095e-05 2.3051264e-07 6.4202477e-06 3.1014022e-03]
Word 35 score: [9.9632156e-01 1.2836190e-05 2.2584227e-07 7.2069765e-06 3.6581277e-03]
------
226
3
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O
Real slot label: O
Score: 
------
227
i have successfully booked your reservation at ni ##rma ##l ' s for 2 people at 1 : 30 ##pm on 3 / 17 / 16 . enjoy !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-numberofpeople O O B-starttime I-starttime I-starttime I-starttime O B-date I-date I-date I-date I-date O B-closing O
Real slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-numberofpeople O O B-starttime I-starttime I-starttime I-starttime O B-date I-date I-date I-date I-date O B-closing O
Score: 
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [9.9928999e-01 1.9656393e-06 4.1906286e-08 2.0491877e-06 7.0590508e-04]
Word 11 score: [9.9914598e-01 3.0238650e-06 4.1027562e-08 2.3296750e-06 8.4866188e-04]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
Word 27 score: [1.8580513e-01 5.3994539e-03 8.0333793e-01 1.6736316e-05 5.4407544e-03]
------
228
i would like to book an chinese restaurant in downtown seattle on 03 / 12 / 16 at 6 : 30 ##pm for 4 people
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O B-cuisine O O O B-city O B-date I-date I-date I-date I-date O B-starttime I-starttime I-starttime I-starttime O B-numberofpeople O
Real slot label: O O O O O O B-cuisine O O O B-city O B-date I-date I-date I-date I-date O B-starttime I-starttime I-starttime I-starttime O B-numberofpeople O
Score: 
Word 6 score: [9.7643638e-01 1.4367507e-05 2.1597628e-04 2.3290975e-02 4.2400770e-05]
Word 10 score: [2.7185209e-02 2.9522183e-04 2.1839732e-01 3.1719247e-03 7.5095034e-01]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
------
229
here are 3 of the top rated chinese restaurants in seattle : ka ##u ka ##u , wild ginger asian restaurant , and sichuan ##ese cuisine . would you like to book one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O B-cuisine O O B-city O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O B-cuisine O O B-city O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 7 score: [9.9829572e-01 7.3723371e-05 7.2106965e-09 1.2518453e-03 3.7865399e-04]
Word 10 score: [1.1832205e-01 4.3766890e-04 4.9441051e-02 8.3070773e-01 1.0914621e-03]
Word 12 score: [6.0154406e-09 3.6999193e-06 4.1565781e-07 9.9998832e-01 7.5909379e-06]
Word 13 score: [5.6843837e-03 1.9202846e-04 5.8298343e-01 1.2181819e-01 2.8932190e-01]
Word 14 score: [1.45166068e-05 1.09560474e-07 1.56426959e-05 9.99214053e-01
 7.55681598e-04]
Word 15 score: [1.2527904e-05 9.4816706e-08 1.0094871e-05 9.9935144e-01 6.2575599e-04]
Word 17 score: [0.00289215 0.10785576 0.437339   0.33899587 0.11291724]
Word 18 score: [6.2697834e-01 3.4997279e-03 1.9230308e-09 5.6456332e-03 3.6387631e-01]
Word 19 score: [7.9672498e-04 4.5863442e-05 9.3487306e-03 3.7986541e-01 6.0994327e-01]
Word 20 score: [3.8391264e-14 7.3976898e-01 2.5537924e-03 2.5767717e-01 1.2158901e-17]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [4.8684923e-04 9.9950588e-01 7.2777361e-06 4.5277151e-15 4.5277151e-15]
Word 24 score: [5.0403778e-03 9.9495959e-01 1.3280802e-08 1.9073386e-20 1.9073386e-20]
Word 25 score: [2.1973291e-07 9.9191850e-01 2.4956044e-08 8.0812778e-03 8.2859775e-11]
------
230
ka ##u ka ##u
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [4.3002787e-05 1.0888034e-06 2.6040468e-08 9.9952269e-01 4.3321573e-04]
Word 1 score: [7.1517788e-05 3.7442754e-07 9.9715096e-01 8.6086438e-05 2.6911378e-03]
Word 2 score: [1.4714361e-04 1.2803363e-07 3.7308154e-03 9.8501378e-01 1.1108149e-02]
Word 3 score: [1.3367270e-04 1.3902576e-07 2.3488237e-03 9.8883623e-01 8.6811436e-03]
------
231
i ' m sorry , i ' m not able to book that restaurant at this time . would you like to try a different one ?
Predicted label: ['request']
Real label: ['confirm_question']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
232
yes wilder ginger
Predicted label: ['inform']
Real label: ['confirm_answer']
Predicted slot label: O B-restaurantname I-restaurantname
Real slot label: O B-restaurantname I-restaurantname
Score: 
Word 1 score: [2.25112235e-05 1.02011763e-04 1.29684375e-03 1.14149265e-01
 8.84429336e-01]
Word 2 score: [1.4757162e-01 4.5461366e-03 1.4963991e-08 2.6657190e-03 8.4521657e-01]
------
233
success ! i was able to book you a table for 4 at wild ginger on 3 / 12 at 6 : 30 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime I-starttime I-starttime O
Real slot label: O O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime I-starttime I-starttime O
Score: 
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.00662554 0.21594962 0.5233645  0.13473839 0.11932197]
Word 14 score: [6.0117012e-01 1.6001686e-01 2.3554145e-09 3.5287587e-03 2.3528424e-01]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
------
234
i ' d like to reserve a table for 1 at bar ##olo ri ##stor ##ante in seattle for march 15th , i prefer 6 : 00 pm if available .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-city O B-date I-date O O O O O O O O O O
Real slot label: O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-city O B-date I-date O O O O O O O O O O
Score: 
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [4.0396708e-03 6.4486363e-09 1.7660785e-02 9.3364406e-01 4.4655524e-02]
Word 12 score: [3.8927487e-01 5.3505048e-08 7.4740378e-03 6.0141385e-01 1.8372459e-03]
Word 13 score: [9.891182e-01 1.088166e-02 4.516214e-08 4.516214e-08 4.516214e-08]
Word 14 score: [9.8962349e-01 1.0376517e-02 1.1581791e-08 1.1581791e-08 1.1581791e-08]
Word 15 score: [9.9086541e-01 9.1346102e-03 4.2636685e-08 4.2636685e-08 4.2636685e-08]
Word 17 score: [8.0363661e-02 4.4532429e-04 4.2650324e-01 4.9140906e-01 1.2787583e-03]
Word 19 score: [8.7054013e-06 7.7889782e-01 7.2659679e-02 5.7460345e-02 9.0973444e-02]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
------
235
what name would you like to book the reservation under ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
236
mike hunt
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname I-personfullname
Real slot label: B-personfullname I-personfullname
Score: 
Word 0 score: [1.4195989e-07 8.8825536e-01 4.0456526e-02 3.0831467e-02 4.0456526e-02]
Word 1 score: [1.9122599e-02 8.5546487e-11 8.0427720e-04 9.8007292e-01 2.1007180e-07]
------
237
i ' ve booked your reservation . thank you .
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O B-closing I-closing O
Real slot label: O O O O O O O B-closing I-closing O
Score: 
Word 7 score: [8.9873135e-04 7.2936842e-08 9.9907339e-01 1.4301496e-10 2.7757926e-05]
Word 8 score: [5.5480510e-01 2.8623894e-03 1.3346437e-02 3.2810803e-04 4.2865798e-01]
------
238
are there any vega ##n restaurants in the seattle area ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O B-restauranttype I-restauranttype O O O B-city O O
Real slot label: O O O B-restauranttype I-restauranttype O O O B-city O O
Score: 
Word 3 score: [0.00542274 0.96060777 0.00542274 0.01427336 0.01427336]
Word 4 score: [2.3806034e-08 9.9493450e-01 2.3806034e-08 2.5327152e-03 2.5327152e-03]
Word 8 score: [2.5967937e-02 9.6990596e-05 4.8090883e-02 9.1389585e-01 1.1948322e-02]
------
239
here are 3 of the top rated restaurants in seattle with vega ##n options : cafe pet ##ti ##ross ##o , tu ##lio , and julia ' s of wall ##ing ##ford . would you like to try one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O B-rating I-rating O O B-city O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O B-rating I-rating O O B-city O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 5 score: [1.2521156e-04 2.9416091e-04 3.7177708e-07 4.9979016e-01 4.9979016e-01]
Word 6 score: [9.0276158e-01 1.6561539e-03 1.3104749e-04 8.7109489e-05 9.5364042e-02]
Word 9 score: [3.8340494e-02 3.3924315e-04 2.0849701e-02 9.3902344e-01 1.4471413e-03]
Word 15 score: [1.1729342e-04 3.0443701e-03 1.0918540e-02 4.7820164e-11 9.8591983e-01]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [9.9996209e-01 6.9899255e-07 3.7247231e-05 1.4747313e-11 1.4747313e-11]
Word 26 score: [7.1720564e-01 4.4609838e-05 2.7388191e-01 1.7457880e-04 8.6932229e-03]
Word 27 score: [9.9935108e-01 1.0561683e-06 1.0349735e-07 1.9244630e-06 6.4584543e-04]
Word 28 score: [9.84018385e-01 1.37834875e-02 2.05244822e-03 1.45469661e-04
 2.10967386e-07]
Word 29 score: [0.2 0.2 0.2 0.2 0.2]
Word 30 score: [0.2 0.2 0.2 0.2 0.2]
Word 31 score: [0.2 0.2 0.2 0.2 0.2]
------
240
yes , tu ##lio will su ##ffi ##ce . is there a dress code for tu ##lio ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O B-restaurantname I-restaurantname O O O O O O O O O O O B-restaurantname I-restaurantname O
Real slot label: O O B-restaurantname I-restaurantname O O O O O O O O O O O B-restaurantname I-restaurantname O
Score: 
Word 2 score: [4.2149407e-01 4.3512257e-05 1.4776261e-01 9.5600849e-03 4.2113969e-01]
Word 3 score: [1.3141733e-02 2.4950257e-04 9.8518223e-01 3.2664271e-04 1.0998432e-03]
Word 15 score: [4.9046865e-01 8.4596308e-05 2.0904979e-01 1.3523417e-02 2.8687358e-01]
Word 16 score: [2.6885227e-03 5.8902299e-04 9.9648970e-01 6.6739027e-05 1.6601644e-04]
------
241
no there is n ' t a dress code . does this still interest you ?
Predicted label: ['confirm_question']
Real label: ['inform', 'confirm_question']
Predicted slot label: O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O
Score: 
------
242
yes . do they have accommodations for a larger party ? say 8 - 10 people for a birthday celebration ?
Predicted label: ['request', 'inform']
Real label: ['request', 'confirm_answer']
Predicted slot label: O O O O O O O O O O O O B-numberofpeople I-numberofpeople I-numberofpeople O O O B-occasion I-occasion O
Real slot label: O O O O O O O O O O O O B-numberofpeople I-numberofpeople I-numberofpeople O O O B-occasion I-occasion O
Score: 
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [8.2461932e-04 9.9708325e-01 6.0396752e-04 5.8474399e-07 1.4875472e-03]
Word 19 score: [5.8890080e-01 8.7798173e-05 3.1664094e-05 2.1508526e-05 4.1095826e-01]
------
243
yes , tu ##lio can easily accommodate parties of that size . would you like to make a reservation ?
Predicted label: ['inform', 'confirm_question']
Real label: ['confirm_question', 'confirm_answer']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O
Score: 
------
244
indeed . please allow for a party of 10 to be safe and we will need 2 high ##chai ##rs . saturday night at 7 would be a good time .
Predicted label: ['inform', 'confirm_answer']
Real label: ['inform']
Predicted slot label: O O O O O O B-occasion O B-numberofpeople O O O O O O O O O O O O B-date I-date O B-starttime O O O O O O
Real slot label: O O O O O O B-occasion O B-numberofpeople O O O O O O O O O O O O B-date I-date O B-starttime O O O O O O
Score: 
Word 6 score: [9.9826658e-01 4.7499529e-04 1.1970821e-03 1.1658556e-10 6.1367486e-05]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [2.1534991e-02 3.6550367e-03 3.5677862e-04 9.7244624e-03 9.6472877e-01]
Word 22 score: [6.0544915e-12 5.0000000e-01 1.6522795e-11 5.0000000e-01 1.5425700e-14]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
------
245
7 ##pm is already booked but both 6 : 30 ##pm and 7 : 30 ##pm are available for your party . would either of those su ##ffi ##ce ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: B-starttime I-starttime O O O O O B-starttime I-starttime I-starttime I-starttime O B-starttime I-starttime I-starttime I-starttime O O O O O O O O O O O O O O
Real slot label: B-starttime I-starttime O O O O O B-starttime I-starttime I-starttime I-starttime O B-starttime I-starttime I-starttime I-starttime O O O O O O O O O O O O O O
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
------
246
i ' m in the mood for mexican
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O B-cuisine
Real slot label: O O O O O O O B-cuisine
Score: 
Word 7 score: [2.2356195e-05 7.5404726e-02 1.4322614e-03 5.4559614e-06 9.2313522e-01]
------
247
where are you located ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
248
i ' m in seattle
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O B-city
Real slot label: O O O O B-city
Score: 
Word 4 score: [5.7710987e-02 1.0184855e-04 8.2647935e-02 8.5615540e-01 3.3838178e-03]
------
249
what date would you like me to look for a reservation ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O
Score: 
------
250
tomorrow
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date
Real slot label: B-date
Score: 
Word 0 score: [1.8618775e-03 9.9809891e-01 1.5822363e-09 5.2036609e-07 3.8719150e-05]
------
251
how many are going ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
252
probably four
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O
Real slot label: O O
Score: 
------
253
what time would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
254
sometime around 6 : 45 ##pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O B-starttime I-starttime I-starttime I-starttime I-starttime
Real slot label: O B-starttime I-starttime I-starttime I-starttime I-starttime
Score: 
Word 1 score: [9.90256667e-01 9.71222855e-03 1.15270395e-05 1.15270395e-05
 8.06389380e-06]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
------
255
here are 3 of the top rated mexican restaurants in seattle : el cam ##ino , he ##cho , barrio . would you like to try one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O B-rating I-rating B-cuisine O O B-city O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname O B-restaurantname O O O O O O O O O O
Real slot label: O O O O O B-rating I-rating B-cuisine O O B-city O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname O B-restaurantname O O O O O O O O O O
Score: 
Word 5 score: [1.3215044e-03 7.7497057e-04 1.8280107e-06 4.9895084e-01 4.9895084e-01]
Word 6 score: [9.4093567e-01 2.3937471e-04 8.0608142e-09 8.5780966e-11 5.8824975e-02]
Word 7 score: [8.3004664e-08 5.5167149e-04 4.5032102e-05 4.2748476e-09 9.9940312e-01]
Word 10 score: [0.17629527 0.00157862 0.14207937 0.6791311  0.00091564]
Word 12 score: [1.2811842e-05 2.8699383e-04 1.5673666e-06 9.9969864e-01 4.0470818e-09]
Word 13 score: [2.1231258e-03 9.9787688e-01 1.8310854e-12 5.3947952e-17 5.3947952e-17]
Word 14 score: [6.9669430e-04 9.9930334e-01 2.7759953e-10 4.3058626e-11 4.3058626e-11]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [1.5513812e-02 1.6066628e-05 1.0063305e-03 6.8850397e-07 9.8346299e-01]
------
256
he ##cho or barrio
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [1.1000809e-04 3.4573624e-01 4.7519075e-06 6.2556360e-06 6.5414280e-01]
Word 3 score: [7.0709451e-05 4.1290988e-08 4.8384933e-05 3.3050702e-09 9.9988091e-01]
------
257
what name would you like to book the reservation under ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
258
jennifer lopez
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname I-personfullname
Real slot label: B-personfullname I-personfullname
Score: 
Word 0 score: [7.9527308e-05 9.2658281e-01 4.3063312e-05 7.3137462e-02 1.5704475e-04]
Word 1 score: [1.7581053e-05 9.9715036e-01 1.3819769e-03 5.1308890e-10 1.4501070e-03]
------
259
great . i ' ve booked your reservation . thank you .
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O O B-closing I-closing O
Real slot label: O O O O O O O O O B-closing I-closing O
Score: 
Word 9 score: [5.7079503e-03 3.9896122e-07 9.9423945e-01 6.9908740e-10 5.2277035e-05]
Word 10 score: [2.3912594e-01 1.0577512e-03 1.9225588e-02 1.3770066e-04 7.4045306e-01]
------
260
hello
Predicted label: ['greeting']
Real label: ['greeting']
Predicted slot label: B-greeting
Real slot label: B-greeting
Score: 
Word 0 score: [4.0650181e-03 9.9537271e-01 5.5657350e-04 2.7999151e-06 2.7999151e-06]
------
261
hi ! would you like to make a reservation ?
Predicted label: ['greeting', 'confirm_question']
Real label: ['greeting']
Predicted slot label: B-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting
Real slot label: B-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting
Score: 
Word 0 score: [7.4090807e-05 3.3219340e-01 1.6696475e-02 3.3219340e-01 3.1884265e-01]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [3.0922054e-04 2.5844809e-01 6.8350559e-01 1.5823126e-02 4.1914012e-02]
Word 3 score: [0.21181835 0.04866802 0.01203928 0.00424523 0.72322905]
Word 4 score: [2.1643418e-01 2.3764409e-05 2.4461202e-05 3.0624920e-01 4.7726840e-01]
Word 5 score: [5.2502555e-06 1.2061433e-04 9.9953711e-01 5.5171483e-08 3.3701028e-04]
Word 6 score: [3.6791538e-05 4.2254505e-01 1.7791224e-05 5.7739639e-01 3.9939250e-06]
Word 7 score: [0.8494941  0.00310196 0.09302747 0.05321443 0.00116204]
Word 8 score: [3.8161772e-01 1.9652278e-05 1.7538376e-05 5.0876765e-03 6.1325741e-01]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
------
262
yes . a table for two at the bis ##tro in green ( green , ohio ) next wednesday the 16th at 5 ##pm .
Predicted label: ['request']
Real label: ['inform']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname O B-city O B-city O B-state O B-date I-date I-date I-date O B-starttime I-starttime O
Real slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname O B-city O B-city O B-state O B-date I-date I-date I-date O B-starttime I-starttime O
Score: 
Word 7 score: [2.5838165e-02 1.1822108e-02 9.6228898e-01 1.7812441e-05 3.2874141e-05]
Word 8 score: [9.97552454e-01 2.43345369e-03 5.95059817e-07 1.34342072e-05
 1.08743215e-07]
Word 9 score: [9.9809605e-01 4.2695037e-04 6.0383595e-06 1.4705905e-03 3.1139285e-07]
Word 11 score: [7.7615760e-04 9.5226377e-01 4.4397935e-02 2.4883416e-03 7.3798452e-05]
Word 13 score: [7.7494170e-04 9.6450192e-01 3.1840783e-02 2.8216941e-03 6.0624770e-05]
Word 15 score: [4.0543237e-06 3.0368724e-06 4.9999642e-01 4.9999642e-01 1.2137924e-07]
Word 17 score: [6.3820094e-06 7.8430312e-06 1.3609255e-05 9.9997044e-01 1.7164369e-06]
Word 18 score: [8.0998439e-01 6.2918865e-11 1.9437538e-02 8.5289046e-02 8.5289046e-02]
Word 19 score: [5.6040698e-01 3.8101879e-01 5.1849812e-02 5.2020635e-04 6.2042107e-03]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
------
263
i ' m sorry , i ' m unable to book that particular restaurant . would you like to try a different location ?
Predicted label: ['request']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
264
no
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O
Real slot label: O
Score: 
------
265
how about a reservation on a different day ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
266
any tables open at bob ' s burger ##s ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 4 score: [2.2530794e-10 8.3808935e-01 1.6186169e-01 4.0164970e-05 8.8237121e-06]
Word 5 score: [9.9543816e-01 3.9867507e-03 2.8013284e-04 2.5165698e-04 4.3311727e-05]
Word 6 score: [9.9990392e-01 2.0308002e-05 1.5734520e-06 2.3447195e-05 5.0731360e-05]
Word 7 score: [1.000000e+00 8.243682e-12 8.243682e-12 8.243682e-12 8.243682e-12]
Word 8 score: [1.0000000e+00 4.5817086e-11 4.5817086e-11 4.5817086e-11 4.5817086e-11]
------
267
i ' m happy to assist you ! what city are you dining in ?
Predicted label: ['request']
Real label: ['request', 'greeting']
Predicted slot label: B-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting O O O O O O O O
Real slot label: B-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting O O O O O O O O
Score: 
Word 0 score: [9.4144338e-01 3.6992120e-07 1.4553136e-03 2.1366438e-02 3.5734553e-02]
Word 1 score: [1.6541156e-09 8.2674110e-01 7.8890921e-04 1.7246997e-01 1.7314804e-08]
Word 2 score: [3.0613292e-09 8.6001354e-01 2.8759162e-03 1.3711053e-01 5.4878917e-08]
Word 3 score: [2.4467327e-03 1.5275981e-01 8.5072337e-05 3.4235001e-01 5.0235832e-01]
Word 4 score: [5.1718353e-06 6.2965853e-05 9.8334819e-01 5.5121796e-09 1.6583709e-02]
Word 5 score: [0.40190506 0.12387359 0.47156072 0.00089142 0.00176925]
Word 6 score: [0.07656379 0.00250517 0.00900941 0.01096911 0.90095246]
------
268
washington dc
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city I-city
Real slot label: B-city I-city
Score: 
Word 0 score: [3.0682294e-08 3.3695069e-03 1.1015363e-03 9.9545324e-01 7.5607692e-05]
Word 1 score: [1.8891711e-05 4.9965745e-01 1.2620474e-06 6.6494540e-04 4.9965745e-01]
------
269
i can not find a restaurant by that name . i did located bobby ' s burger palace . is that what you meant ?
Predicted label: ['inform', 'confirm_question']
Real label: ['inform', 'confirm_question']
Predicted slot label: O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O
Real slot label: O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O
Score: 
Word 13 score: [4.99072257e-07 9.99635220e-01 2.50825047e-04 3.71821933e-08
 1.13404065e-04]
Word 14 score: [7.5869840e-01 8.5883394e-06 1.5448733e-02 8.0904126e-04 2.2503525e-01]
Word 15 score: [9.9589044e-01 1.3666622e-07 3.0275203e-08 7.4014451e-06 4.1021560e-03]
Word 16 score: [9.1841710e-01 3.0172193e-02 5.5248541e-04 9.8455439e-06 5.0848320e-02]
Word 17 score: [9.9809486e-01 1.8539065e-03 2.6898730e-05 1.6501781e-08 2.4241122e-05]
------
270
yes . i would like to eat there with 3 people tonight at 6 pm .
Predicted label: ['confirm_answer']
Real label: ['inform', 'confirm_answer']
Predicted slot label: O O O O O O O O O B-numberofpeople O B-date O O O O
Real slot label: O O O O O O O O O B-numberofpeople O B-date O O O O
Score: 
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.05747937 0.18096824 0.2274995  0.01204431 0.52200854]
------
271
unfortunately i can not make reservations at that restaurant at this time . would you like me to search for different burger places in your area ?
Predicted label: ['request', 'inform', 'confirm_question']
Real label: ['inform', 'confirm_question']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
272
yes
Predicted label: ['confirm_answer']
Real label: ['confirm_answer']
Predicted slot label: O
Real slot label: O
Score: 
------
273
i found a few great options for you ! 1 ) old dominion brew ##house , 2 ) celebrity dell ##y , and 3 ) cafe deluxe - west end . would you like to book one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 25 score: [5.0154496e-05 1.1566555e-03 1.1376622e-02 7.0571193e-10 9.8741663e-01]
Word 26 score: [6.3543087e-01 1.4977497e-01 6.5019168e-02 1.4977497e-01 1.8602869e-11]
Word 27 score: [9.8599792e-01 6.6332947e-03 7.3492707e-04 6.6332947e-03 5.2318120e-07]
Word 28 score: [1.9045236e-02 6.0555726e-07 2.0962375e-07 9.5313078e-01 2.7823195e-02]
Word 29 score: [1.2117056e-07 4.3340804e-15 4.9806786e-01 4.9806786e-01 3.8642790e-03]
------
274
yes . i ' ll do cafe deluxe .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O B-restaurantname I-restaurantname O
Real slot label: O O O O O O B-restaurantname I-restaurantname O
Score: 
Word 6 score: [9.0282883e-05 1.4952407e-03 5.5050943e-03 1.1900695e-11 9.9290931e-01]
Word 7 score: [8.1411362e-01 6.8127394e-02 4.9631611e-02 6.8127394e-02 1.6789543e-13]
------
275
i have successfully completed your reservation at cafe deluxe for tonight at 6 ##pm . enjoy !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname O B-date O B-starttime I-starttime O O O
Real slot label: O O O O O O O B-restaurantname I-restaurantname O B-date O B-starttime I-starttime O O O
Score: 
Word 7 score: [1.9315745e-04 1.9293139e-04 8.4050223e-03 2.4751147e-12 9.9120879e-01]
Word 8 score: [6.5921837e-01 1.6592667e-01 8.9283036e-03 1.6592667e-01 2.6275255e-13]
Word 10 score: [2.8622666e-04 7.7875085e-02 2.1552902e-02 3.7130121e-05 9.0024865e-01]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
------
276
hello . please find me a mexican restaurant in central ##ia , il for a party of 2 for tomorrow at 5 pm .
Predicted label: ['request', 'greeting']
Real label: ['request', 'greeting']
Predicted slot label: O O O O O O B-cuisine O O B-city I-city O B-state O O O O B-numberofpeople O B-date O B-starttime I-starttime O
Real slot label: O O O O O O B-cuisine O O B-city I-city O B-state O O O O B-numberofpeople O B-date O B-starttime I-starttime O
Score: 
Word 6 score: [4.5058745e-04 7.9845154e-01 5.0579175e-02 1.4283387e-03 1.4909038e-01]
Word 9 score: [0.22475387 0.00295119 0.01751379 0.06826424 0.6865169 ]
Word 10 score: [0.76345193 0.00082008 0.2131093  0.01850596 0.00411272]
Word 12 score: [1.0000000e+00 1.3684664e-14 2.3289358e-11 3.1425461e-14 4.6563968e-12]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [4.5487672e-01 5.4268789e-01 2.5403168e-09 4.1607333e-07 2.4349492e-03]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [1.0785932e-06 4.4757923e-01 5.5239356e-01 2.6173122e-05 2.2350992e-10]
------
277
hi , do you have a price range in mind ?
Predicted label: ['request']
Real label: ['request', 'greeting']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
278
no
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O
Real slot label: O
Score: 
------
279
what name would you like to book the reservation under ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
280
jason
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O
Real slot label: O
Score: 
------
281
i ca n ' t find any matching ##rest ##aur ##ants within 50 miles of central ##ia , il . would you still like me to search for the nearest one ?
Predicted label: ['inform', 'confirm_question']
Real label: ['confirm_question']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
282
yes please
Predicted label: ['confirm_answer']
Real label: ['confirm_answer']
Predicted slot label: O O
Real slot label: O O
Score: 
------
283
i found some results in st . louis . 1 ) dia ##bl ##ito ##s can ##tina , 2 ) can ##tina la ##redo , and 3 ) don emilia ##no ' s restaurant ##e . would you like to book one of those ##s ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O
Real slot label: O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O
Score: 
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [5.1799580e-02 9.0721118e-01 4.0974732e-02 1.4499368e-05 6.5468013e-11]
Word 16 score: [5.10509573e-02 9.18964148e-01 2.99736671e-02 1.11249965e-05
 2.93824652e-11]
Word 20 score: [9.3623316e-01 6.3766658e-02 2.5690585e-07 6.5982458e-10 1.0953354e-16]
Word 21 score: [9.9354845e-01 6.0880473e-03 3.3426861e-04 2.9241177e-05 6.2828431e-16]
Word 22 score: [4.2799988e-04 2.0479607e-04 3.6625970e-05 9.9880302e-01 5.2759383e-04]
Word 23 score: [2.9988759e-04 1.0941133e-04 3.2140531e-05 9.9917221e-01 3.8629177e-04]
Word 28 score: [1.7225003e-12 6.6625994e-10 9.9999988e-01 1.2779321e-07 4.7217812e-09]
Word 29 score: [2.4053793e-01 7.5946206e-01 2.6941158e-10 2.6941158e-10 2.6941158e-10]
Word 30 score: [5.7810197e-05 9.9993253e-01 3.1992313e-06 3.1992313e-06 3.1992313e-06]
Word 31 score: [9.9898237e-01 1.2364450e-06 1.9881004e-08 2.2207373e-06 1.0141359e-03]
Word 32 score: [9.9895298e-01 1.7133240e-06 1.7480144e-08 2.2696427e-06 1.0430395e-03]
Word 33 score: [3.8636991e-01 1.7067392e-01 3.9469102e-01 3.9109989e-05 4.8225980e-02]
Word 34 score: [3.5258052e-01 2.2254498e-01 3.6271676e-01 4.8913756e-05 6.2108818e-02]
------
284
dia ##bl ##ito ##s can ##tina please
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [1.3328985e-02 9.6339029e-01 2.3277242e-02 3.5706355e-06 4.4606444e-13]
Word 5 score: [1.2176277e-02 9.7093958e-01 1.6881146e-02 2.9958051e-06 1.7129237e-13]
------
285
success ! i have booked a table for 2 at dia ##bl ##ito ##s can ##tina on 3 / 8 at 5 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O
Real slot label: O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O
Score: 
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [1.2989512e-02 9.6941042e-01 1.7598122e-02 2.0028037e-06 6.4181821e-14]
Word 15 score: [1.1117778e-02 9.7550052e-01 1.3379685e-02 1.9442982e-06 4.4403161e-14]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
------
286
what are the top ten dining options near 03 ##0 ##60
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O B-distanceconstraints I-distanceconstraints I-distanceconstraints I-distanceconstraints
Real slot label: O O O O O O O B-distanceconstraints I-distanceconstraints I-distanceconstraints I-distanceconstraints
Score: 
Word 7 score: [5.7052547e-01 2.7735907e-01 2.9277759e-08 1.0018406e-03 1.5111366e-01]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
------
287
here are 3 of the top rated restaurants in nash ##ua , nh . mt ' s local kitchen & wine bar , surf , and lila ##c blossom .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O B-rating I-rating O O B-city I-city O B-state O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O O B-rating I-rating O O B-city I-city O B-state O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 5 score: [2.0281215e-05 2.0591181e-04 8.9944237e-08 4.9988690e-01 4.9988690e-01]
Word 6 score: [9.4827175e-01 4.7871566e-04 7.1568834e-11 1.1782467e-12 5.1249538e-02]
Word 9 score: [7.9577898e-05 2.9997402e-04 2.9842906e-05 6.6070998e-01 3.3888051e-01]
Word 10 score: [8.1331687e-05 9.5308023e-06 5.9647387e-05 9.9965882e-01 1.9067332e-04]
Word 12 score: [1.000000e+00 4.915013e-12 4.915013e-12 4.915013e-12 4.915013e-12]
Word 14 score: [1.6572690e-02 3.8633013e-07 9.8342609e-01 5.4613384e-08 7.3539314e-07]
Word 15 score: [0.54912317 0.01983624 0.35814962 0.00174182 0.07114912]
Word 16 score: [9.9955195e-01 2.8655436e-06 7.4935002e-08 1.2059621e-06 4.4382201e-04]
Word 17 score: [8.1187738e-03 7.5860665e-04 9.6226811e-01 2.8836522e-02 1.7880593e-05]
Word 18 score: [4.2998333e-14 9.9993277e-01 6.7264700e-05 1.4461870e-11 4.0661249e-11]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [7.8549117e-01 2.1439265e-01 1.8481014e-06 8.4801199e-05 2.9515921e-05]
Word 21 score: [7.1655202e-04 3.7956109e-08 1.0858028e-06 1.1416340e-03 9.9814069e-01]
Word 23 score: [8.3868345e-03 3.0281830e-12 1.5134960e-08 9.8891300e-01 2.7001232e-03]
Word 26 score: [1.0926514e-05 6.7799869e-05 9.9972922e-01 4.7702520e-07 1.9160988e-04]
Word 27 score: [1.3746422e-02 3.4064392e-03 9.8062938e-01 9.0310503e-05 2.1274588e-03]
Word 28 score: [0.39633122 0.39633122 0.01589403 0.1755495  0.01589403]
------
288
can you compare the three options ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
289
lila ##c blossom is a chinese restaurant , surf is a seafood restaurant , and mt ' s local kitchen & wine is an american restaurant . they all have great reviews .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O B-rating I-rating I-rating O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O B-rating I-rating I-rating O
Score: 
Word 29 score: [4.3586510e-06 9.9386543e-01 6.0686418e-03 4.3586510e-06 5.7136705e-05]
Word 30 score: [8.9466829e-07 3.4866277e-02 5.0942239e-04 1.1585962e-01 8.4876376e-01]
Word 31 score: [3.2423821e-11 5.0000000e-01 5.0000000e-01 2.0486858e-25 2.0486858e-25]
------
290
tell me more about surf
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O B-restaurantname
Real slot label: O O O O B-restaurantname
Score: 
Word 4 score: [3.6970566e-03 5.6278184e-11 2.0370135e-07 9.9134922e-01 4.9535348e-03]
------
291
surf is moderately priced and overall has very favorable reviews .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
292
what are the three most expensive dishes ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O B-pricing I-pricing O O
Real slot label: O O O O B-pricing I-pricing O O
Score: 
Word 4 score: [9.5715359e-02 1.5187412e-02 3.3911395e-01 5.4989797e-01 8.5279738e-05]
Word 5 score: [5.6518722e-01 4.2360935e-01 5.1847742e-06 1.1198095e-02 1.7271805e-07]
------
293
portuguese seafood stew for $ 29 , pan ##ko baked cod for $ 27 , and lobster sarah 2 ##lb $ 39 or lobster kristina 1a ##¼ lb $ 32 * .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
294
what is lobster kristina ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
295
steamed & shu ##cked native lobster fl ##am ##ba ##© ##ed with co ##gna ##c , lobster stock , chi ##ves , cream and butter , served with jasmine rice & grille ##d as ##para ##gus .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
296
sounds ta ##sty ! i would like to make a reservation .
Predicted label: ['confirm_question']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O
Score: 
------
297
great - what day would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
298
book me a table for 1 at ag ##rod ##ol ##ce in seattle for tomorrow at 7 : 00 pm .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-city O B-date O O O O O O
Real slot label: O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-city O B-date O O O O O O
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [9.6037108e-01 3.2921001e-02 6.7079426e-03 3.0278662e-09 3.0278662e-09]
Word 8 score: [9.9999833e-01 4.4040030e-07 1.1630012e-06 7.7842565e-15 7.7842565e-15]
Word 9 score: [9.9999583e-01 3.8555054e-06 2.5747121e-07 2.5578924e-08 2.5578924e-08]
Word 10 score: [9.9999619e-01 3.5548578e-06 2.6315558e-07 1.9189404e-08 1.9189404e-08]
Word 12 score: [1.1514235e-01 3.5222116e-04 3.0879056e-01 5.7429701e-01 1.4179060e-03]
Word 14 score: [8.07083905e-01 7.00962842e-02 1.60615173e-07 3.80599818e-06
 1.22815795e-01]
------
299
i have successfully booked your reservation . enjoy !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-closing O
Real slot label: O O O O O O O B-closing O
Score: 
Word 7 score: [1.3326339e-01 4.5599709e-03 8.5700858e-01 1.4872108e-05 5.1531675e-03]
------
300
can you recommend a good thai restaurant ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-restauranttype I-restauranttype O
Real slot label: O O O O O B-restauranttype I-restauranttype O
Score: 
Word 5 score: [6.4679195e-09 8.4434953e-10 6.4679195e-09 2.1648442e-03 9.9783522e-01]
Word 6 score: [2.7428723e-05 9.4691628e-01 5.2158777e-02 8.9755771e-04 2.4879074e-18]
------
301
i can definitely help . what city are you located in ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O
Score: 
------
302
seattle
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city
Real slot label: B-city
Score: 
Word 0 score: [7.00580537e-01 1.55774556e-04 1.84231237e-01 1.14841454e-01
 1.90965831e-04]
------
303
on what date would you like to eat ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
304
tomorrow at 5 pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date O O O
Real slot label: B-date O O O
Score: 
Word 0 score: [8.6580077e-04 9.9913293e-01 1.3575843e-10 4.2804569e-08 1.3410212e-06]
------
305
how many guests will you have ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
306
3
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
307
i found the following restaurants that fit your criteria : a ##yu ##tt ##haya thai restaurant & bar , mala ##kor thai restaurant , pinto thai bis ##tro & su ##shi bar .
Predicted label: ['inform', 'multiple_choice']
Real label: ['multiple_choice']
Predicted slot label: O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 10 score: [1.2021529e-08 9.9999988e-01 5.3010631e-08 5.5484066e-18 5.5484066e-18]
Word 11 score: [5.1683500e-08 9.9936551e-01 6.3440611e-04 6.1787464e-16 6.1787464e-16]
Word 12 score: [2.3946572e-07 9.9152112e-01 8.4786247e-03 7.2994797e-09 7.2994797e-09]
Word 13 score: [2.4011663e-07 9.9115366e-01 8.8461488e-03 4.2779420e-09 4.2779420e-09]
Word 14 score: [0.3651989 0.1490813 0.3651989 0.0193265 0.1011944]
Word 15 score: [4.6440358e-13 7.3004836e-01 3.3438168e-03 2.6660785e-01 2.4419697e-14]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [1.6234690e-02 1.4696557e-06 1.4402702e-05 1.6939947e-02 9.6680945e-01]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.33543408 0.1407808  0.33543408 0.04745413 0.14089686]
Word 22 score: [4.6648091e-13 7.2877806e-01 3.4046012e-03 2.6781729e-01 1.3232995e-14]
Word 24 score: [1.9979384e-06 9.9940252e-01 7.6993092e-05 4.3906618e-04 7.9424848e-05]
Word 25 score: [8.0860125e-05 5.9167895e-05 8.0860125e-05 4.3608332e-03 9.9541843e-01]
Word 26 score: [9.2544234e-01 7.0834793e-02 7.2354633e-05 3.6502413e-03 3.7057828e-07]
Word 27 score: [9.2982113e-01 6.6909142e-02 6.4991007e-05 3.2044305e-03 3.4203165e-07]
Word 28 score: [0.2 0.2 0.2 0.2 0.2]
Word 29 score: [3.9365295e-07 7.6077431e-01 1.6658978e-08 2.3797973e-01 1.2455076e-03]
Word 30 score: [5.5388546e-07 6.2743652e-01 1.8893655e-08 3.7112924e-01 1.4336819e-03]
Word 31 score: [8.8694496e-03 9.8028943e-07 1.4273587e-05 1.1483537e-02 9.7963184e-01]
------
308
make a reservation at pinto thai bis ##tro & su ##shi bar
Predicted label: ['request']
Real label: ['inform']
Predicted slot label: O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 4 score: [6.3800556e-09 9.9995565e-01 1.0209126e-06 4.1218911e-05 2.0735965e-06]
Word 5 score: [1.6573975e-05 1.0195418e-05 1.6573975e-05 2.3489931e-04 9.9972171e-01]
Word 6 score: [8.3817935e-01 1.5834887e-01 9.1016562e-05 3.3803105e-03 3.6191008e-07]
Word 7 score: [8.4928817e-01 1.4748932e-01 8.0528393e-05 3.1416679e-03 3.5354873e-07]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [3.0454902e-07 2.2531573e-01 9.4261017e-09 7.7326858e-01 1.4153693e-03]
Word 10 score: [3.6779770e-07 1.4367087e-01 9.0078940e-09 8.5522395e-01 1.1047452e-03]
Word 11 score: [6.1519877e-03 2.5225754e-07 1.1853590e-05 6.1000800e-03 9.8773581e-01]
------
309
what name would you like to book the reservation under ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
310
z ##ig z ##ig ##ler
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname I-personfullname I-personfullname I-personfullname I-personfullname
Real slot label: B-personfullname I-personfullname I-personfullname I-personfullname I-personfullname
Score: 
Word 0 score: [0.40009913 0.05016576 0.04210654 0.40009913 0.10752947]
Word 1 score: [1.8008555e-04 9.8319364e-01 1.6446231e-02 1.8008555e-04 1.6785606e-14]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
------
311
unfortunately there was no availability for 5 ##pm , i can book : 5 : 30 ##pm or 6 ##pm . would you like me to book either times ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O B-starttime I-starttime O O O O O B-starttime I-starttime I-starttime I-starttime O B-starttime I-starttime O O O O O O O O O O
Real slot label: O O O O O O B-starttime I-starttime O O O O O B-starttime I-starttime I-starttime I-starttime O B-starttime I-starttime O O O O O O O O O O
Score: 
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
------
312
try 6 ##pm
Predicted label: ['request']
Real label: ['inform']
Predicted slot label: O B-starttime I-starttime
Real slot label: O B-starttime I-starttime
Score: 
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
------
313
your reservation at pinto thai bis ##tro & su ##shi bar was confirmed for 03 / 08 / 2016 at 6 ##pm for 3 guests under the name z ##ig z ##ig ##ler .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O B-date I-date I-date I-date I-date O B-starttime I-starttime O B-numberofpeople O O O O B-personfullname I-personfullname I-personfullname I-personfullname I-personfullname O
Real slot label: O O O O O O O O O O O O O O B-date I-date I-date I-date I-date O B-starttime I-starttime O B-numberofpeople O O O O B-personfullname I-personfullname I-personfullname I-personfullname I-personfullname O
Score: 
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 28 score: [4.9661401e-01 5.3164237e-03 1.4556017e-03 4.9661401e-01 1.1741985e-13]
Word 29 score: [1.8932261e-04 8.9647090e-01 1.0315045e-01 1.8932261e-04 8.7300950e-15]
Word 30 score: [0.2 0.2 0.2 0.2 0.2]
Word 31 score: [0.2 0.2 0.2 0.2 0.2]
Word 32 score: [0.2 0.2 0.2 0.2 0.2]
------
314
hi . i want a restaurant in seattle that has really good wings . what do you recommend ?
Predicted label: ['request', 'greeting']
Real label: ['request', 'greeting']
Predicted slot label: B-greeting O O O O O O B-city O O O O B-food O O O O O O
Real slot label: B-greeting O O O O O O B-city O O O O B-food O O O O O O
Score: 
Word 0 score: [3.7508202e-05 2.6290625e-01 2.7859095e-02 2.6290625e-01 4.4629097e-01]
Word 7 score: [0.203565   0.00104446 0.35129702 0.44309452 0.00099894]
Word 12 score: [9.9503714e-01 4.9174130e-03 8.2963749e-12 4.5406472e-05 6.5192751e-10]
------
315
hi . do you have price range or type of atmosphere in mind ?
Predicted label: ['request']
Real label: ['request', 'greeting']
Predicted slot label: B-greeting O O O O O O O O O O O O O
Real slot label: B-greeting O O O O O O O O O O O O O
Score: 
Word 0 score: [7.4431555e-05 5.0904918e-02 2.8625159e-02 5.0904918e-02 8.6949050e-01]
------
316
something casual
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O B-atmosphere
Real slot label: O B-atmosphere
Score: 
Word 1 score: [8.8234566e-07 5.7276329e-06 6.5506618e-03 9.9335927e-01 8.3525025e-05]
------
317
the restaurants i ' ve found for you are ; the old sage , rooster ##s bar and grill , and beach ##house bar and grill . would you like to try one of these ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 10 score: [4.0191398e-03 8.8386843e-04 9.9508923e-01 3.1359216e-06 4.7277185e-06]
Word 11 score: [1.0731355e-09 2.8032132e-10 9.9999833e-01 1.6222178e-06 5.5022946e-13]
Word 12 score: [1.8299342e-08 1.1435567e-12 6.7540839e-02 5.5407570e-04 9.3190497e-01]
Word 14 score: [1.0000000e+00 2.2470723e-10 2.2470723e-10 2.2470723e-10 2.2470723e-10]
Word 15 score: [9.9999940e-01 1.6746364e-07 1.6746364e-07 1.6746364e-07 1.6746364e-07]
Word 16 score: [1.1604309e-02 8.8306848e-07 6.9604598e-06 1.0950661e-02 9.7743714e-01]
Word 17 score: [0.6301165  0.02787609 0.06127341 0.08908242 0.19165158]
Word 18 score: [6.4788271e-15 1.2201762e-15 2.3417461e-03 1.4151774e-12 9.9765825e-01]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [7.9553081e-03 4.8994161e-07 4.5748948e-06 3.4094178e-03 9.8863029e-01]
Word 24 score: [0.5194578  0.03689507 0.06672639 0.14856878 0.22835195]
Word 25 score: [1.5747849e-14 3.9360719e-15 1.4776896e-03 3.3011159e-12 9.9852234e-01]
------
318
rooster ##s
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname
Score: 
Word 0 score: [0.9867387  0.00331531 0.00331531 0.00331531 0.00331531]
Word 1 score: [1.0000000e+00 2.9956105e-13 2.9956105e-13 2.9956105e-13 2.9956105e-13]
------
319
what date would you like your res ##ese ##rva ##tion to be ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O
Score: 
------
320
i would like to book an chinese restaurant in downtown seattle on 03 / 12 / 2016 at 6 : 30 ##pm for 4 people
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O B-cuisine O O B-address B-city O B-date I-date I-date I-date I-date O B-starttime I-starttime I-starttime I-starttime O B-numberofpeople O
Real slot label: O O O O O O B-cuisine O O B-address B-city O B-date I-date I-date I-date I-date O B-starttime I-starttime I-starttime I-starttime O B-numberofpeople O
Score: 
Word 6 score: [9.9177611e-01 1.3410023e-05 2.4464662e-04 7.9466430e-03 1.9266578e-05]
Word 9 score: [4.5785593e-09 1.0000000e+00 5.6898819e-11 3.7770562e-08 7.9147459e-11]
Word 10 score: [2.6881542e-02 2.8120424e-04 3.0166325e-01 3.2374393e-03 6.6793656e-01]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
------
321
here are 3 of the top rated chinese restaurants in downtown seattle : wild ginger asian restaurant , sichuan ##ese cuisine restaurant , mike ' s no ##odle house . would you like to try one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 13 score: [0.00201919 0.278365   0.15229568 0.41656232 0.15075785]
Word 14 score: [2.7417165e-01 8.7619955e-03 1.1880271e-08 8.4633268e-03 7.0860302e-01]
Word 15 score: [4.1566204e-04 2.9419232e-05 3.2198648e-03 1.3263628e-01 8.6369872e-01]
Word 16 score: [4.1783601e-13 7.2880751e-01 2.6267513e-03 2.6856577e-01 2.5539684e-15]
Word 18 score: [3.0633502e-04 9.9967444e-01 1.9250370e-05 6.1402198e-14 6.1402198e-14]
Word 19 score: [7.3031627e-04 9.9926955e-01 1.6015380e-07 5.4052696e-18 5.4052696e-18]
Word 20 score: [1.1783061e-05 9.7322422e-01 5.4272396e-06 2.6758622e-02 2.5806173e-09]
Word 21 score: [1.7873027e-13 8.3720708e-01 1.9487239e-03 1.6084419e-01 1.0028813e-15]
Word 23 score: [3.5200552e-05 2.1741039e-03 7.7697627e-02 8.4239542e-01 7.7697627e-02]
Word 24 score: [0.26966485 0.00152112 0.58637255 0.0014343  0.14100723]
Word 25 score: [9.9795544e-01 2.1330093e-06 9.1162967e-08 2.9075759e-06 2.0393820e-03]
Word 26 score: [9.0513086e-01 4.3773769e-05 8.3443570e-05 1.6798642e-08 9.4741940e-02]
Word 27 score: [9.1454029e-01 4.0267118e-05 7.9346901e-05 1.5541458e-08 8.5340142e-02]
Word 28 score: [0.00449078 0.83742344 0.00453291 0.11209346 0.0414594 ]
------
322
mike ##s no ##odle house sounds great
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O
Score: 
Word 0 score: [0.17906259 0.17906259 0.2139583  0.2139583  0.2139583 ]
Word 1 score: [5.000000e-01 5.000000e-01 8.612245e-12 8.612245e-12 8.612245e-12]
Word 2 score: [7.1331936e-01 1.3752861e-05 3.0923049e-05 7.5900859e-09 2.8663594e-01]
Word 3 score: [8.1112254e-01 1.6432654e-05 2.9770683e-05 8.3295904e-09 1.8883125e-01]
Word 4 score: [0.00777318 0.808489   0.00697387 0.08225247 0.09451143]
------
323
it looks like mike ' s no ##odle house is not currently available to be booked through our system , do you have another choice ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O
Real slot label: O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O
Score: 
Word 3 score: [0.00082383 0.01244484 0.0881725  0.81038636 0.0881725 ]
Word 4 score: [8.4682655e-01 2.5654113e-06 1.3180953e-01 4.3228100e-04 2.0928938e-02]
Word 5 score: [9.9950445e-01 7.3688170e-08 9.1859938e-08 5.6130639e-06 4.8964884e-04]
Word 6 score: [2.7190253e-01 1.6753775e-05 2.2933989e-05 7.1381772e-09 7.2805774e-01]
Word 7 score: [3.6099145e-01 2.3123157e-05 2.7093040e-05 8.7206704e-09 6.3895822e-01]
Word 8 score: [0.01299631 0.68325603 0.02064679 0.16251053 0.12059035]
------
324
how about wild ginger asian restaurant
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O B-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O B-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 2 score: [0.01805372 0.13354784 0.7419533  0.04917835 0.05726679]
Word 3 score: [8.9007783e-01 1.8476279e-03 8.1992269e-10 9.7987452e-04 1.0709467e-01]
Word 4 score: [1.4983403e-04 5.6105064e-06 1.1709112e-03 7.8538245e-01 2.1329115e-01]
------
325
great ! your reservation is confirmed !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
326
i would like a restaurant in seattle on march 24th at 7 pm for 3 people .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O B-city O B-date I-date O O O O B-numberofpeople O O
Real slot label: O O O O O O B-city O B-date I-date O O O O B-numberofpeople O O
Score: 
Word 6 score: [1.07524425e-01 5.16234082e-04 1.60121936e-02 8.75671387e-01
 2.75800499e-04]
Word 8 score: [8.7173321e-06 8.0749619e-01 1.1950437e-01 4.1296769e-02 3.1693965e-02]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
------
327
sure ! do you have a preference on cuisine or price range ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O
Score: 
------
328
no
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O
Real slot label: O
Score: 
------
329
here are three restaurants to choose from in seattle : wild ginger asian restaurant , can ##lis restaurant , sky ##city restaurant .
Predicted label: ['inform']
Real label: ['multiple_choice']
Predicted slot label: O O O O O O O O B-city O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O O O O O B-city O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 8 score: [1.7979090e-01 1.7998619e-04 3.9469220e-02 7.7932733e-01 1.2325210e-03]
Word 10 score: [0.00092463 0.30677035 0.4876568  0.09788041 0.10676783]
Word 11 score: [3.6012763e-01 3.0753538e-03 9.7400532e-10 5.4328712e-03 6.3136417e-01]
Word 12 score: [1.5400208e-03 2.5201445e-05 7.7209878e-03 4.4410738e-01 5.4660636e-01]
Word 13 score: [1.36578294e-14 6.79871738e-01 3.81376012e-03 3.16314489e-01
 7.01682673e-18]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [9.9446488e-15 6.6166556e-01 4.3259501e-03 3.3400851e-01 4.6578276e-18]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [6.8766734e-15 7.0146549e-01 3.7661027e-03 2.9476845e-01 2.8416326e-18]
------
330
sky ##city restaurant
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [1.1816131e-14 5.4401958e-01 5.0910306e-03 4.5088938e-01 3.4669108e-18]
------
331
success ! i was able to book you a table for 3 at sky ##city restaurant on 3 / 24 at 7 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O
Real slot label: O O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O
Score: 
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [2.7682417e-14 7.1824026e-01 3.1581824e-03 2.7860156e-01 5.5375838e-18]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
------
332
can i reserve a five star place for thursday night at 3 : 30 for 2 people ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O B-rating I-rating O O B-date I-date O B-starttime I-starttime I-starttime O B-numberofpeople O O
Real slot label: O O O O B-rating I-rating O O B-date I-date O B-starttime I-starttime I-starttime O B-numberofpeople O O
Score: 
Word 4 score: [1.9840647e-04 2.4038833e-09 9.9979931e-01 5.3898560e-07 1.7062309e-06]
Word 5 score: [5.7112476e-05 5.5537511e-02 4.9249914e-01 6.0149086e-05 4.5184609e-01]
Word 8 score: [0.9181072  0.02583778 0.00150328 0.01519336 0.0393584 ]
Word 9 score: [2.0650717e-11 5.0000000e-01 1.5366697e-11 5.0000000e-01 5.1998570e-14]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
------
333
i ' m happy to assist you ! what city are you dining in ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O
Score: 
------
334
seattle please
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city O
Real slot label: B-city O
Score: 
Word 0 score: [4.6863988e-01 4.8223612e-04 3.1261435e-01 2.1815759e-01 1.0594785e-04]
------
335
here are 3 of the top rated restaurants in seattle : harvest best , mk ##t . , and ii terra ##zzo carmine . would you like to try one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 19 score: [8.6255646e-01 9.8430633e-04 6.5423466e-02 7.0840493e-02 1.9530935e-04]
Word 20 score: [9.9778676e-01 7.3204586e-07 7.9231395e-06 2.2045567e-03 5.9192142e-13]
Word 21 score: [6.5430112e-02 7.4265333e-04 4.3591425e-02 8.9023107e-01 4.7849057e-06]
Word 22 score: [2.2524082e-04 2.8443741e-04 7.1822661e-03 1.4387770e-03 9.9086928e-01]
------
336
harvest best
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname
Score: 
Word 0 score: [0.02127477 0.00897165 0.16369122 0.00091053 0.8051518 ]
Word 1 score: [9.9999952e-01 7.7247830e-10 4.2631558e-19 9.2500031e-08 3.0657856e-07]
------
337
your reservation has been confirmed . please enjoy your meal , and thank you for using our service !
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O B-closing I-closing I-closing O O O O O O O O O
Real slot label: O O O O O O O B-closing I-closing I-closing O O O O O O O O O
Score: 
Word 7 score: [1.3287681e-02 3.6039557e-02 9.4891536e-01 1.7554958e-03 1.9283705e-06]
Word 8 score: [1.5546512e-03 9.9762160e-01 8.2370127e-04 5.0042002e-16 5.0042002e-16]
Word 9 score: [4.3908670e-07 2.2726842e-06 8.1367316e-06 4.4051239e-01 5.5947673e-01]
------
338
please book a table for 4 in seattle for tomorrow at 8 : 30 pm at the back ##door under the name beau ren ##fr ##o
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O O B-restaurantname I-restaurantname O O O B-personfullname I-personfullname I-personfullname I-personfullname
Real slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O O B-restaurantname I-restaurantname O O O B-personfullname I-personfullname I-personfullname I-personfullname
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [8.7345213e-02 9.4614958e-04 6.9680226e-01 2.1484390e-01 6.2505278e-05]
Word 9 score: [7.2410816e-01 2.4371958e-01 1.6523199e-08 6.6347525e-07 3.2171521e-02]
Word 17 score: [1.6000447e-01 1.9688005e-06 8.3998966e-01 1.9688005e-06 1.9688005e-06]
Word 18 score: [2.9894575e-02 3.0541897e-04 9.6918911e-01 3.0541897e-04 3.0541897e-04]
Word 22 score: [2.3210926e-03 3.8970518e-04 1.8426102e-01 7.7690065e-01 3.6127493e-02]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
------
339
success ! your reservation has been confirmed . please enjoy your meal !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O B-closing I-closing I-closing O
Real slot label: O O O O O O O O O B-closing I-closing I-closing O
Score: 
Word 9 score: [2.9296679e-03 3.1680182e-02 9.6420735e-01 1.1828173e-03 7.0784423e-09]
Word 10 score: [4.0898345e-07 9.9539655e-01 4.6030814e-03 4.6271301e-18 4.6271301e-18]
Word 11 score: [5.3571392e-05 1.8429606e-05 9.2574401e-04 6.8260324e-01 3.1639907e-01]
------
340
i ' m looking for the best mexican food in los angeles for tomorrow around 5 ##pm . i have 3 people in total
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O B-cuisine I-cuisine O B-city I-city O B-date O B-starttime I-starttime O O O B-numberofpeople O O O
Real slot label: O O O O O O O B-cuisine I-cuisine O B-city I-city O B-date O B-starttime I-starttime O O O B-numberofpeople O O O
Score: 
Word 7 score: [4.3856839e-05 1.3287601e-01 6.4591044e-03 4.4745620e-06 8.6061668e-01]
Word 8 score: [1.1598400e-04 3.4050035e-07 9.9731725e-01 2.4976956e-03 6.8729256e-05]
Word 10 score: [7.3662915e-05 6.1134560e-05 1.9394182e-02 9.8855380e-06 9.8046118e-01]
Word 11 score: [4.0080827e-01 6.2525459e-04 5.9856647e-01 6.2356691e-12 6.2356691e-12]
Word 13 score: [5.8407843e-01 2.4436361e-01 1.0582870e-06 1.7762712e-05 1.7153917e-01]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
------
341
here are 3 of the top rated mexican places in la : the tal ##pa restaurant , border grill , gr ##ac ##ias mad ##re . would you like to try one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 12 score: [2.1026289e-02 3.6077034e-03 9.7531271e-01 2.6398022e-05 2.6908307e-05]
Word 13 score: [0.45897967 0.0204857  0.00096766 0.00096766 0.51859933]
Word 14 score: [9.9988306e-01 2.2599575e-06 5.7294877e-05 5.7294877e-05 1.4682566e-09]
Word 15 score: [5.3848126e-13 9.1617650e-01 1.2143112e-03 8.2609206e-02 1.5188000e-14]
Word 17 score: [4.1469738e-01 8.2433558e-05 5.7033777e-01 9.1612814e-03 5.7211309e-03]
Word 18 score: [1.0896333e-14 8.3217008e-18 8.4722154e-03 1.8370368e-13 9.9152786e-01]
Word 20 score: [3.7940744e-02 3.0069137e-01 6.5879911e-01 2.2859408e-03 2.8289569e-04]
Word 21 score: [1.6875126e-04 1.5712031e-06 2.9277587e-08 9.9450630e-01 5.3234263e-03]
Word 22 score: [2.1189191e-04 8.4265406e-07 2.7002696e-05 2.1841662e-02 9.7791845e-01]
Word 23 score: [5.0383085e-07 4.9999976e-01 4.9999976e-01 7.7316965e-11 6.6603223e-11]
Word 24 score: [1.1564359e-06 4.9999940e-01 4.9999940e-01 7.8579726e-11 5.4179813e-11]
------
342
border grill sounds good to me
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname O O O O
Real slot label: B-restaurantname I-restaurantname O O O O
Score: 
Word 0 score: [8.1053156e-05 3.1073987e-02 2.4742961e-02 9.3662119e-01 7.4808528e-03]
Word 1 score: [9.2618969e-19 6.8160637e-22 1.6914214e-03 2.2842684e-17 9.9830854e-01]
------
343
your reservation at border grill for 5 ##pm on 03 / 08 / 2016 for 3 has been confirmed , enjoy your meal !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O B-restaurantname I-restaurantname O B-starttime I-starttime O B-date I-date I-date I-date I-date O B-numberofpeople O O O O O O O O
Real slot label: O O O B-restaurantname I-restaurantname O B-starttime I-starttime O B-date I-date I-date I-date I-date O B-numberofpeople O O O O O O O O
Score: 
Word 3 score: [9.7028369e-01 5.7114244e-06 2.6683118e-02 3.0045975e-03 2.2926957e-05]
Word 4 score: [1.5280883e-18 3.6577398e-21 7.7391608e-04 5.2446603e-17 9.9922609e-01]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
------
344
hi im looking for a vega ##n rest ##era ##unt located in la ##rgo florida
Predicted label: ['request', 'greeting']
Real label: ['request', 'greeting']
Predicted slot label: B-greeting O O O O O O O O O O O B-city I-city B-state
Real slot label: B-greeting O O O O O O O O O O O B-city I-city B-state
Score: 
Word 0 score: [8.4027142e-06 2.3708500e-01 1.3386598e-02 2.3708500e-01 5.1243496e-01]
Word 12 score: [4.9997753e-01 4.9997753e-01 3.5748033e-07 1.6549263e-08 4.4556618e-05]
Word 13 score: [4.99970615e-01 4.99970615e-01 5.32926094e-08 1.36428095e-08
 5.86799106e-05]
Word 14 score: [1.3309943e-11 5.8848229e-03 4.9705747e-01 2.5803058e-07 4.9705747e-01]
------
345
on what date would you like to make the reservation ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
346
hello
Predicted label: ['inform']
Real label: ['greeting']
Predicted slot label: B-greeting
Real slot label: B-greeting
Score: 
Word 0 score: [9.6869074e-02 8.9725631e-01 5.8493973e-03 1.2623526e-05 1.2623526e-05]
------
347
hi . on what date would like to make a reservation ?
Predicted label: ['request']
Real label: ['request', 'greeting']
Predicted slot label: B-greeting O O O O O O O O O O O
Real slot label: B-greeting O O O O O O O O O O O
Score: 
Word 0 score: [1.00661855e-04 3.67521867e-02 2.90347598e-02 3.67521867e-02
 8.97360146e-01]
------
348
i am looking for a mexican restaurant in seattle for this friday night . party of 2 , 7 ##pm
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-cuisine O O B-city O O B-date I-date O O O B-numberofpeople O B-starttime I-starttime
Real slot label: O O O O O B-cuisine O O B-city O O B-date I-date O O O B-numberofpeople O B-starttime I-starttime
Score: 
Word 5 score: [2.0278734e-05 1.9831738e-01 2.7521960e-03 4.8302536e-07 7.9890972e-01]
Word 8 score: [7.0733100e-02 1.2909900e-04 4.3846381e-01 4.8751736e-01 3.1566760e-03]
Word 11 score: [3.7371312e-06 3.8989032e-07 6.5579161e-07 9.9647021e-01 3.5250746e-03]
Word 12 score: [5.1294400e-08 4.9999994e-01 2.0602002e-08 4.9999994e-01 2.4597770e-11]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
------
349
hello . do you have a price range in mind ?
Predicted label: ['request', 'greeting']
Real label: ['request', 'greeting']
Predicted slot label: B-greeting O O O O O O O O O O
Real slot label: B-greeting O O O O O O O O O O
Score: 
Word 0 score: [2.7517199e-03 9.9635518e-01 8.9189905e-04 5.8794137e-07 5.8794137e-07]
------
350
$ 30 a plate or less
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-pricing I-pricing I-pricing I-pricing I-pricing I-pricing
Real slot label: B-pricing I-pricing I-pricing I-pricing I-pricing I-pricing
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [7.2770848e-07 7.2185166e-02 1.8069678e-04 9.4010810e-10 9.2763335e-01]
Word 3 score: [4.4956396e-04 9.8440731e-01 7.7600975e-04 1.4314287e-02 5.2810545e-05]
Word 4 score: [4.9155601e-04 9.9948186e-01 2.6117022e-10 2.6464450e-08 2.6630167e-05]
Word 5 score: [2.0362782e-07 6.5499282e-01 4.0346464e-09 3.4500691e-01 2.7807230e-09]
------
351
here are three restaurants that i found . do any of these interest you : 1 ) barrio mexican kitchen & bar , 2 ) fog ##on co ##cina mexican ##a , or 3 ) ag ##ave co ##cina & tequila ##s ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 17 score: [2.1768900e-02 8.9696819e-05 7.9032928e-03 1.0766994e-06 9.7023702e-01]
Word 18 score: [3.8793474e-04 1.1698093e-01 6.3169906e-03 1.1515033e-02 8.6479914e-01]
Word 19 score: [1.83042123e-11 9.99891639e-01 1.08395696e-04 6.98915592e-10
 6.73070655e-10]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [1.2678091e-01 2.9254586e-06 1.3740926e-05 1.4501193e-01 7.2819048e-01]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
Word 26 score: [0.2 0.2 0.2 0.2 0.2]
Word 27 score: [0.2 0.2 0.2 0.2 0.2]
Word 28 score: [0.2 0.2 0.2 0.2 0.2]
Word 29 score: [7.3611987e-01 1.9327730e-05 2.5868988e-01 5.5660622e-04 4.6143159e-03]
Word 30 score: [6.7094004e-01 1.9838129e-05 3.2334021e-01 5.1440223e-04 5.1855370e-03]
Word 35 score: [4.7378670e-03 4.8540076e-03 3.7944110e-04 9.9002868e-01 4.2026858e-08]
Word 36 score: [9.0006151e-04 9.9533099e-01 1.3681240e-05 3.7552523e-03 1.3657379e-13]
Word 37 score: [0.2 0.2 0.2 0.2 0.2]
Word 38 score: [0.2 0.2 0.2 0.2 0.2]
Word 39 score: [0.2 0.2 0.2 0.2 0.2]
Word 40 score: [1.000000e+00 7.866744e-09 7.866744e-09 7.866744e-09 7.866744e-09]
Word 41 score: [1.000000e+00 9.423218e-09 9.423218e-09 9.423218e-09 9.423218e-09]
------
352
ag ##ave co ##cina & tequila ##s sounds good
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O
Score: 
Word 0 score: [3.4606925e-01 1.6513835e-07 1.8735241e-02 1.6211915e-06 6.3519365e-01]
Word 1 score: [5.8832072e-04 9.8977381e-01 5.2204159e-06 9.6327001e-03 1.4125093e-14]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [1.0000000e+00 4.3115383e-10 4.3115383e-10 4.3115383e-10 4.3115383e-10]
Word 6 score: [1.000000e+00 3.400892e-10 3.400892e-10 3.400892e-10 3.400892e-10]
------
353
success ! i have booked a table for 2 at ag ##ave co ##cina and tequila ##s on friday at 7 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date O B-starttime I-starttime O
Real slot label: O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date O B-starttime I-starttime O
Score: 
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [1.8956748e-04 9.4883493e-04 8.2294582e-06 9.9885333e-01 4.2688710e-09]
Word 11 score: [9.3140913e-04 9.8803049e-01 8.7467834e-06 1.1029374e-02 3.8579118e-14]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.4074315  0.02297252 0.0132807  0.02403178 0.53228354]
Word 15 score: [1.0000000e+00 3.8200954e-10 3.8200954e-10 3.8200954e-10 3.8200954e-10]
Word 16 score: [1.0000000e+00 1.3688691e-13 1.3688691e-13 1.3688691e-13 1.3688691e-13]
Word 18 score: [3.1166445e-02 2.7849557e-04 1.5045036e-05 9.6743172e-01 1.1082951e-03]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
------
354
hi there . i really want some exotic food . somewhere in los angeles .
Predicted label: ['request', 'greeting']
Real label: ['request', 'greeting']
Predicted slot label: B-greeting I-greeting O O O O O B-cuisine O O O O B-city I-city O
Real slot label: B-greeting I-greeting O O O O O B-cuisine O O O O B-city I-city O
Score: 
Word 0 score: [2.0492684e-05 1.6454777e-01 2.2039253e-02 1.6454777e-01 6.4884466e-01]
Word 1 score: [0.1956526  0.00853158 0.1956526  0.40451068 0.1956526 ]
Word 7 score: [5.1529425e-01 4.8440668e-01 1.8557909e-04 1.0810742e-04 5.3231420e-06]
Word 12 score: [1.63933764e-05 1.06197534e-04 1.43074796e-01 9.07063531e-06
 8.56793404e-01]
Word 13 score: [9.6851069e-01 4.4181705e-03 2.7071238e-02 2.1100977e-12 2.1100977e-12]
------
355
what date were you looking to book ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
356
saturday around 6 ##pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date B-starttime I-starttime I-starttime
Real slot label: B-date B-starttime I-starttime I-starttime
Score: 
Word 0 score: [5.4153670e-02 1.8482204e-01 1.2364450e-06 7.6101768e-01 5.3602594e-06]
Word 1 score: [0.00932834 0.02890642 0.31598717 0.31598717 0.32979086]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
------
357
how many are going ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
358
just 2
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O B-numberofpeople
Real slot label: O B-numberofpeople
Score: 
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
------
359
some good choices are : animal , tara ' s himalayan cuisine and gen ##wa korean bb ##q . would you like to try one of these ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O B-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O B-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 5 score: [8.4395322e-15 4.4684313e-12 1.5389364e-07 7.8311873e-09 9.9999988e-01]
Word 7 score: [1.2337939e-02 1.1744437e-02 1.4441647e-04 6.2974244e-02 9.1279906e-01]
Word 8 score: [0.42656526 0.01016225 0.24643761 0.00434447 0.3124904 ]
Word 9 score: [9.9810541e-01 6.7054398e-06 7.7794247e-08 6.3382922e-06 1.8813729e-03]
Word 10 score: [0.07103631 0.21255675 0.0831678  0.6325724  0.00066674]
Word 11 score: [4.9945288e-06 9.9018002e-01 1.6490056e-06 9.8134214e-03 6.7369721e-10]
Word 13 score: [5.27830445e-04 1.15454175e-04 9.99356687e-01 1.41650043e-08
 1.41650043e-08]
Word 14 score: [4.428052e-06 9.904389e-01 9.556721e-03 6.456398e-13 6.456398e-13]
Word 15 score: [0.49358127 0.01063745 0.49358127 0.00059437 0.00160554]
Word 16 score: [5.8100708e-11 1.2018761e-16 9.8540628e-01 1.4593377e-02 4.0551089e-07]
Word 17 score: [5.02043546e-11 9.30470192e-17 9.86021101e-01 1.39784245e-02
 4.99111479e-07]
------
360
animal sounds fun !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname O O O
Real slot label: B-restaurantname O O O
Score: 
Word 0 score: [2.0541492e-07 7.7037548e-05 2.0493087e-03 6.4579412e-02 9.3329400e-01]
------
361
i ' m sorry , i ' m unable to book that restaurant at this time . i apologize . would you like to try a different one ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
362
any of the others that have tables
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
363
unfortunately , all of those restaurants are unavailable for online booking at this time . however , the following do have tables at that time : 1 ) on ##yx ( ja ##pen ##ese food ) , 2 ) bang na ( thai ) , and 3 ) buenos aires grill ( argentine ##an ) . would you like
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
364
1
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-choice
Real slot label: B-choice
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
365
i ' ve booked you at on ##xy for the 12th and 6 ##pm . thank you .
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O O O B-date O B-starttime I-starttime O B-closing I-closing O
Real slot label: O O O O O O O O O O B-date O B-starttime I-starttime O B-closing I-closing O
Score: 
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [1.4301982e-03 1.4534659e-07 9.9849796e-01 1.6130379e-10 7.1732102e-05]
Word 16 score: [3.8722900e-01 1.7236867e-03 4.5217264e-02 2.8344450e-04 5.6554663e-01]
------
366
i would like a restaurant in seattle on march 21st at 9 pm for 3 people .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O B-city O B-date I-date O O O O B-numberofpeople O O
Real slot label: O O O O O O B-city O B-date I-date O O O O B-numberofpeople O O
Score: 
Word 6 score: [1.3766915e-01 6.7655707e-04 2.9472064e-02 8.3178556e-01 3.9671140e-04]
Word 8 score: [8.0352265e-06 8.3030671e-01 1.0288843e-01 3.9184701e-02 2.7612088e-02]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
------
367
is there a certain type of cuisine you are interested in ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O
Score: 
------
368
family friendly
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restauranttype I-restauranttype
Real slot label: B-restauranttype I-restauranttype
Score: 
Word 0 score: [6.3369989e-05 4.9379130e-04 9.9913257e-01 7.2874482e-06 3.0299876e-04]
Word 1 score: [8.9398411e-05 8.5720646e-01 1.3933480e-01 1.0865543e-06 3.3682303e-03]
------
369
sure ! i ' ve found the following options : 1 ) 520 bar & grill , 2 ) aqua terra , and 3 ) the back ##door . would you like to book one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname O O O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname O O O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [5.5956298e-01 1.0603231e-05 1.4492036e-02 1.4353453e-01 2.8239986e-01]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [1.1637809e-16 1.1465552e-17 1.0537565e-03 2.1405802e-14 9.9894625e-01]
Word 19 score: [1.3077942e-05 2.2413954e-06 1.0531880e-08 4.2488301e-07 9.9998426e-01]
Word 20 score: [2.4416915e-03 3.0435256e-03 1.2663857e-02 1.9887601e-04 9.8165202e-01]
Word 25 score: [4.1013390e-02 7.0130453e-03 9.5193851e-01 9.4028774e-06 2.5637839e-05]
Word 26 score: [2.3137823e-01 1.3405249e-05 7.6858145e-01 1.3405249e-05 1.3405249e-05]
Word 27 score: [0.08363157 0.00783532 0.89286244 0.00783532 0.00783532]
------
370
please book 520 bar & grill
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [3.31236959e-01 4.34906178e-06 1.01930415e-02 6.73484132e-02
 5.91217220e-01]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [2.1371289e-18 4.0886116e-19 6.3632225e-04 2.3648125e-16 9.9936372e-01]
------
371
success ! i was able to book you a table for 3 at 520 bar & grill on 3 / 21 at 9 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O
Real slot label: O O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O
Score: 
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [4.1933614e-01 3.5712533e-06 5.4311841e-03 1.2414670e-01 4.5108235e-01]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [3.4500489e-18 1.1342602e-18 5.8166409e-04 5.2180898e-16 9.9941838e-01]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
------
372
where should i book a birthday dinner ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-occasion B-mealtype O
Real slot label: O O O O O B-occasion B-mealtype O
Score: 
Word 5 score: [3.4197283e-04 9.9763620e-01 2.0698190e-04 4.6009245e-07 1.8143387e-03]
Word 6 score: [9.9997485e-01 1.4971951e-06 4.3520564e-13 2.3700162e-05 9.9677677e-10]
------
373
could you please provide your location ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
374
nashville tn
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city B-state
Real slot label: B-city B-state
Score: 
Word 0 score: [8.3206040e-01 3.9332915e-02 5.4023225e-05 6.6967485e-03 1.2185590e-01]
Word 1 score: [3.6525188e-07 9.9730945e-01 7.6382570e-08 5.1842135e-06 2.6848949e-03]
------
375
i ' m happy to assist you ! what time and date would you like your reservation for ?
Predicted label: ['request']
Real label: ['request', 'greeting']
Predicted slot label: B-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting O O O O O O O O O O O O
Real slot label: B-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting O O O O O O O O O O O O
Score: 
Word 0 score: [9.4714183e-01 2.3634774e-07 2.0403666e-03 1.8867554e-02 3.1950068e-02]
Word 1 score: [1.5522779e-09 9.1812098e-01 3.2054490e-04 8.1558466e-02 1.1539406e-08]
Word 2 score: [2.9397287e-09 9.3531036e-01 2.4104032e-03 6.2279172e-02 4.5289958e-08]
Word 3 score: [3.8986313e-03 7.5971760e-02 1.6971453e-04 1.5656987e-01 7.6339000e-01]
Word 4 score: [1.3022205e-05 6.6080203e-05 9.8828566e-01 8.5518366e-09 1.1635203e-02]
Word 5 score: [0.4803374  0.11434372 0.39597332 0.0021153  0.00723025]
Word 6 score: [0.03287615 0.00175181 0.00681458 0.01407544 0.944482  ]
------
376
march 16th at 8 pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date I-date O B-starttime I-starttime
Real slot label: B-date I-date O B-starttime I-starttime
Score: 
Word 0 score: [1.2024418e-05 2.2088962e-02 4.5386972e-03 4.2863005e-01 5.4473025e-01]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [3.7032933e-07 1.3344681e-01 8.6654866e-01 4.1030153e-06 9.1974578e-10]
------
377
how many guests are in your party ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
378
8
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
379
would you like a specific cuisine ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
380
no preference
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-cuisine I-cuisine
Real slot label: B-cuisine I-cuisine
Score: 
Word 0 score: [2.0834225e-01 2.0284439e-05 7.8548849e-01 5.8776839e-03 2.7134779e-04]
Word 1 score: [6.6940463e-01 1.0244659e-06 2.0009932e-01 9.6474178e-03 1.2084757e-01]
------
381
mag ##gia ##no ' s - nashville , anatolia turkish restaurant , and sam ##bu ##ca restaurant are the top 3 restaurants with available seating . may i book one of these options for you ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-rating I-rating O O O O O O O O O O O O O O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-rating I-rating O O O O O O O O O O O O O O O
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [9.9846137e-01 1.0415764e-06 7.3394105e-08 2.2730667e-06 1.5352388e-03]
Word 4 score: [9.9803990e-01 1.5387416e-06 9.0113836e-08 2.8503014e-06 1.9555781e-03]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.00150064 0.8506743  0.00110978 0.00758641 0.13912885]
Word 8 score: [1.3431105e-04 8.5657384e-06 9.9316436e-01 3.3463961e-03 3.3463961e-03]
Word 9 score: [1.9830186e-09 7.0218366e-01 2.6679591e-06 2.9781365e-01 1.6884634e-10]
Word 10 score: [2.9943699e-13 8.6142576e-01 2.0994840e-03 1.3647476e-01 1.8908734e-15]
Word 13 score: [0.9327111  0.01386224 0.004096   0.04617798 0.00315264]
Word 14 score: [1.2760456e-08 9.9915290e-01 3.6224630e-08 8.4665808e-04 4.3430717e-07]
Word 15 score: [1.0778207e-03 4.6830586e-01 1.0296927e-04 5.3047591e-01 3.7498743e-05]
Word 16 score: [3.2428918e-13 8.3015293e-01 2.2821757e-03 1.6756496e-01 1.3999355e-15]
Word 19 score: [8.5637948e-05 5.8354912e-05 3.8555677e-07 4.9992782e-01 4.9992782e-01]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
------
382
sam ##bu ##ca restaurant
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [7.4373193e-02 5.4528689e-01 9.4406269e-03 3.7063947e-01 2.5975271e-04]
Word 1 score: [8.9408712e-09 9.9902785e-01 2.0685905e-08 9.7135641e-04 8.4728583e-07]
Word 2 score: [2.0133913e-04 4.3812397e-01 2.3776671e-05 5.6161571e-01 3.5275527e-05]
Word 3 score: [4.8963454e-14 7.9069030e-01 2.3877858e-03 2.0692194e-01 2.2958919e-17]
------
383
thank you so much for booking with us ! your reservation has been confirmed as requested . enjoy your meal !
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: B-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing O O O O O O O O O B-closing I-closing I-closing O
Real slot label: B-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing O O O O O O O O O B-closing I-closing I-closing O
Score: 
Word 0 score: [9.5695235e-02 4.2220861e-05 8.9132255e-01 1.0814615e-02 2.1254059e-03]
Word 1 score: [8.88687551e-01 4.96208528e-03 3.53228254e-03 7.57098969e-05
 1.02742456e-01]
Word 2 score: [8.4712690e-01 1.3808590e-05 4.9923104e-04 7.7645149e-05 1.5228237e-01]
Word 3 score: [1.1010881e-02 1.9101385e-07 6.2791673e-07 9.8889434e-01 9.3854942e-05]
Word 4 score: [3.2100427e-08 1.0354960e-06 2.3952913e-07 9.9987984e-01 1.1876991e-04]
Word 5 score: [0.00263318 0.8641403  0.06026665 0.0126932  0.06026665]
Word 6 score: [9.9994349e-01 3.3690849e-06 2.1880651e-06 5.0946990e-05 2.4338755e-08]
Word 7 score: [0.34351975 0.01673194 0.00177279 0.08110419 0.5568713 ]
Word 17 score: [6.2810853e-02 1.8208433e-02 9.1065311e-01 6.7131332e-05 8.2604382e-03]
Word 18 score: [2.3209230e-05 9.9544322e-01 4.5335726e-03 2.2683898e-18 2.2683898e-18]
Word 19 score: [3.3425396e-05 1.1826416e-05 7.5075473e-04 7.2897446e-01 2.7022958e-01]
------
384
can you book the hard rock cafe at 7 pm on march 14th for 2 people in seattle ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O B-date I-date O B-numberofpeople O O B-city O
Real slot label: O O O O O O O O O O O B-date I-date O B-numberofpeople O O B-city O
Score: 
Word 11 score: [1.2371976e-05 8.6650544e-01 4.8459429e-02 4.4117257e-02 4.0905509e-02]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [7.6757841e-02 1.7373273e-04 3.4385720e-01 5.7910061e-01 1.1057645e-04]
------
385
what name would you like to book the reservation under ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
386
chevy chase
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname I-personfullname
Real slot label: B-personfullname I-personfullname
Score: 
Word 0 score: [0.130912   0.6333309  0.23134984 0.00127431 0.00313305]
Word 1 score: [2.1069307e-02 2.0315145e-08 8.9282281e-08 9.7870523e-01 2.2540668e-04]
------
387
hi . i ' ve booked your restaurant for tomorrow . thank you .
Predicted label: ['inform', 'greeting', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O O B-date O O O O
Real slot label: O O O O O O O O O B-date O O O O
Score: 
Word 9 score: [2.0680098e-01 7.9291546e-01 1.4193409e-08 1.0198532e-06 2.8242316e-04]
------
388
i would like a restaurant in seattle on march 21st at 7 pm for 3 people .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O B-city O B-date I-date O O O O B-numberofpeople O O
Real slot label: O O O O O O B-city O B-date I-date O O O O B-numberofpeople O O
Score: 
Word 6 score: [1.2515698e-01 7.5916830e-04 1.3423050e-02 8.6045355e-01 2.0727368e-04]
Word 8 score: [9.8280916e-06 8.0569255e-01 1.2208114e-01 4.4071052e-02 2.8145444e-02]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
------
389
is there a specific type of cuisine you would like ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
390
no
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O
Real slot label: O
Score: 
------
391
here are three restaurants that i found . do any of these interest you : 1 ) the pink door , 2 ) wild ginger asian restaurant , or 3 ) barrio mexican kitchen & bar ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 17 score: [1.1358147e-02 1.1746222e-03 9.8742199e-01 3.2440184e-05 1.2798330e-05]
Word 18 score: [5.2059781e-06 5.6811987e-06 9.9990451e-01 8.4557025e-05 2.2620691e-08]
Word 19 score: [5.5329065e-04 9.9944609e-01 2.5685535e-08 2.1485017e-07 3.5545750e-07]
Word 23 score: [4.8615056e-04 1.5329778e-01 5.5559602e-02 6.1060190e-01 1.8005450e-01]
Word 24 score: [2.4511448e-01 6.4507626e-02 2.4330307e-08 1.2105237e-02 6.7827272e-01]
Word 25 score: [1.0300616e-03 1.7406691e-04 7.9023791e-03 2.5959665e-01 7.3129684e-01]
Word 26 score: [5.2637135e-09 3.5180580e-02 1.9317560e-02 9.4550186e-01 1.3069833e-11]
Word 31 score: [1.36134863e-01 5.21388836e-04 1.36087816e-02 1.35781265e-05
 8.49721491e-01]
Word 32 score: [1.5607830e-04 4.0469542e-02 5.7527018e-03 4.3433219e-02 9.1018844e-01]
Word 33 score: [2.9431575e-07 9.9933618e-01 6.6027866e-04 3.1118851e-08 3.2011767e-06]
Word 34 score: [0.2 0.2 0.2 0.2 0.2]
Word 35 score: [3.4435043e-01 5.9982049e-05 1.1646202e-04 5.3437030e-01 1.2110279e-01]
------
392
the pink door
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [9.3488133e-01 5.7967387e-02 4.5638226e-05 1.3098910e-05 7.0925080e-03]
Word 1 score: [5.2864820e-04 3.6919000e-06 9.9876440e-01 7.0289039e-04 2.9678026e-07]
Word 2 score: [4.8394127e-06 9.9999511e-01 1.0466302e-10 1.4629585e-09 1.0603713e-08]
------
393
hi . i ' ve booked your restaurant for tomorrow . thank you .
Predicted label: ['inform']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O O B-date O O O O
Real slot label: O O O O O O O O O B-date O O O O
Score: 
Word 9 score: [1.7809352e-01 8.2179523e-01 4.8213726e-09 3.5420484e-07 1.1086889e-04]
------
394
trying to find a nice restaurant in baton rouge , la for my parent ' s anniversary . nice , but not overly expensive .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O B-city I-city O B-state O O O O O B-occasion O O O O B-pricing I-pricing I-pricing O
Real slot label: O O O O O O O B-city I-city O B-state O O O O O B-occasion O O O O B-pricing I-pricing I-pricing O
Score: 
Word 7 score: [3.1273463e-05 5.6049320e-08 5.6947305e-11 1.0861078e-08 9.9996865e-01]
Word 8 score: [9.9056870e-01 9.5153885e-11 3.9857487e-06 2.6261148e-03 6.8011866e-03]
Word 10 score: [8.4089959e-01 8.3772495e-05 7.7134078e-05 1.3512959e-02 1.4542659e-01]
Word 16 score: [5.2139819e-01 3.0002722e-01 1.6730174e-01 1.6049024e-05 1.1256747e-02]
Word 21 score: [2.2744898e-11 9.9999547e-01 1.6289203e-09 3.4703753e-06 1.0845791e-06]
Word 22 score: [9.9389851e-01 6.0033938e-03 9.8124139e-05 2.4694085e-08 2.4694085e-08]
Word 23 score: [1.2611551e-02 5.6888592e-01 7.4871616e-03 4.1101259e-01 2.7908684e-06]
------
395
what date are you looking to book ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
396
43 ##18 ##4
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O
Real slot label: O O O
Score: 
------
397
at what time would you like to book ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
398
anytime after 6 ##pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-starttime I-starttime I-starttime I-starttime
Real slot label: B-starttime I-starttime I-starttime I-starttime
Score: 
Word 0 score: [1.2910611e-04 2.0086395e-02 3.2659483e-01 3.2659483e-01 3.2659483e-01]
Word 1 score: [3.4554859e-04 3.1743377e-01 3.1743377e-01 3.6462194e-01 1.6496074e-04]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
------
399
how many guests will you have ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
400
it ' ll be just the two of them .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
401
would you like a specific cuisine ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
402
not anything overly ethnic . chinese is fine , mexican is fine , various european is fine , but like japanese and indian and thai and such , those are out . steak , seafood , italian ( though that ' s kinda over ##don ##e ) . . . they ' re 60 . it ' s their
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-cuisine I-cuisine I-cuisine I-cuisine O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: B-cuisine I-cuisine I-cuisine I-cuisine O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
Word 0 score: [7.3521514e-06 9.9445927e-01 1.0271594e-06 5.3333272e-03 1.9906461e-04]
Word 1 score: [2.8727279e-10 1.1663895e-08 1.7773422e-11 1.6142040e-07 9.9999988e-01]
Word 2 score: [9.9182653e-01 7.9292944e-03 2.3992600e-04 2.1767296e-06 2.1767296e-06]
Word 3 score: [1.5034531e-04 7.1233124e-05 5.6530500e-04 9.9921286e-01 1.8895032e-07]
------
403
here are some great options for you : 18 steak , beau ##sol ##eil restaurant , and ju ##ban ' s creole restaurant . would you like to book one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O B-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O O B-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [9.8487389e-01 6.8342882e-09 3.2203756e-12 1.9230944e-09 1.5126124e-02]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [1.6852654e-13 6.7856151e-01 2.7716244e-03 3.1866688e-01 2.9023250e-16]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [9.9877447e-01 6.2637093e-07 1.2759645e-07 2.5110835e-06 1.2223598e-03]
Word 20 score: [9.9805558e-01 2.0091961e-06 1.1943683e-07 3.7105776e-06 1.9386736e-03]
Word 21 score: [9.6539092e-01 2.1007493e-02 4.1509815e-03 3.2453520e-06 9.4474955e-03]
Word 22 score: [1.4729495e-13 6.8859071e-01 3.0869276e-03 3.0832240e-01 1.5901496e-16]
------
404
i need to make a reservation for a first date .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
405
what city are you in ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O
Real slot label: O O O O O O
Score: 
------
406
boston .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city O
Real slot label: B-city O
Score: 
Word 0 score: [8.9322382e-01 5.9433745e-07 4.9767807e-02 5.4514757e-04 5.6462578e-02]
------
407
on what date would like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
408
friday .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date O
Real slot label: B-date O
Score: 
Word 0 score: [9.6209848e-01 1.5661284e-02 2.1181390e-02 1.8588027e-04 8.7296451e-04]
------
409
at what time would you like to din ##e ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
410
8 ##pm . 2 people .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-starttime I-starttime O B-numberofpeople O O
Real slot label: B-starttime I-starttime O B-numberofpeople O O
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
------
411
what type of cuisine would you like ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
412
italian .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-cuisine O
Real slot label: B-cuisine O
Score: 
Word 0 score: [9.9998999e-01 8.9797737e-07 1.3528640e-09 3.0362148e-09 9.0426829e-06]
------
413
i ' ve found a few options for you ! eun ##o ri ##stor ##ante . al dent ##e , and amelia ' s tr ##att ##oria . would you like to book one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 10 score: [9.9614489e-01 3.6049958e-06 3.1319838e-03 1.1192560e-09 7.1944657e-04]
Word 11 score: [4.9054429e-01 1.7750838e-07 5.0706273e-01 6.1634942e-08 2.3927037e-03]
Word 12 score: [9.9554116e-01 4.4545946e-03 1.4098359e-06 1.4098359e-06 1.4098359e-06]
Word 13 score: [9.9653590e-01 3.4593905e-03 1.5874754e-06 1.5874754e-06 1.5874754e-06]
Word 14 score: [9.9666923e-01 3.3210851e-03 3.2579505e-06 3.2579505e-06 3.2579505e-06]
Word 16 score: [6.8100344e-04 2.2151532e-04 8.2037723e-01 8.3046662e-06 1.7871198e-01]
Word 17 score: [6.0403405e-11 9.9999261e-01 2.6819498e-07 1.3901181e-06 5.6406134e-06]
Word 18 score: [1.5350131e-12 6.3262759e-03 3.8300045e-02 9.5524836e-01 1.2525120e-04]
Word 21 score: [0.01311422 0.8679377  0.00900668 0.07667851 0.03326291]
Word 22 score: [8.3076543e-01 1.3118218e-05 1.2692563e-01 1.7827773e-04 4.2117506e-02]
Word 23 score: [9.9924672e-01 4.5167019e-07 3.3939806e-08 1.2110420e-06 7.5163879e-04]
Word 24 score: [1.0000000e+00 4.1510463e-12 4.1510463e-12 4.1510463e-12 4.1510463e-12]
Word 25 score: [1.000000e+00 3.421414e-13 3.421414e-13 3.421414e-13 3.421414e-13]
Word 26 score: [1.000000e+00 2.445557e-13 2.445557e-13 2.445557e-13 2.445557e-13]
------
414
eun ##o ri ##stor ##ante
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [6.5631834e-03 3.3437280e-04 1.0314977e-04 1.7135673e-03 9.9128574e-01]
Word 1 score: [4.3527645e-01 6.8782441e-08 5.6344652e-01 8.2261806e-09 1.2769675e-03]
Word 2 score: [9.9101454e-01 8.9854626e-03 3.6067014e-09 3.6067014e-09 3.6067014e-09]
Word 3 score: [9.9178195e-01 8.2180137e-03 2.2765274e-09 2.2765274e-09 2.2765274e-09]
Word 4 score: [9.9236333e-01 7.6367222e-03 4.0224544e-09 4.0224544e-09 4.0224544e-09]
------
415
and what name should be on the reservation ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
416
mike .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname O
Real slot label: B-personfullname O
Score: 
Word 0 score: [1.3715371e-07 3.7110135e-01 3.0414435e-01 2.0609772e-02 3.0414435e-01]
------
417
i found a couple of options for you : 22 broad street , 350 grill , and a man ##o italian kitchen . would you like to book one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.37826908 0.00699432 0.04354089 0.28559786 0.28559786]
Word 11 score: [2.9004023e-06 4.4285423e-07 3.8920367e-05 9.9764603e-01 2.3116476e-03]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [1.4250850e-16 1.0468133e-19 2.7170207e-03 4.3374732e-15 9.9728298e-01]
Word 17 score: [1.6543812e-01 1.6535877e-03 7.8417838e-02 7.5425822e-01 2.3224899e-04]
Word 18 score: [3.6779451e-12 2.7227600e-07 9.9999976e-01 2.5290592e-10 6.9129319e-10]
Word 19 score: [8.2231044e-10 5.4759752e-05 9.9994493e-01 3.0234546e-07 5.1161235e-11]
Word 20 score: [9.9395615e-01 7.2148483e-04 1.0341254e-06 5.0713681e-04 4.8141964e-03]
Word 21 score: [1.3716308e-12 9.9999702e-01 2.9787814e-06 8.5044471e-12 6.0284466e-10]
------
418
22 broad street .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname O
Real slot label: B-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.63421625 0.00754212 0.00137036 0.17843567 0.17843567]
Word 2 score: [1.3892026e-06 1.8037328e-08 1.8449249e-02 1.3740674e-04 9.8141187e-01]
------
419
i ' m sorry , we are unable to book this location in boston . would you like to select another restaurant ?
Predicted label: ['request', 'inform']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
420
a man ##o italian kitchen
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [7.0589763e-08 4.1025607e-05 7.3822752e-02 9.2613608e-01 2.7640379e-13]
Word 1 score: [1.1332213e-12 1.4807513e-07 9.9999988e-01 4.7957492e-11 4.7512997e-11]
Word 2 score: [9.9170006e-10 4.4320477e-05 9.9995553e-01 1.2123398e-07 2.4934641e-11]
Word 3 score: [9.9880493e-01 9.2845039e-06 4.1499231e-08 7.4574811e-05 1.1112827e-03]
Word 4 score: [2.61980667e-14 9.99995828e-01 4.18929176e-06 1.16119545e-11
 1.03109445e-10]
------
421
great i have booked a reservation for you under the name mike at a man ##o italian kitchen on 3 / 11 at 8 : 00 pm for 2 people .
Predicted label: ['inform']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O B-personfullname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O O O O O O B-numberofpeople O O
Real slot label: O O O O O O O O O O O B-personfullname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O O O O O O B-numberofpeople O O
Score: 
Word 11 score: [1.6961486e-06 1.0570060e-03 3.5672325e-01 2.8549480e-01 3.5672325e-01]
Word 13 score: [1.1666267e-02 9.1975331e-03 8.1853014e-01 1.6038845e-01 2.1754691e-04]
Word 14 score: [5.5391257e-07 2.4962879e-04 9.9781138e-01 6.2668399e-04 1.3117965e-03]
Word 15 score: [2.9164090e-14 5.6773263e-08 1.0000000e+00 1.7250430e-11 1.7712531e-12]
Word 16 score: [9.9797815e-01 2.4786343e-06 1.6131811e-08 4.2215073e-05 1.9771869e-03]
Word 17 score: [5.0180965e-17 9.9999940e-01 6.1992250e-07 1.1476335e-12 2.9936378e-13]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 28 score: [0.2 0.2 0.2 0.2 0.2]
------
422
please book a table for 2 in seattle for tomorrow at 9 : 00 pm at stone ##burn ##er under the name george cal ##omba ##ris
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O B-personfullname I-personfullname I-personfullname I-personfullname
Real slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O B-personfullname I-personfullname I-personfullname I-personfullname
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [1.6699712e-01 1.6608307e-03 2.2462405e-01 6.0655904e-01 1.5900524e-04]
Word 9 score: [7.9528010e-01 1.8886386e-01 8.5837701e-09 2.4248305e-07 1.5855856e-02]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [6.06517657e-04 5.04877698e-03 9.80986774e-01 1.33572295e-02
 7.19418949e-07]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
------
423
i have secured that table for you , mr . cal ##oma ##ris ! thanks for using our service !
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O O O O O O O B-closing I-closing I-closing I-closing I-closing O
Real slot label: O O O O O O O O O O O O O O B-closing I-closing I-closing I-closing I-closing O
Score: 
Word 14 score: [4.0911505e-05 2.2465813e-01 6.8935055e-01 8.2575731e-02 3.3746639e-03]
Word 15 score: [3.6775950e-11 1.6723213e-08 3.0778711e-08 9.9999940e-01 5.2796503e-07]
Word 16 score: [1.8906739e-02 6.4636188e-05 1.8906739e-02 9.6212178e-01 3.3488555e-14]
Word 17 score: [4.2008523e-07 5.3411055e-02 6.8906754e-01 1.3376236e-01 1.2375858e-01]
Word 18 score: [9.5546134e-03 1.6100103e-05 1.1457858e-03 1.0926060e-02 9.7835743e-01]
------
424
hello , i was wondering if you can tell me where a good restaurant is to book ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O
Score: 
------
425
sure thing ! what city are you looking in ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
426
reserve a table monday at 6 ##pm for 4 people at a indian buffet in wilmington , nc
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O B-date O B-starttime I-starttime O B-numberofpeople O O O B-cuisine B-restauranttype O B-city O B-state
Real slot label: O O O B-date O B-starttime I-starttime O B-numberofpeople O O O B-cuisine B-restauranttype O B-city O B-state
Score: 
Word 3 score: [6.3467713e-04 1.7552859e-04 9.8854977e-01 5.3199893e-03 5.3199893e-03]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [4.1017804e-01 4.1281202e-01 1.7830519e-03 5.9733960e-05 1.7516708e-01]
Word 13 score: [1.3275365e-08 4.2056324e-14 6.7014410e-19 1.3808176e-11 1.0000000e+00]
Word 15 score: [8.9045847e-05 2.0749180e-06 3.2409593e-02 1.2759675e-01 8.3990252e-01]
Word 17 score: [1.0000000e+00 1.1054814e-11 1.1054814e-11 1.1054814e-11 1.1054814e-11]
------
427
unfortunately there are no indian buffet ##s in wilmington that may be booked through this service . would you like to try a different cuisine ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O B-cuisine O O O B-city O O O O O O O O O O O O O O O O O
Real slot label: O O O O B-cuisine O O O B-city O O O O O O O O O O O O O O O O O
Score: 
Word 4 score: [8.8439047e-02 3.1070808e-01 2.2343796e-02 3.7065867e-05 5.7847202e-01]
Word 8 score: [1.68015104e-04 1.01449871e-06 2.85303611e-02 1.52656995e-02
 9.56034899e-01]
------
428
asian fusion
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-cuisine I-cuisine
Real slot label: B-cuisine I-cuisine
Score: 
Word 0 score: [2.3186287e-05 2.2237744e-07 5.7613383e-06 9.9994934e-01 2.1423593e-05]
Word 1 score: [7.6645456e-06 9.9998713e-01 4.4490633e-07 4.5826309e-06 2.6088532e-07]
------
429
yo sake downtown su ##shi lounge is an asian restaurant with available tables . would you like to book ?
Predicted label: ['inform', 'confirm_question']
Real label: ['inform', 'confirm_question']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-cuisine O O O O O O O O O O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-cuisine O O O O O O O O O O O
Score: 
Word 0 score: [8.6929305e-03 9.7886217e-01 8.7180146e-04 3.4516491e-04 1.1227891e-02]
Word 1 score: [0.7268708  0.01805796 0.24222058 0.00133651 0.01151417]
Word 2 score: [1.7213886e-09 9.9999547e-01 8.0563611e-10 6.6021119e-07 3.7536229e-06]
Word 3 score: [1.0349946e-05 8.2236874e-01 5.5447209e-08 1.7712966e-01 4.9109501e-04]
Word 4 score: [5.7751267e-06 8.9644068e-01 4.1080980e-08 1.0310508e-01 4.4839433e-04]
Word 5 score: [2.68861949e-02 1.06275875e-04 6.30386248e-02 9.09901857e-01
 6.70249865e-05]
Word 8 score: [3.9143354e-04 1.1017460e-03 1.1452240e-03 9.9445623e-01 2.9053229e-03]
------
430
that ##s sounds devin ##e , please book that
Predicted label: ['inform', 'confirm_answer']
Real label: ['confirm_answer']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
431
i have booked your reservation at yo sake for four guests on monday . thank you and enjoy your dinner .
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O B-restaurantname I-restaurantname O O O O B-date O B-closing I-closing I-closing I-closing I-closing I-closing I-closing
Real slot label: O O O O O O B-restaurantname I-restaurantname O O O O B-date O B-closing I-closing I-closing I-closing I-closing I-closing I-closing
Score: 
Word 6 score: [1.8813832e-08 9.9995613e-01 4.3836000e-05 2.8211695e-11 7.8568467e-09]
Word 7 score: [0.27207094 0.01474047 0.69819945 0.00477138 0.01021775]
Word 12 score: [2.4584120e-03 8.9251506e-04 9.8258305e-01 7.0330002e-03 7.0330002e-03]
Word 14 score: [4.8577719e-04 4.4585576e-08 9.9949682e-01 1.6439310e-10 1.7392218e-05]
Word 15 score: [6.4150345e-01 1.4494749e-03 5.4893461e-03 1.9982284e-04 3.5135800e-01]
Word 16 score: [9.9561775e-01 1.0564757e-03 6.9105206e-04 2.1951684e-05 2.6129128e-03]
Word 17 score: [9.41412582e-04 4.97930050e-02 9.48835611e-01 4.18052980e-04
 1.20117975e-05]
Word 18 score: [1.1991459e-06 9.9916553e-01 8.3328644e-04 1.6496345e-15 1.6496345e-15]
Word 19 score: [9.8345214e-01 1.6500397e-02 8.2149722e-07 4.6417870e-05 2.7990527e-07]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
------
432
i need a restaurant that only serves locally sourced produce and meat
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O
Score: 
------
433
here are the restaurants i found matching your request . please select one : 1 ) elliott ' s oyster house - rating : 4 out of 5 . 2 ) the pink door - rating : 4 out of 5 . 3 ) ja ##pone ##ssa - rating : 4 out of 5 .
Predicted label: ['multiple_choice']
Real label: ['multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
434
book me elliott ' s oyster house please
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 2 score: [6.54716253e-01 1.11866705e-02 3.34096760e-01 1.74176606e-07
 1.74176606e-07]
Word 3 score: [6.9517863e-01 2.3124646e-04 2.8613344e-01 3.7127297e-04 1.8085344e-02]
Word 4 score: [9.9958438e-01 1.7074005e-06 8.9838686e-08 2.4020044e-06 4.1141588e-04]
Word 5 score: [9.8518246e-01 4.1530943e-03 1.0664183e-02 1.3210726e-09 2.0707239e-07]
Word 6 score: [0.00345525 0.79895604 0.00573002 0.08433343 0.10752518]
------
435
at what time would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
436
today at 8 : 00pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date O B-starttime I-starttime I-starttime
Real slot label: B-date O B-starttime I-starttime I-starttime
Score: 
Word 0 score: [9.0848785e-05 8.4440082e-01 2.9567017e-03 1.5145410e-02 1.3740626e-01]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
------
437
at what date would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
438
well . . . i said today at 8 : 00pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O B-date O B-starttime I-starttime I-starttime
Real slot label: O O O O O O B-date O B-starttime I-starttime I-starttime
Score: 
Word 6 score: [9.58478451e-01 3.18442544e-05 1.27658555e-02 2.81469412e-02
 5.76912891e-04]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
------
439
how many people are going ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O
Real slot label: O O O O O O
Score: 
------
440
3
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
441
sorry , there are no tables are available for the date / time selected and your party size you in elliott ' s oyster house . would you like to select another date or restaurant ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O
Score: 
Word 20 score: [6.6683042e-01 4.5133727e-03 3.2865626e-01 6.3052474e-10 6.3052474e-10]
Word 21 score: [9.6147978e-01 1.3687618e-06 3.4666605e-02 1.3019270e-04 3.7220488e-03]
Word 22 score: [9.9990475e-01 1.5700753e-09 2.8294042e-07 3.7252090e-07 9.4699586e-05]
Word 23 score: [9.6015978e-01 2.2793952e-02 1.7042862e-02 8.8046699e-09 3.3074859e-06]
Word 24 score: [0.00068806 0.4541201  0.00987055 0.23609912 0.29922217]
------
442
what about tomorrow ? you got me interested
Predicted label: ['request']
Real label: ['inform']
Predicted slot label: O O B-date O O O O O
Real slot label: O O B-date O O O O O
Score: 
Word 2 score: [3.5293769e-02 9.4461776e-03 6.4299604e-07 5.1201500e-06 9.5525426e-01]
------
443
sorry , there are no tables are available for the date / time selected and your party size you in elliott ' s oyster house . would you like to select another date or restaurant ?
Predicted label: ['inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O
Score: 
Word 20 score: [6.3787740e-01 3.4250310e-03 3.5869756e-01 8.5504503e-10 8.5504503e-10]
Word 21 score: [9.67004478e-01 1.58602666e-06 3.01046222e-02 1.16241434e-04
 2.77308049e-03]
Word 22 score: [9.9992919e-01 1.8089553e-09 2.4431020e-07 3.3070808e-07 7.0153743e-05]
Word 23 score: [9.7530389e-01 1.1819366e-02 1.2874563e-02 6.4059398e-09 2.1967680e-06]
Word 24 score: [0.00072737 0.48833278 0.00860406 0.2019655  0.30037034]
------
444
can you check ja ##pone ##ssa ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O B-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O B-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
------
445
hello , i was wondering if you can tell me where a good restaurant is to book ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O
Score: 
------
446
sure ! how many people are in your party ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
447
book me a table for 1 in seattle for tomorrow at 7 : 00 pm at pi ##zz ##eria cr ##edo
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [5.3513616e-02 2.5301118e-04 9.7080261e-02 8.4811699e-01 1.0361248e-03]
Word 9 score: [3.2186621e-01 2.8101889e-02 2.2692399e-07 1.4974185e-06 6.5003014e-01]
Word 16 score: [8.1789319e-18 1.5255454e-16 3.9220779e-04 4.0395316e-18 9.9960786e-01]
Word 17 score: [1.5636058e-18 7.4864865e-14 7.6918256e-01 1.2438702e-17 2.3081750e-01]
Word 18 score: [1.7249232e-18 8.8959741e-16 3.6842257e-01 4.1586234e-17 6.3157743e-01]
Word 19 score: [2.0842049e-03 7.1342736e-05 9.9687743e-01 4.8346556e-04 4.8346556e-04]
Word 20 score: [1.8332095e-03 5.9454873e-05 9.9740583e-01 3.5070401e-04 3.5070401e-04]
------
448
i have successfully booked your reservation . enjoy !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-closing O
Real slot label: O O O O O O O B-closing O
Score: 
Word 7 score: [1.4454368e-01 4.6206224e-03 8.4402692e-01 1.4565760e-05 6.7942785e-03]
------
449
reserve a table for 4 at a beach restaurant in wright ##sville beach , nc on saturday at 6 ##pm
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O B-city I-city I-city O O O B-date O B-starttime I-starttime
Real slot label: O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O B-city I-city I-city O O O B-date O B-starttime I-starttime
Score: 
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.14197813 0.04958877 0.5245349  0.26299316 0.02090506]
Word 7 score: [1.1064044e-03 2.7867995e-07 3.6432180e-06 1.3550514e-04 9.9875414e-01]
Word 8 score: [1.6463258e-05 4.3262795e-01 3.1469578e-01 2.5265980e-01 2.8265685e-17]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [4.7586083e-05 4.9582116e-09 3.5306497e-05 1.8781379e-02 9.8113567e-01]
Word 16 score: [1.3296561e-02 5.4406520e-04 2.1561485e-04 3.4620756e-01 6.3973624e-01]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
------
450
22 north and east - blockade runner beach resort restaurant are available . would you like to try one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: B-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O
Real slot label: B-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [7.1360332e-01 2.8584352e-01 2.1202607e-06 9.7940858e-05 4.5305188e-04]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [7.2423889e-09 9.7546112e-12 5.8464883e-10 1.0000000e+00 1.8087755e-10]
Word 7 score: [7.7379923e-03 8.9453431e-07 2.0830503e-06 1.5347578e-04 9.9210560e-01]
Word 8 score: [9.1943120e-09 2.8501186e-01 7.1498531e-01 2.8163104e-06 2.0854442e-10]
Word 9 score: [4.2546396e-12 1.2238293e-05 5.6603597e-03 9.9432749e-01 1.1533855e-18]
------
451
# name ?
Predicted label: ['request', 'confirm_question']
Real label: ['inform']
Predicted slot label: O O O
Real slot label: O O O
Score: 
------
452
i have successfully completed your reservation at blockade runner beach resort restaurant . enjoy !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O
Real slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O
Score: 
Word 7 score: [9.9994588e-01 9.5655560e-07 4.5241188e-05 3.0363112e-06 4.9228111e-06]
Word 8 score: [8.0367664e-07 1.5858245e-04 4.4059525e-03 6.0200822e-01 3.9342648e-01]
Word 9 score: [7.8604994e-03 9.1617685e-06 1.5678976e-08 4.1404543e-03 9.8798984e-01]
Word 10 score: [7.9904581e-05 6.2569433e-01 2.4385472e-01 4.8362776e-03 1.2553476e-01]
Word 11 score: [9.9011633e-14 8.1522691e-01 1.5622318e-03 1.8321092e-01 1.7469499e-17]
------
453
i ' d like to reserve a table for 2 at wild ginger seattle in seattle for march 16th , i prefer 6 : 30 pm if available .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O B-city O B-date I-date O O O O O O O O O O
Real slot label: O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O B-city O B-date I-date O O O O O O O O O O
Score: 
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.00615868 0.04312038 0.7755686  0.12429717 0.05085514]
Word 12 score: [9.2383575e-01 2.4265626e-03 2.8624028e-11 1.4882951e-04 7.3588856e-02]
Word 13 score: [3.2264903e-02 1.6964336e-03 7.9425901e-02 8.8655740e-01 5.5329176e-05]
Word 15 score: [2.3803391e-02 2.1980781e-04 5.0753210e-02 9.2426443e-01 9.5915864e-04]
Word 17 score: [1.6525144e-05 8.0092925e-01 9.0931617e-02 5.9690051e-02 4.8432615e-02]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
------
454
your reservation has been confirmed . please enjoy your meal , and thank you for using our service !
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O O O O O B-closing I-closing I-closing I-closing I-closing I-closing O
Real slot label: O O O O O O O O O O O O B-closing I-closing I-closing I-closing I-closing I-closing O
Score: 
Word 12 score: [2.9653912e-02 1.4292292e-04 9.6834499e-01 8.9885747e-05 1.7682209e-03]
Word 13 score: [9.2051530e-01 1.8358916e-03 1.0492892e-02 2.1691242e-04 6.6939056e-02]
Word 14 score: [7.5365072e-08 9.5740222e-07 1.6996797e-08 9.9995887e-01 4.0067393e-05]
Word 15 score: [2.0043852e-02 1.1765806e-03 2.0043852e-02 9.5873564e-01 4.6216749e-11]
Word 16 score: [3.2913256e-05 5.8532294e-02 8.2360131e-01 5.7721417e-02 6.0112093e-02]
Word 17 score: [2.71935035e-02 4.62614145e-04 1.31678665e-02 1.79698095e-01
 7.79477894e-01]
------
455
i ' d like to reserve a table for 1 at wild ginger seattle in seattle for march 16th , i prefer 6 : 00 pm if available .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O B-city O O O O O O O O O O O O O
Real slot label: O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O B-city O O O O O O O O O O O O O
Score: 
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.00627511 0.01493275 0.93638104 0.01993924 0.02247185]
Word 12 score: [9.2952323e-01 2.1719721e-03 6.4215113e-12 6.2646614e-05 6.8242081e-02]
Word 13 score: [7.0082597e-02 1.8655802e-03 1.9195119e-01 7.3601490e-01 8.5700463e-05]
Word 15 score: [5.4679733e-02 2.1496923e-04 1.1443282e-01 8.2927519e-01 1.3972428e-03]
------
456
there is a table available at 6 : 30 pm ; if that works for you , what name would you like the reservation under ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
457
mike hunt
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname I-personfullname
Real slot label: B-personfullname I-personfullname
Score: 
Word 0 score: [2.5943152e-07 9.1655046e-01 3.0467186e-02 2.2514896e-02 3.0467186e-02]
Word 1 score: [1.8147809e-02 1.1184526e-10 7.0025271e-04 9.8115164e-01 2.6669659e-07]
------
458
i have successfully completed your reservation for wild ginger on march 16th at 6 : 30 ##pm . enjoy your meal !
Predicted label: ['inform']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname O O O O B-starttime I-starttime I-starttime I-starttime O B-closing I-closing I-closing I-closing
Real slot label: O O O O O O O B-restaurantname I-restaurantname O O O O B-starttime I-starttime I-starttime I-starttime O B-closing I-closing I-closing I-closing
Score: 
Word 7 score: [0.00405393 0.0451112  0.61034787 0.07835837 0.26212862]
Word 8 score: [3.3309314e-01 6.3257344e-02 1.7436307e-10 3.9669536e-03 5.9968263e-01]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [8.54678899e-02 1.43048735e-02 8.90883029e-01 2.63406782e-05
 9.31779109e-03]
Word 19 score: [1.8455014e-05 9.9590623e-01 4.0753079e-03 3.2144365e-20 3.2144365e-20]
Word 20 score: [3.4096360e-05 4.4002081e-06 3.3538643e-04 5.8075809e-01 4.1886804e-01]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
------
459
hello , i am in ##qui ##ring about an establishment that has exotic meat ##s to try in the denver area . i would like to try meat ##s like elk , em ##u or even kangaroo . is there any place that offers this type of cuisine ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O B-restauranttype I-restauranttype I-restauranttype O O O O B-city I-city O O O O O O O O O B-cuisine O B-cuisine I-cuisine O B-cuisine I-cuisine O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O B-restauranttype I-restauranttype I-restauranttype O O O O B-city I-city O O O O O O O O O B-cuisine O B-cuisine I-cuisine O B-cuisine I-cuisine O O O O O O O O O O O O
Score: 
Word 12 score: [6.8645680e-01 3.1339571e-01 1.4157846e-04 5.6221443e-06 2.3374074e-07]
Word 13 score: [6.9500744e-01 3.0499259e-01 1.5529078e-09 4.7373264e-19 4.7373264e-19]
Word 14 score: [4.82672960e-01 5.17327070e-01 1.29482975e-08 1.09678366e-13
 1.09678366e-13]
Word 19 score: [3.5895912e-08 4.2787806e-06 2.4706704e-05 9.9994528e-01 2.5677678e-05]
Word 20 score: [2.6011650e-04 6.4073589e-07 9.6594874e-04 4.0956917e-03 9.9467766e-01]
Word 30 score: [4.5987017e-05 9.9473500e-01 7.9323627e-06 5.2074399e-03 3.7663790e-06]
Word 32 score: [1.9496706e-07 1.2362341e-06 1.1167148e-13 9.9999857e-01 1.3982719e-09]
Word 33 score: [9.3128765e-01 6.3262358e-02 5.8657865e-09 5.4499139e-03 9.8596146e-08]
Word 35 score: [2.5080122e-05 5.7967710e-03 7.4461587e-02 3.1903246e-01 6.0068411e-01]
Word 36 score: [2.6810340e-11 1.5029850e-05 1.3891312e-11 1.1362075e-10 9.9998498e-01]
------
460
i ' m happy to assist you ! how many guests are in your party ?
Predicted label: ['request', 'greeting']
Real label: ['request', 'greeting']
Predicted slot label: B-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting O O O O O O O O O
Real slot label: B-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting O O O O O O O O O
Score: 
Word 0 score: [4.1093165e-01 5.0856323e-07 4.8229503e-03 5.2452702e-03 5.7899970e-01]
Word 1 score: [1.6051274e-08 7.7043384e-01 2.1375227e-03 2.2742814e-01 4.7872595e-07]
Word 2 score: [3.0456587e-08 7.9403806e-01 8.8994298e-03 1.9706072e-01 1.7516771e-06]
Word 3 score: [2.3732512e-06 1.4976314e-01 3.8639905e-07 8.5006148e-01 1.7267978e-04]
Word 4 score: [7.1383496e-05 4.0763531e-05 2.6642621e-01 2.4385123e-08 7.3346168e-01]
Word 5 score: [0.13466802 0.2218294  0.60245216 0.02518046 0.01587   ]
Word 6 score: [0.8204747  0.04965307 0.00460163 0.01305676 0.11221379]
------
461
there are 5 of us in total
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O B-numberofpeople O O O O
Real slot label: O O B-numberofpeople O O O O
Score: 
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
------
462
what time and date would you like your reservation for ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
463
tuesday night at 5 : 00
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O
Real slot label: O O O O O O
Score: 
------
464
tag is a restaurant that serves exotic foods like that . they are well - known for their kangaroo . would you like to book a table there ?
Predicted label: ['inform', 'confirm_question']
Real label: ['inform', 'confirm_question']
Predicted slot label: B-restaurantname O O O O O O O O O O O O O O O O O B-cuisine O O O O O O O O O O
Real slot label: B-restaurantname O O O O O O O O O O O O O O O O O B-cuisine O O O O O O O O O O
Score: 
Word 0 score: [1.2449382e-06 9.9000745e-03 1.0290237e-04 6.9793127e-04 9.8929775e-01]
Word 18 score: [1.9415499e-11 7.0712602e-05 5.4436561e-10 2.5896429e-09 9.9992931e-01]
------
465
yu ##mmy ! i certainly want to book this !
Predicted label: ['inform', 'confirm_answer']
Real label: ['confirm_answer']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
466
success ! your reservation has been confirmed , please enjoy your meal !
Predicted label: ['inform', 'thanks']
Real label: ['inform']
Predicted slot label: O O O O O O O O B-closing I-closing I-closing I-closing O
Real slot label: O O O O O O O O B-closing I-closing I-closing I-closing O
Score: 
Word 8 score: [3.8861591e-02 2.6090242e-02 9.3469507e-01 3.5304905e-04 3.6228316e-09]
Word 9 score: [6.4020319e-04 1.7421599e-02 9.8139977e-01 5.3844956e-04 2.4508925e-08]
Word 10 score: [1.7896110e-06 9.9732435e-01 2.6738963e-03 9.3817853e-19 9.3817853e-19]
Word 11 score: [1.9860674e-04 9.3464541e-06 5.1091355e-04 7.2635245e-01 2.7292871e-01]
------
467
can you find me the best upscale cuban place in miami for tomorrow night ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O B-cuisine I-cuisine O O B-city O B-date I-date O
Real slot label: O O O O O O B-cuisine I-cuisine O O B-city O B-date I-date O
Score: 
Word 6 score: [6.8163067e-06 7.5173834e-06 6.6241423e-06 9.9997878e-01 3.2547041e-07]
Word 7 score: [9.5237434e-02 4.9957862e-06 4.4535372e-01 1.4050175e-02 4.4535372e-01]
Word 10 score: [1.4570008e-01 4.2690459e-01 1.4703785e-07 4.2690459e-01 4.9053750e-04]
Word 12 score: [6.40107155e-01 2.37563759e-01 1.81923610e-06 1.09144175e-05
 1.22316271e-01]
Word 13 score: [3.5758211e-12 5.0000000e-01 3.1594332e-12 5.0000000e-01 5.0061697e-14]
------
468
what time would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
469
from 6 to 7 ##pm would work , there will be 5 of us
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O
Score: 
------
470
i found 3 restaurants you may like , 94 ##th aero squadron , havana 1957 , and bella cuba . which would you like to book ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname O O B-restaurantname I-restaurantname O O O O O O O O
Real slot label: O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname O O B-restaurantname I-restaurantname O O O O O O O O
Score: 
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [2.9114908e-10 9.9991429e-01 6.0312944e-10 8.1383048e-05 4.3485720e-06]
Word 11 score: [9.9060941e-01 3.5236677e-05 8.8784182e-03 1.3436235e-05 4.6349579e-04]
Word 13 score: [2.7294367e-04 3.4884697e-06 1.3062146e-05 9.2374273e-03 9.9047297e-01]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [8.82131159e-01 3.34481172e-07 9.77267933e-10 3.01097387e-08
 1.17868446e-01]
Word 18 score: [8.5620796e-03 9.0566346e-06 9.7864211e-01 1.1533102e-02 1.2535878e-03]
------
471
i ' ll go with bella cuba
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O B-restaurantname I-restaurantname
Real slot label: O O O O O B-restaurantname I-restaurantname
Score: 
Word 5 score: [8.7105411e-01 1.3029991e-07 1.2404038e-09 1.1024103e-07 1.2894571e-01]
Word 6 score: [4.2542377e-03 1.6120015e-05 9.8143584e-01 1.2103118e-02 2.1906374e-03]
------
472
i have successfully booked your reservation at bella cuba for 6 : 30 ##pm tomorrow . enjoy !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname O B-starttime I-starttime I-starttime I-starttime B-date O B-closing O
Real slot label: O O O O O O O B-restaurantname I-restaurantname O B-starttime I-starttime I-starttime I-starttime B-date O B-closing O
Score: 
Word 7 score: [4.0724680e-02 2.4721242e-08 2.3613458e-10 1.3476157e-08 9.5927525e-01]
Word 8 score: [2.1325182e-02 2.5067186e-05 9.7191513e-01 6.3262843e-03 4.0828870e-04]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [1.7850018e-05 9.7877276e-01 1.1204939e-11 2.8699217e-08 2.1209382e-02]
Word 16 score: [1.6542682e-01 1.2773463e-02 7.6685125e-01 3.8078313e-05 5.4910351e-02]
------
473
hello
Predicted label: ['greeting']
Real label: ['greeting']
Predicted slot label: B-greeting
Real slot label: B-greeting
Score: 
Word 0 score: [4.0650237e-03 9.9537271e-01 5.5657350e-04 2.7999233e-06 2.7999233e-06]
------
474
hello , can i help you book a restaurant ?
Predicted label: ['request']
Real label: ['greeting']
Predicted slot label: B-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting O
Real slot label: B-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting O
Score: 
Word 0 score: [4.6983016e-01 5.2516741e-01 4.9928236e-03 4.7927210e-06 4.7927210e-06]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [9.9990022e-01 1.2002926e-07 2.5598426e-09 9.5812145e-05 3.7730397e-06]
Word 3 score: [0.28360078 0.4747771  0.00281415 0.23797053 0.00083745]
Word 4 score: [3.5726927e-02 9.2004329e-01 1.2227787e-03 4.2695314e-02 3.1160831e-04]
Word 5 score: [8.3345139e-01 3.4387312e-03 1.2555034e-02 6.8523223e-04 1.4986974e-01]
Word 6 score: [9.9910778e-01 2.3485298e-09 6.6888501e-04 2.2326094e-04 7.4128856e-11]
Word 7 score: [0.7599292  0.07223296 0.06876524 0.04089371 0.05817892]
Word 8 score: [3.8628345e-12 2.6692524e-06 4.3847892e-03 9.9561262e-01 1.3552130e-18]
------
475
yes , a table for five at bal ##ze ##m ny for tuesday evening please .
Predicted label: ['inform']
Real label: ['request']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date O O
Real slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date O O
Score: 
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [4.6245833e-07 8.0600810e-05 6.1651981e-01 8.4384665e-02 2.9901448e-01]
Word 12 score: [0.02956164 0.21598867 0.18077569 0.00917942 0.5644946 ]
Word 13 score: [0.02356409 0.00263921 0.21706037 0.4369462  0.3197901 ]
------
476
at what me would you like to make a reservation ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
477
8 : 15 ##pm please
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-starttime I-starttime I-starttime I-starttime O
Real slot label: B-starttime I-starttime I-starttime I-starttime O
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
------
478
success ! i was able to book you a table for 5 on 3 / 8 at 8 : 15 pm at bal ##ze ##m .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O B-numberofpeople O B-date I-date I-date O O O O O O B-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O O O O O O O O B-numberofpeople O B-date I-date I-date O O O O O O B-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
------
479
i ' m looking for a upscale french restaurant in seattle for a party of 4 for tomorrow night around 6 : 30 ##pm
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O B-restauranttype B-cuisine O O B-city O O O O B-numberofpeople O O O O B-starttime I-starttime I-starttime I-starttime
Real slot label: O O O O O O B-restauranttype B-cuisine O O B-city O O O O B-numberofpeople O O O O B-starttime I-starttime I-starttime I-starttime
Score: 
Word 6 score: [1.4704144e-04 1.0204202e-04 1.2485274e-03 9.9849677e-01 5.7047764e-06]
Word 7 score: [9.9745899e-01 1.9435626e-03 1.8381020e-09 9.1900813e-07 5.9650716e-04]
Word 10 score: [5.0506230e-02 1.9492787e-04 3.7518889e-01 5.7299024e-01 1.1197360e-03]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
------
480
i found the following restaurants that fit your criteria : luc , cafe camp ##agne , bas ##till ##e cafe & bar .
Predicted label: ['inform', 'multiple_choice']
Real label: ['multiple_choice']
Predicted slot label: O O O O O O O O O O B-restaurantname O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O O O O O O O B-restaurantname O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 10 score: [9.9246985e-01 7.5302129e-03 2.3039981e-12 2.3039981e-12 2.3039981e-12]
Word 12 score: [2.2887008e-04 4.3045962e-03 8.8095441e-03 1.6112374e-10 9.8665696e-01]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [1.1995708e-04 3.4033027e-01 8.6319233e-07 7.1909003e-06 6.5954173e-01]
Word 17 score: [3.0791018e-02 9.5489985e-01 9.1659643e-08 1.9863553e-04 1.4110391e-02]
Word 18 score: [9.7563601e-01 8.2516681e-06 1.7078794e-06 1.9794845e-04 2.4156090e-02]
Word 19 score: [3.0192256e-01 1.4931827e-02 9.3721878e-04 2.0879870e-10 6.8220842e-01]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [3.2861363e-02 1.1378757e-05 1.3836165e-05 2.5138197e-02 9.4197524e-01]
------
481
book the cafe camp ##agne please
Predicted label: ['request']
Real label: ['inform']
Predicted slot label: O O O O O O
Real slot label: O O O O O O
Score: 
------
482
success ! i have book you a table for 4 at cafe camp ##agne on 3 / 8 at 6 : 30 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O B-numberofpeople O O O O O B-date I-date I-date O B-starttime I-starttime I-starttime I-starttime O
Real slot label: O O O O O O O O O B-numberofpeople O O O O O B-date I-date I-date O B-starttime I-starttime I-starttime I-starttime O
Score: 
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
------
483
hello
Predicted label: ['greeting']
Real label: ['greeting']
Predicted slot label: B-greeting
Real slot label: B-greeting
Score: 
Word 0 score: [4.0650237e-03 9.9537271e-01 5.5657350e-04 2.7999233e-06 2.7999233e-06]
------
484
hi , would you like to make a restaurant reservation ?
Predicted label: ['greeting', 'confirm_question']
Real label: ['confirm_question']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
485
yes i would
Predicted label: ['confirm_answer']
Real label: ['confirm_answer']
Predicted slot label: O O O
Real slot label: O O O
Score: 
------
486
great ! please let me know how many people are in your party , what time and day you ' d like a reservation for , and the city you ' re dining in . if you have a specific restaurant or cuisine in mind , that would be very helpful as well .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
487
thank you . 2 people . saturday , 3 \ / 12 @ 7 : 00 pm in royal oak mi . i would like mexican food
Predicted label: ['inform', 'thanks']
Real label: ['inform']
Predicted slot label: O O O B-numberofpeople O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O O B-cuisine I-cuisine
Real slot label: O O O B-numberofpeople O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O O B-cuisine I-cuisine
Score: 
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [1.7800756e-06 1.4308046e-04 8.0493277e-01 4.3601757e-03 1.9056208e-01]
Word 19 score: [0.17205401 0.04904605 0.17205401 0.17205401 0.43479195]
Word 20 score: [1.0321940e-01 1.0715078e-01 1.0954525e-04 7.8952026e-01 8.0619821e-13]
Word 25 score: [6.1601699e-05 8.2363158e-02 8.7116649e-03 2.2048176e-04 9.0864307e-01]
Word 26 score: [5.7615008e-04 1.0160613e-05 9.9446726e-01 4.5382939e-03 4.0817927e-04]
------
488
i ' m sorry , there are no mexican restaurants available to book in that area . would you like a different kind of food ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
489
how about american please
Predicted label: ['inform', 'confirm_answer']
Real label: ['inform']
Predicted slot label: O O O O
Real slot label: O O O O
Score: 
------
490
cafe muse has a table available at 7 ##pm , and tom ' s oyster bar royal oak has a table at 6 : 30 ##pm . would you like to book either of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
491
cafe muse at 7 ##pm please for 2 people
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname O B-starttime I-starttime O O B-numberofpeople O
Real slot label: B-restaurantname I-restaurantname O B-starttime I-starttime O O B-numberofpeople O
Score: 
Word 0 score: [7.5738048e-05 3.3349181e-03 4.9665710e-03 6.5137997e-06 9.9161619e-01]
Word 1 score: [1.3796814e-05 9.9932277e-01 1.2837607e-07 6.6302030e-04 1.9886120e-07]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
------
492
your reservation was confirmed , enjoy your meal
Predicted label: ['inform']
Real label: ['inform', 'closing']
Predicted slot label: O O O O O B-closing I-closing I-closing
Real slot label: O O O O O B-closing I-closing I-closing
Score: 
Word 5 score: [1.3264000e-01 1.5622128e-02 8.4994793e-01 1.0558522e-04 1.6842800e-03]
Word 6 score: [1.0958153e-06 9.8522007e-01 1.4778779e-02 4.2530945e-20 4.2530945e-20]
Word 7 score: [3.8726732e-05 6.9251209e-06 4.8861076e-04 7.1098661e-01 2.8847912e-01]
------
493
i ' d like to find the best moroccan place in new york city
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O B-cuisine O O B-city I-city O
Real slot label: O O O O O O O O B-cuisine O O B-city I-city O
Score: 
Word 8 score: [7.3548712e-02 1.8831133e-06 6.5774435e-01 1.9515634e-01 7.3548712e-02]
Word 11 score: [1.8905205e-04 8.6294794e-03 3.5859044e-10 9.6732240e-11 9.9118149e-01]
Word 12 score: [5.8713794e-01 4.4340483e-04 4.1655585e-02 3.7063676e-01 1.2623594e-04]
------
494
sure , lets start with your date of reservation , please .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O
Score: 
------
495
this sunday for lunch - sometime from noon to 2 : 30 ##pm would work , there ' s two of us
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date I-date O B-mealtype O O B-starttime I-starttime I-starttime I-starttime I-starttime I-starttime I-starttime O O O O O O O O O
Real slot label: B-date I-date O B-mealtype O O B-starttime I-starttime I-starttime I-starttime I-starttime I-starttime I-starttime O O O O O O O O O
Score: 
Word 0 score: [0.09357592 0.17348799 0.11855759 0.00122935 0.61314917]
Word 1 score: [1.2482005e-06 1.7628433e-01 1.4810222e-03 1.1951671e-02 8.1028169e-01]
Word 3 score: [1.7893839e-05 3.3441512e-03 2.5773630e-04 6.1267334e-01 3.8370696e-01]
Word 6 score: [1.1317745e-03 3.3038941e-06 3.4638815e-06 9.9174809e-01 7.1134018e-03]
Word 7 score: [1.0087738e-04 1.0087738e-04 9.9647766e-01 5.8974289e-05 3.2616097e-03]
Word 8 score: [2.3402964e-07 4.6822964e-03 9.9526149e-01 4.0685419e-09 5.5983397e-05]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
------
496
great , i found 3 options that may work for you . bar six , bar ##bes restaurant , and tag ##ine fine moroccan cuisine . which would you like to book ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O B-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O
Real slot label: O O O O O O O O O O O O B-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O
Score: 
Word 12 score: [2.7589563e-03 7.6147074e-07 2.2700323e-04 9.9585211e-01 1.1611803e-03]
Word 13 score: [9.6619406e-09 1.2432427e-04 9.9986959e-01 3.1504861e-09 6.0355360e-06]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [4.6193389e-14 8.5886717e-01 1.1831783e-03 1.3994971e-01 1.0839587e-16]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [2.8982856e-09 1.4609128e-04 1.8432659e-07 9.0611237e-01 9.3741409e-02]
Word 23 score: [4.5359513e-01 4.7846374e-08 3.6015056e-02 5.6794669e-02 4.5359513e-01]
Word 24 score: [5.2276173e-06 9.6105003e-01 6.9792088e-07 3.8943987e-02 6.9175193e-10]
------
497
i think tag ##ine moroccan sounds like it would be good , let ' s go with that
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O
Real slot label: O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O
Score: 
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [3.8420066e-01 1.8222655e-08 2.0475581e-01 2.6842805e-02 3.8420066e-01]
------
498
there is a 12 ##pm and a 3 ##pm opening . which one would you prefer ?
Predicted label: ['inform']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O B-starttime I-starttime O O B-starttime I-starttime O O O O O O O O
Real slot label: O O O B-starttime I-starttime O O B-starttime I-starttime O O O O O O O O
Score: 
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
------
499
hey i live in bell ##ingham , wa and i ' m looking for an italian restaurant that will take 4 of us next thursday night . we ' re going to be seeing a movie and i ' m not sure what time it ends exactly , so let ' s just say 7 ##pm .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O B-city I-city O O O O O O O O O B-cuisine I-cuisine O O O B-numberofpeople O O B-date I-date O O O O O O O O O O O O O O O O O O O O O O O O O O O O O B-starttime I-starttime O
Real slot label: O O O O B-city I-city O O O O O O O O O B-cuisine I-cuisine O O O B-numberofpeople O O B-date I-date O O O O O O O O O O O O O O O O O O O O O O O O O O O O O B-starttime I-starttime O
Score: 
Word 4 score: [8.9444857e-06 4.1644789e-02 1.2663846e-04 1.8836806e-02 9.3938285e-01]
Word 5 score: [3.8878672e-05 2.3389882e-01 1.0607710e-02 3.2425407e-02 7.2302920e-01]
Word 15 score: [9.9596739e-01 3.0003236e-10 4.2196682e-09 3.0623340e-08 4.0325816e-03]
Word 16 score: [2.5743358e-05 6.2751669e-01 3.4349152e-01 2.8966060e-02 9.7498315e-18]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [1.3333473e-03 5.8059965e-04 3.6793703e-03 9.9434859e-01 5.8073885e-05]
Word 24 score: [6.0815422e-04 1.5033827e-03 1.7000236e-04 4.2106152e-05 9.9767643e-01]
Word 54 score: [0.2 0.2 0.2 0.2 0.2]
Word 55 score: [0.2 0.2 0.2 0.2 0.2]
------
500
here are 3 of the top rated italian restaurants in bell ##ingham : d ' anna ' s cafe italian ##o , g ##lus ##ep ##pe ' s al porto italian restaurant , la fia ##mma wood fire pizza . would you like to try one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 13 score: [5.5777383e-07 8.1108814e-01 3.1171009e-04 4.8807692e-06 1.8859468e-01]
Word 14 score: [1.1787176e-04 8.1059140e-01 1.7454614e-03 5.4514916e-03 1.8209378e-01]
Word 15 score: [7.57330554e-08 7.50034988e-01 1.24968225e-02 2.18309700e-01
 1.91583838e-02]
Word 16 score: [9.9598712e-01 2.1423130e-06 1.4077052e-07 3.7812181e-06 4.0067621e-03]
Word 17 score: [9.9591893e-01 2.9934217e-06 1.2862918e-07 4.0401810e-06 4.0740077e-03]
Word 18 score: [1.5953588e-01 1.2642632e-02 1.1252457e-03 4.7572385e-10 8.2669622e-01]
Word 19 score: [2.3784171e-04 8.2775116e-01 1.7194909e-01 3.3128184e-05 2.8818056e-05]
Word 20 score: [2.8020368e-04 7.9388553e-01 2.0575716e-01 4.5398927e-05 3.1705258e-05]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
Word 26 score: [9.9524903e-01 2.1084272e-06 1.6888640e-07 3.7015664e-06 4.7450005e-03]
Word 27 score: [9.9612671e-01 2.3574344e-06 1.2035011e-07 3.2953863e-06 3.8675384e-03]
Word 28 score: [3.6441130e-04 1.1353024e-04 9.9943119e-01 4.6645266e-05 4.4216878e-05]
Word 29 score: [1.3638599e-02 3.4545130e-07 1.9146751e-03 2.4743329e-03 9.8197216e-01]
Word 30 score: [9.8781872e-01 3.8931798e-03 3.4287709e-06 1.2140132e-03 7.0705707e-03]
Word 31 score: [6.4991426e-13 8.7348193e-01 1.3532267e-03 1.2516485e-01 3.6584756e-14]
Word 33 score: [6.6813445e-01 1.7165364e-03 5.4095250e-05 2.9708406e-01 3.3010814e-02]
Word 34 score: [0.2 0.2 0.2 0.2 0.2]
Word 35 score: [0.2 0.2 0.2 0.2 0.2]
Word 36 score: [1.3903957e-08 2.2184800e-02 3.6814639e-05 9.0680391e-01 7.0974439e-02]
Word 37 score: [2.7977412e-05 1.5628548e-05 9.9169636e-01 8.2597155e-03 2.7939950e-07]
Word 38 score: [6.3891494e-01 2.4940464e-12 1.2931714e-08 3.6108506e-01 1.9969133e-09]
------
501
g ##lus ##ep ##pe ' s al porto italian restaurant ( wow , what a mouthful ! ) sounds delicious . we ' ll definitely try there .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [9.9936646e-01 1.3615278e-06 9.7671368e-08 2.0060952e-06 6.3007645e-04]
Word 5 score: [9.9943691e-01 2.4984881e-06 5.3211284e-08 1.7198654e-06 5.5888155e-04]
Word 6 score: [4.5070021e-05 3.1251144e-05 9.9992228e-01 9.0341723e-07 5.2026934e-07]
Word 7 score: [7.0181843e-03 2.9360115e-07 4.5691193e-03 3.2202941e-03 9.8519206e-01]
Word 8 score: [9.9810994e-01 3.3295353e-05 1.7601167e-08 5.9559519e-05 1.7972034e-03]
Word 9 score: [1.9204578e-14 8.4057438e-01 2.2658450e-03 1.5715975e-01 4.7774525e-19]
------
502
success , i was able to book you a table at giuseppe ' s al porto for 4 people at 7 pm on 3 / 10 .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-numberofpeople O O B-starttime I-starttime O B-date I-date I-date O
Real slot label: O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-numberofpeople O O B-starttime I-starttime O B-date I-date I-date O
Score: 
Word 11 score: [2.2302411e-10 9.9997747e-01 2.2483779e-05 2.0797950e-08 8.1391320e-08]
Word 12 score: [7.6784301e-01 8.1620895e-04 1.4264263e-01 4.1196696e-04 8.8286154e-02]
Word 13 score: [9.9955350e-01 1.8952006e-06 3.5748503e-08 7.3949212e-07 4.4379733e-04]
Word 14 score: [7.531778e-05 1.948867e-05 9.999038e-01 9.759149e-07 4.058500e-07]
Word 15 score: [1.0281569e-02 6.4560760e-07 4.7684503e-03 6.5166415e-03 9.7843277e-01]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [2.4169365e-04 9.8146594e-01 1.8291816e-02 2.9346251e-07 2.2087794e-07]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
------
503
what are the best restaurants in new hampshire ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O B-state I-state O
Real slot label: O O O O O O B-state I-state O
Score: 
Word 6 score: [4.7381391e-06 6.7146117e-04 6.2615464e-12 9.5266711e-12 9.9932384e-01]
Word 7 score: [9.5234913e-01 4.4922311e-02 2.2398829e-08 2.7277113e-03 8.7389031e-07]
------
504
hello . do you have specific city you ' re searching in ?
Predicted label: ['request']
Real label: ['request', 'greeting']
Predicted slot label: B-greeting O O O O O O O O O O O O
Real slot label: B-greeting O O O O O O O O O O O O
Score: 
Word 0 score: [1.7418375e-02 9.8201758e-01 5.6264905e-04 7.5262005e-07 7.5262005e-07]
------
505
just new hampshire in general . i would like to take a road trip and explore the state
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O B-state I-state O O O O O O O O O O O O O O O
Real slot label: O B-state I-state O O O O O O O O O O O O O O O
Score: 
Word 1 score: [6.8595400e-04 4.2446002e-02 9.4884108e-11 1.1510375e-11 9.5686799e-01]
Word 2 score: [9.9810922e-01 1.8275072e-03 1.3981480e-09 6.3291627e-05 4.3775419e-08]
------
506
what day are you wanting the reservation to be for ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
507
i am looking to book a table for 3 at a cafe type of restaurant in fresno , ca at 3 ##pm today
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O B-numberofpeople O O B-restauranttype O O O O B-city O B-state O B-starttime I-starttime B-date
Real slot label: O O O O O O O O B-numberofpeople O O B-restauranttype O O O O B-city O B-state O B-starttime I-starttime B-date
Score: 
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [6.2497676e-04 6.3142780e-04 8.6428877e-03 1.5193443e-13 9.9010068e-01]
Word 16 score: [4.9992859e-01 9.1913935e-05 9.6366639e-06 4.1222109e-05 4.9992859e-01]
Word 18 score: [5.2965171e-10 9.9874902e-01 8.6511903e-08 1.2506425e-03 2.7690089e-07]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [9.8592526e-01 1.2063684e-05 4.6594883e-04 5.7241844e-04 1.3024381e-02]
------
508
i ' m happy to assist you ! unfortunately we do not have any cafe - style restaurants in fresno with available seating . black angus steak ##house - fresno , elephant bar restaurant - fresno , and max ' s bis ##tro & bar are the top 3 restaurants with available seating at 3 ##pm . may i
Predicted label: ['inform', 'greeting']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O O O B-city O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-rating I-rating O O O O O B-starttime I-starttime O O O
Real slot label: O O O O O O O O O O O O O O O O O O O B-city O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-rating I-rating O O O O O B-starttime I-starttime O O O
Score: 
Word 19 score: [4.9846521e-01 1.1300525e-03 2.8146998e-04 1.6581210e-03 4.9846521e-01]
Word 24 score: [9.9999797e-01 1.9275112e-06 6.8480377e-10 6.0055626e-08 1.1057887e-08]
Word 25 score: [2.5671168e-06 9.9998212e-01 2.6512328e-07 2.5671168e-06 1.2484722e-05]
Word 26 score: [6.3807081e-15 9.6523488e-21 6.4454508e-19 1.4160248e-17 1.0000000e+00]
Word 27 score: [5.0637561e-15 5.9894621e-21 4.5067617e-19 9.4490016e-18 1.0000000e+00]
Word 28 score: [0.2 0.2 0.2 0.2 0.2]
Word 29 score: [4.7947398e-01 4.1015707e-02 1.7706333e-06 3.4682645e-05 4.7947398e-01]
Word 31 score: [6.2113294e-15 3.7876027e-10 6.2427403e-05 9.1709948e-01 8.2838133e-02]
Word 32 score: [8.2655936e-01 8.8478300e-06 2.0667964e-03 1.5418375e-01 1.7181149e-02]
Word 33 score: [7.5716881e-12 4.6470740e-01 3.3051607e-03 5.3198743e-01 7.9753993e-14]
Word 34 score: [0.2 0.2 0.2 0.2 0.2]
Word 35 score: [4.7205159e-01 5.5833828e-02 2.6055104e-06 6.0381833e-05 4.7205159e-01]
Word 38 score: [6.0201890e-04 3.2372892e-04 2.9803007e-06 4.0612258e-02 9.5845902e-01]
Word 39 score: [0.7240376  0.00228172 0.02686513 0.00128292 0.24553266]
Word 40 score: [9.9929547e-01 2.9916555e-06 2.4151092e-09 6.5450314e-07 7.0086448e-04]
Word 41 score: [6.6434085e-01 3.2934210e-01 5.4046894e-05 6.2626717e-03 4.1290744e-07]
Word 42 score: [7.0041937e-01 2.9407099e-01 5.0905051e-05 5.4584150e-03 3.6566041e-07]
Word 43 score: [0.2 0.2 0.2 0.2 0.2]
Word 44 score: [1.3990843e-01 1.7809559e-06 7.3339179e-06 7.6765329e-02 7.8331709e-01]
Word 47 score: [8.4630810e-03 1.0937651e-03 4.7702642e-08 4.9522159e-01 4.9522159e-01]
Word 48 score: [0.2 0.2 0.2 0.2 0.2]
Word 54 score: [0.2 0.2 0.2 0.2 0.2]
Word 55 score: [0.2 0.2 0.2 0.2 0.2]
------
509
elephant bar
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname
Score: 
Word 0 score: [6.7739655e-12 6.0093361e-09 4.8188140e-04 9.6001476e-01 3.9503347e-02]
Word 1 score: [1.3242401e-01 6.0894530e-07 2.8759108e-03 3.1114005e-02 8.3358556e-01]
------
510
thank you for booking with us ! your reservation has been confirmed as requested . please enjoy your meal !
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: B-closing I-closing I-closing I-closing I-closing I-closing I-closing O O O O O O O O B-closing I-closing I-closing I-closing I-closing
Real slot label: B-closing I-closing I-closing I-closing I-closing I-closing I-closing O O O O O O O O B-closing I-closing I-closing I-closing I-closing
Score: 
Word 0 score: [5.6439918e-02 8.2662889e-05 9.2948371e-01 1.2176724e-02 1.8169809e-03]
Word 1 score: [9.2172861e-01 2.0537674e-03 4.1866256e-03 8.0033060e-05 7.1950950e-02]
Word 2 score: [5.6872511e-09 1.3173425e-06 1.7835307e-06 9.9999237e-01 4.4796584e-06]
Word 3 score: [0.00110137 0.03500532 0.4524224  0.05904863 0.4524224 ]
Word 4 score: [9.9990022e-01 2.4701748e-07 1.7018567e-05 8.2481893e-05 8.3804512e-11]
Word 5 score: [7.6885417e-02 9.1331221e-02 6.0119113e-05 2.1566246e-02 8.1015700e-01]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [5.5498637e-02 5.6516983e-02 8.8776314e-01 2.2125551e-04 7.4361362e-09]
Word 16 score: [2.2452159e-03 2.9591508e-02 9.6525174e-01 2.9115942e-03 1.0280596e-08]
Word 17 score: [6.2786103e-07 9.9307352e-01 6.9258902e-03 1.5906162e-17 1.5906162e-17]
Word 18 score: [1.0173790e-04 7.6041047e-06 7.0383697e-04 5.1774579e-01 4.8144105e-01]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
------
511
need something for wedding anniversary
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O B-occasion I-occasion
Real slot label: O O O B-occasion I-occasion
Score: 
Word 3 score: [2.3533653e-07 2.3533653e-07 6.1085692e-10 3.7500677e-06 9.9999583e-01]
Word 4 score: [3.4146793e-03 6.7134559e-01 7.1621522e-02 1.6918394e-04 2.5344908e-01]
------
512
where are you located ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
513
wilmington
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-address
Real slot label: B-address
Score: 
Word 0 score: [1.0514752e-04 4.2716470e-05 1.7730334e-01 7.4437571e-01 7.8173108e-02]
------
514
what date would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
515
the day after tomorrow
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date I-date I-date I-date
Real slot label: B-date I-date I-date I-date
Score: 
Word 0 score: [9.2094249e-01 7.3606499e-02 1.5854675e-05 1.3949600e-05 5.4212366e-03]
Word 1 score: [4.1659263e-12 3.4643488e-12 1.0000000e+00 1.8419662e-12 6.1547733e-12]
Word 2 score: [3.1263677e-05 4.9998206e-01 4.9998206e-01 4.5703860e-06 2.6958231e-08]
Word 3 score: [2.3058196e-06 2.0845990e-08 9.9896889e-11 1.2253300e-08 9.9999774e-01]
------
516
how many guests ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O
Real slot label: O O O O
Score: 
------
517
4
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
518
great - what time would you like to eat at ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
519
10 ##pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-starttime I-starttime
Real slot label: B-starttime I-starttime
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
------
520
here are 3 of the top rated restaurants in wilmington that would be good for an anniversary celebration : the melting pot , ruth ' s chris steak house , the little dip ##per . would you like to try one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 23 score: [4.6933150e-07 1.6371351e-07 5.4735914e-02 3.1968133e-09 9.4526356e-01]
Word 24 score: [0.3199936  0.00073791 0.5851476  0.00147225 0.09264863]
Word 25 score: [9.9790776e-01 1.9645552e-06 8.9944614e-08 4.7357275e-06 2.0855435e-03]
Word 26 score: [6.0949767e-01 2.4704073e-01 8.8008208e-05 1.3858502e-02 1.2951510e-01]
Word 27 score: [1.22806065e-01 8.24869228e-10 2.81444179e-14 1.17384505e-10
 8.77193928e-01]
Word 28 score: [0.00662613 0.8268065  0.00526191 0.10358581 0.0577197 ]
Word 30 score: [3.5674348e-02 3.6561859e-03 9.6054858e-01 5.7436391e-05 6.3450425e-05]
Word 31 score: [5.9703954e-05 2.0515479e-02 9.7941899e-01 3.0362020e-07 5.6044514e-06]
Word 32 score: [2.2427717e-01 7.6545936e-01 2.7447436e-06 6.6565390e-04 9.5951157e-03]
Word 33 score: [2.4876994e-01 7.3973161e-01 2.6800687e-06 8.6403702e-04 1.0631764e-02]
------
521
ruth ; s
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O
Real slot label: O O O
Score: 
------
522
we have booked your restaurant . thank you .
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
523
how is the chip ##ot ##le
Predicted label: ['request']
Real label: ['inform']
Predicted slot label: O O O B-restaurantname I-restaurantname I-restaurantname
Real slot label: O O O B-restaurantname I-restaurantname I-restaurantname
Score: 
Word 3 score: [2.6396156e-04 9.8345286e-01 7.4594677e-04 1.6658734e-05 1.5520549e-02]
Word 4 score: [3.8113302e-01 1.9824307e-02 5.9848779e-01 5.5440899e-04 4.4925744e-07]
Word 5 score: [5.9827798e-05 4.9639847e-02 9.5028615e-01 1.3998284e-05 2.4898986e-07]
------
524
hello ! what location are you in ? i can give you specific details about your local chip ##ot ##le , if you ' d like .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O
Score: 
Word 17 score: [1.1008950e-03 9.7018617e-01 4.6553370e-03 2.0791142e-05 2.4036828e-02]
Word 18 score: [9.8094571e-01 2.4898560e-04 1.8796090e-02 7.5909056e-06 1.6899555e-06]
Word 19 score: [2.7785138e-03 6.3602783e-02 9.3361163e-01 3.0724191e-06 3.9537535e-06]
------
525
can you find me an asian restaurant that serves a buffet for lunch tomorrow in seattle ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-restauranttype O O O O B-cuisine O B-mealtype B-date O B-city O
Real slot label: O O O O O B-restauranttype O O O O B-cuisine O B-mealtype B-date O B-city O
Score: 
Word 5 score: [2.6435891e-05 1.3983158e-04 4.5803213e-04 9.9933714e-01 3.8541031e-05]
Word 10 score: [7.8396886e-07 2.4132416e-01 1.0087425e-08 6.1643846e-07 7.5867438e-01]
Word 12 score: [1.6616994e-05 9.3233073e-04 1.2164901e-04 6.0514593e-01 3.9378348e-01]
Word 13 score: [5.2876509e-04 6.3924526e-06 1.1872715e-02 7.7840978e-01 2.0918234e-01]
Word 15 score: [2.5005069e-01 1.4260445e-04 2.7482289e-01 4.6932459e-01 5.6592296e-03]
------
526
what time would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
527
noon
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-starttime
Real slot label: B-starttime
Score: 
Word 0 score: [1.3289289e-03 1.3289289e-03 9.9711132e-01 1.4591274e-04 8.4849671e-05]
------
528
how many people are expected ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O
Real slot label: O O O O O O
Score: 
------
529
2
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
530
what name would you like to book the reservation under ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
531
gig ##i
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname I-personfullname
Real slot label: B-personfullname I-personfullname
Score: 
Word 0 score: [1.0361770e-04 4.7151246e-03 3.3172706e-01 3.3172706e-01 3.3172706e-01]
Word 1 score: [9.9999976e-01 1.9026933e-07 3.1354821e-13 3.1354821e-13 3.1354821e-13]
------
532
i found the following restaurants that fit your criteria : boom no ##odle , sub ##i japanese restaurant , kan ##ame i ##zak ##aya .
Predicted label: ['inform', 'multiple_choice']
Real label: ['request', 'multiple_choice']
Predicted slot label: O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 10 score: [3.7566148e-11 2.5494580e-06 9.9999750e-01 1.2281228e-09 4.3744319e-10]
Word 11 score: [6.0864299e-05 2.3982986e-07 2.1164973e-05 2.7680628e-08 9.9991763e-01]
Word 12 score: [7.9990894e-01 1.0724843e-05 1.7388295e-05 2.1981112e-09 2.0006308e-01]
Word 14 score: [1.1768620e-07 3.8567092e-02 2.8004007e-07 8.6774021e-01 9.3692347e-02]
Word 15 score: [2.3313289e-09 5.8170784e-02 3.1726330e-11 6.0094559e-01 3.4088364e-01]
Word 16 score: [1.2221992e-06 2.8274003e-01 8.1758422e-04 7.1604449e-01 3.9671606e-04]
Word 17 score: [4.7369908e-14 6.7285967e-01 2.5711572e-03 3.2456914e-01 2.6878476e-17]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [9.7326853e-04 9.9880886e-01 2.1782101e-04 3.7251469e-10 3.7251469e-10]
Word 22 score: [6.9790980e-04 9.9909735e-01 2.0476774e-04 1.8450996e-10 1.8450996e-10]
Word 23 score: [8.463145e-04 9.989951e-01 1.586031e-04 5.016002e-10 5.016002e-10]
------
533
kan ##ame i ##zak ##aya sounds good
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [7.0763368e-04 9.9917251e-01 1.1979668e-04 2.3359471e-11 2.3359471e-11]
Word 3 score: [4.8454676e-04 9.9938691e-01 1.2848912e-04 8.6786689e-12 8.6786689e-12]
Word 4 score: [6.7520182e-04 9.9923551e-01 8.9285342e-05 3.0712124e-11 3.0712124e-11]
------
534
your reservation on 03 / 08 / 2016 under gig ##i was confirmed for 2 guests at 12 ##pm . enjoy your meal at kan ##ame i ##zak ##aya .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O B-date I-date I-date I-date I-date O O O O O O O O O B-starttime I-starttime O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O B-date I-date I-date I-date I-date O O O O O O O O O B-starttime I-starttime O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
Word 26 score: [7.8262138e-04 9.9896586e-01 2.5156376e-04 1.8280464e-11 1.8280464e-11]
Word 27 score: [6.8151858e-04 9.9913847e-01 1.7993944e-04 1.1170012e-11 1.1170012e-11]
Word 28 score: [7.8193477e-04 9.9905318e-01 1.6487567e-04 1.2986989e-11 1.2986989e-11]
------
535
i need a restaurant for three people to eat at near dupont circle tomorrow night
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O B-distanceconstraints I-distanceconstraints I-distanceconstraints B-date I-date
Real slot label: O O O O O O O O O O B-distanceconstraints I-distanceconstraints I-distanceconstraints B-date I-date
Score: 
Word 10 score: [5.8752543e-01 3.4215844e-01 4.1774770e-09 2.1181584e-04 7.0104353e-02]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.01482149 0.03129055 0.8298155  0.04037999 0.0836925 ]
Word 13 score: [2.5506782e-07 2.7864624e-10 2.0842014e-08 1.6426317e-07 9.9999964e-01]
Word 14 score: [3.4613038e-13 5.0000000e-01 2.1258117e-13 5.0000000e-01 6.2041570e-17]
------
536
i ' m happy to assist you ! do you have a specific restaurant or cuisine in mind ?
Predicted label: ['request', 'greeting']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O
Score: 
------
537
how about indian food ?
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O B-cuisine O O
Real slot label: O O B-cuisine O O
Score: 
Word 2 score: [1.1286850e-01 5.7457161e-01 2.1155600e-03 1.7017734e-05 3.1042734e-01]
------
538
what time would you like your reservation for ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
539
0 . 79 ##16 ##66 ##66 ##7
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
540
i ' m happy to assist you ! what city are you dining in ?
Predicted label: ['request', 'greeting']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O
Score: 
------
541
washington dc
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city I-city
Real slot label: B-city I-city
Score: 
Word 0 score: [3.2598519e-09 6.1542226e-04 1.9316463e-04 9.9918014e-01 1.1176383e-05]
Word 1 score: [6.9436933e-06 4.9733716e-01 5.7163442e-07 5.3181271e-03 4.9733716e-01]
------
542
what name would you like to book the reservation under ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
543
donald
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname
Real slot label: B-personfullname
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
544
adi ##ti indian dining - alexandria , american tan ##door , ang ##eet ##hi all have tables available at your specified time . would you like to book one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O
Score: 
Word 0 score: [7.9447389e-01 1.7011434e-01 3.1229386e-02 4.1643274e-03 1.7979446e-05]
Word 1 score: [8.4869468e-01 2.0448311e-05 1.5126668e-01 1.8233719e-05 1.3307693e-13]
Word 2 score: [9.9834125e-04 9.9788010e-01 6.3817581e-04 4.2521572e-04 5.8147016e-05]
Word 3 score: [1.8574034e-04 1.2949761e-04 6.0247318e-03 9.9366003e-01 4.4971429e-10]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.00197843 0.1661401  0.00695405 0.00395823 0.8209692 ]
Word 7 score: [6.2958659e-03 5.0120230e-10 5.5149423e-05 9.9334794e-01 3.0102109e-04]
Word 8 score: [3.9739374e-04 9.9944764e-01 1.5475524e-04 2.0901085e-07 9.9442780e-12]
Word 9 score: [5.9429811e-07 9.9986005e-01 1.3935268e-04 1.7996530e-08 4.3538673e-08]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
------
545
yes , let ' s do ang ##eet ##hi
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O B-restaurantname I-restaurantname I-restaurantname
Real slot label: O O O O O O B-restaurantname I-restaurantname I-restaurantname
Score: 
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
------
546
your reservation has been confirmed . please enjoy your meal , and thank you for using our service !
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O B-closing I-closing I-closing O O O O O O O O O
Real slot label: O O O O O O O B-closing I-closing I-closing O O O O O O O O O
Score: 
Word 7 score: [4.4765566e-03 2.7952531e-02 9.6611786e-01 1.4528707e-03 1.7494872e-07]
Word 8 score: [1.7362781e-05 9.9925643e-01 7.2616199e-04 5.4826555e-19 5.4826555e-19]
Word 9 score: [1.6470807e-08 7.1867294e-09 1.3540927e-07 4.8886761e-01 5.1113224e-01]
------
547
i need to book a table for 3 / 21 at 7 pm for dinner at the beer park in las vegas for two guests .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O B-date I-date I-date O O O O B-mealtype O O B-restaurantname I-restaurantname O O O O O O O
Real slot label: O O O O O O O B-date I-date I-date O O O O B-mealtype O O B-restaurantname I-restaurantname O O O O O O O
Score: 
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [9.9991572e-01 1.5894189e-05 1.5840721e-11 6.8434048e-05 1.8000204e-09]
Word 17 score: [5.4380301e-13 1.4753401e-04 3.2503242e-10 9.9985242e-01 3.7547357e-12]
Word 18 score: [8.2118817e-07 6.0084604e-02 7.1375787e-02 8.6807519e-01 4.6356826e-04]
------
548
i have successfully completed your reservation ! enjoy !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-closing O
Real slot label: O O O O O O O B-closing O
Score: 
Word 7 score: [5.7846088e-02 1.2011557e-02 9.2993820e-01 1.5215877e-04 5.2046929e-05]
------
549
please find a table with a mountain view saturday at 8 in knoxville , tn for 4 people
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O B-date O B-starttime O B-city O B-state O B-numberofpeople O
Real slot label: O O O O O O O O B-date O B-starttime O B-city O B-state O B-numberofpeople O
Score: 
Word 8 score: [9.3697337e-05 3.5391080e-05 2.8870518e-03 1.4176281e-04 9.9684215e-01]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [2.9300837e-04 3.2292905e-03 2.7788477e-02 9.4340456e-01 2.5284667e-02]
Word 14 score: [5.3266390e-06 9.9999404e-01 8.4898927e-10 1.2881685e-07 5.2372371e-07]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
------
550
i ' m unable to secure specific tables at any restaurant . i can find a restaurant that * may * give you a mountain view . shall i proceed ?
Predicted label: ['inform', 'confirm_question']
Real label: ['inform', 'confirm_question']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
551
yes
Predicted label: ['confirm_answer']
Real label: ['confirm_answer']
Predicted slot label: O
Real slot label: O
Score: 
------
552
happy to assist you ! i can offer you the top three restaurants in your , or would you like me to narrow down the options by a cuisine of your choice ?
Predicted label: ['request']
Real label: ['request', 'greeting']
Predicted slot label: B-greeting I-greeting I-greeting I-greeting O O O O O O B-rating I-rating O O O O O O O O O O O O O O O O O O O O O
Real slot label: B-greeting I-greeting I-greeting I-greeting O O O O O O B-rating I-rating O O O O O O O O O O O O O O O O O O O O O
Score: 
Word 0 score: [1.27165848e-02 1.25576672e-03 1.05858904e-04 3.29674706e-02
 9.52954292e-01]
Word 1 score: [4.1008316e-06 1.7118835e-05 8.7400162e-01 3.6556430e-10 1.2597720e-01]
Word 2 score: [0.1976436  0.10722683 0.6728414  0.00683854 0.01544961]
Word 3 score: [0.11376518 0.00264477 0.00452682 0.01202652 0.8670367 ]
Word 10 score: [1.8849022e-04 1.6595503e-05 1.0953850e-07 4.9989739e-01 4.9989739e-01]
Word 11 score: [0.13255876 0.00400578 0.8075633  0.02373929 0.0321328 ]
------
553
german
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-cuisine
Real slot label: B-cuisine
Score: 
Word 0 score: [3.1558782e-01 2.0965496e-04 2.9319169e-03 6.8067348e-01 5.9711101e-04]
------
554
unfortunately there are no german restaurants that i ' m able to book for you . would you like to try french cuisine at the orange ##ry or european / fond ##ue at the melting pot instead ?
Predicted label: ['inform']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O B-cuisine O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O B-cuisine O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
Word 4 score: [1.1399581e-02 2.3539153e-05 1.2990132e-02 9.7533232e-01 2.5450304e-04]
------
555
european \ / fond ##ue at the melting pot . french makes me po ##ot
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O B-restaurantname I-restaurantname I-restaurantname O B-cuisine O O O O
Real slot label: O O O O O O B-restaurantname I-restaurantname I-restaurantname O B-cuisine O O O O
Score: 
Word 6 score: [4.4802520e-02 3.5258718e-02 9.1982692e-01 1.0810537e-05 1.0108528e-04]
Word 7 score: [9.8691106e-01 1.2775365e-02 1.8067683e-04 1.5069029e-06 1.3126970e-04]
Word 8 score: [1.6873375e-02 9.2602217e-01 5.7103448e-02 6.5859024e-07 3.1608909e-07]
Word 10 score: [2.4616399e-01 3.7150055e-01 3.7948877e-01 9.4453964e-05 2.7522377e-03]
------
556
thank you for booking with us ! your reservation has been confirmed as requested . please fond ##ue enjoy your meal !
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: B-closing I-closing I-closing I-closing I-closing I-closing O O O O O O O O O B-closing I-closing I-closing I-closing I-closing I-closing O
Real slot label: B-closing I-closing I-closing I-closing I-closing I-closing O O O O O O O O O B-closing I-closing I-closing I-closing I-closing I-closing O
Score: 
Word 0 score: [9.1492437e-02 1.1154876e-04 8.5954320e-01 4.5458447e-02 3.3942866e-03]
Word 1 score: [0.45799968 0.00237371 0.01185687 0.00054693 0.5272228 ]
Word 2 score: [9.0219238e-08 1.3676461e-05 3.5621648e-05 9.9991655e-01 3.3984641e-05]
Word 3 score: [0.00108027 0.04643207 0.44729003 0.05790757 0.44729003]
Word 4 score: [9.9952841e-01 1.8028126e-06 1.2524004e-05 4.5729740e-04 1.4481344e-09]
Word 5 score: [1.8347715e-01 1.2009200e-01 2.2533200e-04 4.0658284e-02 6.5554726e-01]
Word 15 score: [6.8792105e-02 5.2342460e-02 8.7843454e-01 4.3087569e-04 2.7676153e-08]
Word 16 score: [4.4477647e-03 9.7168819e-04 8.7750697e-01 5.6703779e-05 1.1701689e-01]
Word 17 score: [1.7122589e-05 2.1649317e-05 9.9774903e-01 3.8071650e-07 2.2118692e-03]
Word 18 score: [4.6636364e-03 9.4828932e-03 9.5385206e-01 3.2001194e-02 1.8292189e-07]
Word 19 score: [3.6247050e-07 9.9515897e-01 4.8406967e-03 1.1108440e-17 1.1108440e-17]
Word 20 score: [6.5823668e-04 7.6110722e-05 1.4823389e-02 7.8062618e-01 2.0381609e-01]
------
557
book me a table for 1 in seattle for tomorrow at 7 : 00 pm at queen city grill
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname
Real slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [1.7251963e-02 1.7692082e-04 3.9210562e-02 9.4275928e-01 6.0127984e-04]
Word 9 score: [6.12198591e-01 1.04205795e-01 1.59251260e-06 4.55469353e-06
 2.83589393e-01]
Word 16 score: [1.92293487e-02 1.17576354e-04 1.09886840e-01 8.69593620e-01
 1.17257505e-03]
Word 17 score: [3.4164760e-04 2.0193438e-04 9.4078362e-01 4.5675620e-06 5.8668241e-02]
Word 18 score: [2.5079237e-16 3.2022292e-17 1.0528935e-03 1.0454434e-14 9.9894708e-01]
------
558
hi . i ' ve booked your restaurant for tomorrow . thank you .
Predicted label: ['inform']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O O B-date O O O O
Real slot label: O O O O O O O O O B-date O O O O
Score: 
Word 9 score: [4.1170281e-01 5.8791316e-01 1.1072889e-08 9.0800637e-07 3.8319273e-04]
------
559
i would like to make a reservation for lunch at the best rated bis ##tro in seattle
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O B-mealtype O O B-rating I-rating B-restaurantname I-restaurantname O B-city
Real slot label: O O O O O O O O B-mealtype O O B-rating I-rating B-restaurantname I-restaurantname O B-city
Score: 
Word 8 score: [9.5197692e-07 4.1068517e-04 9.7698037e-05 4.0687007e-01 5.9262061e-01]
Word 11 score: [1.0000000e+00 2.8957425e-12 5.2824246e-18 6.9618916e-10 1.0377385e-09]
Word 12 score: [8.6647028e-01 6.8909093e-03 1.9294354e-10 6.3540622e-12 1.2663890e-01]
Word 13 score: [9.2621738e-01 1.6415495e-03 1.4103057e-06 5.2011386e-02 2.0128276e-02]
Word 14 score: [9.9194080e-01 4.2715888e-03 7.0686849e-07 3.7738432e-03 1.3110804e-05]
Word 16 score: [8.97157565e-03 1.11718145e-04 3.97452191e-02 9.49008167e-01
 2.16325116e-03]
------
560
what date would you like me to look ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
561
i would like it for march 21
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O B-date I-date
Real slot label: O O O O O B-date I-date
Score: 
Word 5 score: [6.9482317e-06 5.9916967e-01 7.5503245e-02 5.4842837e-02 2.7047727e-01]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
------
562
i ' ll also need to know how many guests you ' ll have .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O
Score: 
------
563
4
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
564
what time would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
565
0 . 54 ##16 ##66 ##66 ##7
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
566
il bis ##tro is 4 . 5 / 5 stars . would you like this option ?
Predicted label: ['confirm_question']
Real label: ['inform', 'confirm_question']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname O B-rating I-rating I-rating I-rating I-rating I-rating O O O O O O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname O B-rating I-rating I-rating I-rating I-rating I-rating O O O O O O O
Score: 
Word 0 score: [9.9999630e-01 3.0660640e-06 5.7407482e-07 6.1168883e-09 1.7778909e-08]
Word 1 score: [9.9091387e-01 3.7944186e-04 8.6555563e-05 8.6133890e-03 6.7147603e-06]
Word 2 score: [8.3452082e-01 1.5088618e-01 1.7215799e-04 1.4419487e-02 1.3305279e-06]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [5.7297981e-01 1.9624553e-09 5.1156241e-02 4.6316764e-17 3.7586394e-01]
------
567
yes thank you !
Predicted label: ['confirm_answer', 'thanks']
Real label: ['confirm_answer', 'thanks']
Predicted slot label: O O O O
Real slot label: O O O O
Score: 
------
568
i have successfully completed your reservation for il bis ##tro on march 21 at 1 ##pm . enjoy !
Predicted label: ['inform', 'closing']
Real label: ['inform']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname O B-date I-date O B-starttime I-starttime O O O
Real slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname O B-date I-date O B-starttime I-starttime O O O
Score: 
Word 7 score: [1.0000000e+00 4.0651304e-13 4.6562684e-10 8.6991411e-13 8.4374851e-12]
Word 8 score: [9.9896467e-01 8.9312744e-05 9.8806231e-06 9.3594898e-04 2.5688703e-07]
Word 9 score: [9.7096133e-01 2.7633088e-02 1.7032800e-05 1.3884238e-03 8.5034834e-08]
Word 11 score: [8.5363281e-06 4.9040052e-01 5.0093360e-02 1.6939053e-02 4.4255856e-01]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
------
569
can you find a bb ##q restaurant in seattle for a party of two for tomorrow night around 6 ##pm
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O B-restauranttype I-restauranttype O O B-city O O B-occasion O O O B-date I-date B-starttime I-starttime I-starttime
Real slot label: O O O O B-restauranttype I-restauranttype O O B-city O O B-occasion O O O B-date I-date B-starttime I-starttime I-starttime
Score: 
Word 4 score: [7.4020075e-14 4.3659415e-13 1.2399640e-03 1.9462710e-02 9.7929734e-01]
Word 5 score: [7.7358768e-13 4.7041542e-16 9.0852916e-01 9.1470830e-02 1.0036871e-09]
Word 8 score: [5.9075553e-02 1.7942933e-04 1.6558357e-01 7.6942617e-01 5.7353275e-03]
Word 11 score: [9.9911541e-01 1.3491574e-04 7.1796757e-04 2.5390441e-11 3.1681509e-05]
Word 15 score: [3.5984150e-01 6.2003195e-01 1.3554970e-07 4.4462695e-06 2.0121919e-02]
Word 16 score: [2.6663821e-12 5.0000000e-01 1.3152779e-12 5.0000000e-01 1.3104812e-14]
Word 17 score: [0.58443767 0.03278934 0.18421392 0.18421392 0.01434519]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
------
570
do you have a price range in mind or would you just like to go with the top rated places ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O
Score: 
------
571
top rated
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-rating I-rating
Real slot label: B-rating I-rating
Score: 
Word 0 score: [8.7248071e-07 9.9848300e-01 1.4763982e-03 1.9872688e-05 1.9872688e-05]
Word 1 score: [9.2536843e-01 2.7680998e-03 3.1547993e-11 5.6134009e-13 7.1863480e-02]
------
572
what name would you like to book the reservation under ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
573
donald james
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname I-personfullname
Real slot label: B-personfullname I-personfullname
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [6.7011654e-09 3.0475901e-03 4.3306582e-02 1.0566675e-11 9.5364583e-01]
------
574
i found the following restaurants that match : jack ' s bb ##q , rooster ' s bar & grill .
Predicted label: ['inform']
Real label: ['multiple_choice']
Predicted slot label: O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 8 score: [1.8096826e-07 9.9934989e-01 2.2838859e-11 9.9399449e-09 6.4989162e-04]
Word 9 score: [0.82105917 0.01108323 0.02423049 0.00147655 0.14215063]
Word 10 score: [9.9933201e-01 7.9481943e-06 1.5568199e-08 2.3921136e-06 6.5754057e-04]
Word 11 score: [2.3314209e-12 1.7061803e-18 9.8075438e-01 1.9244606e-02 1.0117679e-06]
Word 12 score: [3.7097712e-12 2.6828559e-18 9.7756028e-01 2.2438271e-02 1.3953804e-06]
Word 14 score: [9.9409604e-01 3.5211390e-03 2.8112391e-04 2.8112391e-04 1.8205481e-03]
Word 15 score: [0.72757155 0.0070523  0.10314553 0.00145962 0.16077101]
Word 16 score: [9.9941051e-01 4.7689791e-06 1.1617511e-08 1.6313112e-06 5.8308907e-04]
Word 17 score: [3.3004652e-03 3.4120642e-08 3.7270404e-06 4.0255305e-03 9.9267030e-01]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [5.6163500e-18 6.8733167e-19 4.2494151e-04 1.6769003e-15 9.9957508e-01]
------
575
let ' s book jack ' s bb ##q
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 4 score: [6.1457138e-07 9.9874449e-01 3.7983888e-10 4.2824833e-08 1.2548710e-03]
Word 5 score: [0.74181855 0.00370634 0.13135248 0.0013096  0.12181298]
Word 6 score: [9.9950099e-01 2.1226713e-06 3.0728714e-08 1.4673508e-06 4.9547275e-04]
Word 7 score: [8.6578780e-13 1.3915921e-19 9.9193645e-01 8.0633936e-03 6.5737062e-08]
Word 8 score: [8.83178025e-13 1.73520533e-19 9.90477800e-01 9.52212512e-03
 1.07475394e-07]
------
576
i have secured a table at jack ' s bb ##q on 3 / 8 / 16 for 2 people under the name donald james . can i help you with anything else this evening ?
Predicted label: ['inform']
Real label: ['inform', 'greeting']
Predicted slot label: O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date I-date I-date O B-numberofpeople O O O O B-personfullname I-personfullname O O O O O O O O O O O
Real slot label: O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date I-date I-date O B-numberofpeople O O O O B-personfullname I-personfullname O O O O O O O O O O O
Score: 
Word 6 score: [3.1219245e-06 9.9486732e-01 7.9895299e-09 1.6988467e-07 5.1294030e-03]
Word 7 score: [0.8057693  0.00244524 0.02561811 0.00162393 0.1645434 ]
Word 8 score: [9.9972707e-01 5.2785754e-07 5.8350595e-09 7.7209228e-07 2.7159331e-04]
Word 9 score: [2.7558214e-12 1.1481185e-19 9.9260050e-01 7.3990873e-03 3.2226768e-07]
Word 10 score: [3.1498439e-12 2.3106551e-19 9.8864859e-01 1.1350521e-02 9.1299358e-07]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [2.8593304e-08 9.2675593e-03 9.4388574e-02 1.8294914e-10 8.9634389e-01]
------
577
i ' m looking for a family steak ##house
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O B-restauranttype I-restauranttype I-restauranttype
Real slot label: O O O O O O B-restauranttype I-restauranttype I-restauranttype
Score: 
Word 6 score: [1.0619941e-11 6.6543245e-05 1.8217969e-03 7.5344310e-08 9.9811161e-01]
Word 7 score: [2.3544142e-09 6.4117738e-21 7.1742028e-18 1.2821158e-16 1.0000000e+00]
Word 8 score: [9.9255415e-10 1.2725761e-22 7.4944114e-20 3.2273943e-18 1.0000000e+00]
------
578
hello . what city are you located in ?
Predicted label: ['request', 'greeting']
Real label: ['greeting']
Predicted slot label: B-greeting O O O O O O O O
Real slot label: B-greeting O O O O O O O O
Score: 
Word 0 score: [6.2053413e-03 9.9200702e-01 1.7762254e-03 5.6811296e-06 5.6811296e-06]
------
579
jacksonville , nc
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city O O
Real slot label: B-city O O
Score: 
Word 0 score: [4.4003293e-05 1.0076801e-05 9.5816070e-01 3.5848760e-04 4.1426700e-02]
------
580
on what date would you like to make the reservation ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
581
tuesday
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date
Real slot label: B-date
Score: 
Word 0 score: [0.15173678 0.0709009  0.65885377 0.10196005 0.01654847]
------
582
do you have a time in mind ? also , how many guests will you have ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O
Score: 
------
583
8 people at 7 ##pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople O O B-starttime I-starttime
Real slot label: B-numberofpeople O O B-starttime I-starttime
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
------
584
what name would you like to book the reservation under ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
585
chi ##sum
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname I-personfullname
Real slot label: B-personfullname I-personfullname
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
------
586
i ' m sorry , i ' m unable to book any restaurants in that location right now . would you like to select a different area ?
Predicted label: ['request', 'inform']
Real label: ['multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
587
new york city
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city I-city O
Real slot label: B-city I-city O
Score: 
Word 0 score: [4.4227343e-02 9.5572752e-01 1.8824286e-07 3.6374581e-10 4.4874985e-05]
Word 1 score: [6.9482237e-01 1.2026285e-04 5.5598006e-02 2.4938312e-01 7.6225035e-05]
------
588
would you still like to search for a steak ##house ?
Predicted label: ['request']
Real label: ['inform']
Predicted slot label: O O O O O O O O B-restauranttype I-restauranttype O
Real slot label: O O O O O O O O B-restauranttype I-restauranttype O
Score: 
Word 8 score: [2.1635432e-12 2.0426259e-17 2.4515603e-15 4.6895393e-14 1.0000000e+00]
Word 9 score: [3.6841361e-06 4.5058261e-15 5.1430626e-13 6.7649723e-12 9.9999630e-01]
------
589
yes
Predicted label: ['confirm_answer']
Real label: ['confirm_answer']
Predicted slot label: O
Real slot label: O
Score: 
------
590
i ' ve found a few options for you : 1 ) st ##k - nyc , 2 ) 212 steak ##house , and 3 ) amber steak house . would you want to book one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname I-restaurantname O O O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname I-restaurantname O O O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [2.61905488e-13 1.46936859e-18 1.00633376e-14 1.49080790e-16
 1.00000000e+00]
Word 21 score: [3.5551516e-16 6.8135620e-22 2.3245670e-20 7.2985837e-19 1.0000000e+00]
Word 26 score: [3.7316184e-02 8.6020613e-01 1.0220633e-01 7.2701674e-05 1.9861027e-04]
Word 27 score: [9.9302554e-01 1.5574030e-10 6.4983593e-13 5.5474408e-10 6.9744177e-03]
Word 28 score: [0.00179178 0.9006315  0.00248912 0.07811844 0.01696912]
------
591
amber steak house .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname O
Real slot label: B-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 0 score: [9.8048466e-01 5.7630730e-03 1.3636257e-02 5.3272652e-05 6.2802013e-05]
Word 1 score: [9.9246699e-01 1.5897407e-11 4.7290395e-14 4.4091838e-11 7.5330213e-03]
Word 2 score: [0.00288209 0.8377006  0.00303561 0.09370334 0.0626784 ]
------
592
success ! i have booked a table for 8 at amber steak house on 3 / 8 at 7 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O
Real slot label: O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O
Score: 
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [2.8360659e-02 5.5731332e-01 4.1307455e-01 5.5015291e-04 7.0125260e-04]
Word 11 score: [9.8142439e-01 3.7751594e-11 6.4061664e-14 8.0581986e-11 1.8575681e-02]
Word 12 score: [0.00269212 0.8436098  0.00325011 0.0939183  0.05652965]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
------
593
hello . this is kind of a strange request , but i have a bunch of producers , writers , directors - - hollywood types - - that are meeting up to discuss a new project . i really need to find a restaurant in seattle that can not only take 14 of us on wednesday around 2 ##pm
Predicted label: ['request', 'greeting']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O B-city O O O O O B-numberofpeople O O O B-date B-starttime I-starttime I-starttime
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O B-city O O O O O B-numberofpeople O O O B-date B-starttime I-starttime I-starttime
Score: 
Word 45 score: [1.3988584e-01 8.3019544e-04 4.2588803e-01 4.3322566e-01 1.7031864e-04]
Word 51 score: [0.2 0.2 0.2 0.2 0.2]
Word 55 score: [5.0392617e-07 1.3510075e-01 8.5604984e-01 4.4244337e-03 4.4244337e-03]
Word 56 score: [0.0011709  0.02889198 0.13205487 0.13205487 0.70582736]
Word 57 score: [0.2 0.2 0.2 0.2 0.2]
Word 58 score: [0.2 0.2 0.2 0.2 0.2]
------
594
you will have to contact restaurants directly to book private rooms . i can search for a restaurant in a quieter area but i can guarantee that it will be empty .
Predicted label: ['inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O B-restauranttype O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O B-restauranttype O O O O O O O O O O O O O O O O O O O O O O
Score: 
Word 9 score: [5.5245959e-09 4.0270656e-06 2.4664934e-07 2.3557775e-10 9.9999571e-01]
------
595
okay . just a quieter , more private atmosphere works too . it just ca n ' t be somewhere that ' s cramped and crowded , although i realize you ca n ' t make guarantees .
Predicted label: ['confirm_answer']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
596
i ' ve found a few with private dining rooms . how would that work for you ? we have 1 ) 520 bar & grill , 2 ) and ##al ##uca , and 3 ) aqua . would you like to book any of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O B-restauranttype O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname I-restaurantname O O O O B-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O B-restauranttype O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname I-restaurantname O O O O B-restaurantname O O O O O O O O O O
Score: 
Word 7 score: [6.1673825e-07 2.3136764e-04 1.4792382e-06 3.9972066e-09 9.9976665e-01]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [4.5353800e-01 3.3773449e-05 1.2252499e-02 1.4550653e-01 3.8866928e-01]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [1.4396505e-16 4.4264562e-17 3.8707742e-04 1.2918576e-14 9.9961299e-01]
Word 29 score: [0.2 0.2 0.2 0.2 0.2]
Word 30 score: [0.2 0.2 0.2 0.2 0.2]
Word 31 score: [0.2 0.2 0.2 0.2 0.2]
Word 36 score: [1.1073561e-04 2.2507389e-05 8.0090280e-07 2.4091778e-06 9.9986351e-01]
------
597
that ' s great , thank you . let ' s try and ##al ##uca first and if that ' s not available , try aqua .
Predicted label: ['inform']
Real label: ['inform', 'thanks']
Predicted slot label: B-closing I-closing I-closing I-closing I-closing I-closing I-closing O O O O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O B-restaurantname O
Real slot label: B-closing I-closing I-closing I-closing I-closing I-closing I-closing O O O O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O B-restaurantname O
Score: 
Word 0 score: [8.3628076e-04 7.2961085e-02 8.6505306e-01 1.4579356e-04 6.1003856e-02]
Word 1 score: [3.6908838e-05 9.9981147e-01 2.5556020e-08 2.9258224e-05 1.2237216e-04]
Word 2 score: [1.1072359e-04 9.9962354e-01 2.9336549e-08 3.6166763e-05 2.2946598e-04]
Word 3 score: [1.1892926e-06 1.8899273e-02 5.6277006e-04 3.4948975e-01 6.3104701e-01]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [5.0167443e-04 1.0773449e-06 9.9912077e-01 8.9276950e-09 3.7645840e-04]
Word 6 score: [7.1268432e-02 2.8585831e-03 5.1772298e-04 2.1691719e-04 9.2513835e-01]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [2.2610231e-05 2.3499788e-06 1.0110117e-07 4.3488981e-07 9.9997449e-01]
------
598
please note that and ##al ##uca largest online reservation is 8 . if you are looking to book a larger party , please contact the restaurant directly . then on second try : aqua by el ga ##uch ##o accepts online reservations for parties up to 8 . for larger parties , please call the restaurant directly .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O B-occasion O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O B-occasion O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
Word 20 score: [9.9994588e-01 1.2146739e-05 4.0768842e-05 1.9543024e-12 1.2110922e-06]
------
599
i need to book a mexican restaurant for tomorrow night
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-restauranttype I-restauranttype O B-date I-date
Real slot label: O O O O O B-restauranttype I-restauranttype O B-date I-date
Score: 
Word 5 score: [2.1570809e-04 5.3185987e-01 2.4159843e-02 7.1001094e-05 4.4369361e-01]
Word 6 score: [2.7995186e-05 6.8463373e-01 2.9833311e-01 1.7005179e-02 4.5740570e-17]
Word 8 score: [3.4479761e-01 6.4370376e-01 2.6864822e-07 4.9998453e-06 1.1493429e-02]
Word 9 score: [2.0818111e-12 5.0000000e-01 1.7903427e-12 5.0000000e-01 2.0203581e-14]
------
600
i ' d love to help ! what city , please ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O
Score: 
------
601
seattle washington
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city B-state
Real slot label: B-city B-state
Score: 
Word 0 score: [8.0172712e-01 5.3283977e-05 1.3288470e-01 6.4953856e-02 3.8108591e-04]
Word 1 score: [1.6048391e-07 2.0505467e-03 2.5469952e-04 2.0632091e-01 7.9137361e-01]
------
602
what time would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
603
anytime after 7
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-starttime I-starttime I-starttime
Real slot label: B-starttime I-starttime I-starttime
Score: 
Word 0 score: [2.6226114e-04 2.0096847e-01 2.6625642e-01 2.6625642e-01 2.6625642e-01]
Word 1 score: [1.2293868e-04 4.7454709e-01 4.7454709e-01 5.0777037e-02 5.8392857e-06]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
------
604
how many guests will you have ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
605
2
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
606
here are 3 of the top rated mexican restaurants in seattle : cas ##co anti ##gu ##o , barrio , and el cam ##ino . would you like to try one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 12 score: [9.9357891e-01 2.5799885e-05 6.3870628e-03 2.6081733e-07 7.8986550e-06]
Word 13 score: [8.2128383e-03 7.2570178e-03 6.2303409e-02 2.6560494e-07 9.2222649e-01]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [3.7503581e-02 2.9568588e-05 1.9590687e-03 7.3514582e-07 9.6050698e-01]
Word 21 score: [3.5874655e-05 5.1203376e-04 3.3716724e-06 9.9944872e-01 8.4569436e-09]
Word 22 score: [5.4416023e-03 9.9455845e-01 3.1165478e-13 1.9558837e-18 1.9558837e-18]
Word 23 score: [7.4361206e-04 9.9925631e-01 6.7570435e-11 2.2814636e-12 2.2814636e-12]
------
607
cas ##co anti ##gu ##o
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [9.4273227e-01 6.1485320e-05 5.3143591e-02 1.7977778e-05 4.0446958e-03]
Word 1 score: [1.5137022e-02 4.8284219e-03 5.6119133e-02 6.6128962e-08 9.2391533e-01]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
------
608
success ! i have booked a table for 2 at cas ##co anti ##gu ##o on 3 / 11 at 7 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O
Real slot label: O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O
Score: 
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [9.91235137e-01 1.86387897e-05 8.73457268e-03 2.50266368e-07
 1.13193255e-05]
Word 11 score: [2.6079804e-02 5.9342356e-03 8.6978048e-02 1.5898770e-07 8.8100767e-01]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
------
609
can you find a restaurant that allows me to have 5 people join a table of 4 ? it ' s for los angeles , 8 ##pm on sunday night
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O B-numberofpeople O O O O O O O O O O O B-city I-city O B-starttime I-starttime O B-date I-date
Real slot label: O O O O O O O O O O B-numberofpeople O O O O O O O O O O O B-city I-city O B-starttime I-starttime O B-date I-date
Score: 
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [5.1276409e-05 3.4882611e-05 3.8807667e-03 1.0534745e-05 9.9602246e-01]
Word 23 score: [5.4603088e-01 5.8944024e-05 4.5391011e-01 6.7302792e-14 6.7302792e-14]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
Word 26 score: [0.2 0.2 0.2 0.2 0.2]
Word 28 score: [8.1693628e-08 2.2174098e-02 3.7468851e-07 6.8781691e-07 9.7782475e-01]
Word 29 score: [3.7603805e-12 5.0000000e-01 1.1047905e-11 5.0000000e-01 1.1484256e-15]
------
610
is there any type of cuisine you are interested in ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
611
hello
Predicted label: ['inform']
Real label: ['greeting']
Predicted slot label: B-greeting
Real slot label: B-greeting
Score: 
Word 0 score: [7.7598525e-04 9.9851710e-01 7.0046814e-04 3.2056987e-06 3.2056987e-06]
------
612
hello , can i help you book a restaurant ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
613
book me a table for 2 in seattle for tomorrow at 7 : 00 pm at omega ou ##zer ##in
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-city O B-date O B-starttime I-starttime I-starttime I-starttime O B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: O O O O O B-numberofpeople O B-city O B-date O B-starttime I-starttime I-starttime I-starttime O B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [9.4632559e-02 3.2560702e-04 2.3250243e-01 6.7007625e-01 2.4631289e-03]
Word 9 score: [5.2385294e-01 3.1257771e-02 3.9150257e-07 2.0881621e-06 4.4488683e-01]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [9.2579685e-03 9.8400962e-01 6.6699432e-03 1.2184319e-07 6.2332008e-05]
Word 16 score: [3.7165014e-03 9.7657067e-01 9.8673406e-04 2.7091979e-04 1.8455278e-02]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
------
614
your reservation for omega ou ##zer ##i on 03 / 08 / 2016 at 7 ##pm was confirmed for two guests .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
615
can you find me a vega ##n restaurant with wheelchair access in berkeley , ca
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-restauranttype I-restauranttype O O O O O B-city O B-state
Real slot label: O O O O O B-restauranttype I-restauranttype O O O O O B-city O B-state
Score: 
Word 5 score: [0.00460796 0.96343464 0.00460796 0.01367473 0.01367473]
Word 6 score: [3.2301926e-07 9.3463653e-01 3.2301926e-07 3.2681398e-02 3.2681398e-02]
Word 12 score: [1.9936834e-08 3.2908804e-04 1.2501283e-08 9.9967086e-01 9.9042268e-08]
Word 14 score: [9.4854313e-10 9.9778479e-01 1.6294709e-07 2.2135691e-03 1.5357127e-06]
------
616
i ' m happy to assist you ! what time and date would you like your reservation for ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O
Score: 
------
617
next tuesday , between 6 ##pm and 7 ##pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date I-date O B-starttime I-starttime I-starttime I-starttime I-starttime I-starttime
Real slot label: B-date I-date O B-starttime I-starttime I-starttime I-starttime I-starttime I-starttime
Score: 
Word 0 score: [0.02913396 0.39300287 0.00945292 0.52113175 0.04727848]
Word 1 score: [0.0060361  0.06237444 0.0626175  0.004612   0.86436003]
Word 3 score: [6.6241705e-06 1.1540394e-01 7.3272461e-01 1.5037306e-01 1.4917057e-03]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [3.58101651e-02 2.83570238e-03 4.21464392e-05 1.02285296e-04
 9.61209714e-01]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
------
618
how many guests are in your party ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
619
2
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
620
i would suggest cha - ya , herb ##ivo ##re , or sanctuary bis ##tro . would you like to book one of these ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 3 score: [9.926932e-12 1.000000e+00 3.522242e-08 1.851205e-08 7.541920e-12]
Word 4 score: [6.6693991e-01 3.3297721e-01 1.0991297e-05 6.3967935e-05 7.9186975e-06]
Word 5 score: [2.0966241e-05 9.9997079e-01 3.5004086e-07 7.8694220e-06 1.1306506e-10]
Word 7 score: [1.7982953e-04 2.0230411e-02 1.8032051e-06 9.7954559e-01 4.2325686e-05]
Word 8 score: [9.9969566e-01 2.0031880e-06 1.4005003e-10 3.0219616e-04 6.1982966e-08]
Word 9 score: [3.51762809e-02 8.69958997e-02 1.21784415e-05 8.77815068e-01
 6.18108402e-07]
Word 12 score: [9.7496720e-04 5.3013885e-01 5.3311180e-07 4.6886250e-01 2.3173836e-05]
Word 13 score: [9.9010229e-01 5.0746027e-04 4.6807756e-05 9.3390942e-03 4.2922884e-06]
Word 14 score: [8.3237135e-01 1.5681344e-01 9.6950760e-05 1.0717286e-02 1.0401347e-06]
------
621
sanctuary bis ##tro
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [2.7537915e-01 3.0312255e-01 2.6677922e-06 9.4244475e-05 4.2140141e-01]
Word 1 score: [9.9740016e-01 3.2461676e-04 5.8366300e-06 2.2683451e-03 1.1094853e-06]
Word 2 score: [9.31417227e-01 6.49379715e-02 1.28577785e-05 3.63160949e-03
 2.92837541e-07]
------
622
i am so sorry , i am unable to book a reservation at the sanctuary bis ##tro . may i suggest three other restaurants that you may choose from . 1 . gr ##ac ##ias mad ##re 2 . k ##ru ##a thai and 3 . millennium would you like to try one of these on the 15th ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname O O O O O O O O O O O O
Score: 
Word 14 score: [3.4465516e-04 5.5672342e-01 4.4305162e-07 4.4292074e-01 1.0679255e-05]
Word 15 score: [9.8860210e-01 5.0765700e-03 1.7854441e-05 6.3030650e-03 3.2423802e-07]
Word 16 score: [9.3610990e-01 5.9955351e-02 2.1880136e-05 3.9125304e-03 3.2575321e-07]
Word 39 score: [0.2 0.2 0.2 0.2 0.2]
Word 40 score: [0.2 0.2 0.2 0.2 0.2]
Word 41 score: [0.2 0.2 0.2 0.2 0.2]
Word 42 score: [0.10220171 0.04941445 0.10220171 0.0538216  0.6923606 ]
Word 46 score: [1.0015751e-06 9.5803970e-01 1.7025560e-08 4.1958820e-02 4.6677002e-07]
------
623
let ' s try millennium !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O B-restaurantname O
Real slot label: O O O O B-restaurantname O
Score: 
Word 4 score: [1.7620486e-07 9.5250106e-01 1.4389232e-08 4.7495101e-02 3.6928170e-06]
------
624
i ' m sorry , the previous agent was incorrect . the only vega ##n restaurant in berkeley proper with availability at your chosen time is aj ##anta restaurant , offering vega ##n indian cuisine . would you like to book ?
Predicted label: ['inform', 'confirm_question']
Real label: ['inform', 'confirm_question']
Predicted slot label: O O O O O O O O O O O O O B-restauranttype I-restauranttype O O B-city O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O O B-restauranttype I-restauranttype B-cuisine O O O O O O O O
Real slot label: O O O O O O O O O O O O O B-restauranttype I-restauranttype O O B-city O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O O B-restauranttype I-restauranttype B-cuisine O O O O O O O O
Score: 
Word 13 score: [0.14249036 0.70747936 0.14249036 0.00377001 0.00377001]
Word 14 score: [0.02859244 0.7960694  0.02859244 0.07337285 0.07337285]
Word 17 score: [9.4923653e-06 5.7598683e-03 6.7129845e-06 9.9422282e-01 1.1082525e-06]
Word 26 score: [0.2 0.2 0.2 0.2 0.2]
Word 27 score: [0.2 0.2 0.2 0.2 0.2]
Word 28 score: [3.0801503e-12 9.1089928e-01 2.3401836e-03 8.6760558e-02 6.0389892e-15]
Word 31 score: [0.10394166 0.78863364 0.10394166 0.00174152 0.00174152]
Word 32 score: [2.2024948e-07 9.9884957e-02 2.2024948e-07 4.5005733e-01 4.5005733e-01]
Word 33 score: [9.4473083e-03 8.6141622e-01 3.3565562e-02 9.4997682e-02 5.7329214e-04]
------
625
yes , book that pl ##s
Predicted label: ['confirm_answer']
Real label: ['request', 'confirm_answer']
Predicted slot label: O O O O O O
Real slot label: O O O O O O
Score: 
------
626
success ! your reservation has been confirmed , please enjoy your meal !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O B-closing I-closing I-closing I-closing I-closing
Real slot label: O O O O O O O O B-closing I-closing I-closing I-closing I-closing
Score: 
Word 8 score: [1.5071878e-01 3.9671317e-02 8.0910081e-01 5.0904258e-04 3.1204552e-09]
Word 9 score: [1.2137529e-03 1.2388074e-02 9.8587263e-01 5.2543101e-04 1.7777023e-08]
Word 10 score: [1.34428155e-05 9.95824099e-01 4.16241912e-03 2.87133643e-18
 2.87133643e-18]
Word 11 score: [2.2673792e-05 1.2865357e-05 3.1129332e-04 8.1342912e-01 1.8622407e-01]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
------
627
hello , i was wondering if you can tell me where a good restaurant is to book ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O
Score: 
------
628
sure , i ' d be happy to help ! can you give me the city , please ?
Predicted label: ['request']
Real label: ['request', 'greeting']
Predicted slot label: O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O
Score: 
------
629
hi ! need reservations for bu ##ca di be ##pp ##o inside the ball ##y ' s casino on 3 / 21 at 7 pm please for two guests .
Predicted label: ['request', 'greeting']
Real label: ['request']
Predicted slot label: O O O O O B-mealtype I-mealtype I-mealtype I-mealtype I-mealtype I-mealtype O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O B-mealtype I-mealtype I-mealtype I-mealtype I-mealtype I-mealtype O O O O O O O O O O O O O O O O O O O
Score: 
Word 5 score: [9.5009001e-04 1.1305857e-06 1.0369661e-03 9.9316071e-07 9.9801081e-01]
Word 6 score: [9.9978429e-01 1.6212597e-04 3.3261219e-07 3.1607258e-05 2.1540181e-05]
Word 7 score: [9.7380322e-01 4.9684990e-05 2.4091680e-02 8.2264101e-04 1.2327888e-03]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
------
630
hello ; can you confirm the city and state of the ball ##ys ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O
Score: 
------
631
las vegas nevada
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city I-city O
Real slot label: B-city I-city O
Score: 
Word 0 score: [1.03071485e-04 2.28979826e-01 1.30618354e-02 3.80184647e-05
 7.57817268e-01]
Word 1 score: [1.0000000e+00 4.3711913e-17 4.3711913e-17 4.3711913e-17 4.3711913e-17]
------
632
thank you so much for booking with us ! your reservation has been confirmed as requested . please enjoy your meal !
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks', 'closing']
Predicted slot label: O O O O O O O O O O O O O O O O O O B-closing I-closing I-closing O
Real slot label: O O O O O O O O O O O O O O O O O O B-closing I-closing I-closing O
Score: 
Word 18 score: [8.4995106e-03 3.5680003e-02 9.5438075e-01 1.4396288e-03 9.7597791e-08]
Word 19 score: [8.3012577e-07 9.9292725e-01 7.0718839e-03 2.2973324e-18 2.2973324e-18]
Word 20 score: [3.1499768e-04 1.0908659e-05 1.3790876e-03 3.9022890e-01 6.0806608e-01]
------
633
i ' d like to reserve a table for 4 at wild ginger seattle in seattle for march 15th ; i prefer 6 : 00 pm if available .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O B-city O B-date I-date O O O O O O O O O O
Real slot label: O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O B-city O B-date I-date O O O O O O O O O O
Score: 
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.00363997 0.01788411 0.8645958  0.06589461 0.04798559]
Word 12 score: [5.8913636e-01 7.3947045e-03 9.5718475e-11 4.3581953e-04 4.0303320e-01]
Word 13 score: [7.5904950e-02 3.1125594e-03 3.9590460e-01 5.2505493e-01 2.2989281e-05]
Word 15 score: [6.3324437e-02 4.8081283e-04 2.1246471e-01 7.2282547e-01 9.0450898e-04]
Word 17 score: [9.5267396e-06 8.5981327e-01 5.7229254e-02 3.4534577e-02 4.8413433e-02]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
------
634
i have successfully booked your reservation . enjoy !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-closing O
Real slot label: O O O O O O O B-closing O
Score: 
Word 7 score: [1.7759718e-01 4.9279793e-03 8.0925947e-01 2.0186173e-05 8.1951814e-03]
------
635
i would like a restaurant in seattle on march 20th at 7 pm for 3 people .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O B-city O B-date I-date O O O O B-numberofpeople O O
Real slot label: O O O O O O B-city O B-date I-date O O O O B-numberofpeople O O
Score: 
Word 6 score: [9.4923310e-02 5.9991563e-04 2.5250517e-02 8.7888265e-01 3.4362258e-04]
Word 8 score: [9.2804648e-06 8.4659034e-01 9.0506256e-02 3.5498980e-02 2.7395148e-02]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
------
636
hi . what type of cuisine are you looking for ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
637
mexican
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-cuisine
Real slot label: B-cuisine
Score: 
Word 0 score: [0.00189237 0.95151156 0.01239765 0.03324313 0.00095529]
------
638
here are 3 of the top rated mexican restaurants in seattle : del ##i bao , corn ##eli ##o , la gr ##el ##ha . would you like to book one of those or would you prefer more options ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O B-rating I-rating O O O O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O
Real slot label: O O O O O B-rating I-rating O O O O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O
Score: 
Word 5 score: [1.6181137e-04 1.6617338e-03 1.6334819e-06 4.9908745e-01 4.9908745e-01]
Word 6 score: [9.4714165e-01 4.4623486e-04 3.8444994e-10 6.6936942e-12 5.2412160e-02]
Word 12 score: [3.5788831e-01 1.8615411e-19 9.4071705e-19 6.1142138e-14 6.4211172e-01]
Word 13 score: [2.7172898e-03 3.1940383e-19 3.7834826e-16 8.2333765e-13 9.9728274e-01]
Word 14 score: [1.6958236e-08 9.9999917e-01 8.4656131e-07 1.1403302e-08 8.6944468e-15]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [8.7798107e-01 7.8484381e-04 3.5998792e-06 1.0154978e-01 1.9680733e-02]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
------
639
please book la gr ##el ##ha
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 2 score: [9.8123175e-01 2.1343505e-04 8.0874061e-06 5.8422564e-03 1.2704586e-02]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
------
640
i ' m sorry , that one is n ' t available through online booking . would you like to try one of the other options ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
641
can you book del ##i bao
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O B-restaurantname I-restaurantname I-restaurantname
Real slot label: O O O B-restaurantname I-restaurantname I-restaurantname
Score: 
Word 3 score: [1.1139971e-01 4.4577709e-19 1.8245667e-18 6.3138303e-14 8.8860029e-01]
Word 4 score: [1.6030205e-03 3.8543312e-18 7.1399314e-16 2.5138734e-12 9.9839693e-01]
Word 5 score: [2.9163095e-08 9.9999917e-01 8.6030775e-07 1.6840360e-08 1.0187392e-14]
------
642
i ' m sorry , that one is n ' t available through online booking . would you like to try another option ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
643
can you book hard rock cafe ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O B-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O B-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 3 score: [8.7454910e-06 8.4444927e-08 5.7104556e-03 1.0358031e-01 8.9070046e-01]
Word 4 score: [5.8338791e-01 6.1875327e-10 4.1661215e-01 7.4568511e-12 2.7825502e-08]
Word 5 score: [2.5096431e-02 2.4010378e-03 5.3611216e-03 2.0181476e-10 9.6714139e-01]
------
644
success ! i was able to book you a table for 3 at hard rock cafe on 3 / 20 at 7 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O B-numberofpeople O O O O O B-date I-date I-date O B-starttime I-starttime O
Real slot label: O O O O O O O O O O O B-numberofpeople O O O O O B-date I-date I-date O B-starttime I-starttime O
Score: 
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
------
645
hello
Predicted label: ['greeting']
Real label: ['greeting']
Predicted slot label: O
Real slot label: O
Score: 
------
646
hi , would you like to make a reservation ?
Predicted label: ['request']
Real label: ['confirm_question']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
647
i ' d like a table for 4 at ass ##ag ##gio in seattle on march 16th at 5 ##pm .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O B-city O B-date I-date O B-starttime I-starttime O
Real slot label: O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O B-city O B-date I-date O B-starttime I-starttime O
Score: 
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [7.0221178e-02 2.0245096e-04 1.0813456e-01 8.1899071e-01 2.4511162e-03]
Word 15 score: [2.2151984e-05 6.4033157e-01 8.4447660e-02 1.0872620e-01 1.6647241e-01]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
------
648
what name would you like to book the reservation under ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
649
david lynch
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname I-personfullname
Real slot label: B-personfullname I-personfullname
Score: 
Word 0 score: [4.6382821e-04 3.3183683e-06 9.9953187e-01 9.4874031e-07 7.9919950e-08]
Word 1 score: [1.0298495e-03 1.1446680e-02 9.8752350e-01 1.5882927e-10 2.3567551e-11]
------
650
hi . i ' ve booked your restaurant for tomorrow . thank you .
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O O B-date O O O O
Real slot label: O O O O O O O O O B-date O O O O
Score: 
Word 9 score: [3.4252232e-01 6.5686530e-01 5.0303304e-09 6.3005979e-07 6.1175704e-04]
------
651
book me a table for 2 in seattle for tomorrow at 7 : 00 pm at ma ##m ##no ##on
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O O O B-date O B-starttime I-starttime I-starttime I-starttime O B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: O O O O O B-numberofpeople O O O B-date O B-starttime I-starttime I-starttime I-starttime O B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [5.8030474e-01 9.0070494e-02 1.1559142e-06 2.9909593e-06 3.2962066e-01]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [1.3335929e-02 9.8496014e-01 1.6400836e-03 1.7858135e-07 6.3643427e-05]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
------
652
hi . i ' ve booked your restaurant for tomorrow . thank you .
Predicted label: ['inform']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O O B-date O O O O
Real slot label: O O O O O O O O O B-date O O O O
Score: 
Word 9 score: [3.9386886e-01 6.0576683e-01 1.2261261e-08 9.9645433e-07 3.6325699e-04]
------
653
may i book a five star place for wednesday at 1 : 30 ##pm for 2 people in seattle ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O B-rating I-rating O O B-date O B-starttime I-starttime I-starttime I-starttime O B-numberofpeople O O B-city O
Real slot label: O O O O B-rating I-rating O O B-date O B-starttime I-starttime I-starttime I-starttime O B-numberofpeople O O B-city O
Score: 
Word 4 score: [2.7103350e-04 1.7862688e-09 9.9972743e-01 5.0857108e-07 1.0194537e-06]
Word 5 score: [6.5568143e-05 9.6063308e-02 3.7137443e-01 5.2250358e-05 5.3244442e-01]
Word 8 score: [1.0747603e-06 1.8604996e-02 9.5883173e-01 1.1281056e-02 1.1281056e-02]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [3.7423261e-02 2.0411721e-04 2.8382349e-01 6.7795575e-01 5.9335621e-04]
------
654
any preference on cuisine or food type ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
655
is there ph ##o ?
Predicted label: ['inform']
Real label: ['request']
Predicted slot label: O O B-cuisine I-cuisine O
Real slot label: O O B-cuisine I-cuisine O
Score: 
Word 2 score: [4.3322697e-01 8.5756811e-04 3.9733060e-02 2.2685335e-06 5.2618009e-01]
Word 3 score: [9.9734953e-03 9.6834832e-01 4.3054027e-09 1.9060932e-08 2.1678135e-02]
------
656
i found two places specializing in ph ##o , jenny ph ##o , and what the ph ##o . which would you like to try ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O B-cuisine I-cuisine O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O
Real slot label: O O O O O O B-cuisine I-cuisine O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O
Score: 
Word 6 score: [7.0911974e-01 2.0321405e-03 1.5610130e-01 1.3254487e-05 1.3273361e-01]
Word 7 score: [4.1300768e-01 2.1111636e-01 4.4401702e-02 6.1737104e-05 3.3141252e-01]
Word 9 score: [1.4579275e-08 9.9992192e-01 7.0873968e-05 8.8165137e-07 6.3701586e-06]
Word 10 score: [9.5013902e-02 6.2531340e-01 5.8676733e-07 7.1722883e-07 2.7967131e-01]
Word 11 score: [8.9797743e-02 3.6533847e-02 2.1334107e-07 5.5571665e-08 8.7366807e-01]
Word 14 score: [1.2072800e-06 1.8755674e-04 2.4940173e-06 9.9980873e-01 3.0712211e-08]
Word 15 score: [1.6363132e-04 1.4573640e-01 8.2004368e-01 1.2720139e-04 3.3929076e-02]
Word 16 score: [4.3078817e-02 7.3789366e-02 1.6646529e-08 5.9569750e-08 8.8313174e-01]
Word 17 score: [2.7136082e-02 4.2849146e-02 5.8907204e-09 3.4560621e-08 9.3001473e-01]
------
657
jenny ph ##o please
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname O
Real slot label: B-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 0 score: [3.6640067e-02 9.6292049e-01 4.3874589e-04 5.6639288e-07 8.7520384e-08]
Word 1 score: [6.2157349e-03 9.9148965e-01 3.4841063e-10 9.2096188e-09 2.2946277e-03]
Word 2 score: [1.4783627e-01 4.1896704e-01 2.0537558e-09 4.8371135e-08 4.3319669e-01]
------
658
unfortunately , this restaurant is not on the open ##table reservation network . to see if they take reservations and have availability , you will need to call the restaurant directly or visit their website .
Predicted label: ['multiple_choice']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
659
hi . i just moved to seattle , wa and i ' m dying to find a place that i can have a good meal with some nice live music . the type of restaurant matters less than if they have good food and live entertainment . my gal and a couple of her buddies ( so 4 of
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O B-restauranttype I-restauranttype I-restauranttype I-restauranttype I-restauranttype I-restauranttype O O O O O O O O O O O B-numberofpeople O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O B-restauranttype I-restauranttype I-restauranttype I-restauranttype I-restauranttype I-restauranttype O O O O O O O O O O O B-numberofpeople O
Score: 
Word 40 score: [5.2591105e-05 8.6664277e-01 1.2723531e-01 5.2591105e-05 6.0167164e-03]
Word 41 score: [1.4718823e-03 1.4273867e-03 1.6608061e-05 9.9693620e-01 1.4785558e-04]
Word 42 score: [1.4024192e-05 4.1984893e-07 9.9779153e-01 2.1507156e-03 4.3304131e-05]
Word 43 score: [1.6571518e-02 5.7814219e-03 1.8265055e-04 2.0935895e-06 9.7746229e-01]
Word 44 score: [3.9728519e-02 1.4266352e-01 7.0842621e-03 2.7526830e-06 8.1052095e-01]
Word 45 score: [6.5231672e-04 7.7973539e-01 4.6550176e-05 2.1878472e-01 7.8105449e-04]
Word 57 score: [0.2 0.2 0.2 0.2 0.2]
------
660
what time would you like the reservation to be for ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
661
i was thinking 7 : 30 or 8 ##pm , depending on what ' s available .
Predicted label: ['inform']
Real label: ['multiple_choice']
Predicted slot label: O O O O O O O B-starttime I-starttime O O O O O O O O
Real slot label: O O O O O O O B-starttime I-starttime O O O O O O O O
Score: 
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
------
662
do you have a pricing range in mind ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
663
something between $ 20 - 50 , so probably mid - tier .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O B-pricing I-pricing I-pricing I-pricing I-pricing I-pricing I-pricing I-pricing I-pricing I-pricing I-pricing O
Real slot label: O B-pricing I-pricing I-pricing I-pricing I-pricing I-pricing I-pricing I-pricing I-pricing I-pricing I-pricing O
Score: 
Word 1 score: [1.3437494e-06 2.1959324e-01 1.0666614e-02 7.6440012e-01 5.3386176e-03]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [3.0214480e-01 1.2288599e-06 6.9605100e-01 5.8998330e-04 1.2130103e-03]
Word 8 score: [9.1155236e-08 5.7317723e-14 4.5025690e-06 1.1889922e-08 9.9999535e-01]
Word 9 score: [8.1960124e-01 1.3644850e-03 1.2984005e-02 1.6605031e-01 4.1444184e-17]
Word 10 score: [1.0000000e+00 1.1492371e-09 4.5346676e-10 1.2290211e-09 9.1574226e-31]
Word 11 score: [9.9999988e-01 2.2517206e-08 1.2233056e-08 7.2461638e-08 1.2788407e-27]
------
664
sure ! here are a few ideas : 1 ) royal room , 2 ) capitol cid ##er , and 3 ) the pink door . would you like to book one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O B-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname I-restaurantname O O O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O O O O B-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname I-restaurantname O O O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 10 score: [1.2730931e-06 2.1171800e-04 8.6087680e-01 9.4307018e-03 1.2947957e-01]
Word 11 score: [7.4545335e-04 3.5643959e-01 1.7653815e-06 6.4007384e-01 2.7393699e-03]
Word 15 score: [1.3152699e-06 5.3468702e-10 9.8910296e-01 1.0893328e-02 2.3724649e-06]
Word 16 score: [9.9565238e-01 4.3430296e-03 6.6763306e-07 3.6941951e-06 2.3520943e-07]
Word 17 score: [7.0596784e-01 2.9120344e-01 2.8267526e-03 1.3674594e-06 5.5134717e-07]
Word 22 score: [8.1709679e-03 4.1853273e-03 9.8762709e-01 2.9890350e-06 1.3736834e-05]
Word 23 score: [1.9863932e-05 6.1895287e-07 9.9989307e-01 8.6416418e-05 5.4791802e-09]
Word 24 score: [3.1316292e-06 9.9999690e-01 1.2949398e-10 4.5763254e-10 2.4241080e-09]
------
665
i ' d like to try to royal room , so long as there will be live music .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O B-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 7 score: [1.5557641e-06 3.8184432e-04 7.2750169e-01 1.7220512e-02 2.5489438e-01]
Word 8 score: [6.1655918e-04 8.2116425e-02 3.0009073e-07 9.1579229e-01 1.4744686e-03]
------
666
i ' m sorry , our system is unable to book this restaurant . would you like to try another one ?
Predicted label: ['request', 'inform']
Real label: ['multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
667
okay . please try the capitol cid ##er restaurant next , and i guess if not the royal room .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O
Score: 
------
668
your reservation at the capitol cid ##er for 03 / 11 / 2016 was confirmed for 4 people at 7 : 30 ##pm . enjoy your meal .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O B-date I-date I-date I-date I-date O O O B-numberofpeople O O O O O O O B-closing I-closing I-closing O
Real slot label: O O O O O O O O B-date I-date I-date I-date I-date O O O B-numberofpeople O O O O O O O B-closing I-closing I-closing O
Score: 
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [7.2706707e-02 5.2908394e-03 9.2024124e-01 1.6654667e-05 1.7446470e-03]
Word 25 score: [1.7819739e-05 9.8553699e-01 1.4445149e-02 5.2635499e-20 5.2635499e-20]
Word 26 score: [4.1845538e-05 2.5666936e-06 1.3879816e-04 7.0944607e-01 2.9037076e-01]
------
669
i ' d like to reserve a table for 4 at the pink door in seattle for march 16th , i prefer 9 : 00 pm if available .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O B-city O B-date I-date O O O O O O O O O O
Real slot label: O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O B-city O B-date I-date O O O O O O O O O O
Score: 
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [1.8624905e-02 1.4621812e-02 9.6653593e-01 6.7296038e-05 1.5010113e-04]
Word 12 score: [7.9199155e-05 7.0665988e-07 9.9982220e-01 9.7919976e-05 4.3223189e-08]
Word 13 score: [1.7360029e-05 9.9998260e-01 2.0773534e-10 1.3917274e-10 7.5395540e-10]
Word 15 score: [5.6066878e-02 4.3590655e-04 1.7335917e-01 7.6931226e-01 8.2579278e-04]
Word 17 score: [1.0500537e-05 8.3830285e-01 6.2735796e-02 4.1500799e-02 5.7450142e-02]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
------
670
there is a table available for your requested date and restaurant ; what name would you like the reservation under ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O
Score: 
------
671
mike hunt
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname I-personfullname
Real slot label: B-personfullname I-personfullname
Score: 
Word 0 score: [2.7599322e-07 9.2014432e-01 3.0474624e-02 1.8906070e-02 3.0474624e-02]
Word 1 score: [1.5680414e-02 1.2274265e-10 7.0202322e-04 9.8361731e-01 2.8918069e-07]
------
672
your reservation has been confirmed . please enjoy your meal , and thank you for using our service !
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O B-closing I-closing I-closing O O O O O O O O O
Real slot label: O O O O O O O B-closing I-closing I-closing O O O O O O O O O
Score: 
Word 7 score: [1.7813575e-02 2.4571549e-02 9.5683044e-01 7.8398263e-04 4.1002988e-07]
Word 8 score: [1.5235570e-05 9.9932432e-01 6.6050945e-04 2.8708291e-19 2.8708291e-19]
Word 9 score: [1.4437993e-08 4.5661199e-09 1.2374421e-07 5.1351404e-01 4.8648584e-01]
------
673
book me a table for 2 in seattle for tomorrow at 7 : 00 pm at ri ##stor ##ante do ##ria
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [2.7476115e-02 2.0615685e-04 3.5463877e-02 9.3628126e-01 5.7263445e-04]
Word 9 score: [6.9282198e-01 7.5214110e-02 1.1862752e-06 3.5684286e-06 2.3195919e-01]
Word 16 score: [9.9826318e-01 1.7368119e-03 2.3047656e-08 2.3047656e-08 2.3047656e-08]
Word 17 score: [9.85094547e-01 1.49054965e-02 4.43303129e-14 4.43303129e-14
 4.43303129e-14]
Word 18 score: [9.9361837e-01 6.3808989e-03 2.5350832e-07 2.5350832e-07 2.5350832e-07]
Word 19 score: [9.9527538e-01 9.9663466e-10 2.1051405e-09 4.6572010e-03 6.7401517e-05]
Word 20 score: [9.9741191e-01 1.3836277e-09 2.3141764e-09 2.5354119e-03 5.2674412e-05]
------
674
your reservation at ri ##stor ##ante do ##ria for 03 / 08 / 2016 at 7 ##pm for two people was confirmed .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date I-date I-date O B-starttime I-starttime O O O O O O
Real slot label: O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date I-date I-date O B-starttime I-starttime O O O O O O
Score: 
Word 3 score: [9.9819773e-01 1.8023031e-03 7.7291418e-09 7.7291418e-09 7.7291418e-09]
Word 4 score: [9.6958655e-01 3.0413399e-02 5.8507467e-15 5.8507467e-15 5.8507467e-15]
Word 5 score: [9.9160755e-01 8.3924448e-03 1.5686821e-08 1.5686821e-08 1.5686821e-08]
Word 6 score: [9.9699068e-01 1.2056133e-08 1.0767173e-08 2.9775556e-03 3.1731997e-05]
Word 7 score: [9.9660373e-01 3.3469014e-08 1.3916081e-08 3.3745114e-03 2.1714692e-05]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
------
675
please book a table for 4 in seattle for tomorrow at 8 : 30 pm at alt ##ura under the name gary me ##hi ##gan
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname O O O B-personfullname I-personfullname I-personfullname I-personfullname
Real slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname O O O B-personfullname I-personfullname I-personfullname I-personfullname
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [9.2960782e-02 1.0211410e-03 5.6275833e-01 3.4318346e-01 7.6323951e-05]
Word 9 score: [7.56348968e-01 1.27653360e-01 1.46024908e-08 4.67260378e-07
 1.15997165e-01]
Word 16 score: [9.9286903e-03 7.7593862e-04 7.9802787e-01 1.9126749e-01 3.1217547e-13]
Word 17 score: [7.5176835e-01 5.0222734e-04 2.4359138e-01 4.1380338e-03 1.5374815e-12]
Word 21 score: [5.3696937e-07 1.9209089e-02 5.9865206e-04 9.6098268e-01 1.9209089e-02]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
------
676
success ! your reservation has been confirmed . please enjoy your meal !
Predicted label: ['inform']
Real label: ['inform', 'closing']
Predicted slot label: O O O O O O O O O B-closing I-closing I-closing O
Real slot label: O O O O O O O O O B-closing I-closing I-closing O
Score: 
Word 9 score: [2.5270449e-03 3.3408392e-02 9.6284378e-01 1.2207457e-03 1.8769114e-08]
Word 10 score: [6.3868310e-07 9.9621671e-01 3.7826076e-03 8.9660993e-18 8.9660993e-18]
Word 11 score: [6.8506786e-05 1.8225866e-05 7.7267515e-04 6.3590151e-01 3.6323911e-01]
------
677
i would like to find a american steak house in dallas which is casual dress
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O B-cuisine B-food O O O O O B-dress_code O
Real slot label: O O O O O O B-cuisine B-food O O O O O B-dress_code O
Score: 
Word 6 score: [2.0393583e-03 1.0491213e-10 3.8786806e-04 9.9338222e-01 4.1905772e-03]
Word 7 score: [8.0067676e-01 1.4067405e-05 1.8296749e-05 3.4101396e-07 1.9929051e-01]
Word 13 score: [7.2410955e-07 1.0463935e-06 1.0886897e-02 9.8909235e-01 1.8961633e-05]
------
678
when would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
679
tom ##mo ##row if po ##ssi ##be
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
680
what time would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
681
around 7 would be good
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-starttime I-starttime O O O
Real slot label: B-starttime I-starttime O O O
Score: 
Word 0 score: [9.9999464e-01 3.3507554e-06 2.2503662e-07 2.2503662e-07 1.4965366e-06]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
------
682
how many are going ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
683
6
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
684
texas de brazil - dallas , perry ' s steak ##house & grille - uptown , and texas de brazil - addison are the top 3 restaurants in your preferred cuisine with available seating . may i book one of these options for you ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O O O O O O
Score: 
Word 6 score: [1.0639449e-07 2.9938978e-09 6.5680601e-02 9.2051095e-01 1.3808374e-02]
Word 7 score: [0.5080887  0.00176526 0.36200267 0.00083258 0.12731071]
Word 8 score: [9.9912101e-01 1.4030957e-06 8.5017000e-08 1.4023144e-06 8.7604375e-04]
Word 9 score: [1.08190506e-16 1.08881548e-23 6.28037233e-22 3.09835717e-20
 1.00000000e+00]
Word 10 score: [1.18420844e-16 1.04387715e-23 5.85149504e-22 2.93698167e-20
 1.00000000e+00]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [8.9827375e-13 2.5037025e-12 9.9999881e-01 4.2525137e-08 1.1414212e-06]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [8.1543782e-04 8.3557630e-01 2.9777354e-02 3.3068812e-07 1.3383061e-01]
Word 17 score: [9.9992490e-01 2.1970898e-07 5.6280700e-05 1.8659573e-05 6.7902815e-11]
Word 18 score: [1.8694875e-01 1.3537790e-03 8.0300254e-01 7.9207144e-05 8.6156409e-03]
Word 19 score: [9.8111690e-04 6.0084945e-01 3.3769399e-01 1.6809368e-05 6.0458645e-02]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [6.1681327e-05 8.5799700e-05 2.8198689e-02 9.7158742e-01 6.6448105e-05]
------
685
perry ' s steak ##house & grille - uptown
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [1.6936430e-03 7.8674973e-05 1.6583340e-01 1.7230375e-01 6.6009057e-01]
Word 1 score: [7.1004599e-01 5.5479957e-04 2.1556440e-01 4.8010881e-04 7.3354684e-02]
Word 2 score: [9.9954093e-01 7.0435948e-07 4.5069605e-08 8.4149133e-07 4.5754827e-04]
Word 3 score: [3.0325980e-17 1.0470272e-24 2.4288005e-23 5.8003823e-21 1.0000000e+00]
Word 4 score: [2.9712208e-17 1.0134053e-24 2.2029692e-23 5.7640978e-21 1.0000000e+00]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [2.4000664e-13 3.9224811e-13 9.9999940e-01 1.0095891e-08 6.3703453e-07]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [5.8946555e-04 8.7305796e-01 3.3083338e-02 3.2043565e-07 9.3268916e-02]
------
686
i have successfully booked your reservation at perry ' s steak ##house & grille - uptown for tomorrow at 7 . enjoy !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O B-closing O
Real slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O B-closing O
Score: 
Word 7 score: [4.0828560e-08 5.0882347e-09 3.0198079e-01 5.7915735e-01 1.1886183e-01]
Word 8 score: [8.4000272e-01 8.6404943e-05 4.7283534e-02 1.8997026e-04 1.1243731e-01]
Word 9 score: [9.9955231e-01 4.4612637e-08 1.2475862e-08 2.1833192e-07 4.4748315e-04]
Word 10 score: [2.0077472e-16 2.3385462e-22 4.3832525e-22 4.3089371e-19 1.0000000e+00]
Word 11 score: [2.2380019e-16 2.4717128e-22 4.8636968e-22 4.4906984e-19 1.0000000e+00]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [2.8021791e-11 1.7882291e-12 9.9997890e-01 2.0788988e-07 2.0918318e-05]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [1.4098550e-03 8.8378519e-01 8.0889151e-02 4.9370465e-07 3.3915315e-02]
Word 21 score: [2.0026868e-02 1.2736213e-02 9.6556163e-01 2.6985264e-05 1.6483889e-03]
------
687
make a reservation for 2 on friday , march 11th at 6 ##pm at long ##horn steak ##house .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O B-numberofpeople O B-date I-date I-date I-date O B-starttime I-starttime O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O B-numberofpeople O B-date I-date I-date I-date O B-starttime I-starttime O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [4.0958464e-02 7.8367162e-04 4.5311575e-05 9.5594943e-01 2.2631097e-03]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [6.2920147e-04 7.9457814e-01 4.3095265e-02 1.4865974e-01 1.3037624e-02]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [1.1066693e-02 2.0625428e-03 7.4498944e-06 9.8686278e-01 5.3033483e-07]
Word 15 score: [1.2377881e-04 8.8394572e-06 2.1580932e-07 9.9986720e-01 4.6721782e-10]
Word 16 score: [3.6579856e-16 4.3640972e-23 8.7391850e-21 8.1218971e-20 1.0000000e+00]
Word 17 score: [5.0760530e-16 1.6414539e-23 4.2670742e-21 3.3336523e-20 1.0000000e+00]
------
688
i ' m happy to assist you ! what city are you dining in ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O
Score: 
------
689
can you find me a chinese restaurant in san diego on march 10th at 5 : 00pm ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-cuisine O O B-city I-city O B-date I-date O B-starttime I-starttime I-starttime O
Real slot label: O O O O O B-cuisine O O B-city I-city O B-date I-date O B-starttime I-starttime I-starttime O
Score: 
Word 5 score: [9.82779205e-01 7.18916417e-05 3.48616391e-03 1.35595575e-02
 1.03175254e-04]
Word 8 score: [1.0528452e-06 2.0520084e-01 7.9479688e-01 6.5678466e-07 5.3717895e-07]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [1.4878303e-05 7.4873310e-01 6.2443204e-02 7.4791767e-02 1.1401708e-01]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
------
690
how many are going ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
691
3 people
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople O
Real slot label: B-numberofpeople O
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
692
do you have a price range in mind ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
693
medium please
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-pricing O
Real slot label: B-pricing O
Score: 
Word 0 score: [8.7099648e-01 1.0169417e-01 2.5753003e-02 1.7817203e-05 1.5385293e-03]
------
694
i ' m not finding a lot of chinese restaurants that are available for online booking . i have found jasmine seafood restaurant with the key ##words : jasmine seafood restaurant , dim sum , fresh seafood , best chinese san diego , ke ##ar ##ny mesa , convoy . it is highly rated . would you like to
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'confirm_question']
Predicted slot label: O O O O O O O O B-cuisine O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O B-cuisine O O O O O O O O O O O O B-rating I-rating O O O O O
Real slot label: O O O O O O O O B-cuisine O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O B-cuisine O O O O O O O O O O O O B-rating I-rating O O O O O
Score: 
Word 8 score: [9.9895132e-01 4.5605088e-05 3.1802358e-04 6.6987815e-04 1.5146626e-05]
Word 20 score: [7.6885669e-07 9.9999845e-01 2.3504734e-07 5.9348429e-07 4.6311444e-09]
Word 21 score: [6.0160157e-05 3.7131426e-03 9.6466887e-04 1.9339466e-06 9.9526006e-01]
Word 22 score: [7.9714894e-11 2.4908420e-01 4.8359983e-02 7.0255584e-01 4.5307619e-18]
Word 28 score: [6.4385193e-07 9.9999845e-01 2.5915023e-07 6.5091854e-07 6.5626407e-09]
Word 29 score: [3.3455246e-05 6.1808655e-04 2.0427945e-04 5.3047864e-07 9.9914360e-01]
Word 30 score: [2.3905002e-13 5.1349854e-01 5.4134298e-03 4.8108798e-01 1.6588136e-16]
Word 39 score: [8.7413430e-01 6.7681109e-04 4.5079891e-09 4.9509432e-02 7.5679421e-02]
Word 52 score: [4.0298773e-04 4.5879865e-06 6.1634136e-03 9.9342442e-01 4.5879865e-06]
Word 53 score: [0.39802456 0.02129598 0.0034712  0.00764261 0.56956565]
------
695
how about ja ##si ##mine seafood restaurant
Predicted label: ['request']
Real label: ['inform']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
696
great ! i have booked that reservation for you . thank you .
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O O O B-closing I-closing O
Real slot label: O O O O O O O O O O B-closing I-closing O
Score: 
Word 10 score: [2.4839479e-03 4.0799861e-07 9.9734443e-01 7.9154272e-10 1.7128522e-04]
Word 11 score: [1.8249504e-01 1.3532202e-03 4.5079626e-02 5.9086253e-04 7.7048129e-01]
------
697
i ' d like to reserve a table for 2 at the capital grille in seattle for march 14th , i prefer 7 : 00 pm if available .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O B-numberofpeople O O B-restaurantname I-restaurantname O B-city O B-date I-date O O O O O O O O O O
Real slot label: O O O O O O O O O B-numberofpeople O O B-restaurantname I-restaurantname O B-city O B-date I-date O O O O O O O O O O
Score: 
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [7.7913725e-10 2.0816571e-10 4.6171754e-11 9.9999976e-01 1.9007601e-07]
Word 13 score: [7.9243634e-12 2.4379654e-09 9.9998653e-01 1.2674468e-05 8.3545530e-07]
Word 15 score: [3.4485105e-02 2.9774575e-04 9.4163857e-02 8.7051511e-01 5.3819758e-04]
Word 17 score: [8.3442610e-06 8.5656220e-01 5.7169005e-02 3.9063737e-02 4.7196675e-02]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
------
698
there is a table available for your requested date and restaurant ; what name would you like the reservation under ?
Predicted label: ['request', 'inform']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O
Score: 
------
699
hunt . . . ( \ u2 ##0 ##22 _ \ u2 ##0 ##22 ) \ / ( \ u2 ##0 ##22 _ \ u2 ##0 ##22 ) > \ u2 ##31 ##0 \ u2 ##5 ##a ##0 - \ u2 ##5 ##a ##0 \ / ( \ u2 ##31 ##0 \ u2 ##5 ##a ##0 _ \ u2
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
700
( – _ a – ) i have successfully booked your reservation at the capital grille for 7 ##pm on march 14th . enjoy , mike ( – _ a – )
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O B-restaurantname I-restaurantname O B-starttime I-starttime O B-date I-date O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O B-restaurantname I-restaurantname O B-starttime I-starttime O B-date I-date O O O O O O O O O O O
Score: 
Word 15 score: [5.3173715e-10 9.9630137e-11 2.2371740e-12 9.9999988e-01 1.3798198e-07]
Word 16 score: [1.4439548e-11 3.7598724e-10 9.9999213e-01 4.4678900e-06 3.4999312e-06]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [5.1476836e-06 7.1273077e-01 3.8615163e-02 1.9694729e-02 2.2895415e-01]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
------
701
i ' d like to reserve a table at mi pueblo in pet ##al ##uma , ca . 4 people , wednesday at 5 ##pm
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O B-restaurantname I-restaurantname O B-city I-city I-city I-city I-city O B-numberofpeople O O B-date O B-starttime I-starttime
Real slot label: O O O O O O O O O B-restaurantname I-restaurantname O B-city I-city I-city I-city I-city O B-numberofpeople O O B-date O B-starttime I-starttime
Score: 
Word 9 score: [3.1939277e-04 9.6346653e-01 9.6178256e-09 3.6213804e-02 3.8565179e-07]
Word 10 score: [9.9999630e-01 6.8519302e-07 5.1992782e-07 3.6006588e-07 2.1210476e-06]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [2.5308702e-09 9.8886430e-01 1.2951753e-07 1.1135407e-02 2.6313245e-07]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [6.7532557e-07 1.1072730e-03 9.8402691e-01 7.4325507e-03 7.4325507e-03]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
------
702
i ' m sorry , our system is unable to book that restaurant . is there any other way i can help you ?
Predicted label: ['inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
703
can you find me a restaurant in pet ##al ##uma that you can book for that time ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O B-city I-city I-city O O O O O O O O
Real slot label: O O O O O O O B-city I-city I-city O O O O O O O O
Score: 
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
------
704
here are a few options : bis ##tro 100 , central market , and dr ##e ' s bar & grill .
Predicted label: ['inform']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 6 score: [8.4142506e-01 1.5848553e-01 2.0049889e-05 6.5535365e-05 3.8247863e-06]
Word 7 score: [9.7895598e-01 1.5522855e-03 4.7145120e-05 1.9408189e-02 3.6422378e-05]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [7.47965574e-01 1.13762205e-07 2.41055891e-01 3.57787968e-07
 1.09781409e-02]
Word 11 score: [5.4160995e-07 2.1826746e-03 9.9623507e-01 1.0752757e-04 1.4742034e-03]
Word 14 score: [7.0070138e-07 1.4653403e-05 5.5595581e-09 9.9994135e-01 4.3324490e-05]
Word 15 score: [1.2553328e-09 7.6369759e-13 1.7762557e-09 9.9999976e-01 1.7588884e-07]
Word 16 score: [9.9987292e-01 2.1849111e-07 5.3174491e-09 2.7991902e-07 1.2657406e-04]
Word 17 score: [9.99878049e-01 1.99198780e-07 4.49545245e-09 2.74976884e-07
 1.21494675e-04]
Word 18 score: [5.5394118e-04 9.3931174e-09 7.2906784e-07 2.3361275e-04 9.9921179e-01]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [6.5943087e-19 1.3542357e-19 1.3973837e-04 3.4918493e-17 9.9986029e-01]
------
705
i ' ll try dr ##e ' s bar & grill
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 4 score: [2.8955034e-07 9.6880399e-07 2.0797748e-09 9.9999499e-01 3.7872849e-06]
Word 5 score: [2.1923620e-10 1.6637154e-13 2.0024908e-10 1.0000000e+00 4.0571852e-08]
Word 6 score: [9.9982637e-01 4.3059234e-07 8.5992031e-09 4.0531421e-07 1.7285137e-04]
Word 7 score: [9.9979466e-01 5.5461453e-07 9.8890061e-09 4.4871840e-07 2.0445505e-04]
Word 8 score: [8.4489235e-04 1.3603618e-08 1.2434750e-06 4.6686540e-04 9.9868697e-01]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [2.5502774e-19 6.7151369e-20 2.0098539e-04 2.0659100e-17 9.9979907e-01]
------
706
i have successfully completed your reservation at dr ##e ' s bar & grill for 4 people on 3 / 9 at 5 ##pm . enjoy !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O B-numberofpeople O O B-date I-date I-date O B-starttime I-starttime O B-closing O
Real slot label: O O O O O O O O O O O O O O O B-numberofpeople O O B-date I-date I-date O B-starttime I-starttime O B-closing O
Score: 
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [7.2950915e-02 4.5615891e-03 9.1225660e-01 9.8311948e-06 1.0221126e-02]
------
707
find me a an independent best restaurant in des moines , iowa
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O B-restauranttype I-restauranttype I-restauranttype I-restauranttype O B-city I-city O B-state
Real slot label: O O O B-restauranttype I-restauranttype I-restauranttype I-restauranttype O B-city I-city O B-state
Score: 
Word 3 score: [1.2615743e-03 2.1541239e-01 1.9524387e-05 3.0693606e-10 7.8330660e-01]
Word 4 score: [1.7733737e-07 6.6606673e-14 9.9999988e-01 1.6320941e-08 1.2798967e-13]
Word 5 score: [1.0000000e+00 4.1552015e-10 3.3247479e-21 1.0397518e-08 4.3010107e-09]
Word 6 score: [2.0910309e-09 5.2524999e-02 4.3963215e-01 5.0784284e-01 2.2998394e-21]
Word 8 score: [3.0748926e-03 1.2196534e-06 9.9692386e-01 5.3355143e-10 3.8609826e-10]
Word 9 score: [0.23036553 0.06412901 0.6250028  0.02332441 0.05717825]
Word 11 score: [1.3529586e-14 9.8285991e-01 4.0598970e-06 1.7135985e-02 7.3269129e-14]
------
708
here are the restaurants i found matching your request . please select one : 1 ) centro - rating : 4 out of 5 . 2 ) dj ##ango restaurant - rating : 4 out of 5 . 3 ) alba restaurant - rating : 4 . 5 out of 5 .
Predicted label: ['inform', 'multiple_choice']
Real label: ['multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
709
can you book centro this friday at 7 ##pm for 2 ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O B-restaurantname O B-date O B-starttime I-starttime O B-numberofpeople O
Real slot label: O O O B-restaurantname O B-date O B-starttime I-starttime O B-numberofpeople O
Score: 
Word 3 score: [9.7826296e-01 2.8753484e-06 2.1728337e-02 2.5239824e-08 5.6917515e-06]
Word 5 score: [2.87741950e-05 8.30689169e-06 1.01794085e-05 9.60451663e-01
 3.95009778e-02]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
------
710
i want to eat in seattle for a party of 4 bb ##q please tomorrow at 1 ##pm
Predicted label: ['request']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O B-numberofpeople B-mealtype I-mealtype O B-date O B-starttime I-starttime
Real slot label: O O O O O O O O O O B-numberofpeople B-mealtype I-mealtype O B-date O B-starttime I-starttime
Score: 
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [2.0435905e-07 3.0466965e-10 8.7357056e-01 1.2517516e-01 1.2540803e-03]
Word 12 score: [1.2455441e-15 1.4275825e-22 9.9905676e-01 9.4320212e-04 4.0953768e-12]
Word 14 score: [7.2177976e-02 3.0415461e-03 7.3723150e-08 2.2484912e-06 9.2477816e-01]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
------
711
here are 3 of the top bb ##q places in seattle : hole in the wall bb ##q , ro ##ro bb ##q & grill , and the bar ##be ##que pit . would you like to try one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['multiple_choice']
Predicted slot label: O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 12 score: [1.1611565e-10 2.4705952e-07 3.6720965e-06 2.2113282e-13 9.9999607e-01]
Word 13 score: [3.6768171e-05 1.0987536e-06 1.7814142e-05 1.8429189e-05 9.9992597e-01]
Word 14 score: [0.00169687 0.01806373 0.00167867 0.01031507 0.9682456 ]
Word 15 score: [2.3616994e-10 9.3424910e-01 1.0236540e-11 6.3124497e-07 6.5750152e-02]
Word 16 score: [3.3164482e-09 1.5385204e-15 9.8488772e-01 1.5104484e-02 7.7193281e-06]
Word 17 score: [2.2737292e-09 1.3660111e-15 9.8208976e-01 1.7900258e-02 9.9578865e-06]
Word 19 score: [1.5567514e-09 9.9999988e-01 5.9779396e-08 7.2465882e-09 3.7337221e-15]
Word 20 score: [8.7037718e-01 1.2373237e-01 5.8628884e-03 2.7591748e-05 1.5456527e-13]
Word 21 score: [2.0459103e-09 7.4018636e-16 9.8471099e-01 1.5285588e-02 3.3813797e-06]
Word 22 score: [1.7159156e-09 1.1962272e-15 9.7955167e-01 2.0436432e-02 1.1859850e-05]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [5.6107310e-15 2.4098979e-15 5.3857203e-04 3.6484981e-13 9.9946147e-01]
Word 27 score: [3.5013445e-02 1.6136127e-02 9.4842398e-01 1.6261783e-04 2.6379601e-04]
Word 28 score: [6.7421329e-01 1.4793881e-07 1.0859552e-01 1.0859552e-01 1.0859552e-01]
Word 29 score: [0.08221003 0.17657647 0.24707115 0.24707115 0.24707115]
Word 30 score: [0.17817907 0.2301845  0.19721214 0.19721214 0.19721214]
Word 31 score: [1.2930969e-05 1.6609338e-04 1.9434723e-09 9.9980801e-01 1.2930969e-05]
------
712
can you try hole in the wall bb ##q what a name !
Predicted label: ['request']
Real label: ['inform']
Predicted slot label: O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O
Real slot label: O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O
Score: 
Word 3 score: [2.4036021e-11 1.6302580e-09 1.2553984e-08 1.0974068e-13 1.0000000e+00]
Word 4 score: [6.5992358e-09 4.8093551e-09 4.5450798e-07 1.6733240e-07 9.9999940e-01]
Word 5 score: [0.0024921  0.09883598 0.00963617 0.00544461 0.8835911 ]
Word 6 score: [3.7934544e-10 9.3975687e-01 5.7933564e-11 5.5059087e-07 6.0242563e-02]
Word 7 score: [1.2241645e-09 9.7559475e-17 9.8831230e-01 1.1682260e-02 5.3913532e-06]
Word 8 score: [8.9499730e-10 1.1282001e-16 9.8502940e-01 1.4968353e-02 2.2180895e-06]
------
713
unfortunately i ca n ' t book that restaurant . would you like to try jack ' s bb ##q instead ?
Predicted label: ['inform', 'confirm_question']
Real label: ['multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O
Real slot label: O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O
Score: 
Word 15 score: [7.4939057e-06 9.9621707e-01 5.1262413e-07 1.0837025e-07 3.7748108e-03]
Word 16 score: [5.0258623e-03 9.4785899e-01 8.1774415e-06 4.4769436e-04 4.6659302e-02]
Word 17 score: [1.0499712e-01 7.8887880e-01 7.8274215e-06 8.7695499e-04 1.0523932e-01]
Word 18 score: [5.2600363e-10 2.1441682e-13 6.3892148e-02 7.8614473e-02 8.5749346e-01]
Word 19 score: [8.5999885e-10 4.8171146e-13 7.5822733e-02 9.2517480e-02 8.3165979e-01]
------
714
where is the restaurant mag ##gia ##nos
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O B-restauranttype I-restauranttype I-restauranttype
Real slot label: O O O O B-restauranttype I-restauranttype I-restauranttype
Score: 
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
------
715
what city are you located in ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
716
reserve a table for 2 at 8 ##pm saturday night at a romantic restaurant in wilmington , nc
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O B-numberofpeople O B-starttime I-starttime B-date I-date O O B-atmosphere O O B-city I-city I-city
Real slot label: O O O O B-numberofpeople O B-starttime I-starttime B-date I-date O O B-atmosphere O O B-city I-city I-city
Score: 
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [3.4179931e-05 4.6268953e-05 7.1660202e-04 9.9756134e-01 1.6416140e-03]
Word 9 score: [9.1894428e-13 5.0000000e-01 1.9912730e-12 5.0000000e-01 1.6675936e-15]
Word 12 score: [5.8432572e-05 9.3878949e-01 8.2179635e-05 6.0592432e-02 4.7743547e-04]
Word 15 score: [3.8533264e-05 3.0367738e-07 6.1212801e-03 3.4683120e-02 9.5915669e-01]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [1.0000000e+00 1.0430789e-12 1.0430789e-12 1.0430789e-12 1.0430789e-12]
------
717
i ' m happy to assist you ! do you have a specific restaurant or cuisine in mind ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O
Score: 
------
718
it ##ilia ##n
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-cuisine I-cuisine I-cuisine
Real slot label: B-cuisine I-cuisine I-cuisine
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
------
719
angelo ' s pi ##zz ##eria & bis ##tro , os ##ter ##ia ci ##cc ##hett ##i , and os ##ter ##ia ci ##cc ##hett ##i - monkey junction are all italian restaurants with available seating . would you like to book one of these options ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-cuisine O O O O O O O O O O O O O O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-cuisine O O O O O O O O O O O O O O O
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.35562626 0.00134322 0.21293901 0.00353925 0.42655215]
Word 2 score: [9.9809700e-01 1.0187720e-06 4.2563510e-08 4.5087199e-06 1.8975671e-03]
Word 3 score: [5.3463926e-16 3.3376022e-14 5.3724155e-02 7.1990279e-15 9.4627589e-01]
Word 4 score: [7.3213314e-16 4.3668042e-14 3.9653435e-02 7.7381830e-15 9.6034658e-01]
Word 5 score: [7.3628164e-16 4.3176122e-14 4.0165525e-02 7.3433538e-15 9.5983452e-01]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [6.1593950e-01 3.5616171e-01 1.6757856e-04 2.7727840e-02 3.4767686e-06]
Word 8 score: [6.8853116e-01 2.8060260e-01 1.8372547e-04 3.0679446e-02 3.1441507e-06]
Word 19 score: [9.9999821e-01 1.7502307e-06 5.8726746e-10 5.8726746e-10 5.8726746e-10]
Word 20 score: [9.9997628e-01 2.3716069e-05 3.7717805e-17 3.7717805e-17 3.7717805e-17]
Word 21 score: [9.5669383e-01 4.3301795e-02 1.4524173e-06 1.4524173e-06 1.4524173e-06]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
Word 26 score: [0.2 0.2 0.2 0.2 0.2]
Word 27 score: [8.9394258e-13 1.8950682e-14 2.9553479e-01 1.2631310e-04 7.0433891e-01]
Word 28 score: [9.9069631e-01 9.2600286e-03 1.4230064e-05 6.6997068e-06 2.2845521e-05]
Word 31 score: [6.4525265e-01 2.1923337e-07 5.2596192e-06 5.9795257e-06 3.5473582e-01]
------
720
os ##ter ##ia ci ##cc ##hett ##i - monkey junction
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [2.7408120e-01 1.0029135e-04 2.4193951e-01 2.4193951e-01 2.4193951e-01]
Word 1 score: [9.9984455e-01 1.5536691e-04 6.0362004e-18 6.0362004e-18 6.0362004e-18]
Word 2 score: [9.3547750e-01 6.4522460e-02 5.0625153e-09 5.0625153e-09 5.0625153e-09]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [2.53883091e-12 3.35859109e-15 7.65336037e-01 1.19696015e-04
 2.34544277e-01]
Word 9 score: [9.7891939e-01 2.1072550e-02 6.4749802e-06 2.6711854e-07 1.4459874e-06]
------
721
your reservation is confirmed ! please enjoy your meal , and thank you for using our service .
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O B-closing I-closing I-closing O O O O O O O O O
Real slot label: O O O O O O B-closing I-closing I-closing O O O O O O O O O
Score: 
Word 6 score: [1.9106792e-02 2.3066541e-02 9.5616961e-01 1.6563887e-03 6.7396485e-07]
Word 7 score: [3.6374593e-05 9.9955910e-01 4.0448067e-04 9.0387672e-18 9.0387672e-18]
Word 8 score: [8.1149253e-08 4.9235375e-08 1.0628753e-06 7.1223134e-01 2.8776747e-01]
------
722
hi , i ' m looking for a table for 6 at morgan street brewery in saint louis this friday at 5 : 30 pm
Predicted label: ['request', 'greeting']
Real label: ['request']
Predicted slot label: O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O B-city I-city B-date I-date O O O O O
Real slot label: O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O B-city I-city B-date I-date O O O O O
Score: 
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [1.45286085e-05 9.20504611e-03 7.13723451e-02 2.58083101e-02
 8.93599749e-01]
Word 13 score: [3.8837093e-06 2.2841044e-05 3.1380814e-03 1.5862784e-04 9.9667656e-01]
Word 14 score: [6.6136839e-03 8.2995415e-01 1.6317692e-01 2.5423709e-04 9.9988097e-07]
Word 16 score: [8.7176108e-01 3.9123870e-02 2.9723017e-04 6.9494992e-02 1.9322814e-02]
Word 17 score: [4.5605825e-06 1.9668702e-09 9.9999547e-01 4.8810879e-08 2.2856688e-09]
Word 18 score: [1.6977940e-05 1.9304405e-04 9.9976844e-01 1.0732659e-08 2.1559365e-05]
Word 19 score: [1.1697935e-04 1.4828690e-05 4.1230282e-06 9.8916745e-01 1.0696582e-02]
------
723
unfortunately i can not book reservations at that restaurant . would you like to try someplace else ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O
Score: 
------
724
are there any brewery restaurants in saint louis you can ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O B-restauranttype I-restauranttype O B-city I-city O O O
Real slot label: O O O B-restauranttype I-restauranttype O B-city I-city O O O
Score: 
Word 3 score: [1.4114426e-04 5.3813681e-02 8.5943395e-01 8.6585857e-02 2.5458899e-05]
Word 4 score: [0.03350815 0.47497523 0.00239576 0.43297827 0.05614257]
Word 6 score: [0.27249855 0.07570115 0.10638881 0.54273283 0.00267868]
Word 7 score: [5.6817416e-06 2.7396386e-11 9.9999428e-01 3.3377938e-09 9.6755118e-11]
------
725
it looks like i can book the square one brewery & distillery if you are interested in that one .
Predicted label: ['inform']
Real label: ['confirm_question']
Predicted slot label: O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O
Real slot label: O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O
Score: 
Word 9 score: [1.2652372e-03 9.5309460e-01 4.4307102e-02 1.3329559e-03 2.4936911e-08]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [8.1780960e-04 9.9741888e-01 1.8751158e-10 1.4678133e-04 1.6165491e-03]
------
726
yes that would be perfect !
Predicted label: ['confirm_answer']
Real label: ['confirm_answer']
Predicted slot label: O O O O O O
Real slot label: O O O O O O
Score: 
------
727
your reservation was confirmed , enjoy your meal
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O B-closing I-closing I-closing
Real slot label: O O O O O B-closing I-closing I-closing
Score: 
Word 5 score: [2.5601327e-01 7.7752797e-03 7.2954488e-01 4.3277636e-05 6.6232947e-03]
Word 6 score: [3.6251597e-06 9.8919684e-01 1.0799565e-02 8.0027075e-21 8.0027075e-21]
Word 7 score: [4.1151055e-05 6.8601189e-06 5.2145799e-04 5.7426155e-01 4.2516902e-01]
------
728
hello , i was wondering if you can tell me where a good restaurant is to book ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O
Score: 
------
729
i sure can ! if you would let me know what city you are located in and a type of food you would like i would be glad to help you find and book a restaurant .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
730
hello , i was wondering if you can tell me where a good restaurant is to book ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O
Score: 
------
731
sure ! do you have a specific restaurant or cuisine in mind ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O
Score: 
------
732
where can i find good vegetarian chili ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-food I-food O
Real slot label: O O O O O B-food I-food O
Score: 
Word 5 score: [1.1670248e-02 9.5471027e-09 1.9406872e-03 9.8550123e-01 8.8790653e-04]
Word 6 score: [3.4177792e-01 2.8015613e-08 1.4877089e-03 1.2056037e-07 6.5673417e-01]
------
733
what city and state would you like me to look ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
734
please look in birmingham , alabama
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O B-city O B-state
Real slot label: O O O B-city O B-state
Score: 
Word 3 score: [3.6800839e-02 2.7021110e-01 6.1261153e-04 6.2713420e-01 6.5241218e-02]
Word 5 score: [1.5356190e-05 2.0490086e-03 3.2217324e-09 9.9750072e-01 4.3495471e-04]
------
735
i ' m happy to assist you ! how many guests are in your party ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O
Score: 
------
736
there will be two of us .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
737
what time and date would you like your reservation for ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
738
0 . 79 ##16 ##66 ##66 ##7
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
739
and what date would you like to book ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
740
book me a table for 2 in seattle for tomorrow at 7 : 00 pm at la med ##usa
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname
Real slot label: O O O O O O O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname
Score: 
Word 7 score: [2.3905069e-02 2.1839519e-04 3.5264701e-02 9.4022208e-01 3.8968888e-04]
Word 9 score: [7.4463665e-01 1.1494983e-01 1.2445852e-06 4.4266330e-06 1.4040790e-01]
Word 16 score: [8.7052989e-01 4.8233039e-04 7.0710657e-06 6.8647631e-02 6.0333062e-02]
Word 17 score: [5.1907815e-11 4.1740145e-07 2.3840498e-07 2.0332279e-11 9.9999928e-01]
Word 18 score: [4.1009680e-09 1.4743064e-06 1.8089553e-05 1.2074660e-11 9.9998045e-01]
------
741
your reservation is booked for tomorrow . thank you .
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
742
find me a place for a lunch ##eon known for it ' s coffee
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O B-mealtype I-mealtype O O O O O O
Real slot label: O O O O O O B-mealtype I-mealtype O O O O O O
Score: 
Word 6 score: [9.2870408e-01 1.5837232e-04 7.0434608e-02 5.4448983e-04 1.5837232e-04]
Word 7 score: [9.9204832e-01 1.2602289e-04 7.6368181e-03 6.2714171e-05 1.2602289e-04]
------
743
what city are you located in ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
744
seattle
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city
Real slot label: B-city
Score: 
Word 0 score: [7.1310699e-01 1.1612017e-04 1.9865239e-01 8.7868527e-02 2.5596344e-04]
------
745
do you have a price range or specific cuisine in mind ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O
Score: 
------
746
mid - range not too fancy
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-pricing I-pricing I-pricing B-cuisine I-cuisine I-cuisine
Real slot label: B-pricing I-pricing I-pricing B-cuisine I-cuisine I-cuisine
Score: 
Word 0 score: [0.01217326 0.24695669 0.24695669 0.24695669 0.24695669]
Word 1 score: [1.0000000e+00 3.8519613e-24 3.8519613e-24 3.8519613e-24 3.8519613e-24]
Word 2 score: [1.000000e+00 7.279113e-21 7.279113e-21 7.279113e-21 7.279113e-21]
Word 3 score: [4.2971396e-06 9.9651766e-01 6.4862529e-06 1.4191073e-06 3.4701254e-03]
Word 4 score: [9.9996221e-01 1.8890676e-05 3.5272723e-08 1.8890676e-05 3.5272723e-08]
Word 5 score: [1.1475000e-01 2.5722262e-05 7.8010529e-02 2.4947397e-07 8.0721349e-01]
------
747
what date would you like me to look for a reservation ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O
Score: 
------
748
thursday evening
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date I-date
Real slot label: B-date I-date
Score: 
Word 0 score: [0.07273247 0.7666224  0.08307695 0.04964064 0.02792753]
Word 1 score: [0.0145068  0.00234705 0.17568718 0.4992125  0.30824652]
------
749
how many people are going ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O
Real slot label: O O O O O O
Score: 
------
750
three or four
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O
Real slot label: O O O
Score: 
------
751
what time would you like me to search for ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
752
between 1 ##pm and 2 : 30
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-starttime I-starttime I-starttime I-starttime I-starttime I-starttime I-starttime
Real slot label: B-starttime I-starttime I-starttime I-starttime I-starttime I-starttime I-starttime
Score: 
Word 0 score: [0.03602105 0.4468366  0.0434061  0.47220358 0.00153273]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [5.5666775e-02 2.2773582e-03 4.0034072e-05 8.4918967e-05 9.4193083e-01]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
------
753
what name would you like to book the reservation under ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
754
roger sc ##hmi ##tty
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname I-personfullname I-personfullname I-personfullname
Real slot label: B-personfullname I-personfullname I-personfullname I-personfullname
Score: 
Word 0 score: [0.2729897  0.6621359  0.01646429 0.01484189 0.0335682 ]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
------
755
great . i ' ve booked your reservation . thank you .
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O O B-closing I-closing O
Real slot label: O O O O O O O O O B-closing I-closing O
Score: 
Word 9 score: [3.6137437e-03 1.1768078e-07 9.9634993e-01 8.9358682e-10 3.6140365e-05]
Word 10 score: [6.2355733e-01 3.1724356e-03 1.5280163e-02 3.4950869e-04 3.5764062e-01]
------
756
i need a cozy spot for my date tomorrow .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O B-atmosphere O O O B-occasion B-date O
Real slot label: O O O B-atmosphere O O O B-occasion B-date O
Score: 
Word 3 score: [4.6004626e-04 9.7489561e-04 6.0247989e-05 9.9844450e-01 6.0247989e-05]
Word 7 score: [9.8156112e-01 5.6350965e-04 5.2396340e-06 3.0193926e-04 1.7568128e-02]
Word 8 score: [2.02443883e-01 3.66716050e-02 7.14004216e-07 1.27265175e-05
 7.60871053e-01]
------
757
where are you located ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
758
dallas .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city O
Real slot label: B-city O
Score: 
Word 0 score: [0.0664387  0.6477382  0.00171142 0.10330424 0.18080746]
------
759
what type of cuisine would you like ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
760
chinese .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-cuisine O
Real slot label: B-cuisine O
Score: 
Word 0 score: [3.5778707e-01 1.4026149e-04 6.3858706e-01 2.5715407e-03 9.1400073e-04]
------
761
at what time would you like to din ##e ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
762
8 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-starttime I-starttime O
Real slot label: B-starttime I-starttime O
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
------
763
how many people will be dining ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
764
3
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
765
can i have a name for the reservation ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
766
mike ,
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname O
Real slot label: B-personfullname O
Score: 
Word 0 score: [2.0816315e-06 9.2253804e-01 3.1516377e-02 1.4427130e-02 3.1516377e-02]
------
767
i ' ve found some good choices - but can i clarify that you want a cozy spot for a date , but want to a reservation for 3 people ?
Predicted label: ['request', 'inform']
Real label: ['confirm_question']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
768
yes .
Predicted label: ['confirm_answer']
Real label: ['confirm_answer']
Predicted slot label: O O
Real slot label: O O
Score: 
------
769
some good choices are cannon chinese kitchen , new china grille and yao fu ##zi cuisine . would you like to try one of these ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 4 score: [0.92915505 0.04314637 0.00204717 0.02115813 0.00449321]
Word 5 score: [6.1369193e-01 2.9367437e-03 3.1216084e-06 2.9331529e-01 9.0052888e-02]
Word 6 score: [1.8589642e-12 9.9999607e-01 3.8938060e-06 1.5137830e-11 5.6397825e-10]
Word 8 score: [6.3330488e-05 3.0284089e-03 5.0170725e-09 6.2766087e-10 9.9690825e-01]
Word 9 score: [2.8621584e-05 1.4863522e-06 8.3232623e-01 1.6743293e-01 2.1071421e-04]
Word 10 score: [1.8526481e-11 1.8568721e-11 9.9999678e-01 3.1187196e-07 2.8692859e-06]
Word 12 score: [1.2102093e-06 6.0283611e-07 7.2022252e-05 9.9992621e-01 2.6788183e-10]
Word 13 score: [4.7501818e-08 1.3963092e-05 9.9998605e-01 2.3731600e-12 2.3731600e-12]
Word 14 score: [2.1054360e-04 1.2876251e-02 9.8691016e-01 1.5222179e-06 1.5222179e-06]
Word 15 score: [1.2888970e-06 9.9323761e-01 3.9839432e-07 6.7607006e-03 2.3268348e-10]
------
770
yao fu ##zi cuisine
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [0.36052018 0.00197246 0.10590746 0.5280154  0.00358441]
Word 1 score: [3.2538344e-07 1.9158742e-05 9.9998045e-01 3.4454658e-13 3.4454658e-13]
Word 2 score: [9.2992239e-04 2.1668065e-02 9.7740084e-01 6.2309641e-07 6.2309641e-07]
Word 3 score: [1.2096657e-08 9.9984407e-01 2.9408225e-09 1.5595263e-04 2.4337353e-12]
------
771
your reservation at yao fu ##zi cuisine was confirmed for 03 / 08 / 2016 for 8 ##pm with 3 guests under the name mike . enjoy your meal !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-date I-date I-date I-date I-date O B-starttime I-starttime O B-numberofpeople O O O O B-personfullname O B-closing I-closing I-closing O
Real slot label: O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-date I-date I-date I-date I-date O B-starttime I-starttime O B-numberofpeople O O O O B-personfullname O B-closing I-closing I-closing O
Score: 
Word 3 score: [3.1966323e-07 1.0003380e-06 4.8691854e-05 9.9995005e-01 1.3956449e-11]
Word 4 score: [1.0694141e-07 6.0316113e-05 9.9993956e-01 3.4435052e-13 3.4435052e-13]
Word 5 score: [2.4710127e-04 9.8562561e-02 9.0118951e-01 4.4154001e-07 4.4154001e-07]
Word 6 score: [6.3101908e-08 9.9955112e-01 1.8080170e-08 4.4871253e-04 5.2272019e-12]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [1.2842803e-06 1.7748958e-03 3.3744204e-01 3.2333970e-01 3.3744204e-01]
Word 26 score: [2.4528867e-02 1.1133265e-02 9.6394968e-01 3.0696821e-05 3.5756847e-04]
Word 27 score: [9.1030552e-06 9.8532945e-01 1.4661427e-02 4.4441335e-20 4.4441335e-20]
Word 28 score: [1.2851788e-05 2.2596701e-06 1.0148743e-04 8.1654376e-01 1.8333964e-01]
------
772
would you happen to have any idea what the best rated su ##shi place around is ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O B-rating I-rating B-cuisine I-cuisine O O O O
Real slot label: O O O O O O O O O B-rating I-rating B-cuisine I-cuisine O O O O
Score: 
Word 9 score: [1.0000000e+00 1.5357137e-11 6.9384069e-16 1.0246043e-09 1.4699247e-09]
Word 10 score: [9.6687818e-01 2.4260102e-05 1.0100607e-08 4.1532167e-10 3.3097629e-02]
Word 11 score: [3.4737612e-05 3.2592084e-02 8.7513627e-08 6.3116598e-04 9.6674192e-01]
Word 12 score: [8.6293239e-03 1.0822566e-02 2.6091625e-04 1.1493427e-03 9.7913796e-01]
------
773
i ' m happy to assist you ! what city are you dining in ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O
Score: 
------
774
i will be dining in hartford , ct . i would like a table for 2 at 6 ##pm tomorrow if available .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O B-city O O O O O O O O O B-numberofpeople O B-starttime I-starttime B-date O O O
Real slot label: O O O O O B-city O O O O O O O O O B-numberofpeople O B-starttime I-starttime B-date O O O
Score: 
Word 5 score: [2.0446655e-04 1.1763634e-03 2.7636250e-05 3.8897782e-04 9.9820256e-01]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [1.7670067e-05 6.2241954e-01 4.4038576e-10 1.2710494e-07 3.7756264e-01]
------
775
feng asian bis ##tro is a pan - asian restaurant in hartford with a table open at 6 ##pm . would you like to book ?
Predicted label: ['inform', 'confirm_question']
Real label: ['inform', 'confirm_question']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O B-city O O O O O B-starttime I-starttime O O O O O O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O B-city O O O O O B-starttime I-starttime O O O O O O O
Score: 
Word 0 score: [7.0439698e-03 1.6876178e-05 2.6963082e-01 2.0100380e-01 5.2230453e-01]
Word 1 score: [1.7459340e-03 1.0193401e-04 1.1466255e-01 1.3373289e-04 8.8335586e-01]
Word 2 score: [5.7975757e-01 4.0288058e-01 1.6611622e-04 1.7186988e-02 8.7235458e-06]
Word 3 score: [6.7875290e-01 3.0523381e-01 1.0709499e-04 1.5889712e-02 1.6463158e-05]
Word 11 score: [9.5718005e-04 1.1793458e-02 3.4199815e-04 5.2105566e-03 9.8169690e-01]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
------
776
yes , please book that table for me . thank you .
Predicted label: ['confirm_answer', 'thanks']
Real label: ['confirm_answer', 'thanks']
Predicted slot label: O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O
Score: 
------
777
your reservation has been confirmed . please enjoy your meal , and thank you for using our service !
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O
Score: 
------
778
hello , i was wondering if you can tell me where a good restaurant is to book ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O
Score: 
------
779
i can if you ' ll begin by telling me your location .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O
Score: 
------
780
good evening , i need to find a restaurant
Predicted label: ['greeting']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
781
what is your location ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
782
i am located in philadelphia and need to know restaurants that are vega ##n
Predicted label: ['confirm_question']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O B-restauranttype I-restauranttype
Real slot label: O O O O O O O O O O O O B-restauranttype I-restauranttype
Score: 
Word 12 score: [0.03552946 0.9164777  0.03552946 0.0062317  0.0062317 ]
Word 13 score: [5.566415e-07 9.821931e-01 5.566415e-07 8.902899e-03 8.902899e-03]
------
783
what date are you looking to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
784
i am looking to go tomorrow night march 8th
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O B-date I-date I-date I-date
Real slot label: O O O O O B-date I-date I-date I-date
Score: 
Word 5 score: [3.9046982e-01 3.3964276e-02 3.3601356e-07 7.7318355e-06 5.7555783e-01]
Word 6 score: [1.1678883e-12 5.0000000e-01 1.4011424e-12 5.0000000e-01 8.5363605e-16]
Word 7 score: [2.2032807e-04 8.6535037e-01 3.2472976e-02 8.8640518e-02 1.3315855e-02]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
------
785
what time would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
786
i would like to go around 8 ##pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O B-starttime I-starttime
Real slot label: O O O O O O B-starttime I-starttime
Score: 
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
------
787
how many are going ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
788
4
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
789
here are 3 of the top rated vega ##n restaurants in philadelphia : ve ##dge , mori ##moto restaurant , and mama ' s restaurant . would you like to book one of those or would you prefer more options ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O B-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O B-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O
Score: 
Word 13 score: [3.0458760e-03 9.9695063e-01 1.1546853e-06 1.1546853e-06 1.1546853e-06]
Word 14 score: [9.3871552e-01 6.1284076e-02 1.2070569e-07 1.2070569e-07 1.2070569e-07]
Word 16 score: [5.9034087e-02 4.0867967e-06 2.7504925e-02 2.8429609e-05 9.1342843e-01]
Word 17 score: [2.19512845e-06 1.03524042e-04 9.99887586e-01 6.55473059e-06
 1.06095776e-07]
Word 18 score: [2.9470775e-13 7.9134929e-01 2.4746344e-03 2.0617610e-01 1.3724344e-15]
Word 21 score: [0.05463025 0.02515489 0.02168156 0.88182557 0.01670768]
Word 22 score: [0.4415379  0.00396644 0.25846353 0.00388813 0.2921439 ]
Word 23 score: [9.9936813e-01 2.7558255e-07 1.9030763e-08 1.1808011e-06 6.3040684e-04]
Word 24 score: [3.9463292e-13 8.3192718e-01 2.3889251e-03 1.6568395e-01 1.2220784e-15]
------
790
i would like to book mori ##moto
Predicted label: ['inform']
Real label: ['request']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
791
your reservation for mori ##moto restaurant on 03 / 08 / 2016 at 8 ##pm for 4 guests is confirmed . enjoy your meal !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O B-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date I-date I-date O B-starttime I-starttime O B-numberofpeople O O O O B-closing I-closing I-closing O
Real slot label: O O O B-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date I-date I-date O B-starttime I-starttime O B-numberofpeople O O O O B-closing I-closing I-closing O
Score: 
Word 3 score: [2.2983070e-01 3.6204344e-06 8.8059217e-02 3.3704047e-05 6.8207276e-01]
Word 4 score: [1.9715288e-05 1.1950698e-05 9.9996161e-01 6.0189845e-06 6.3606706e-07]
Word 5 score: [3.3562774e-13 5.8365917e-01 3.6500324e-03 4.1269076e-01 5.3322054e-17]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [5.1609378e-02 4.2860555e-03 9.4332045e-01 1.6050330e-05 7.6815434e-04]
Word 22 score: [1.8077159e-05 9.7735947e-01 2.2622462e-02 9.7147329e-20 9.7147329e-20]
Word 23 score: [6.7365709e-06 5.6151798e-06 9.3119204e-05 9.0290570e-01 9.6988864e-02]
------
792
i ' m looking for an italian restaurant in the atlanta area . what are your suggestions ? tomorrow at 5 ##pm for party of 3
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O B-cuisine O O O B-city O O O O O O O B-date O B-starttime I-starttime O B-occasion O B-numberofpeople
Real slot label: O O O O O O B-cuisine O O O B-city O O O O O O O B-date O B-starttime I-starttime O B-occasion O B-numberofpeople
Score: 
Word 6 score: [9.9706322e-01 5.7153476e-10 2.2668596e-08 5.2487465e-08 2.9367271e-03]
Word 10 score: [1.2060294e-02 9.8792225e-01 6.3875841e-06 8.5625270e-06 2.4807359e-06]
Word 18 score: [4.8452654e-01 7.7337347e-02 1.8817576e-06 1.5076209e-05 4.3811917e-01]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [9.9915373e-01 1.3016367e-04 6.9820345e-04 1.6644791e-11 1.7838383e-05]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
------
793
i found the following restaurants that fit your criteria : il local ##ino , anti ##ca post ##a , vale ##nza restaurant . which one would you like to book ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O
Real slot label: O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O
Score: 
Word 10 score: [1.0000000e+00 2.4814075e-13 2.4744543e-10 2.8596925e-12 4.3890688e-10]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [7.3397692e-05 3.2945004e-01 6.5401101e-01 3.1099366e-06 1.6462466e-02]
Word 15 score: [0.04175171 0.83693576 0.05355599 0.00164787 0.06610861]
Word 16 score: [1.4951894e-04 1.9725060e-04 6.8920933e-02 3.2913447e-06 9.3072909e-01]
Word 17 score: [1.3099643e-04 1.3939604e-04 6.1998747e-02 3.7056036e-06 9.3772715e-01]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [4.5179775e-13 9.1609782e-01 1.1430072e-03 8.2759179e-02 8.8681605e-15]
------
794
anti ##ca post ##a
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [1.8378122e-07 1.0681869e-09 9.9999976e-01 1.0889168e-12 5.4737082e-08]
Word 1 score: [5.1569022e-02 6.3306159e-01 2.9704067e-01 3.0169950e-04 1.8026970e-02]
Word 2 score: [1.2425653e-06 1.8895918e-06 6.6001597e-03 1.1927028e-07 9.9339664e-01]
Word 3 score: [2.1725141e-06 3.2911619e-06 9.1461847e-03 1.5725065e-07 9.9084830e-01]
------
795
success ! i was able to book a table for 3 at anti ##ca post ##a tomorrow at 5 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname B-date O B-starttime I-starttime O
Real slot label: O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname B-date O B-starttime I-starttime O
Score: 
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [3.8626215e-05 3.4546856e-02 9.6088910e-01 3.5006570e-07 4.5250230e-03]
Word 13 score: [7.2389379e-02 6.3544387e-01 2.7747729e-01 1.5272635e-04 1.4536786e-02]
Word 14 score: [8.0868296e-07 1.5686151e-06 5.8863475e-03 1.2507944e-07 9.9411112e-01]
Word 15 score: [5.9833593e-07 1.1109350e-06 3.2187128e-03 9.7030586e-08 9.9677950e-01]
Word 16 score: [2.8540111e-07 1.6124941e-06 7.9335660e-14 2.0265081e-11 9.9999809e-01]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
------
796
book me a table for 1 in seattle for tomorrow at 7 : 00 pm at tr ##op ##ico ##s breeze
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [5.5396784e-02 2.6982711e-04 1.0693785e-01 8.3685702e-01 5.3850800e-04]
Word 9 score: [4.6858403e-01 5.1548939e-02 1.8323587e-07 1.3482990e-06 4.7986546e-01]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [5.0537378e-01 2.6757109e-03 4.9188572e-01 6.2565501e-05 2.2299962e-06]
------
797
hi . i ' ve booked your restaurant for tomorrow . thank you .
Predicted label: ['inform']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O O B-date O B-closing I-closing O
Real slot label: O O O O O O O O O B-date O B-closing I-closing O
Score: 
Word 9 score: [3.4335515e-01 6.5620571e-01 8.8129637e-09 7.7382981e-07 4.3833759e-04]
Word 11 score: [1.1134466e-02 2.6075764e-07 9.8879212e-01 4.5100557e-10 7.3130264e-05]
Word 12 score: [9.0817243e-01 1.5037318e-03 1.7693646e-02 7.7570083e-05 7.2552599e-02]
------
798
where is the ruby tuesday located on the lower end or the bill block
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O B-restaurantname I-restaurantname O O O O O O O O O
Real slot label: O O O B-restaurantname I-restaurantname O O O O O O O O O
Score: 
Word 3 score: [1.0136670e-02 9.8918798e-12 1.5035200e-04 4.7564406e-02 9.4214857e-01]
Word 4 score: [0.02217788 0.38677555 0.14460634 0.4010676  0.04537258]
------
799
i ' m happy to assist you ! what city are you dining in ?
Predicted label: ['request', 'greeting']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O
Score: 
------
800
hello , i was wondering if you can tell me where a good restaurant is to book ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O
Score: 
------
801
i ' m happy to assist you ! do you have a specific restaurant or cuisine in mind ?
Predicted label: ['request']
Real label: ['request', 'greeting']
Predicted slot label: O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O
Score: 
------
802
can you please help me with finding a restaurant and making a reservation ? i live in san diego and i really want to go to an old school italian place known for it ' s pasta tomorrow . there ' s going to be 6 of us and we ' re meeting for dinner at 6 ##pm .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O B-city I-city O O O O O O O O B-restauranttype I-restauranttype B-cuisine O O O O O O O B-date O O O O O O O B-numberofpeople O O O O O O O O B-mealtype O B-starttime I-starttime O
Real slot label: O O O O O O O O O O O O O O O O O B-city I-city O O O O O O O O B-restauranttype I-restauranttype B-cuisine O O O O O O O B-date O O O O O O O B-numberofpeople O O O O O O O O B-mealtype O B-starttime I-starttime O
Score: 
Word 17 score: [1.2183558e-06 4.0241811e-01 5.9758037e-01 2.6243916e-07 3.1591831e-08]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 27 score: [6.9014736e-06 6.0483901e-10 9.9757129e-01 2.4213553e-03 5.2385280e-07]
Word 28 score: [2.2374465e-09 1.0000000e+00 1.8604096e-14 5.9014789e-09 3.9393697e-16]
Word 29 score: [1.3469054e-01 1.3641306e-07 2.7598515e-05 1.3057126e-04 8.6515117e-01]
Word 37 score: [2.4496909e-02 1.7914397e-05 1.8149948e-06 1.3832115e-05 9.7546947e-01]
Word 45 score: [0.2 0.2 0.2 0.2 0.2]
Word 54 score: [9.9994195e-01 1.0649132e-05 1.1391916e-11 4.7440484e-05 5.2600413e-10]
Word 56 score: [0.2 0.2 0.2 0.2 0.2]
Word 57 score: [0.2 0.2 0.2 0.2 0.2]
------
803
here are 3 of the top rated italian restaurants in san diego : as ##ti ri ##stor ##ante , alexander ' s on 30th , and ba ##ci restaurant . would you like to try one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O B-rating I-rating B-cuisine O O B-city I-city O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O B-rating I-rating B-cuisine O O B-city I-city O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 5 score: [7.7876443e-04 3.6622270e-04 4.6411384e-07 4.9942726e-01 4.9942726e-01]
Word 6 score: [9.0397346e-01 3.7889072e-04 2.3405895e-05 6.4803958e-06 9.5617816e-02]
Word 7 score: [4.2274576e-02 1.5148501e-08 3.5320581e-06 1.0106372e-04 9.5762080e-01]
Word 10 score: [1.8305667e-05 7.9915398e-01 2.0082635e-01 3.9710213e-07 1.0341513e-06]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [4.9999428e-01 4.9999428e-01 1.1421772e-05 7.2966265e-11 7.2966265e-11]
Word 14 score: [4.9999082e-01 4.9999082e-01 1.8327970e-05 1.8063829e-16 1.8063829e-16]
Word 15 score: [9.9031079e-01 9.6757682e-03 4.4665903e-06 4.4665903e-06 4.4665903e-06]
Word 16 score: [9.9042964e-01 9.5668174e-03 1.2226066e-06 1.2226066e-06 1.2226066e-06]
Word 17 score: [9.9287546e-01 7.1118367e-03 4.2281163e-06 4.2281163e-06 4.2281163e-06]
Word 19 score: [4.5502367e-03 1.1886395e-01 2.3952661e-04 1.7101303e-08 8.7634623e-01]
Word 20 score: [0.00396097 0.00467009 0.98130727 0.00151179 0.00854989]
Word 21 score: [9.9841917e-01 3.2411028e-06 7.2720077e-08 3.1601135e-06 1.5742556e-03]
Word 22 score: [4.3782053e-04 1.3638407e-04 1.9769277e-03 9.7087091e-01 2.6578037e-02]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 26 score: [6.3118987e-02 9.3623161e-01 6.4489729e-04 2.2341721e-06 2.2341721e-06]
Word 27 score: [2.8228212e-07 9.9834263e-01 1.6570237e-03 1.2713505e-13 1.2713505e-13]
Word 28 score: [9.7067895e-14 8.8632429e-01 1.2189440e-03 1.1245675e-01 2.5037540e-15]
------
804
have any of these restaurants been around for a long time ? i do n ' t want any ##pl ##ace new or that just opened in the last 5 years .
Predicted label: ['request']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
805
as ##ti has been open for over 20 years ! would you like to try that one ?
Predicted label: ['inform', 'confirm_question']
Real label: ['inform', 'confirm_question']
Predicted slot label: B-restaurantname I-restaurantname O O O O O O O O O O O O O O O O
Real slot label: B-restaurantname I-restaurantname O O O O O O O O O O O O O O O O
Score: 
Word 0 score: [0.44337168 0.44337168 0.10996103 0.00164781 0.00164781]
Word 1 score: [4.9992275e-01 4.9992275e-01 1.5439170e-04 1.7057293e-16 1.7057293e-16]
------
806
that sounds perfect ! i ' m so excited for this .
Predicted label: ['confirm_answer']
Real label: ['confirm_answer']
Predicted slot label: O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O
Score: 
------
807
great ! can i have a name for the reservation ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
808
mai ##sie days
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname I-personfullname I-personfullname
Real slot label: B-personfullname I-personfullname I-personfullname
Score: 
Word 0 score: [0.00364486 0.62796646 0.12279622 0.12279622 0.12279622]
Word 1 score: [6.4129514e-01 3.5870486e-01 1.9109202e-11 1.9109202e-11 1.9109202e-11]
Word 2 score: [5.7434244e-04 1.4412405e-01 4.2762083e-01 5.9892569e-05 4.2762083e-01]
------
809
i have successfully completed your reservation for mai ##sie days at as ##ti ri ##stor ##ante on 3 / 9 at 6 ##pm for 6 guests . enjoy !
Predicted label: ['inform']
Real label: ['inform', 'closing']
Predicted slot label: O O O O O O O B-personfullname I-personfullname I-personfullname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O B-numberofpeople O O B-closing O
Real slot label: O O O O O O O B-personfullname I-personfullname I-personfullname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O B-numberofpeople O O B-closing O
Score: 
Word 7 score: [3.1929421e-01 6.8070579e-01 3.2039467e-09 3.2039467e-09 3.2039467e-09]
Word 8 score: [3.6726499e-01 6.3273501e-01 6.0533167e-12 6.0533167e-12 6.0533167e-12]
Word 9 score: [1.2564816e-03 6.8648957e-02 4.6501735e-01 5.9846909e-05 4.6501735e-01]
Word 11 score: [4.9999857e-01 4.9999857e-01 2.8989386e-06 5.1435917e-12 5.1435917e-12]
Word 12 score: [4.9999571e-01 4.9999571e-01 8.5717356e-06 1.3019598e-17 1.3019598e-17]
Word 13 score: [9.7195935e-01 2.8040346e-02 8.9318512e-08 8.9318512e-08 8.9318512e-08]
Word 14 score: [9.7672403e-01 2.3275983e-02 1.6334504e-08 1.6334504e-08 1.6334504e-08]
Word 15 score: [9.7954583e-01 2.0454133e-02 4.8977839e-08 4.8977839e-08 4.8977839e-08]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 27 score: [9.3997745e-03 1.3434746e-02 9.7110671e-01 2.0743162e-05 6.0380646e-03]
------
810
i am looking to book a table for 3 at a tex me ##x type of restaurant in san diego , ca at 3 ##pm today
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O B-numberofpeople O O B-cuisine I-cuisine I-cuisine O O O O B-city I-city O B-state O B-starttime I-starttime B-date
Real slot label: O O O O O O O O B-numberofpeople O O B-cuisine I-cuisine I-cuisine O O O O B-city I-city O B-state O B-starttime I-starttime B-date
Score: 
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [1.2825934e-04 4.7830574e-05 2.1629052e-03 9.9766052e-01 4.6831562e-07]
Word 12 score: [1.0000000e+00 2.8826535e-24 2.8826535e-24 2.8826535e-24 2.8826535e-24]
Word 13 score: [1.00000e+00 7.63271e-17 7.63271e-17 7.63271e-17 7.63271e-17]
Word 18 score: [6.2788638e-07 7.8649163e-01 2.1350728e-01 4.6138942e-07 3.8531027e-08]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [1.0181926e-08 9.9212247e-01 1.2012954e-07 7.8766700e-03 7.3358439e-07]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [9.8408288e-01 2.2365368e-05 4.8292128e-04 7.6053705e-04 1.4651217e-02]
------
811
i ' m happy to assist you ! blind burr ##o and ortega ' s a mexican bis ##tro both offer mexican / southwestern style and have available tables this afternoon . which one would you like to book ?
Predicted label: ['inform', 'greeting']
Real label: ['inform', 'greeting', 'multiple_choice']
Predicted slot label: B-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-cuisine I-cuisine I-cuisine O O O B-seating O B-date I-date O O O O O O O O O
Real slot label: B-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-cuisine I-cuisine I-cuisine O O O B-seating O B-date I-date O O O O O O O O O
Score: 
Word 0 score: [3.3508325e-01 6.4703704e-07 2.3653135e-03 5.2772979e-03 6.5727353e-01]
Word 1 score: [3.4048757e-08 6.4989406e-01 4.0709318e-04 3.4969798e-01 8.8650813e-07]
Word 2 score: [4.5216765e-08 8.0737138e-01 4.3005096e-03 1.8832545e-01 2.6144039e-06]
Word 3 score: [1.2965361e-06 2.9037878e-01 4.4766107e-08 7.0951706e-01 1.0279586e-04]
Word 4 score: [2.5655786e-06 1.9140431e-05 1.3735877e-01 5.1247118e-09 8.6261958e-01]
Word 5 score: [0.22582555 0.11155361 0.65064466 0.00652313 0.00545303]
Word 6 score: [0.7874669  0.01861474 0.00634257 0.01676184 0.17081402]
Word 8 score: [3.0080208e-05 9.9990356e-01 6.5427725e-05 4.1564654e-10 9.5360042e-07]
Word 9 score: [2.0202571e-05 9.9391633e-01 7.4292511e-05 1.0320838e-03 4.9570212e-03]
Word 10 score: [1.2389110e-02 7.8465033e-01 1.9299376e-01 9.7979382e-03 1.6882094e-04]
Word 12 score: [9.9999857e-01 3.7191401e-07 3.7191401e-07 3.7191401e-07 3.7191401e-07]
Word 13 score: [8.01263273e-01 6.65606291e-04 8.97149444e-02 3.11636482e-03
 1.05239876e-01]
Word 14 score: [9.99684691e-01 1.14965296e-07 3.33048478e-09 1.09268126e-06
 3.14079836e-04]
Word 15 score: [3.2926246e-07 5.2924752e-01 4.6574536e-01 5.0068637e-03 3.7079986e-10]
Word 16 score: [6.8832989e-05 6.3720131e-03 8.6132832e-02 9.0596616e-01 1.4601791e-03]
Word 17 score: [3.0323455e-01 6.4707124e-01 8.2006009e-05 4.9607251e-02 4.9567334e-06]
Word 18 score: [4.1991884e-01 5.4749882e-01 9.2343071e-05 3.2487035e-02 3.0271081e-06]
Word 21 score: [2.6473502e-04 9.6380278e-02 9.6067861e-03 9.5390305e-06 8.9373869e-01]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [3.6338130e-03 7.7899596e-05 9.9628460e-01 3.7370983e-06 2.0915230e-16]
Word 27 score: [8.6841100e-01 1.2010392e-01 1.7471601e-05 9.8532038e-03 1.6142909e-03]
Word 29 score: [1.8145053e-01 8.1755322e-01 9.9622109e-04 5.3955357e-10 1.4043059e-09]
Word 30 score: [0.28311908 0.6405574  0.02492433 0.00227959 0.04911959]
------
812
blind burr ##o for michelle
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [1.0805025e-05 8.1721271e-05 5.6131366e-06 8.1239037e-02 9.1866285e-01]
Word 1 score: [4.4387366e-06 9.5148528e-01 7.0230644e-06 1.1631564e-04 4.8387039e-02]
Word 2 score: [1.0242637e-03 9.5224684e-01 4.1813519e-02 4.6811034e-03 2.3428138e-04]
Word 3 score: [1.8163027e-08 4.0379317e-07 1.6150404e-08 9.9999952e-01 4.5711250e-08]
Word 4 score: [9.5695168e-01 4.3044534e-02 1.2684841e-06 1.2684841e-06 1.2684841e-06]
------
813
thank you for booking with us ! your reservation has been confirmed as requested . please enjoy your meal , michelle !
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: B-closing I-closing I-closing I-closing I-closing I-closing O O O O O O O O O B-closing I-closing I-closing I-closing I-closing I-closing O
Real slot label: B-closing I-closing I-closing I-closing I-closing I-closing O O O O O O O O O B-closing I-closing I-closing I-closing I-closing I-closing O
Score: 
Word 0 score: [1.8266259e-01 2.4320933e-04 7.6686162e-01 4.1866235e-02 8.3663398e-03]
Word 1 score: [0.4885292  0.00277544 0.01795457 0.00058942 0.49015135]
Word 2 score: [6.5680311e-08 1.8323313e-05 3.1173524e-05 9.9991691e-01 3.3428751e-05]
Word 3 score: [0.00097179 0.00599341 0.46724403 0.05854662 0.46724403]
Word 4 score: [9.9871778e-01 1.1567099e-06 1.1737149e-04 1.1637356e-03 1.9606141e-09]
Word 5 score: [2.7309123e-01 1.5240167e-01 1.8878528e-04 2.0326482e-02 5.5399185e-01]
Word 15 score: [3.5069834e-02 3.6705725e-02 9.2785990e-01 3.6445545e-04 1.8062543e-08]
Word 16 score: [1.21250516e-03 6.33265525e-02 9.27727103e-01 7.73372082e-03
 1.07099725e-08]
Word 17 score: [5.4929018e-07 9.9049497e-01 9.5044170e-03 8.9195777e-16 8.9195777e-16]
Word 18 score: [4.84455319e-04 1.48974605e-05 2.35718256e-03 6.29607379e-01
 3.67536128e-01]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [9.975920e-01 2.408003e-03 2.914738e-12 2.914738e-12 2.914738e-12]
------
814
reserve a table for 2 at the melting pot in wilmington , nc tomorrow at 8 ##pm
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O B-numberofpeople O O B-restaurantname I-restaurantname O B-city O B-state O O B-starttime I-starttime
Real slot label: O O O O B-numberofpeople O O B-restaurantname I-restaurantname O B-city O B-state O O B-starttime I-starttime
Score: 
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [4.0023679e-01 7.8969393e-03 5.9158832e-01 2.2516684e-07 2.7773247e-04]
Word 8 score: [7.4001074e-01 3.0842397e-02 2.2914584e-01 7.9452815e-07 1.4849681e-07]
Word 10 score: [8.4827981e-05 5.8322991e-07 2.1085845e-02 3.5977725e-02 9.4285107e-01]
Word 12 score: [1.0000000e+00 1.7080377e-11 1.7080377e-11 1.7080377e-11 1.7080377e-11]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
------
815
success ! your reservation has been confirmed , please enjoy your meal !
Predicted label: ['inform']
Real label: ['inform', 'closing']
Predicted slot label: O O O O O O O O O B-closing I-closing I-closing O
Real slot label: O O O O O O O O O B-closing I-closing I-closing O
Score: 
Word 9 score: [1.1758437e-02 4.0528655e-02 9.4593954e-01 1.7727342e-03 6.7259384e-07]
Word 10 score: [5.0451585e-05 9.9686784e-01 3.0816768e-03 1.0982165e-15 1.0982165e-15]
Word 11 score: [2.8782475e-04 5.3965603e-04 6.7611281e-03 6.5231752e-01 3.4009382e-01]
------
816
what are the best restaurants for dating in nash ##ua , nh
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O B-occasion O B-city I-city O B-state
Real slot label: O O O O O O B-occasion O B-city I-city O B-state
Score: 
Word 6 score: [6.95896742e-04 1.01027399e-04 1.35203665e-02 9.82167244e-01
 3.51547310e-03]
Word 8 score: [1.9127589e-05 7.4613301e-05 1.8526618e-05 5.8795327e-01 4.1193438e-01]
Word 9 score: [1.0683529e-04 1.9383959e-05 1.6447918e-04 9.9933261e-01 3.7659571e-04]
Word 11 score: [1.0000000e+00 1.4925806e-12 1.4925806e-12 1.4925806e-12 1.4925806e-12]
------
817
here is the complete list of restaurants available for reservation in nash ##ua , nh : mt ' s local kitchen & wine bar , not your average joe ' s nash ##ua nh , stella blu , joe ' s american bar & grill - nash ##ua , and india palace restaurant .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O B-city I-city O B-state O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O O O O O O O O B-city I-city O B-state O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 11 score: [2.0988906e-05 8.2431317e-05 1.0155787e-05 7.2015774e-01 2.7972871e-01]
Word 12 score: [4.5900571e-05 6.5424751e-06 4.0230312e-05 9.9971944e-01 1.8784680e-04]
Word 14 score: [1.0000000e+00 1.1025049e-13 1.1025049e-13 1.1025049e-13 1.1025049e-13]
Word 16 score: [1.9781230e-02 2.4207071e-07 9.8021841e-01 2.8561974e-08 1.3562422e-07]
Word 17 score: [0.8274811  0.01634249 0.09009121 0.00109082 0.06499431]
Word 18 score: [9.9976689e-01 3.1107775e-06 1.0141634e-08 7.2292681e-07 2.2926305e-04]
Word 19 score: [1.0861831e-02 5.5817369e-04 9.3090910e-01 5.7654213e-02 1.6755906e-05]
Word 20 score: [1.4935485e-14 9.9984443e-01 1.5556675e-04 3.4425771e-11 1.4677645e-11]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [6.1372942e-01 3.8622838e-01 8.3463112e-07 2.4705485e-05 1.6768572e-05]
Word 23 score: [7.1032095e-04 7.8802467e-09 9.6177246e-07 6.0743530e-04 9.9868137e-01]
Word 25 score: [1.11800005e-11 9.99993801e-01 8.03596634e-10 5.59272303e-06
 5.83489737e-07]
Word 26 score: [1.6878503e-05 1.4842109e-01 8.5156202e-01 1.8707781e-14 1.8707781e-14]
Word 27 score: [3.3985555e-01 3.2357448e-01 2.1711336e-05 5.0089867e-03 3.3153921e-01]
Word 28 score: [3.1419555e-04 1.0866555e-04 1.6260532e-08 1.1318040e-01 8.8639677e-01]
Word 29 score: [9.9949372e-01 1.2747013e-06 4.3633104e-08 1.2490500e-06 5.0376629e-04]
Word 30 score: [9.9969518e-01 2.8413904e-06 9.8976445e-09 8.5399319e-07 3.0114249e-04]
Word 31 score: [1.1729312e-04 1.6757956e-02 2.5300741e-02 7.9326826e-01 1.6455571e-01]
Word 32 score: [1.4669534e-04 1.1962345e-02 2.2883561e-02 8.7042689e-01 9.4580539e-02]
Word 33 score: [1.000000e+00 7.917584e-11 7.917584e-11 7.917584e-11 7.917584e-11]
Word 35 score: [9.7163028e-01 2.8343102e-02 4.5023345e-09 1.1798654e-06 2.5463461e-05]
Word 36 score: [2.8501666e-01 3.0821523e-09 1.2538808e-04 7.1485555e-01 2.4352403e-06]
Word 38 score: [6.4846435e-09 5.4521405e-07 1.9553459e-09 1.4953525e-08 9.9999940e-01]
Word 39 score: [8.6670077e-01 2.0740025e-03 1.0044163e-01 4.1914365e-04 3.0364333e-02]
Word 40 score: [9.9977213e-01 2.0125790e-06 9.7016235e-09 6.0989356e-07 2.2522519e-04]
Word 41 score: [1.5960960e-02 1.7638018e-09 4.7053763e-04 9.8330462e-01 2.6386415e-04]
Word 42 score: [4.6819905e-04 5.7687162e-09 1.0888118e-06 4.9601967e-04 9.9903476e-01]
Word 43 score: [0.2 0.2 0.2 0.2 0.2]
Word 44 score: [1.1767488e-19 1.8813278e-20 1.9123337e-04 7.7641464e-18 9.9980885e-01]
Word 45 score: [0.2 0.2 0.2 0.2 0.2]
Word 46 score: [8.0824735e-05 8.8820858e-03 1.7445263e-02 8.7395728e-01 9.9634580e-02]
Word 47 score: [1.19688244e-04 9.57078766e-03 1.86839812e-02 9.17051852e-01
 5.45737296e-02]
Word 50 score: [9.9996138e-01 9.9775733e-08 3.7845848e-07 3.7568701e-05 6.1130197e-07]
Word 51 score: [1.8142858e-04 9.9979252e-01 1.7283834e-07 1.0358958e-09 2.5852276e-05]
Word 52 score: [2.4270165e-14 6.5045983e-01 5.1428080e-03 3.4439737e-01 2.3111393e-19]
------
818
which restaurant has the most romantic atmosphere
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O B-atmosphere I-atmosphere I-atmosphere O
Real slot label: O O O B-atmosphere I-atmosphere I-atmosphere O
Score: 
Word 3 score: [2.2133526e-03 4.0026079e-03 9.9378055e-01 5.4690793e-07 2.9590783e-06]
Word 4 score: [9.0789184e-02 4.1377484e-03 2.7678275e-01 6.2824327e-01 4.7077207e-05]
Word 5 score: [9.6098032e-05 9.9808443e-01 5.1584677e-04 1.1493737e-03 1.5432852e-04]
------
819
not your average joe ' s has a nice setting . it serves eclectic american food and has a full bar .
Predicted label: ['inform', 'confirm_question']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O B-cuisine O O O O O O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O B-cuisine O O O O O O O
Score: 
Word 0 score: [3.4821703e-04 6.4682871e-01 1.9802660e-04 3.4917077e-01 3.4543010e-03]
Word 1 score: [3.1025561e-07 1.2080497e-01 8.7919474e-01 3.3573615e-16 3.3573615e-16]
Word 2 score: [0.01072683 0.85734195 0.10649455 0.00087456 0.02456212]
Word 3 score: [6.0672477e-07 2.7519509e-05 9.2997725e-09 5.5231149e-06 9.9996638e-01]
Word 4 score: [5.7582927e-01 2.6556927e-05 3.2259703e-02 4.9384176e-03 3.8694605e-01]
Word 5 score: [9.0847564e-01 1.6384131e-05 1.1696187e-03 1.5103769e-04 9.0187319e-02]
Word 14 score: [2.2212844e-06 5.3527958e-18 1.5932870e-05 3.2413010e-03 9.9674052e-01]
------
820
can you recommend a good turkish place in san francisco for tomorrow night at 5 ##pm ? i have two people
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-cuisine O O B-city I-city O B-date I-date O B-starttime I-starttime O O O O O
Real slot label: O O O O O B-cuisine O O B-city I-city O B-date I-date O B-starttime I-starttime O O O O O
Score: 
Word 5 score: [4.2235447e-06 8.2041261e-08 8.9325158e-06 9.9998498e-01 1.6887165e-06]
Word 8 score: [5.2392818e-07 1.5062621e-01 8.4937239e-01 4.2083474e-07 5.2556612e-07]
Word 9 score: [5.0386059e-04 2.2540714e-03 9.9713290e-01 1.0908062e-04 1.2735082e-10]
Word 11 score: [6.2299418e-01 3.1327251e-01 3.9061447e-07 4.5105530e-06 6.3728377e-02]
Word 12 score: [5.2520930e-12 5.0000000e-01 2.8635362e-12 5.0000000e-01 2.9706774e-14]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
------
821
tuba restaurant , kitchen istanbul , and per ##a are the top 3 restaurants in your preferred cuisine with available seating . may i book one of these options for you ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: B-restaurantname I-restaurantname O B-restaurantname I-restaurantname O O B-restaurantname I-restaurantname O O B-rating I-rating O O O O O O O O O O O O O O O O O O O
Real slot label: B-restaurantname I-restaurantname O B-restaurantname I-restaurantname O O B-restaurantname I-restaurantname O O B-rating I-rating O O O O O O O O O O O O O O O O O O O
Score: 
Word 0 score: [1.7794968e-01 3.1793445e-06 8.1931674e-01 1.6286374e-03 1.1017843e-03]
Word 1 score: [2.0336562e-12 7.6570994e-01 2.3940019e-02 2.1035005e-01 3.9638937e-18]
Word 3 score: [1.7842606e-07 9.5572180e-01 4.4272315e-02 2.0247739e-06 3.6873964e-06]
Word 4 score: [5.5671751e-01 4.4254532e-01 5.1368865e-05 2.0791191e-05 6.6497963e-04]
Word 7 score: [4.1701869e-09 2.4346553e-11 4.9999797e-01 4.9999797e-01 4.0189811e-06]
Word 8 score: [1.4998738e-08 1.0827868e-06 4.9999928e-01 4.9999928e-01 2.6991381e-07]
Word 11 score: [1.9853655e-06 1.0091618e-05 8.9819807e-08 4.9999392e-01 4.9999392e-01]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
------
822
sure , i ' ll go with kitchen ins ##tan ##bu ##l
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 7 score: [3.4181845e-08 9.7093475e-01 2.9062958e-02 1.5290642e-06 7.4347713e-07]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
------
823
i have successfully booked your reservation at kitchen ins ##tan ##bu ##l for tomorrow at 5 ##pm . enjoy !
Predicted label: ['inform']
Real label: ['inform', 'closing']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date O B-starttime I-starttime O B-closing O
Real slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date O B-starttime I-starttime O B-closing O
Score: 
Word 7 score: [9.7759926e-07 9.1648948e-01 8.3494559e-02 1.1236470e-05 3.6997765e-06]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [7.0350337e-01 1.6975172e-01 2.1184871e-07 2.5278414e-05 1.2671934e-01]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [1.3908261e-01 1.1395559e-02 8.4340370e-01 2.4502906e-05 6.0936953e-03]
------
824
hi , i am looking to book a restaurant reservation this friday for me and my wife
Predicted label: ['request', 'greeting']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O B-date O O O O O
Real slot label: O O O O O O O O O O O B-date O O O O O
Score: 
Word 11 score: [1.1272478e-04 1.8743867e-05 8.5199827e-06 9.7134262e-01 2.8517425e-02]
------
825
great , where are you located ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
826
i am located in austin texas looking for a mexican restaurant that is top rated
Predicted label: ['inform']
Real label: ['request']
Predicted slot label: O O O O B-city B-state O O O B-cuisine O O O B-restauranttype I-restauranttype
Real slot label: O O O O B-city B-state O O O B-cuisine O O O B-restauranttype I-restauranttype
Score: 
Word 4 score: [1.5444533e-06 5.7198633e-02 3.5601571e-02 3.5601571e-02 8.7159663e-01]
Word 5 score: [5.9683081e-03 1.0491886e-05 9.9395329e-01 6.6244022e-05 1.6186234e-06]
Word 9 score: [5.6414033e-06 1.6129734e-01 1.7240288e-03 5.8928742e-07 8.3697242e-01]
Word 13 score: [5.5216196e-09 6.6500756e-09 9.9232933e-10 5.0000000e-01 5.0000000e-01]
Word 14 score: [9.6679795e-01 6.5768772e-04 3.6499441e-12 7.1366456e-14 3.2544278e-02]
------
827
what time would you like a table ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
828
something around 8 ##pm please
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O B-starttime I-starttime O
Real slot label: O O B-starttime I-starttime O
Score: 
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
------
829
here are three restaurants that i found . would you like any of these options : 1 ) manuel ' s great hills , 2 ) benji ' s can ##tina , 3 ) el alma cafe y can ##tina ?
Predicted label: ['multiple_choice']
Real label: ['multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.22268103 0.02770315 0.05073125 0.00213077 0.6967538 ]
Word 20 score: [9.9397403e-01 2.5949260e-04 6.2513166e-08 2.4538597e-06 5.7639102e-03]
Word 21 score: [8.5375723e-10 3.0916643e-01 7.0092018e-04 3.7211090e-01 3.1802177e-01]
Word 22 score: [9.9998224e-01 1.7718701e-05 1.1187070e-09 1.1187070e-09 1.1187070e-09]
Word 26 score: [8.4530437e-01 4.8558850e-02 1.0613676e-01 3.1709007e-09 3.1709007e-09]
Word 27 score: [0.13532841 0.05700536 0.09925873 0.00498944 0.703418  ]
Word 28 score: [9.9476862e-01 4.2115844e-05 5.2168982e-08 1.8257008e-06 5.1874216e-03]
Word 29 score: [1.87072977e-02 9.72364604e-01 8.92323256e-03 4.81088910e-06
 1.07745375e-11]
Word 30 score: [2.0181835e-02 9.7361982e-01 6.1937990e-03 4.5325278e-06 5.4938068e-12]
Word 31 score: [0.2 0.2 0.2 0.2 0.2]
Word 34 score: [1.7278295e-05 1.4893216e-03 1.7851733e-06 9.9849164e-01 2.1194341e-08]
Word 35 score: [5.6967068e-01 6.2526589e-05 6.3969426e-02 3.6066273e-01 5.6346403e-03]
Word 36 score: [4.9399603e-02 2.9721251e-03 8.6940354e-04 2.7515984e-11 9.4675893e-01]
Word 37 score: [3.0483083e-09 9.9999785e-01 1.1240693e-06 1.4239849e-09 1.0196518e-06]
Word 38 score: [2.5756862e-02 9.6964520e-01 4.5922324e-03 5.7808306e-06 2.7146113e-12]
Word 39 score: [2.5682678e-02 9.7072732e-01 3.5856059e-03 4.4450990e-06 1.6072095e-12]
------
830
please book reservations for the one that is the most expensive priced option
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O B-pricing I-pricing I-pricing O O
Real slot label: O O O O O O O O B-pricing I-pricing I-pricing O O
Score: 
Word 8 score: [2.6649339e-03 4.4128490e-03 9.9292046e-01 4.4320464e-07 1.3757083e-06]
Word 9 score: [2.2008043e-02 2.5726657e-03 4.6175402e-02 9.2923903e-01 4.8593583e-06]
Word 10 score: [2.5864201e-02 9.5128119e-01 2.2820657e-04 2.2626122e-02 3.0436129e-07]
------
831
unfortunately , your time slot is not available for that table . would you like one of the following times : 6 : 30 ##pm , 8 : 45 ##pm , 9 ##pm ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['confirm_question']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O B-starttime I-starttime I-starttime I-starttime O B-starttime I-starttime I-starttime I-starttime O B-starttime I-starttime O
Real slot label: O O O O O O O O O O O O O O O O O O O O O B-starttime I-starttime I-starttime I-starttime O B-starttime I-starttime I-starttime I-starttime O B-starttime I-starttime O
Score: 
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 26 score: [0.2 0.2 0.2 0.2 0.2]
Word 27 score: [0.2 0.2 0.2 0.2 0.2]
Word 28 score: [0.2 0.2 0.2 0.2 0.2]
Word 29 score: [0.2 0.2 0.2 0.2 0.2]
Word 31 score: [0.2 0.2 0.2 0.2 0.2]
Word 32 score: [0.2 0.2 0.2 0.2 0.2]
------
832
8 : 45 ##pm will work please book for that time
Predicted label: ['inform']
Real label: ['request']
Predicted slot label: B-starttime I-starttime I-starttime I-starttime O O O O O O O
Real slot label: B-starttime I-starttime I-starttime I-starttime O O O O O O O
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
------
833
great your reservation is confirmed !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O
Real slot label: O O O O O O
Score: 
------
834
i ' d like to reserve a table for 1 at wild ginger seattle in seattle for march 16th , i prefer 5 : 30 pm if available .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O B-city O B-date I-date O O O O O O O O O O
Real slot label: O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O B-city O B-date I-date O O O O O O O O O O
Score: 
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.00377571 0.05654081 0.75051457 0.14508374 0.0440852 ]
Word 12 score: [9.4097239e-01 1.6367951e-03 2.6500439e-11 2.0992136e-04 5.7180919e-02]
Word 13 score: [3.8967993e-02 1.8389341e-03 9.3828216e-02 8.6529207e-01 7.2741437e-05]
Word 15 score: [2.7838062e-02 2.2405427e-04 5.9820388e-02 9.1083109e-01 1.2863489e-03]
Word 17 score: [1.3533653e-05 7.8947777e-01 9.0722643e-02 6.2102266e-02 5.7683762e-02]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
------
835
what name would you like to book the reservation under ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
836
adam west
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname I-personfullname
Real slot label: B-personfullname I-personfullname
Score: 
Word 0 score: [5.0608614e-03 6.9776934e-04 2.0735145e-06 7.1259959e-10 9.9423933e-01]
Word 1 score: [3.02587905e-05 1.14219016e-04 8.96051154e-03 8.20377529e-01
 1.70517504e-01]
------
837
your reservation has been confirmed . please enjoy your meal , and thank you for using our service !
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O B-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing
Real slot label: O O O O O O B-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing
Score: 
Word 6 score: [6.4999312e-03 2.7788451e-03 9.9023974e-01 4.8141944e-04 9.0669685e-09]
Word 7 score: [1.4551607e-02 6.6675782e-02 9.1690892e-01 1.8611141e-03 2.6098958e-06]
Word 8 score: [3.4835475e-04 9.9916363e-01 4.8809088e-04 8.9596223e-16 8.9596223e-16]
Word 9 score: [5.7801145e-07 1.0240784e-06 6.3864245e-06 4.0015817e-01 5.9983385e-01]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [9.9391395e-01 5.8491988e-04 2.2181130e-03 3.6627374e-04 2.9167391e-03]
Word 12 score: [4.27022539e-02 1.45790225e-04 9.55864131e-01 1.10119836e-04
 1.17773318e-03]
Word 13 score: [6.5775514e-01 2.8101015e-03 2.2229064e-02 6.3952303e-04 3.1656620e-01]
Word 14 score: [9.63012212e-08 4.57725537e-06 6.73864804e-08 9.99889135e-01
 1.06122614e-04]
Word 15 score: [1.8065533e-02 1.1021727e-03 1.8065533e-02 9.6276677e-01 3.4816688e-11]
Word 16 score: [1.4359964e-05 7.0848957e-02 7.8951728e-01 6.2718675e-02 7.6900683e-02]
Word 17 score: [1.5605041e-02 6.9619186e-04 1.0495890e-02 2.0121450e-02 9.5308143e-01]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
------
838
hello ! i am seeking a reservation at a mexican restaurant for 4 people at 6 ##pm tomorrow in lansing , michigan .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O B-cuisine O O B-numberofpeople O O B-starttime I-starttime B-date O B-city I-city I-city O
Real slot label: O O O O O O O O O B-cuisine O O B-numberofpeople O O B-starttime I-starttime B-date O B-city I-city I-city O
Score: 
Word 9 score: [3.5317826e-05 2.1106948e-01 8.5576931e-03 1.6310485e-06 7.8033584e-01]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [1.0304093e-06 1.7897030e-02 6.8046515e-12 1.6090645e-08 9.8210192e-01]
Word 19 score: [7.8162360e-01 1.2483782e-04 5.3958822e-04 1.3391591e-03 2.1637280e-01]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [9.9998760e-01 2.4447052e-06 9.5138275e-06 8.9715941e-09 3.6781205e-07]
------
839
i ' m sorry , i ca n ' t book any mexican restaurants in that area , but i did find an international restaurant called cy ##gn ##us 27 . would you be interested in that ?
Predicted label: ['inform', 'confirm_question']
Real label: ['request', 'inform', 'confirm_question']
Predicted slot label: O O O O O O O O O O O O B-cuisine O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O B-cuisine O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
Word 12 score: [8.553783e-04 4.624295e-01 9.449494e-02 7.469424e-05 4.421455e-01]
------
840
sure !
Predicted label: ['confirm_answer']
Real label: ['confirm_answer']
Predicted slot label: O O
Real slot label: O O
Score: 
------
841
your reservation has been confirmed . please enjoy your meal !
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O B-closing I-closing I-closing O
Real slot label: O O O O O O O B-closing I-closing I-closing O
Score: 
Word 7 score: [4.4310549e-03 3.0360920e-02 9.6372086e-01 1.4871305e-03 5.2099935e-08]
Word 8 score: [6.9606705e-07 9.9581295e-01 4.1862899e-03 8.4519221e-19 8.4519221e-19]
Word 9 score: [3.0271342e-05 5.7344610e-06 5.1473477e-04 5.6816071e-01 4.3128848e-01]
------
842
book a place to eat for 4 people that has piano music in wilmington , nc ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O B-numberofpeople O O O B-atmosphere I-atmosphere O B-city O B-state O
Real slot label: O O O O O O B-numberofpeople O O O B-atmosphere I-atmosphere O B-city O B-state O
Score: 
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [2.2624883e-07 9.9755365e-01 5.1356920e-08 6.2227006e-09 2.4461376e-03]
Word 11 score: [9.2060113e-04 8.8985911e-07 8.0380970e-01 1.9526726e-01 1.4671100e-06]
Word 13 score: [8.7992070e-05 6.7847697e-07 6.7674108e-02 1.0395203e-01 8.2828516e-01]
Word 15 score: [1.000000e+00 5.354959e-10 5.354959e-10 5.354959e-10 5.354959e-10]
------
843
i ' m happy to assist you ! what time and date would you like your reservation for ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O
Score: 
------
844
sunday at noon
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date I-date I-date
Real slot label: B-date I-date I-date
Score: 
Word 0 score: [1.8976596e-09 9.9961579e-01 8.1690068e-06 1.0772019e-07 3.7593170e-04]
Word 1 score: [7.5666973e-10 1.0000000e+00 4.6340411e-13 4.4283782e-11 1.9235575e-12]
Word 2 score: [1.0974372e-04 1.0974372e-04 9.9780542e-01 2.4005129e-05 1.9510880e-03]
------
845
there are no restaurants with piano music for me to book . i can su ##g
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O B-atmosphere I-atmosphere O O O O O O O O O
Real slot label: O O O O O B-atmosphere I-atmosphere O O O O O O O O O
Score: 
Word 5 score: [1.2631898e-08 9.9995780e-01 4.1163267e-10 1.0835038e-11 4.2143234e-05]
Word 6 score: [1.0047671e-03 1.2294805e-06 9.9854797e-01 4.4429558e-04 1.6998656e-06]
------
846
ok , th ##ne just plain american cuisine
Predicted label: ['inform']
Real label: ['request']
Predicted slot label: O O O O O O B-cuisine O
Real slot label: O O O O O O B-cuisine O
Score: 
Word 6 score: [3.7447608e-03 8.5626944e-10 5.4666423e-04 9.9163997e-01 4.0685451e-03]
------
847
port land grille and au ##bria ##na ' s fine dining are 2 of the top rated american restaurants in wilmington . would you like to try one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O B-rating O B-cuisine O O B-city O O O O O O O O O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O B-rating O B-cuisine O O B-city O O O O O O O O O O
Score: 
Word 0 score: [7.9187530e-01 4.8047781e-02 3.5219549e-04 3.3144774e-09 1.5972470e-01]
Word 1 score: [2.9332361e-09 3.7708684e-14 3.0116364e-19 7.0296384e-13 1.0000000e+00]
Word 2 score: [5.4925587e-14 3.9403143e-13 9.9999976e-01 4.1326840e-09 2.3215601e-07]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [9.9947947e-01 3.3720976e-06 5.0695238e-08 1.9852487e-06 5.1521184e-04]
Word 8 score: [9.9931180e-01 6.3038265e-06 6.1257538e-08 2.4309304e-06 6.7934714e-04]
Word 9 score: [3.0136185e-10 1.4797757e-04 1.2470969e-08 8.0707157e-01 1.9278052e-01]
Word 10 score: [1.1924139e-04 9.4442919e-05 5.0593377e-03 9.9472708e-01 7.0899764e-10]
Word 15 score: [1.1276052e-06 2.3029455e-05 8.4303529e-08 4.9998790e-01 4.9998790e-01]
Word 17 score: [5.7787420e-03 5.9784237e-16 4.3777909e-04 7.4552697e-01 2.4825656e-01]
Word 20 score: [1.2392244e-04 5.9022761e-07 2.5274172e-02 1.6670387e-02 9.5793092e-01]
------
848
port land grille
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [6.9988090e-01 2.4889934e-01 3.4455468e-03 7.2531835e-11 4.7774155e-02]
Word 1 score: [2.00022541e-08 1.30994314e-14 8.76733837e-20 1.52465735e-12
 1.00000000e+00]
Word 2 score: [9.375840e-14 2.781408e-13 9.999994e-01 5.926234e-09 5.372212e-07]
------
849
i ' m sorry , no tables are available within 2 . 5 hours of that time . would you like to try a different time or a different restaurant ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
850
au ##bria ##na ' s fine dining
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [9.9978858e-01 5.1932211e-08 3.9873516e-08 6.3240680e-07 2.1076814e-04]
Word 4 score: [9.9965763e-01 1.6893256e-07 3.3892363e-08 9.2537613e-07 3.4124192e-04]
Word 5 score: [2.8456048e-11 1.0127656e-04 3.4123545e-08 5.8048970e-01 4.1940895e-01]
Word 6 score: [2.4606782e-04 1.1995408e-04 3.0015132e-03 9.9663240e-01 3.7071671e-10]
------
851
unfortunately au ##bria ##na ' s fine dining is closed on sunday and monday . would you like to try saturday ? or would you prefer a different restaurant on sunday ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-date O O O O O O O O O O O O O O O O O O B-date O
Real slot label: O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-date O O O O O O O O O O O O O O O O O O B-date O
Score: 
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [9.9949312e-01 6.0172603e-08 1.0114140e-07 3.2976302e-06 5.0337508e-04]
Word 5 score: [9.9939144e-01 8.8794209e-08 1.1926640e-07 3.5741791e-06 6.0477830e-04]
Word 6 score: [8.8078315e-11 8.3644089e-05 3.4669309e-08 7.6247776e-01 2.3743862e-01]
Word 7 score: [1.1088277e-03 6.5825996e-04 3.3638158e-03 9.9486911e-01 5.6590208e-09]
Word 11 score: [3.0171938e-07 1.2249097e-02 1.4173091e-06 7.4785912e-06 9.8774159e-01]
Word 30 score: [7.7819280e-08 4.7954276e-02 2.9300438e-06 5.8899655e-06 9.5203674e-01]
------
852
port land grille on sunday first available
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname O B-date O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname O B-date O O
Score: 
Word 0 score: [7.2637141e-01 2.5111619e-01 6.7157461e-03 8.4654797e-11 1.5796693e-02]
Word 1 score: [6.45237392e-08 1.10459696e-13 1.26109164e-18 8.85501481e-12
 9.99999881e-01]
Word 2 score: [9.1654245e-13 1.3321326e-12 9.9999833e-01 2.8373798e-08 1.6203563e-06]
Word 4 score: [7.0934076e-09 1.2958820e-02 1.4121936e-06 2.0524183e-06 9.8703766e-01]
------
853
unfortunately port land grille has no availability for your time and date , would you like to try another time and / or date ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O O O O
Real slot label: O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O O O O
Score: 
Word 1 score: [4.7597882e-01 1.8619664e-01 2.7834300e-03 2.9766392e-09 3.3504114e-01]
Word 2 score: [2.6851939e-07 3.8231085e-12 1.1925038e-16 1.4692507e-10 9.9999976e-01]
Word 3 score: [2.4915369e-12 1.6136334e-11 9.9999547e-01 1.7014688e-07 4.4595699e-06]
------
854
saturday
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date
Real slot label: B-date
Score: 
Word 0 score: [1.7929494e-01 6.6850418e-01 3.5556895e-06 1.5219192e-01 5.3541075e-06]
------
855
it looks like that restaurant does n ' t open until 5 : 30 ##pm . would you like to go for dinner instead ? or i can help you find another restaurant .
Predicted label: ['request', 'inform']
Real label: ['request', 'inform', 'confirm_question']
Predicted slot label: O O O O O O O O O O O B-starttime I-starttime I-starttime I-starttime O O O O O O O B-mealtype O O O O O O O O O O O
Real slot label: O O O O O O O O O O O B-starttime I-starttime I-starttime I-starttime O O O O O O O B-mealtype O O O O O O O O O O O
Score: 
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [9.9979812e-01 5.2907799e-05 1.7604012e-09 1.4901096e-04 1.6205895e-08]
------
856
fine , we will delay until 5 : 30
Predicted label: ['inform']
Real label: ['confirm_answer']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
857
i have secured a table for you at 5 : 30 ##pm ! may i have a name for the reservation ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O B-starttime I-starttime I-starttime I-starttime O O O O O O O O O O
Real slot label: O O O O O O O O B-starttime I-starttime I-starttime I-starttime O O O O O O O O O O
Score: 
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
------
858
tom mann
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname I-personfullname
Real slot label: B-personfullname I-personfullname
Score: 
Word 0 score: [1.1005531e-02 1.3323064e-01 3.0346453e-04 5.8964110e-06 8.5545439e-01]
Word 1 score: [1.00907460e-01 6.03860917e-06 8.99078250e-01 8.11745576e-06
 1.13786925e-07]
------
859
your reservation was confirmed under tom mann , enjoy your meal .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O B-personfullname I-personfullname O B-closing I-closing I-closing O
Real slot label: O O O O O B-personfullname I-personfullname O B-closing I-closing I-closing O
Score: 
Word 5 score: [4.1384521e-04 2.7192566e-03 8.8805938e-03 1.5525036e-03 9.8643386e-01]
Word 6 score: [3.8626526e-02 2.3911594e-05 9.6133906e-01 1.0332558e-05 1.4553645e-07]
Word 8 score: [9.0953104e-02 3.4577657e-02 8.5946494e-01 1.0140288e-04 1.4902871e-02]
Word 9 score: [2.4310836e-07 9.5850855e-01 4.1491229e-02 3.3427741e-19 3.3427741e-19]
Word 10 score: [8.6915141e-05 1.4354170e-05 9.8163367e-04 8.6822861e-01 1.3068847e-01]
------
860
find me a restaurant with g ##lu ##ten free menu items open on mondays in wilmington , nc . party of 3 at 8 ##pm
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-food I-food I-food I-food O O O O O O B-city O B-state O B-occasion O B-numberofpeople O B-starttime I-starttime
Real slot label: O O O O O B-food I-food I-food I-food O O O O O O B-city O B-state O B-occasion O B-numberofpeople O B-starttime I-starttime
Score: 
Word 5 score: [9.3208599e-01 2.5081716e-02 5.5984600e-04 1.1407115e-04 4.2158321e-02]
Word 6 score: [6.8371202e-07 4.8540057e-12 1.6275001e-14 6.0927541e-10 9.9999928e-01]
Word 7 score: [3.3518761e-05 6.5292838e-08 4.6170207e-11 1.2210273e-07 9.9996626e-01]
Word 8 score: [9.7864485e-01 1.3507996e-03 9.9831854e-04 3.3875465e-06 1.9002596e-02]
Word 15 score: [2.1147433e-05 1.1321791e-07 1.7102432e-02 1.1353722e-01 8.6933911e-01]
Word 17 score: [1.0000000e+00 1.0256409e-12 1.0256409e-12 1.0256409e-12 1.0256409e-12]
Word 19 score: [9.9985516e-01 5.3529515e-05 8.6248641e-05 2.7831520e-12 5.0408544e-06]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
------
861
would you like the reservation for monday march 14th or a different date ?
Predicted label: ['request']
Real label: ['request', 'confirm_question']
Predicted slot label: O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O
Score: 
------
862
yes
Predicted label: ['confirm_answer']
Real label: ['confirm_answer']
Predicted slot label: O
Real slot label: O
Score: 
------
863
here are 3 of the top rated restaurants in wilmington with a g ##lu ##ten free menu : black sea grill , epic food company , and indo ##chin ##e . would you like to try one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O B-rating I-rating O O B-city O O B-food I-food I-food I-food O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O B-rating I-rating O O B-city O O B-food I-food I-food I-food O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 5 score: [5.2916599e-05 5.1582836e-05 2.3233117e-07 4.9994761e-01 4.9994761e-01]
Word 6 score: [9.6274078e-01 1.5882934e-04 1.9828519e-08 1.2898080e-09 3.7100382e-02]
Word 9 score: [6.4818538e-05 4.5488301e-07 4.8601855e-02 2.3800597e-02 9.2753232e-01]
Word 12 score: [6.1599338e-01 3.7010375e-01 1.9050707e-03 2.5376803e-04 1.1744106e-02]
Word 13 score: [2.1880334e-04 1.8917059e-06 8.4633983e-10 1.6741942e-07 9.9977916e-01]
Word 14 score: [2.1919839e-04 9.2505807e-06 1.5536724e-09 5.8074863e-07 9.9977106e-01]
Word 15 score: [9.8726976e-01 1.0269515e-02 1.4310876e-03 6.3336323e-05 9.6623943e-04]
Word 18 score: [9.9999714e-01 2.8885609e-06 1.4477030e-09 1.3528383e-08 6.6876913e-09]
Word 19 score: [1.0160028e-02 2.2367232e-04 1.1567225e-03 3.2934022e-01 6.5911937e-01]
Word 20 score: [5.6984578e-17 1.0476306e-17 7.8894268e-04 1.6246888e-14 9.9921107e-01]
Word 22 score: [8.789810e-02 5.204660e-03 1.245330e-01 6.852152e-08 7.823641e-01]
Word 23 score: [0.00108582 0.00268528 0.9450016  0.02711204 0.02411533]
Word 24 score: [4.9258136e-10 1.2412102e-06 9.9941909e-01 5.0262403e-04 7.7075769e-05]
Word 27 score: [3.7329637e-09 9.9910742e-01 1.4051339e-05 4.3922209e-04 4.3922209e-04]
Word 28 score: [1.5410855e-04 4.5651451e-02 3.0963224e-06 4.7709566e-01 4.7709566e-01]
Word 29 score: [9.9822799e-08 9.9783176e-01 2.0306300e-06 1.0831056e-03 1.0831056e-03]
------
864
black sea grill
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [3.1466391e-03 9.0221924e-01 6.3740856e-07 9.3510956e-02 1.1225305e-03]
Word 1 score: [1.6312780e-02 1.1233015e-04 9.7840745e-04 3.4212136e-01 6.4047515e-01]
Word 2 score: [7.4941819e-18 2.6231494e-18 9.0095465e-04 7.4106669e-16 9.9909902e-01]
------
865
i ' m sorry , none of the listed restaurants have a table at that time . there are tables available at cap ##rise bis ##tro , catch , or the melting pot . would you like to book any of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [9.6707690e-01 3.1225275e-02 1.2703713e-05 1.6819754e-03 3.1611157e-06]
Word 25 score: [9.7822624e-01 2.0841060e-02 3.5078258e-06 9.2685904e-04 2.3329371e-06]
Word 27 score: [1.04383666e-07 8.05840343e-02 6.24911036e-06 1.00371579e-07
 9.19409513e-01]
Word 30 score: [2.1944931e-02 2.2875311e-02 9.5319396e-01 1.4820599e-04 1.8376578e-03]
Word 31 score: [4.8822772e-02 9.5117527e-01 6.8085972e-14 7.8971574e-08 1.7859264e-06]
Word 32 score: [2.0919582e-03 8.7056196e-01 1.2734471e-01 5.1977224e-07 8.8266103e-07]
------
866
cap ##rise bis ##tro
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [9.4231004e-01 5.3298559e-02 1.9640351e-05 4.3712091e-03 5.3175455e-07]
Word 3 score: [9.58181858e-01 3.85267064e-02 1.16133815e-05 3.27925407e-03
 5.85379041e-07]
------
867
i can not book reservations at that restaurant . would you like to try a different restaurant ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O
Score: 
------
868
i would like to book a table at a 5 star seafood restaurant in san fran ##sic ##o
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O B-rating I-rating B-restauranttype O O B-city I-city I-city I-city
Real slot label: O O O O O O O O O B-rating I-rating B-restauranttype O O B-city I-city I-city I-city
Score: 
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [1.9582234e-05 1.2642536e-02 2.9783866e-01 5.0657000e-05 6.8944860e-01]
Word 11 score: [2.1178555e-07 1.4443121e-04 8.2836465e-05 1.1516837e-08 9.9977249e-01]
Word 14 score: [5.6371846e-07 5.7532996e-01 4.2466778e-01 1.5749862e-06 6.4735723e-08]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
------
869
what date would you like a reservation ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
870
march 20th
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date I-date
Real slot label: B-date I-date
Score: 
Word 0 score: [1.8783481e-05 2.4213260e-02 1.0301265e-02 4.9379179e-01 4.7167486e-01]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
------
871
what time would you like the reservation ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
872
8 pm for 2 adults
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O B-numberofpeople O
Real slot label: O O O B-numberofpeople O
Score: 
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
------
873
here are 3 of the top rated seafood restaurants in san francisco : alam ##o square seafood grill , anchor and hope , and bar cr ##ud ##o - di ##vis ##ade ##ro st . would you like to try one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O B-rating I-rating B-restauranttype O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O B-rating I-rating B-restauranttype O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O O O O O
Score: 
Word 5 score: [1.0318966e-04 2.0421986e-04 3.7648408e-07 4.9984616e-01 4.9984616e-01]
Word 6 score: [6.4453131e-01 7.1774889e-03 3.7731232e-05 2.5243527e-05 3.4822819e-01]
Word 7 score: [3.1685627e-06 7.2972155e-03 1.0988145e-03 5.7979628e-07 9.9160016e-01]
Word 13 score: [3.8523835e-06 1.9245199e-06 1.0080657e-07 5.6072628e-01 4.3926784e-01]
Word 14 score: [3.1261477e-06 3.6455617e-07 1.2365199e-04 4.7465292e-06 9.9986815e-01]
Word 15 score: [9.9833906e-01 1.1017215e-06 1.6477794e-06 1.6579346e-03 1.9644797e-07]
Word 16 score: [8.9672925e-05 9.6716678e-01 3.1834565e-02 1.8964533e-05 8.9005131e-04]
Word 17 score: [9.7875769e-17 1.2088990e-17 9.1273326e-04 2.7636779e-14 9.9908721e-01]
Word 19 score: [3.6611002e-11 7.3524775e-10 9.9885404e-01 3.4612644e-04 7.9980702e-04]
Word 20 score: [2.6881063e-02 9.5745116e-02 6.9786236e-04 2.7390508e-05 8.7664849e-01]
Word 21 score: [7.8617424e-01 3.5371286e-09 2.3239742e-04 1.8781613e-01 2.5777243e-02]
------
874
i have heard good thing about the alam ##o square seafood grill i ' d like to reserve a table there please
Predicted label: ['inform', 'confirm_question']
Real label: ['request']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 7 score: [1.3047296e-05 3.1705108e-06 1.2774934e-06 2.5498682e-01 7.4499565e-01]
Word 8 score: [5.9536378e-06 3.8810859e-07 5.1370339e-04 1.0183085e-06 9.9947888e-01]
Word 9 score: [9.9326777e-01 4.7395453e-08 4.4507352e-08 6.7318249e-03 3.3322689e-07]
Word 10 score: [4.46369697e-04 9.65867221e-01 2.68369876e-02 1.10132105e-05
 6.83839153e-03]
Word 11 score: [9.4957895e-23 5.0801052e-26 3.9995284e-05 1.9695652e-22 9.9995995e-01]
------
875
i ' ve confirmed your reservation for alam ##o square seafood grill , enjoy your meal !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-closing I-closing I-closing I-closing
Real slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-closing I-closing I-closing I-closing
Score: 
Word 7 score: [2.7314404e-06 7.6873066e-06 8.5316418e-07 8.4386909e-01 1.5611973e-01]
Word 8 score: [1.2419732e-05 3.3056410e-06 1.9486933e-03 9.1957781e-06 9.9802643e-01]
Word 9 score: [9.9520940e-01 1.0264226e-06 1.1588885e-06 4.7881403e-03 2.4708609e-07]
Word 10 score: [2.9101816e-04 8.0346149e-01 1.9570401e-01 5.2223582e-05 4.9128290e-04]
Word 11 score: [1.7326464e-15 3.2866165e-16 3.6157577e-03 2.4456218e-13 9.9638426e-01]
Word 13 score: [3.0973741e-01 8.1449514e-03 3.5941207e-01 1.5262982e-05 3.2269025e-01]
Word 14 score: [3.2523210e-04 9.9624205e-01 3.4327139e-03 7.3889364e-17 7.3889364e-17]
Word 15 score: [4.7422876e-04 5.2771118e-04 9.1672298e-03 5.8596176e-01 4.0386906e-01]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
------
876
i ' d like to reserve a table for 1 at wild ginger seattle in seattle for march 15th , i prefer 6 : 15 pm if available .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O B-city O O O O O O B-starttime I-starttime I-starttime I-starttime O O O
Real slot label: O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O B-city O O O O O O B-starttime I-starttime I-starttime I-starttime O O O
Score: 
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.00413109 0.01735698 0.8815528  0.05302069 0.04393843]
Word 12 score: [5.3254282e-01 8.0467407e-03 8.3383682e-11 5.2941963e-04 4.5888099e-01]
Word 13 score: [7.8793123e-02 2.9025248e-03 5.2779800e-01 3.9048174e-01 2.4578661e-05]
Word 15 score: [6.9526568e-02 5.1348220e-04 2.8195104e-01 6.4670837e-01 1.3005474e-03]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [1.9784241e-06 9.4504470e-01 5.4943815e-02 7.5258008e-06 1.9337776e-06]
------
877
wild ginger seattle does not offering booking ##s at 6 : 15 ##pm . would you prefer 6 : 00pm or 6 : 30 ##pm ?
Predicted label: ['inform']
Real label: ['inform', 'multiple_choice']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname O O O O O O B-starttime I-starttime I-starttime I-starttime O O O O O O O O B-starttime I-starttime I-starttime I-starttime O
Real slot label: B-restaurantname I-restaurantname I-restaurantname O O O O O O B-starttime I-starttime I-starttime I-starttime O O O O O O O O B-starttime I-starttime I-starttime I-starttime O
Score: 
Word 0 score: [0.10353538 0.00543489 0.76163965 0.03803289 0.09135715]
Word 1 score: [7.2774059e-01 3.4283930e-03 1.5969322e-10 6.5947731e-04 2.6817158e-01]
Word 2 score: [3.0448666e-02 1.3358451e-03 7.5909269e-01 2.0910934e-01 1.3484899e-05]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
------
878
6 : 30 ##pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-starttime I-starttime I-starttime I-starttime
Real slot label: B-starttime I-starttime I-starttime I-starttime
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
------
879
success ! your reservation has been confirmed , please enjoy your meal !
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O O B-closing I-closing I-closing O
Real slot label: O O O O O O O O O B-closing I-closing I-closing O
Score: 
Word 9 score: [9.7738197e-03 2.7878199e-02 9.6037811e-01 1.9697682e-03 9.4147786e-08]
Word 10 score: [2.2712352e-06 9.9076098e-01 9.2366952e-03 8.0210008e-18 8.0210008e-18]
Word 11 score: [1.4651121e-04 1.7079070e-05 1.7219970e-03 7.7274203e-01 2.2537243e-01]
------
880
can you recommend a nice place in miami , fl ? for this sunday
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O B-city O B-state O O O B-date
Real slot label: O O O O O O O B-city O B-state O O O B-date
Score: 
Word 7 score: [1.3395144e-01 4.3293941e-01 4.7785125e-08 4.3293941e-01 1.6973764e-04]
Word 9 score: [2.0783229e-02 5.7154000e-01 2.9442324e-11 4.0534359e-01 2.3331395e-03]
Word 13 score: [1.4844555e-06 7.2994865e-03 5.0642093e-06 8.8675995e-05 9.9260521e-01]
------
881
i ' m happy to assist you ! do you have a specific restaurant or cuisine in mind ?
Predicted label: ['request']
Real label: ['request', 'greeting']
Predicted slot label: O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O
Score: 
------
882
i think mexican food sounds good but i know cuban is popular so that would work . there ' s two of us , we ' re okay with sometime from 5 to 7 ##pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
883
el cam ##ino mexican soul food & tequila bar , can ##tina la vein ##te , and catalina restaurant are the top 3 restaurants in your preferred cuisine with available seating . may i book one of these options for you ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
Word 0 score: [0.36488584 0.20051321 0.03104629 0.40312335 0.00043127]
Word 1 score: [2.82743247e-03 9.97172594e-01 1.13538126e-13 2.78298015e-19
 2.78298015e-19]
Word 2 score: [1.2444307e-03 9.9875557e-01 8.0172561e-12 6.5731844e-14 6.5731844e-14]
Word 3 score: [1.9791503e-05 4.6774168e-02 3.4078911e-02 9.0638781e-01 1.2739412e-02]
Word 4 score: [5.7177275e-12 3.3716765e-07 1.8947130e-13 9.9999964e-01 2.3022928e-08]
Word 5 score: [4.4222699e-07 5.7544518e-04 9.9769717e-01 1.5917608e-03 1.3516977e-04]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [2.1037794e-10 1.4562223e-11 5.8591771e-01 4.1408229e-01 9.5851316e-10]
Word 8 score: [2.1731008e-03 9.5290225e-08 3.5764961e-06 2.6702031e-03 9.9515307e-01]
Word 10 score: [9.3168694e-01 6.8312787e-02 3.5276307e-07 2.8353972e-10 2.0235931e-18]
Word 11 score: [9.9077797e-01 7.9318639e-03 1.2646025e-03 2.5502612e-05 4.0546031e-17]
Word 12 score: [6.19983941e-04 2.51849890e-01 3.18681548e-09 6.33288324e-01
 1.14241816e-01]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [9.3747210e-03 9.5870777e-04 3.9936054e-09 3.8002453e-12 9.8966658e-01]
------
884
great , thank you for making sure they are available first . i ' ll go with catalina restaurant .
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O O O O O O O O O O B-restaurantname O O
Real slot label: O O O O O O O O O O O O O O O O O B-restaurantname O O
Score: 
Word 17 score: [8.80519766e-03 1.14393144e-04 2.82459334e-10 1.07844872e-13
 9.91080463e-01]
------
885
thank you so much for booking with us ! your reservation has been confirmed as requested at 5 ##pm . please enjoy your meal !
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O O O O O O O O O O B-starttime I-starttime O B-closing I-closing I-closing I-closing I-closing
Real slot label: O O O O O O O O O O O O O O O O O B-starttime I-starttime O B-closing I-closing I-closing I-closing I-closing
Score: 
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [7.31614053e-01 1.08190484e-01 1.59850031e-01 3.44176486e-04
 1.21026267e-06]
Word 21 score: [3.7049794e-01 1.0570469e-02 6.1558247e-01 2.0885144e-04 3.1403205e-03]
Word 22 score: [1.9278123e-06 9.9497509e-01 5.0230278e-03 1.7317987e-17 1.7317987e-17]
Word 23 score: [2.5231132e-04 2.1086429e-04 8.3307866e-03 7.6096201e-01 2.3024394e-01]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
------
886
hello ! i need to take clients to a nice restaurant downtown seattle . thursday at 1 pm
Predicted label: ['request', 'greeting']
Real label: ['request', 'greeting']
Predicted slot label: B-greeting O O O O O O O O O O B-distanceconstraints B-city O B-date O O O
Real slot label: B-greeting O O O O O O O O O O B-distanceconstraints B-city O B-date O O O
Score: 
Word 0 score: [1.8759406e-01 8.1178594e-01 6.1902642e-04 4.9483725e-07 4.9483725e-07]
Word 11 score: [1.0528232e-08 1.0000000e+00 3.8952227e-11 4.3972346e-08 4.0807280e-10]
Word 12 score: [3.2753237e-02 1.7951521e-04 6.9203871e-01 9.7209134e-04 2.7405649e-01]
Word 14 score: [9.0349531e-01 5.9736357e-03 6.2123535e-04 2.2444854e-02 6.7464888e-02]
------
887
hi . do you have a type of cuisine in mind ?
Predicted label: ['request', 'greeting']
Real label: ['request', 'greeting']
Predicted slot label: B-greeting O O O O O O O O O O O
Real slot label: B-greeting O O O O O O O O O O O
Score: 
Word 0 score: [3.8953571e-05 7.1856901e-03 6.4349859e-03 7.1856901e-03 9.7915465e-01]
------
888
a steak ##house would be great
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O B-restauranttype I-restauranttype O O O
Real slot label: O B-restauranttype I-restauranttype O O O
Score: 
Word 1 score: [6.3814594e-16 1.5584853e-22 5.0148009e-20 2.9841686e-18 1.0000000e+00]
Word 2 score: [3.6038170e-08 2.7120694e-21 4.3521524e-19 8.6046656e-17 1.0000000e+00]
------
889
how many are going ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
890
6
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
891
what name would you like to book the reservation under ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
892
john q doe
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname I-personfullname I-personfullname
Real slot label: B-personfullname I-personfullname I-personfullname
Score: 
Word 0 score: [5.6281791e-05 3.3976431e-03 7.0628495e-04 3.1986315e-02 9.6385342e-01]
Word 1 score: [5.4280584e-09 4.5980760e-06 2.3674706e-01 4.2459765e-06 7.6324415e-01]
Word 2 score: [2.6411563e-02 4.9650403e-06 1.0122325e-09 2.9552598e-09 9.7358340e-01]
------
893
i found the following restaurants that fit your criteria : the capital grille - seattle , stanford ' s - north ##gate , sullivan ' s steak ##house - seattle .
Predicted label: ['multiple_choice']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
894
the capital grille , please
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname O O
Score: 
Word 0 score: [8.4780121e-01 1.3010643e-01 1.3186788e-05 1.3263750e-05 2.2065988e-02]
Word 1 score: [6.3988800e-06 1.9455976e-10 1.8675285e-15 9.9999356e-01 3.2952763e-09]
Word 2 score: [2.7975396e-14 1.7766181e-13 9.9999988e-01 4.2964023e-09 1.0635894e-07]
------
895
success ! i was able to book you a reservation for 6 at the capital grille on 3 / 10 at 1 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O
Real slot label: O O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O
Score: 
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [1.6168866e-01 2.4400305e-02 8.1367987e-01 1.8457464e-05 2.1279948e-04]
Word 14 score: [8.3888080e-10 4.6719763e-11 4.2639029e-13 1.0000000e+00 1.7180712e-08]
Word 15 score: [2.8532352e-12 3.0428171e-10 9.9999011e-01 9.0621606e-06 8.4047690e-07]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
------
896
reserve a table for 4 at an oyster bar in wilmington , nc on saturday at 8 ##pm
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O B-numberofpeople O O B-restauranttype I-restauranttype O B-city O B-state O B-date O B-starttime I-starttime
Real slot label: O O O O B-numberofpeople O O B-restauranttype I-restauranttype O B-city O B-state O B-date O B-starttime I-starttime
Score: 
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [9.9710757e-01 1.5523667e-06 2.8904546e-03 5.0231660e-07 6.9876474e-15]
Word 8 score: [2.9218832e-01 9.8855198e-06 2.5675582e-02 1.6977062e-02 6.6514915e-01]
Word 10 score: [5.7398203e-05 3.8744889e-07 1.9017039e-02 6.2004134e-02 9.1892105e-01]
Word 12 score: [1.00000e+00 9.48908e-14 9.48908e-14 9.48908e-14 9.48908e-14]
Word 14 score: [6.5015168e-03 1.7085213e-04 1.8980086e-04 1.1619386e-01 8.7694395e-01]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
------
897
what name would you like to book the reservation under ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
898
blur ##ry face
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname I-personfullname I-personfullname
Real slot label: B-personfullname I-personfullname I-personfullname
Score: 
Word 0 score: [1.23363361e-06 9.99578893e-01 1.03795515e-04 1.03795515e-04
 2.12273386e-04]
Word 1 score: [6.3965633e-10 9.9999964e-01 9.9745300e-08 9.9745300e-08 9.0205056e-08]
Word 2 score: [9.8998266e-01 9.9910973e-03 3.9172021e-09 2.3700062e-05 2.6530040e-06]
------
899
i do n ' t see any oyster - specific bars , but there is one seafood restaurant in wilmington that meets your needs : catch - modern seafood cuisine . would you like to book ?
Predicted label: ['inform', 'confirm_question']
Real label: ['inform', 'confirm_question']
Predicted slot label: O O O O O O O O O O O O O O O O B-restauranttype O O B-city O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O B-restauranttype O O B-city O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O
Score: 
Word 16 score: [3.9746283e-04 8.9001060e-01 8.8036969e-02 9.0923204e-05 2.1464100e-02]
Word 19 score: [1.2902708e-03 1.2585693e-05 2.4101229e-01 2.3410592e-02 7.3427421e-01]
Word 25 score: [5.9056907e-07 7.3288870e-03 4.5085158e-06 1.2872855e-06 9.9266475e-01]
Word 26 score: [0.2 0.2 0.2 0.2 0.2]
Word 27 score: [4.6847816e-07 5.1518914e-08 9.7391415e-01 3.8234142e-05 2.6047066e-02]
Word 28 score: [5.6913844e-04 8.1944931e-01 1.7853454e-01 2.8849741e-05 1.4182157e-03]
Word 29 score: [5.4136167e-06 8.6654311e-01 2.9318126e-06 1.3344851e-01 6.0444816e-10]
------
900
book catch
Predicted label: ['confirm_answer']
Real label: ['request']
Predicted slot label: O B-restaurantname
Real slot label: O B-restaurantname
Score: 
Word 1 score: [1.6579741e-06 4.5201551e-02 2.6155435e-06 6.2260037e-06 9.5478791e-01]
------
901
success ! your reservation has been confirmed , please enjoy your meal !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O B-closing I-closing I-closing I-closing O
Real slot label: O O O O O O O O B-closing I-closing I-closing I-closing O
Score: 
Word 8 score: [7.3890701e-02 4.1044008e-02 8.8450480e-01 5.6041626e-04 6.2826871e-08]
Word 9 score: [9.1874907e-03 1.2167687e-02 9.7805655e-01 5.8655522e-04 1.6868719e-06]
Word 10 score: [8.6976324e-06 9.9836916e-01 1.6221806e-03 4.3070844e-18 4.3070844e-18]
Word 11 score: [4.3317872e-05 1.1572178e-05 6.7533593e-04 7.7108550e-01 2.2818428e-01]
------
902
hello
Predicted label: ['greeting']
Real label: ['greeting']
Predicted slot label: B-greeting
Real slot label: B-greeting
Score: 
Word 0 score: [4.0650237e-03 9.9537271e-01 5.5657350e-04 2.7999233e-06 2.7999233e-06]
------
903
hi there ! would you like to make a restaurant reservation ?
Predicted label: ['greeting']
Real label: ['request', 'greeting']
Predicted slot label: B-greeting I-greeting O O O O O O O O O O
Real slot label: B-greeting I-greeting O O O O O O O O O O
Score: 
Word 0 score: [1.6280685e-05 1.8805006e-01 1.0156611e-02 1.8805006e-01 6.1372685e-01]
Word 1 score: [0.32491857 0.00166512 0.32491857 0.02357917 0.32491857]
------
904
i am looking to book a table for 3 at a cafe type of restaurant in new york , new york at 3 ##pm today
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O B-numberofpeople O B-restauranttype I-restauranttype I-restauranttype I-restauranttype I-restauranttype O B-state I-state O B-state I-state O B-starttime I-starttime B-date
Real slot label: O O O O O O O O B-numberofpeople O B-restauranttype I-restauranttype I-restauranttype I-restauranttype I-restauranttype O B-state I-state O B-state I-state O B-starttime I-starttime B-date
Score: 
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.22192821 0.03859021 0.26335028 0.09105831 0.38507292]
Word 11 score: [3.1253981e-04 2.1111956e-04 5.9032035e-03 3.2004449e-14 9.9357313e-01]
Word 12 score: [9.9983633e-01 1.6218206e-04 1.7243743e-09 7.4985530e-07 7.6973424e-07]
Word 13 score: [9.9999702e-01 1.9251256e-09 5.9369370e-08 4.4733756e-07 2.4744425e-06]
Word 14 score: [1.3622781e-11 1.2264538e-06 8.0932193e-03 9.9190557e-01 3.5874927e-20]
Word 16 score: [1.6885467e-06 1.2145931e-04 1.7005909e-12 1.9809728e-13 9.9987686e-01]
Word 17 score: [0.06518959 0.01986836 0.00719496 0.8123882  0.09535894]
Word 19 score: [6.1641039e-08 5.2356449e-06 1.9989236e-14 7.2860419e-15 9.9999464e-01]
Word 20 score: [0.03023686 0.02172685 0.00623257 0.67321587 0.26858783]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [9.6372497e-01 4.6566391e-05 5.5881351e-04 1.4021238e-03 3.4267489e-02]
------
905
here are some options for you : in ##fin ##i t - cafe , ka ##fe mozart , and cafe vienna . would you like to book one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 14 score: [6.4410833e-06 9.9999356e-01 3.3218692e-09 3.3218692e-09 3.3218692e-09]
Word 15 score: [9.9846613e-01 1.5339407e-03 3.5732735e-14 3.5732735e-14 3.5732735e-14]
Word 16 score: [1.2015627e-05 1.0599387e-01 8.9392138e-01 1.8813598e-05 5.3916952e-05]
Word 19 score: [4.87782600e-05 9.22374718e-04 9.95052792e-03 1.14436606e-10
 9.89078224e-01]
Word 20 score: [9.9593604e-01 3.7776649e-06 2.6152988e-03 9.9039741e-04 4.5447078e-04]
------
906
cafe vienna
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname
Score: 
Word 0 score: [6.0437229e-05 1.1754635e-02 7.4790395e-03 7.4069681e-06 9.8069841e-01]
Word 1 score: [9.9813676e-01 1.8260428e-06 1.5653799e-03 1.2803134e-04 1.6798102e-04]
------
907
this restaurant is actually in nj . would you like to proceed or pick a different ##e one ?
Predicted label: ['request', 'inform']
Real label: ['inform', 'confirm_question']
Predicted slot label: O O O O O B-state O O O O O O O O O O O O O
Real slot label: O O O O O B-state O O O O O O O O O O O O O
Score: 
Word 5 score: [1.0000000e+00 1.0538074e-12 1.0538074e-12 1.0538074e-12 1.0538074e-12]
------
908
in ##fin ##i t would be fine as well
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O
Score: 
Word 0 score: [9.7119576e-01 2.5035990e-02 3.6942847e-03 1.0968054e-05 6.2992447e-05]
Word 1 score: [2.0844369e-05 2.0640658e-05 5.3240376e-04 6.1205301e-02 9.3822080e-01]
Word 2 score: [0.02947567 0.00620014 0.01120739 0.58349776 0.36961904]
Word 3 score: [6.8085972e-04 8.8876543e-05 1.5668668e-03 9.9765480e-01 8.6238633e-06]
------
909
i ' ve secured that table for you ! what is your name , please ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O
Score: 
------
910
mark
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname
Real slot label: B-personfullname
Score: 
Word 0 score: [2.7188942e-01 3.8666040e-01 8.2599792e-05 3.0524060e-01 3.6126990e-02]
------
911
thank you for booking with us ! your reservation has been confirmed as requested . please enjoy your meal !
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: B-closing I-closing I-closing I-closing I-closing I-closing O O O O O O O O O B-closing I-closing I-closing I-closing O
Real slot label: B-closing I-closing I-closing I-closing I-closing I-closing O O O O O O O O O B-closing I-closing I-closing I-closing O
Score: 
Word 0 score: [2.1756513e-01 2.9941366e-04 6.9734812e-01 7.5082898e-02 9.7044781e-03]
Word 1 score: [0.29929212 0.00163935 0.03464016 0.00079952 0.6636288 ]
Word 2 score: [2.0796418e-07 4.4996323e-05 5.3198226e-05 9.9984598e-01 5.5521516e-05]
Word 3 score: [0.00096233 0.00339584 0.4824045  0.0308328  0.4824045 ]
Word 4 score: [9.9766386e-01 4.4336016e-06 6.0852570e-05 2.2708499e-03 6.5624933e-10]
Word 5 score: [6.3366085e-01 9.4725221e-02 5.1571138e-04 1.0837925e-02 2.6026031e-01]
Word 15 score: [8.2078181e-02 3.4453977e-02 8.8316107e-01 3.0678473e-04 1.3560182e-08]
Word 16 score: [6.5701356e-04 5.6077696e-02 9.3057710e-01 1.2688162e-02 8.9472723e-09]
Word 17 score: [2.3807070e-07 9.9149138e-01 8.5083880e-03 6.3224816e-16 6.3224816e-16]
Word 18 score: [5.6842586e-04 1.0745221e-04 1.5255544e-02 7.4150115e-01 2.4256736e-01]
------
912
book a table for 6 at a fond ##ue type place in wilmington , nc on saturday at 6 ##pm
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O B-numberofpeople O O B-restauranttype I-restauranttype I-restauranttype O O B-city O B-state O B-date O B-starttime I-starttime
Real slot label: O O O O B-numberofpeople O O B-restauranttype I-restauranttype I-restauranttype O O B-city O B-state O B-date O B-starttime I-starttime
Score: 
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [0.01183219 0.00169128 0.87413913 0.00088345 0.11145402]
Word 8 score: [2.8420134e-06 1.6682745e-07 5.2649796e-01 1.8548894e-07 4.7349876e-01]
Word 9 score: [9.9235690e-01 9.1486550e-07 8.1040803e-08 7.6284185e-03 1.3715440e-05]
Word 12 score: [6.3964675e-05 7.0495406e-07 1.7107768e-02 9.1000929e-02 8.9182663e-01]
Word 14 score: [1.0000000e+00 4.4410556e-12 4.4410556e-12 4.4410556e-12 4.4410556e-12]
Word 16 score: [2.4799755e-02 1.0132489e-03 1.9879233e-04 5.7061201e-01 4.0337616e-01]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
------
913
the little dip ##per and the melting pot - wilmington both have available seating at this time . which would you prefer to book ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O
Real slot label: O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O
Score: 
Word 5 score: [2.3014048e-02 1.2206127e-02 9.6470892e-01 1.4045500e-05 5.6898334e-05]
Word 6 score: [6.6998869e-02 9.3298447e-01 5.1390963e-14 1.9580131e-07 1.6407768e-05]
Word 7 score: [4.0868574e-04 9.9733293e-01 2.2581881e-03 1.5284066e-07 3.8038120e-08]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.00102475 0.02696818 0.02147214 0.8367215  0.11381347]
------
914
the melting pot
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [8.6156023e-01 1.3393542e-01 9.9577910e-06 3.0811136e-06 4.4913790e-03]
Word 1 score: [1.12979554e-01 8.87010455e-01 1.06522606e-13 4.36366960e-08
 9.93813319e-06]
Word 2 score: [5.7112536e-04 9.7750354e-01 2.1925159e-02 8.0970544e-08 3.7101291e-08]
------
915
i have successfully completed your reservation for 6 at the melting pot on saturday at 6 ##pm . enjoy !
Predicted label: ['inform']
Real label: ['inform', 'closing']
Predicted slot label: O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O B-date O O O O B-closing I-closing
Real slot label: O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O B-date O O O O B-closing I-closing
Score: 
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [6.3028410e-02 2.7509717e-02 9.0942037e-01 7.9784704e-06 3.3496566e-05]
Word 10 score: [1.3598397e-01 8.6391068e-01 2.3855957e-09 7.8807642e-07 1.0452042e-04]
Word 11 score: [9.3082947e-01 3.3482403e-02 3.5669781e-02 1.8214543e-05 5.9429528e-08]
Word 13 score: [0.28334555 0.03265244 0.00086284 0.30759683 0.3755423 ]
Word 18 score: [6.9762021e-02 1.5101578e-02 9.1201109e-01 3.9818042e-05 3.0855187e-03]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
------
916
please book a table for 3 in seattle for tomorrow at 7 : 00 pm at os ##ter ##ia rig ##ole ##tto under the name elvis du ##mer ##vil
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-personfullname I-personfullname I-personfullname I-personfullname
Real slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-personfullname I-personfullname I-personfullname I-personfullname
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [1.12552345e-01 7.58690061e-04 5.53176403e-01 3.33388418e-01
 1.24198355e-04]
Word 9 score: [7.3973054e-01 9.9960528e-02 1.6756534e-08 4.7304965e-07 1.6030845e-01]
Word 16 score: [9.9999893e-01 1.0580288e-06 2.0398169e-13 2.0398169e-13 2.0398169e-13]
Word 17 score: [9.9999285e-01 7.1423024e-06 2.5113898e-18 2.5113898e-18 2.5113898e-18]
Word 18 score: [9.9037838e-01 9.6215941e-03 3.6390098e-08 3.6390098e-08 3.6390098e-08]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [9.4991417e-05 1.9040918e-04 1.5398586e-04 8.3894047e-06 9.9955231e-01]
Word 26 score: [0.2 0.2 0.2 0.2 0.2]
Word 27 score: [0.2 0.2 0.2 0.2 0.2]
Word 28 score: [0.2 0.2 0.2 0.2 0.2]
------
917
i have secured that table for you , elvis ! thanks for using our service !
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O B-personfullname O B-closing I-closing I-closing I-closing I-closing I-closing
Real slot label: O O O O O O O O B-personfullname O B-closing I-closing I-closing I-closing I-closing I-closing
Score: 
Word 8 score: [1.6989852e-05 4.9688626e-02 9.4656209e-03 3.6078859e-07 9.4082844e-01]
Word 10 score: [1.4449612e-04 2.9346487e-01 5.9841597e-01 1.0392189e-01 4.0527433e-03]
Word 11 score: [1.5841984e-11 1.7916083e-08 1.7652184e-08 9.9999928e-01 6.4039438e-07]
Word 12 score: [7.5173513e-03 4.8344187e-05 7.5173513e-03 9.8491687e-01 5.7326470e-15]
Word 13 score: [4.6504110e-07 3.7574600e-02 7.3452425e-01 7.1821652e-02 1.5607902e-01]
Word 14 score: [1.1752532e-02 1.8008161e-05 1.6417006e-03 1.5823662e-02 9.7076416e-01]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
------
918
are there any asian fusion restaurants near me ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O B-cuisine I-cuisine O B-distanceconstraints I-distanceconstraints O
Real slot label: O O O B-cuisine I-cuisine O B-distanceconstraints I-distanceconstraints O
Score: 
Word 3 score: [2.5527360e-04 2.0196391e-03 1.1651163e-02 9.8462176e-01 1.4521743e-03]
Word 4 score: [1.6890235e-04 9.9981099e-01 7.2145161e-07 1.8823872e-05 5.2721356e-07]
Word 6 score: [4.33493495e-01 4.39944774e-01 2.26636757e-07 1.63465366e-02
 1.10214986e-01]
Word 7 score: [4.6889443e-07 9.9999928e-01 9.2698480e-09 5.4282406e-08 2.3973283e-07]
------
919
where are you located ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
920
nash ##ua , nh
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city I-city O B-state
Real slot label: B-city I-city O B-state
Score: 
Word 0 score: [1.2301818e-04 1.3057867e-03 3.0927398e-04 9.1836475e-02 9.0642548e-01]
Word 1 score: [2.1784354e-05 4.1372232e-06 3.7181249e-05 9.9972075e-01 2.1611828e-04]
Word 3 score: [1.000000e+00 2.385609e-13 2.385609e-13 2.385609e-13 2.385609e-13]
------
921
here are 3 of the top rated asian fusion restaurants in nash ##ua : shanghai osaka , san francisco kitchen , noodles & company .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O B-rating I-rating B-cuisine I-cuisine O O O O O B-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O O B-rating I-rating B-cuisine I-cuisine O O O O O B-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 5 score: [2.9950715e-07 5.6730582e-06 3.4442877e-08 4.9999702e-01 4.9999702e-01]
Word 6 score: [8.9404064e-01 4.5651390e-04 5.8413057e-12 5.1635688e-14 1.0550293e-01]
Word 7 score: [0.00126184 0.00172617 0.9761814  0.01968451 0.00114609]
Word 8 score: [2.6928708e-03 9.9708337e-01 3.6687129e-06 2.1934419e-04 7.8424608e-07]
Word 14 score: [2.6543909e-10 1.9017530e-07 9.9998212e-01 2.1783887e-06 1.5520514e-05]
Word 15 score: [1.19698474e-04 1.12984690e-03 9.82783556e-01 4.01002821e-03
 1.19568072e-02]
Word 17 score: [2.1105127e-07 8.6071789e-01 1.3928120e-01 6.3001545e-07 6.5337133e-08]
Word 18 score: [2.6093167e-05 7.8460298e-02 9.2151356e-01 4.8205443e-08 4.3504104e-18]
Word 19 score: [6.0659519e-14 9.9863571e-01 1.3642735e-03 6.4740052e-10 2.8018815e-11]
Word 21 score: [6.2769320e-04 6.8474445e-04 5.2763562e-07 5.2763562e-07 9.9868661e-01]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [1.5857713e-09 2.1903325e-06 9.9643648e-01 3.0231501e-03 5.3816003e-04]
------
922
are there any other options ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O
Real slot label: O O O O O O
Score: 
------
923
do you have a price range or atmosphere in mind ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
924
i would like a casual atmosphere with price range per dish of $ 10 to $ 15
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O B-atmosphere O O O O B-pricing I-pricing I-pricing I-pricing I-pricing I-pricing I-pricing I-pricing
Real slot label: O O O O B-atmosphere O O O O B-pricing I-pricing I-pricing I-pricing I-pricing I-pricing I-pricing I-pricing
Score: 
Word 4 score: [3.3054919e-06 1.4596604e-07 1.2557180e-01 8.7441862e-01 6.1917481e-06]
Word 9 score: [4.7994170e-02 4.9562030e-04 5.8939588e-01 2.4336355e-03 3.5968071e-01]
Word 10 score: [4.5367924e-04 2.0821493e-18 3.5701826e-01 6.4252812e-01 1.1733164e-18]
Word 11 score: [9.99999642e-01 5.49490897e-09 1.40009435e-08 1.87294003e-08
 3.95862344e-07]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [4.4952776e-13 5.9912304e-06 3.1307744e-04 1.3962362e-14 9.9968100e-01]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
------
925
here are a few other options : chen yang li , soho asian restaurant & bar , pacific fusion .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname O
Real slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname O
Score: 
Word 7 score: [9.5727682e-01 2.5357146e-04 1.1661995e-03 4.1300930e-02 2.5226966e-06]
Word 8 score: [7.4398501e-13 3.9704454e-07 1.8789656e-02 7.0303239e-02 9.1090679e-01]
Word 9 score: [6.4209903e-06 5.9894405e-06 4.6438510e-03 9.9534374e-01 1.0832729e-11]
Word 11 score: [4.7178710e-06 6.7587505e-05 4.7178710e-06 9.8817956e-01 1.1743329e-02]
Word 12 score: [6.8695676e-03 4.1139056e-04 2.9524717e-01 2.0481367e-03 6.9542372e-01]
Word 13 score: [9.0873218e-15 6.4471185e-01 4.1099004e-03 3.5117823e-01 1.8480377e-18]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [6.4397167e-04 1.1304699e-08 8.9704372e-07 4.3141950e-04 9.9892360e-01]
Word 17 score: [9.9952161e-01 4.2513257e-05 1.1375489e-04 1.6139837e-06 3.2047095e-04]
Word 18 score: [2.5161130e-06 9.9994111e-01 4.7070967e-06 8.2970582e-06 4.3286316e-05]
------
926
tell me more about chen yang li
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O B-restaurantname I-restaurantname I-restaurantname
Real slot label: O O O O B-restaurantname I-restaurantname I-restaurantname
Score: 
Word 4 score: [7.3696816e-01 9.7060169e-05 2.1471562e-04 2.6271695e-01 3.0410997e-06]
Word 5 score: [7.8067368e-14 1.3674563e-06 4.7625917e-01 8.3206156e-03 5.1541883e-01]
Word 6 score: [5.1926964e-08 6.5013894e-10 1.3313840e-04 9.9986684e-01 5.5981698e-14]
------
927
chen yang li is an informal eater ##y offering traditional chinese fare plus su ##shi & other popular asian dishes .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname O O B-atmosphere O O O B-cuisine I-cuisine I-cuisine I-cuisine I-cuisine I-cuisine I-cuisine I-cuisine I-cuisine I-cuisine I-cuisine O
Real slot label: B-restaurantname I-restaurantname I-restaurantname O O B-atmosphere O O O B-cuisine I-cuisine I-cuisine I-cuisine I-cuisine I-cuisine I-cuisine I-cuisine I-cuisine I-cuisine I-cuisine O
Score: 
Word 0 score: [1.7907111e-01 5.9408862e-03 8.1438363e-01 6.0435577e-04 1.3942193e-08]
Word 1 score: [7.3807063e-12 7.2113039e-07 7.9850201e-03 1.1225948e-01 8.7975478e-01]
Word 2 score: [3.8312360e-06 7.8578989e-07 3.2597792e-03 9.9673551e-01 2.7220095e-12]
Word 5 score: [4.5627192e-07 7.9658751e-09 9.9999523e-01 3.3904437e-09 4.3021123e-06]
Word 9 score: [4.6152778e-02 9.3710440e-01 1.6742805e-02 2.0229388e-08 4.0040327e-08]
Word 10 score: [1.9967388e-01 3.1236148e-08 7.8664561e-11 7.9987931e-01 4.4684109e-04]
Word 11 score: [3.3694531e-07 4.1846793e-05 9.1390641e-05 9.9979967e-01 6.6826608e-05]
Word 12 score: [2.3760673e-08 2.9355601e-10 2.3886387e-06 2.3886387e-06 9.9999523e-01]
Word 13 score: [8.3894580e-09 9.9976796e-01 4.2973211e-10 1.3726293e-06 2.3064532e-04]
Word 14 score: [4.7192036e-05 1.4633812e-04 3.7414786e-06 1.0388538e-03 9.9876404e-01]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [2.3398371e-02 2.1588641e-01 4.7913166e-03 2.4160345e-04 7.5568229e-01]
Word 17 score: [2.8739444e-03 8.5311185e-04 9.9621922e-01 5.2599891e-05 1.1678801e-06]
Word 18 score: [8.3766063e-05 6.9207588e-04 4.3194517e-03 9.9484730e-01 5.7414265e-05]
Word 19 score: [2.5572196e-01 5.6086559e-13 3.1440826e-21 7.4140275e-01 2.8753099e-03]
------
928
please give me a list of mexican restaurants in downtown seattle .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O B-address B-city O
Real slot label: O O O O O O O O O B-address B-city O
Score: 
Word 9 score: [2.2503041e-08 1.0000000e+00 2.5184022e-10 5.6215320e-08 4.3824852e-10]
Word 10 score: [3.7845229e-03 2.1860877e-05 2.3182052e-01 4.7824037e-04 7.6389486e-01]
------
929
at what date would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
930
what ##s open late in wilmington , nc
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O B-restauranttype I-restauranttype O B-city O B-state
Real slot label: O O B-restauranttype I-restauranttype O B-city O B-state
Score: 
Word 2 score: [9.5479754e-07 7.2095645e-08 6.2193978e-04 9.9934822e-01 2.8764814e-05]
Word 3 score: [5.1894558e-06 9.7830498e-01 4.4853604e-04 2.1124510e-08 2.1241339e-02]
Word 5 score: [6.5674954e-05 2.8185386e-07 1.0505874e-02 4.2620312e-02 9.4680780e-01]
Word 7 score: [1.000000e+00 7.301447e-13 7.301447e-13 7.301447e-13 7.301447e-13]
------
931
what date would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
932
saturday
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date
Real slot label: B-date
Score: 
Word 0 score: [7.4253075e-02 2.4294366e-01 4.9909563e-06 6.8277693e-01 2.1334296e-05]
------
933
at what time would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
934
0 . 04 ##16 ##66 ##66 ##7
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
935
how many guests ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O
Real slot label: O O O O
Score: 
------
936
3
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
937
do you have a type of cuisine in mind ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
938
cr ##ep ##es
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-cuisine I-cuisine I-cuisine
Real slot label: B-cuisine I-cuisine I-cuisine
Score: 
Word 0 score: [0.00177635 0.2495559  0.2495559  0.2495559  0.2495559 ]
Word 1 score: [1.000000e+00 1.894022e-11 1.894022e-11 1.894022e-11 1.894022e-11]
Word 2 score: [9.9999917e-01 1.8741051e-07 1.8741051e-07 1.8741051e-07 1.8741051e-07]
------
939
there is no cr ##ep ##erie available with those details , would you like to try another cuisine ?
Predicted label: ['request', 'inform']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O
Score: 
------
940
southern
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-cuisine
Real slot label: B-cuisine
Score: 
Word 0 score: [1.1151874e-01 1.1384222e-03 8.8623643e-01 3.6947135e-05 1.0694660e-03]
------
941
i ' m sorry , no restaurants are available for reservations at 1a ##m . would you like to select another time ?
Predicted label: ['request', 'inform']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
942
10 ##pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-starttime I-starttime
Real slot label: B-starttime I-starttime
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
------
943
i found one option for you : catch . there is only a table available at 9 ##pm . would you like to book this or perhaps i should try a different kind of food ?
Predicted label: ['request', 'inform']
Real label: ['confirm_question']
Predicted slot label: O O O O O O O B-restaurantname O O O O O O O O B-starttime I-starttime O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O B-restaurantname O O O O O O O O B-starttime I-starttime O O O O O O O O O O O O O O O O O O
Score: 
Word 7 score: [1.9655917e-07 6.7608380e-03 1.8997472e-06 8.8038576e-08 9.9323696e-01]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
------
944
book that
Predicted label: ['request']
Real label: ['confirm_answer']
Predicted slot label: O O
Real slot label: O O
Score: 
------
945
success ! i have booked a table for 3 at catch on 3 / 12 at 9 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O B-numberofpeople O B-restaurantname O B-date I-date I-date O B-starttime I-starttime O
Real slot label: O O O O O O O O B-numberofpeople O B-restaurantname O B-date I-date I-date O B-starttime I-starttime O
Score: 
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [1.7800147e-07 4.4326972e-02 4.0025607e-06 1.1620284e-07 9.5566863e-01]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
------
946
the location of the vegas burger joint sent
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O B-cuisine I-cuisine B-restaurantname I-restaurantname
Real slot label: O O O O B-cuisine I-cuisine B-restaurantname I-restaurantname
Score: 
Word 4 score: [1.0000000e+00 2.5708937e-08 2.5708937e-08 2.5708937e-08 2.5708937e-08]
Word 5 score: [1.6504164e-03 1.3017738e-01 2.8795359e-05 1.5388937e-04 8.6798960e-01]
Word 6 score: [2.5719933e-03 9.9742800e-01 7.2810946e-10 1.4695322e-12 2.9240126e-09]
Word 7 score: [1.4749814e-10 6.1001870e-06 9.9999392e-01 1.3018413e-16 1.3018413e-16]
------
947
i ' m not sure what you are asking . i do n ' t see any burger restaurants named ' joint sent ' in las vegas .
Predicted label: ['inform', 'confirm_question']
Real label: ['inform', 'Not_Sure']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
948
i would like to book a seafood place in seattle on 03 / 19 at 1 : 30 ##pm for 2 people
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O B-restauranttype I-restauranttype O B-city O B-date I-date I-date O B-starttime I-starttime I-starttime I-starttime O B-numberofpeople O
Real slot label: O O O O O O B-restauranttype I-restauranttype O B-city O B-date I-date I-date O B-starttime I-starttime I-starttime I-starttime O B-numberofpeople O
Score: 
Word 6 score: [3.5891120e-05 7.7356927e-02 5.8671474e-03 9.4594461e-06 9.1673052e-01]
Word 7 score: [3.8494354e-09 6.5796500e-12 2.6845155e-06 9.9999642e-01 8.4179300e-07]
Word 9 score: [6.5809026e-02 1.6942872e-04 8.0508269e-02 8.0036438e-01 5.3148817e-02]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
------
949
sure thing ! 99 park restaurant ; anthony ' s home ##port - des moines ; and ar ##nies - edmond ##s are all available at that time . which would you like to book ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O
Real slot label: O O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O
Score: 
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [8.9982757e-05 8.1273820e-03 6.6170149e-02 9.2253095e-01 3.0814952e-03]
Word 5 score: [2.0490469e-14 9.4302285e-01 9.0609601e-04 5.6071009e-02 2.7824056e-17]
Word 7 score: [1.9216925e-07 5.4505587e-02 3.3898327e-02 5.4405797e-01 3.6753798e-01]
Word 8 score: [8.09007347e-01 9.96212693e-05 1.36968866e-01 1.14028495e-04
 5.38101345e-02]
Word 9 score: [9.9847835e-01 4.3094474e-06 2.2469412e-07 2.6108473e-06 1.5145073e-03]
Word 10 score: [9.9444652e-01 7.7509190e-05 2.7379792e-03 2.7379792e-03 4.8803975e-11]
Word 11 score: [9.9481118e-01 7.8008728e-05 2.5554395e-03 2.5554395e-03 8.5019054e-11]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [4.9182398e-07 3.0388471e-06 9.7548383e-01 1.6790418e-02 7.7222106e-03]
Word 14 score: [9.8943198e-01 5.3752965e-04 3.6561303e-04 8.0885412e-03 1.5762633e-03]
Word 17 score: [4.8197834e-03 9.8851508e-01 2.7206357e-11 1.6781630e-15 6.6651623e-03]
Word 18 score: [2.1029259e-01 6.9376999e-03 1.2911102e-12 6.2367442e-14 7.8276974e-01]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
------
950
99 park restaurant
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [6.1763349e-06 8.8410761e-04 8.3248075e-03 9.9054420e-01 2.4068535e-04]
Word 2 score: [4.5389578e-15 6.8033904e-01 3.4453017e-03 3.1621569e-01 4.6962145e-19]
------
951
your reservation has been confirmed . please enjoy your meal ; and thank you for using our service !
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O O O O O B-closing I-closing I-closing I-closing I-closing I-closing O
Real slot label: O O O O O O O O O O O O B-closing I-closing I-closing I-closing I-closing I-closing O
Score: 
Word 12 score: [7.4861236e-03 1.9313593e-05 9.9223936e-01 1.6433665e-07 2.5498093e-04]
Word 13 score: [6.4417249e-01 1.7050372e-03 2.2451408e-02 2.2366160e-04 3.3144742e-01]
Word 14 score: [8.6371221e-09 1.4790890e-06 1.0332472e-08 9.9998426e-01 1.4239876e-05]
Word 15 score: [1.8280519e-02 2.6556151e-04 1.8280519e-02 9.6317333e-01 9.5200750e-14]
Word 16 score: [3.5475116e-06 8.1985869e-02 7.7769560e-01 8.0199167e-02 6.0115803e-02]
Word 17 score: [1.38309635e-02 1.14177681e-04 3.89656960e-03 1.46703692e-02
 9.67488050e-01]
------
952
can you book the hard rock cafe at 3 pm on march 18th for 2 people in seattle ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O B-date I-date O B-numberofpeople O O B-city O
Real slot label: O O O O O O O O O O O B-date I-date O B-numberofpeople O O B-city O
Score: 
Word 11 score: [1.2035430e-05 8.8212329e-01 3.8065679e-02 3.6665339e-02 4.3133732e-02]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [7.9278655e-02 1.8046009e-04 4.3810174e-01 4.8229539e-01 1.4375792e-04]
------
953
hi . i ' ve booked your restaurant for tomorrow . thank you .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O B-date O B-closing I-closing O
Real slot label: O O O O O O O O O B-date O B-closing I-closing O
Score: 
Word 9 score: [3.4174275e-01 6.5779108e-01 1.1054948e-08 9.9091676e-07 4.6510689e-04]
Word 11 score: [1.1567635e-02 3.3124007e-07 9.8834687e-01 4.5781948e-10 8.5116189e-05]
Word 12 score: [9.2139608e-01 1.6060384e-03 1.6567361e-02 7.8885008e-05 6.0351729e-02]
------
954
book me a table for 1 at ag ##rod ##ol ##ce in seattle for tomorrow at 7 : 00 pm .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-date O O O O O O
Real slot label: O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-date O O O O O O
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [9.6037120e-01 3.2920938e-02 6.7079179e-03 3.0278839e-09 3.0278839e-09]
Word 8 score: [9.9999833e-01 4.4039695e-07 1.1629901e-06 7.7842861e-15 7.7842861e-15]
Word 9 score: [9.9999583e-01 3.8555308e-06 2.5747391e-07 2.5579215e-08 2.5579215e-08]
Word 10 score: [9.9999619e-01 3.5548442e-06 2.6315411e-07 1.9189368e-08 1.9189368e-08]
Word 14 score: [8.0708319e-01 7.0096225e-02 1.6061442e-07 3.8059950e-06 1.2281663e-01]
------
955
success ! i was able to book you a table for 1 at ag ##rod ##ol ##ce tomorrow at 7 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname B-date O O O O
Real slot label: O O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname B-date O O O O
Score: 
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [9.0347427e-01 7.1542129e-02 2.4983553e-02 3.9077785e-09 3.9077785e-09]
Word 14 score: [9.9999893e-01 4.1317548e-07 6.8340148e-07 2.8842806e-15 2.8842806e-15]
Word 15 score: [9.9999499e-01 4.7995677e-06 2.9526967e-07 4.0826169e-09 4.0826169e-09]
Word 16 score: [9.9999487e-01 4.7196486e-06 3.3402546e-07 2.2806377e-09 2.2806377e-09]
Word 17 score: [7.9694303e-07 1.2537172e-06 1.1955758e-13 1.2584097e-11 9.9999785e-01]
------
956
please book a table for 3 in seattle for tomorrow at 7 : 00 pm at el cam ##ino under the name sophia pet ##rill ##o
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O B-personfullname I-personfullname I-personfullname I-personfullname
Real slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O B-personfullname I-personfullname I-personfullname I-personfullname
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [1.2909319e-01 1.2960102e-03 4.4788900e-01 4.2159063e-01 1.3122147e-04]
Word 9 score: [8.1413448e-01 1.2745181e-01 1.3580976e-08 3.6184747e-07 5.8413271e-02]
Word 16 score: [1.2332270e-05 3.3884196e-04 1.4786752e-06 9.9964738e-01 6.5374524e-09]
Word 17 score: [2.0542911e-03 9.9794573e-01 9.9313938e-13 1.3090991e-17 1.3090991e-17]
Word 18 score: [1.1583478e-03 9.9884170e-01 4.7902769e-11 3.1553669e-13 3.1553669e-13]
Word 22 score: [9.99846339e-01 5.81103414e-08 1.09851580e-05 1.21562916e-04
 2.11452680e-05]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
------
957
your reservation has been confirmed . please enjoy your meal , and thank you for using our service !
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'closing']
Predicted slot label: O O O O O O O B-closing I-closing I-closing O O O O O O O O O
Real slot label: O O O O O O O B-closing I-closing I-closing O O O O O O O O O
Score: 
Word 7 score: [1.2973369e-02 4.8034146e-02 9.3653965e-01 2.4525381e-03 4.0153992e-07]
Word 8 score: [7.7921046e-05 9.9930930e-01 6.1271992e-04 2.9389575e-17 2.9389575e-17]
Word 9 score: [6.3473152e-08 6.0515930e-08 4.4290641e-07 4.9270269e-01 5.0729674e-01]
------
958
can you find a restaurant that makes ethiopian food in los angeles ? i have 4 people and it ' s for tonight 7 ##pm
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O B-food O O B-city I-city O O O B-numberofpeople O O O O O O B-date B-starttime I-starttime
Real slot label: O O O O O O O B-food O O B-city I-city O O O B-numberofpeople O O O O O O B-date B-starttime I-starttime
Score: 
Word 7 score: [1.6640654e-02 8.2369678e-10 9.8334658e-01 1.2469673e-05 3.9918899e-07]
Word 10 score: [3.6844864e-05 6.2759202e-05 1.4067901e-02 6.3288198e-06 9.8582608e-01]
Word 11 score: [8.84278655e-01 1.50716736e-03 1.14214085e-01 1.27011830e-11
 1.27011830e-11]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.01058031 0.28825232 0.03083627 0.10000875 0.57032233]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
------
959
here are 3 of the top rated restaurants in los angeles with ethiopian food : mess ##ob ethiopian restaurant , mer ##kato ethiopian restaurant , and rosa ##lind ' s ethiopian restaurant . would you like to try one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [8.4428924e-01 5.0968818e-05 1.5565796e-01 5.9720281e-07 1.2964019e-06]
Word 18 score: [5.2707858e-14 8.7766999e-01 1.3719145e-03 1.2095806e-01 1.0110896e-16]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [8.3871317e-01 6.6509208e-05 1.6121840e-01 5.4510502e-07 1.3405855e-06]
Word 23 score: [4.9446080e-14 9.0076476e-01 1.2381824e-03 9.7996980e-02 8.7688239e-17]
Word 26 score: [4.5167880e-08 2.9129112e-08 9.7945429e-02 9.0205449e-01 2.6092778e-13]
Word 27 score: [5.7885114e-05 3.8405400e-11 9.9994206e-01 4.2998863e-08 6.8676237e-15]
Word 28 score: [9.9830085e-01 2.1626229e-06 5.7449574e-07 4.2203701e-06 1.6922087e-03]
Word 29 score: [9.9767739e-01 5.8275273e-06 3.6665020e-07 4.7408871e-06 2.3116537e-03]
Word 30 score: [7.8892249e-01 4.8431422e-05 2.1102744e-01 8.5420305e-07 8.4691089e-07]
Word 31 score: [6.7171793e-14 8.5282111e-01 1.6468534e-03 1.4553197e-01 1.5385201e-16]
------
960
sure , i ' ll go with mer ##kato
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname
Real slot label: O O O O O O O B-restaurantname I-restaurantname
Score: 
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
------
961
unfortunately , this restaurant is not on the open ##table reservation network . to see if they take reservations and have availability , you will need to call the restaurant directly or visit their website .
Predicted label: ['multiple_choice']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
962
please book angel ##ini os ##ter ##ia in la for my party and time
Predicted label: ['inform']
Real label: ['request']
Predicted slot label: O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-city O O O O O
Real slot label: O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-city O O O O O
Score: 
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [9.946960e-01 5.303988e-03 4.372825e-09 4.372825e-09 4.372825e-09]
Word 5 score: [9.9613780e-01 3.8621931e-03 2.1247903e-09 2.1247903e-09 2.1247903e-09]
Word 6 score: [9.920312e-01 7.968815e-03 4.601851e-09 4.601851e-09 4.601851e-09]
Word 8 score: [8.5728890e-01 4.3990134e-04 4.8270022e-07 1.3347085e-01 8.7998314e-03]
------
963
no tables are available within 2 . 5 hours of your 7 : 00 pm request . the next available reservation is march 10th at 9 ##pm , would you like to book ?
Predicted label: ['inform', 'confirm_question']
Real label: ['confirm_question']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O B-date I-date O B-starttime I-starttime O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O B-date I-date O B-starttime I-starttime O O O O O O O
Score: 
Word 22 score: [2.6415439e-05 4.8810211e-01 1.7708226e-01 1.4781730e-01 1.8697192e-01]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
Word 26 score: [0.2 0.2 0.2 0.2 0.2]
------
964
ye ##a , i guess that will work , thanks
Predicted label: ['confirm_answer', 'thanks']
Real label: ['confirm_answer']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
965
your reservation on march 10th at 9 ##pm at angel ##lini os ##ter ##ia for 4 was confirmed . enjoy your meal .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O B-date I-date O B-starttime I-starttime O O O O O O O B-numberofpeople O O O B-closing I-closing I-closing O
Real slot label: O O O B-date I-date O B-starttime I-starttime O O O O O O O B-numberofpeople O O O B-closing I-closing I-closing O
Score: 
Word 3 score: [6.9347170e-06 5.6169903e-01 2.2466719e-02 5.3142621e-03 4.1051301e-01]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [7.5887531e-02 6.7047672e-03 9.1028088e-01 2.2880515e-05 7.1039810e-03]
Word 20 score: [1.9080300e-05 9.9232531e-01 7.6556364e-03 7.6101192e-20 7.6101192e-20]
Word 21 score: [1.0081391e-05 3.6727856e-06 9.0356647e-05 8.6779708e-01 1.3209875e-01]
------
966
i would like to eat lobster tails tuesday at 2 pm with a party of 4 in downtown seattle
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-food I-food B-date O B-numberofpeople O O O O O O O O B-city
Real slot label: O O O O O B-food I-food B-date O B-numberofpeople O O O O O O O O B-city
Score: 
Word 5 score: [3.3932231e-08 3.6645769e-16 2.4386975e-11 7.0319556e-02 9.2968047e-01]
Word 6 score: [6.9905317e-01 4.4260862e-05 7.1179349e-04 3.7014678e-03 2.9648930e-01]
Word 7 score: [9.3140528e-07 1.9100399e-07 3.3366199e-08 1.4533202e-07 9.9999869e-01]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [5.5899168e-03 4.9406026e-05 3.0930361e-01 7.4128655e-04 6.8431574e-01]
------
967
here are 3 of the best restaurants in seattle that serve lobster tails : metropolitan grill , the capital grill , the brooklyn seafood , steak & oyster house . would you like to book one of those or would you prefer more options ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O B-city O O B-food I-food O B-restaurantname I-restaurantname O O O O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O B-city O O B-food I-food O B-restaurantname I-restaurantname O O O O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O
Score: 
Word 8 score: [9.6455604e-02 9.5160045e-05 8.3176382e-03 8.7061507e-01 2.4516471e-02]
Word 11 score: [1.4174941e-07 3.6450174e-12 2.0432703e-08 7.8547612e-02 9.2145222e-01]
Word 12 score: [0.8147914  0.00379188 0.00778627 0.03914946 0.13448091]
Word 14 score: [0.03826073 0.47679982 0.00193357 0.00620616 0.47679982]
Word 15 score: [3.3751811e-17 1.6019651e-20 3.3054936e-03 9.1119506e-16 9.9669456e-01]
Word 21 score: [3.4969192e-02 1.3093452e-02 9.5184249e-01 1.6306840e-05 7.8542238e-05]
Word 22 score: [3.2328504e-08 3.4730025e-08 7.1026611e-01 2.7723852e-01 1.2495254e-02]
Word 23 score: [1.2476637e-04 9.6206439e-01 3.6681514e-02 3.0204754e-05 1.0992072e-03]
Word 25 score: [9.9921720e-03 4.9043708e-02 9.2867096e-11 4.1108117e-10 9.4096416e-01]
Word 26 score: [0.2 0.2 0.2 0.2 0.2]
Word 27 score: [9.5247334e-01 2.9452985e-02 1.8056488e-02 5.7535416e-09 1.7197945e-05]
Word 28 score: [0.0036898  0.7931702  0.00706797 0.11483266 0.08123928]
------
968
sea ##k and oyster house please
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 0 score: [0.61504567 0.07308199 0.14749388 0.08218922 0.08218922]
Word 1 score: [8.7936056e-01 4.1836747e-06 1.2063524e-01 1.7759989e-14 1.7759989e-14]
Word 2 score: [0.37696344 0.02608664 0.02055809 0.01588333 0.56050843]
Word 3 score: [9.6579719e-01 1.7088072e-03 3.2493606e-02 3.1240814e-09 4.7270984e-07]
Word 4 score: [2.6839648e-04 7.5374192e-01 1.4631656e-03 9.2416950e-02 1.5210962e-01]
------
969
i am sorry , i am not able to book that restaurant . i do show an opening on your date and time at the capital grill . would you like to reserve that ?
Predicted label: ['inform', 'confirm_question']
Real label: ['confirm_question']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O
Score: 
Word 24 score: [3.9674204e-02 2.0848379e-02 9.3939376e-01 3.2645767e-05 5.0907878e-05]
Word 25 score: [3.0751166e-10 2.0614586e-10 5.3432347e-10 9.9999976e-01 2.4421655e-07]
Word 26 score: [2.4501842e-17 2.3608234e-20 5.2976602e-04 5.2317533e-17 9.9947029e-01]
------
970
ok yes !
Predicted label: ['confirm_answer']
Real label: ['confirm_answer']
Predicted slot label: O O O
Real slot label: O O O
Score: 
------
971
excellent - i have made a reservation for you at the capital grill , under the name jane doe for 3 / 8 at 2 pm for 4 people .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O O B-personfullname I-personfullname O B-date I-date I-date O B-starttime I-starttime O B-numberofpeople O O
Real slot label: O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O O B-personfullname I-personfullname O B-date I-date I-date O B-starttime I-starttime O B-numberofpeople O O
Score: 
Word 10 score: [3.6569351e-01 5.6763958e-02 5.7739657e-01 8.6930095e-06 1.3719923e-04]
Word 11 score: [1.1498868e-08 5.0201017e-09 4.0877235e-10 9.9998283e-01 1.7110266e-05]
Word 12 score: [4.1406431e-19 2.2023676e-21 1.7873953e-04 2.2844158e-17 9.9982125e-01]
Word 17 score: [1.5690753e-03 1.3855532e-07 4.9549557e-04 9.9780601e-01 1.2933495e-04]
Word 18 score: [8.0186082e-04 2.0460583e-10 8.6014094e-09 1.4526828e-11 9.9919814e-01]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [5.7791567e-05 7.7049667e-01 2.2943528e-01 1.0299980e-05 4.3020272e-08]
Word 27 score: [0.2 0.2 0.2 0.2 0.2]
------
972
i need to book a table for 3 / 21 at 7 pm for dinner at the anthony ' s fish gr ##otto in la mesa for two guests .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O B-mealtype O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-city I-city O O O O
Real slot label: O O O O O O O O O O O O O O B-mealtype O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-city I-city O O O O
Score: 
Word 14 score: [9.9996662e-01 8.0782875e-06 7.7340296e-12 2.5281232e-05 7.0557965e-10]
Word 17 score: [2.6160015e-07 8.3178133e-02 8.1233807e-02 3.4366277e-01 4.9192506e-01]
Word 18 score: [7.4087691e-01 1.4199366e-05 2.3269458e-01 5.1390049e-05 2.6362810e-02]
Word 19 score: [9.9968636e-01 3.2493429e-07 1.7011860e-07 5.1663744e-07 3.1273894e-04]
Word 20 score: [1.4645707e-05 9.6706867e-01 1.0276571e-09 6.4209185e-12 3.2916646e-02]
Word 21 score: [3.7320486e-05 8.9422916e-05 9.9940360e-01 4.6954991e-04 6.1451580e-08]
Word 22 score: [4.56170819e-05 7.11250032e-05 9.99364674e-01 5.18473622e-04
 1.15874414e-07]
Word 24 score: [9.6783262e-01 2.4263330e-05 7.3765827e-06 8.1725623e-03 2.3963204e-02]
Word 25 score: [9.2092323e-06 1.4601237e-04 2.1209676e-02 2.3415945e-08 9.7863501e-01]
------
973
i ' ve confirmed availability and booked your reservation for dinner at anthony ' s fish gr ##otto - la mesa . enjoy your meal !
Predicted label: ['inform']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-closing I-closing I-closing O
Real slot label: O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-closing I-closing I-closing O
Score: 
Word 12 score: [4.61727332e-08 2.46582583e-01 1.28248995e-02 6.07781649e-01
 1.32810906e-01]
Word 13 score: [9.2501217e-01 1.8218216e-05 2.7463717e-02 5.6447116e-05 4.7449432e-02]
Word 14 score: [9.9909449e-01 2.8329384e-07 2.2307489e-08 5.6289434e-07 9.0470636e-04]
Word 15 score: [2.02214214e-05 9.02228951e-01 1.38269245e-08 1.85747511e-11
 9.77508500e-02]
Word 16 score: [2.0999715e-03 7.2045875e-04 9.9358433e-01 3.5951312e-03 2.2776010e-08]
Word 17 score: [2.1124519e-03 5.5090571e-04 9.9477553e-01 2.5610395e-03 1.6956882e-08]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [1.5915690e-03 5.7829338e-01 7.9846103e-09 2.7323627e-01 1.4687876e-01]
Word 20 score: [3.6781212e-06 9.3742318e-07 4.1418542e-05 4.3068032e-10 9.9995399e-01]
Word 22 score: [1.09164044e-01 1.92146841e-02 8.63987446e-01 6.52528979e-05
 7.56863831e-03]
Word 23 score: [8.5211199e-05 9.9612123e-01 3.7935448e-03 9.1719292e-18 9.1719292e-18]
Word 24 score: [1.8860454e-04 2.3066827e-04 3.0936513e-03 6.8936688e-01 3.0712014e-01]
------
974
book me nearest mexican restaurant
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O B-restauranttype O
Real slot label: O O O B-restauranttype O
Score: 
Word 3 score: [1.9220619e-05 1.9850304e-02 2.5497508e-04 8.9596018e-02 8.9027953e-01]
------
975
can you please specify you location ? i would need to know city name .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O
Score: 
------
976
i ' m in new york city
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O B-city I-city O
Real slot label: O O O O B-city I-city O
Score: 
Word 4 score: [3.3696977e-06 9.8176562e-05 1.7398912e-12 9.1669218e-13 9.9989843e-01]
Word 5 score: [4.7122404e-01 7.2677736e-05 5.7712644e-02 4.7062406e-01 3.6653859e-04]
------
977
here are the restaurants i found matching your request . please select one : 1 ) la esq ##uin ##a - 2 ) dos cam ##ino ##s - rating : 3 . 5 out of 5 . 3 ) dos cam ##ino ##s - rating : 3 . 5 out of 5 .
Predicted label: ['inform']
Real label: ['multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
978
book me dos cam ##ino ##s please
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 2 score: [0.5646759  0.14818317 0.10843814 0.00154418 0.17715864]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
------
979
how many people are going ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O
Real slot label: O O O O O O
Score: 
------
980
2
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
981
at what date would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
982
tomorrow at 7 ##pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date O B-starttime I-starttime
Real slot label: B-date O B-starttime I-starttime
Score: 
Word 0 score: [8.5865561e-04 9.9913812e-01 2.8052985e-10 1.0523317e-07 3.0792173e-06]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
------
983
your reservation at dos cam ##ino ##s for 02 / 16 / 2016 07 : 00pm for 2 people under john smith has been confirmed .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date I-date I-date O O O O B-numberofpeople O O B-personfullname I-personfullname O O O O
Real slot label: O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date I-date I-date O O O O B-numberofpeople O O B-personfullname I-personfullname O O O O
Score: 
Word 3 score: [0.24423292 0.67665756 0.01498277 0.00126687 0.06285977]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [2.4329944e-02 1.8974608e-03 1.1929662e-08 9.7160792e-01 2.1647457e-03]
Word 21 score: [4.5944727e-04 3.1923864e-06 6.1253534e-04 4.8458412e-07 9.9892431e-01]
------
984
please book a table for 3 in seattle for tomorrow at 7 : 30 pm at sera ##fin ##a under the name lucille blu ##th
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O B-personfullname I-personfullname I-personfullname
Real slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O B-personfullname I-personfullname I-personfullname
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [1.1357040e-01 8.4575691e-04 6.3451380e-01 2.5098175e-01 8.8262197e-05]
Word 9 score: [7.9541099e-01 1.3080080e-01 1.0586737e-08 5.6798791e-07 7.3787592e-02]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
------
985
i have successfully booked your reservation ! enjoy !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-closing O
Real slot label: O O O O O O O B-closing O
Score: 
Word 7 score: [7.4706614e-02 5.9284726e-03 9.1923714e-01 3.5738827e-05 9.2077942e-05]
------
986
i have an important business meeting with 10 people . i need a nice place in orlando to take them for lunch .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O B-numberofpeople O O O O O B-restauranttype I-restauranttype O B-city O O O O B-mealtype O
Real slot label: O O O O O O O B-numberofpeople O O O O O B-restauranttype I-restauranttype O B-city O O O O B-mealtype O
Score: 
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [9.9998307e-01 1.6870272e-05 2.9193071e-08 2.9193071e-08 1.0017600e-12]
Word 14 score: [8.4196545e-06 8.4200869e-14 4.4260338e-07 9.9999106e-01 4.4063800e-08]
Word 16 score: [6.4712169e-04 2.0540033e-04 4.8332303e-04 1.8596333e-01 8.1270075e-01]
Word 21 score: [1.2440868e-05 1.5428375e-03 2.1761240e-04 7.4246776e-01 2.5575936e-01]
------
987
what date were you looking to reserve ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
988
friday . maybe 11 ##am ?
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date O O B-starttime I-starttime O
Real slot label: B-date O O B-starttime I-starttime O
Score: 
Word 0 score: [9.6305329e-01 1.5166928e-02 1.7237209e-02 9.0281671e-04 3.6398803e-03]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
------
989
who ' s name would you like to book under ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
990
candy cane
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname I-personfullname
Real slot label: B-personfullname I-personfullname
Score: 
Word 0 score: [9.8896690e-04 6.9252657e-08 1.1416881e-04 9.9888855e-01 8.1483477e-06]
Word 1 score: [4.8437417e-02 1.1405721e-02 6.0245816e-06 9.0593219e-01 3.4218587e-02]
------
991
i ' ve found a few great options for you ! 1 ) em ##eri ##l ' s restaurant , 2 ) enzo ' s on the lake , and 3 ) fog ##o de chao . would you like to book one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 13 score: [9.9660093e-01 8.3476992e-04 2.5643765e-03 1.8266428e-11 1.8266428e-11]
Word 14 score: [8.42547178e-01 3.31035331e-02 1.24349214e-01 1.93014459e-11
 1.93014459e-11]
Word 15 score: [9.4277412e-03 1.8543594e-02 9.7202873e-01 4.8142445e-11 4.8142445e-11]
Word 16 score: [9.9914718e-01 1.8494377e-06 2.9789387e-08 9.1136707e-07 8.5011451e-04]
Word 17 score: [9.9899310e-01 2.4977312e-06 3.0054093e-08 1.2123662e-06 1.0032038e-03]
Word 18 score: [2.2506479e-14 5.6985962e-01 2.2266342e-03 4.2791370e-01 2.2984107e-18]
Word 22 score: [1.0000000e+00 1.3190694e-14 1.3190694e-14 1.3190694e-14 1.3190694e-14]
Word 23 score: [0.44752306 0.00050172 0.4837365  0.00081237 0.06742632]
Word 24 score: [9.9922562e-01 1.8110742e-06 4.9938691e-08 1.7088822e-06 7.7081472e-04]
Word 25 score: [4.6583635e-05 1.1035393e-05 4.5987760e-04 9.8975044e-01 9.7319754e-03]
Word 26 score: [0.00286462 0.04739505 0.00472463 0.00157264 0.94344306]
Word 27 score: [2.4836301e-05 1.0385698e-03 8.6954364e-04 6.3304578e-06 9.9806076e-01]
Word 32 score: [0.2 0.2 0.2 0.2 0.2]
Word 33 score: [0.2 0.2 0.2 0.2 0.2]
Word 34 score: [2.2279380e-03 9.2179753e-02 9.0541488e-01 2.5160434e-06 1.7485277e-04]
Word 35 score: [1.0000000e+00 1.0319915e-11 1.0319915e-11 1.0319915e-11 1.0319915e-11]
------
992
mmm , how about 1
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
993
i ' m sorry , a table for 10 is only open at 11 : 30 ##am that day . would that be acceptable ?
Predicted label: ['inform', 'confirm_question']
Real label: ['inform', 'confirm_question']
Predicted slot label: O O O O O O O O B-numberofpeople O O O O B-starttime I-starttime I-starttime I-starttime O O O O O O O O
Real slot label: O O O O O O O O B-numberofpeople O O O O B-starttime I-starttime I-starttime I-starttime O O O O O O O O
Score: 
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
------
994
yes , that ' s fine
Predicted label: ['confirm_answer']
Real label: ['confirm_answer']
Predicted slot label: O O O O O O
Real slot label: O O O O O O
Score: 
------
995
ok , that table is confirmed ! you have a table for 10 at em ##eri ##ls for 11 : 30 on 3 / 11 . thank you , candy !
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O O O O O B-date I-date I-date O O O O O O
Real slot label: O O O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O O O O O B-date I-date I-date O O O O O O
Score: 
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
------
996
i ' d like to reserve a table for 3 at bar ##olo ri ##stor ##ante in seattle for march 17th , i prefer 6 : 00 pm if available .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-city O B-date I-date O O O O O O O O O O
Real slot label: O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-city O B-date I-date O O O O O O O O O O
Score: 
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [4.8812809e-03 3.2777645e-09 3.0052703e-02 9.2009652e-01 4.4969518e-02]
Word 12 score: [1.1727046e-01 8.4398000e-09 1.8292805e-02 8.6110735e-01 3.3293730e-03]
Word 13 score: [9.9617732e-01 3.8226964e-03 2.9697808e-10 2.9697808e-10 2.9697808e-10]
Word 14 score: [9.9679333e-01 3.2066612e-03 2.5375060e-10 2.5375060e-10 2.5375060e-10]
Word 15 score: [9.9650961e-01 3.4903630e-03 2.7478972e-10 2.7478972e-10 2.7478972e-10]
Word 17 score: [6.7231663e-02 3.4645968e-04 2.6197618e-01 6.6963583e-01 8.0984569e-04]
Word 19 score: [6.734893e-06 7.615091e-01 8.227185e-02 8.502182e-02 7.119043e-02]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
------
997
what name would you like to book the reservation under ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
998
mike hunt
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname I-personfullname
Real slot label: B-personfullname I-personfullname
Score: 
Word 0 score: [2.0026948e-07 8.7464792e-01 4.1782226e-02 4.1787505e-02 4.1782226e-02]
Word 1 score: [2.0186758e-02 9.7323212e-11 8.2123181e-04 9.7899181e-01 2.0900724e-07]
------
999
i have successfully completed your reservation . enjoy !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-closing O
Real slot label: O O O O O O O B-closing O
Score: 
Word 7 score: [1.0831404e-01 4.1644857e-03 8.8112503e-01 7.9702777e-06 6.3885082e-03]
------
1000
i ' d like to book a burger joint ( highly rated ) for next february 14 . somewhere around 7 pm . thought i ' d give the miss ##us the evening off from cooking that day .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O B-restauranttype I-restauranttype O B-rating I-rating O O O O O O O B-starttime I-starttime I-starttime O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O B-restauranttype I-restauranttype O B-rating I-rating O O O O O O O B-starttime I-starttime I-starttime O O O O O O O O O O O O O O O O O
Score: 
Word 7 score: [3.0662792e-04 3.1653303e-06 4.4338372e-05 2.4733061e-05 9.9962115e-01]
Word 8 score: [3.8698129e-02 9.6056926e-01 3.2416764e-08 4.1790101e-13 7.3256443e-04]
Word 10 score: [1.4550552e-04 1.9429774e-06 6.3986593e-04 9.9921072e-01 1.9429774e-06]
Word 11 score: [9.2107058e-02 8.3713725e-02 1.2513823e-04 1.5902813e-04 8.2389498e-01]
Word 19 score: [9.9933690e-01 6.5874762e-04 1.6872824e-06 1.6872824e-06 9.4943402e-07]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [5.0702348e-04 7.9782403e-01 2.0166610e-01 1.9856546e-07 2.6550542e-06]
------
1001
could you specify a city that you would like to book in ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O
Score: 
------
1002
seattle
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city
Real slot label: B-city
Score: 
Word 0 score: [7.3905295e-01 9.0789828e-05 1.7599867e-01 8.4619455e-02 2.3810756e-04]
------
1003
i can help find you a good burger joint . can you tell me how many people the reservation will be for ?
Predicted label: ['request', 'inform']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1004
2
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
1005
i am sorry , it looks like it is not possible to reserve a table that far in advance . would you like to try a different date ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1006
ok , how about tomorrow night
Predicted label: ['inform', 'confirm_answer']
Real label: ['inform']
Predicted slot label: O O O O B-date I-date
Real slot label: O O O O B-date I-date
Score: 
Word 4 score: [4.3829781e-01 4.7237334e-01 3.8146861e-06 1.4752181e-05 8.9310266e-02]
Word 5 score: [3.964777e-11 5.000000e-01 6.297420e-11 5.000000e-01 4.576693e-13]
------
1007
here are 3 of the top rated burger places in seattle : smith , jimmy ' s on first , and paddy ' s co ##yne ' s irish pub . would you like to try one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O B-rating I-rating B-food O O B-city O B-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O B-rating I-rating B-food O O B-city O B-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 5 score: [2.8394009e-03 1.4556252e-03 9.1374721e-07 4.9785206e-01 4.9785206e-01]
Word 6 score: [2.4631952e-01 1.7594488e-02 6.2167109e-04 3.7482535e-04 7.3508954e-01]
Word 7 score: [3.6522755e-04 5.6777573e-08 2.3525562e-04 2.8841337e-04 9.9911112e-01]
Word 10 score: [1.09096415e-01 4.75750916e-04 4.80241440e-02 8.40824127e-01
 1.57964916e-03]
Word 12 score: [9.9794310e-01 4.3619960e-04 2.6417716e-04 1.4728611e-06 1.3550497e-03]
Word 14 score: [0.00318026 0.01660815 0.00912997 0.69668835 0.2743932 ]
Word 15 score: [0.71406054 0.00130235 0.12512489 0.00210432 0.15740794]
Word 16 score: [9.9877566e-01 1.3773075e-06 4.8134503e-08 4.3873424e-06 1.2186203e-03]
Word 17 score: [2.5226505e-04 1.0150601e-04 1.8747400e-03 9.8386121e-01 1.3910345e-02]
Word 18 score: [6.7946151e-02 1.0913027e-02 2.9947781e-03 6.0695637e-04 9.1753906e-01]
Word 21 score: [9.4551378e-01 5.5982335e-05 4.1311733e-02 1.0319505e-04 1.3015365e-02]
Word 22 score: [5.3840435e-01 3.0811183e-04 4.1330212e-01 1.5307734e-03 4.6454605e-02]
Word 23 score: [9.9879360e-01 1.2504461e-06 9.0079773e-08 4.3166456e-06 1.2006211e-03]
Word 24 score: [9.2561267e-02 9.0138268e-01 6.0501080e-03 3.9895003e-06 2.0034943e-06]
Word 25 score: [6.3003935e-02 9.3306905e-01 3.9228019e-03 2.7309818e-06 1.4157395e-06]
Word 26 score: [9.9879766e-01 1.0101577e-06 1.1344619e-07 4.6330874e-06 1.1966024e-03]
Word 27 score: [9.9876416e-01 1.2182815e-06 7.7798390e-08 4.3000055e-06 1.2302224e-03]
Word 28 score: [7.8743440e-01 4.0123425e-09 5.3494255e-04 2.4584818e-04 2.1178477e-01]
Word 29 score: [1.2670502e-04 8.3249146e-03 1.2197957e-03 5.9302518e-04 9.8973548e-01]
------
1008
yes , paddy ' s co ##yne ' s irish pub
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 2 score: [8.70556712e-01 2.31677895e-05 1.21869884e-01 1.61560325e-04
 7.38874823e-03]
Word 3 score: [6.6894811e-01 1.5197789e-04 2.6850986e-01 9.1350020e-04 6.1476555e-02]
Word 4 score: [9.9927133e-01 3.4866795e-07 8.6639730e-08 2.3636637e-06 7.2582660e-04]
Word 5 score: [5.9804428e-02 9.3678874e-01 3.4039272e-03 1.6211250e-06 1.2485506e-06]
Word 6 score: [4.9759205e-02 9.4766718e-01 2.5713884e-03 1.2758056e-06 9.8936891e-07]
Word 7 score: [9.9936622e-01 3.3323906e-07 8.6209617e-08 2.1837259e-06 6.3117442e-04]
Word 8 score: [9.9926382e-01 3.4871425e-07 9.4962765e-08 2.4505753e-06 7.3333830e-04]
Word 9 score: [3.2662320e-01 2.7133946e-09 1.3092654e-04 7.7561382e-04 6.7247033e-01]
Word 10 score: [2.1859385e-04 2.2525755e-03 4.7041074e-04 5.1890028e-04 9.9653947e-01]
------
1009
what name would you like to book under ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
1010
master user
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname I-personfullname
Real slot label: B-personfullname I-personfullname
Score: 
Word 0 score: [6.3009136e-03 2.2905006e-03 6.5955031e-01 3.3120069e-01 6.5759919e-04]
Word 1 score: [5.7806126e-03 3.2324934e-01 1.0134124e-11 2.3237997e-06 6.7096770e-01]
------
1011
your reservation at paddy ' s co ##yne ' s irish pub was confirmed for 03 / 09 / 2016 at 7 ##pm with two guests under the name master user . enjoy your meal !
Predicted label: ['inform', 'closing']
Real label: ['inform', 'closing']
Predicted slot label: O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-date I-date I-date I-date I-date O B-starttime I-starttime O O O O O O B-personfullname I-personfullname O B-closing I-closing I-closing I-closing
Real slot label: O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-date I-date I-date I-date I-date O B-starttime I-starttime O O O O O O B-personfullname I-personfullname O B-closing I-closing I-closing I-closing
Score: 
Word 3 score: [9.3678868e-01 1.6391835e-04 1.3176801e-02 7.4002282e-06 4.9863216e-02]
Word 4 score: [8.33608329e-01 4.59267649e-05 5.66579029e-02 1.19037286e-04
 1.09568790e-01]
Word 5 score: [9.9915016e-01 5.9392001e-08 2.1782768e-08 2.7189679e-07 8.4952539e-04]
Word 6 score: [1.9363315e-01 8.0536503e-01 1.0008920e-03 6.5029332e-07 2.2225356e-07]
Word 7 score: [1.8022729e-01 8.1879705e-01 9.7481563e-04 6.0205087e-07 2.1488290e-07]
Word 8 score: [9.9922121e-01 7.4275100e-08 1.9562043e-08 2.9732686e-07 7.7838014e-04]
Word 9 score: [9.9909377e-01 7.8035427e-08 2.0559037e-08 2.9261739e-07 9.0582971e-04]
Word 10 score: [4.23022121e-01 3.32487526e-09 1.09546876e-04 3.25221336e-04
 5.76543152e-01]
Word 11 score: [7.4726879e-05 6.9124578e-03 2.9184745e-04 2.9459767e-04 9.9242628e-01]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 29 score: [3.4816071e-02 8.4572406e-03 8.1574154e-01 1.4097862e-01 6.4941096e-06]
Word 30 score: [1.3308931e-03 5.5145058e-03 2.3059717e-11 2.2761862e-08 9.9315464e-01]
Word 32 score: [8.3693098e-03 1.1943725e-02 9.7931826e-01 2.5698051e-05 3.4304938e-04]
Word 33 score: [3.0150244e-05 9.9580067e-01 4.1692024e-03 1.2688166e-18 1.2688166e-18]
Word 34 score: [1.5954898e-05 3.9027859e-06 1.3085506e-04 7.5028032e-01 2.4956889e-01]
Word 35 score: [0.2 0.2 0.2 0.2 0.2]
------
1012
hello , can you assist me in booking a restaurant for 3 people on march 9th at 10 : 00 ##am . my budget is around $ 30 per person . can you show me a list of restaurants that serve br ##un ##ch please ?
Predicted label: ['request']
Real label: ['request', 'greeting']
Predicted slot label: O O O O O O O O O O O B-numberofpeople O O B-date I-date O O O O O O O O O O B-pricing I-pricing I-pricing I-pricing O O O O O O O O O O O B-mealtype I-mealtype I-mealtype O O
Real slot label: O O O O O O O O O O O B-numberofpeople O O B-date I-date O O O O O O O O O O B-pricing I-pricing I-pricing I-pricing O O O O O O O O O O O B-mealtype I-mealtype I-mealtype O O
Score: 
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [2.6258372e-06 3.1751022e-01 6.0920987e-02 1.3394369e-01 4.8762244e-01]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 26 score: [0.2 0.2 0.2 0.2 0.2]
Word 27 score: [0.2 0.2 0.2 0.2 0.2]
Word 28 score: [1.4316462e-08 4.6026031e-08 3.7550774e-06 4.1915834e-07 9.9999571e-01]
Word 29 score: [1.2281971e-04 4.2510387e-10 2.4691178e-06 6.2117679e-06 9.9986851e-01]
Word 41 score: [5.2417501e-05 1.0817241e-05 9.8633617e-03 3.6495032e-03 9.8642379e-01]
Word 42 score: [5.2060641e-04 1.4009080e-03 1.7600605e-03 9.9627256e-01 4.5821165e-05]
Word 43 score: [0.0106405  0.25905666 0.02372847 0.68357605 0.02299833]
------
1013
in what city should i search ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
1014
new york city , please .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city I-city O O O O
Real slot label: B-city I-city O O O O
Score: 
Word 0 score: [3.1876929e-02 9.6810395e-01 3.0416408e-07 3.3950187e-10 1.8809529e-05]
Word 1 score: [6.26243174e-01 1.09813955e-04 9.19771846e-03 3.64446521e-01
 2.78073253e-06]
------
1015
i found the following restaurants matching your criteria : 900 park restaurant , anton ##ette ' s east hills , ban ##c cafe .
Predicted label: ['multiple_choice']
Real label: ['multiple_choice']
Predicted slot label: O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.00099306 0.12330991 0.35263056 0.47683895 0.04622746]
Word 11 score: [1.0340577e-13 9.5805126e-01 7.3633395e-04 4.1212402e-02 2.1175309e-14]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [9.9796945e-01 6.0779666e-07 6.3174490e-08 2.4573735e-06 2.0273258e-03]
Word 16 score: [9.9784005e-01 1.2030542e-06 3.4377265e-08 2.4253973e-06 2.1562050e-03]
Word 17 score: [7.5591304e-03 4.8799087e-05 9.8554879e-01 2.1896225e-05 6.8213535e-03]
Word 18 score: [9.999721e-01 3.605501e-06 8.095530e-06 8.095530e-06 8.095530e-06]
Word 20 score: [2.2337809e-03 9.9630046e-01 7.4185125e-05 5.3285289e-04 8.5879624e-04]
Word 21 score: [9.4525886e-01 3.3699130e-03 1.2342538e-05 1.1040355e-02 4.0318444e-02]
Word 22 score: [2.8682208e-01 6.6717453e-03 6.4621342e-04 2.0769908e-10 7.0585990e-01]
------
1016
book ban ##c cafe please
Predicted label: ['request']
Real label: ['inform']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
1017
i ' m sorry , i was unable to book for that time slot . there are , however , openings at 11 am and 11 : 15 am . do either of these interest you ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O B-starttime I-starttime O B-starttime I-starttime I-starttime I-starttime O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O B-starttime I-starttime O B-starttime I-starttime I-starttime I-starttime O O O O O O O O
Score: 
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [5.3561574e-12 2.0289755e-07 2.7831393e-09 9.9999976e-01 7.3724610e-10]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
Word 26 score: [0.2 0.2 0.2 0.2 0.2]
Word 27 score: [0.2 0.2 0.2 0.2 0.2]
Word 28 score: [1.1608514e-09 2.8502350e-07 3.8636156e-09 9.9999976e-01 6.7989772e-12]
------
1018
yes , please book 11 : 15 ##am
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O B-starttime I-starttime I-starttime I-starttime
Real slot label: O O O O B-starttime I-starttime I-starttime I-starttime
Score: 
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
------
1019
i have successfully completed your reservation for ban ##c cafe at 11 : 15 ##am on 3 / 9 for 3 people . enjoy !
Predicted label: ['inform', 'closing']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O B-starttime I-starttime I-starttime I-starttime O B-date I-date I-date O B-numberofpeople O O B-closing O
Real slot label: O O O O O O O O O O O B-starttime I-starttime I-starttime I-starttime O B-date I-date I-date O B-numberofpeople O O B-closing O
Score: 
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [4.9098324e-02 2.4921337e-02 9.1189116e-01 5.7179190e-05 1.4032016e-02]
------
1020
any restaurants in gate ##d communities in wilmington , nc
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O B-city O B-state
Real slot label: O O O O O O O B-city O B-state
Score: 
Word 7 score: [1.1010876e-04 7.8616989e-07 1.7145121e-02 7.0855036e-02 9.1188890e-01]
Word 9 score: [1.0000000e+00 1.7847378e-11 1.7847378e-11 1.7847378e-11 1.7847378e-11]
------
1021
what date would you like me to look ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
1022
3 \ / 16 \ / 2016
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
1023
how many are going ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
1024
4
Predicted label: ['inform']
Real label: ['request']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
1025
is there a certain type of cuisine you are looking for ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O
Score: 
------
1026
french
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-cuisine
Real slot label: B-cuisine
Score: 
Word 0 score: [0.02193323 0.8665559  0.10071819 0.0023125  0.00848017]
------
1027
i ca n ' t find any that are located in gate ##d communities . perhaps there is another criteria we could try ?
Predicted label: ['inform', 'confirm_question']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1028
upper ##class , some ##pl ##ass te ##h riff ##raf ##f does n ' t go
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restauranttype I-restauranttype O O O O O O O O O O O O O O
Real slot label: B-restauranttype I-restauranttype O O O O O O O O O O O O O O
Score: 
Word 0 score: [0.10892423 0.21739696 0.21739696 0.23888491 0.21739696]
Word 1 score: [1.0000000e+00 1.4935693e-15 1.4935693e-15 1.1341724e-09 1.4935693e-15]
------
1029
i can recommend the cap ##rice bis ##tro - they have openings at 5 : 30 and 8 : 00 on 3 / 16 .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O B-starttime I-starttime I-starttime O O O O O B-date I-date I-date O
Real slot label: O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O B-starttime I-starttime I-starttime O O O O O B-date I-date I-date O
Score: 
Word 4 score: [6.4514831e-02 7.7659520e-04 9.3291163e-01 1.2232482e-03 5.7374162e-04]
Word 5 score: [0.31181723 0.00132423 0.6517685  0.02788465 0.00720542]
Word 6 score: [9.8594922e-01 1.3849574e-02 9.9118040e-07 1.9839942e-04 1.8998196e-06]
Word 7 score: [9.683707e-01 3.123683e-02 2.571226e-06 3.843203e-04 5.637345e-06]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
------
1030
0 . 229 ##16 ##66 ##6 ##7
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
1031
i have booked cap ##rice bis ##tro for 5 : 30 . thank you and enjoy your meal .
Predicted label: ['inform', 'thanks']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O B-closing I-closing I-closing I-closing I-closing I-closing O
Real slot label: O O O O O O O O O O O O B-closing I-closing I-closing I-closing I-closing I-closing O
Score: 
Word 12 score: [1.9060802e-03 9.8971604e-08 9.9805671e-01 1.4356547e-10 3.7108814e-05]
Word 13 score: [8.9806974e-01 2.8368293e-03 7.2389045e-03 1.5086494e-04 9.1703713e-02]
Word 14 score: [9.9399757e-01 1.4739819e-03 1.5605215e-03 5.7248057e-05 2.9106319e-03]
Word 15 score: [4.3157217e-04 1.0463045e-01 8.9401376e-01 9.0169470e-04 2.2557260e-05]
Word 16 score: [7.3807360e-06 9.9878186e-01 1.2107830e-03 4.4624816e-14 4.4624816e-14]
Word 17 score: [3.0342122e-05 2.3215884e-05 8.2536548e-04 7.2217649e-01 2.7694455e-01]
------
1032
i would like to book mexican in seattle for two on 03 / 25 at 1 ##pm
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-state O B-city O O O B-date I-date I-date O B-starttime I-starttime
Real slot label: O O O O O B-state O B-city O O O B-date I-date I-date O B-starttime I-starttime
Score: 
Word 5 score: [3.7818601e-05 2.8822619e-01 9.5735695e-03 3.0977873e-05 7.0213145e-01]
Word 7 score: [1.0920010e-01 1.2525998e-04 2.2309561e-01 6.6616118e-01 1.4178642e-03]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
------
1033
here are three restaurants that i found . do any of these interest you : 1 ) barrio mexican kitchen & bar , 2 ) fog ##on co ##cina mexican ##a , or 3 ) ag ##ave co ##cina & tequila ##s ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 17 score: [1.9577159e-02 1.3936844e-04 1.8798679e-02 7.0614510e-06 9.6147764e-01]
Word 18 score: [2.9920734e-04 4.6387117e-02 2.8302043e-03 4.7728423e-02 9.0275508e-01]
Word 19 score: [3.8564729e-09 9.9990785e-01 9.2024675e-05 1.7951512e-09 6.8352534e-08]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [2.3380436e-01 6.6182954e-05 4.2123407e-05 3.7679574e-01 3.8929152e-01]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
Word 26 score: [0.2 0.2 0.2 0.2 0.2]
Word 27 score: [0.2 0.2 0.2 0.2 0.2]
Word 28 score: [0.2 0.2 0.2 0.2 0.2]
Word 29 score: [1.9329138e-01 1.0173584e-05 7.9487509e-01 9.7697293e-03 2.0536061e-03]
Word 30 score: [1.4916934e-01 8.8414718e-06 8.4122294e-01 7.6448917e-03 1.9540552e-03]
Word 35 score: [8.6981347e-03 6.6992808e-03 1.8477006e-03 9.8274547e-01 9.4306433e-06]
Word 36 score: [1.1981282e-03 9.9605078e-01 4.8305938e-05 2.7028469e-03 2.2221265e-11]
Word 37 score: [0.2 0.2 0.2 0.2 0.2]
Word 38 score: [0.2 0.2 0.2 0.2 0.2]
Word 39 score: [0.2 0.2 0.2 0.2 0.2]
Word 40 score: [9.9999273e-01 1.8432485e-06 1.8432485e-06 1.8432485e-06 1.8432485e-06]
Word 41 score: [9.9999106e-01 2.2079491e-06 2.2079491e-06 2.2079491e-06 2.2079491e-06]
------
1034
2
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O
Real slot label: O
Score: 
------
1035
i ' m sorry , no tables are open with 2 . 5 hours of your request . would you like to try another restaurant or time ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1036
yes try barrio mexican kitchen
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O B-restaurantname I-restaurantname I-restaurantname
Real slot label: O O B-restaurantname I-restaurantname I-restaurantname
Score: 
Word 2 score: [8.2184412e-03 3.0675212e-05 4.9161687e-03 3.5835380e-06 9.8683119e-01]
Word 3 score: [2.3488658e-04 1.0373219e-02 3.7955877e-03 9.4931740e-01 3.6278814e-02]
Word 4 score: [2.2512937e-10 9.9998093e-01 1.9002986e-05 1.3188683e-10 2.3354961e-08]
------
1037
success ! i was able to book you a table for 2 at barrio mexican kitchen on 3 / 25 at 1 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O
Real slot label: O O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O
Score: 
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [8.1595562e-02 7.5256135e-06 3.9114133e-03 6.0035222e-07 9.1448474e-01]
Word 14 score: [1.47931583e-04 7.90401995e-02 1.19181825e-02 1.10681333e-01
 7.98212290e-01]
Word 15 score: [2.0015961e-11 9.9983394e-01 1.6607807e-04 1.0391982e-09 7.7453227e-10]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
------
1038
what nearby restaurants are open at 2a ##m ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
1039
un ##for ##nu ##nate ##ly i can not find any restaurants i can book matching your request .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O
Score: 
------
1040
that ' s strange . . . where have you searched ? i ' m in seattle
Predicted label: ['request']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O O B-city
Real slot label: O O O O O O O O O O O O O O O O B-city
Score: 
Word 16 score: [2.4182793e-02 1.4679178e-04 4.5298304e-02 9.2915648e-01 1.2156849e-03]
------
1041
how many people are going ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O
Real slot label: O O O O O O
Score: 
------
1042
2
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
1043
what type of cuisine are you interested in ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
1044
seafood
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-cuisine
Real slot label: B-cuisine
Score: 
Word 0 score: [5.7872571e-04 9.9891806e-01 4.2398338e-04 4.2033294e-05 3.7242848e-05]
------
1045
here are the restaurants i found matching your request . please select one : 1 ) elliott ' s oyster house - rating : 4 out of 5 . 2 ) et ##ta ' s seafood - rating : 3 . 5 out of 5 . 3 ) the brooklyn seafood , steak i _ i _ _
Predicted label: ['inform', 'multiple_choice']
Real label: ['multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1046
do et ##ta ' s seafood
Predicted label: []
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [5.1297545e-01 1.9441018e-02 3.2723591e-02 4.3482924e-01 3.0679545e-05]
Word 1 score: [9.9931180e-01 6.8824063e-04 5.7883882e-11 5.7883882e-11 5.7883882e-11]
Word 2 score: [9.4787014e-01 5.2129924e-02 2.1433085e-13 2.1433085e-13 2.1433085e-13]
Word 3 score: [9.9904615e-01 4.8504298e-06 4.1931256e-07 2.7582780e-06 9.4569422e-04]
Word 4 score: [9.9900025e-01 5.2586174e-06 4.1912460e-07 2.8637817e-06 9.9119800e-04]
Word 5 score: [2.7639457e-04 9.3890035e-01 5.6845799e-02 2.4501811e-05 3.9529158e-03]
------
1047
your reservation at et ##ta ' s seafood for 02 : 00 ##am for 2 people under john smith has been confirmed .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O B-numberofpeople O O B-personfullname I-personfullname O O O O
Real slot label: O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O B-numberofpeople O O B-personfullname I-personfullname O O O O
Score: 
Word 3 score: [9.9956137e-01 4.3856929e-04 3.3838830e-09 3.3838830e-09 3.3838830e-09]
Word 4 score: [9.5273554e-01 4.7264487e-02 4.3984906e-13 4.3984906e-13 4.3984906e-13]
Word 5 score: [9.9960226e-01 2.7635571e-07 1.0754110e-08 7.5359929e-07 3.9665247e-04]
Word 6 score: [9.9959415e-01 3.4047537e-07 8.5876186e-09 7.2032736e-07 4.0481435e-04]
Word 7 score: [3.9023253e-05 9.3602109e-01 6.3565351e-02 1.3714423e-05 3.6076293e-04]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [2.0936556e-02 1.5190737e-03 2.2615518e-08 9.7184712e-01 5.6972899e-03]
Word 18 score: [1.0756798e-03 6.9798689e-06 1.2404493e-03 1.0669163e-06 9.9767584e-01]
------
1048
hi - i ' m looking for a steak ##house in tampa .
Predicted label: ['request', 'greeting']
Real label: ['request']
Predicted slot label: O O O O O O O O B-restauranttype I-restauranttype O B-city O
Real slot label: O O O O O O O O B-restauranttype I-restauranttype O B-city O
Score: 
Word 8 score: [3.2113482e-15 1.2962816e-20 1.0150223e-17 6.6548798e-17 1.0000000e+00]
Word 9 score: [6.5289305e-07 1.6984785e-19 1.4412459e-16 1.6224783e-15 9.9999940e-01]
Word 11 score: [1.5344849e-04 2.1084052e-05 1.1010242e-02 9.7548229e-01 1.3333045e-02]
------
1049
i ' d love to help you with that ! what date , please ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O
Score: 
------
1050
march 17th - it ' s my anniversary .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date I-date O O O O O O O
Real slot label: B-date I-date O O O O O O O
Score: 
Word 0 score: [6.2517820e-06 1.6965412e-02 4.3342989e-03 3.9825761e-01 5.8043653e-01]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
------
1051
cong ##rat ##s ! i assume there will be just 2 dining ?
Predicted label: ['inform', 'greeting', 'thanks']
Real label: ['confirm_question']
Predicted slot label: O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O
Score: 
------
1052
yes , anything open around 7 pm
Predicted label: ['request']
Real label: ['inform']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
1053
great . i ' ve found a few options for you : dempsey ' s steak ##house has a table available at 6 : 30 ##pm , the capital grille has one at 7 ##pm , and charley ' s steak house has a table at 7 ##pm as well . can i book one of these for you
Predicted label: ['inform']
Real label: ['multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O B-starttime I-starttime I-starttime I-starttime O O B-restaurantname I-restaurantname O O O B-starttime I-starttime O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O B-starttime I-starttime O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O B-starttime I-starttime I-starttime I-starttime O O B-restaurantname I-restaurantname O O O B-starttime I-starttime O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O B-starttime I-starttime O O O O O O O O O O O
Score: 
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
Word 28 score: [1.7410714e-07 1.1034399e-11 6.3652673e-16 9.9999988e-01 2.5052843e-10]
Word 29 score: [1.6925270e-14 9.2080301e-14 9.9999988e-01 5.0897215e-09 1.7007137e-07]
Word 33 score: [0.2 0.2 0.2 0.2 0.2]
Word 34 score: [0.2 0.2 0.2 0.2 0.2]
Word 37 score: [0.05922098 0.4961095  0.41491124 0.00792577 0.02183248]
Word 38 score: [9.5967251e-01 1.0333856e-03 2.0473627e-03 1.1131970e-04 3.7135389e-02]
Word 39 score: [9.9965024e-01 5.3821518e-06 1.4123995e-08 2.8959519e-07 3.4407264e-04]
Word 40 score: [3.0620271e-02 1.0622646e-10 5.3290922e-17 3.5448735e-13 9.6937972e-01]
Word 41 score: [0.00394658 0.87035674 0.0027566  0.0586006  0.06433942]
Word 46 score: [0.2 0.2 0.2 0.2 0.2]
Word 47 score: [0.2 0.2 0.2 0.2 0.2]
------
1054
yes , let ' s go with charley ' s .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 7 score: [0.1522213  0.23474368 0.57810557 0.0140456  0.02088378]
Word 8 score: [9.1928649e-01 1.3984249e-04 4.4972282e-02 1.6457621e-04 3.5436764e-02]
Word 9 score: [9.9948835e-01 5.3997940e-07 7.1015897e-08 8.6047538e-07 5.1005487e-04]
------
1055
great , i have booked a table for 2 at charley ' s steak house at 7 pm on 3 / 17 . enjoy your dinner .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-starttime I-starttime O B-date I-date I-date O B-closing I-closing I-closing O
Real slot label: O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-starttime I-starttime O B-date I-date I-date O B-closing I-closing I-closing O
Score: 
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.19166227 0.09385789 0.6366354  0.03382324 0.0440212 ]
Word 11 score: [9.0147114e-01 1.0382420e-04 2.9433403e-02 2.1911607e-04 6.8772562e-02]
Word 12 score: [9.9953842e-01 1.5119883e-07 1.7522810e-08 4.2490339e-07 4.6100732e-04]
Word 13 score: [9.8540567e-02 2.1212988e-10 1.4503426e-15 2.1095322e-11 9.0145940e-01]
Word 14 score: [0.00138687 0.84915346 0.00236758 0.1125297  0.03456235]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [1.3844238e-04 9.9621069e-01 3.6503400e-03 3.0031856e-07 2.2371310e-07]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [3.4848422e-02 8.1354966e-03 9.5612067e-01 2.0948970e-05 8.7446725e-04]
Word 24 score: [4.4519122e-05 9.9710566e-01 2.8498191e-03 2.7074723e-20 2.7074723e-20]
Word 25 score: [9.1985989e-01 8.0039278e-02 5.1805732e-06 9.4134499e-05 1.5526564e-06]
------
1056
i would like to book a table for two at pacific steak ##s & seafood for 7 ##pm in san diego
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-starttime I-starttime O B-city I-city
Real slot label: O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-starttime I-starttime O B-city I-city
Score: 
Word 10 score: [9.9791282e-01 1.4780437e-04 3.3873890e-04 7.4411732e-06 1.5931833e-03]
Word 11 score: [9.9994183e-01 2.4265132e-06 5.5743105e-05 5.2864501e-11 1.4173203e-10]
Word 12 score: [9.9817407e-01 8.9255118e-06 1.8170074e-03 8.8984503e-10 3.6488756e-09]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [1.2633073e-04 9.2983061e-01 6.8014003e-02 2.2678967e-05 2.0063960e-03]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [5.02388161e-07 1.13054134e-01 8.86944354e-01 5.00943770e-07
 4.71300524e-07]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
------
1057
great , what day are you interested in going ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
1058
3 \ / 15 please
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
1059
great ! your reservation for 7 : 00pm at pacific steak ##s & seafood is confirmed !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O
Score: 
------
1060
book me a table for 1 at bar ##olo in seattle for tomorrow at 7 : 00 pm .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-restaurantname I-restaurantname O B-city O B-date O B-starttime I-starttime I-starttime I-starttime O
Real slot label: O O O O O B-numberofpeople O B-restaurantname I-restaurantname O B-city O B-date O B-starttime I-starttime I-starttime I-starttime O
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [7.2864187e-03 4.8100013e-09 5.0797425e-02 9.0243304e-01 3.9483055e-02]
Word 8 score: [3.3776620e-01 3.0953700e-08 9.4385026e-03 6.5117562e-01 1.6196695e-03]
Word 10 score: [5.4712787e-02 1.5978169e-04 1.1671960e-01 8.2723397e-01 1.1739107e-03]
Word 12 score: [7.6300389e-01 7.1944222e-02 4.5959203e-07 4.3901591e-06 1.6504703e-01]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [4.9883319e-04 9.9441397e-01 5.0803986e-03 3.0280540e-07 6.3558632e-06]
------
1061
i have successfully made your reservation . enjoy !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-closing O
Real slot label: O O O O O O O B-closing O
Score: 
Word 7 score: [1.2642005e-01 5.0329003e-03 8.6066782e-01 1.5056283e-05 7.8641465e-03]
------
1062
i would like to book a thai restaurant in seattle on 03 / 19 / 16 at 2 : 30 ##pm for 2 people
Predicted label: ['request']
Real label: ['inform']
Predicted slot label: O O O O O O B-restauranttype I-restauranttype O O O B-date I-date I-date I-date I-date O B-starttime I-starttime I-starttime I-starttime O B-numberofpeople O
Real slot label: O O O O O O B-restauranttype I-restauranttype O O O B-date I-date I-date I-date I-date O B-starttime I-starttime I-starttime I-starttime O B-numberofpeople O
Score: 
Word 6 score: [5.8775838e-09 5.7733607e-10 5.8775838e-09 1.5611510e-03 9.9843889e-01]
Word 7 score: [5.8359332e-05 4.1433913e-01 5.3142154e-01 5.4180957e-02 2.6833393e-17]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
------
1063
here are 3 of the top rated thai restaurants in seattle : buddha ru ##ks ##a , a ##yu ##tt ##haya thai restaurant , and thai tom . would you like to book one of those or would you prefer more options ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['multiple_choice']
Predicted slot label: O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname O O O O O O O O O O O O O O O O
Score: 
Word 12 score: [4.9449661e-04 4.7083905e-01 3.7046787e-04 5.0179427e-03 5.2327800e-01]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [5.7008076e-08 9.9999988e-01 5.5591546e-08 2.8126123e-17 2.8126123e-17]
Word 18 score: [2.2392496e-07 9.9952865e-01 4.7118778e-04 8.7502442e-20 8.7502442e-20]
Word 19 score: [9.8557871e-07 9.8919570e-01 1.0803304e-02 7.8439217e-12 7.8439217e-12]
Word 20 score: [9.6516169e-07 9.8906541e-01 1.0933670e-02 3.7273704e-12 3.7273704e-12]
Word 21 score: [0.2925682  0.1036261  0.2925682  0.03057788 0.2806596 ]
Word 22 score: [6.0085759e-14 8.3639169e-01 2.1004246e-03 1.6150795e-01 1.0489131e-17]
Word 25 score: [3.8313641e-07 4.3337415e-08 3.8313641e-07 5.8936393e-03 9.9410558e-01]
Word 26 score: [3.4142597e-13 5.9261680e-08 6.5020026e-06 9.9999344e-01 3.6607349e-11]
------
1064
thai tom
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname
Score: 
Word 0 score: [2.4414355e-01 4.5650620e-02 2.4414355e-01 8.1498101e-06 4.6605414e-01]
Word 1 score: [9.2574528e-06 7.0908630e-01 1.5660819e-03 2.8898731e-01 3.5102462e-04]
------
1065
i apologize for the inc ##on ##ven ##ience , that restaurant is n ' t listed for online booking . would you like to try a different one ?
Predicted label: ['request', 'inform']
Real label: ['multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1066
buddha ru ##ks ##a
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [2.7712146e-10 9.9999988e-01 4.7887731e-12 1.2803754e-07 4.2785285e-08]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
------
1067
i ' m sorry , unfortunately our system is unable to book that restaurant . would you like to try a different one ?
Predicted label: ['request', 'inform']
Real label: ['multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1068
try a ##yu ##tt ##haya thai
Predicted label: ['request', 'inform']
Real label: ['inform']
Predicted slot label: O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 1 score: [3.3864939e-07 9.9999964e-01 1.3710670e-08 8.8220105e-22 8.8220105e-22]
Word 2 score: [1.0417488e-04 9.9677581e-01 3.1199635e-03 5.4581955e-23 5.4581955e-23]
Word 3 score: [9.5209898e-06 9.9888867e-01 1.1017979e-03 2.7801376e-16 2.7801376e-16]
Word 4 score: [1.1968483e-05 9.9901533e-01 9.7264949e-04 1.6570102e-16 1.6570102e-16]
Word 5 score: [0.00313443 0.00097271 0.00313443 0.02232933 0.97042906]
------
1069
unfortunately , there are no tables open at that time . here are the closest matches i found : 12 ##pm , 4 ##pm , 4 : 15 ##pm .
Predicted label: ['inform', 'multiple_choice']
Real label: ['multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O O O B-starttime I-starttime O B-starttime I-starttime O B-starttime I-starttime I-starttime I-starttime O
Real slot label: O O O O O O O O O O O O O O O O O O O B-starttime I-starttime O B-starttime I-starttime O B-starttime I-starttime I-starttime I-starttime O
Score: 
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
Word 26 score: [0.2 0.2 0.2 0.2 0.2]
Word 27 score: [0.2 0.2 0.2 0.2 0.2]
Word 28 score: [0.2 0.2 0.2 0.2 0.2]
------
1070
4 ##pm please
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-starttime I-starttime O
Real slot label: B-starttime I-starttime O
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
------
1071
success ! i was able to book you a table for 2 at a ##yu ##tt ##haya thai on 3 / 19 at 4 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O
Real slot label: O O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O
Score: 
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [5.6201781e-09 1.0000000e+00 1.1662228e-08 8.8054811e-20 8.8054811e-20]
Word 14 score: [2.9490058e-08 9.9967754e-01 3.2244448e-04 4.4510004e-20 4.4510004e-20]
Word 15 score: [2.3654087e-07 9.9411905e-01 5.8807833e-03 7.5308997e-13 7.5308997e-13]
Word 16 score: [2.7710553e-07 9.9268556e-01 7.3141824e-03 4.3101181e-13 4.3101181e-13]
Word 17 score: [0.11669517 0.03064022 0.11669517 0.0453811  0.6905884 ]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
------
1072
find me a restaurant in the aurora area that serves su ##shi and has live music .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O B-state O O O B-cuisine I-cuisine O O O O O
Real slot label: O O O O O O B-state O O O B-cuisine I-cuisine O O O O O
Score: 
Word 6 score: [3.7859247e-06 9.9996960e-01 1.3296953e-05 1.3296953e-05 1.7783659e-08]
Word 10 score: [5.7033100e-10 9.9998772e-01 2.2620912e-10 2.1933086e-07 1.1986485e-05]
Word 11 score: [2.1866756e-04 6.8127802e-03 1.0167046e-04 4.7348323e-04 9.9239349e-01]
------
1073
un ##for ##nu ##nate ##ly i can not find any restaurants i can book matching your request .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O
Score: 
------
1074
let ' s can you find me a su ##shi place in aurora ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O B-cuisine I-cuisine O O B-city O
Real slot label: O O O O O O O O B-cuisine I-cuisine O O B-city O
Score: 
Word 8 score: [4.3575525e-07 9.9952126e-01 1.0023891e-07 4.9071491e-06 4.7330101e-04]
Word 9 score: [3.7384212e-02 1.6396168e-04 7.9561276e-03 3.5486305e-03 9.5094705e-01]
Word 12 score: [7.2057934e-05 9.9853814e-01 6.9009658e-04 6.9009658e-04 9.6557178e-06]
------
1075
un ##for ##nu ##nate ##ly i can not find any restaurants i can book matching your request .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O
Score: 
------
1076
i know at least one - dom ##o 77 . can you book it ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O
Score: 
------
1077
at what time would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
1078
tomorrow at 7 ##pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date O B-starttime I-starttime
Real slot label: B-date O B-starttime I-starttime
Score: 
Word 0 score: [5.7744462e-04 9.9942160e-01 2.4827967e-10 1.1222794e-07 8.4799734e-07]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
------
1079
how many people are going ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O
Real slot label: O O O O O O
Score: 
------
1080
2
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
1081
your reservation at dom ##o 77 for 02 / 16 / 2016 07 : 00pm for 2 people under john smith has been confirmed .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O B-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date I-date I-date O O O O B-numberofpeople O O B-personfullname I-personfullname O O O O
Real slot label: O O O B-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date I-date I-date O O O O B-numberofpeople O O B-personfullname I-personfullname O O O O
Score: 
Word 3 score: [1.4405925e-08 2.8783630e-08 1.3745624e-01 8.6254376e-01 2.6086346e-09]
Word 4 score: [5.0881008e-05 3.5300895e-05 1.0242899e-01 8.9748389e-01 9.0558524e-07]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [7.5015281e-03 2.4688016e-03 5.7350729e-09 9.8851007e-01 1.5195260e-03]
Word 20 score: [1.0295243e-03 3.4604495e-06 1.3973424e-03 6.6109874e-07 9.9756902e-01]
------
1082
hi , i ' m looking for a trend ##y french restaurant in seattle for tonight around 7 pm for a party of 2
Predicted label: ['request', 'greeting']
Real label: ['request', 'greeting']
Predicted slot label: B-greeting O O O O O O O O O B-cuisine O O B-city O B-date O O O O O B-occasion O B-numberofpeople
Real slot label: B-greeting O O O O O O O O O B-cuisine O O B-city O B-date O O O O O B-occasion O B-numberofpeople
Score: 
Word 0 score: [1.6086136e-05 2.9874039e-01 1.3964651e-02 2.9874039e-01 3.8853851e-01]
Word 10 score: [9.9790704e-01 6.2057836e-05 3.1108000e-06 6.8927184e-06 2.0209369e-03]
Word 13 score: [1.0384558e-01 8.6062681e-04 2.9918781e-01 5.9564984e-01 4.5619055e-04]
Word 15 score: [0.00468507 0.32753477 0.14653459 0.00691545 0.5143301 ]
Word 21 score: [9.9959058e-01 2.2585705e-04 1.7800806e-04 7.2932285e-12 5.5485389e-06]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
------
1083
i have 2 restaurants that are contemporary french that might interest you . the first is bat ##eau , which has a table open at 7 : 30 tonight , and the other is lou ##lay , which is available at 7 : 00 .
Predicted label: ['inform']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1084
lets book bat ##eau
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O B-restaurantname I-restaurantname
Real slot label: O O B-restaurantname I-restaurantname
Score: 
Word 2 score: [1.0000000e+00 2.6678788e-14 2.6678788e-14 2.6678788e-14 2.6678788e-14]
Word 3 score: [1.0000000e+00 6.8009885e-16 6.8009885e-16 6.8009885e-16 6.8009885e-16]
------
1085
what name would you like to reserve under ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
1086
master user
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname I-personfullname
Real slot label: B-personfullname I-personfullname
Score: 
Word 0 score: [0.02381767 0.00125938 0.5036932  0.46912044 0.00210929]
Word 1 score: [1.1763495e-02 4.3544617e-01 1.4192444e-12 3.3327181e-06 5.5278707e-01]
------
1087
ok , master ! your table is reserved for tonight at 7 for 2 people at bat ##eau !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O B-date O B-starttime O B-numberofpeople O O B-restaurantname I-restaurantname O
Real slot label: O O O O O O O O O B-date O B-starttime O B-numberofpeople O O B-restaurantname I-restaurantname O
Score: 
Word 9 score: [3.5879275e-04 9.3880743e-02 4.7170833e-02 1.2225599e-04 8.5846734e-01]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [1.000000e+00 4.370081e-14 4.370081e-14 4.370081e-14 4.370081e-14]
Word 17 score: [1.0000000e+00 1.2171757e-15 1.2171757e-15 1.2171757e-15 1.2171757e-15]
------
1088
i am in search of a restaurant that opens early in the morning .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O B-starttime I-starttime I-starttime I-starttime O
Real slot label: O O O O O O O O O B-starttime I-starttime I-starttime I-starttime O
Score: 
Word 9 score: [5.4715534e-09 4.8726108e-02 9.5109719e-01 3.5575601e-11 1.7664651e-04]
Word 10 score: [1.3729055e-01 7.4348927e-01 4.3014503e-09 8.8952138e-04 1.1833064e-01]
Word 11 score: [7.8005984e-02 4.6778664e-02 8.7515700e-01 1.7408564e-05 4.0875519e-05]
Word 12 score: [3.7446767e-03 9.8499566e-01 2.6984188e-07 1.1192918e-02 6.6509587e-05]
------
1089
hello , lets see if we can find what you ' re looking for today . what city are you looking to book in ?
Predicted label: ['request', 'greeting']
Real label: ['request', 'greeting']
Predicted slot label: B-greeting O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: B-greeting O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
Word 0 score: [7.3425256e-04 9.9861741e-01 6.4688100e-04 7.6889188e-07 7.6889188e-07]
------
1090
new york .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city I-city O
Real slot label: B-city I-city O
Score: 
Word 0 score: [2.0914720e-02 9.7906578e-01 2.4905992e-07 2.0004291e-10 1.9220677e-05]
Word 1 score: [7.5219882e-01 1.6578076e-04 3.6731031e-02 2.1089007e-01 1.4217401e-05]
------
1091
i can help with that . how early are you looking for ? is 5 am early enough ?
Predicted label: ['request']
Real label: ['request', 'confirm_question']
Predicted slot label: O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O
Score: 
------
1092
that ' s good .
Predicted label: ['confirm_answer']
Real label: ['confirm_answer']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
1093
do you have a type of cuisine in mind ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
1094
chinese .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-cuisine O
Real slot label: B-cuisine O
Score: 
Word 0 score: [3.9689085e-01 1.4353078e-04 5.9448731e-01 7.1255993e-03 1.3527273e-03]
------
1095
great , what date would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
1096
i need to book a table for 3 / 21 at 7 pm for dinner at the blue point coastal cuisine in san diego for two guests .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O B-date I-date I-date O O O O B-mealtype O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-city I-city O O O O
Real slot label: O O O O O O O B-date I-date I-date O O O O B-mealtype O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-city I-city O O O O
Score: 
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [9.9989593e-01 1.9787527e-05 4.2680359e-11 8.4229221e-05 2.3390681e-09]
Word 17 score: [9.9950707e-01 2.9346883e-09 2.2273915e-05 4.7058574e-04 4.7699540e-08]
Word 18 score: [1.3231540e-03 4.8644108e-07 1.6357759e-03 9.9672097e-01 3.1959554e-04]
Word 19 score: [6.4191180e-03 3.2320222e-07 2.1915944e-06 9.9357831e-01 2.1554767e-11]
Word 20 score: [2.6640801e-09 9.9993443e-01 2.2800943e-10 6.5584798e-05 2.1839444e-12]
Word 22 score: [4.6071099e-07 2.0875777e-01 7.9124105e-01 3.3612699e-07 3.6543594e-07]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
------
1097
great ! your reservation on 3 / 21 at blue point coastal cuisine is confirmed !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O B-date I-date I-date O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O
Real slot label: O O O O O B-date I-date I-date O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [9.9716175e-01 1.5778078e-09 5.0527618e-05 2.7876897e-03 6.3738923e-08]
Word 10 score: [5.5884826e-04 1.1468902e-06 6.5370003e-04 9.9832577e-01 4.6052798e-04]
Word 11 score: [7.5982036e-03 5.1770485e-07 4.2472593e-06 9.9239701e-01 3.4071860e-11]
Word 12 score: [1.0663378e-08 9.9984598e-01 2.4086999e-09 1.5400964e-04 2.2779387e-12]
------
1098
would like to book a five star restaurant for birthday dinner in seattle on 04 / 18 / 16 at 8 : 30 ##pm for 10 people
Predicted label: ['request']
Real label: ['inform']
Predicted slot label: O O O O O B-restauranttype I-restauranttype O O B-mealtype I-mealtype O B-city O B-date I-date I-date I-date I-date O B-starttime I-starttime I-starttime I-starttime O B-numberofpeople O
Real slot label: O O O O O B-restauranttype I-restauranttype O O B-mealtype I-mealtype O B-city O B-date I-date I-date I-date I-date O B-starttime I-starttime I-starttime I-starttime O B-numberofpeople O
Score: 
Word 5 score: [5.0494220e-04 6.0916565e-09 9.9949455e-01 9.4640377e-08 4.0684779e-07]
Word 6 score: [1.5394453e-05 1.3870398e-02 3.5963234e-01 7.1162598e-05 6.2641072e-01]
Word 9 score: [2.5657308e-04 9.9793833e-01 2.7157782e-04 1.9964226e-07 1.5331942e-03]
Word 10 score: [9.9974138e-01 5.5045216e-06 6.8713457e-10 2.5308930e-04 4.4623288e-08]
Word 12 score: [9.0750374e-02 9.3198702e-05 6.5194212e-02 8.3756423e-01 6.3980538e-03]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
------
1099
hello . do you have a cuisine in mind ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
1100
yes american
Predicted label: ['request']
Real label: ['inform']
Predicted slot label: O B-cuisine
Real slot label: O B-cuisine
Score: 
Word 1 score: [2.5027134e-03 1.6403991e-11 2.7731136e-05 9.8328745e-01 1.4182082e-02]
------
1101
here are 3 of the best rated american restaurants in seattle : metropolitan grill , sky ##city restaurant , and purple cafe and wine bar . would you like to book one of those or would you prefer more options ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O B-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O B-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O
Score: 
Word 12 score: [7.7556826e-02 4.6029952e-01 2.1285737e-04 1.6312785e-03 4.6029952e-01]
Word 13 score: [3.4687667e-16 2.7792121e-19 3.0638014e-03 1.0865741e-14 9.9693620e-01]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [3.3620950e-14 8.6353600e-01 1.8709484e-03 1.3459302e-01 1.5178316e-16]
Word 20 score: [9.9257988e-01 5.6191795e-03 1.8035580e-09 1.6684468e-03 1.3250137e-04]
Word 21 score: [7.0475698e-01 8.2245149e-04 5.9491920e-04 1.3124504e-10 2.9382563e-01]
Word 22 score: [0.45107183 0.04428156 0.0498636  0.09181646 0.36296663]
Word 23 score: [2.5527030e-01 7.4429762e-01 8.4920375e-06 2.3424875e-05 4.0018541e-04]
Word 24 score: [9.9584889e-03 7.0362279e-07 6.2538461e-06 5.0280625e-03 9.8500663e-01]
------
1102
purple cafe
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O
Real slot label: O O
Score: 
------
1103
success ! i was able to book you a table for 10 on 4 / 18 at 8 : 30 pm at the purple cafe and wine bar .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O B-numberofpeople O B-date I-date I-date O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O O O O O O O O B-numberofpeople O B-date I-date I-date O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [8.4335226e-01 1.5656160e-01 2.9536518e-10 1.8416875e-05 6.7734494e-05]
Word 24 score: [6.6315514e-01 2.3057510e-04 9.0717440e-05 5.2589400e-13 3.3652350e-01]
Word 25 score: [0.49886656 0.02676465 0.04325926 0.03835388 0.39275563]
Word 26 score: [4.9910566e-01 5.0087374e-01 6.3013903e-07 9.3260542e-06 1.0645214e-05]
Word 27 score: [3.0637165e-03 3.7673914e-08 1.7357448e-06 1.9842132e-03 9.9495018e-01]
------
1104
i ' d like to reserve a table for 4 at bar ##olo ri ##stor ##ante in seattle for march 15th , i prefer 8 : 00 pm if available .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-city O B-date I-date O O O O O O O O O O
Real slot label: O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-city O B-date I-date O O O O O O O O O O
Score: 
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [4.1498546e-03 2.0977705e-08 2.2516940e-02 9.3860906e-01 3.4724113e-02]
Word 12 score: [3.8694453e-01 1.6137551e-07 1.1337314e-02 6.0018533e-01 1.5327093e-03]
Word 13 score: [9.9430758e-01 5.6895576e-03 9.3033412e-07 9.3033412e-07 9.3033412e-07]
Word 14 score: [9.9436873e-01 5.6305411e-03 2.2618322e-07 2.2618322e-07 2.2618322e-07]
Word 15 score: [9.9484223e-01 5.1553338e-03 7.8614545e-07 7.8614545e-07 7.8614545e-07]
Word 17 score: [6.6894233e-02 5.7767873e-04 1.7118244e-01 7.6069224e-01 6.5344188e-04]
Word 19 score: [1.4531344e-05 8.2819271e-01 6.4841352e-02 4.0160060e-02 6.6791393e-02]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
------
1105
alright , may i have a name to put the reservation under ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O
Score: 
------
1106
mike hunt
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname I-personfullname
Real slot label: B-personfullname I-personfullname
Score: 
Word 0 score: [2.4380580e-07 8.8358372e-01 4.0851645e-02 3.4712739e-02 4.0851645e-02]
Word 1 score: [1.7962424e-02 1.1158503e-10 1.0190537e-03 9.8101830e-01 1.9296345e-07]
------
1107
your reservation has been confirmed . please enjoy your meal , and thank you for using our service !
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O O O O O B-closing I-closing I-closing I-closing I-closing I-closing O
Real slot label: O O O O O O O O O O O O B-closing I-closing I-closing I-closing I-closing I-closing O
Score: 
Word 12 score: [1.82206053e-02 1.03122693e-04 9.81031597e-01 1.02791215e-04
 5.41899237e-04]
Word 13 score: [7.5995159e-01 2.1475009e-03 7.0801978e-03 1.8444302e-04 2.3063616e-01]
Word 14 score: [1.5980469e-09 1.2465594e-07 4.3681276e-09 9.9999297e-01 6.9079565e-06]
Word 15 score: [7.7720392e-03 5.0308736e-04 7.7720392e-03 9.8395282e-01 1.3001599e-13]
Word 16 score: [4.5228744e-06 5.2388571e-02 7.3800611e-01 8.9501098e-02 1.2009969e-01]
Word 17 score: [1.8550253e-02 1.0183745e-04 2.4232054e-02 9.0271838e-02 8.6684400e-01]
------
1108
hi , i am looking for a chinese food restaurant in rhode island
Predicted label: ['request', 'greeting']
Real label: ['request']
Predicted slot label: O O O O O O O B-cuisine I-cuisine O O B-city I-city
Real slot label: O O O O O O O B-cuisine I-cuisine O O B-city I-city
Score: 
Word 7 score: [9.9955767e-01 9.4711995e-06 1.7473755e-04 2.5614380e-04 2.0242073e-06]
Word 8 score: [8.8042888e-04 2.0975043e-05 9.9005669e-01 8.8688117e-03 1.7302384e-04]
Word 11 score: [2.2454573e-07 2.1158676e-01 1.0689659e-04 2.7365750e-01 5.1464862e-01]
Word 12 score: [5.8981714e-10 9.9810660e-01 7.9437486e-06 2.1593194e-04 1.6694914e-03]
------
1109
here are 3 of the top rated chinese restaurants in rhode island : ocean view chinese restaurant , as ##para palace , and ye express . would you like to make a reservation at one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['multiple_choice']
Predicted slot label: O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname O O O O O O O O O O O O O
Score: 
Word 13 score: [3.0336386e-07 9.9990499e-01 2.1678670e-06 3.9475242e-05 5.3074571e-05]
Word 14 score: [2.3581032e-02 1.2972637e-01 3.7329208e-02 8.0924565e-01 1.1777081e-04]
Word 15 score: [2.0853317e-01 2.7247902e-03 7.8666574e-01 1.1717680e-05 2.0645561e-03]
Word 16 score: [7.0651770e-14 8.8882852e-01 1.3287765e-03 1.0984273e-01 6.1993685e-16]
Word 18 score: [9.9958938e-01 4.5380193e-11 3.7020323e-04 7.9797971e-08 4.0273015e-05]
Word 19 score: [1.8719295e-02 5.2714515e-01 4.4649398e-01 7.5761429e-03 6.5428889e-05]
Word 20 score: [9.7750729e-01 2.2308778e-02 3.5430530e-05 2.2108816e-08 1.4850266e-04]
Word 23 score: [2.7608997e-01 7.0866865e-01 1.5009025e-02 8.2934988e-05 1.4937042e-04]
Word 24 score: [0.00164787 0.06049037 0.0354707  0.8790464  0.02334462]
------
1110
can you book the hard rock cafe at 3 pm on march 14th for 2 people in seattle ?
Predicted label: ['request']
Real label: ['inform']
Predicted slot label: O O O O B-restaurantname I-restaurantname I-restaurantname O O O O B-date I-date O B-numberofpeople O O O O
Real slot label: O O O O B-restaurantname I-restaurantname I-restaurantname O O O O B-date I-date O B-numberofpeople O O O O
Score: 
Word 4 score: [5.2814571e-06 3.7387007e-08 3.8027982e-03 9.8061055e-02 8.9813089e-01]
Word 5 score: [1.1061481e-01 4.7829733e-11 8.8938516e-01 6.7493266e-13 2.1742842e-08]
Word 6 score: [1.0186972e-01 2.9858339e-03 4.1768174e-03 7.4205130e-12 8.9096773e-01]
Word 11 score: [5.8766582e-05 7.7867192e-01 3.9665729e-02 6.3954845e-02 1.1764870e-01]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
------
1111
what name would you like to book the reservation under ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
1112
chevy chase
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname I-personfullname
Real slot label: B-personfullname I-personfullname
Score: 
Word 0 score: [0.28522518 0.37361363 0.32572526 0.00322312 0.01221276]
Word 1 score: [5.5065725e-02 6.1979698e-08 2.0367527e-07 9.4395310e-01 9.8085450e-04]
------
1113
alright , chevy , your reservation is confirmed !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
1114
reserve the blue ##fin grill in wilmington , nc for a party of 4 on tuesday night at 8 ##pm
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O B-restaurantname I-restaurantname I-restaurantname O B-city O O O O O O B-numberofpeople O B-date O O O O
Real slot label: O O B-restaurantname I-restaurantname I-restaurantname O B-city O O O O O O B-numberofpeople O B-date O O O O
Score: 
Word 2 score: [6.2850058e-01 9.8767068e-06 3.3500177e-07 3.3500177e-07 3.7148893e-01]
Word 3 score: [6.701509e-02 6.994807e-02 1.265348e-04 1.265348e-04 8.627838e-01]
Word 4 score: [3.4737115e-18 2.5896678e-19 1.8952704e-04 1.3251494e-16 9.9981052e-01]
Word 6 score: [1.0460934e-04 8.6268750e-07 4.0498286e-02 9.6026205e-02 8.6337006e-01]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.0345973  0.3207232  0.29613093 0.0077806  0.34076792]
------
1115
your reservation is confirmed ! please enjoy your meal , and thank you for using our service .
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O B-closing I-closing I-closing O O O O O O O O O
Real slot label: O O O O O O B-closing I-closing I-closing O O O O O O O O O
Score: 
Word 6 score: [2.3548687e-02 3.9303567e-02 9.3536401e-01 1.7832590e-03 5.4597962e-07]
Word 7 score: [5.4573093e-04 9.9884605e-01 6.0814992e-04 4.5333425e-17 4.5333425e-17]
Word 8 score: [5.4201411e-08 1.7755156e-07 4.5771560e-07 4.8745289e-01 5.1254642e-01]
------
1116
please book a table for 4 in seattle for tomorrow at 9 : 00 pm at chop shop under the name blanche dev ##ere ##aux
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname O O O B-personfullname I-personfullname I-personfullname I-personfullname
Real slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname O O O B-personfullname I-personfullname I-personfullname I-personfullname
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [1.6372788e-01 1.1570397e-03 5.4221892e-01 2.9279932e-01 9.6841068e-05]
Word 9 score: [7.9519653e-01 1.8284759e-01 5.7817400e-09 3.0846832e-07 2.1955555e-02]
Word 16 score: [9.9974424e-01 8.4354292e-07 1.0761456e-04 6.7227743e-06 1.4060276e-04]
Word 17 score: [9.9999988e-01 6.8696498e-10 9.8715532e-08 1.2262379e-11 3.0560207e-10]
Word 21 score: [1.49508605e-05 9.97393131e-01 3.81883365e-05 3.81883365e-05
 2.51559075e-03]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
------
1117
i have successfully booked your reservation ! enjoy !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-closing I-closing
Real slot label: O O O O O O O B-closing I-closing
Score: 
Word 7 score: [1.1639449e-01 6.2418249e-03 8.7700993e-01 4.7648282e-05 3.0607381e-04]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
------
1118
i ' d like to find mid - priced seafood restaurant in charleston , sc
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O B-pricing I-pricing I-pricing B-cuisine O O B-city O B-state
Real slot label: O O O O O O B-pricing I-pricing I-pricing B-cuisine O O B-city O B-state
Score: 
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [7.5217798e-08 1.7013583e-04 9.2606424e-06 3.2112837e-09 9.9982053e-01]
Word 12 score: [9.9911350e-01 8.0953469e-04 7.6816104e-05 7.1479032e-09 6.7272332e-08]
Word 14 score: [5.4348529e-08 8.3925871e-09 1.3225984e-07 9.9999976e-01 1.0757643e-09]
------
1119
great . what date and time would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O
Score: 
------
1120
next saturday the 19th at 8 : 00
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date I-date I-date I-date O B-starttime I-starttime I-starttime
Real slot label: B-date I-date I-date I-date O B-starttime I-starttime I-starttime
Score: 
Word 0 score: [0.02705626 0.26540643 0.00822562 0.67197126 0.02734044]
Word 1 score: [7.4366312e-07 4.8136135e-09 6.0802542e-02 6.7905439e-03 9.3240613e-01]
Word 2 score: [5.5239671e-01 4.0052077e-01 3.7985966e-02 4.0152142e-04 8.6949877e-03]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
------
1121
i ' m happy to assist you ! how many guests are in your party ?
Predicted label: ['request', 'greeting']
Real label: ['request', 'greeting']
Predicted slot label: B-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting O O O O O O O O O
Real slot label: B-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting O O O O O O O O O
Score: 
Word 0 score: [5.5236620e-01 1.4217559e-07 8.6226100e-03 1.9831011e-02 4.1917998e-01]
Word 1 score: [2.5979595e-08 8.9225209e-01 1.7269914e-03 1.0602058e-01 3.9499645e-07]
Word 2 score: [4.8392796e-08 9.0275735e-01 7.0586088e-03 9.0182588e-02 1.4188513e-06]
Word 3 score: [1.8084621e-04 2.3134413e-01 5.6040266e-05 7.5869000e-01 9.7289691e-03]
Word 4 score: [1.7299760e-03 1.3964626e-04 7.1252280e-01 2.7897093e-07 2.8560731e-01]
Word 5 score: [0.11763448 0.16418822 0.5684628  0.0401384  0.10957609]
Word 6 score: [0.36199385 0.04346867 0.00701073 0.07798398 0.50954276]
------
1122
3
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
1123
fish , am ##en street fish + raw bar , and coast bar & grill _ charleston are the top 3 restaurants with mid - priced seafood with available seating . may i book one of these options for you ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: B-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: B-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
Word 0 score: [9.6618575e-01 3.2023333e-02 9.2431328e-05 6.2685208e-06 1.6922400e-03]
Word 2 score: [2.0679206e-04 4.0010538e-02 7.0557696e-01 1.0180593e-01 1.5239975e-01]
Word 3 score: [7.8110657e-05 9.9623257e-01 3.6850623e-03 2.0991893e-06 2.1453006e-06]
Word 4 score: [4.0526584e-06 5.2721680e-07 4.7353326e-04 9.2159486e-01 7.7927008e-02]
Word 5 score: [1.7403307e-06 9.5164132e-01 4.4141421e-10 1.7915771e-12 4.8356868e-02]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [1.3912790e-10 9.9383330e-01 5.0827898e-03 3.5619255e-08 1.0839319e-03]
Word 8 score: [3.7571113e-03 7.6925041e-08 3.6061779e-06 3.9800648e-03 9.9225920e-01]
Word 11 score: [9.7276342e-01 1.4733547e-02 9.7315433e-06 1.2312312e-02 1.8100998e-04]
Word 12 score: [4.0508807e-01 5.6437843e-06 7.9459036e-03 1.9693747e-01 3.9002290e-01]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [5.1801189e-18 6.0701626e-19 2.8145334e-04 1.0180683e-15 9.9971849e-01]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
------
1124
yes , coast bar & grill
Predicted label: ['inform']
Real label: ['inform', 'confirm_answer']
Predicted slot label: O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 2 score: [9.4506139e-01 2.1142496e-02 1.5968767e-04 3.3259783e-02 3.7660566e-04]
Word 3 score: [3.9636219e-01 1.8392795e-05 8.5884249e-03 1.3068295e-01 4.6434808e-01]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [2.42787883e-17 1.35444555e-17 4.20592231e-04 1.86810131e-15
 9.99579370e-01]
------
1125
great your reservation is confirmed !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O
Real slot label: O O O O O O
Score: 
------
1126
i ' d like to make a reservation at the general muir in atlanta for this saturday
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O B-city O B-date I-date
Real slot label: O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O B-city O B-date I-date
Score: 
Word 9 score: [3.5135325e-02 2.7638379e-02 9.3703538e-01 4.7608704e-05 1.4332408e-04]
Word 10 score: [1.6113381e-01 8.3357930e-01 5.0350642e-03 2.5164688e-04 1.7407753e-07]
Word 11 score: [2.4868783e-02 9.7513121e-01 1.5615901e-08 1.5615901e-08 1.5615901e-08]
Word 13 score: [4.0817019e-02 9.5916438e-01 1.0052429e-05 7.4519016e-06 1.1493681e-06]
Word 15 score: [3.4532982e-01 6.5432912e-01 3.4102690e-04 6.8334602e-11 2.7102229e-10]
Word 16 score: [1.3971696e-06 1.8000894e-09 3.0401325e-02 2.9544632e-03 9.6664286e-01]
------
1127
it does not appear that general muir offers reservations through this service . would you like to select a new restaurant or cuisine ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1128
no thanks
Predicted label: ['confirm_answer', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O B-closing
Real slot label: O B-closing
Score: 
Word 1 score: [1.9904253e-05 2.9552673e-05 8.5262081e-04 9.9410868e-01 4.9893335e-03]
------
1129
thank you for using our system .
Predicted label: ['thanks']
Real label: ['thanks']
Predicted slot label: B-closing I-closing I-closing I-closing I-closing I-closing I-closing
Real slot label: B-closing I-closing I-closing I-closing I-closing I-closing I-closing
Score: 
Word 0 score: [1.0654654e-01 1.3590675e-04 8.7472624e-01 1.1033458e-02 7.5578745e-03]
Word 1 score: [8.4621835e-01 4.1148001e-03 6.9403523e-03 1.1257560e-04 1.4261398e-01]
Word 2 score: [5.3491256e-09 6.3804860e-06 2.0422606e-06 9.9993765e-01 5.3903706e-05]
Word 3 score: [2.2046497e-02 9.8928162e-05 2.2046497e-02 9.5580810e-01 1.9543957e-14]
Word 4 score: [6.5579484e-09 2.0691104e-02 5.3154719e-01 9.6382238e-02 3.5137948e-01]
Word 5 score: [6.7315295e-02 1.2957683e-04 6.5153098e-01 2.8100997e-01 1.4178014e-05]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
------
1130
reserve a table for 4 at a place where casual wear is acceptable in wilmington , nc on friday at 8 ##pm
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O B-numberofpeople O O O O O O O O O B-city O O O B-date O B-starttime I-starttime
Real slot label: O O O O B-numberofpeople O O O O O O O O O B-city O O O B-date O B-starttime I-starttime
Score: 
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [5.1984684e-05 2.9211895e-07 3.5706773e-02 8.5657559e-02 8.7858337e-01]
Word 18 score: [1.4346397e-03 4.0918258e-05 2.4334099e-06 9.9758160e-01 9.4036449e-04]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
------
1131
i ' m happy to assist you ! do you have a specific restaurant or cuisine in mind ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O
Score: 
------
1132
american
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-cuisine
Real slot label: B-cuisine
Score: 
Word 0 score: [1.5932063e-02 1.5370406e-01 5.8634351e-03 8.2449883e-01 1.5922226e-06]
------
1133
here are 3 of the top rated casual american restaurants in wilmington : 22 north , 247 craven , and flying fish cafe & wine bar . do any of those interest you ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O B-restaurantname I-restaurantname O B-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O
Real slot label: O O O O O O O O O O O O O B-restaurantname I-restaurantname O B-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O
Score: 
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [7.7664977e-01 2.2322039e-01 1.3510042e-07 2.0139871e-05 1.0959139e-04]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [1.3898779e-03 1.1257754e-01 8.6623335e-01 1.9114751e-02 6.8447914e-04]
Word 20 score: [1.9142045e-04 1.9142045e-04 9.4573797e-06 2.1903015e-04 9.9938869e-01]
Word 21 score: [1.0202446e-08 6.7016065e-01 2.9702152e-08 3.0894159e-10 3.2983932e-01]
Word 22 score: [1.5451451e-01 4.1234097e-03 1.1943314e-03 8.2356413e-12 8.4016776e-01]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [4.24538702e-01 5.75324059e-01 4.05409673e-06 3.30993535e-05
 1.00094665e-04]
Word 25 score: [7.0944615e-03 2.8937308e-07 3.9165379e-06 4.1956957e-03 9.8870569e-01]
------
1134
flying fish cafe & wine bar
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [3.0963995e-02 3.0963995e-02 3.9734584e-01 3.5809941e-04 5.4036814e-01]
Word 1 score: [1.06247295e-08 7.37856746e-01 6.24476515e-09 8.76616627e-11
 2.62143224e-01]
Word 2 score: [8.9621134e-02 2.7528564e-03 3.8285271e-04 5.1095472e-13 9.0724319e-01]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [5.6761414e-01 4.3233725e-01 1.4134224e-06 2.4895155e-05 2.2287988e-05]
Word 5 score: [7.6018567e-03 1.2204764e-07 2.2006413e-06 5.5706189e-03 9.8682517e-01]
------
1135
i have successfully completed your reservation at flying fish cafe & wine bar for friday at 8 ##pm . enjoy !
Predicted label: ['inform']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date O B-starttime I-starttime O B-closing O
Real slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date O B-starttime I-starttime O B-closing O
Score: 
Word 7 score: [1.28269618e-04 1.28269618e-04 1.11339905e-05 3.04183544e-04
 9.99428093e-01]
Word 8 score: [3.0362749e-08 5.1728225e-01 2.8316204e-08 1.9188894e-11 4.8271772e-01]
Word 9 score: [4.5671746e-02 3.0920363e-03 1.6505903e-03 1.6307213e-12 9.4958562e-01]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [8.1304234e-01 1.8681987e-01 8.9036280e-07 1.2984747e-04 7.0324459e-06]
Word 12 score: [2.4333599e-01 5.2942728e-06 1.5798922e-05 1.1747562e-01 6.3916731e-01]
Word 14 score: [8.0932550e-02 6.2718824e-04 2.9850367e-05 9.1775137e-01 6.5898610e-04]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [6.0109254e-02 8.5771056e-03 9.2679185e-01 2.1710386e-05 4.5000324e-03]
------
1136
i am interested in finding a cheap restaurant for kids .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O B-pricing O B-restauranttype I-restauranttype O
Real slot label: O O O O O O B-pricing O B-restauranttype I-restauranttype O
Score: 
Word 6 score: [8.92597020e-01 1.22990605e-05 4.65360372e-08 1.07366852e-01
 2.38520643e-05]
Word 8 score: [3.2541237e-12 5.9824135e-10 7.4350276e-11 9.9999940e-01 5.8821297e-07]
Word 9 score: [6.5746664e-10 9.9997199e-01 4.0083110e-06 4.9228805e-07 2.3557453e-05]
------
1137
what is your location ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
1138
boston .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city O
Real slot label: B-city O
Score: 
Word 0 score: [9.3452537e-01 4.1339985e-07 3.0678075e-02 1.3351720e-03 3.3460893e-02]
------
1139
what date would you like me to look for a reservation ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O
Score: 
------
1140
saturday .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date O
Real slot label: B-date O
Score: 
Word 0 score: [5.7741530e-02 5.4071599e-01 5.3917262e-07 4.0153793e-01 3.9629422e-06]
------
1141
at what time would you like to din ##e ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
1142
6 pm . 2 people .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-starttime I-starttime O B-numberofpeople O O
Real slot label: B-starttime I-starttime O B-numberofpeople O O
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [1.3727354e-04 7.8786737e-01 2.1199499e-01 2.3245840e-07 1.4870017e-07]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
------
1143
would you like a specific cuisine ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
1144
chinese .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-cuisine O
Real slot label: B-cuisine O
Score: 
Word 0 score: [2.3201346e-01 2.0978760e-04 7.6331860e-01 3.6193661e-03 8.3873444e-04]
------
1145
i found a few options for you : golden temple , red lantern , and royal east restaurant . would you like to book any of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O B-restaurantname I-restaurantname O B-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O O B-restaurantname I-restaurantname O B-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 8 score: [6.0583651e-03 2.4191260e-03 5.1877890e-07 9.7326648e-01 1.8255481e-02]
Word 9 score: [1.9123517e-03 3.0263586e-18 9.9808758e-01 3.6275063e-13 1.3121262e-08]
Word 11 score: [1.1930431e-03 9.8451507e-01 1.2826360e-02 1.2530724e-05 1.4529201e-03]
Word 12 score: [9.9999893e-01 2.3131752e-13 2.3851996e-07 1.3554667e-09 8.7402708e-07]
Word 15 score: [3.5611781e-06 1.5465004e-04 8.6928552e-01 1.2140904e-02 1.1841538e-01]
Word 16 score: [1.0189867e-04 1.0931595e-03 2.2404160e-01 7.7920936e-02 6.9684237e-01]
Word 17 score: [3.0169606e-13 8.4353346e-01 1.8128692e-03 1.5465370e-01 4.4704123e-16]
------
1146
golden temple
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname
Score: 
Word 0 score: [9.0448993e-01 5.5735721e-04 3.2794833e-02 6.2107231e-02 5.0578434e-05]
Word 1 score: [6.1193435e-04 8.8165191e-21 9.9938810e-01 2.8285134e-15 4.0178003e-10]
------
1147
success ! i have booked a table for 2 at golden temple on 3 / 12 at 6 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O
Real slot label: O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O
Score: 
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [1.3457267e-02 1.1063076e-03 4.8146910e-07 9.7416049e-01 1.1275430e-02]
Word 11 score: [4.0278803e-03 1.0021287e-19 9.9597210e-01 3.7149774e-14 1.0808219e-09]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
------
1148
please book a table for 4 in seattle for tomorrow at 6 : 30 pm at the old sage under the name rudy gal ##ind ##o
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O B-personfullname I-personfullname I-personfullname I-personfullname
Real slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O B-personfullname I-personfullname I-personfullname I-personfullname
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [1.5392390e-01 1.3787982e-03 2.9155079e-01 5.5289382e-01 2.5277145e-04]
Word 9 score: [8.2040817e-01 1.5052497e-01 1.0068638e-08 2.6390529e-07 2.9066553e-02]
Word 16 score: [1.7660566e-02 4.3577938e-03 9.7788805e-01 2.7591959e-05 6.6072367e-05]
Word 17 score: [1.6741242e-09 5.9392125e-10 9.9999976e-01 2.1170322e-07 7.7741708e-13]
Word 18 score: [6.3291034e-10 2.5398414e-13 2.7098796e-01 1.1972528e-03 7.2781479e-01]
Word 22 score: [9.6237290e-01 5.0156740e-07 1.4588769e-06 1.2208284e-07 3.7624989e-02]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
------
1149
i have successfully completed your reservation . enjoy !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-closing O
Real slot label: O O O O O O O B-closing O
Score: 
Word 7 score: [1.1915551e-01 4.6942965e-03 8.7265587e-01 1.4091327e-05 3.4802244e-03]
------
1150
hello . i am needing to place a reservation for an upscale restaurant in seattle , wa , for tomorrow night . there ' s going to be 5 of us , and we ' re hoping to din ##e between 6 - 7 ##pm . a place that does n ' t allow kids , please .
Predicted label: ['request', 'greeting']
Real label: ['request', 'greeting']
Predicted slot label: O O O O O O O O O O O B-restauranttype O O B-city O B-state O O B-date I-date O O O O O O O B-numberofpeople O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O B-restauranttype O O B-city O B-state O O B-date I-date O O O O O O O B-numberofpeople O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
Word 11 score: [1.4422709e-04 2.8142103e-04 3.6421593e-03 9.9592519e-01 7.1031891e-06]
Word 14 score: [8.1057839e-02 4.8194526e-04 5.4490525e-01 3.7278709e-01 7.6789624e-04]
Word 16 score: [7.66579324e-05 9.06032801e-01 8.61309189e-03 8.51609483e-02
 1.16514784e-04]
Word 19 score: [3.98952127e-01 1.06825985e-01 2.90499116e-07 1.16080419e-05
 4.94209945e-01]
Word 20 score: [1.6379078e-12 5.0000000e-01 4.7906460e-13 5.0000000e-01 3.8239078e-15]
Word 28 score: [0.2 0.2 0.2 0.2 0.2]
------
1151
is there a specific type of cuisine you are interested in ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O
Score: 
------
1152
no , so long as no seafood ! it ' s more important that it be a 21 + restaurant .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1153
none of them forbid children , but i have found some that have a bar area that will be child - free . 1 ) 13 ##mo ##ons , 2 ) 99 park , and 3 ) an ##cho ##vies & olive ##s . would you like to book one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
Word 26 score: [0.2 0.2 0.2 0.2 0.2]
Word 27 score: [0.2 0.2 0.2 0.2 0.2]
Word 31 score: [0.2 0.2 0.2 0.2 0.2]
Word 32 score: [1.688530e-05 5.757524e-03 7.870042e-02 9.097985e-01 5.726607e-03]
Word 37 score: [1.0000000e+00 2.1457218e-10 2.1457218e-10 2.1457218e-10 2.1457218e-10]
Word 38 score: [1.0000000e+00 1.2396903e-10 1.2396903e-10 1.2396903e-10 1.2396903e-10]
Word 39 score: [1.0000000e+00 1.1571466e-09 1.1571466e-09 1.1571466e-09 1.1571466e-09]
Word 40 score: [0.2 0.2 0.2 0.2 0.2]
Word 41 score: [1.5410949e-05 1.6388387e-05 4.6664614e-09 6.1946416e-01 3.8050404e-01]
Word 42 score: [1.0474238e-05 1.0876537e-05 2.9855571e-09 6.0992682e-01 3.9005175e-01]
------
1154
that sounds like a fair compromise . let ' s go with 99 park first , and if that ' s not available , an ##cho ##vies & olive ##s . i would also like to change the time to 9 ##pm - - i sincerely doubt any kids will be there then .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O B-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O O O O O O O O O B-starttime I-starttime O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O B-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O O O O O O O O O B-starttime I-starttime O O O O O O O O O O O O
Score: 
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [3.9951945e-05 1.6495227e-03 9.2652449e-03 9.8779488e-01 1.2504396e-03]
Word 40 score: [0.2 0.2 0.2 0.2 0.2]
Word 41 score: [0.2 0.2 0.2 0.2 0.2]
------
1155
unfortunately , i can not book a table at 9 ##pm , but they do have an opening at 8 : 45 pm . does that work with you ?
Predicted label: ['inform', 'confirm_question']
Real label: ['confirm_question']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1156
yes , i ' ll take it .
Predicted label: ['confirm_answer']
Real label: ['confirm_answer']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
1157
i have successfully completed your reservation for tomorrow at 9 : 45 ##pm for 5 guests at 99 park .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-date O B-starttime I-starttime I-starttime I-starttime O B-numberofpeople O O B-restaurantname I-restaurantname O
Real slot label: O O O O O O O B-date O B-starttime I-starttime I-starttime I-starttime O B-numberofpeople O O B-restaurantname I-restaurantname O
Score: 
Word 7 score: [2.5452545e-01 3.8110878e-02 5.0755915e-08 7.8703151e-06 7.0735574e-01]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [1.8877183e-05 3.2295022e-04 2.7147778e-03 9.9657756e-01 3.6592330e-04]
------
1158
find me a sandwich shop that delivers
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O B-restauranttype I-restauranttype O O
Real slot label: O O O B-restauranttype I-restauranttype O O
Score: 
Word 3 score: [1.0113484e-05 7.3872502e-07 1.2279537e-06 2.4731540e-11 9.9998796e-01]
Word 4 score: [9.9999988e-01 3.2399310e-08 2.9082822e-10 5.2909815e-08 3.5298282e-08]
------
1159
where are you located ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
1160
seattle
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city
Real slot label: B-city
Score: 
Word 0 score: [6.7302501e-01 1.0880615e-04 2.3454167e-01 9.2015170e-02 3.0936170e-04]
------
1161
do you have a price range in mind ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
1162
average
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-pricing
Real slot label: B-pricing
Score: 
Word 0 score: [9.9051124e-01 6.9825482e-03 2.2031574e-03 4.5286947e-06 2.9865725e-04]
------
1163
what date would you like me to look for a reservation ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O
Score: 
------
1164
tomorrow . i ' d like to have sandwiches delivered to me rather than din ##e in
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date O O O O O O O O O O O O O O O O
Real slot label: B-date O O O O O O O O O O O O O O O O
Score: 
Word 0 score: [4.4808182e-04 9.9955124e-01 5.7637058e-11 2.6673561e-08 6.2590829e-07]
------
1165
this is a restaurant reservations service . we do not handle delivery requests at this time .
Predicted label: ['confirm_question']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O
Score: 
------
1166
okay . then set me up with a reservation tomorrow at noon
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O B-date B-starttime I-starttime
Real slot label: O O O O O O O O O B-date B-starttime I-starttime
Score: 
Word 9 score: [6.0196114e-01 1.8214831e-01 6.8596466e-07 6.2323115e-06 2.1588358e-01]
Word 10 score: [3.0232661e-09 1.0000000e+00 3.1592387e-12 1.1929309e-10 2.6520890e-11]
Word 11 score: [1.2554979e-04 1.2554979e-04 9.9676943e-01 4.9834445e-05 2.9296188e-03]
------
1167
how many guests will you have ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
1168
just 3
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O B-numberofpeople
Real slot label: O B-numberofpeople
Score: 
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
------
1169
i found some great options for you ! 1 ) paddy co ##yne ' s irish pub , 2 ) aqua terra , and 3 ) art house cafe . would you like to book one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname O O O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname O O O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 10 score: [9.7233337e-01 4.6962050e-05 1.7278690e-02 4.3077336e-05 1.0297896e-02]
Word 11 score: [1.8077002e-01 8.1837857e-01 5.7862094e-04 2.7278528e-04 2.8900477e-08]
Word 12 score: [2.5245860e-02 9.7447848e-01 2.7347912e-04 4.2325308e-07 1.6632857e-06]
Word 13 score: [9.9870026e-01 9.2289730e-07 6.0594239e-08 1.3695089e-06 1.2972825e-03]
Word 14 score: [9.9802053e-01 1.7987904e-06 5.4545144e-08 1.6259489e-06 1.9760721e-03]
Word 15 score: [6.3996071e-01 1.1590332e-08 4.6560541e-04 1.0611026e-03 3.5851261e-01]
Word 16 score: [1.3236146e-04 1.0415629e-02 9.7095669e-04 6.7648152e-04 9.8780453e-01]
Word 20 score: [1.8948020e-05 9.4247480e-06 6.8434666e-08 1.4394114e-06 9.9997008e-01]
Word 21 score: [2.7057440e-03 9.4934000e-04 1.3793183e-02 1.0367123e-04 9.8244804e-01]
Word 26 score: [0.00265052 0.01153258 0.26650363 0.2559765  0.46333674]
Word 27 score: [2.54723942e-03 5.76417267e-01 1.08366185e-04 3.41513827e-02
 3.86775702e-01]
Word 28 score: [8.6537391e-02 4.4178553e-03 1.1606195e-03 1.2899927e-10 9.0788412e-01]
------
1170
art house cafe
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O
Real slot label: O O O
Score: 
------
1171
what name would you like to book the reservation under ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
1172
jimmy johnson
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname I-personfullname
Real slot label: B-personfullname I-personfullname
Score: 
Word 0 score: [0.02184731 0.15608451 0.08353572 0.34088385 0.39764863]
Word 1 score: [7.9147139e-05 9.9992049e-01 3.7706521e-08 3.1092235e-08 3.1890960e-07]
------
1173
i ' ve booked your reservation for you . thank you .
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O O B-closing I-closing O
Real slot label: O O O O O O O O O B-closing I-closing O
Score: 
Word 9 score: [7.8415079e-03 6.5375593e-06 9.9028718e-01 3.2840912e-08 1.8646896e-03]
Word 10 score: [6.4654924e-02 7.7764795e-04 1.1579481e-02 4.2385681e-04 9.2256403e-01]
------
1174
book me a table for 7 ##pm tomorrow evening at morton ' s - seattle
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-starttime I-starttime B-date I-date O B-restaurantname I-restaurantname I-restaurantname O B-city
Real slot label: O O O O O B-starttime I-starttime B-date I-date O B-restaurantname I-restaurantname I-restaurantname O B-city
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [1.6802722e-05 3.8008359e-01 1.3951794e-10 6.6152182e-08 6.1989957e-01]
Word 8 score: [0.00805077 0.00249939 0.07548515 0.7543338  0.15963085]
Word 10 score: [3.6107742e-03 5.7992031e-04 5.6681224e-06 2.8593037e-01 7.0987320e-01]
Word 11 score: [7.2789669e-01 5.8846909e-04 2.3746561e-01 1.6236342e-04 3.3886887e-02]
Word 12 score: [9.9909604e-01 4.0561131e-06 3.8840341e-07 1.2549324e-06 8.9824607e-04]
Word 14 score: [2.4945375e-02 6.4689614e-04 7.7625293e-01 1.9810055e-01 5.4284959e-05]
------
1175
how many people are going ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O
Real slot label: O O O O O O
Score: 
------
1176
2
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
1177
your reservation at morton ' s for 02 / 16 / 2016 07 : 00pm for 2 people under john smith has been confirmed .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O B-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date I-date I-date O O O O B-numberofpeople O O B-personfullname I-personfullname O O O O
Real slot label: O O O B-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date I-date I-date O O O O B-numberofpeople O O B-personfullname I-personfullname O O O O
Score: 
Word 3 score: [1.8611982e-03 2.9658421e-03 4.6710461e-06 6.6238356e-01 3.3278480e-01]
Word 4 score: [9.6591115e-01 9.5275333e-05 5.5380343e-03 2.8948591e-04 2.8166007e-02]
Word 5 score: [9.9988174e-01 2.8397613e-08 2.2331532e-09 1.8887586e-07 1.1802447e-04]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [1.4955098e-02 5.0591258e-03 2.8996132e-08 9.7662497e-01 3.3607457e-03]
Word 20 score: [6.2053330e-04 6.4524811e-06 1.6058488e-03 1.7534503e-06 9.9776542e-01]
------
1178
book me a table for 1 in seattle for tomorrow at 7 : 00 pm at tr ##op ##ico ##s breeze
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [5.5396728e-02 2.6982583e-04 1.0693712e-01 8.3685780e-01 5.3850544e-04]
Word 9 score: [4.6858391e-01 5.1549222e-02 1.8323600e-07 1.3482884e-06 4.7986537e-01]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [5.0537521e-01 2.6757084e-03 4.9188426e-01 6.2565559e-05 2.2300026e-06]
------
1179
hi . i ' ve booked your restaurant for tomorrow . thank you .
Predicted label: ['inform']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O
Score: 
------
1180
find me a cuban restaurant with patio seating in miami
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O B-cuisine O O B-seating O O B-city
Real slot label: O O O B-cuisine O O B-seating O O B-city
Score: 
Word 3 score: [7.1189770e-09 9.9958056e-01 2.0869194e-04 2.0681823e-06 2.0869194e-04]
Word 6 score: [1.9626555e-16 1.0136338e-04 4.2855817e-09 1.4793755e-08 9.9989855e-01]
Word 9 score: [2.7860138e-01 3.6053765e-01 5.0214373e-07 3.6053765e-01 3.2280019e-04]
------
1181
here are 3 of the top rated cuban restaurants in miami with outdoor seating : havana 1957 , la ##rio ##s on the beach , and yu ##ca .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O B-rating I-rating B-cuisine O O B-city O B-seating O O B-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname O
Real slot label: O O O O O B-rating I-rating B-cuisine O O B-city O B-seating O O B-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname O
Score: 
Word 5 score: [1.1561841e-05 1.4585328e-04 1.1572507e-07 4.9992120e-01 4.9992120e-01]
Word 6 score: [9.5772415e-01 4.5415465e-04 1.7245269e-11 1.8916880e-13 4.1821655e-02]
Word 7 score: [0.00412527 0.06861018 0.4366024  0.0540598  0.4366024 ]
Word 10 score: [1.6540143e-01 4.1723889e-01 1.0196063e-07 4.1723889e-01 1.2068739e-04]
Word 12 score: [1.0000000e+00 4.1296572e-10 1.0831526e-15 4.0917657e-13 1.2192614e-09]
Word 15 score: [8.3101455e-05 1.1890924e-06 1.3341896e-05 3.3502749e-03 9.9655211e-01]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [7.5353266e-05 6.0722391e-07 1.3074276e-04 9.9614799e-01 3.6453789e-03]
Word 22 score: [0.00129912 0.08014243 0.01160257 0.00423168 0.9027243 ]
Word 23 score: [4.1603154e-05 3.5027032e-08 3.1065259e-09 7.2380225e-04 9.9923456e-01]
Word 26 score: [4.1021818e-01 5.8977419e-01 2.5608772e-06 2.5608772e-06 2.5608772e-06]
Word 27 score: [1.1200319e-06 9.9999893e-01 2.0872187e-20 2.0872187e-20 2.0872187e-20]
------
1182
i ' d like havana 1957
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O B-restaurantname I-restaurantname
Real slot label: O O O O B-restaurantname I-restaurantname
Score: 
Word 4 score: [1.1158871e-04 1.5605598e-06 1.2009383e-05 1.6449153e-03 9.9822992e-01]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
------
1183
when would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
1184
reserve a table for 2 at a beach restaurant in carolina beach , nc on saturday at 6 ##pm
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O B-numberofpeople O O B-restaurantname O O B-address I-address O O O B-date O B-starttime I-starttime
Real slot label: O O O O B-numberofpeople O O B-restaurantname O O B-address I-address O O O B-date O B-starttime I-starttime
Score: 
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [7.4108347e-04 1.8875707e-07 2.3200041e-06 1.2937927e-04 9.9912709e-01]
Word 10 score: [1.3917514e-06 8.8123115e-06 1.1149024e-06 4.9138424e-07 9.9998820e-01]
Word 11 score: [1.6592877e-04 3.0777990e-08 7.2523904e-01 1.4878028e-02 2.5971699e-01]
Word 15 score: [1.41286515e-02 5.06099197e-04 1.86183461e-04 5.47424972e-01
 4.37754154e-01]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
------
1185
open ##table does not serve the carolina beach area yet . could you please try a different city ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O B-city I-city I-city O O O O O O O O O O
Real slot label: O O O O O O B-city I-city I-city O O O O O O O O O O
Score: 
Word 6 score: [4.9239870e-06 1.0983908e-05 1.4910794e-06 1.9799650e-06 9.9998057e-01]
Word 7 score: [7.7536213e-04 2.2788549e-07 7.1538125e-07 3.5824472e-04 9.9886537e-01]
Word 8 score: [1.7675410e-07 2.9196110e-04 4.6438862e-09 2.0730229e-02 9.7897756e-01]
------
1186
wright ##sville beach , nc
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city I-city I-city O B-state
Real slot label: B-city I-city I-city O B-state
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [6.1039791e-05 4.5483613e-08 8.8243114e-06 2.8690292e-02 9.7123981e-01]
Word 4 score: [1.00000e+00 4.48717e-12 4.48717e-12 4.48717e-12 4.48717e-12]
------
1187
per ##si ##mmon ##s waterfront restaurant has a fantastic view . would you like to try there or should i search for additional options ?
Predicted label: ['inform', 'confirm_question']
Real label: ['inform', 'confirm_question']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O O O
Score: 
Word 0 score: [0.25573096 0.18606724 0.18606724 0.18606724 0.18606724]
Word 1 score: [9.9999988e-01 3.8375603e-08 3.8375603e-08 3.8375603e-08 3.8375603e-08]
Word 2 score: [9.9674368e-01 8.1410207e-04 8.1410207e-04 8.1410207e-04 8.1410207e-04]
Word 3 score: [0.9959698  0.00100758 0.00100758 0.00100758 0.00100758]
Word 4 score: [0.08534314 0.775674   0.01723058 0.06732038 0.05443189]
------
1188
yes
Predicted label: ['confirm_answer']
Real label: ['confirm_answer']
Predicted slot label: O
Real slot label: O
Score: 
------
1189
there is no table available at 6 ##pm . however , 5 : 45 and 6 : 15 are open . would either of those work for you ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O B-starttime I-starttime O O O B-starttime I-starttime I-starttime O B-starttime I-starttime I-starttime O O O O O O O O O O O
Real slot label: O O O O O O B-starttime I-starttime O O O B-starttime I-starttime I-starttime O B-starttime I-starttime I-starttime O O O O O O O O O O O
Score: 
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
------
1190
0 . 260 ##41 ##66 ##6 ##7
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
1191
i have successfully completed your reservation for per ##si ##mmon ##s waterfront restaurant at 6 : 15 on saturday . enjoy !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-starttime I-starttime I-starttime O B-date O B-closing O
Real slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-starttime I-starttime I-starttime O B-date O B-closing O
Score: 
Word 7 score: [1.00000e+00 7.43567e-11 7.43567e-11 7.43567e-11 7.43567e-11]
Word 8 score: [1.00000000e+00 1.06487485e-10 1.06487485e-10 1.06487485e-10
 1.06487485e-10]
Word 9 score: [9.9998999e-01 2.5217948e-06 2.5217948e-06 2.5217948e-06 2.5217948e-06]
Word 10 score: [9.9998772e-01 3.0645438e-06 3.0645438e-06 3.0645438e-06 3.0645438e-06]
Word 11 score: [0.13387595 0.7123799  0.00620323 0.13780276 0.00973816]
Word 12 score: [2.5452446e-13 9.2212105e-01 7.9724001e-04 7.7081621e-02 5.1088167e-17]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.19785532 0.01400077 0.00068714 0.16395965 0.6234971 ]
Word 20 score: [2.6499148e-02 1.2612503e-02 9.5708960e-01 2.7085331e-05 3.7716855e-03]
------
1192
i ' m going to be in des ##tin florida next week . looking for some upscale seafood restaurants .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O B-city I-city I-city B-date I-date O O O O B-rating B-restauranttype O O
Real slot label: O O O O O O O B-city I-city I-city B-date I-date O O O O B-rating B-restauranttype O O
Score: 
Word 7 score: [9.9999964e-01 7.8494189e-08 7.8494189e-08 7.8494189e-08 7.8494189e-08]
Word 8 score: [1.0000000e+00 1.8861681e-13 1.8861681e-13 1.8861681e-13 1.8861681e-13]
Word 9 score: [1.8127141e-13 1.0790789e-03 4.9946046e-01 4.0222732e-09 4.9946046e-01]
Word 10 score: [1.8942210e-10 2.0643500e-07 6.8786756e-12 9.9999976e-01 2.3460501e-08]
Word 11 score: [1.5916191e-06 9.9783641e-01 1.3060814e-04 1.3782957e-03 6.5312663e-04]
Word 16 score: [4.8955673e-05 3.0783933e-05 1.8400350e-04 9.9973458e-01 1.7294250e-06]
Word 17 score: [2.8262603e-10 6.6778416e-10 2.1003864e-10 2.2922857e-12 1.0000000e+00]
------
1193
what date would you like to make a reservation for ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
1194
friday , march 18th
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O
Real slot label: O O O O
Score: 
------
1195
at what time would you like to make the reservation ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
1196
0 . 83 ##33 ##33 ##33 ##3
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
1197
how many guests will be dining ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
1198
4
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
1199
here are 3 of the top rated upscale seafood restaurants in des ##tin : sea ##gar ' s restaurant , marina cafe , and vin ##ti ##j wine boutique . would you like to book one of those or would you prefer more options ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O B-rating I-rating O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O
Real slot label: O O O O O B-rating I-rating O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O
Score: 
Word 5 score: [1.9857592e-04 2.7173085e-04 5.8758570e-07 4.9976456e-01 4.9976456e-01]
Word 6 score: [9.7684550e-01 3.2121848e-04 1.0758663e-09 1.6669112e-11 2.2833327e-02]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [9.9903619e-01 1.7715539e-06 5.8049523e-08 2.0761854e-06 9.6005696e-04]
Word 17 score: [9.9879551e-01 2.0826153e-06 6.5830648e-08 2.1686858e-06 1.2000052e-03]
Word 18 score: [2.2422462e-13 8.0492246e-01 1.6535328e-03 1.9342399e-01 4.9418740e-16]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
Word 26 score: [0.2 0.2 0.2 0.2 0.2]
Word 27 score: [2.2187552e-01 7.7760398e-01 4.8840175e-06 2.1866781e-05 4.9374858e-04]
Word 28 score: [5.6013603e-02 3.8216525e-01 5.6112653e-01 6.9456885e-04 7.8016093e-08]
------
1200
i would like to book sea ##gar ' s restaurant . what is the dress code ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O
Real slot label: O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [9.9888283e-01 3.2784990e-07 2.0527908e-07 4.0909763e-06 1.1125359e-03]
Word 8 score: [9.9803668e-01 3.8265745e-07 5.4969564e-07 6.2430368e-06 1.9561201e-03]
Word 9 score: [7.0658038e-14 9.2016774e-01 1.7380876e-03 7.8094169e-02 5.8393719e-18]
------
1201
your table at sea ##gar ' s restaurant was confirmed for 8 ##pm on 03 / 18 / 2016 for 4 people . please be advised the dress code is attire dress ##y .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-starttime I-starttime O B-date I-date I-date I-date I-date O B-numberofpeople O O O O O O O O O B-dress_code I-dress_code I-dress_code O
Real slot label: O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-starttime I-starttime O B-date I-date I-date I-date I-date O B-numberofpeople O O O O O O O O O B-dress_code I-dress_code I-dress_code O
Score: 
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [9.9942172e-01 9.6705992e-07 3.4682813e-08 1.2100787e-06 5.7613861e-04]
Word 6 score: [9.9928778e-01 1.1397267e-06 4.8953794e-08 1.3365863e-06 7.0978637e-04]
Word 7 score: [1.7181584e-14 8.1442082e-01 2.3803269e-03 1.8319881e-01 1.9557939e-18]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 30 score: [2.6308477e-05 9.1147697e-01 2.2415810e-03 8.6112380e-02 1.4281106e-04]
Word 31 score: [7.9829246e-01 2.0170216e-01 4.9866444e-06 3.9997170e-07 8.4049218e-18]
Word 32 score: [2.9152331e-01 7.0843035e-01 4.3919445e-05 2.4712381e-06 2.6307713e-16]
------
1202
i need a kid friendly place for br ##un ##ch on sunday - in miami
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O B-atmosphere I-atmosphere O O B-mealtype I-mealtype I-mealtype O B-date O O B-city
Real slot label: O O O B-atmosphere I-atmosphere O O B-mealtype I-mealtype I-mealtype O B-date O O B-city
Score: 
Word 3 score: [3.2702493e-04 1.6678872e-10 9.9967241e-01 4.9205723e-10 5.3422986e-07]
Word 4 score: [9.3458082e-05 6.8127406e-01 3.1384110e-01 4.2199786e-06 4.7871438e-03]
Word 7 score: [5.5297105e-06 7.8557321e-07 1.0505533e-03 8.3711260e-04 9.9810612e-01]
Word 8 score: [0.00183552 0.00589525 0.00327979 0.98409456 0.00489485]
Word 9 score: [0.00539705 0.11692473 0.01450883 0.6436837  0.21948574]
Word 11 score: [3.0695571e-08 7.4132495e-03 5.5599497e-07 3.5770352e-06 9.9258256e-01]
Word 14 score: [9.9566933e-03 4.9466124e-01 1.0482713e-07 4.9466124e-01 7.2067184e-04]
------
1203
what time would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
1204
from 10 to 12 would be fine ; whatever is closest to 10 . there will be three of us
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O B-starttime I-starttime I-starttime O O O O O O O O O O O O O O O O
Real slot label: O B-starttime I-starttime I-starttime O O O O O O O O O O O O O O O O
Score: 
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [4.3711853e-07 1.0759974e-02 9.7529840e-01 4.5473034e-09 1.3941210e-02]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
------
1205
there are many restaurants available at that time ; do you have a preferred cuisine so i may narrow down the results for you ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1206
american style is fine ; just nothing that ' s too eccentric ; i have a pick ##y kid
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-cuisine I-cuisine O O O O O O O O O O O O O O O O O
Real slot label: B-cuisine I-cuisine O O O O O O O O O O O O O O O O O
Score: 
Word 0 score: [4.2712078e-03 7.0359564e-01 1.5563238e-03 2.9057679e-01 4.3766160e-08]
Word 1 score: [2.4988592e-04 5.1005590e-01 4.6949491e-01 7.4248156e-03 1.2774432e-02]
------
1207
660 at the angle ##rs ; 94 ##th aero squadron ; and bala ##n ' s are 3 of the top options . would you like to try one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [9.8381331e-04 9.9897408e-01 3.8898954e-05 2.8989834e-06 3.0466896e-07]
Word 2 score: [2.9816139e-02 1.1494640e-02 9.5861697e-01 2.1294258e-05 5.0890787e-05]
Word 3 score: [1.000000e+00 9.508671e-09 9.508671e-09 9.508671e-09 9.508671e-09]
Word 4 score: [9.9999714e-01 7.1582588e-07 7.1582588e-07 7.1582588e-07 7.1582588e-07]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [3.0066208e-10 9.9992692e-01 1.2410859e-09 5.8886129e-05 1.4193424e-05]
Word 9 score: [9.9618334e-01 4.2848660e-05 3.3880405e-03 1.2925515e-05 3.7274900e-04]
Word 12 score: [1.0362550e-06 4.2696954e-07 2.4592541e-09 7.5727854e-08 9.9999845e-01]
Word 13 score: [9.5539296e-01 1.3304298e-04 2.7308153e-02 1.2210167e-02 4.9557048e-03]
Word 14 score: [9.9895310e-01 6.5437848e-06 8.4586887e-08 3.9548900e-06 1.0362855e-03]
Word 15 score: [9.9855727e-01 8.9171781e-06 6.0901037e-08 3.4305945e-06 1.4301986e-03]
------
1208
i think bala ##n ' s sounds just fine
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O
Real slot label: O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O
Score: 
Word 2 score: [1.0999427e-06 1.2640761e-07 3.4954122e-09 9.7760562e-08 9.9999869e-01]
Word 3 score: [8.9244586e-01 4.3412445e-05 3.3561692e-02 5.3609952e-02 2.0339040e-02]
Word 4 score: [9.9908400e-01 2.3948746e-06 8.9776933e-08 1.7069854e-06 9.1181678e-04]
Word 5 score: [9.9902976e-01 3.1171346e-06 4.5324246e-08 1.2565306e-06 9.6588233e-04]
------
1209
great your reservation for 10 : 00 ##am at bala ##ns is confirmed .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O B-restaurantname I-restaurantname O O O
Real slot label: O O O O O O O O O B-restaurantname I-restaurantname O O O
Score: 
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
------
1210
i ' d like a place with a good ve ##al sc ##all ##op ##ini
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O B-food I-food I-food I-food I-food I-food
Real slot label: O O O O O O O O O B-food I-food I-food I-food I-food I-food
Score: 
Word 9 score: [7.46057782e-21 1.00000000e+00 4.00203136e-16 4.79694941e-18
 1.01593624e-25]
Word 10 score: [1.4373379e-23 1.0000000e+00 2.2318441e-18 1.2454668e-20 3.2475716e-27]
Word 11 score: [9.9996185e-01 5.3767610e-07 3.7527181e-05 9.9033108e-12 9.9033108e-12]
Word 12 score: [9.9995005e-01 6.5461717e-07 4.9297494e-05 4.1046480e-12 4.1046480e-12]
Word 13 score: [9.9986863e-01 1.8099098e-06 1.2951482e-04 5.1606282e-11 5.1606282e-11]
Word 14 score: [9.9987757e-01 2.8691081e-06 1.1955445e-04 4.3189591e-11 4.3189591e-11]
------
1211
where are you located ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
1212
chicago
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city
Real slot label: B-city
Score: 
Word 0 score: [2.9598832e-06 3.9903058e-05 5.2903014e-01 4.7066918e-01 2.5784332e-04]
------
1213
what date would you like me to look for a reservation ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O
Score: 
------
1214
thursday
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date
Real slot label: B-date
Score: 
Word 0 score: [0.06194369 0.7396532  0.10290691 0.06723508 0.02826109]
------
1215
how many are going ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
1216
3 or 4
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople O B-numberofpeople
Real slot label: B-numberofpeople O B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
------
1217
what time would you like me to search for ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
1218
anytime between 5 and 8 ##pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-starttime I-starttime I-starttime I-starttime I-starttime I-starttime
Real slot label: B-starttime I-starttime I-starttime I-starttime I-starttime I-starttime
Score: 
Word 0 score: [0.00113449 0.36629838 0.21085571 0.21085571 0.21085571]
Word 1 score: [4.9227218e-08 1.7854033e-04 1.6751802e-06 9.9976856e-01 5.1178326e-05]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [4.9064826e-02 2.7402069e-03 3.2600994e-05 1.0438974e-04 9.4805795e-01]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
------
1219
do you have a price range in mind ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
1220
moderately expensive
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-pricing I-pricing
Real slot label: B-pricing I-pricing
Score: 
Word 0 score: [0.06066392 0.00856295 0.31025773 0.31025773 0.31025773]
Word 1 score: [9.5471925e-01 4.0196829e-02 8.0286028e-08 5.0838338e-03 5.4893359e-08]
------
1221
i found the following restaurants that fit your criteria for 5 ##pm : ric ##card ##o tr ##att ##oria , rosa ##l ' s , sap ##ori tr ##att ##oria . which one would you like to book .
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O B-starttime I-starttime O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O
Real slot label: O O O O O O O O O O B-starttime I-starttime O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O
Score: 
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [1.0000000e+00 2.5826324e-10 2.5826324e-10 2.5826324e-10 2.5826324e-10]
Word 17 score: [1.0000000e+00 2.2916006e-11 2.2916006e-11 2.2916006e-11 2.2916006e-11]
Word 18 score: [1.000000e+00 6.085409e-13 6.085409e-13 6.085409e-13 6.085409e-13]
Word 20 score: [1.7345656e-07 1.1066443e-07 3.6873065e-12 9.3092573e-01 6.9073960e-02]
Word 21 score: [9.2370315e-03 3.6308869e-05 1.9235367e-02 9.5463568e-01 1.6855648e-02]
Word 22 score: [9.9780113e-01 1.7041644e-06 1.9352109e-07 3.9721153e-06 2.1928838e-03]
Word 23 score: [9.9738687e-01 2.4450976e-06 1.2311389e-07 3.4134750e-06 2.6071817e-03]
Word 25 score: [8.69018972e-01 1.30651847e-01 1.09720575e-04 1.09720575e-04
 1.09720575e-04]
Word 26 score: [9.2820364e-01 7.1796335e-02 4.8193283e-11 4.8193283e-11 4.8193283e-11]
Word 27 score: [1.000000e+00 2.536596e-10 2.536596e-10 2.536596e-10 2.536596e-10]
Word 28 score: [1.000000e+00 9.193966e-12 9.193966e-12 9.193966e-12 9.193966e-12]
Word 29 score: [1.0000000e+00 2.4286854e-11 2.4286854e-11 2.4286854e-11 2.4286854e-11]
------
1222
rosa ##l
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname
Score: 
Word 0 score: [7.7848708e-13 1.8232005e-15 6.7065701e-15 1.3270530e-08 1.0000000e+00]
Word 1 score: [3.6705547e-05 3.8631012e-07 9.9595791e-01 2.3815136e-03 1.6234720e-03]
------
1223
i have successfully completed your reservation for rosa ##l ' s at 5 : 00pm on thursday for 4 people . enjoy !
Predicted label: ['inform', 'closing']
Real label: ['inform', 'closing']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname O O O O O O O O O B-numberofpeople O O B-closing I-closing
Real slot label: O O O O O O O B-restaurantname I-restaurantname O O O O O O O O O B-numberofpeople O O B-closing I-closing
Score: 
Word 7 score: [1.5492898e-08 6.3143535e-09 1.5951405e-12 8.6263555e-01 1.3736445e-01]
Word 8 score: [1.5895258e-04 1.0202038e-07 3.2488976e-04 8.6246979e-01 1.3704629e-01]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [4.3377932e-02 1.2127247e-02 9.4024265e-01 3.6556328e-05 4.2156698e-03]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
------
1224
i need to bring back an order of food from check ##ers can you give me the managers name or the owner please
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1225
what city and state would you like me to look ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
1226
i would love to take my children to a family friendly restaurant . can you please find a family friendly rest ##ara ##unt with some activities for my young children ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O B-atmosphere I-atmosphere O O O O O O O B-atmosphere I-atmosphere O O O O O O O O O O O
Real slot label: O O O O O O O O O B-atmosphere I-atmosphere O O O O O O O B-atmosphere I-atmosphere O O O O O O O O O O O
Score: 
Word 9 score: [2.1326940e-10 1.0177548e-04 2.2440193e-02 3.6150686e-07 9.7745764e-01]
Word 10 score: [3.5700832e-06 1.7445346e-03 9.9818712e-01 1.7273666e-07 6.4625674e-05]
Word 18 score: [3.0390088e-10 7.4872572e-05 1.6795110e-02 1.0241648e-06 9.8312896e-01]
Word 19 score: [5.9106165e-05 4.6925038e-02 9.5192730e-01 7.5851193e-07 1.0878553e-03]
------
1227
hello . lets get started with what city you ' re located in .
Predicted label: ['request']
Real label: ['request', 'greeting']
Predicted slot label: B-greeting O O O O O O O O O O O O O
Real slot label: B-greeting O O O O O O O O O O O O O
Score: 
Word 0 score: [8.2753589e-03 9.9127179e-01 4.5140725e-04 7.1197081e-07 7.1197081e-07]
------
1228
i am located in arlington , texas
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O B-city O B-state
Real slot label: O O O O B-city O B-state
Score: 
Word 4 score: [1.01412866e-07 9.69842613e-01 2.60821432e-02 2.95971194e-03
 1.11537788e-03]
Word 6 score: [9.9961263e-01 2.5849670e-07 3.4706251e-04 4.0101142e-05 6.6678996e-10]
------
1229
what time and date would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
1230
tomorrow night sometime around 8 pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date I-date O B-starttime I-starttime I-starttime
Real slot label: B-date I-date O B-starttime I-starttime I-starttime
Score: 
Word 0 score: [1.4218678e-03 9.9857461e-01 1.9958415e-10 6.6419524e-08 3.4424297e-06]
Word 1 score: [5.8975193e-13 5.0000000e-01 5.5435263e-13 5.0000000e-01 1.3746001e-16]
Word 3 score: [9.6299475e-01 3.6867268e-02 5.0090985e-05 5.0090985e-05 3.7807633e-05]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [1.6395956e-04 7.6304883e-01 2.3678221e-01 1.0741385e-06 3.8996413e-06]
------
1231
how many guests will you have ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
1232
2 adults ( including myself ) and 2 children
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofkids O O O O O O B-numberofkids O
Real slot label: B-numberofkids O O O O O O B-numberofkids O
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
------
1233
i found a few great options for you ! 1 ) salt ##grass steak ##house , 2 ) babe ' s chicken dinner house , and 3 ) rudy ' s country store . would you like to book one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 11 score: [9.9999523e-01 2.1235956e-06 2.5815077e-06 1.8192347e-12 1.8192347e-12]
Word 12 score: [9.9998796e-01 1.7406466e-06 1.0256146e-05 2.0145734e-13 2.0145734e-13]
Word 13 score: [1.7149418e-15 7.2947354e-21 5.9736554e-19 6.0710876e-18 1.0000000e+00]
Word 14 score: [1.6161291e-15 3.2641252e-21 3.6965135e-19 3.0448955e-18 1.0000000e+00]
Word 18 score: [0.01064802 0.18055132 0.009609   0.69782114 0.10137055]
Word 19 score: [0.03882625 0.19957367 0.11294842 0.0113569  0.6372947 ]
Word 20 score: [9.9068916e-01 1.8675851e-04 3.0507789e-07 8.6326027e-06 9.1151306e-03]
Word 21 score: [3.1717107e-04 4.8198830e-03 1.2893694e-02 4.4280814e-06 9.8196477e-01]
Word 22 score: [1.0000000e+00 1.5634111e-09 7.0821512e-13 8.6282304e-10 1.4523790e-12]
Word 23 score: [0.01319574 0.9064111  0.0024583  0.05227205 0.02566278]
Word 28 score: [9.9751353e-01 7.5741234e-08 1.6313506e-07 2.2465763e-08 2.4862844e-03]
Word 29 score: [6.8522578e-01 5.2226183e-04 2.0842236e-01 1.2003611e-03 1.0462918e-01]
Word 30 score: [9.9780732e-01 7.6732977e-06 7.4759136e-08 4.2967708e-06 2.1806015e-03]
Word 31 score: [9.9999928e-01 3.1499906e-07 1.2293121e-07 1.0766516e-07 1.4816263e-07]
Word 32 score: [1.2519329e-12 4.7435165e-05 6.6096362e-07 7.4517448e-13 9.9995184e-01]
------
1234
sure i would love to try babe ' s chicken dinner . please go ahead and book it for me .
Predicted label: ['inform']
Real label: ['request']
Predicted slot label: O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 6 score: [0.00524206 0.20396684 0.04129407 0.53468704 0.21480991]
Word 7 score: [4.2238370e-02 3.4947146e-04 9.0879840e-01 5.5787142e-04 4.8055902e-02]
Word 8 score: [9.9535877e-01 6.3847187e-06 1.3819944e-05 7.2302435e-05 4.5488556e-03]
Word 9 score: [2.4235626e-03 7.1962409e-02 2.6546265e-03 1.5006621e-07 9.2295927e-01]
Word 10 score: [1.0000000e+00 2.7834571e-10 6.6090164e-16 8.6749045e-12 4.7982902e-16]
------
1235
i ' m sorry , i am unable to book this restaurant . would you like to select another one ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1236
sure can we try salt ##grass steak ##house ?
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 4 score: [9.9999189e-01 2.6677101e-06 5.5000964e-06 3.0260608e-14 3.0260608e-14]
Word 5 score: [9.9995267e-01 2.4852538e-06 4.4854933e-05 4.8097368e-16 4.8097368e-16]
Word 6 score: [7.1567762e-15 8.4339990e-22 2.5172752e-20 2.0979755e-18 1.0000000e+00]
Word 7 score: [6.7094865e-15 7.9454974e-22 3.0055407e-20 1.7445322e-18 1.0000000e+00]
------
1237
i have successfully completed your reservation ! enjoy !
Predicted label: ['inform']
Real label: ['inform', 'closing']
Predicted slot label: O O O O O O O B-closing O
Real slot label: O O O O O O O B-closing O
Score: 
Word 7 score: [1.0493587e-02 6.0105319e-03 9.8335600e-01 1.2739244e-04 1.2435544e-05]
------
1238
looking for a dinner theater in wilmington , nc
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O B-mealtype B-restauranttype O B-city O O
Real slot label: O O O B-mealtype B-restauranttype O B-city O O
Score: 
Word 3 score: [9.9998319e-01 2.1443520e-06 4.9137278e-13 1.4694012e-05 4.1838963e-10]
Word 4 score: [7.6154196e-05 4.9629462e-06 2.5067008e-08 9.9991751e-01 1.2578054e-06]
Word 6 score: [2.2077700e-05 7.8162167e-08 3.2733619e-02 5.5304427e-02 9.1193980e-01]
------
1239
there are no dinner theaters that offer booking through this service . would you like to choose a different restaurant genre or cuisine type ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1240
hi ##bach ##i
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-cuisine I-cuisine I-cuisine
Real slot label: B-cuisine I-cuisine I-cuisine
Score: 
Word 0 score: [9.9864596e-01 4.7544752e-05 1.0277338e-04 3.3750260e-04 8.6635904e-04]
Word 1 score: [3.1006218e-06 9.1831398e-01 2.2757009e-02 2.4467971e-07 5.8925726e-02]
Word 2 score: [1.6392216e-02 8.1762439e-01 5.1994617e-03 1.7056490e-04 1.6061333e-01]
------
1241
there are no hi ##bach ##i restaurants available through this service . i can offer you the top three most popular or rated restaurants , or i can narrow it down by cuisine . which would you prefer ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1242
top 3
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restauranttype I-restauranttype
Real slot label: B-restauranttype I-restauranttype
Score: 
Word 0 score: [1.8596366e-07 9.9992800e-01 7.1730436e-05 5.7738660e-08 5.7738660e-08]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
------
1243
would you like a list of the top 3 most popular , or top 3 highest rated options that i ' m able to book for you ?
Predicted label: ['request']
Real label: ['multiple_choice']
Predicted slot label: O O O O O O O O O O O O O B-restauranttype I-restauranttype I-restauranttype I-restauranttype I-restauranttype O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O B-restauranttype I-restauranttype I-restauranttype I-restauranttype I-restauranttype O O O O O O O O O O
Score: 
Word 13 score: [9.0586570e-07 6.5008217e-06 1.1245757e-07 4.9999624e-01 4.9999624e-01]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [1.0000000e+00 2.6769642e-16 2.6769642e-16 2.6769642e-16 2.6769642e-16]
Word 16 score: [2.7281198e-01 4.6608015e-03 1.2814129e-08 3.8282328e-09 7.2252727e-01]
Word 17 score: [1.0000000e+00 4.8902498e-20 4.8902498e-20 4.8902498e-20 4.8902498e-20]
------
1244
popular
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restauranttype
Real slot label: B-restauranttype
Score: 
Word 0 score: [2.2829769e-03 1.3649684e-02 5.3744572e-03 9.7849405e-01 1.9893050e-04]
------
1245
how many guests are in your party ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
1246
4
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
1247
what time and date would you like your reservation for ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
1248
tonight at 8
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date O B-starttime
Real slot label: B-date O B-starttime
Score: 
Word 0 score: [5.5404066e-04 7.3151290e-03 9.8358226e-01 3.2404608e-07 8.5482858e-03]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
------
1249
the blue point , the little dip ##per , and cap ##rice bis ##tro are the 3 most popular restaurants in wilmington . would you like to book one of those or should i present additional options ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O B-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O B-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
Word 1 score: [9.3032271e-01 5.1463225e-08 3.1775562e-04 6.9341034e-02 1.8484063e-05]
Word 2 score: [2.6679089e-02 1.4451658e-03 8.4376894e-05 9.6997625e-01 1.8150918e-03]
Word 5 score: [1.6561055e-05 4.4586728e-03 9.9552453e-01 1.8209249e-08 2.6003133e-07]
Word 6 score: [2.4848336e-01 7.4530470e-01 5.7834023e-07 8.6692395e-05 6.1246087e-03]
Word 7 score: [3.0363020e-01 6.8904769e-01 5.6443730e-07 1.4019755e-04 7.1813185e-03]
Word 10 score: [4.2323619e-02 9.2035724e-04 9.5591789e-01 7.7549909e-04 6.2594023e-05]
Word 11 score: [0.48917344 0.00185896 0.00820148 0.4969422  0.00382391]
Word 12 score: [9.0146667e-01 9.5682412e-02 1.4074693e-05 2.8360658e-03 7.0379167e-07]
Word 13 score: [8.8132876e-01 1.1567885e-01 1.4709712e-05 2.9764096e-03 1.2467710e-06]
------
1250
the blue point
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O B-restaurantname I-restaurantname
Real slot label: O B-restaurantname I-restaurantname
Score: 
Word 1 score: [9.1253150e-01 3.3882199e-09 1.2384994e-04 8.7341785e-02 2.8694458e-06]
Word 2 score: [1.0496397e-02 9.1682211e-04 1.2046499e-04 9.8763299e-01 8.3328394e-04]
------
1251
i have successfully booked your reservation for the blue point at 8 ##pm tonight for 4 people . enjoy !
Predicted label: ['inform', 'closing']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O B-closing O
Real slot label: O O O O O O O O O O O O O O O O O O B-closing O
Score: 
Word 18 score: [3.0482642e-02 2.1190478e-02 9.4597125e-01 7.9776277e-05 2.2758693e-03]
------
1252
are any theaters in seattle playing whiskey tango fox ##tro ##t ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O B-city O O O O O O O
Real slot label: O O O O B-city O O O O O O O
Score: 
Word 4 score: [5.138035e-02 8.962665e-05 8.962457e-02 8.519170e-01 6.988384e-03]
------
1253
thank you for your request . you have reached the restaurant booking agent . can i help you book a restaurant instead ?
Predicted label: ['request', 'thanks']
Real label: ['thanks']
Predicted slot label: B-closing I-closing I-closing I-closing I-closing I-closing O O O O O O O O O O O O O O O O O
Real slot label: B-closing I-closing I-closing I-closing I-closing I-closing O O O O O O O O O O O O O O O O O
Score: 
Word 0 score: [4.2674717e-02 6.8023597e-05 9.3830949e-01 1.5447728e-02 3.5000374e-03]
Word 1 score: [9.0719587e-01 2.9242511e-03 6.6966657e-03 6.6953689e-05 8.3116293e-02]
Word 2 score: [2.2688853e-08 2.7201427e-06 5.3022330e-07 9.9993205e-01 6.4612570e-05]
Word 3 score: [1.0731439e-04 9.9899131e-01 9.0132677e-04 2.2361508e-11 2.2361508e-11]
Word 4 score: [1.9997312e-06 1.9526292e-02 9.0635693e-01 6.0733363e-02 1.3381463e-02]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
------
1254
hi
Predicted label: ['inform', 'thanks']
Real label: ['greeting']
Predicted slot label: B-greeting
Real slot label: B-greeting
Score: 
Word 0 score: [2.1139065e-05 4.8544034e-01 3.8860121e-03 4.8544034e-01 2.5212158e-02]
------
1255
hello ! would you like to make a restaurant reservation ?
Predicted label: ['request']
Real label: ['greeting', 'confirm_question']
Predicted slot label: B-greeting O O O O O O O O O O
Real slot label: B-greeting O O O O O O O O O O
Score: 
Word 0 score: [9.770009e-02 8.996324e-01 2.652305e-03 7.564029e-06 7.564029e-06]
------
1256
i would like reservations for a nice su ##shi restaurant in las vegas do you have any suggestions
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O B-restauranttype I-restauranttype O O B-city I-city O O O O O
Real slot label: O O O O O O O B-restauranttype I-restauranttype O O B-city I-city O O O O O
Score: 
Word 7 score: [4.1744639e-09 9.9986374e-01 8.3974455e-10 6.4045453e-06 1.2974562e-04]
Word 8 score: [1.6201105e-03 9.1082249e-05 1.9625541e-05 1.1940621e-02 9.8632854e-01]
Word 11 score: [2.0208072e-05 8.8939942e-07 8.3880812e-02 9.1576391e-01 3.3417539e-04]
Word 12 score: [1.000000e+00 4.218371e-12 4.218371e-12 4.218371e-12 4.218371e-12]
------
1257
i ' m happy to assist you ! how many guests are in your party ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O
Score: 
------
1258
2
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
1259
great , thanks ! i ' ll also need to know the date and time you wish to make a reservation so i can check availability .
Predicted label: ['request', 'thanks']
Real label: ['request', 'thanks']
Predicted slot label: O O B-closing O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O B-closing O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
Word 2 score: [5.0335244e-04 2.1541488e-01 7.2804725e-01 5.3126551e-02 2.9079192e-03]
------
1260
this weekend - 3 \ / 12 at 7 pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
1261
i found three restaurants you might like ! kat ##su ##ya , mars ##sa steak & su ##shi , and tides seafood & su ##shi bar . which would you like to book ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O
Real slot label: O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O
Score: 
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [9.6452177e-02 6.3488265e-10 1.0973631e-14 5.0658960e-11 9.0354788e-01]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [4.3703636e-07 8.6403757e-01 1.8356923e-08 1.3402277e-01 1.9391117e-03]
Word 17 score: [5.3318337e-07 7.7627313e-01 2.1664654e-08 2.2125641e-01 2.4698495e-03]
Word 20 score: [5.9838909e-15 2.9200530e-02 9.7079933e-01 1.1102094e-07 1.8519154e-13]
Word 21 score: [1.8262630e-04 5.1530595e-03 1.4407133e-03 6.9246198e-06 9.9321669e-01]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [2.1173535e-07 9.4597125e-01 1.1125872e-08 5.2628510e-02 1.4000153e-03]
Word 24 score: [3.8653201e-07 8.6574507e-01 1.6807775e-08 1.3219170e-01 2.0628278e-03]
Word 25 score: [6.2925494e-03 3.0102166e-07 5.7116704e-06 4.4211210e-03 9.8928040e-01]
------
1262
tides seafood & su ##shi bar
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [0.6451289  0.01558581 0.00339298 0.01476005 0.3211322 ]
Word 1 score: [8.2035709e-05 7.0048985e-03 1.7660593e-03 1.6773344e-06 9.9114531e-01]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [3.5366054e-07 9.2475951e-01 3.9513290e-09 6.9961354e-02 5.2788523e-03]
Word 4 score: [4.3944863e-07 8.7126857e-01 4.5644906e-09 1.2248943e-01 6.2415325e-03]
Word 5 score: [3.1494405e-03 1.0019208e-07 2.1041037e-06 2.5237103e-03 9.9432462e-01]
------
1263
great ! your reservation is confirmed at tides seafood and su ##shi bar !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 7 score: [7.1508689e-18 3.5486146e-04 9.9964511e-01 3.0782639e-09 1.1403356e-19]
Word 8 score: [4.731403e-05 6.289343e-03 8.859888e-04 5.634349e-07 9.927769e-01]
Word 9 score: [0.5302326  0.01935152 0.03411893 0.02778763 0.3885092 ]
Word 10 score: [7.4600656e-08 9.9626583e-01 9.8171216e-10 2.9918028e-03 7.4229925e-04]
Word 11 score: [7.60817670e-07 8.81417692e-01 3.05550629e-09 1.13285065e-01
 5.29647293e-03]
Word 12 score: [1.7017407e-03 2.5791222e-08 1.2340377e-06 1.0391942e-03 9.9725789e-01]
------
1264
i need the best mexican place that you can reserve in san francisco
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O B-food O O O O O O B-city I-city
Real slot label: O O O O B-food O O O O O O B-city I-city
Score: 
Word 4 score: [6.1887945e-08 3.8856274e-04 9.7488755e-06 4.5799835e-09 9.9960154e-01]
Word 11 score: [1.5934463e-06 3.5837522e-01 6.4162183e-01 1.1253843e-06 2.4357439e-07]
Word 12 score: [3.3830147e-04 3.8929869e-04 9.9926621e-01 6.2369136e-06 2.8029968e-12]
------
1265
what date would you like me to look ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
1266
this would be for two people on sunday
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-date
Real slot label: O O O O O O O B-date
Score: 
Word 7 score: [1.0848571e-08 1.4542401e-01 3.9184314e-07 7.6485389e-07 8.5457480e-01]
------
1267
great , what time would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
1268
i ' m pretty len ##ient as i mostly care about finding the best place , so the earliest time after 5 ##pm would be fine
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O B-starttime I-starttime O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O B-starttime I-starttime O O O
Score: 
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
------
1269
don ramon ' s mexican restaurant , mama ##cit ##a , and blue ag ##ave club are the three top rated mexican restaurants with availability at or just after 5 ##pm . which would you like to book ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O O O O O O
Score: 
Word 0 score: [4.19022490e-06 1.17105126e-04 9.38577712e-01 6.12033047e-02
 9.76033261e-05]
Word 1 score: [9.7016162e-01 2.6913830e-07 1.0562213e-02 2.0886442e-07 1.9275777e-02]
Word 2 score: [9.9914360e-01 8.0253230e-06 1.0134003e-07 2.4741325e-06 8.4582547e-04]
Word 3 score: [9.99049485e-01 7.82305506e-06 1.09634605e-07 2.47285698e-06
 9.40183236e-04]
Word 4 score: [1.8077142e-05 3.4288578e-02 2.1332698e-02 9.2168164e-01 2.2678934e-02]
Word 5 score: [2.0137277e-14 6.5385360e-01 2.5492972e-03 3.4359714e-01 8.3409857e-18]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [9.9924517e-01 1.3122700e-09 3.2775904e-05 7.2213862e-04 4.5654296e-08]
Word 13 score: [6.3133897e-04 9.9646866e-01 5.3008189e-06 2.8947301e-03 4.2698625e-13]
Word 14 score: [9.9733353e-01 9.4568371e-05 2.3596054e-03 2.1051241e-04 1.8115416e-06]
Word 15 score: [1.1566964e-05 1.4944096e-02 6.8015903e-01 3.0488527e-01 9.1100194e-10]
------
1270
blue ag ##ave club works just fine
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O
Score: 
Word 0 score: [9.7331053e-01 1.3864875e-09 1.0088752e-03 2.5678895e-02 1.7391422e-06]
Word 1 score: [3.4981736e-04 9.9628192e-01 3.5489841e-06 3.3647851e-03 2.1873037e-14]
Word 2 score: [9.9410146e-01 6.5009767e-04 4.1211843e-03 1.1269808e-03 2.1807183e-07]
Word 3 score: [1.2049834e-06 7.2184444e-04 7.1779531e-01 2.8148162e-01 7.5226644e-11]
------
1271
thank you so much for booking with us ! your reservation has been confirmed as requested . please enjoy your meal !
Predicted label: ['inform', 'thanks']
Real label: ['thanks']
Predicted slot label: O O O O O O O O O O O O O O O O O O B-closing I-closing I-closing O
Real slot label: O O O O O O O O O O O O O O O O O O B-closing I-closing I-closing O
Score: 
Word 18 score: [9.975005e-03 3.275361e-02 9.540911e-01 3.179665e-03 7.622106e-07]
Word 19 score: [5.0498147e-06 9.9599910e-01 3.9958353e-03 8.0347031e-17 8.0347031e-17]
Word 20 score: [1.0603336e-03 3.8754387e-04 2.0714492e-02 6.0043639e-01 3.7740120e-01]
------
1272
hello
Predicted label: ['greeting']
Real label: ['greeting']
Predicted slot label: B-greeting
Real slot label: B-greeting
Score: 
Word 0 score: [4.0650181e-03 9.9537271e-01 5.5657350e-04 2.7999151e-06 2.7999151e-06]
------
1273
hi , would you like to make a reservation ?
Predicted label: ['request']
Real label: ['greeting']
Predicted slot label: B-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting
Real slot label: B-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting
Score: 
Word 0 score: [1.9935721e-04 2.8419283e-01 8.5450560e-02 2.8419283e-01 3.4596440e-01]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.21294495 0.00218937 0.7822911  0.0011568  0.00141777]
Word 3 score: [8.5803688e-01 7.3563950e-03 2.6769678e-03 2.8389072e-04 1.3164596e-01]
Word 4 score: [5.3418092e-02 9.4403466e-04 1.4557117e-05 1.0968585e-01 8.3593744e-01]
Word 5 score: [3.1801466e-08 9.1197413e-05 9.9988031e-01 4.5354570e-10 2.8458560e-05]
Word 6 score: [1.4836727e-04 7.4293345e-01 1.1541274e-06 2.5691700e-01 7.3452192e-08]
Word 7 score: [0.54863274 0.03808654 0.25954604 0.11758117 0.03615355]
Word 8 score: [4.9481025e-01 4.2412071e-06 7.0038736e-06 4.8551097e-05 5.0512999e-01]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
------
1274
yes , a table for two at cr ##ave in akron ohio for next wednesday evening at 4 : 45 ##pm
Predicted label: ['inform']
Real label: ['request', 'confirm_answer']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname O B-city B-state O B-date I-date I-date O B-starttime I-starttime I-starttime I-starttime
Real slot label: O O O O O O O B-restaurantname I-restaurantname O B-city B-state O B-date I-date I-date O B-starttime I-starttime I-starttime I-starttime
Score: 
Word 7 score: [5.9608163e-05 3.6333845e-09 6.2695323e-03 9.9365389e-01 1.6935721e-05]
Word 8 score: [0.01600911 0.03566894 0.01038701 0.90174633 0.03618859]
Word 10 score: [2.2383544e-03 8.1670851e-02 2.8617056e-05 8.9067996e-01 2.5382234e-02]
Word 11 score: [1.1214581e-05 3.3136857e-05 4.9997050e-01 4.9997050e-01 1.4652567e-05]
Word 13 score: [5.0161261e-04 6.0284621e-04 8.9157503e-03 9.8989153e-01 8.8292654e-05]
Word 14 score: [8.9998916e-02 4.3313446e-09 7.1558774e-02 4.1922113e-01 4.1922113e-01]
Word 15 score: [0.04990163 0.03660399 0.03580534 0.64017224 0.23751679]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
------
1275
success ! i was able to book you a table for 2 at cr ##ave next wednesday at 4 : 45 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname O O O B-starttime I-starttime I-starttime I-starttime O
Real slot label: O O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname O O O B-starttime I-starttime I-starttime I-starttime O
Score: 
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [1.3848602e-04 4.5871942e-09 1.2798230e-02 9.8704755e-01 1.5724274e-05]
Word 14 score: [0.01361519 0.9588906  0.00146458 0.01405542 0.01197427]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
------
1276
is there a place that has memorabilia on the walls in wilmington , nc ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O B-city O B-state O
Real slot label: O O O O O O O O O O O B-city O B-state O
Score: 
Word 11 score: [8.0759339e-05 5.0376940e-07 2.8811662e-02 6.4427473e-02 9.0667963e-01]
Word 13 score: [1.0000000e+00 1.7158925e-09 1.7158925e-09 1.7158925e-09 1.7158925e-09]
------
1277
i ' m happy to assist you ! how many guests are in your party ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O
Score: 
------
1278
4
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
1279
when would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
1280
tonight
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date
Real slot label: B-date
Score: 
Word 0 score: [1.1605379e-03 1.8925164e-02 9.7056234e-01 5.1362076e-06 9.3468782e-03]
------
1281
what time would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
1282
8 ##pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-starttime I-starttime
Real slot label: B-starttime I-starttime
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
------
1283
unfortunately , i ca n ' t find anything with that specific criteria . perhaps you would like to try a sports bar ? they typically have memorabilia on the walls .
Predicted label: ['inform', 'confirm_question']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O B-restauranttype I-restauranttype O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O B-restauranttype I-restauranttype O O O O O O O O O
Score: 
Word 21 score: [8.6765620e-05 3.0282199e-01 4.6458989e-03 5.3297156e-01 1.5947375e-01]
Word 22 score: [5.2017730e-01 2.6651862e-04 5.7868239e-02 3.1850973e-01 1.0317821e-01]
------
1284
yes do sports bar
Predicted label: ['confirm_answer']
Real label: ['inform']
Predicted slot label: O O B-restauranttype I-restauranttype
Real slot label: O O B-restauranttype I-restauranttype
Score: 
Word 2 score: [5.0086664e-06 2.6952574e-01 4.2982483e-03 5.6879425e-01 1.5737680e-01]
Word 3 score: [4.3837073e-01 3.9885740e-04 5.3502442e-03 7.5973548e-02 4.7990665e-01]
------
1285
i can not find any sports bars in the wilmington area available for reservation on open ##table . would you like to try a different area or one of wilmington ' s top rated restaurants such as 22 north or the blue point ?
Predicted label: ['inform', 'confirm_question']
Real label: ['request', 'inform']
Predicted slot label: O O O O O B-restauranttype I-restauranttype B-distanceconstraints I-distanceconstraints I-distanceconstraints I-distanceconstraints O O O O O O O O O O O O O O O O O O B-city I-city I-city B-rating I-rating O O O B-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O O B-restauranttype I-restauranttype B-distanceconstraints I-distanceconstraints I-distanceconstraints I-distanceconstraints O O O O O O O O O O O O O O O O O O B-city I-city I-city B-rating I-rating O O O B-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 5 score: [8.1583319e-05 2.1151936e-01 3.1065543e-03 4.8692504e-01 2.9836750e-01]
Word 6 score: [6.9435373e-07 4.5505320e-03 1.6447004e-05 4.8384868e-06 9.9542737e-01]
Word 7 score: [5.0953142e-10 3.2647193e-08 4.4516415e-11 7.0285899e-10 1.0000000e+00]
Word 8 score: [3.5802374e-04 2.9984508e-03 9.9663585e-01 2.6950845e-06 5.0355707e-06]
Word 9 score: [3.1755463e-04 2.0198345e-06 1.7713372e-02 2.1141538e-02 9.6082562e-01]
Word 10 score: [2.9842820e-04 1.4939123e-05 1.5308183e-04 3.1847311e-03 9.9634874e-01]
Word 29 score: [5.6485168e-04 3.6998010e-06 4.9996860e-02 1.9910604e-02 9.2952394e-01]
Word 30 score: [9.9950564e-01 3.9485318e-04 8.2612059e-06 6.8066520e-06 8.4443214e-05]
Word 31 score: [9.8799370e-05 9.9950647e-01 4.0832583e-07 5.7629048e-05 3.3668065e-04]
Word 32 score: [1.7737838e-07 1.6794336e-06 1.5727478e-07 4.9999899e-01 4.9999899e-01]
Word 33 score: [3.7947598e-01 7.3838010e-03 2.2187628e-06 8.6128182e-07 6.1313719e-01]
Word 37 score: [0.2 0.2 0.2 0.2 0.2]
Word 38 score: [8.2944494e-01 1.6843162e-01 2.3304476e-06 2.8314319e-04 1.8379038e-03]
Word 40 score: [4.9405536e-03 1.3907332e-02 9.8087156e-01 5.3930413e-05 2.2665356e-04]
Word 41 score: [8.6862636e-01 2.7863010e-09 9.9039156e-05 1.3126858e-01 6.1318510e-06]
Word 42 score: [4.2731958e-03 8.7054423e-04 3.2104323e-05 9.9357527e-01 1.2488654e-03]
------
1286
22 north
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [9.4957346e-01 5.0091881e-02 9.8863289e-08 5.9185209e-06 3.2863932e-04]
------
1287
i have successfully completed your reservation at 22 north for tonight at 8 ##pm ! enjoy !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname O B-date O B-starttime I-starttime O B-closing O
Real slot label: O O O O O O O B-restaurantname I-restaurantname O B-date O B-starttime I-starttime O B-closing O
Score: 
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [4.5642236e-04 9.2354345e-01 6.6528931e-02 6.2357257e-03 3.2353667e-03]
Word 10 score: [3.4072081e-04 1.2393039e-01 1.8568091e-02 7.9204816e-05 8.5708159e-01]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [1.1720259e-01 1.2808307e-02 8.6756396e-01 7.7993413e-05 2.3470435e-03]
------
1288
looking for a view of a gold course for 4 in wilmington , nc
Predicted label: ['request']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O B-city O O
Real slot label: O O O O O O O O O O O B-city O O
Score: 
Word 11 score: [5.3187072e-05 4.9272768e-07 1.6365426e-02 7.7313229e-02 9.0626770e-01]
------
1289
i can not find any restaurants available for booking with a view of a golf course . would you like to search for something else ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1290
view of the river
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restauranttype I-restauranttype I-restauranttype I-restauranttype
Real slot label: B-restauranttype I-restauranttype I-restauranttype I-restauranttype
Score: 
Word 0 score: [2.4980006e-03 1.4657481e-03 4.0895697e-01 5.8701962e-01 5.9623366e-05]
Word 1 score: [9.9842632e-01 3.6087637e-05 2.0316365e-04 1.9547825e-04 1.1389283e-03]
Word 2 score: [3.0955130e-06 2.3651075e-01 7.5641590e-01 1.4283854e-06 7.0688236e-03]
Word 3 score: [5.6043779e-09 9.9653840e-01 2.5344221e-08 3.4580796e-03 3.5611010e-06]
------
1291
i found a few options for you : 1 ) harry ' s seafood is on the river , as is iron hill brewery . i ' m unable to book a specific table , but i ' d be happy to secure a reservation at either of those for you .
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
Word 21 score: [9.9860877e-01 2.1575470e-05 8.4815058e-04 5.1303400e-04 8.4568301e-06]
Word 22 score: [1.5732031e-06 6.1949231e-07 1.2611596e-01 4.5002285e-05 8.7383682e-01]
Word 23 score: [2.1347979e-03 9.1212445e-01 8.5149132e-02 5.9123500e-04 4.1957693e-07]
------
1292
is this in north carolina ?
Predicted label: ['request']
Real label: ['inform']
Predicted slot label: O O O B-state I-state O
Real slot label: O O O B-state I-state O
Score: 
Word 3 score: [4.0476624e-07 9.6689498e-01 3.3092018e-02 1.1452649e-05 1.1989820e-06]
Word 4 score: [6.5048313e-05 3.0609310e-05 1.0977902e-06 2.4641849e-05 9.9987853e-01]
------
1293
i ' m sorry , let ' s find you a restaurant in the correct location . what day would you like to go ?
Predicted label: ['request', 'inform']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1294
3 \ / 12 \ / 2016
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date I-date I-date I-date I-date I-date I-date
Real slot label: B-date I-date I-date I-date I-date I-date I-date
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
------
1295
what time would you like your reservation for ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
1296
8 ##pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-starttime I-starttime
Real slot label: B-starttime I-starttime
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
------
1297
do you have a cuisine in mind ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
1298
it ##iol ##ian
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-cuisine I-cuisine I-cuisine
Real slot label: B-cuisine I-cuisine I-cuisine
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
------
1299
i found the following italian restaurants available for booking for you : au ##bria ##na ' s fine dining , os ##ter ##ia ci ##cc ##hett ##i , angelo ' s pi ##zz ##eria & bis ##tro only au ##bria ##na ' s has river ##view seating available .
Predicted label: ['inform']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O B-restauranttype I-restauranttype O O O
Real slot label: O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O B-restauranttype I-restauranttype O O O
Score: 
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [9.9845183e-01 5.2702062e-06 3.5538321e-06 4.9779055e-06 1.5343607e-03]
Word 16 score: [9.92121577e-01 1.87492144e-04 3.01200134e-06 1.12339285e-05
 7.67684355e-03]
Word 17 score: [7.4716651e-09 1.2959162e-02 1.4060904e-08 8.3891249e-01 1.4812826e-01]
Word 18 score: [1.0070152e-04 3.5811161e-05 8.6806633e-02 9.1305679e-01 8.7468173e-08]
Word 20 score: [9.9999952e-01 4.5770426e-07 2.8422358e-12 2.8422358e-12 2.8422358e-12]
Word 21 score: [9.999962e-01 3.821204e-06 1.628938e-19 1.628938e-19 1.628938e-19]
Word 22 score: [9.9589866e-01 4.1012825e-03 8.8288399e-10 8.8288399e-10 8.8288399e-10]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
Word 26 score: [0.2 0.2 0.2 0.2 0.2]
Word 28 score: [0.2 0.2 0.2 0.2 0.2]
Word 29 score: [8.4215909e-01 2.0439977e-04 1.2036154e-01 8.2776148e-04 3.6447272e-02]
Word 30 score: [9.9983692e-01 1.4935712e-07 1.6897404e-08 8.1768906e-07 1.6205816e-04]
Word 31 score: [1.0870499e-18 1.1000669e-15 2.7803543e-01 4.6096968e-18 7.2196454e-01]
Word 32 score: [1.5220934e-18 1.0083839e-15 1.7969863e-01 5.2797776e-18 8.2030141e-01]
Word 33 score: [1.2728290e-18 8.5299781e-16 1.8228561e-01 4.3883234e-18 8.1771439e-01]
Word 34 score: [0.2 0.2 0.2 0.2 0.2]
Word 35 score: [7.6148993e-01 2.2754657e-01 2.0716017e-05 1.0941709e-02 1.0894208e-06]
Word 36 score: [8.1463915e-01 1.7560136e-01 2.0091480e-05 9.7385505e-03 8.5823223e-07]
Word 44 score: [0.2 0.2 0.2 0.2 0.2]
Word 45 score: [0.2 0.2 0.2 0.2 0.2]
------
1300
au ##bria ##na ' s fine dining
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [9.9981076e-01 8.1090647e-08 4.4533362e-08 4.7783823e-07 1.8872769e-04]
Word 4 score: [9.9969351e-01 2.6378839e-07 3.7853734e-08 6.9921015e-07 3.0555829e-04]
Word 5 score: [2.1751311e-11 4.7898164e-05 1.2332444e-08 7.9237634e-01 2.0757568e-01]
Word 6 score: [1.0694301e-04 3.8301248e-05 1.8528783e-03 9.9800187e-01 1.6901605e-10]
------
1301
i ' ve confirmed your reservation for au ##bria ##na ' s on 03 / 12 / 2016 at 8 ##pm , enjoy your meal .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O B-date I-date I-date I-date I-date O B-starttime I-starttime O B-closing I-closing I-closing O
Real slot label: O O O O O O O O O O O O O B-date I-date I-date I-date I-date O B-starttime I-starttime O B-closing I-closing I-closing O
Score: 
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [3.1834081e-01 7.3062722e-03 6.0002458e-01 2.5784739e-05 7.4302562e-02]
Word 23 score: [3.1013522e-05 9.9685127e-01 3.1177248e-03 1.9306172e-19 1.9306172e-19]
Word 24 score: [6.8071327e-05 5.6217791e-06 2.5595064e-04 7.9753947e-01 2.0213090e-01]
------
1302
are there any sports events taking place in charlotte ##sville va this weekend ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O B-city I-city I-city O B-date O
Real slot label: O O O O O O O O B-city I-city I-city O B-date O
Score: 
Word 8 score: [1.2232726e-06 8.1845421e-01 2.2388321e-04 1.6903712e-01 1.2283581e-02]
Word 9 score: [2.1750944e-02 1.1049274e-03 1.4134784e-05 1.4229806e-02 9.6290028e-01]
Word 10 score: [1.1582943e-04 4.9950352e-01 6.9133023e-04 1.8589484e-04 4.9950352e-01]
Word 12 score: [9.97577131e-01 4.73066253e-09 1.29341402e-06 1.45340155e-05
 2.40704906e-03]
------
1303
i have only learned to search , book and answer questions about restaurants so far . can i help you with reservations ?
Predicted label: ['confirm_question']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1304
yes . what is the top rated restaurant in charlotte ##sville va ?
Predicted label: ['request']
Real label: ['request', 'confirm_answer']
Predicted slot label: O O O O O B-rating I-rating O O B-city I-city B-state O
Real slot label: O O O O O B-rating I-rating O O B-city I-city B-state O
Score: 
Word 5 score: [6.9797957e-06 9.1728346e-08 4.9267008e-09 4.9999642e-01 4.9999642e-01]
Word 6 score: [8.9339072e-01 7.5396406e-04 3.7889603e-10 2.9530451e-11 1.0585541e-01]
Word 9 score: [4.6857604e-06 7.7370936e-01 1.7409255e-04 2.1403942e-01 1.2072354e-02]
Word 10 score: [9.7299755e-02 9.4421790e-04 1.9608880e-05 1.5417829e-02 8.8631856e-01]
Word 11 score: [2.3536841e-04 4.9755865e-01 4.4203964e-03 2.2688582e-04 4.9755865e-01]
------
1305
here are the top 3 restaurants in charlotte ##sville , va : the ivy inn restaurant , downtown grille , bella ' s restaurant .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 12 score: [9.3260422e-02 1.9480184e-02 8.8717753e-01 2.2750946e-05 5.9103157e-05]
Word 13 score: [4.5666468e-01 5.4321271e-01 1.2197924e-04 3.2386507e-07 3.2386507e-07]
Word 14 score: [3.97198573e-06 3.00202752e-03 1.16094045e-04 3.00202752e-03
 9.93875802e-01]
Word 15 score: [1.5596368e-13 6.4583790e-01 4.8190849e-03 3.4934300e-01 1.3724951e-16]
Word 17 score: [1.2814510e-08 9.9999988e-01 1.9222674e-11 6.3282741e-08 1.9191029e-10]
Word 18 score: [1.19381545e-11 3.08047232e-09 9.99986410e-01 1.32763444e-05
 3.99335647e-07]
Word 20 score: [9.8279935e-01 3.3278579e-07 7.9222334e-10 3.0047190e-08 1.7200287e-02]
Word 21 score: [0.5609694  0.0330827  0.22864468 0.00518258 0.17212063]
Word 22 score: [9.9969184e-01 8.9516027e-07 9.3595451e-09 6.7611109e-07 3.0664142e-04]
Word 23 score: [3.9215664e-14 7.4297911e-01 3.6644114e-03 2.5335646e-01 7.5295935e-17]
------
1306
can you make me a reservation at bella ##s for tomorrow night ? 2 people , 7 : 30 ##pm
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname O B-date I-date O B-numberofpeople O O B-starttime I-starttime I-starttime I-starttime
Real slot label: O O O O O O O B-restaurantname I-restaurantname O B-date I-date O B-numberofpeople O O B-starttime I-starttime I-starttime I-starttime
Score: 
Word 7 score: [2.2846167e-03 9.9771512e-01 8.2436777e-08 8.2436777e-08 8.2436777e-08]
Word 8 score: [9.3735266e-01 6.2646359e-02 3.2620403e-07 3.2620403e-07 3.2620403e-07]
Word 10 score: [6.5043932e-01 3.1212229e-01 1.7662713e-07 1.7941586e-06 3.7436515e-02]
Word 11 score: [1.6703664e-11 5.0000000e-01 2.0434553e-11 5.0000000e-01 8.3025987e-14]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
------
1307
i have booked your reservation . thank you and enjoy your dinner .
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O
Score: 
------
1308
i would like a restaurant in seattle on march 20th at 5 pm for 3 people .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O B-city O B-date I-date O O O O B-numberofpeople O O
Real slot label: O O O O O O B-city O B-date I-date O O O O B-numberofpeople O O
Score: 
Word 6 score: [1.4621560e-01 5.7226920e-04 7.3827326e-02 7.7897263e-01 4.1213108e-04]
Word 8 score: [7.3496990e-06 8.8325894e-01 5.7021473e-02 2.8740583e-02 3.0971600e-02]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
------
1309
sure ! do you have a preference on cuisine or price range ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O
Score: 
------
1310
20 to 40 per person
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
1311
okay . is there any particular cuisine you would like ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
1312
seafood
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-cuisine
Real slot label: B-cuisine
Score: 
Word 0 score: [2.5082973e-04 9.9948597e-01 2.1665930e-04 2.0841715e-05 2.5700076e-05]
------
1313
i found the following restaurants that match your requirements : ag ##ave co ##cina & tequila ##s - seattle , bran ##zin ##o restaurant , ely ##sian bar .
Predicted label: ['inform', 'multiple_choice']
Real label: ['multiple_choice']
Predicted slot label: O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 10 score: [5.0946040e-04 2.4933936e-03 6.8157824e-05 9.9692875e-01 1.9483288e-07]
Word 11 score: [1.9288098e-03 9.9590236e-01 5.7844238e-05 2.1110182e-03 4.0883161e-11]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [1.43170619e-04 6.25156531e-07 9.99856234e-01 1.09294795e-10
 1.09294795e-10]
Word 21 score: [9.9280626e-01 4.7657281e-04 6.7171566e-03 3.6647780e-09 3.6647780e-09]
Word 22 score: [0.01972812 0.5333876  0.44518453 0.0008499  0.0008499 ]
Word 23 score: [1.1088713e-13 6.9072425e-01 2.7628534e-03 3.0651286e-01 1.5481032e-15]
Word 25 score: [0.08013245 0.81768554 0.00438566 0.08013245 0.01766389]
Word 26 score: [0.01536361 0.22864881 0.00328379 0.01536361 0.7373403 ]
Word 27 score: [1.3218300e-02 5.3113479e-07 1.0300731e-05 1.3460343e-02 9.7331053e-01]
------
1314
ag ##ave co ##cina & tequila ##s - seattle
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [1.7469183e-02 9.7195993e-09 2.1305722e-03 3.6760529e-08 9.8040020e-01]
Word 1 score: [8.0124027e-04 9.9373782e-01 1.6378177e-05 5.4445737e-03 1.0657952e-12]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
------
1315
success ! i was able to book you a table for 3 at ag ##ave co ##cina & tequila ##s - seattle on 3 / 20 at 5 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O
Real slot label: O O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O
Score: 
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [1.0290148e-03 3.3845222e-03 1.1928568e-04 9.9546576e-01 1.3810144e-06]
Word 14 score: [2.2528753e-04 9.9770170e-01 6.9804769e-06 2.0660590e-03 3.3761361e-14]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
Word 27 score: [0.2 0.2 0.2 0.2 0.2]
Word 28 score: [0.2 0.2 0.2 0.2 0.2]
------
1316
i would like a seafood restaurant in seattle on march 20th at 6 pm for 3 people .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O B-restauranttype O O B-city O B-date I-date O B-starttime I-starttime O B-numberofpeople O O
Real slot label: O O O O B-restauranttype O O B-city O B-date I-date O B-starttime I-starttime O B-numberofpeople O O
Score: 
Word 4 score: [4.8092088e-06 7.0027886e-03 1.4580784e-03 1.1031419e-06 9.9153310e-01]
Word 7 score: [3.0998584e-02 7.3370204e-05 3.6629345e-02 9.2210656e-01 1.0192188e-02]
Word 9 score: [4.8809197e-06 7.3113024e-01 1.7007190e-01 5.3750068e-02 4.5042913e-02]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [6.1205924e-06 4.8114106e-01 5.1885217e-01 5.8488240e-07 3.7036809e-08]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
------
1317
hello , do you have a price range in mind ?
Predicted label: ['request']
Real label: ['request', 'greeting']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
1318
no
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O
Real slot label: O
Score: 
------
1319
here are three restaurants that i found . do any of these interest you : 1 ) elliott ' s oyster house , 2 ) the brooklyn seafood , steak & oyster house , 3 ) et ##ta ' s seafood ?
Predicted label: ['multiple_choice']
Real label: ['multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 17 score: [7.8827757e-01 2.3687907e-02 1.8802735e-01 3.6010601e-06 3.6010601e-06]
Word 18 score: [0.19721943 0.01452567 0.23621146 0.01188195 0.54016155]
Word 19 score: [9.9125189e-01 8.7956523e-06 9.3324893e-08 2.2356244e-05 8.7167704e-03]
Word 20 score: [8.7547785e-01 1.1872918e-01 5.3508715e-03 4.0999659e-08 4.4196023e-04]
Word 21 score: [0.00510866 0.78510034 0.0109512  0.1667154  0.0321244 ]
Word 25 score: [4.9652889e-02 2.5359525e-03 9.4770533e-01 8.2128659e-05 2.3750159e-05]
Word 26 score: [6.3672564e-06 2.2570794e-06 7.8939301e-01 1.9202529e-01 1.8573031e-02]
Word 27 score: [9.3148038e-04 6.9996148e-01 2.9817864e-01 6.8523776e-04 2.4316282e-04]
Word 28 score: [0.2 0.2 0.2 0.2 0.2]
Word 29 score: [1.6322362e-01 3.8148675e-09 1.7375854e-13 6.2510441e-10 8.3677638e-01]
Word 30 score: [0.2 0.2 0.2 0.2 0.2]
Word 31 score: [8.7038493e-01 1.2451309e-01 4.7023380e-03 4.3309075e-08 3.9971163e-04]
Word 32 score: [0.00528477 0.7914997  0.01113068 0.16218919 0.02989573]
Word 36 score: [9.9551129e-01 4.4317702e-03 1.9025556e-05 1.9025556e-05 1.9025556e-05]
Word 37 score: [8.2137072e-01 1.7862935e-01 2.7837250e-09 2.7837250e-09 2.7837250e-09]
Word 38 score: [9.9374169e-01 1.0280037e-05 5.1068834e-08 1.7737868e-05 6.2302402e-03]
Word 39 score: [9.9308985e-01 1.1574569e-05 6.0938632e-08 1.8922547e-05 6.8794694e-03]
Word 40 score: [9.9016773e-04 6.8251377e-01 3.1546640e-01 7.2553777e-04 3.0413427e-04]
Word 41 score: [0.2 0.2 0.2 0.2 0.2]
------
1320
et ##ta ' s seafood
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [0.01281774 0.0031933  0.3279963  0.3279963  0.3279963 ]
Word 1 score: [9.2544127e-01 7.4558668e-02 5.2539185e-13 5.2539185e-13 5.2539185e-13]
Word 2 score: [9.9789572e-01 1.1274962e-05 1.2204146e-07 6.1379646e-06 2.0867798e-03]
Word 3 score: [9.9781942e-01 1.5867219e-05 1.1356098e-07 6.4455116e-06 2.1580900e-03]
Word 4 score: [1.4455490e-04 8.8347459e-01 1.1468113e-01 2.1063555e-05 1.6786485e-03]
------
1321
success ! i was able to book you a table for 3 at et ##ta ' s seafood on 3 / 20 at 6 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O
Real slot label: O O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O
Score: 
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [9.9963176e-01 3.6821331e-04 1.4552239e-08 1.4552239e-08 1.4552239e-08]
Word 14 score: [9.3204904e-01 6.7950971e-02 5.9688669e-13 5.9688669e-13 5.9688669e-13]
Word 15 score: [9.9912804e-01 4.4733029e-06 4.7272593e-08 2.5547736e-06 8.6488796e-04]
Word 16 score: [9.9904698e-01 5.0743865e-06 4.4287322e-08 2.2975983e-06 9.4564090e-04]
Word 17 score: [1.07773616e-04 9.00709152e-01 9.78965908e-02 1.37806901e-05
 1.27270306e-03]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
------
1322
i would like to book an chinese restaurant in seattle on 03 / 16 / 16 at 1 : 30 ##pm for 2 people
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O B-restauranttype I-restauranttype O O O B-date I-date I-date I-date I-date O B-starttime I-starttime I-starttime I-starttime O B-numberofpeople O
Real slot label: O O O O O O B-restauranttype I-restauranttype O O O B-date I-date I-date I-date I-date O B-starttime I-starttime I-starttime I-starttime O B-numberofpeople O
Score: 
Word 6 score: [9.8416740e-01 3.7813417e-05 9.7650144e-04 1.4771326e-02 4.6882167e-05]
Word 7 score: [5.6566537e-04 3.6420021e-02 6.7605639e-01 2.8695786e-01 6.3853911e-14]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
------
1323
here are three restaurants that i found . do any of these interest you : 1 ) wild ginger asian restaurant , 2 ) ming china bis ##tro , 3 ) wild ginger at the brave ##rn ?
Predicted label: ['multiple_choice']
Real label: ['multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 24 score: [9.9751067e-01 5.5883382e-05 1.2699363e-07 2.4333706e-03 1.6156825e-08]
Word 25 score: [8.3688494e-05 1.1358678e-06 9.4409734e-01 5.5671927e-02 1.4585277e-04]
Word 26 score: [9.7709912e-01 2.1771329e-02 1.5711634e-05 1.1135120e-03 3.0355170e-07]
Word 27 score: [9.8243630e-01 1.6728435e-02 1.0773987e-05 8.2425436e-04 2.5367098e-07]
Word 31 score: [0.00073668 0.2522993  0.06736518 0.51589406 0.1637048 ]
Word 32 score: [3.23347479e-01 1.19644813e-02 1.04360765e-07 2.61884145e-02
 6.38499498e-01]
Word 33 score: [0.01800462 0.00189838 0.01770285 0.95992965 0.00246451]
Word 34 score: [0.00807971 0.0224815  0.09853192 0.07407785 0.79682904]
Word 35 score: [0.2 0.2 0.2 0.2 0.2]
Word 36 score: [0.2 0.2 0.2 0.2 0.2]
------
1324
2
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
1325
i have successfully completed your reservation at ming china bis ##tro for 2 people on 3 / 16 / 16 at 1 : 30 ##pm . enjoy !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-numberofpeople O O B-date I-date I-date I-date I-date O B-starttime I-starttime I-starttime I-starttime O B-closing O
Real slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-numberofpeople O O B-date I-date I-date I-date I-date O B-starttime I-starttime I-starttime I-starttime O B-closing O
Score: 
Word 7 score: [9.8565245e-01 1.0321119e-04 2.7631627e-06 1.4241487e-02 1.3827365e-08]
Word 8 score: [2.0160656e-04 4.8900027e-05 6.7762125e-01 3.2197273e-01 1.5548758e-04]
Word 9 score: [9.1875160e-01 7.7057190e-02 5.1884763e-05 4.1388362e-03 3.9916259e-07]
Word 10 score: [9.4511372e-01 5.2321192e-02 2.8197033e-05 2.5367255e-03 2.5211210e-07]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 26 score: [1.1211062e-01 1.0302650e-02 8.7178260e-01 3.1807551e-05 5.7723005e-03]
------
1326
i want to book a restaurant by the water in seattle tonight for 2 people at 8 ##pm
Predicted label: ['request']
Real label: ['inform']
Predicted slot label: O O O O O O B-restauranttype I-restauranttype I-restauranttype O B-city B-date O B-numberofpeople O O B-starttime I-starttime
Real slot label: O O O O O O B-restauranttype I-restauranttype I-restauranttype O B-city B-date O B-numberofpeople O O B-starttime I-starttime
Score: 
Word 6 score: [3.1032485e-01 4.4250807e-09 7.0094720e-06 6.8870908e-01 9.5907686e-04]
Word 7 score: [1.8028684e-05 8.2940346e-01 1.3049734e-01 1.0324744e-05 4.0070914e-02]
Word 8 score: [6.2560171e-01 5.6450700e-10 3.1170779e-01 2.7353293e-13 6.2690571e-02]
Word 10 score: [1.2986699e-01 1.3819477e-04 3.1455654e-01 5.5308735e-01 2.3509481e-03]
Word 11 score: [4.9547171e-03 9.5199955e-01 9.8479949e-03 3.2614175e-02 5.8353972e-04]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
------
1327
un ##for ##nu ##nate ##ly i can not find any restaurants i can book matching your request .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O
Score: 
------
1328
what is the reason ? is it time or you do not know the restaurants by the water ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O
Score: 
------
1329
i am sorry to hear that .
Predicted label: ['inform']
Real label: ['Deny']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
1330
your response does not make any sense . . .
Predicted label: ['confirm_question', 'confirm_answer']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
1331
un ##for ##nu ##nate ##ly i can not find any restaurants i can book matching your request .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O
Score: 
------
1332
ok , thanks . maybe next time . . .
Predicted label: ['confirm_answer', 'thanks']
Real label: ['thanks']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
1333
thank you for using our service , goodbye
Predicted label: ['confirm_answer', 'thanks']
Real label: ['thanks']
Predicted slot label: B-closing I-closing I-closing I-closing I-closing I-closing O O
Real slot label: B-closing I-closing I-closing I-closing I-closing I-closing O O
Score: 
Word 0 score: [0.39408675 0.00057822 0.50688297 0.05165472 0.04679733]
Word 1 score: [5.9688956e-01 9.5831184e-03 2.0454533e-02 3.6864326e-04 3.7270412e-01]
Word 2 score: [2.8326409e-07 2.1680255e-04 1.3181129e-04 9.9939740e-01 2.5372228e-04]
Word 3 score: [1.6632352e-02 2.2171151e-04 1.6632352e-02 9.6651357e-01 5.8221813e-14]
Word 4 score: [3.0661109e-08 2.9359313e-02 4.1392311e-01 1.4370842e-01 4.1300911e-01]
Word 5 score: [1.3749412e-03 1.0438481e-06 6.7399855e-04 2.4983249e-04 9.9770027e-01]
------
1334
i need a recommendation for the cheap ##est restaurant in la that is wheelchair accessible on monday . there ' s 2 of us , and we ' re okay with any time between 2 ##pm and 4 ##pm
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O B-pricing I-pricing O O B-city O O O O O B-date O O O O B-numberofpeople O O O O O O O O O O O B-starttime I-starttime I-starttime I-starttime I-starttime I-starttime
Real slot label: O O O O O O B-pricing I-pricing O O B-city O O O O O B-date O O O O B-numberofpeople O O O O O O O O O O O B-starttime I-starttime I-starttime I-starttime I-starttime I-starttime
Score: 
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [9.1220987e-01 6.8371110e-06 6.8679343e-05 1.3263969e-04 8.7581873e-02]
Word 16 score: [5.6340385e-05 2.0836145e-05 9.8900652e-01 5.4581519e-03 5.4581519e-03]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 33 score: [4.5658345e-07 6.1442405e-02 3.1807635e-02 9.0655303e-01 1.9648080e-04]
Word 34 score: [0.2 0.2 0.2 0.2 0.2]
Word 35 score: [0.2 0.2 0.2 0.2 0.2]
Word 36 score: [1.6710421e-02 1.3972649e-03 7.5061084e-06 3.2677486e-05 9.8185217e-01]
Word 37 score: [0.2 0.2 0.2 0.2 0.2]
Word 38 score: [0.2 0.2 0.2 0.2 0.2]
------
1335
hi . do you have a type of cuisine in mind ?
Predicted label: ['request', 'greeting']
Real label: ['request', 'greeting']
Predicted slot label: B-greeting O O O O O O O O O O O
Real slot label: B-greeting O O O O O O O O O O O
Score: 
Word 0 score: [6.2899337e-05 1.1294133e-02 1.0418087e-02 1.1294133e-02 9.6693069e-01]
------
1336
american would be great
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-cuisine O O O
Real slot label: B-cuisine O O O
Score: 
Word 0 score: [5.2026091e-03 8.6714998e-02 4.4483491e-03 9.0363282e-01 1.1791697e-06]
------
1337
here are some recommendations for you : 1 ) carbon beach club restaurant , 2 ) hey 19 public house , or 3 ) geoffrey ' s restaurant . would you like to try one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 9 score: [3.5603792e-10 9.9999952e-01 9.6747686e-11 4.4544515e-07 6.9200712e-09]
Word 10 score: [5.8453582e-02 1.7048127e-05 7.9145378e-01 7.8132562e-03 1.4226244e-01]
Word 11 score: [5.5817759e-06 1.7179504e-02 1.8915711e-01 7.9365778e-01 1.0672235e-08]
Word 12 score: [7.7565294e-14 6.0115325e-01 2.9158245e-03 3.9593092e-01 5.1023084e-17]
Word 16 score: [2.0045436e-04 2.6887392e-03 1.7656335e-03 1.5733896e-05 9.9532950e-01]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [6.7497444e-06 8.5098200e-06 2.0992610e-10 1.1057063e-12 9.9998474e-01]
Word 19 score: [0.0057637  0.9066854  0.00120665 0.06611596 0.02022821]
Word 24 score: [1.6199015e-02 9.8305327e-01 7.4766524e-04 8.5033673e-12 8.5033673e-12]
Word 25 score: [0.45237112 0.01478301 0.352045   0.00201743 0.17878346]
Word 26 score: [9.9887675e-01 4.9834257e-06 3.8733639e-08 1.0661447e-06 1.1172137e-03]
Word 27 score: [1.8045730e-14 7.2870290e-01 1.7291958e-03 2.6956791e-01 3.4230557e-17]
------
1338
2
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-choice
Real slot label: B-choice
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
1339
there are tables available at 2 and 2 : 15 pm . which would you like ?
Predicted label: ['inform', 'confirm_question']
Real label: ['multiple_choice']
Predicted slot label: O O O O O B-starttime O O O O O O O O O O O
Real slot label: O O O O O B-starttime O O O O O O O O O O O
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
------
1340
0 . 09 ##37 ##5
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
1341
i ' ve made your reservation at hey 19 public house . thank you .
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-closing I-closing O
Real slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-closing I-closing O
Score: 
Word 7 score: [1.8080043e-05 3.1657332e-06 6.6440866e-06 2.4031362e-06 9.9996960e-01]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [2.9066304e-02 1.3657436e-03 2.8787272e-07 5.6032951e-10 9.6956772e-01]
Word 10 score: [1.7226115e-02 9.0434885e-01 5.7502900e-04 6.4080216e-02 1.3769790e-02]
Word 12 score: [3.1046062e-03 6.8908258e-07 9.9676239e-01 3.2723957e-10 1.3224036e-04]
Word 13 score: [1.0315978e-01 1.1171807e-03 1.2332622e-02 3.0381023e-04 8.8308668e-01]
------
1342
book the tilted ki ##lt in wilmington , nc for friday night at 7 ##pm for a party of 3
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O B-city O B-state O B-date I-date O B-starttime I-starttime O O O O B-numberofpeople
Real slot label: O O O O O O B-city O B-state O B-date I-date O B-starttime I-starttime O O O O B-numberofpeople
Score: 
Word 6 score: [8.2928440e-05 7.3464008e-07 2.3921404e-02 7.4866720e-02 9.0112811e-01]
Word 8 score: [1.00000000e+00 1.07260874e-10 1.07260874e-10 1.07260874e-10
 1.07260874e-10]
Word 10 score: [1.9054422e-01 2.9165763e-03 2.0597996e-04 8.0264050e-01 3.6927112e-03]
Word 11 score: [1.2621622e-12 5.0000000e-01 1.5824661e-12 5.0000000e-01 1.0886689e-15]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
------
1343
what name would you like to book the reservation under ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
1344
basket weaver
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname I-personfullname
Real slot label: B-personfullname I-personfullname
Score: 
Word 0 score: [1.6593075e-04 1.2225930e-09 7.9741149e-04 2.9150205e-04 9.9874508e-01]
Word 1 score: [1.5623339e-02 3.3069500e-06 9.6578395e-01 6.3034456e-04 1.7959082e-02]
------
1345
your reservation is confirmed ! please enjoy your meal , and thank you for using our service .
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O
Score: 
------
1346
looking for jamaican food in southeastern area of north carolina
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O B-food O O O O O O O
Real slot label: O O B-food O O O O O O O
Score: 
Word 2 score: [2.2764728e-09 9.9991035e-01 2.5682315e-05 3.8222188e-05 2.5682315e-05]
------
1347
how many are going ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
1348
4
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
1349
what date would you like me to look ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
1350
3 \ / 12 \ / 2016
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
1351
what time would you like me to search for ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
1352
7 ##pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-starttime I-starttime
Real slot label: B-starttime I-starttime
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
------
1353
can you provide a city for me to look for a restaurant ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O
Score: 
------
1354
wilmington , nc
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city O B-state
Real slot label: B-city O B-state
Score: 
Word 0 score: [1.1700999e-04 2.9954399e-05 4.7313303e-01 4.6560991e-01 6.1110146e-02]
Word 2 score: [1.0000000e+00 4.1815335e-10 4.1815335e-10 4.1815335e-10 4.1815335e-10]
------
1355
i ' m sorry i do n ' t have any jamaican restaurants that take online reservations in wilmington . would you like to try a different type of food ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O B-restauranttype O O O O O O B-city O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O B-restauranttype O O O O O O B-city O O O O O O O O O O O O
Score: 
Word 11 score: [9.2777718e-08 9.9794084e-01 3.8995579e-04 1.2791352e-03 3.8995579e-04]
Word 18 score: [1.5297851e-04 4.6650868e-07 6.9994308e-02 1.6664851e-02 9.1318738e-01]
------
1356
options ?
Predicted label: ['confirm_question']
Real label: ['confirm_question']
Predicted slot label: O O
Real slot label: O O
Score: 
------
1357
wilmington has italian , american , french , steak ##house restaurants , among others . do any of those interest you ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: B-city O B-cuisine O B-cuisine O B-cuisine O B-cuisine I-cuisine O O O B-cuisine O O O O O O O O
Real slot label: B-city O B-cuisine O B-cuisine O B-cuisine O B-cuisine I-cuisine O O O B-cuisine O O O O O O O O
Score: 
Word 0 score: [1.2390299e-03 4.4129681e-04 5.1211375e-01 3.4796461e-01 1.3824132e-01]
Word 2 score: [9.7582257e-01 1.1446646e-07 8.6781256e-07 1.8236274e-06 2.4174675e-02]
Word 4 score: [4.5415265e-03 3.7055790e-09 2.6941776e-05 9.9535215e-01 7.9399833e-05]
Word 6 score: [2.5482437e-02 1.1460717e-01 8.5798389e-01 1.9532863e-04 1.7311736e-03]
Word 8 score: [6.5948630e-16 1.6489074e-18 2.5857019e-15 8.0675055e-16 1.0000000e+00]
Word 9 score: [1.2242439e-06 7.6166410e-18 3.9995871e-15 7.9965433e-14 9.9999881e-01]
Word 13 score: [3.5777630e-04 4.8426335e-04 9.9897778e-01 1.8022062e-04 1.4992283e-08]
------
1358
steak ##house
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-cuisine I-cuisine
Real slot label: B-cuisine I-cuisine
Score: 
Word 0 score: [2.8569300e-11 6.3162599e-13 1.5091905e-11 1.4513088e-10 1.0000000e+00]
Word 1 score: [7.8050213e-08 1.0501898e-19 6.4551514e-17 8.7941512e-16 9.9999988e-01]
------
1359
here are some restaurants that i found . would you like any of these options : sullivan ' s steak ##house , tonic bar and grille ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 16 score: [9.6973818e-06 9.3431154e-06 3.1516212e-01 8.4230260e-07 6.8481797e-01]
Word 17 score: [6.3566220e-01 3.8909924e-04 2.3517373e-01 5.9112767e-04 1.2818381e-01]
Word 18 score: [9.9894327e-01 7.7880753e-07 4.1332680e-08 1.3892368e-06 1.0545575e-03]
Word 19 score: [1.3293510e-15 2.1069804e-20 4.9610514e-19 1.0752719e-17 1.0000000e+00]
Word 20 score: [1.09319406e-15 1.14745654e-20 2.65509493e-19 5.95943348e-18
 1.00000000e+00]
Word 22 score: [9.9582219e-01 7.1280165e-06 4.1115993e-05 2.3253458e-03 1.8042854e-03]
Word 23 score: [6.7782217e-01 4.7620484e-05 1.2992761e-02 1.4351651e-01 1.6562089e-01]
Word 24 score: [0.36218894 0.03657758 0.07570318 0.09827712 0.42725316]
Word 25 score: [3.8587161e-11 1.9526623e-11 9.9998701e-01 4.2835910e-07 1.2463299e-05]
------
1360
sullivan ' s steak ##house
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [0.00078498 0.77890366 0.18053243 0.01414769 0.02563124]
Word 1 score: [7.5822860e-01 8.9759276e-05 1.9504219e-01 1.9183062e-04 4.6447616e-02]
Word 2 score: [9.9940002e-01 5.1432966e-07 4.9944070e-08 9.7607096e-07 5.9842650e-04]
Word 3 score: [5.7220682e-17 3.6881109e-23 5.0234117e-22 8.3374662e-20 1.0000000e+00]
Word 4 score: [5.7960592e-17 3.9310542e-23 4.7735379e-22 9.0633275e-20 1.0000000e+00]
------
1361
i ' m sorry , that restaurant is actually in wilmington , de . here are some choices for nc : ruth ' s chris steak ##house . would you like to reserve that instead ?
Predicted label: ['inform', 'confirm_question']
Real label: ['inform', 'confirm_question']
Predicted slot label: O O O O O O O O O O B-city O B-state O O O O O O B-city O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O
Real slot label: O O O O O O O O O O B-city O B-state O O O O O O B-city O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O
Score: 
Word 10 score: [2.1661264e-04 1.3445591e-06 4.9485486e-02 1.9335598e-02 9.3096095e-01]
Word 12 score: [3.2744923e-05 9.9996626e-01 8.3095364e-07 9.2057121e-08 4.7355475e-09]
Word 19 score: [1.000000e+00 2.615695e-09 2.615695e-09 2.615695e-09 2.615695e-09]
Word 21 score: [8.9322228e-08 2.6119293e-08 2.9336807e-01 5.7218053e-11 7.0663184e-01]
Word 22 score: [0.3910526  0.00041834 0.23138717 0.00288496 0.37425694]
Word 23 score: [9.9713069e-01 4.2511624e-07 5.3339193e-08 2.5599136e-06 2.8663375e-03]
Word 24 score: [8.7499273e-01 5.0700974e-02 2.4123463e-05 4.5396402e-03 6.9742508e-02]
Word 25 score: [4.8975991e-15 7.1987251e-22 2.9068203e-20 1.1798244e-18 1.0000000e+00]
Word 26 score: [3.2909913e-15 1.6257633e-22 1.1136898e-20 2.9167187e-19 1.0000000e+00]
------
1362
yes please , i do n ' t have the gas money to get to del ##ew ##are
Predicted label: ['inform']
Real label: ['confirm_answer']
Predicted slot label: O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O
Score: 
------
1363
that would be a bit of a drive ! i have successfully completed your reservation at ruth ' s chris steak house in wilmington , nc for march 12th at 7 ##pm . enjoy !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O B-starttime I-starttime O O O
Real slot label: O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O B-starttime I-starttime O O O
Score: 
Word 16 score: [9.4301228e-08 3.9260972e-09 1.3115712e-01 1.5023803e-11 8.6884284e-01]
Word 17 score: [0.53441924 0.00068595 0.10375376 0.00127559 0.3598654 ]
Word 18 score: [9.9912709e-01 1.8565034e-07 4.4739853e-08 5.8144377e-07 8.7218947e-04]
Word 19 score: [8.9301234e-01 3.3864409e-02 6.3574348e-06 5.9038638e-03 6.7212932e-02]
Word 20 score: [1.0948294e-02 7.7371588e-11 2.0354486e-16 3.4417586e-13 9.8905164e-01]
Word 21 score: [1.2802755e-02 8.6536545e-01 5.5002217e-04 6.2825233e-02 5.8456555e-02]
Word 22 score: [2.7090563e-09 1.4035004e-09 5.2000262e-09 2.0920563e-08 1.0000000e+00]
Word 23 score: [6.4983330e-04 1.9313463e-06 1.0708537e-01 1.0706285e-02 8.8155651e-01]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [1.000000e+00 3.138768e-13 3.138768e-13 3.138768e-13 3.138768e-13]
Word 30 score: [0.2 0.2 0.2 0.2 0.2]
Word 31 score: [0.2 0.2 0.2 0.2 0.2]
------
1364
book me a table for 1 in seattle for tomorrow at 7 : 00 pm at cafe ben ##go ##di
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-city O B-date O B-starttime I-starttime I-starttime I-starttime O B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: O O O O O B-numberofpeople O B-city O B-date O B-starttime I-starttime I-starttime I-starttime O B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [2.8398581e-02 1.9393595e-04 4.3891642e-02 9.2699689e-01 5.1901239e-04]
Word 9 score: [5.8783501e-01 6.4171717e-02 7.6171887e-07 2.5667543e-06 3.4798989e-01]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [2.1615109e-04 9.8754531e-01 1.2207856e-02 4.4451422e-06 2.6181271e-05]
Word 16 score: [7.0696342e-04 1.7474034e-03 5.6944783e-03 4.0215477e-11 9.9185115e-01]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
------
1365
i have successfully booked your reservation for tomorrow . enjoy !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-date O B-closing O
Real slot label: O O O O O O O B-date O B-closing O
Score: 
Word 7 score: [7.8215861e-01 1.5693109e-01 8.3478852e-08 7.5287016e-06 6.0902689e-02]
Word 9 score: [1.2078126e-01 1.1206094e-02 8.5475427e-01 3.1096391e-05 1.3227347e-02]
------
1366
i would like to book a seafood place in seattle on 03 / 20 at 3 : 30 ##pm for 3 people
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O B-food O O B-city O B-date I-date I-date O B-starttime I-starttime I-starttime I-starttime O B-numberofpeople O
Real slot label: O O O O O O B-food O O B-city O B-date I-date I-date O B-starttime I-starttime I-starttime I-starttime O B-numberofpeople O
Score: 
Word 6 score: [4.1567455e-05 9.0789035e-02 7.3167691e-03 1.0927815e-05 9.0184164e-01]
Word 9 score: [5.8279734e-02 1.7619369e-04 7.7398606e-02 8.2592142e-01 3.8223993e-02]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
------
1367
here are 3 of the top rated seafood restaurants in seattle : elliott ' s oyster house , the brooklyn seafood , steak & oyster house , and metropolitan grill . would you like to book one of those or would you prefer more options ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O B-rating I-rating O O O B-city O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname O O O O O O O O O O O O O O O O
Real slot label: O O O O O B-rating I-rating O O O B-city O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname O O O O O O O O O O O O O O O O
Score: 
Word 5 score: [3.8875423e-05 1.2799555e-04 2.2657652e-07 4.9991643e-01 4.9991643e-01]
Word 6 score: [9.8917156e-01 3.4757177e-05 2.1424504e-09 5.5975332e-11 1.0793688e-02]
Word 10 score: [7.1695015e-02 2.9513869e-04 1.6586805e-02 9.0959215e-01 1.8309344e-03]
Word 12 score: [9.3324274e-01 1.2579813e-02 5.4177411e-02 6.3518368e-10 6.3518368e-10]
Word 13 score: [0.5098897  0.00695669 0.34981132 0.0015124  0.13182987]
Word 14 score: [9.9825066e-01 8.0598575e-06 1.9357043e-07 4.3231794e-06 1.7366742e-03]
Word 15 score: [9.6523416e-01 1.8795788e-02 1.5964046e-02 2.7432505e-09 5.8277719e-06]
Word 16 score: [0.00281022 0.84889644 0.00447096 0.09333814 0.05048418]
Word 18 score: [3.54639702e-02 1.10555729e-02 9.53339934e-01 2.83732425e-05
 1.12052694e-04]
Word 19 score: [3.0480471e-08 4.6759389e-08 7.2116607e-01 2.6554617e-01 1.3287708e-02]
Word 20 score: [2.9483662e-04 9.4595087e-01 5.2311681e-02 2.8180701e-05 1.4144205e-03]
Word 22 score: [6.3831699e-03 1.2360963e-03 1.6239306e-12 7.0755964e-11 9.9238068e-01]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [9.5032942e-01 2.2657869e-02 2.7004521e-02 3.1004990e-09 8.2696570e-06]
Word 25 score: [0.00247598 0.8304353  0.00482579 0.1023789  0.05988407]
Word 28 score: [7.1437389e-02 4.6365324e-01 5.5375076e-05 1.2007848e-03 4.6365324e-01]
Word 29 score: [8.1613089e-18 3.0465024e-21 2.0894113e-03 2.4292233e-16 9.9791056e-01]
------
1368
brooklyn seafood please
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname O
Real slot label: B-restaurantname I-restaurantname O
Score: 
Word 0 score: [4.2469118e-04 9.6165895e-04 5.9184190e-03 3.6942127e-01 6.2327391e-01]
Word 1 score: [5.4560103e-05 2.8287626e-03 5.6046504e-04 4.1703859e-07 9.9655581e-01]
------
1369
unfortunately there are no times available at 3 : 30 pm . i was able to find times at 4 pm and 4 : 15 pm , do either of these interest you ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O O O B-starttime I-starttime O B-starttime I-starttime I-starttime I-starttime O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O B-starttime I-starttime O B-starttime I-starttime I-starttime I-starttime O O O O O O O O
Score: 
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [4.2558973e-08 1.8313173e-02 9.8168266e-01 4.1758303e-06 1.9731509e-10]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [1.1756749e-06 9.6532857e-01 3.4654610e-02 1.2354648e-05 3.3100721e-06]
------
1370
4 ##pm pe ##lase
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O
Real slot label: O O O O
Score: 
------
1371
great . i ' ve booked your reservation for you !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
1372
captain d ' has seating for 40 people for about two hours and a meeting is that possible
Predicted label: ['request']
Real label: ['inform']
Predicted slot label: O O O O O O B-seating O O O O O O O O O O O
Real slot label: O O O O O O B-seating O O O O O O O O O O O
Score: 
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
------
1373
i ' m happy to assist you ! what city are you dining in ?
Predicted label: ['request', 'greeting']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O
Score: 
------
1374
can i reserve a table for two at arrow ##leaf bis ##tro in winthrop , wa ? tomorrow at 7 ##pm
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-city O B-state O B-date O B-starttime I-starttime
Real slot label: O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-city O B-state O B-date O B-starttime I-starttime
Score: 
Word 8 score: [8.8510358e-01 1.1489642e-01 2.2494548e-09 2.2494548e-09 2.2494548e-09]
Word 9 score: [4.4715742e-04 9.9955279e-01 3.0922065e-10 3.0922065e-10 3.0922065e-10]
Word 10 score: [8.0157983e-01 1.9386469e-01 8.5858126e-05 4.4680587e-03 1.5659467e-06]
Word 11 score: [7.8179467e-01 2.1494207e-01 7.2398288e-05 3.1894632e-03 1.3762660e-06]
Word 13 score: [7.3502550e-04 8.7440899e-04 2.3433000e-03 9.1487402e-01 8.1173204e-02]
Word 15 score: [2.0310469e-04 5.7469004e-01 8.4566986e-03 4.1651872e-01 1.3146682e-04]
Word 17 score: [5.2274728e-01 1.3005701e-02 4.8731016e-07 1.9827426e-06 4.6424454e-01]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
------
1375
what name would you like to book the reservation under ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
1376
smith works . as long as they are okay with alias ##es
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname I-personfullname O O O O O O O O O O
Real slot label: B-personfullname I-personfullname O O O O O O O O O O
Score: 
Word 0 score: [3.8772091e-01 1.5945088e-02 6.8902886e-03 5.4823813e-05 5.8938885e-01]
Word 1 score: [5.8745112e-02 1.5659940e-03 1.6944192e-03 1.2679574e-04 9.3786776e-01]
------
1377
we will be closed for the month of march in order to move to our new location . we apologize for any inc ##on ##ven ##ience . would you like to try some place else ?
Predicted label: ['request', 'inform', 'confirm_question']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1378
hi , how it it going i am looking for a good french restaurant in my area
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O B-cuisine I-cuisine O O O
Real slot label: O O O O O O O O O O O O B-cuisine I-cuisine O O O
Score: 
Word 12 score: [6.5606332e-01 5.7041496e-02 2.8522655e-01 7.0498572e-05 1.5980864e-03]
Word 13 score: [3.8863051e-05 8.0379349e-01 1.7157677e-01 2.4590824e-02 6.7859634e-17]
------
1379
i ' d love to help you with that . what is your location ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O
Score: 
------
1380
i am currently in san francisco california
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O B-city I-city I-city
Real slot label: O O O O B-city I-city I-city
Score: 
Word 4 score: [7.282164e-07 9.661066e-01 3.389166e-02 9.742474e-07 4.739369e-08]
Word 5 score: [1.50128955e-03 7.72212632e-04 9.97604966e-01 1.21494384e-04
 3.17738479e-12]
Word 6 score: [9.9941778e-01 5.6671205e-08 3.8128253e-04 2.0015602e-04 8.8956608e-07]
------
1381
when would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
1382
i would like to go next thursday at 9 ##pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O B-date I-date O B-starttime I-starttime
Real slot label: O O O O O B-date I-date O B-starttime I-starttime
Score: 
Word 5 score: [1.2527702e-05 4.3294600e-05 4.5424156e-04 9.9948406e-01 5.8318701e-06]
Word 6 score: [5.1276654e-04 2.5003986e-03 3.8110366e-04 4.3204294e-05 9.9656254e-01]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
------
1383
how many are going ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
1384
there will be a total of 6 of us going
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O B-numberofpeople O O O
Real slot label: O O O O O O B-numberofpeople O O O
Score: 
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
------
1385
here are three restaurants that i found . would you like any of these options : 1 ) bo ##uche , 2 ) l ' ar ##do ##ise , 3 ) kei ##ko a no ##b hill ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 18 score: [6.6274010e-06 9.9844438e-01 1.9509393e-05 1.4944954e-03 3.5080793e-05]
Word 19 score: [1.6532766e-03 3.2077613e-01 1.4133470e-05 2.1625354e-03 6.7539394e-01]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
Word 26 score: [0.2 0.2 0.2 0.2 0.2]
Word 27 score: [0.2 0.2 0.2 0.2 0.2]
Word 31 score: [4.3053639e-01 3.9371479e-01 1.6341005e-01 1.2338786e-02 5.5021146e-14]
Word 32 score: [4.6933554e-02 2.3666219e-01 7.1629620e-01 1.0804851e-04 1.6145855e-16]
Word 33 score: [1.4328831e-01 7.3569977e-01 9.3529627e-02 2.7455185e-02 2.7065060e-05]
Word 34 score: [9.9169648e-01 1.1158586e-03 6.9906507e-03 1.9544867e-04 1.5325849e-06]
Word 35 score: [9.9046516e-01 1.5046700e-03 7.8285383e-03 1.9988471e-04 1.8070206e-06]
Word 36 score: [2.0873010e-04 2.0970667e-05 7.6616722e-01 3.8654991e-05 2.3356442e-01]
------
1386
can you please book us for bo ##uche
Predicted label: ['request']
Real label: ['inform']
Predicted slot label: O O O O O O B-restaurantname I-restaurantname
Real slot label: O O O O O O B-restaurantname I-restaurantname
Score: 
Word 6 score: [1.4979023e-06 9.9805522e-01 7.9318188e-06 1.6897927e-03 2.4559660e-04]
Word 7 score: [2.3300976e-04 1.7681496e-01 4.8780958e-06 2.1678391e-03 8.2077938e-01]
------
1387
your reservation at bo ##uche for next thursday at 9 ##pm has been booked . enjoy !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O B-restaurantname I-restaurantname O B-date I-date O B-starttime I-starttime O O O O B-closing O
Real slot label: O O O B-restaurantname I-restaurantname O B-date I-date O B-starttime I-starttime O O O O B-closing O
Score: 
Word 3 score: [1.0177299e-06 9.9948657e-01 7.7506993e-06 4.9658585e-04 8.0789223e-06]
Word 4 score: [6.5901506e-05 2.9735315e-01 2.5280774e-06 4.3404746e-04 7.0214444e-01]
Word 6 score: [6.9836003e-04 6.1316759e-04 2.9378356e-02 9.6918082e-01 1.2935004e-04]
Word 7 score: [0.02603565 0.02915488 0.00095491 0.00209104 0.9417635 ]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [1.3932371e-02 1.1311890e-02 9.7203642e-01 1.5292793e-05 2.7040420e-03]
------
1388
what italian restaurant is the best for tonight ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O B-cuisine O O O O O B-date O
Real slot label: O B-cuisine O O O O O B-date O
Score: 
Word 1 score: [9.6652192e-01 2.9014542e-09 3.8210729e-07 3.8399224e-07 3.3477347e-02]
Word 7 score: [0.00790889 0.24374789 0.01593359 0.12820087 0.6042088 ]
------
1389
i ' m happy to assist you ! what city are you dining in ?
Predicted label: ['request']
Real label: ['request', 'greeting']
Predicted slot label: O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O
Score: 
------
1390
seattle
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city
Real slot label: B-city
Score: 
Word 0 score: [6.4854258e-01 1.9075582e-04 1.9193657e-01 1.5904182e-01 2.8820566e-04]
------
1391
how many guests are in your party ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
1392
4 total
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople O
Real slot label: B-numberofpeople O
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
1393
great . do you have a preference on time ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
1394
whatever time is available
Predicted label: ['request']
Real label: ['inform']
Predicted slot label: B-starttime I-starttime I-starttime I-starttime
Real slot label: B-starttime I-starttime I-starttime I-starttime
Score: 
Word 0 score: [0.00642329 0.27874082 0.70234877 0.01170135 0.00078571]
Word 1 score: [0.11843199 0.03570524 0.00284487 0.00140319 0.84161466]
Word 2 score: [3.3062429e-07 7.4691352e-06 9.9998856e-01 6.5428969e-07 3.0347039e-06]
Word 3 score: [8.5705382e-01 1.3119678e-01 7.1919339e-07 1.1561517e-02 1.8721167e-04]
------
1395
i ' m afraid it ' s too late to find reservations for tonight . would you like to try another date ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1396
tomorrow after 6 pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date B-starttime I-starttime I-starttime
Real slot label: B-date B-starttime I-starttime I-starttime
Score: 
Word 0 score: [4.7595962e-04 9.9952328e-01 4.8471650e-11 3.2175333e-08 7.6685660e-07]
Word 1 score: [1.3528962e-09 5.0000000e-01 5.0000000e-01 6.6473582e-10 9.3338401e-12]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [1.2487386e-05 6.2949336e-01 3.7049368e-01 4.6951811e-07 4.8214428e-08]
------
1397
il terra ##zzo carmine , bar cot ##to , and sera ##fin ##a all have tables available at 6 ##pm . which would you like to book ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O
Score: 
Word 0 score: [1.0000000e+00 3.1085856e-09 5.0129927e-09 5.2781304e-12 9.6270561e-12]
Word 1 score: [9.9874747e-01 5.3278353e-07 4.3769965e-06 1.2475672e-03 3.6312740e-14]
Word 2 score: [1.7632213e-01 7.0553907e-04 4.7280956e-02 7.7569091e-01 4.5092546e-07]
Word 3 score: [1.4564396e-04 9.7112366e-05 2.7152820e-04 7.6722016e-04 9.9871850e-01]
Word 5 score: [3.9082924e-03 1.3410606e-06 4.6558215e-04 9.8737466e-01 8.2501937e-03]
Word 6 score: [4.3976036e-01 5.2810938e-04 4.3958509e-05 5.5627197e-01 3.3956161e-03]
Word 7 score: [0.11875929 0.14144637 0.10937405 0.46755603 0.16286433]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
------
1398
sera ##fin ##a
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
------
1399
your reservation is confirmed ! please enjoy your meal , and thank you for using our service .
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O B-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing O
Real slot label: O O O O O B-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing O
Score: 
Word 5 score: [5.3643491e-03 8.8283233e-03 9.8509514e-01 7.1229570e-04 1.2238344e-09]
Word 6 score: [3.2182445e-03 2.3427464e-02 9.7231704e-01 1.0370916e-03 7.0759242e-08]
Word 7 score: [3.8719409e-05 9.9901116e-01 9.5008872e-04 8.2360192e-19 8.2360192e-19]
Word 8 score: [1.5774546e-08 3.9804653e-09 5.5772869e-08 6.6515738e-01 3.3484256e-01]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [9.9763620e-01 1.8042438e-04 9.3473989e-04 7.4599731e-05 1.1740938e-03]
Word 11 score: [4.7047976e-02 9.7470975e-04 9.4754314e-01 3.7960938e-04 4.0545338e-03]
Word 12 score: [3.0534640e-01 1.2349717e-03 9.8734014e-03 2.8330952e-04 6.8326193e-01]
Word 13 score: [5.7071797e-10 7.2121509e-08 1.2664305e-08 9.9999845e-01 1.4312419e-06]
Word 14 score: [8.9183338e-03 5.8961171e-04 8.9183338e-03 9.8157364e-01 1.1113362e-14]
Word 15 score: [6.5323223e-07 4.5889966e-02 5.4791707e-01 2.2350027e-01 1.8269205e-01]
Word 16 score: [2.3256559e-02 7.1001609e-06 1.3700957e-02 1.9596252e-01 7.6707286e-01]
------
1400
what are the hours of operations for the hu ##ns restaurant
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O B-restaurantname I-restaurantname I-restaurantname
Real slot label: O O O O O O O O B-restaurantname I-restaurantname I-restaurantname
Score: 
Word 8 score: [1.3912293e-01 8.6087704e-01 7.8309035e-12 7.8309035e-12 7.8309035e-12]
Word 9 score: [1.7151767e-01 8.2848233e-01 4.9268329e-11 4.9268329e-11 4.9268329e-11]
Word 10 score: [4.8107969e-13 8.7394059e-01 2.6823995e-03 1.2337703e-01 2.6597934e-15]
------
1401
may i please have the city or location you ' re interested in ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O
Score: 
------
1402
i need to book a table for 3 / 21 at 7 pm for dinner at the b and b ri ##stor ##ante in las vegas for two ge ##ust ##s .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O B-date I-date I-date O O O O B-mealtype O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-city I-city O O O O O O
Real slot label: O O O O O O O B-date I-date I-date O O O O B-mealtype O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-city I-city O O O O O O
Score: 
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [9.9984956e-01 1.3434129e-05 1.8926718e-11 1.3700929e-04 1.8863737e-09]
Word 17 score: [9.6014206e-05 2.7333397e-07 2.7640383e-05 1.1857659e-01 8.8129950e-01]
Word 18 score: [3.6774537e-01 8.8979281e-02 3.2247049e-03 7.7435107e-05 5.3997314e-01]
Word 19 score: [2.1886541e-05 2.6668753e-08 2.0560490e-06 4.0588489e-05 9.9993539e-01]
Word 20 score: [9.90424573e-01 9.57539491e-03 1.08179805e-10 1.08179805e-10
 1.08179805e-10]
Word 21 score: [9.9274158e-01 7.2583365e-03 3.0582623e-11 3.0582623e-11 3.0582623e-11]
Word 22 score: [9.9114990e-01 8.8501656e-03 2.3850907e-10 2.3850907e-10 2.3850907e-10]
Word 24 score: [4.2613989e-04 4.6030050e-03 4.5040628e-01 5.3066885e-01 1.3895748e-02]
Word 25 score: [1.0000000e+00 1.5607213e-12 1.5607213e-12 1.5607213e-12 1.5607213e-12]
------
1403
i have successfully completed your reservation ! enjoy !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
1404
book me a table tomorrow in seattle for 2 at 10 ##pm anywhere you choose
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O B-date O B-city O B-numberofpeople O B-starttime I-starttime O O O
Real slot label: O O O O B-date O B-city O B-numberofpeople O B-starttime I-starttime O O O
Score: 
Word 4 score: [4.1239211e-01 2.9278585e-01 1.1832329e-06 1.5362877e-05 2.9480544e-01]
Word 6 score: [1.6893854e-02 2.1600747e-04 3.8926262e-01 5.9242815e-01 1.1993659e-03]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
------
1405
here are 3 of the top rated restaurants in seattle : cas ##cina spin ##asse ##s , ag ##rod ##ol ##ce , and boom no ##odle . would you like to book one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O B-rating I-rating O O B-city O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O B-rating I-rating O O B-city O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 5 score: [9.1929073e-03 2.6974385e-03 1.3288720e-06 4.9405411e-01 4.9405411e-01]
Word 6 score: [9.8128766e-01 7.5023971e-05 4.2522514e-09 8.6604168e-11 1.8637326e-02]
Word 9 score: [3.8154822e-02 8.8180794e-04 2.1807533e-02 9.3883866e-01 3.1713099e-04]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [9.9549279e-02 7.6325077e-01 1.3719784e-01 1.0841555e-06 1.0841555e-06]
Word 18 score: [9.9983907e-01 3.2550910e-05 1.2834514e-04 4.2173920e-13 4.2173920e-13]
Word 19 score: [9.9974984e-01 2.2829609e-04 9.6032682e-06 6.0840762e-06 6.0840762e-06]
Word 20 score: [9.9969125e-01 2.8624112e-04 1.3742103e-05 4.3899990e-06 4.3899990e-06]
Word 23 score: [8.0493976e-08 3.0826891e-04 9.9969053e-01 4.9679791e-08 1.1687284e-06]
Word 24 score: [1.3911262e-05 1.3985380e-05 4.0550425e-04 1.2924375e-05 9.9955362e-01]
Word 25 score: [9.6403074e-01 2.2124217e-04 1.1022223e-04 1.6759634e-08 3.5637874e-02]
------
1406
ag ##rod ##ol ##ce
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [5.1408190e-01 6.4151461e-04 2.3967621e-06 2.4263708e-01 2.4263708e-01]
Word 1 score: [9.9996996e-01 3.0607598e-06 2.6936212e-05 1.9519520e-14 1.9519520e-14]
Word 2 score: [9.9996865e-01 2.6400830e-05 4.9277423e-06 3.5505622e-08 3.5505622e-08]
Word 3 score: [9.9996781e-01 2.6433509e-05 5.7494626e-06 2.0563016e-08 2.0563016e-08]
------
1407
what name would you like to book the reservation under ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
1408
james
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname
Real slot label: B-personfullname
Score: 
Word 0 score: [4.6696456e-05 6.4958915e-02 7.8351605e-01 7.6783043e-03 1.4380005e-01]
------
1409
unfortunately 10 ##pm is all booked but 9 : 45 is available . should i book it ?
Predicted label: ['inform', 'confirm_question']
Real label: ['inform', 'confirm_question']
Predicted slot label: O B-starttime I-starttime O O O O B-starttime I-starttime I-starttime O O O O O O O O
Real slot label: O B-starttime I-starttime O O O O B-starttime I-starttime I-starttime O O O O O O O O
Score: 
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
------
1410
yes please !
Predicted label: ['confirm_answer']
Real label: ['confirm_answer']
Predicted slot label: O O O
Real slot label: O O O
Score: 
------
1411
i have successfully booked your reservation for 9 : 45 ##pm . enjoy !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-starttime I-starttime I-starttime I-starttime O B-closing O
Real slot label: O O O O O O O B-starttime I-starttime I-starttime I-starttime O B-closing O
Score: 
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [2.0124424e-02 1.3661404e-02 9.6366066e-01 3.4229746e-05 2.5193139e-03]
------
1412
can you find me a restaurant in miami that serves good italian food ? i have two people
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O B-city O O O B-cuisine O O O O O O
Real slot label: O O O O O O O B-city O O O B-cuisine O O O O O O
Score: 
Word 7 score: [1.5183197e-01 4.2381948e-01 3.9123910e-07 4.2381948e-01 5.2872422e-04]
Word 11 score: [9.4377029e-01 9.5744266e-09 1.2237485e-06 1.0823360e-06 5.6227300e-02]
------
1413
what date and time would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
1414
this would be for this sunday from noon to 2 ##pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O B-date I-date B-starttime I-starttime I-starttime I-starttime I-starttime
Real slot label: O O O O B-date I-date B-starttime I-starttime I-starttime I-starttime I-starttime
Score: 
Word 4 score: [8.6201325e-02 9.1260988e-01 1.1887547e-03 2.1011921e-12 1.7886449e-11]
Word 5 score: [2.8692194e-08 1.4787398e-01 5.3620697e-06 1.7879276e-05 8.5210276e-01]
Word 6 score: [9.2376721e-01 1.6867210e-07 1.6112943e-05 1.9133798e-04 7.6025248e-02]
Word 7 score: [2.9105821e-04 2.9105821e-04 9.8431766e-01 1.3656150e-04 1.4963701e-02]
Word 8 score: [8.997393e-07 1.161364e-02 9.877927e-01 4.194986e-08 5.927535e-04]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
------
1415
here are 3 of the top rated italian restaurants open for lunch : bo ##cc ##e , bianca , and bi ##ce bis ##tro . would you like to try one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O B-rating I-rating B-cuisine O O O B-mealtype O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O B-rating I-rating B-cuisine O O O B-mealtype O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 5 score: [1.9837142e-04 1.3121864e-03 1.1791602e-06 4.9924415e-01 4.9924415e-01]
Word 6 score: [9.7638774e-01 1.4202645e-04 1.7663829e-10 3.0715964e-12 2.3470242e-02]
Word 7 score: [7.6083466e-06 6.2047159e-11 2.8980295e-08 1.3616378e-05 9.9997878e-01]
Word 11 score: [1.0082383e-05 7.2454446e-04 6.5698005e-05 4.0007675e-01 5.9912294e-01]
Word 13 score: [9.98144031e-01 5.70277905e-07 1.30024675e-08 1.85540935e-03
 1.85340219e-16]
Word 14 score: [9.9999976e-01 5.4565998e-13 1.4991490e-07 8.3128384e-08 1.7160660e-16]
Word 15 score: [1.00000000e+00 1.08282645e-11 2.38779112e-08 5.01496267e-09
 3.71801182e-14]
Word 17 score: [1.0958675e-07 2.5995623e-02 1.6662298e-08 1.6662298e-08 9.7400427e-01]
Word 20 score: [3.6432135e-05 8.1544495e-01 1.8221432e-01 2.3020715e-03 2.1388964e-06]
Word 21 score: [4.0836424e-02 2.9921576e-01 2.9711157e-01 3.6263993e-01 1.9629570e-04]
Word 22 score: [8.6061561e-01 1.2153042e-01 1.1842100e-04 1.7733768e-02 1.8828231e-06]
Word 23 score: [8.8054198e-01 1.0845895e-01 7.8142584e-05 1.0919514e-02 1.4890628e-06]
------
1416
bo ##cc ##e sounds good
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname O O
Score: 
Word 0 score: [9.9994588e-01 2.0035240e-07 4.3413776e-05 9.7238899e-06 8.4427160e-07]
Word 1 score: [9.9999988e-01 2.7959086e-13 7.1190335e-08 3.5702989e-08 1.3416322e-17]
Word 2 score: [1.0000000e+00 6.3217352e-12 1.5631077e-08 1.8576628e-09 1.8471847e-15]
------
1417
thank you so much for booking with us ! your reservation has been confirmed as requested at 12 pm . enjoy your meal !
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: B-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing O O O O O O O O O O O B-closing I-closing I-closing I-closing
Real slot label: B-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing O O O O O O O O O O O B-closing I-closing I-closing I-closing
Score: 
Word 0 score: [6.0021169e-02 2.2743994e-05 9.3331885e-01 3.5147197e-03 3.1226089e-03]
Word 1 score: [9.5565832e-01 5.6285625e-03 3.7462572e-03 1.0448733e-04 3.4862343e-02]
Word 2 score: [7.1918762e-01 9.6249489e-05 1.8118458e-03 2.6232706e-04 2.7864200e-01]
Word 3 score: [1.6152728e-02 3.5319179e-06 1.0802598e-05 9.8317289e-01 6.6008698e-04]
Word 4 score: [3.0767912e-06 6.6061133e-05 2.2417651e-06 9.9760002e-01 2.3286620e-03]
Word 5 score: [1.0649859e-03 9.7334188e-01 1.2321960e-02 9.4915682e-04 1.2321960e-02]
Word 6 score: [9.9882764e-01 3.6028484e-04 2.3022334e-05 7.8697648e-04 2.1067683e-06]
Word 7 score: [0.36506346 0.00713504 0.00401419 0.3424506  0.2813367 ]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [2.7165952e-01 1.0783381e-02 4.6758413e-01 6.3413434e-05 2.4990959e-01]
Word 21 score: [2.4124715e-04 9.8851973e-01 1.1239007e-02 1.8899292e-16 1.8899292e-16]
Word 22 score: [0.00092788 0.00137463 0.04588526 0.6912558  0.26055637]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
------
1418
book me a table for 2 in seattle for tomorrow at 7 : 00 pm at taste of the caribbean
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [1.9783258e-02 1.6375094e-04 2.8675864e-02 9.5062721e-01 7.4991561e-04]
Word 9 score: [6.4640892e-01 7.3855132e-02 1.7537178e-06 4.9747678e-06 2.7972922e-01]
Word 16 score: [0.52239805 0.05685931 0.14790693 0.2502638  0.02257195]
Word 17 score: [9.4720024e-01 2.8661321e-04 4.1067447e-03 4.6821419e-02 1.5850044e-03]
Word 18 score: [0.00227623 0.03268505 0.00514134 0.00628573 0.9536117 ]
Word 19 score: [4.9948424e-01 2.7024076e-05 8.2847690e-03 2.9516633e-08 4.9220401e-01]
------
1419
success ! i was able to book you a table for 2 at taste of the caribbean tomorrow at 7 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname B-date O O O O
Real slot label: O O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname B-date O O O O
Score: 
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.28238794 0.08351926 0.32386434 0.2945468  0.01568164]
Word 14 score: [9.9212694e-01 1.5336408e-04 2.2394555e-03 5.0894259e-03 3.9073499e-04]
Word 15 score: [0.0011826  0.01668842 0.00123549 0.00265824 0.97823524]
Word 16 score: [9.8367609e-02 1.8812829e-05 2.8392822e-03 5.5755929e-09 8.9877427e-01]
Word 17 score: [2.3565435e-07 7.8897034e-07 1.1001805e-13 1.1326158e-11 9.9999893e-01]
------
1420
i ' d like to reserve a table for 2 at the capital grille in seattle for march 14th , i prefer 7 : 00 pm if available .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O B-numberofpeople O O B-restaurantname I-restaurantname O B-city O O O O O O O O O O O O O
Real slot label: O O O O O O O O O B-numberofpeople O O B-restaurantname I-restaurantname O B-city O O O O O O O O O O O O O
Score: 
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [7.7912832e-10 2.0816371e-10 4.6171140e-11 9.9999976e-01 1.9007528e-07]
Word 13 score: [7.92433306e-12 2.43794673e-09 9.99986529e-01 1.26744435e-05
 8.35453704e-07]
Word 15 score: [3.4484860e-02 2.9774534e-04 9.4163731e-02 8.7051553e-01 5.3819374e-04]
------
1421
your reservation has been confirmed . please enjoy your meal , and thank you for using our service !
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O B-closing I-closing I-closing O O O O O O O O O
Real slot label: O O O O O O O B-closing I-closing I-closing O O O O O O O O O
Score: 
Word 7 score: [3.8367420e-02 4.7641501e-02 9.1090047e-01 3.0882277e-03 2.3720629e-06]
Word 8 score: [4.6388616e-04 9.9889010e-01 6.4600073e-04 1.6307552e-16 1.6307552e-16]
Word 9 score: [1.2958709e-07 3.8804032e-07 1.4597165e-06 4.7496793e-01 5.2503014e-01]
------
1422
hello
Predicted label: ['greeting']
Real label: ['greeting']
Predicted slot label: B-greeting
Real slot label: B-greeting
Score: 
Word 0 score: [4.0649991e-03 9.9537283e-01 5.5657252e-04 2.7999181e-06 2.7999181e-06]
------
1423
hello , can i help you book a restaurant ?
Predicted label: ['request']
Real label: ['greeting']
Predicted slot label: B-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting
Real slot label: B-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting I-greeting
Score: 
Word 0 score: [4.6983147e-01 5.2516609e-01 4.9928133e-03 4.7927274e-06 4.7927274e-06]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [9.9990022e-01 1.2002857e-07 2.5598230e-09 9.5811054e-05 3.7729824e-06]
Word 3 score: [0.28360024 0.47477442 0.00281417 0.2379737  0.00083745]
Word 4 score: [3.5727065e-02 9.2004341e-01 1.2227835e-03 4.2695154e-02 3.1160776e-04]
Word 5 score: [8.3345360e-01 3.4386816e-03 1.2554805e-02 6.8521837e-04 1.4986756e-01]
Word 6 score: [9.9910778e-01 2.3484850e-09 6.6887477e-04 2.2325754e-04 7.4127718e-11]
Word 7 score: [0.7599269  0.07223385 0.06876582 0.04089406 0.05817941]
Word 8 score: [3.8628415e-12 2.6692621e-06 4.3848054e-03 9.9561250e-01 1.3552129e-18]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
------
1424
yes , a table for to at bat ##eau , 5 ##pm , next wednesday
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname O B-starttime I-starttime O B-date I-date
Real slot label: O O O O O O O B-restaurantname I-restaurantname O B-starttime I-starttime O B-date I-date
Score: 
Word 7 score: [1.0000000e+00 1.3000392e-14 1.3000392e-14 1.3000392e-14 1.3000392e-14]
Word 8 score: [1.000000e+00 7.282329e-15 7.282329e-15 7.282329e-15 7.282329e-15]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [2.3198958e-05 7.0489790e-05 9.7880187e-04 9.9892175e-01 5.7627608e-06]
Word 14 score: [4.0100986e-01 6.0688217e-12 5.7221935e-03 2.9663399e-01 2.9663399e-01]
------
1425
what city are you located in and how many guests will you have ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O
Score: 
------
1426
i ' m in seattle . i will have 1 guest
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
1427
what name would you like to book the reservation under ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
1428
david lynch
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname I-personfullname
Real slot label: B-personfullname I-personfullname
Score: 
Word 0 score: [4.9014029e-04 2.9351522e-06 9.9950635e-01 5.0827140e-07 6.4751227e-08]
Word 1 score: [9.8748319e-04 1.0234731e-02 9.8877770e-01 1.6903592e-10 1.4089464e-11]
------
1429
your reservation at bat ##eau for david lynch was confirmed for 03 / 16 / 2016 at 5 ##pm . enjoy your meal .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-date I-date I-date I-date I-date O B-starttime I-starttime O B-closing I-closing I-closing O
Real slot label: O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-date I-date I-date I-date I-date O B-starttime I-starttime O B-closing I-closing I-closing O
Score: 
Word 3 score: [1.0000000e+00 5.0861283e-14 5.0861283e-14 5.0861283e-14 5.0861283e-14]
Word 4 score: [1.00000e+00 5.55013e-15 5.55013e-15 5.55013e-15 5.55013e-15]
Word 5 score: [2.1948837e-07 5.0402859e-06 6.2506238e-08 9.9999416e-01 5.1823372e-07]
Word 6 score: [5.3237028e-07 1.7247457e-09 9.9714130e-01 2.8580429e-03 1.0637927e-07]
Word 7 score: [9.5925137e-04 1.6327947e-02 9.8271286e-01 8.1875923e-11 3.6884298e-12]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [6.4678234e-03 6.2486427e-03 9.8607397e-01 8.5863257e-06 1.2010089e-03]
Word 21 score: [7.0041342e-06 9.9715924e-01 2.8337219e-03 1.8503625e-20 1.8503625e-20]
Word 22 score: [2.4601419e-05 8.1138734e-07 1.1512000e-04 7.8764194e-01 2.1221749e-01]
------
1430
book me a table at the che ##z pier ##ra in downtown for saturday around 7 pm
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-address O B-date O O O
Real slot label: O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-address O B-date O O O
Score: 
Word 6 score: [4.7228306e-09 2.0773450e-09 1.0190207e-03 9.9898094e-01 1.2189413e-13]
Word 7 score: [2.6868427e-08 2.0166979e-08 4.1943567e-05 9.9995804e-01 3.1650036e-09]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [2.7189083e-08 9.9999988e-01 1.9766231e-09 7.5282244e-08 1.9844454e-10]
Word 13 score: [9.7058766e-02 3.4837362e-03 8.3273808e-05 8.6721641e-01 3.2157850e-02]
------
1431
how many people are going ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O
Real slot label: O O O O O O
Score: 
------
1432
2
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
1433
sorry , 07 : 00pm is not available in che ##z pier ##ra for your party size . would you like to select a differ ##nt time ? 1 ) 06 : 00pm 2 ) 06 : 30 ##pm 3 ) 07 : 45 ##pm 4 ) 08 : 15 ##pm
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-occasion O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-occasion O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
Word 9 score: [4.5004160e-09 2.1896702e-09 4.3168970e-04 9.9956828e-01 4.6899472e-14]
Word 10 score: [1.1723019e-08 8.5333603e-08 9.7512893e-06 9.9999011e-01 2.4418101e-08]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [9.9968469e-01 9.3630515e-05 2.1975627e-04 6.2227124e-12 1.8788307e-06]
------
1434
do 08 : 15 ##pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
1435
your reservation at che ##z pier ##ra for 02 / 20 / 2016 08 : 15 ##pm for 2 people under john smith has been confirmed .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date I-date I-date O O O O O B-numberofpeople O O B-personfullname I-personfullname O O O O
Real slot label: O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date I-date I-date O O O O O B-numberofpeople O O B-personfullname I-personfullname O O O O
Score: 
Word 3 score: [1.6629069e-10 9.5429764e-10 6.8842155e-06 9.9999309e-01 7.4467876e-15]
Word 4 score: [7.6315878e-09 3.0810781e-08 4.2939246e-06 9.9999571e-01 5.9862154e-10]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [1.7342947e-02 1.6586793e-03 5.5463265e-09 9.7776502e-01 3.2333769e-03]
Word 22 score: [1.6090336e-03 6.8395134e-06 1.6811530e-03 1.3677983e-06 9.9670166e-01]
------
1436
are there any sit - down don ##ut places in seattle , wa ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O B-restauranttype I-restauranttype I-restauranttype I-restauranttype I-restauranttype I-restauranttype O B-city O B-state O
Real slot label: O O O B-restauranttype I-restauranttype I-restauranttype I-restauranttype I-restauranttype I-restauranttype O B-city O B-state O
Score: 
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.07026546 0.07034645 0.04316627 0.8123592  0.00386261]
Word 7 score: [2.0543863e-03 4.4652735e-04 7.2571583e-02 8.5685283e-01 6.8074636e-02]
Word 8 score: [5.0000000e-01 5.0000000e-01 2.0010697e-12 2.0010697e-12 2.0010697e-12]
Word 10 score: [5.0296053e-02 7.8994730e-05 5.9148498e-02 7.7992862e-01 1.1054779e-01]
Word 12 score: [5.5921241e-04 8.0159229e-01 1.9160049e-03 1.9572057e-01 2.1197191e-04]
------
1437
unfortunately it does not look like there are any sit - down dough ##nut places . do you have another cuisine preference ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1438
i guess a good american style place for breakfast would work . i need it for this sunday from 9 - 10 : 30 ##am , 2 people
Predicted label: ['request']
Real label: ['inform']
Predicted slot label: O O O O B-cuisine O O O B-mealtype O O O O O O O O B-date O O O O O O O O B-numberofpeople O
Real slot label: O O O O B-cuisine O O O B-mealtype O O O O O O O O B-date O O O O O O O O B-numberofpeople O
Score: 
Word 4 score: [5.5703076e-08 6.1818462e-18 1.0735382e-05 5.9804809e-04 9.9939120e-01]
Word 8 score: [1.99025527e-01 1.68978018e-04 1.29616065e-02 7.87674844e-01
 1.68978018e-04]
Word 17 score: [1.1736928e-06 8.5689081e-03 1.1560707e-04 4.3117255e-03 9.8700261e-01]
Word 26 score: [0.2 0.2 0.2 0.2 0.2]
------
1439
brunswick & hunt , stumbling goat bar and bis ##tro , and jimmy ' s on first are the three most popular american restaurants with seating available . which would you like to book ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O B-cuisine O O O O O O O O O O O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O B-cuisine O O O O O O O O O O O O
Score: 
Word 0 score: [0.00625618 0.05265792 0.01404887 0.921829   0.00520806]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [8.4338206e-01 1.0037492e-05 9.2681430e-02 1.2093488e-04 6.3805476e-02]
Word 4 score: [9.9999714e-01 7.3606861e-07 7.3606861e-07 7.3606861e-07 7.3606861e-07]
Word 5 score: [4.2189834e-15 8.5827756e-15 2.1860848e-11 1.0000000e+00 4.6008847e-08]
Word 6 score: [2.5163142e-03 1.2241264e-07 4.2742613e-06 1.9832242e-03 9.9549603e-01]
Word 7 score: [0.4695925  0.02491993 0.03738899 0.05851978 0.40957883]
Word 8 score: [8.2622194e-01 1.6078413e-01 1.1182172e-04 1.2879834e-02 2.3999237e-06]
Word 9 score: [9.7090673e-01 2.0806396e-02 3.8771890e-05 8.2474705e-03 6.0420393e-07]
Word 12 score: [0.00527468 0.03135361 0.00331653 0.8041123  0.15594286]
Word 13 score: [0.3854846  0.00071044 0.5617762  0.00108639 0.05094231]
Word 14 score: [9.9940741e-01 1.9231165e-06 9.8335981e-08 3.0403887e-06 5.8744644e-04]
Word 15 score: [1.6171976e-04 3.9881957e-06 1.7358846e-03 9.7481298e-01 2.3285450e-02]
Word 16 score: [0.12221399 0.04667671 0.00298354 0.00152638 0.8265994 ]
Word 22 score: [6.6584414e-03 6.0348004e-10 4.6463977e-04 9.8776501e-01 5.1119467e-03]
------
1440
stumbling goat bar sounds interesting , lets go with that
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname O O O O O O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname O O O O O O O
Score: 
Word 0 score: [0.5875029  0.10312427 0.10312427 0.10312427 0.10312427]
Word 1 score: [1.5050034e-13 2.5990030e-14 7.8045168e-11 9.9999976e-01 2.0022033e-07]
Word 2 score: [1.9558170e-03 8.3569624e-08 3.1314173e-06 1.6767449e-03 9.9636430e-01]
------
1441
great your reservation for 10 : 00 ##am at stumbling goat bar and bis ##tro on 3 / 13 / 2016 is confirmed .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O B-starttime I-starttime I-starttime I-starttime O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date I-date I-date O O O
Real slot label: O O O O B-starttime I-starttime I-starttime I-starttime O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date I-date I-date O O O
Score: 
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [9.9999750e-01 6.5434045e-07 6.5434045e-07 6.5434045e-07 6.5434045e-07]
Word 10 score: [1.4313151e-13 4.2866504e-14 5.5873580e-11 9.9999976e-01 2.0158295e-07]
Word 11 score: [2.5141272e-03 1.4911659e-07 3.7504406e-06 2.4658195e-03 9.9501604e-01]
Word 12 score: [0.39635035 0.02608745 0.05720739 0.07749436 0.44286045]
Word 13 score: [9.0687233e-01 8.8459447e-02 3.6604277e-05 4.6308921e-03 6.4102539e-07]
Word 14 score: [9.6974081e-01 2.6567360e-02 1.7302333e-05 3.6742429e-03 2.5136191e-07]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
------
1442
please book a table for 2 in seattle for tomorrow at 7 : 30 pm at bar mel ##us ##ine under the name matt preston
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-personfullname I-personfullname
Real slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-personfullname I-personfullname
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [8.5034534e-02 8.4614765e-04 5.5162770e-01 3.6239406e-01 9.7494660e-05]
Word 9 score: [7.1525431e-01 1.2986158e-01 2.6972927e-08 7.9556747e-07 1.5488330e-01]
Word 16 score: [8.6329393e-03 7.1668843e-08 1.7436796e-05 9.8746431e-01 3.8852079e-03]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [5.9003934e-08 9.9998724e-01 8.2296356e-06 1.6475415e-06 2.8492277e-06]
Word 24 score: [1.1066640e-03 9.4931149e-01 9.2078000e-05 4.4680577e-02 4.8092203e-03]
------
1443
i have successfully booked your reservation . enjoy !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
1444
i need a reservation for a japanese restaurant
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O B-cuisine O
Real slot label: O O O O O O B-cuisine O
Score: 
Word 6 score: [5.6674344e-12 9.9986029e-01 5.7935296e-08 1.3441057e-10 1.3968961e-04]
------
1445
what location are you looking to book a reservation ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
1446
tampa , florida
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city O B-state
Real slot label: B-city O B-state
Score: 
Word 0 score: [0.05208211 0.00077209 0.61322826 0.03696135 0.2969562 ]
Word 2 score: [2.4744253e-08 9.9964404e-01 1.7797854e-04 6.5275219e-10 1.7797854e-04]
------
1447
great , what date are you looking to make a reservation ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O
Score: 
------
1448
father ' s day
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date I-date I-date I-date
Real slot label: B-date I-date I-date I-date
Score: 
Word 0 score: [8.1412698e-05 4.8126081e-01 3.7249666e-01 4.7430929e-02 9.8730169e-02]
Word 1 score: [0.09982952 0.04060742 0.74767184 0.10972077 0.00217049]
Word 2 score: [9.9991930e-01 4.7806261e-06 3.9867643e-07 3.5545931e-05 4.0060993e-05]
Word 3 score: [8.3470567e-08 5.8895375e-07 9.9999917e-01 1.4474065e-07 5.2737089e-08]
------
1449
at what time would you like to make the reservation ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
1450
let ' s do 12 pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O
Real slot label: O O O O O O
Score: 
------
1451
how many are going ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
1452
5 people
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople O
Real slot label: B-numberofpeople O
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
1453
what name would you like to reserve under ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
1454
michael
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname
Real slot label: B-personfullname
Score: 
Word 0 score: [9.9367118e-01 4.0200671e-08 4.0290589e-03 3.2392015e-06 2.2964308e-03]
------
1455
unfortunately there are no japanese restaurants available for that date / time in your location . would you like to pick a different cuisine ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O B-cuisine O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O B-cuisine O O O O O O O O O O O O O O O O O O O O
Score: 
Word 4 score: [4.5701819e-12 9.9999356e-01 3.3458865e-09 2.9479873e-11 6.4060728e-06]
------
1456
no thanks
Predicted label: ['thanks']
Real label: ['thanks']
Predicted slot label: B-closing I-closing
Real slot label: B-closing I-closing
Score: 
Word 0 score: [5.2161660e-02 2.2626937e-04 9.3664098e-01 1.8441760e-03 9.1269128e-03]
Word 1 score: [5.1007228e-05 3.9228878e-05 9.7575889e-04 9.9324208e-01 5.6919884e-03]
------
1457
will that be all then ?
Predicted label: ['request']
Real label: ['confirm_question']
Predicted slot label: O O O O O O
Real slot label: O O O O O O
Score: 
------
1458
yes . thank you
Predicted label: ['thanks']
Real label: ['confirm_answer', 'thanks']
Predicted slot label: O O B-closing I-closing
Real slot label: O O B-closing I-closing
Score: 
Word 2 score: [1.3942166e-02 9.0950285e-05 9.8497838e-01 7.9274693e-09 9.8839821e-04]
Word 3 score: [1.6075891e-02 3.6308201e-04 9.8778093e-03 6.7735818e-04 9.7300583e-01]
------
1459
thank you for using our system !
Predicted label: ['thanks']
Real label: ['thanks']
Predicted slot label: B-closing I-closing I-closing I-closing I-closing I-closing I-closing
Real slot label: B-closing I-closing I-closing I-closing I-closing I-closing I-closing
Score: 
Word 0 score: [0.25539955 0.0009172  0.31395143 0.39775816 0.0319736 ]
Word 1 score: [2.5761303e-01 2.4115513e-03 2.0890798e-02 6.9955620e-04 7.1838498e-01]
Word 2 score: [7.7363635e-09 6.7631709e-06 9.8620967e-06 9.9997497e-01 8.4200492e-06]
Word 3 score: [1.4595343e-02 2.8126148e-04 1.4595343e-02 9.7052807e-01 1.3113930e-14]
Word 4 score: [4.0393004e-09 9.1459798e-03 1.8979803e-01 6.7510724e-02 7.3354524e-01]
Word 5 score: [5.3549647e-02 8.0193997e-05 6.7107308e-01 2.7527022e-01 2.6906595e-05]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
------
1460
i would like to get italian for three on tomorrow at 3 ##pm in seattle
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-restauranttype O O O B-date O B-starttime I-starttime O B-city
Real slot label: O O O O O B-restauranttype O O O B-date O B-starttime I-starttime O B-city
Score: 
Word 5 score: [9.9786431e-01 2.4413804e-10 1.9449185e-08 3.2178530e-08 2.1356978e-03]
Word 9 score: [3.72312099e-01 5.22734672e-02 1.01597209e-06 1.10921565e-05
 5.75402319e-01]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [4.9019013e-02 1.5869146e-04 8.3124362e-02 8.6377198e-01 3.9259158e-03]
------
1461
how many people are going ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O
Real slot label: O O O O O O
Score: 
------
1462
2
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
1463
some good choices are : ag ##rod ##ol ##ce , amar ##o bis ##tro and bar ##olo . would you like to try one of these ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 5 score: [3.2034189e-01 4.5233300e-01 2.2732502e-01 2.1434831e-08 2.1434831e-08]
Word 6 score: [9.9998105e-01 4.6926725e-06 1.4307019e-05 6.8401936e-14 6.8401936e-14]
Word 7 score: [9.9996078e-01 3.6557842e-05 1.4354214e-06 6.2559582e-07 6.2559582e-07]
Word 8 score: [9.999558e-01 4.136517e-05 1.610259e-06 5.367056e-07 5.367056e-07]
Word 10 score: [1.7912967e-05 1.3662526e-01 8.6335665e-01 8.0473093e-08 8.0473093e-08]
Word 11 score: [6.4537548e-05 9.9957138e-01 3.6406014e-04 2.9530570e-14 2.9530570e-14]
Word 12 score: [9.2708325e-01 6.4737409e-02 8.3058272e-05 8.0952141e-03 1.0462385e-06]
Word 13 score: [9.060805e-01 8.568184e-02 9.793814e-05 8.138529e-03 1.199033e-06]
Word 15 score: [1.6676806e-02 3.0676873e-08 1.1024550e-01 8.5372376e-01 1.9353922e-02]
Word 16 score: [7.2445691e-01 1.5789318e-07 3.4227089e-03 2.7147916e-01 6.4118131e-04]
------
1464
amar ##o bis ##tro please
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 0 score: [2.100940e-04 2.579243e-01 6.680873e-01 3.688913e-02 3.688913e-02]
Word 1 score: [9.9202407e-05 9.9881554e-01 1.0853383e-03 1.2780213e-15 1.2780213e-15]
Word 2 score: [9.1044837e-01 8.4961057e-02 2.5448517e-05 4.5646331e-03 5.2160868e-07]
Word 3 score: [8.9836824e-01 9.7642161e-02 2.5298732e-05 3.9637769e-03 5.2141974e-07]
------
1465
there is no availability at 3 ##pm but i found 2 : 45 ##pm , would you like to book ?
Predicted label: ['confirm_question']
Real label: ['request', 'inform']
Predicted slot label: O O O O O B-starttime I-starttime O O O B-starttime I-starttime I-starttime I-starttime O O O O O O O
Real slot label: O O O O O B-starttime I-starttime O O O B-starttime I-starttime I-starttime I-starttime O O O O O O O
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
------
1466
3 ##pm
Predicted label: ['inform', 'confirm_answer']
Real label: ['inform']
Predicted slot label: B-starttime I-starttime
Real slot label: B-starttime I-starttime
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
------
1467
unfortunately that time is all booked but 2 : 45 ##pm is available . should i go ahead and book that ?
Predicted label: ['inform', 'confirm_question']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O B-starttime I-starttime I-starttime I-starttime O O O O O O O O O O O
Real slot label: O O O O O O O B-starttime I-starttime I-starttime I-starttime O O O O O O O O O O O
Score: 
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
------
1468
book me a table for 1 in seattle for tomorrow at 7 : 00 pm at ag ##rod ##ol ##ce
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [3.6155537e-02 2.2390192e-04 7.3014326e-02 8.9002436e-01 5.8183179e-04]
Word 9 score: [4.9910426e-01 5.4923855e-02 3.8292282e-07 1.8125664e-06 4.4596967e-01]
Word 16 score: [9.0993607e-01 7.7199310e-02 1.2864539e-02 1.0551536e-08 1.0551536e-08]
Word 17 score: [9.9999762e-01 6.2790639e-07 1.7573395e-06 2.2411553e-14 2.2411553e-14]
Word 18 score: [9.9999404e-01 5.5186870e-06 4.0891948e-07 4.4882139e-08 4.4882139e-08]
Word 19 score: [9.9999428e-01 5.2182013e-06 4.5040909e-07 2.7869287e-08 2.7869287e-08]
------
1469
hi . i ' ve booked your restaurant for tomorrow . thank you .
Predicted label: ['inform']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O O B-date O O O O
Real slot label: O O O O O O O O O B-date O O O O
Score: 
Word 9 score: [3.6857057e-01 6.3108087e-01 1.0107980e-08 8.0698601e-07 3.4772826e-04]
------
1470
hello , i ' m looking for vega ##n restaurants in portland
Predicted label: ['request', 'greeting']
Real label: ['request', 'greeting']
Predicted slot label: B-greeting O O O O O O B-restauranttype I-restauranttype O O B-city
Real slot label: B-greeting O O O O O O B-restauranttype I-restauranttype O O B-city
Score: 
Word 0 score: [4.5722860e-01 5.4040849e-01 2.3265711e-03 1.8197999e-05 1.8197999e-05]
Word 7 score: [0.02550446 0.9389845  0.02550446 0.00500326 0.00500326]
Word 8 score: [5.0389925e-08 9.5363158e-01 5.0389925e-08 2.3184156e-02 2.3184156e-02]
Word 11 score: [2.1561804e-04 4.8220583e-05 7.9939425e-02 1.2319279e-02 9.0747744e-01]
------
1471
hi . i can definitely help you with that . first i need to know what date and time you would like to go . i ' ll also need the number of guests you ' ll be bringing .
Predicted label: ['request', 'greeting']
Real label: ['request', 'greeting']
Predicted slot label: B-greeting O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: B-greeting O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
Word 0 score: [8.3572095e-06 3.5078622e-02 6.2506418e-03 3.5078622e-02 9.2358375e-01]
------
1472
i ' d like to go on friday and there will be 2 people .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-date O O O O B-numberofpeople O O
Real slot label: O O O O O O O B-date O O O O B-numberofpeople O O
Score: 
Word 7 score: [8.0571420e-02 9.8337710e-04 8.1361046e-05 9.1146314e-01 6.9007766e-03]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
------
1473
and what time , please ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O
Real slot label: O O O O O O
Score: 
------
1474
hello , i am looking for a bb ##q place to eat around nat ##ick , ma .
Predicted label: ['request', 'greeting']
Real label: ['request']
Predicted slot label: O O O O O O O B-food I-food O O O O B-city I-city O B-state O
Real slot label: O O O O O O O B-food I-food O O O O B-city I-city O B-state O
Score: 
Word 7 score: [1.13020955e-13 2.18235667e-14 4.57061251e-04 8.74353107e-03
 9.90799367e-01]
Word 8 score: [1.4670881e-12 3.6218674e-18 9.7884572e-01 2.1154242e-02 1.3814448e-11]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [9.9992561e-01 6.6922919e-05 2.3255902e-06 5.1145744e-06 4.0062367e-10]
------
1475
when would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
1476
lunch time tomorrow , there will be two people .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O B-date O O O O O O O
Real slot label: O O B-date O O O O O O O
Score: 
Word 2 score: [1.8078836e-02 1.4183025e-01 3.8529354e-08 2.4062210e-05 8.4006679e-01]
------
1477
great , for the purpose of the reservation can you give me a time or time range ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O
Score: 
------
1478
11 : 30 - 1 : 30 would be best .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-starttime I-starttime I-starttime I-starttime I-starttime I-starttime I-starttime O O O O
Real slot label: B-starttime I-starttime I-starttime I-starttime I-starttime I-starttime I-starttime O O O O
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
------
1479
bison county barbecue has openings for lunch tomorrow . should i book it ?
Predicted label: ['inform', 'confirm_question']
Real label: ['inform', 'confirm_question']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname O O O B-mealtype B-date O O O O O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname O O O B-mealtype B-date O O O O O O
Score: 
Word 0 score: [7.4752980e-01 6.7578657e-03 4.9023844e-02 1.9668631e-01 2.2443317e-06]
Word 1 score: [5.2843529e-07 1.2747472e-06 3.7424503e-05 1.8571090e-08 9.9996078e-01]
Word 2 score: [1.7051848e-06 4.4412205e-05 1.5045570e-03 9.9725276e-01 1.1965166e-03]
Word 6 score: [2.0005750e-04 1.1508854e-02 5.6269288e-04 7.2059935e-01 2.6712900e-01]
Word 7 score: [7.0222318e-03 3.6428319e-05 1.5736261e-02 6.3121754e-01 3.4598753e-01]
------
1480
please do !
Predicted label: ['confirm_answer']
Real label: ['confirm_answer']
Predicted slot label: O O O
Real slot label: O O O
Score: 
------
1481
i have successfully booked your reservation at bison county for tomorrow at 12 ##pm . enjoy !
Predicted label: ['inform', 'thanks']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O B-closing I-closing
Real slot label: O O O O O O O O O O O O O O O B-closing I-closing
Score: 
Word 15 score: [2.6790695e-02 3.2942872e-02 8.7298185e-01 8.6543012e-05 6.7198083e-02]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
------
1482
which seattle sea food restaurant has the best ratings ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O B-city O O O O O B-rating O O
Real slot label: O B-city O O O O O B-rating O O
Score: 
Word 1 score: [0.01386726 0.00087717 0.47384757 0.50902593 0.00238203]
Word 7 score: [1.0000000e+00 9.3028966e-11 2.5532485e-15 8.2406917e-09 4.8602979e-09]
------
1483
here are the highest rated seafood restaurants in seattle : the capital grille - seattle , the metropolitan grill , pali ##sa ##de .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O B-rating O B-restauranttype O O B-city O O O O O B-city O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O B-rating O B-restauranttype O O B-city O O O O O B-city O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 3 score: [1.0000000e+00 2.4126348e-09 2.4126348e-09 2.4126348e-09 2.4126348e-09]
Word 5 score: [6.1221996e-08 9.3401344e-05 7.8317644e-06 2.1831696e-09 9.9989855e-01]
Word 8 score: [2.2675440e-02 9.8625111e-05 6.9965132e-02 9.0117824e-01 6.0825003e-03]
Word 14 score: [4.8975130e-03 1.7088246e-04 9.6314180e-01 3.1779088e-02 1.0702819e-05]
Word 16 score: [4.1419022e-02 4.1849341e-02 9.1651833e-01 3.0589948e-05 1.8268765e-04]
Word 17 score: [7.9892240e-03 4.9175757e-01 1.3573513e-11 8.4956335e-03 4.9175757e-01]
Word 18 score: [3.1297036e-18 6.3659019e-19 2.0768218e-04 1.4514845e-16 9.9979228e-01]
Word 20 score: [9.9045992e-01 3.1208408e-03 3.0883318e-03 2.4271024e-04 3.0883318e-03]
Word 21 score: [9.9995446e-01 2.3312177e-06 2.1553342e-05 6.2751199e-10 2.1553342e-05]
Word 22 score: [9.9823147e-01 1.7495104e-03 9.4959250e-06 3.1675379e-10 9.4959250e-06]
------
1484
ok can i get a table for three at the capital grille tomorrow at 6 ##pm ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname B-date O B-starttime I-starttime O
Real slot label: O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname B-date O B-starttime I-starttime O
Score: 
Word 9 score: [3.43039222e-02 2.81722490e-02 9.37251151e-01 1.54558991e-04
 1.18114105e-04]
Word 10 score: [4.3686796e-09 6.6054051e-09 3.1013874e-09 9.9999917e-01 7.8395436e-07]
Word 11 score: [3.3662100e-09 2.7666223e-07 9.9793577e-01 2.0597633e-03 4.1328067e-06]
Word 12 score: [1.5308899e-06 9.5220103e-06 1.3895341e-11 2.9716404e-10 9.9998891e-01]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
------
1485
what name would you like to book the reservation under ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
1486
tom sprang
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname I-personfullname
Real slot label: B-personfullname I-personfullname
Score: 
Word 0 score: [3.24189477e-03 1.71405151e-01 4.31852328e-04 1.13574715e-05
 8.24909687e-01]
Word 1 score: [1.0000000e+00 3.9823717e-12 3.9823717e-12 3.9823717e-12 3.9823717e-12]
------
1487
you ' re all set , tom ! thank you for using our service .
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O B-closing I-closing I-closing I-closing I-closing I-closing I-closing
Real slot label: O O O O O O O O B-closing I-closing I-closing I-closing I-closing I-closing I-closing
Score: 
Word 8 score: [1.1061016e-03 1.1387542e-06 9.9882370e-01 3.2723482e-09 6.8992114e-05]
Word 9 score: [0.42358142 0.00197395 0.01969475 0.00062813 0.55412173]
Word 10 score: [5.3622857e-09 2.2479796e-06 3.5505775e-07 9.9998581e-01 1.1569053e-05]
Word 11 score: [1.6400795e-02 7.7298362e-05 1.6400795e-02 9.6712118e-01 8.6344241e-14]
Word 12 score: [1.24958603e-07 4.42037508e-02 6.90545678e-01 1.24086514e-01
 1.41163886e-01]
Word 13 score: [9.8325536e-03 5.6257573e-05 1.7998383e-03 3.2718168e-03 9.8503959e-01]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
------
1488
i would like to book a reservation in a restaurant that serves meat ##lo ##af and mac a cheese for march 18
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O B-food I-food I-food I-food I-food I-food I-food O B-date I-date
Real slot label: O O O O O O O O O O O O B-food I-food I-food I-food I-food I-food I-food O B-date I-date
Score: 
Word 12 score: [2.8877570e-11 1.0765988e-11 1.0164468e-12 8.3411905e-08 9.9999988e-01]
Word 13 score: [1.0320089e-12 2.2088847e-05 3.4244545e-11 2.4243834e-06 9.9997544e-01]
Word 14 score: [2.2546247e-13 1.1256940e-09 1.1087878e-12 2.1315603e-09 1.0000000e+00]
Word 15 score: [8.1045866e-02 1.0325579e-03 8.8204833e-05 2.3273453e-06 9.1783106e-01]
Word 16 score: [3.1449346e-07 4.1449707e-02 3.2949722e-06 6.8866984e-06 9.5853978e-01]
Word 17 score: [6.6098112e-12 5.8152647e-08 2.2885277e-13 1.2794105e-14 1.0000000e+00]
Word 18 score: [9.9995434e-01 2.0676627e-05 2.5006128e-05 4.8357212e-16 2.3776868e-13]
Word 20 score: [4.6706164e-06 2.4206720e-01 1.2349819e-01 2.1225928e-01 4.2217067e-01]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
------
1489
i ' m happy to assist you ! what city are you dining in ?
Predicted label: ['request', 'greeting']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O
Score: 
------
1490
seattle
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city
Real slot label: B-city
Score: 
Word 0 score: [7.2404683e-01 8.9269306e-05 1.5959586e-01 1.1601000e-01 2.5807205e-04]
------
1491
what time would you like your reservation for ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
1492
0 . 70 ##8 ##33 ##33 ##33
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
1493
great . how many in your party ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
1494
4
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
1495
great , i found 3 locations for you . blue ##ac ##re seafood , oz ##zie ' s , and island soul restaurant . which would you like to book ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O
Real slot label: O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O
Score: 
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [9.4669362e-05 9.6905524e-01 3.0202635e-02 4.4577446e-05 6.0292258e-04]
Word 14 score: [1.8819117e-04 9.8227972e-01 1.5623648e-02 1.9084046e-03 2.1551914e-08]
Word 15 score: [4.2551969e-11 9.9999607e-01 3.8834664e-06 8.2716021e-09 8.6687341e-12]
Word 16 score: [9.9898928e-01 2.6028433e-06 6.7159611e-08 2.2896786e-06 1.0056810e-03]
Word 17 score: [9.9861598e-01 3.2278381e-06 7.9664019e-08 2.1428139e-06 1.3784888e-03]
Word 20 score: [1.09570294e-07 1.98987275e-02 2.40439135e-06 9.80098724e-01
 1.01234349e-07]
Word 21 score: [7.6918617e-11 1.4984227e-11 3.2432191e-12 9.9999976e-01 2.2768610e-07]
Word 22 score: [8.7866170e-14 6.9607699e-01 2.2857604e-03 3.0163726e-01 4.3579140e-17]
------
1496
i think we will try oz ##zie ' s
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 5 score: [2.4167413e-05 9.9438465e-01 5.2622180e-03 3.2895009e-04 2.3385334e-09]
Word 6 score: [8.7273924e-11 9.9999309e-01 6.8571935e-06 4.9476045e-09 3.0614339e-12]
Word 7 score: [9.9902773e-01 1.9479646e-06 6.3235937e-08 1.4904941e-06 9.6866995e-04]
Word 8 score: [9.9873191e-01 2.6843854e-06 7.7446927e-08 1.6403028e-06 1.2637085e-03]
------
1497
sorry it appears that restaurant can not be booked in our system yet , do you have another preference ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O
Score: 
------
1498
how about the blue ##ac ##re
Predicted label: ['request']
Real label: ['inform']
Predicted slot label: O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 2 score: [7.39473035e-04 8.63538310e-03 9.90502119e-01 1.75080604e-05
 1.05534964e-04]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
------
1499
thank you so much for booking with us ! your reservation has been confirmed as requested . please enjoy your meal !
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: B-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing O O O O O O O O B-closing I-closing I-closing I-closing I-closing
Real slot label: B-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing O O O O O O O O B-closing I-closing I-closing I-closing I-closing
Score: 
Word 0 score: [5.5457775e-02 9.2969414e-05 9.3497670e-01 7.3666656e-03 2.1059224e-03]
Word 1 score: [6.8441105e-01 2.8002451e-03 7.9873260e-03 1.0832739e-04 3.0469310e-01]
Word 2 score: [8.7590116e-01 1.2788888e-05 2.3156558e-03 1.1609649e-04 1.2165433e-01]
Word 3 score: [2.7290713e-03 2.4462990e-08 6.3954580e-08 9.9725854e-01 1.2236081e-05]
Word 4 score: [2.1834130e-09 1.4439010e-07 1.9450567e-08 9.9998915e-01 1.0756012e-05]
Word 5 score: [0.00358239 0.85176677 0.06810083 0.00844925 0.06810083]
Word 6 score: [9.9998915e-01 3.8537459e-07 9.4564166e-07 9.5628911e-06 1.0322806e-09]
Word 7 score: [0.48611367 0.00607313 0.00219042 0.05989193 0.44573087]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [1.8451032e-01 3.2967057e-02 7.8216380e-01 3.5883443e-04 8.4594953e-09]
Word 18 score: [2.5171929e-03 2.4013096e-02 9.7180319e-01 1.6664370e-03 7.9255493e-08]
Word 19 score: [1.1534820e-06 9.9542171e-01 4.5771603e-03 9.9295888e-19 9.9295888e-19]
Word 20 score: [5.2335443e-05 5.2143910e-06 2.8854524e-04 5.8133394e-01 4.1831997e-01]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
------
1500
where is the k ##rys ##tal restaurant located in cobb county
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
1501
there are numerous locations in cobb county and none of them take reservations . would you like to try another restaurant ?
Predicted label: ['request', 'inform']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1502
i really want to eat some meat ##lo ##af for dinner . is there a restaurant in seattle that serves it ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O B-food I-food I-food O B-mealtype O O O O O O B-city O O O O
Real slot label: O O O O O O B-food I-food I-food O B-mealtype O O O O O O B-city O O O O
Score: 
Word 6 score: [2.2004473e-10 3.5585140e-10 1.7797371e-11 1.8979973e-06 9.9999809e-01]
Word 7 score: [1.6630320e-11 6.1023813e-05 9.3614816e-10 7.5755224e-06 9.9993145e-01]
Word 8 score: [1.7947422e-12 9.0796775e-09 3.2044648e-11 2.3302089e-09 1.0000000e+00]
Word 10 score: [9.9873585e-01 1.5630238e-04 5.1218516e-11 1.1078940e-03 5.9004632e-09]
Word 17 score: [6.3578583e-02 3.4717337e-05 4.4235576e-02 7.9695570e-01 9.5195487e-02]
------
1503
hi . do you have a price range in mind ?
Predicted label: ['request']
Real label: ['request', 'greeting']
Predicted slot label: B-greeting O O O O O O O O O O
Real slot label: B-greeting O O O O O O O O O O
Score: 
Word 0 score: [2.4864884e-04 9.3976252e-02 8.0510728e-02 9.3976252e-02 7.3128814e-01]
------
1504
any would be fine
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-pricing O O O
Real slot label: B-pricing O O O
Score: 
Word 0 score: [1.9088600e-04 2.6730434e-03 7.9227692e-01 7.1603555e-04 2.0414320e-01]
------
1505
what day would you like a reservation for ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
1506
hey there . i want an exotic restaurant in chicago . can you help ?
Predicted label: ['request']
Real label: ['request', 'greeting']
Predicted slot label: B-greeting I-greeting O O O O B-cuisine O O B-city O O O O O
Real slot label: B-greeting I-greeting O O O O B-cuisine O O B-city O O O O O
Score: 
Word 0 score: [9.9334890e-01 6.2512066e-03 2.3932775e-04 1.0913523e-05 1.4967096e-04]
Word 1 score: [0.00723    0.00099113 0.00723    0.97731894 0.00723   ]
Word 6 score: [5.16242504e-01 4.82861400e-01 7.76873785e-04 1.17505355e-04
 1.72702255e-06]
Word 9 score: [4.5091078e-08 9.9700987e-01 6.8718992e-04 2.3026024e-03 2.5082431e-07]
------
1507
sure . what date and time ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
1508
saturday at 6 ##pm . there will be 2 of us
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date O B-starttime I-starttime O O O O B-numberofpeople O O
Real slot label: B-date O B-starttime I-starttime O O O O B-numberofpeople O O
Score: 
Word 0 score: [5.8250617e-02 3.9356667e-01 1.6439791e-06 5.4816377e-01 1.7353144e-05]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
------
1509
i found the following restaurants with exotic type foods : analogue , hands on modern thai and su ##shi bar , chop ##al ka ##ba ##b & steak . which one would you like to reserve ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O B-cuisine O O O B-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O
Real slot label: O O O O O O B-cuisine O O O B-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O
Score: 
Word 6 score: [4.1281730e-01 5.8663434e-01 4.1198605e-04 1.3542960e-04 8.9293951e-07]
Word 10 score: [4.9787748e-01 4.5879590e-04 4.9787748e-01 3.7862901e-03 2.7116611e-09]
Word 12 score: [2.7778503e-02 4.2468879e-13 9.7222102e-01 3.2643395e-11 4.2556098e-07]
Word 13 score: [3.1350940e-09 2.2117923e-09 5.1596840e-06 9.9999404e-01 8.0058732e-07]
Word 14 score: [5.6446479e-06 2.7952707e-08 9.9972719e-01 1.9480117e-07 2.6692511e-04]
Word 15 score: [0.01860468 0.00674287 0.01860468 0.07412937 0.88191855]
Word 16 score: [0.37165046 0.03450024 0.01103856 0.01169617 0.5711146 ]
Word 17 score: [8.9788517e-07 8.7259805e-01 3.1222940e-09 1.2437528e-01 3.0256745e-03]
Word 18 score: [1.8421564e-06 7.1196711e-01 4.3025947e-09 2.8433216e-01 3.6988570e-03]
Word 19 score: [4.4505359e-04 2.2844990e-08 7.3792935e-06 1.1771875e-03 9.9837047e-01]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
Word 26 score: [0.2 0.2 0.2 0.2 0.2]
Word 27 score: [2.7828744e-01 1.3215143e-10 5.0842787e-16 1.2462960e-12 7.2171259e-01]
------
1510
analogue
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname
Real slot label: B-restaurantname
Score: 
Word 0 score: [4.9968818e-01 4.4301845e-04 4.9968818e-01 1.8070953e-04 1.2174637e-08]
------
1511
your reservation was confirmed , enjoy your meal at analogue on saturday at 6 ##pm !
Predicted label: ['inform', 'thanks']
Real label: ['inform']
Predicted slot label: O O O O O B-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing
Real slot label: O O O O O B-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing
Score: 
Word 5 score: [1.2347237e-01 1.1074594e-02 8.4092063e-01 3.2367607e-05 2.4499960e-02]
Word 6 score: [5.7728383e-05 9.9798810e-01 1.9541790e-03 8.3222197e-19 8.3222197e-19]
Word 7 score: [1.1152744e-04 1.0046133e-04 4.8523485e-03 7.4225748e-01 2.5267816e-01]
Word 8 score: [6.0924459e-03 9.9038434e-01 8.2099985e-04 2.7020785e-03 1.4055223e-07]
Word 9 score: [4.9309686e-01 4.3891538e-03 4.9309686e-01 9.4171250e-03 1.3071146e-09]
Word 10 score: [3.5667460e-02 9.6432507e-01 5.5463806e-10 4.1330723e-06 3.3347335e-06]
Word 11 score: [2.5343680e-01 1.7492609e-02 3.8682122e-04 8.2136981e-02 6.4654678e-01]
Word 12 score: [9.3265307e-10 1.0000000e+00 5.2361470e-12 7.6781442e-11 1.2705152e-10]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
------
1512
real authentic italian food in wilmington
Predicted label: ['request']
Real label: ['inform']
Predicted slot label: O O B-cuisine O O O
Real slot label: O O B-cuisine O O O
Score: 
Word 2 score: [9.8961747e-01 6.1759003e-10 4.1038131e-08 4.9087276e-08 1.0382610e-02]
------
1513
what date would you like me to look ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
1514
3 \ / 19 \ / 2016
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date I-date I-date I-date I-date I-date I-date
Real slot label: B-date I-date I-date I-date I-date I-date I-date
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
------
1515
sure . what time , please ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
1516
8 ##pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-starttime I-starttime
Real slot label: B-starttime I-starttime
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
------
1517
which wilmington ? may i have a state , please ?
Predicted label: ['request']
Real label: ['confirm_question']
Predicted slot label: O B-city O O O O O O O O O
Real slot label: O B-city O O O O O O O O O
Score: 
Word 1 score: [3.2477887e-04 1.9373670e-06 5.1756524e-02 2.8718574e-02 9.1919816e-01]
------
1518
north carolina
Predicted label: ['inform']
Real label: ['confirm_answer']
Predicted slot label: B-state I-state
Real slot label: B-state I-state
Score: 
Word 0 score: [3.7981980e-08 9.8506087e-01 2.3252823e-04 1.2671466e-02 2.0350837e-03]
Word 1 score: [2.6262805e-01 1.1409325e-04 1.0990762e-03 1.5200847e-01 5.8415025e-01]
------
1519
how many are going ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
1520
4
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
1521
i can recommend os ##ter ##ia ci ##cc ##hett ##i , which has availability on 3 / 19 at 8 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O B-date I-date I-date O B-starttime I-starttime O
Real slot label: O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O B-date I-date I-date O B-starttime I-starttime O
Score: 
Word 3 score: [9.9999845e-01 1.5398862e-06 3.2107953e-13 3.2107953e-13 3.2107953e-13]
Word 4 score: [9.999931e-01 6.909842e-06 3.514424e-21 3.514424e-21 3.514424e-21]
Word 5 score: [9.8940229e-01 1.0597653e-02 8.0936013e-12 8.0936013e-12 8.0936013e-12]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
------
1522
yes book that
Predicted label: ['confirm_answer']
Real label: ['inform']
Predicted slot label: O O O
Real slot label: O O O
Score: 
------
1523
great , i have made a reservation for you for 4 people at 8 pm on 3 / 19 at os ##ter ##ia ci ##cc ##hett ##i .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O B-numberofpeople O O B-starttime I-starttime O B-date I-date I-date O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O O O O O O O B-numberofpeople O O B-starttime I-starttime O B-date I-date I-date O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [2.0057969e-07 2.7955854e-01 7.2042972e-01 1.1548781e-05 4.4976012e-11]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [9.9999797e-01 2.0012728e-06 4.7913621e-14 4.7913621e-14 4.7913621e-14]
Word 21 score: [9.9997962e-01 2.0386267e-05 1.2757408e-19 1.2757408e-19 1.2757408e-19]
Word 22 score: [9.7616380e-01 2.3836147e-02 3.0662364e-10 3.0662364e-10 3.0662364e-10]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
Word 26 score: [0.2 0.2 0.2 0.2 0.2]
------
1524
hello
Predicted label: ['greeting']
Real label: ['greeting']
Predicted slot label: B-greeting
Real slot label: B-greeting
Score: 
Word 0 score: [4.0650237e-03 9.9537271e-01 5.5657566e-04 2.7999233e-06 2.7999233e-06]
------
1525
hi . would you like to make a restaurant reservation ? if so , what is your location ?
Predicted label: ['request', 'greeting']
Real label: ['request', 'greeting']
Predicted slot label: B-greeting O O O O O O O O O O O O O O O O O O
Real slot label: B-greeting O O O O O O O O O O O O O O O O O O
Score: 
Word 0 score: [3.4970548e-05 1.2123479e-01 1.6118102e-02 1.2123479e-01 7.4137723e-01]
------
1526
can you book the hard rock cafe in seattle on march 21st for 3 people at 3 ##pm ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O B-city O B-date I-date O B-numberofpeople O O B-starttime I-starttime O
Real slot label: O O O O O O O O B-city O B-date I-date O B-numberofpeople O O B-starttime I-starttime O
Score: 
Word 8 score: [3.0596880e-02 4.6095520e-04 3.2824865e-01 6.4045620e-01 2.3733958e-04]
Word 10 score: [2.4679362e-05 8.2379735e-01 2.9880824e-02 8.4885344e-02 6.1411772e-02]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
------
1527
hi . i ' ve booked your reservation for you . thank you .
Predicted label: ['inform', 'greeting', 'thanks']
Real label: ['inform', 'greeting', 'thanks']
Predicted slot label: B-greeting O O O O O O O O O O B-closing I-closing I-closing
Real slot label: B-greeting O O O O O O O O O O B-closing I-closing I-closing
Score: 
Word 0 score: [1.4944978e-04 2.8592750e-01 3.5253812e-02 2.8592750e-01 3.9274180e-01]
Word 11 score: [9.8603144e-03 1.9225595e-06 9.8998231e-01 4.0203163e-10 1.5550890e-04]
Word 12 score: [0.09748551 0.00127833 0.03687226 0.00121656 0.86314726]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
------
1528
can you book the hard rock cafe at 3 pm on march 14th for 2 people in seattle ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O B-starttime I-starttime O B-date I-date O B-numberofpeople O O B-city O
Real slot label: O O O O O O O O B-starttime I-starttime O B-date I-date O B-numberofpeople O O B-city O
Score: 
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [4.4366941e-05 5.9946555e-01 4.0048268e-01 5.5449495e-06 1.8333708e-06]
Word 11 score: [1.0361298e-05 8.8178957e-01 3.9526038e-02 3.7596781e-02 4.1077297e-02]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [8.3106659e-02 1.8599161e-04 4.2761150e-01 4.8896185e-01 1.3408157e-04]
------
1529
your reservation is confirmed for 3 / 14 / 2016 at 3 ##pm at the hard rock cafe in seattle . thank you !
Predicted label: ['inform', 'thanks']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O B-city O B-closing I-closing O
Real slot label: O O O O O O O O O O O O O O O O O O O B-city O B-closing I-closing O
Score: 
Word 19 score: [7.3316514e-02 1.6445246e-03 7.5237960e-01 1.7239943e-01 2.5997037e-04]
Word 21 score: [3.7112318e-03 3.7791757e-08 9.9627078e-01 1.6433165e-10 1.7942699e-05]
Word 22 score: [9.8628020e-01 2.1261219e-03 1.4450909e-03 2.5061372e-05 1.0123562e-02]
------
1530
i ' d like to reserve a table at the nice ##st restaurant in dallas , tx . i have two people in total and it ' s for tomorrow at 8 ##pm
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O B-restauranttype I-restauranttype O O B-city O B-state O O O O O O O O O O O O B-date O B-starttime I-starttime
Real slot label: O O O O O O O O O O B-restauranttype I-restauranttype O O B-city O B-state O O O O O O O O O O O O B-date O B-starttime I-starttime
Score: 
Word 10 score: [1.0000000e+00 3.6214613e-13 3.6214613e-13 3.6214613e-13 3.6214613e-13]
Word 11 score: [1.00000e+00 1.97344e-09 1.97344e-09 1.97344e-09 1.97344e-09]
Word 14 score: [7.97066033e-01 2.00059358e-03 1.24446515e-05 2.53549442e-02
 1.75566033e-01]
Word 16 score: [9.9998486e-01 1.4852705e-05 2.2125124e-07 1.2785611e-15 1.5509179e-11]
Word 29 score: [6.1690885e-01 6.7642711e-02 1.0172526e-07 3.8103165e-06 3.1544459e-01]
Word 31 score: [0.2 0.2 0.2 0.2 0.2]
Word 32 score: [0.2 0.2 0.2 0.2 0.2]
------
1531
the highest rated restaurant in dallas that has an opening at 8 pm tomorrow is cafe pacific , which is a seafood restaurant . i also show an opening at al bi ##ern ##ats , which is ranked very highly and is a steak ##house . would you like to try one of these ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O B-restaurantname I-restaurantname O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O B-restaurantname I-restaurantname O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O O O O O
Score: 
Word 15 score: [1.3656965e-04 9.4032777e-04 8.3558317e-03 7.9693928e-13 9.9056727e-01]
Word 16 score: [5.0447994e-01 2.1704229e-06 4.9548924e-01 2.2653431e-07 2.8379132e-05]
Word 30 score: [4.7849496e-03 2.6616056e-03 9.3088871e-01 8.0650516e-06 6.1656713e-02]
Word 31 score: [0.2 0.2 0.2 0.2 0.2]
Word 32 score: [0.2 0.2 0.2 0.2 0.2]
Word 33 score: [0.2 0.2 0.2 0.2 0.2]
------
1532
wow thank you for being so helpful . i ' ll go with al bi ##ern ##ats !
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 13 score: [2.2401505e-04 1.0764336e-05 2.8649053e-01 1.3691016e-05 7.1326095e-01]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
------
1533
your reservation at al bi ##ern ##ats for 2 on 3 / 8 at 8 ##pm has been successfully booked . enjoy !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-numberofpeople O O O O O B-starttime I-starttime O O O O O B-closing O
Real slot label: O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-numberofpeople O O O O O B-starttime I-starttime O O O O O B-closing O
Score: 
Word 3 score: [1.1327086e-03 1.7458803e-04 9.2902708e-01 2.1553296e-06 6.9663472e-02]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [1.1110858e-01 5.4065231e-03 8.8160276e-01 1.6660006e-05 1.8654995e-03]
------
1534
where is the nearest pizza hut around ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O B-distanceconstraints B-restauranttype I-restauranttype O O
Real slot label: O O O B-distanceconstraints B-restauranttype I-restauranttype O O
Score: 
Word 3 score: [1.00000e+00 7.21566e-11 7.21566e-11 7.21566e-11 7.21566e-11]
Word 4 score: [1.1273742e-02 4.1239080e-08 2.8085234e-09 1.3130419e-04 9.8859489e-01]
Word 5 score: [4.2991364e-01 1.7416053e-02 4.2991364e-01 1.2275671e-01 2.8548303e-10]
------
1535
hi . what city are you located in ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
1536
i need to book a table for 3 / 21 at 7 pm for dinner at the humphrey ##s restaurant in san diego for two guests .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O B-date I-date I-date O O O O B-mealtype O O B-restaurantname I-restaurantname I-restaurantname O B-city I-city O O O O
Real slot label: O O O O O O O B-date I-date I-date O O O O B-mealtype O O B-restaurantname I-restaurantname I-restaurantname O B-city I-city O O O O
Score: 
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [9.9978644e-01 3.9866947e-05 7.4767130e-11 1.7366170e-04 3.8388253e-09]
Word 17 score: [8.7201726e-03 6.6925556e-04 2.7877363e-06 9.8877269e-01 1.8351170e-03]
Word 18 score: [0.00243488 0.3049195  0.00962259 0.0148049  0.66821814]
Word 19 score: [6.80577285e-14 9.16125119e-01 2.19766656e-03 8.16772506e-02
 1.22707934e-17]
Word 21 score: [2.7813687e-07 1.7996633e-01 8.2003307e-01 1.0234504e-07 2.4194352e-07]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
------
1537
i have successfully completed your reservation ! enjoy !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-closing O
Real slot label: O O O O O O O B-closing O
Score: 
Word 7 score: [5.6814011e-02 1.1452686e-02 9.3156314e-01 1.3871648e-04 3.1375032e-05]
------
1538
i would like to book an american restaurant in seattle on 03 / 16 / 16 at 1 : 30 ##pm for 2 people
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O B-restauranttype I-restauranttype O B-city O B-date I-date I-date I-date I-date O B-starttime I-starttime I-starttime I-starttime O B-numberofpeople O
Real slot label: O O O O O O B-restauranttype I-restauranttype O B-city O B-date I-date I-date I-date I-date O B-starttime I-starttime I-starttime I-starttime O B-numberofpeople O
Score: 
Word 6 score: [1.3259499e-03 1.5283995e-10 3.7745322e-05 9.9640107e-01 2.2352682e-03]
Word 7 score: [2.6177277e-04 2.8706104e-01 6.3056332e-01 8.2113951e-02 4.6346604e-16]
Word 9 score: [2.9144572e-02 2.0303915e-04 8.4806204e-02 8.8359135e-01 2.2547257e-03]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
------
1539
i found a few great options for you ! there ' s 1 ) bing ' s , 2 ) coastal kitchen , and 3 ) henry ' s tavern . would you like to book one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O B-restaurantname I-restaurantname O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 14 score: [1.9720013e-04 4.5590344e-01 1.9720013e-04 9.2082328e-06 5.4369295e-01]
Word 15 score: [0.34710258 0.00971178 0.36387834 0.00117339 0.27813393]
Word 16 score: [9.9818099e-01 6.1389342e-06 1.8216332e-07 2.6243017e-06 1.8099429e-03]
Word 20 score: [5.69021583e-01 1.43720733e-03 2.70498872e-01 1.59042343e-01
 1.30960744e-08]
Word 21 score: [6.5717500e-15 9.9999821e-01 1.6691727e-06 1.2264002e-10 9.7213480e-08]
Word 26 score: [0.10388952 0.26983047 0.10955208 0.12049189 0.3962361 ]
Word 27 score: [0.3314894  0.00329577 0.5735998  0.00096216 0.09065286]
Word 28 score: [9.9828351e-01 9.9427516e-06 1.3738621e-07 3.3716105e-06 1.7030359e-03]
Word 29 score: [0.59096485 0.31583533 0.09078015 0.001402   0.00101768]
------
1540
1
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O
Real slot label: O
Score: 
------
1541
your reservation has been confirmed at bing ' s . please enjoy your meal , and thank you for using our service !
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O O O O O O O O O B-closing I-closing I-closing I-closing I-closing I-closing O
Real slot label: O O O O O O O O O O O O O O O O B-closing I-closing I-closing I-closing I-closing I-closing O
Score: 
Word 16 score: [2.9663965e-02 1.5468639e-04 9.6851259e-01 5.8904028e-05 1.6098659e-03]
Word 17 score: [8.5064363e-01 3.2433905e-03 7.2866543e-03 1.0235525e-04 1.3872397e-01]
Word 18 score: [4.9807043e-09 1.1186885e-06 8.7694643e-09 9.9998128e-01 1.7621956e-05]
Word 19 score: [2.0704765e-02 4.6968699e-04 2.0704765e-02 9.5812076e-01 3.2153425e-13]
Word 20 score: [4.30881573e-06 1.00936957e-01 7.39731193e-01 1.16567485e-01
 4.27600220e-02]
Word 21 score: [1.3937689e-02 2.8671490e-04 1.0099804e-02 2.3724684e-02 9.5195109e-01]
------
1542
can you help me to find a good place for american cuisine ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O B-cuisine O O
Real slot label: O O O O O O O O O O B-cuisine O O
Score: 
Word 10 score: [4.0815766e-03 5.1661089e-09 5.0179304e-05 9.9539882e-01 4.6938861e-04]
------
1543
i sure can . what city are you located in ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
1544
i am going to be dining in philadelphia
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-city
Real slot label: O O O O O O O B-city
Score: 
Word 7 score: [9.8189467e-01 1.0607264e-03 1.6860573e-05 1.2967076e-06 1.7026447e-02]
------
1545
do you have a price point in mind ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
1546
pro _ 2016 - 03 - 07 ##t ##22 - 42 - 10 _ 28 ##ff ##f ##49 ##d - 5 ##f ##0 ##9 - 43 ##eb - 83 ##cc - 73 ##6 ##d ##28 ##d ##17 ##2 ##c ##2
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1547
do you have a date you ' re interested in booking ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O
Score: 
------
1548
i need a restaurant that has a business like environment .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O B-restauranttype I-restauranttype I-restauranttype O
Real slot label: O O O O O O O B-restauranttype I-restauranttype I-restauranttype O
Score: 
Word 7 score: [2.1410890e-02 2.4847557e-08 9.7858536e-01 3.6638949e-06 2.0667126e-11]
Word 8 score: [3.3066645e-02 3.8770970e-03 4.7542067e-05 5.1391369e-01 4.4909498e-01]
Word 9 score: [1.3312078e-01 2.0378744e-02 3.7377760e-08 1.6395409e-02 8.3010513e-01]
------
1549
i can try to locate that for you . what city are you in ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O
Score: 
------
1550
new york city .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city I-city O O
Real slot label: B-city I-city O O
Score: 
Word 0 score: [3.8681090e-02 9.6131349e-01 2.1779462e-07 4.4203582e-10 5.1510701e-06]
Word 1 score: [6.8654341e-01 4.8863403e-05 4.0746216e-02 2.7264673e-01 1.4813427e-05]
------
1551
what date would you like me to look for a reservation ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O
Score: 
------
1552
saturday .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date O
Real slot label: B-date O
Score: 
Word 0 score: [1.09099805e-01 6.40630901e-01 5.22217249e-07 2.50266254e-01
 2.55067607e-06]
------
1553
what time would you like to din ##e ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
1554
9 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-starttime I-starttime O
Real slot label: B-starttime I-starttime O
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
------
1555
and how many people will there be ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
1556
2
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
1557
would you like a specific type of cuisine ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
1558
italian .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-cuisine O
Real slot label: B-cuisine O
Score: 
Word 0 score: [9.9999142e-01 1.9995925e-06 3.5144059e-09 5.5852922e-09 6.5195491e-06]
------
1559
i have a few options for you : ci ##rco , cha ##zz palm ##int ##eri , and cellar 58 . would you like to book one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O B-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O
Real slot label: O O O O O O O O B-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O
Score: 
Word 8 score: [1.4417176e-07 9.7961676e-01 2.0203227e-02 1.7987106e-04 1.3737967e-09]
Word 9 score: [3.4351025e-10 8.5137543e-07 3.1886712e-11 9.9999917e-01 1.7767965e-17]
Word 11 score: [5.8245473e-02 7.2304255e-01 3.5046194e-02 1.8357795e-01 8.7851498e-05]
Word 12 score: [2.4914700e-01 4.9411617e-03 8.9020126e-02 6.5675932e-01 1.3241242e-04]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
------
1560
cha ##zz palm ##int ##eri
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [0.02120626 0.304114   0.22972073 0.06328317 0.38167587]
Word 1 score: [7.2052501e-02 2.8217605e-03 9.3819626e-02 8.3128816e-01 1.7894459e-05]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
------
1561
great . what name should be on the reservation ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
1562
mike .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname O
Real slot label: B-personfullname O
Score: 
Word 0 score: [4.8233812e-07 3.8421962e-01 2.2054443e-01 1.7469101e-01 2.2054443e-01]
------
1563
success ! i was able to book a table for 2 at cha ##zz palm ##int ##eri on 3 / 12 at 9 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O
Real slot label: O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O
Score: 
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [1.1880406e-02 7.9073954e-01 2.6275462e-02 1.7110109e-01 3.4897807e-06]
Word 13 score: [1.4948052e-01 3.0450404e-03 2.0206593e-01 6.4537382e-01 3.4593821e-05]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
------
1564
where can i take my wife to make her forget i stayed out too late ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O
Score: 
------
1565
what is your location ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
1566
the dog house ha ##ha , but actually wilmington , nc
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O B-city O B-state
Real slot label: O O O O O O O O B-city O B-state
Score: 
Word 8 score: [1.0776363e-04 8.9424509e-07 2.1583861e-02 3.3202499e-02 9.4510508e-01]
Word 10 score: [1.0000000e+00 6.5485337e-09 6.5485337e-09 6.5485337e-09 6.5485337e-09]
------
1567
what date would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
1568
42 ##44 ##4
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O
Real slot label: O O O
Score: 
------
1569
what time are you looking to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
1570
after our counseling session maybe 7 ##pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O B-starttime I-starttime
Real slot label: O O O O O B-starttime I-starttime
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
------
1571
here are 3 of the top rated restaurants in wilmington : the basics , indo ##chin ##e , and copper penny . would you like to book one of those or would you prefer more options ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O B-city O B-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O B-city O B-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname O O O O O O O O O O O O O O O O
Score: 
Word 9 score: [4.0848029e-04 2.0860425e-06 2.3564352e-01 1.3682756e-02 7.5026321e-01]
Word 11 score: [3.7890121e-02 4.1380413e-03 9.5792747e-01 1.8399747e-05 2.5983014e-05]
Word 12 score: [0.19684511 0.3950783  0.01171979 0.00127849 0.3950783 ]
Word 14 score: [6.2466715e-10 9.9994051e-01 6.7686165e-06 2.6345760e-05 2.6345760e-05]
Word 15 score: [7.8242316e-05 1.0050513e-01 7.1373006e-06 4.4970480e-01 4.4970480e-01]
Word 16 score: [5.0736944e-08 9.9880135e-01 3.2272644e-06 5.9767411e-04 5.9767411e-04]
Word 19 score: [3.42728790e-10 4.93809246e-02 1.13312755e-08 1.02353636e-06
 9.50618029e-01]
Word 20 score: [5.3005889e-14 5.2974606e-01 2.6376612e-02 4.4387737e-01 3.2859777e-11]
------
1572
indo ##chin ##e
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [7.5477496e-05 9.3033373e-01 5.9189624e-04 3.4499452e-02 3.4499452e-02]
Word 1 score: [2.5751221e-04 1.4882408e-01 5.3016693e-06 4.2545655e-01 4.2545655e-01]
Word 2 score: [1.8084364e-07 9.9824095e-01 2.6934590e-06 8.7811315e-04 8.7811315e-04]
------
1573
for how many guests ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
1574
2
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
1575
unfortunately i can not book reservations at that restaurant . would you like to try ruth ' s chris steak house instead ? that is most likely more impressive to your wife anyway ##s .
Predicted label: ['inform', 'confirm_question']
Real label: ['confirm_question']
Predicted slot label: O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O
Score: 
Word 15 score: [3.4807792e-07 1.4016801e-08 9.4847241e-03 5.0484666e-10 9.9051487e-01]
Word 16 score: [9.3947363e-04 9.7336006e-01 4.6798332e-06 2.6643206e-04 2.5429405e-02]
Word 17 score: [3.0042680e-03 9.6565050e-01 1.6725933e-06 1.8255263e-04 3.1160908e-02]
Word 18 score: [9.6668851e-01 5.6926156e-03 2.8837601e-05 3.9278767e-03 2.3662118e-02]
Word 19 score: [1.1391807e-03 4.3870248e-05 4.6825850e-12 6.7290029e-10 9.9881709e-01]
Word 20 score: [4.1683057e-01 4.9810788e-01 4.3895212e-04 1.1321567e-02 7.3300987e-02]
------
1576
yes , do ruth chris steak house
Predicted label: ['confirm_answer']
Real label: ['confirm_answer']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
1577
i have successfully completed your reservation ! enjoy !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-closing O
Real slot label: O O O O O O O B-closing O
Score: 
Word 7 score: [2.6576925e-02 9.4880322e-03 9.6368134e-01 1.7563209e-04 7.8109922e-05]
------
1578
i need a cheap food place for 3 people tomorrow at 1 ##pm in seattle
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O B-restauranttype I-restauranttype O O B-numberofpeople O B-date O B-starttime I-starttime O B-city
Real slot label: O O O B-restauranttype I-restauranttype O O B-numberofpeople O B-date O B-starttime I-starttime O B-city
Score: 
Word 3 score: [9.9993789e-01 3.1858016e-07 2.9046388e-09 5.3278261e-05 8.4910362e-06]
Word 4 score: [1.1183780e-02 6.1261162e-06 9.7643560e-01 1.1004681e-02 1.3698204e-03]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [5.4396305e-02 7.1716448e-03 9.3998182e-07 4.8238430e-06 9.3842626e-01]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [2.7231202e-02 1.4423716e-04 8.9946255e-02 8.7449908e-01 8.1792055e-03]
------
1579
i found three restaurants , ag ##ave co ##cina & can ##tina , basil ' s kitchen , and stanford ' s . which would you like to book ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O
Real slot label: O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O
Score: 
Word 5 score: [1.5875453e-03 3.0734865e-03 1.1443796e-04 9.9522394e-01 5.9486041e-07]
Word 6 score: [3.5104670e-03 9.9266452e-01 5.9893504e-05 3.7650818e-03 1.8253718e-11]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [2.1009553e-02 9.5235181e-01 2.6607038e-02 3.1557174e-05 1.5539211e-09]
Word 11 score: [2.3462446e-02 9.4454938e-01 3.1945191e-02 4.2986969e-05 2.3624429e-09]
Word 13 score: [6.5881819e-01 2.5438544e-06 2.5438544e-06 3.4117422e-01 2.5438544e-06]
Word 14 score: [0.25045452 0.00232412 0.558024   0.00141292 0.1877844 ]
Word 15 score: [9.9656361e-01 3.3983815e-06 3.5244028e-07 4.4302246e-06 3.4282003e-03]
Word 16 score: [2.2494023e-12 9.9999404e-01 5.9401423e-06 4.4061848e-11 1.1122034e-09]
Word 19 score: [9.9997747e-01 4.1496926e-07 1.5876398e-05 6.0639227e-06 2.1603040e-07]
Word 20 score: [0.25576177 0.00070097 0.6670026  0.00098935 0.07554523]
Word 21 score: [9.9855953e-01 6.0810447e-07 2.4332309e-07 1.9091283e-06 1.4376986e-03]
------
1580
ok basil ' s kitchen please
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Real slot label: O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 1 score: [8.4105295e-01 1.7668715e-06 1.7668715e-06 1.5894176e-01 1.7668715e-06]
Word 2 score: [1.8020213e-01 2.3221632e-04 7.8614992e-01 4.0205428e-04 3.3013631e-02]
Word 3 score: [9.9805957e-01 6.6446901e-06 2.7879667e-06 1.3919934e-05 1.9170456e-03]
Word 4 score: [2.2138953e-13 9.9998331e-01 1.6691612e-05 1.1654418e-10 6.7856842e-10]
------
1581
great , your reservation at basil ' s kitchen is confirmed , thank you .
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O
Real slot label: O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O
Score: 
Word 5 score: [2.5425947e-03 1.0589811e-06 1.0589811e-06 9.9745423e-01 1.0589811e-06]
Word 6 score: [6.1578029e-01 2.1967934e-04 6.2620766e-02 3.6338987e-04 3.2101589e-01]
Word 7 score: [9.9708885e-01 3.6310726e-07 3.8012491e-08 1.3441345e-06 2.9095383e-03]
Word 8 score: [1.2609175e-10 9.9999881e-01 1.1909824e-06 1.3299310e-10 1.3725023e-08]
------
1582
hello , can you assist me in booking a restaurant for 2 people on march 9th at 7 : 00pm . my budget is around $ 40 per person . can you show me a list of steak house restaurants that fit this criteria ?
Predicted label: ['request', 'greeting']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O B-numberofpeople O O B-date I-date O O O O O O O O B-pricing I-pricing I-pricing I-pricing I-pricing O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O B-numberofpeople O O B-date I-date O O O O O O O O B-pricing I-pricing I-pricing I-pricing I-pricing O O O O O O O O O O O O O O O O
Score: 
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [2.7225694e-06 5.8827454e-01 4.9104366e-02 9.2927404e-02 2.6969102e-01]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [4.9949074e-01 4.9970609e-01 1.8199274e-04 1.8199274e-04 4.3914598e-04]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
Word 26 score: [0.2 0.2 0.2 0.2 0.2]
Word 27 score: [2.9604239e-09 3.1368558e-08 1.3649818e-06 2.4401837e-07 9.9999845e-01]
Word 28 score: [1.9367809e-04 6.2000537e-11 6.8732362e-07 5.6701413e-07 9.9980503e-01]
------
1583
where are you located ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
1584
indianapolis indiana .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city I-city O
Real slot label: B-city I-city O
Score: 
Word 0 score: [0.5990489  0.06377177 0.01852075 0.2349156  0.08374291]
Word 1 score: [1.0637031e-06 3.9340527e-04 3.1380067e-05 9.9957412e-01 5.7808508e-10]
------
1585
i found three restaurants , fleming ' s steak ##house , peterson ' s , and ocean prime . which would you like to book ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname O O O O O O O O
Real slot label: O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname O O O O O O O O
Score: 
Word 5 score: [6.0738457e-06 5.9998433e-06 1.9431705e-09 9.1531956e-01 8.4668353e-02]
Word 6 score: [0.65522623 0.00547578 0.15838248 0.00086238 0.18005307]
Word 7 score: [9.9803263e-01 5.8402752e-06 6.8861674e-08 2.5128513e-06 1.9589611e-03]
Word 8 score: [2.6985363e-16 8.9492527e-23 5.3227909e-21 2.3775159e-19 1.0000000e+00]
Word 9 score: [2.9958859e-16 9.9029729e-23 5.5340035e-21 2.6659948e-19 1.0000000e+00]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [8.1744856e-01 1.6417042e-03 9.4065100e-02 4.7369907e-04 8.6371019e-02]
Word 13 score: [9.9809235e-01 5.1388142e-06 8.0621220e-08 2.2473935e-06 1.9001731e-03]
Word 16 score: [4.4799680e-08 9.9991190e-01 1.8567191e-06 3.6485908e-05 4.9740083e-05]
Word 17 score: [9.9197817e-01 1.8399241e-08 7.5903623e-03 4.3144746e-04 2.9273480e-12]
------
1586
book ocean prime please .
Predicted label: ['inform']
Real label: ['request']
Predicted slot label: O B-restaurantname I-restaurantname O O
Real slot label: O B-restaurantname I-restaurantname O O
Score: 
Word 1 score: [1.1926182e-09 9.9999297e-01 4.0357165e-08 6.3137927e-06 7.3069759e-07]
Word 2 score: [9.9989116e-01 1.3856840e-09 9.1368325e-05 1.7440278e-05 1.4814728e-13]
------
1587
i ' m sorry , i was unable to find a table at 7 pm . however , ocean prime has openings at 6 : 45 pm , 7 : 15 pm , and 7 : 30 pm . do any of these interest you ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1588
yes , book 7 : 30 ##pm please .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O B-starttime I-starttime I-starttime I-starttime O O
Real slot label: O O O B-starttime I-starttime I-starttime I-starttime O O
Score: 
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
------
1589
your reservation at ocean prime on 03 / 09 / 2016 for 7 : 30 ##pm was confirmed for 2 people . enjoy your meal .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O B-restaurantname I-restaurantname O B-date I-date I-date I-date I-date O B-starttime I-starttime I-starttime I-starttime O O O B-numberofpeople O O B-closing I-closing I-closing O
Real slot label: O O O B-restaurantname I-restaurantname O B-date I-date I-date I-date I-date O B-starttime I-starttime I-starttime I-starttime O O O B-numberofpeople O O B-closing I-closing I-closing O
Score: 
Word 3 score: [1.6498229e-08 9.9987280e-01 1.1679076e-06 1.1943536e-04 6.5571717e-06]
Word 4 score: [9.9633503e-01 3.2517418e-09 3.4431990e-03 2.2172935e-04 1.7080783e-13]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [7.2113261e-02 3.9930353e-03 9.2338163e-01 1.2124934e-05 4.9990229e-04]
Word 23 score: [5.2400512e-05 9.9254346e-01 7.4041113e-03 1.3734515e-20 1.3734515e-20]
Word 24 score: [8.6651935e-06 4.9462051e-06 9.4116192e-05 8.8290972e-01 1.1698253e-01]
------
1590
reserve circa 1922 in wilmington , nc for a party of 4 on thursday night at 8 ##pm
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O B-restaurantname O O B-city O B-state O O O O B-numberofpeople O B-date I-date O B-starttime I-starttime
Real slot label: O B-restaurantname O O B-city O B-state O O O O B-numberofpeople O B-date I-date O B-starttime I-starttime
Score: 
Word 1 score: [1.0000000e+00 2.3449992e-12 5.9024460e-13 5.4136386e-14 7.1588677e-14]
Word 4 score: [9.7228600e-05 7.5108863e-07 3.1622618e-02 6.3768797e-02 9.0451062e-01]
Word 6 score: [1.0000000e+00 1.7002619e-12 1.7002619e-12 1.7002619e-12 1.7002619e-12]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.9018082  0.03425142 0.00118489 0.01744776 0.04530779]
Word 14 score: [6.0951580e-13 5.0000000e-01 9.1941418e-13 5.0000000e-01 4.3553084e-16]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
------
1591
your reservation is confirmed ! please enjoy your meal , and thank you for using our service .
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O
Score: 
------
1592
hi i am looking to book a good bb ##q restaurant in san antonia texas
Predicted label: ['request', 'greeting']
Real label: ['request']
Predicted slot label: O O O O O O O O B-restauranttype I-restauranttype O O B-city I-city B-state
Real slot label: O O O O O O O O B-restauranttype I-restauranttype O O B-city I-city B-state
Score: 
Word 8 score: [2.81494825e-13 2.23666165e-13 1.05490335e-05 2.75193568e-04
 9.99714196e-01]
Word 9 score: [8.4869084e-11 2.0109056e-15 9.5472336e-01 4.5276668e-02 2.4321918e-09]
Word 12 score: [1.3473709e-05 5.2252240e-02 9.4773412e-01 3.9566412e-08 8.4008185e-08]
Word 13 score: [9.9605548e-01 3.8938483e-03 5.0218441e-05 3.9059356e-07 3.4014619e-10]
Word 14 score: [2.2752177e-02 2.2691199e-06 9.7713506e-01 1.0875952e-04 1.7166482e-06]
------
1593
what date would you like to make the reservation ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
1594
i would like to make reservations on 3 \ / 18
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-date I-date I-date I-date
Real slot label: O O O O O O O B-date I-date I-date I-date
Score: 
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
------
1595
thanks . i ' ll also need to know a time range and number of guests , please .
Predicted label: ['request', 'thanks']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O
Score: 
------
1596
looking for something around 6 : 30 and there will be 4 of us going , we are looking for some cheap but good bb ##q
Predicted label: ['inform']
Real label: ['request']
Predicted slot label: O O O B-starttime I-starttime I-starttime I-starttime O O O O B-numberofpeople O O O O O O O O O B-pricing O O O O
Real slot label: O O O B-starttime I-starttime I-starttime I-starttime O O O O B-numberofpeople O O O O O O O O O B-pricing O O O O
Score: 
Word 3 score: [9.98705864e-01 1.27076940e-03 1.14971745e-05 1.14971745e-05
 3.92699519e-07]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [6.44036010e-02 2.08495883e-04 1.32274113e-06 9.35278177e-01
 1.08411405e-04]
------
1597
here are 3 of the top rated bb ##q places in san antonio : dick ' s last resort , smoke the restaurant , the gran ##ary ' cue & brew . would you like to try one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['request', 'inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 14 score: [2.9423574e-02 7.9973370e-01 3.6418198e-05 1.7076194e-01 4.4445449e-05]
Word 15 score: [0.56105614 0.00419451 0.14233421 0.0021071  0.29030806]
Word 16 score: [9.9799663e-01 4.9832488e-06 4.2198728e-08 3.8677708e-06 1.9945032e-03]
Word 17 score: [6.4622101e-05 5.6983549e-02 1.8172532e-05 6.8873250e-01 2.5420117e-01]
Word 18 score: [4.3067746e-05 3.3515969e-01 6.2288022e-01 8.1293685e-03 3.3787645e-02]
Word 20 score: [4.7248544e-05 9.9444133e-01 4.7745816e-03 1.8662104e-06 7.3492707e-04]
Word 21 score: [3.3530407e-04 6.7215733e-02 9.1459745e-01 8.2320228e-05 1.7769169e-02]
Word 22 score: [2.8620712e-13 2.2872420e-01 3.6210809e-03 7.6765466e-01 5.1781072e-16]
Word 24 score: [1.6748156e-02 4.1753836e-03 9.7898269e-01 2.5122841e-05 6.8655085e-05]
Word 25 score: [9.9999654e-01 2.8784706e-11 3.5136047e-06 1.0353614e-11 9.3884698e-13]
Word 26 score: [9.9541950e-01 1.0841465e-08 4.5121741e-03 6.8325688e-05 1.1567302e-08]
Word 27 score: [2.5736165e-04 9.3979013e-01 3.1159467e-03 3.1768015e-04 5.6518823e-02]
Word 28 score: [2.3095332e-04 9.4610566e-01 2.9927294e-03 3.4625191e-04 5.0324380e-02]
Word 29 score: [0.2 0.2 0.2 0.2 0.2]
Word 30 score: [9.7379285e-01 1.4606669e-02 1.1582806e-02 1.5956908e-05 1.6359378e-06]
------
1598
please book the gran ##ary ' cue & brew
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 2 score: [1.0714853e-02 4.2429646e-03 9.8502314e-01 3.4598193e-06 1.5597669e-05]
Word 3 score: [9.9999380e-01 2.2894235e-11 6.2392164e-06 1.2662633e-11 5.5375604e-13]
Word 4 score: [9.9998629e-01 4.6749761e-12 1.3654295e-05 3.7164086e-10 3.7820281e-12]
Word 5 score: [3.1983876e-07 9.5121682e-01 1.0835594e-03 1.2861544e-04 4.7570683e-02]
Word 6 score: [3.2868900e-07 9.5652646e-01 1.0691811e-03 1.4789673e-04 4.2256158e-02]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [9.9045384e-01 8.8795135e-03 6.5808551e-04 8.3441982e-06 2.0538485e-07]
------
1599
i ' ve booked your reservation at the the gran ##ary ' cue & brew on 03 / 18 / 2016 , enjoy your meal !
Predicted label: ['inform']
Real label: ['inform', 'closing']
Predicted slot label: O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date I-date I-date O B-closing I-closing I-closing O
Real slot label: O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date I-date I-date O B-closing I-closing I-closing O
Score: 
Word 8 score: [1.4292185e-02 3.9648777e-03 9.8172015e-01 3.9822576e-06 1.8901712e-05]
Word 9 score: [9.9999094e-01 2.3969116e-10 9.0597323e-06 1.9152974e-10 2.6670790e-12]
Word 10 score: [9.9772805e-01 6.9165171e-09 2.2644559e-03 7.4821878e-06 4.6787538e-09]
Word 11 score: [1.7666107e-06 9.5028710e-01 4.8114546e-03 9.9034642e-04 4.3909367e-02]
Word 12 score: [4.4081415e-07 8.7513107e-01 1.9577522e-02 1.4875531e-03 1.0380348e-01]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [9.9771130e-01 2.0998078e-03 1.7975198e-04 8.9532168e-06 2.0006851e-07]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [2.1716656e-01 1.0825726e-02 7.3062652e-01 4.0388291e-05 4.1340850e-02]
Word 23 score: [8.6395245e-05 9.9830866e-01 1.6049467e-03 1.6914603e-18 1.6914603e-18]
Word 24 score: [2.7495128e-04 8.3506508e-05 2.3287737e-03 7.6874948e-01 2.2856335e-01]
------
1600
i would like to book an chinese restaurant in seattle on 02 / 22 / 2016 at 5 : 30 ##pm for 10 people
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O B-cuisine O O B-city O B-date I-date I-date I-date I-date O B-starttime I-starttime I-starttime I-starttime O B-numberofpeople O
Real slot label: O O O O O O B-cuisine O O B-city O B-date I-date I-date I-date I-date O B-starttime I-starttime I-starttime I-starttime O B-numberofpeople O
Score: 
Word 6 score: [9.9374795e-01 3.5501631e-05 9.6104335e-04 5.2303397e-03 2.5083980e-05]
Word 9 score: [3.2558646e-02 1.6062778e-04 7.9004608e-02 8.8756692e-01 7.0925721e-04]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
------
1601
that date is in the past , can you provide a valid date ?
Predicted label: ['request']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O
Score: 
------
1602
this system works great to catch that how about 3 / 22 / 2016
Predicted label: []
Real label: ['request']
Predicted slot label: O O O O O O O O O B-date I-date I-date I-date I-date
Real slot label: O O O O O O O O O B-date I-date I-date I-date I-date
Score: 
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
------
1603
i am sorry i can not find any chinese restaurants that can book a party of 10 at that time / date . would you like to try a different style of food ?
Predicted label: ['request', 'inform', 'confirm_question']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O B-cuisine O O O O O O O B-numberofpeople O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O B-cuisine O O O O O O O B-numberofpeople O O O O O O O O O O O O O O O O O
Score: 
Word 8 score: [9.9886000e-01 1.6238126e-05 1.3598919e-04 9.7811059e-04 9.6243311e-06]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
------
1604
american please
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-cuisine O
Real slot label: B-cuisine O
Score: 
Word 0 score: [2.7854296e-03 7.8969896e-01 3.6101145e-04 2.0715454e-01 6.9723676e-08]
------
1605
i found three restaurants for you to choose from , anthony ' s pier 66 , ballard annex oyster house , and brave horse tavern . which would you like to book ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O
Real slot label: O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O
Score: 
Word 10 score: [1.5813531e-07 2.2438692e-02 8.2569107e-02 5.9527260e-01 2.9971948e-01]
Word 11 score: [0.63512397 0.00112186 0.21271674 0.00236182 0.14867565]
Word 12 score: [9.9912030e-01 1.3540274e-06 3.5852004e-08 4.7903645e-06 8.7345706e-04]
Word 13 score: [1.3175407e-10 2.2694452e-05 4.5218314e-03 7.3516842e-09 9.9545550e-01]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [9.9999666e-01 8.3321754e-07 8.3321754e-07 8.3321754e-07 8.3321754e-07]
Word 17 score: [4.4646302e-05 9.9569654e-01 3.4722560e-03 4.3460217e-04 3.5203950e-04]
Word 18 score: [9.2547917e-01 4.3093711e-02 3.1411346e-02 7.6985094e-09 1.5789321e-05]
Word 19 score: [0.00229331 0.88372403 0.00306698 0.07087414 0.04004156]
Word 22 score: [9.3491209e-01 1.5609052e-07 4.0737141e-02 1.5378258e-07 2.4350420e-02]
Word 23 score: [1.3013873e-02 9.8698610e-01 5.1014214e-18 3.9291866e-13 3.4136423e-11]
Word 24 score: [6.1673236e-01 3.1920555e-01 6.2330067e-02 1.2597074e-03 4.7229649e-04]
------
1606
anthony ' s pier 66 sounds awesome
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O
Score: 
Word 0 score: [9.2325007e-07 3.6766094e-01 8.0558266e-03 4.7322822e-01 1.5105411e-01]
Word 1 score: [5.4285109e-01 4.8234695e-04 3.4224910e-01 1.9631477e-03 1.1245437e-01]
Word 2 score: [9.9915504e-01 9.3980407e-07 5.2706039e-08 4.4028011e-06 8.3954411e-04]
Word 3 score: [7.0986023e-11 1.0854060e-05 1.0168470e-03 1.3784354e-08 9.9897230e-01]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
------
1607
i have successfully booked your reservation at anthony ' s pier 66 for 10 guests on 3 / 22 at 5 : 30 ##pm . enjoy !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-numberofpeople O O B-date I-date I-date O B-starttime I-starttime I-starttime I-starttime O B-closing O
Real slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-numberofpeople O O B-date I-date I-date O B-starttime I-starttime I-starttime I-starttime O B-closing O
Score: 
Word 7 score: [2.3408569e-08 2.5249876e-02 3.3090005e-03 9.2364484e-01 4.7796272e-02]
Word 8 score: [8.1287062e-01 1.2064654e-04 7.2130963e-02 8.2566397e-04 1.1405209e-01]
Word 9 score: [9.9917620e-01 5.4417433e-07 3.4737976e-08 2.9703758e-06 8.2020892e-04]
Word 10 score: [1.2639044e-10 1.2497403e-05 9.3715644e-04 3.6238397e-08 9.9905032e-01]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [1.2624957e-01 4.9386299e-03 8.6290246e-01 2.1133430e-05 5.8882167e-03]
------
1608
can you book the hard rock cafe in seattle on march 21st for 3 people at 1 ##pm ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O B-city O B-date I-date O B-numberofpeople O O B-starttime I-starttime O
Real slot label: O O O O O O O O B-city O B-date I-date O B-numberofpeople O O B-starttime I-starttime O
Score: 
Word 8 score: [1.3355484e-02 2.3977637e-04 7.4890651e-02 9.1135669e-01 1.5740673e-04]
Word 10 score: [1.7021355e-05 8.9198804e-01 3.5051070e-02 4.1360714e-02 3.1583242e-02]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
------
1609
what name would you like to book the reservation under ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
1610
chevy chase
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname I-personfullname
Real slot label: B-personfullname I-personfullname
Score: 
Word 0 score: [0.14365752 0.5871193  0.2640047  0.00137371 0.00384478]
Word 1 score: [2.1957031e-02 2.7774261e-08 9.3757357e-08 9.7778988e-01 2.5296284e-04]
------
1611
your reservation at the hard rock cafe on march 21st at 1 ##pm was confirmed for 3 people under chevy chase . enjoy your meal !
Predicted label: ['inform']
Real label: ['inform', 'closing']
Predicted slot label: O O O O O O O O B-date I-date O B-starttime I-starttime O O O B-numberofpeople O O B-personfullname I-personfullname O B-closing I-closing I-closing I-closing
Real slot label: O O O O O O O O B-date I-date O B-starttime I-starttime O O O B-numberofpeople O O B-personfullname I-personfullname O B-closing I-closing I-closing I-closing
Score: 
Word 8 score: [3.7980999e-06 7.3615575e-01 3.5867084e-02 1.4816692e-02 2.1315669e-01]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [9.6805656e-01 2.7606215e-03 2.8032089e-02 5.4857216e-04 6.0200033e-04]
Word 20 score: [2.2317178e-03 7.1253076e-10 2.8177658e-08 9.9776006e-01 8.1209382e-06]
Word 22 score: [1.8096530e-01 3.3383067e-03 8.0665356e-01 1.0233309e-05 9.0326350e-03]
Word 23 score: [5.2162522e-05 9.9791425e-01 2.0336111e-03 1.2129219e-18 1.2129219e-18]
Word 24 score: [3.0647898e-05 6.5233976e-06 3.1286266e-04 8.7216043e-01 1.2748951e-01]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
------
1612
where can i get good indian food in wilmington ; nc
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O B-state
Real slot label: O O O O O O O O O O B-state
Score: 
Word 10 score: [1.000000e+00 1.426776e-11 1.426776e-11 1.426776e-11 1.426776e-11]
------
1613
unfortunately i can not find any indian restaurants available for booking on open ##table in wilmington ; nc . would you like to try a different type of cuisine ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O B-state O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O B-state O O O O O O O O O O O O
Score: 
Word 17 score: [1.000000e+00 1.124407e-12 1.124407e-12 1.124407e-12 1.124407e-12]
------
1614
asian
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-cuisine
Real slot label: B-cuisine
Score: 
Word 0 score: [3.4995384e-05 3.2860353e-07 4.7530370e-06 9.9995375e-01 6.1683158e-06]
------
1615
i found the following restaurants that fit your criteria : yo sake downtown su ##shi lounge . would you like to book ?
Predicted label: ['inform', 'confirm_question']
Real label: ['inform', 'confirm_question']
Predicted slot label: O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O
Real slot label: O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O
Score: 
Word 10 score: [6.3623584e-06 9.9789399e-01 2.0983946e-03 1.3480941e-08 1.3239741e-06]
Word 11 score: [0.4921988  0.02052435 0.4789399  0.00239223 0.00594468]
Word 12 score: [1.6638919e-09 9.9999535e-01 1.6649482e-10 5.5124735e-07 4.0497030e-06]
Word 13 score: [7.6645674e-06 8.6249673e-01 1.9869027e-08 1.3698576e-01 5.0975947e-04]
Word 14 score: [4.0295986e-06 9.2438745e-01 1.2708010e-08 7.5203173e-02 4.0538705e-04]
Word 15 score: [2.4583405e-02 1.8330092e-04 1.0131468e-01 8.7384248e-01 7.6120836e-05]
------
1616
yes
Predicted label: ['confirm_answer']
Real label: ['confirm_answer']
Predicted slot label: O
Real slot label: O
Score: 
------
1617
what date and time ; please ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
1618
friday at 8 ##pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date O B-starttime I-starttime
Real slot label: B-date O B-starttime I-starttime
Score: 
Word 0 score: [9.8143584e-01 5.6799655e-03 1.1807240e-02 4.2299280e-04 6.5387780e-04]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
------
1619
how many people are going ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O
Real slot label: O O O O O O
Score: 
------
1620
4
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
1621
your reservation at yo sake downtown su ##shi lounge was confirmed for friday at 8 ##pm for 4 people . enjoy your meal !
Predicted label: ['inform', 'closing']
Real label: ['inform']
Predicted slot label: O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-date O B-starttime I-starttime O B-numberofpeople O O B-closing I-closing I-closing O
Real slot label: O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-date O B-starttime I-starttime O B-numberofpeople O O B-closing I-closing I-closing O
Score: 
Word 3 score: [1.9598757e-07 9.9894840e-01 1.0513456e-03 6.3326072e-10 3.4489702e-08]
Word 4 score: [0.8022559  0.00987541 0.04434906 0.00097889 0.14254065]
Word 5 score: [1.2333528e-09 9.9999738e-01 8.1490459e-09 1.4338581e-06 1.1769673e-06]
Word 6 score: [2.7078251e-05 9.4610512e-01 5.4523531e-07 4.3907534e-02 9.9596577e-03]
Word 7 score: [1.9479396e-05 9.7381216e-01 4.7795510e-07 1.6469847e-02 9.6980743e-03]
Word 8 score: [4.4679265e-02 9.4066003e-05 3.8730437e-03 9.5133549e-01 1.8176876e-05]
Word 12 score: [7.5483245e-01 5.2405475e-03 1.2673002e-04 2.3802333e-01 1.7769565e-03]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [1.45402597e-02 4.64089140e-02 9.36158657e-01 1.07226544e-04
 2.78487732e-03]
Word 21 score: [2.2397600e-05 9.8291999e-01 1.7057594e-02 2.0951527e-17 2.0951527e-17]
Word 22 score: [8.4814237e-05 3.5497400e-05 1.3789712e-03 5.5695581e-01 4.4154483e-01]
------
1622
book me a table for 2 in seattle for tomorrow at 7 : 00 pm at po ##mer ##ol
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname
Real slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [4.5691766e-02 2.3785757e-04 9.0352178e-02 8.6332190e-01 3.9635165e-04]
Word 9 score: [5.4082119e-01 7.4628659e-02 1.5865515e-07 1.4589822e-06 3.8454854e-01]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
------
1623
your reservation at po ##mer ##ol for 7 ##pm on 03 / 08 / 2016 was confirmed for 2 people . enjoy your meal .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O B-restaurantname I-restaurantname I-restaurantname O O O O B-date I-date I-date I-date I-date O O O B-numberofpeople O O B-closing I-closing I-closing O
Real slot label: O O O B-restaurantname I-restaurantname I-restaurantname O O O O B-date I-date I-date I-date I-date O O O B-numberofpeople O O B-closing I-closing I-closing O
Score: 
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [1.5983804e-01 5.4512140e-03 8.3111030e-01 2.9612282e-05 3.5709182e-03]
Word 22 score: [3.9675077e-05 9.9699593e-01 2.9644640e-03 2.2914234e-19 2.2914234e-19]
Word 23 score: [4.2988206e-05 1.9040677e-05 3.7247446e-04 8.0921614e-01 1.9034943e-01]
------
1624
i am looking for a place with vega ##n options .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O B-food I-food O O
Real slot label: O O O O O O O B-food I-food O O
Score: 
Word 7 score: [0.00701667 0.95819026 0.00701667 0.01388822 0.01388822]
Word 8 score: [5.4610254e-09 5.7990575e-01 5.4610254e-09 2.1004716e-01 2.1004716e-01]
------
1625
where are you located ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
1626
san antonio .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city I-city O
Real slot label: B-city I-city O
Score: 
Word 0 score: [6.0820042e-09 3.2053565e-06 9.9940801e-01 3.5883144e-11 5.8881170e-04]
Word 1 score: [9.9997807e-01 5.4724419e-06 5.4724419e-06 5.4724419e-06 5.4724419e-06]
------
1627
here are 3 of the top rated restaurants in san antonio with vega ##n options : green vegetarian cuisine , os ##tra , and sweet ya ##ms .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O B-rating I-rating O O B-city I-city O B-food I-food O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O O B-rating I-rating O O B-city I-city O B-food I-food O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 5 score: [2.5538918e-06 4.4188128e-05 1.3320410e-07 4.9997658e-01 4.9997658e-01]
Word 6 score: [8.5901070e-01 9.4301993e-04 5.3994254e-11 7.6500102e-13 1.4004628e-01]
Word 9 score: [7.9037363e-08 5.8732259e-01 4.1267696e-01 2.9855966e-07 1.1043043e-07]
Word 10 score: [9.9958187e-01 1.0454309e-04 1.0454309e-04 1.0454309e-04 1.0454309e-04]
Word 12 score: [0.00211621 0.98021036 0.00211621 0.00777864 0.00777864]
Word 13 score: [0.00253691 0.28153968 0.00253691 0.35669327 0.35669327]
Word 16 score: [3.4296582e-04 8.2115328e-01 1.7717545e-01 1.1627552e-03 1.6554435e-04]
Word 17 score: [7.38126814e-01 8.09679193e-07 1.14774205e-01 1.47097781e-01
 4.59502360e-07]
Word 18 score: [1.0442219e-12 9.9999642e-01 3.7561967e-14 3.5222736e-06 7.9506510e-15]
Word 20 score: [3.30778603e-05 9.99931455e-01 4.35170648e-07 2.13319981e-05
 1.36496665e-05]
Word 21 score: [9.9800235e-01 1.6506055e-03 1.1693517e-04 2.2332210e-04 6.7452611e-06]
Word 24 score: [2.0909296e-02 5.4922060e-04 8.6007556e-03 9.6937650e-01 5.6425791e-04]
Word 25 score: [7.8405656e-02 2.9510742e-01 6.2648696e-01 1.1345710e-18 1.1345710e-18]
Word 26 score: [9.9858260e-01 2.2070479e-10 1.4174167e-03 5.1222203e-14 5.1222203e-14]
------
1628
green vegetarian cuisine
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [1.1321478e-04 9.9455303e-01 2.9111158e-03 2.4181514e-03 4.5552470e-06]
Word 1 score: [3.3288997e-02 1.1384241e-07 1.4030060e-01 8.2641029e-01 1.1298056e-08]
Word 2 score: [2.8279453e-12 9.9999619e-01 2.3174366e-15 3.7900350e-06 6.1728454e-15]
------
1629
great - what day are you looking to make a reservation for ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O
Score: 
------
1630
i ' d like to make a reservation for 3 at bone ##fish grill in macon , ga , for tomorrow evening at 6 : 00
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O B-city O B-state O O B-date I-date O B-starttime I-starttime I-starttime
Real slot label: O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O B-city O B-state O O B-date I-date O B-starttime I-starttime I-starttime
Score: 
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [7.2733400e-07 6.2637913e-01 1.4497148e-08 3.7362018e-01 6.3608154e-09]
Word 12 score: [2.8575225e-05 9.9990678e-01 7.9051387e-07 6.3834086e-05 2.0014020e-11]
Word 13 score: [3.7034001e-18 5.7998311e-19 3.5546962e-04 2.7248708e-16 9.9964452e-01]
Word 15 score: [9.1924386e-07 1.5779039e-08 2.4847825e-05 3.9376816e-13 9.9997425e-01]
Word 17 score: [4.1107975e-02 5.7890534e-06 4.3502991e-05 1.1595249e-07 9.5884252e-01]
Word 20 score: [8.6795264e-01 6.7079619e-02 1.2314669e-07 2.5457537e-06 6.4965092e-02]
Word 21 score: [0.00699976 0.00188782 0.08435055 0.6628967  0.24386515]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
------
1631
i ' m sorry , bone ##fish grill in macon , ga does not offer reservation through this service . would you like to receive options for seafood restaurants that are available to book ?
Predicted label: ['inform', 'confirm_question']
Real label: ['request', 'inform']
Predicted slot label: O O O O O B-restaurantname I-restaurantname I-restaurantname O B-city O B-state O O O O O O O O O O O O O O O B-cuisine O O O O O O O
Real slot label: O O O O O B-restaurantname I-restaurantname I-restaurantname O B-city O B-state O O O O O O O O O O O O O O O B-cuisine O O O O O O O
Score: 
Word 5 score: [1.9480163e-07 6.2104661e-02 1.8777058e-08 9.3789512e-01 1.4260542e-09]
Word 6 score: [2.2714479e-05 9.9974138e-01 4.3267828e-06 2.3153615e-04 1.1956921e-11]
Word 7 score: [1.0208086e-16 1.2700431e-17 6.2158151e-04 1.0501640e-15 9.9937844e-01]
Word 9 score: [7.4443583e-06 2.5852879e-07 1.4504524e-04 7.0338796e-12 9.9984729e-01]
Word 11 score: [7.90515915e-02 3.73802300e-06 1.10004214e-04 4.12124746e-06
 9.20830548e-01]
Word 27 score: [7.2158240e-05 9.5958507e-01 3.2886684e-02 4.6036774e-05 7.4101426e-03]
------
1632
yes
Predicted label: ['confirm_answer']
Real label: ['confirm_answer']
Predicted slot label: O
Real slot label: O
Score: 
------
1633
unfortunately it looks like macon is not in our system yet , would you be okay with something in atlanta ?
Predicted label: ['inform', 'confirm_question']
Real label: ['inform', 'confirm_question']
Predicted slot label: O O O O B-city O O O O O O O O O O O O O O B-city O
Real slot label: O O O O B-city O O O O O O O O O O O O O O B-city O
Score: 
Word 4 score: [3.4418106e-05 1.1167035e-06 6.2214385e-04 2.2080268e-11 9.9934238e-01]
Word 19 score: [2.1159910e-01 7.8830922e-01 2.9130828e-05 5.3799962e-05 8.7742137e-06]
------
1634
yes
Predicted label: ['confirm_answer']
Real label: ['confirm_answer']
Predicted slot label: O
Real slot label: O
Score: 
------
1635
the opt ##imi ##st , ray ' s on the river , and c & s seafood & oyster bar are the top 3 restaurants in your preferred cuisine with available seating . may i book one of these options for you ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-rating I-rating O O O O O O O O O O O O O O O O O O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-rating I-rating O O O O O O O O O O O O O O O O O O O
Score: 
Word 0 score: [8.6309719e-01 1.3191402e-01 6.1094164e-05 7.9000320e-06 4.9197534e-03]
Word 1 score: [3.6552843e-02 8.7225231e-08 9.5529014e-01 8.1568826e-03 1.0055219e-07]
Word 2 score: [1.5201266e-02 8.1602630e-06 9.8470497e-01 8.5619082e-05 1.3351743e-09]
Word 3 score: [1.9152198e-02 1.0315024e-05 9.8074222e-01 9.5282230e-05 1.3319080e-09]
Word 5 score: [1.9661408e-04 4.7147620e-01 1.6344798e-01 1.2237900e-04 3.6475685e-01]
Word 6 score: [0.4888232  0.0009886  0.39532083 0.00293838 0.11192898]
Word 7 score: [9.9900889e-01 4.7583762e-07 5.3201688e-08 3.0373280e-06 9.8763232e-04]
Word 8 score: [5.4290089e-05 4.7991616e-06 1.9831399e-03 9.8493409e-01 1.3023603e-02]
Word 9 score: [0.00804516 0.06979279 0.00377518 0.00253532 0.9158516 ]
Word 10 score: [1.6462030e-09 1.0000000e+00 9.3497161e-11 5.4392482e-09 1.2585121e-09]
Word 13 score: [1.2252933e-07 1.7161941e-08 9.9999976e-01 1.2252933e-07 2.6709616e-08]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [9.9896944e-01 6.9069660e-07 6.2838133e-08 3.5822841e-06 1.0261376e-03]
Word 16 score: [8.2782142e-05 9.7152138e-01 2.7698431e-02 9.2254950e-06 6.8812148e-04]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [9.5768487e-01 2.5536921e-02 1.6774790e-02 2.1798692e-09 3.4144905e-06]
Word 19 score: [3.7790365e-03 6.4909919e-08 2.7341198e-06 2.0745562e-03 9.9414355e-01]
Word 22 score: [3.2392204e-06 1.5340363e-05 1.9375233e-07 4.9999064e-01 4.9999064e-01]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
------
1636
the opt ##imi ##st
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [9.1815788e-01 7.9266444e-02 6.9371608e-06 1.6800744e-06 2.5671027e-03]
Word 1 score: [1.8425617e-01 2.1062003e-07 8.0452931e-01 1.1213360e-02 9.5003503e-07]
Word 2 score: [1.6622977e-01 1.1460499e-05 8.3354294e-01 2.1583786e-04 7.9394882e-09]
Word 3 score: [1.3874543e-01 1.9879290e-05 8.6098111e-01 2.5351631e-04 6.9793940e-09]
------
1637
thank you so much for booking with us ! your reservation has been confirmed as requested . enjoy your meal !
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: B-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing O O O O O O O O O B-closing I-closing I-closing O
Real slot label: B-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing O O O O O O O O O B-closing I-closing I-closing O
Score: 
Word 0 score: [9.5371053e-02 9.7460375e-05 8.8439864e-01 1.6768632e-02 3.3641246e-03]
Word 1 score: [4.8815566e-01 2.9556537e-03 9.2518330e-03 3.9449887e-04 4.9924228e-01]
Word 2 score: [9.4426525e-01 9.4909292e-06 2.1651208e-04 2.9129314e-05 5.5479661e-02]
Word 3 score: [4.2739555e-02 1.1392838e-06 7.7394643e-06 9.5651478e-01 7.3682494e-04]
Word 4 score: [1.8425324e-07 1.0110602e-05 6.2065942e-06 9.9969721e-01 2.8629249e-04]
Word 5 score: [0.00322028 0.53484595 0.21023835 0.0414571  0.21023835]
Word 6 score: [9.9959582e-01 5.2189630e-06 2.7717930e-05 3.7113143e-04 6.3291203e-08]
Word 7 score: [0.3865623  0.02977638 0.00189926 0.0868649  0.49489716]
Word 17 score: [5.7600100e-02 2.3747629e-02 9.1535270e-01 1.4631980e-04 3.1532568e-03]
Word 18 score: [5.5350993e-06 9.9240303e-01 7.5914697e-03 1.5151781e-18 1.5151781e-18]
Word 19 score: [2.3997830e-04 3.6017500e-05 5.3707650e-03 8.4053177e-01 1.5382145e-01]
------
1638
please book a table for 4 in seattle for tomorrow at 6 : 30 pm at mel ##rose grill under the name dorothy z ##born ##ak
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O B-personfullname I-personfullname I-personfullname I-personfullname
Real slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O B-personfullname I-personfullname I-personfullname I-personfullname
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [1.1606869e-01 1.5353025e-03 4.1687909e-01 4.6535414e-01 1.6274053e-04]
Word 9 score: [8.1911623e-01 9.6876182e-02 1.2740818e-08 3.0350742e-07 8.4007263e-02]
Word 16 score: [5.8812316e-06 5.6525938e-02 1.2214574e-05 9.4343418e-01 2.1839594e-05]
Word 17 score: [2.4507774e-04 2.8619952e-03 1.9567437e-06 9.9676192e-01 1.2908508e-04]
Word 18 score: [2.3116752e-17 8.8138100e-19 1.2694664e-04 1.4869109e-15 9.9987304e-01]
Word 22 score: [7.199811e-04 8.950419e-08 9.992799e-01 1.787043e-13 1.787043e-13]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
------
1639
success ! your reservation has been confirmed . please enjoy your meal !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O B-closing I-closing I-closing I-closing O
Real slot label: O O O O O O O O B-closing I-closing I-closing I-closing O
Score: 
Word 8 score: [6.2434408e-03 1.6968057e-03 9.9167448e-01 3.8538504e-04 5.9031613e-10]
Word 9 score: [6.1749904e-03 2.9538225e-02 9.6287805e-01 1.4086618e-03 8.7514017e-08]
Word 10 score: [1.9926201e-06 9.9700660e-01 2.9913960e-03 6.8715819e-17 6.8715819e-17]
Word 11 score: [8.7293120e-05 4.7828937e-05 1.4330084e-03 6.6622877e-01 3.3220309e-01]
------
1640
hello can you tell me the hours of long ##horn steak ##house ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 8 score: [6.8988338e-05 3.2627603e-04 9.6654821e-07 9.9960381e-01 3.5524430e-08]
Word 9 score: [6.4055548e-06 3.4051570e-07 4.1776036e-07 9.9999285e-01 6.6355962e-12]
Word 10 score: [4.9556847e-17 9.6390875e-24 3.5808536e-21 5.7676642e-20 1.0000000e+00]
Word 11 score: [3.3719114e-17 5.7390771e-24 2.5365819e-21 3.3492414e-20 1.0000000e+00]
------
1641
what city and state would you like me to look ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
1642
hi , i need some help making some reservations
Predicted label: ['request', 'greeting']
Real label: ['request', 'greeting']
Predicted slot label: B-greeting O O O O O O O O
Real slot label: B-greeting O O O O O O O O
Score: 
Word 0 score: [6.1043961e-06 2.2233975e-01 7.6151509e-03 2.2233975e-01 5.4769927e-01]
------
1643
i can help you with making reservations . what city are you in ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O
Score: 
------
1644
i am currently located in atlanta georgia
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O B-city B-state
Real slot label: O O O O O B-city B-state
Score: 
Word 5 score: [1.7439745e-02 9.8246324e-01 5.2035601e-05 2.3356250e-05 2.1640919e-05]
Word 6 score: [1.25727905e-02 1.69639781e-01 1.63582718e-06 7.97598302e-01
 2.01875232e-02]
------
1645
what date and time would you to make reservations for ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
1646
i am looking for reservations this sunday
Predicted label: ['inform']
Real label: ['request']
Predicted slot label: O O O O O B-date I-date
Real slot label: O O O O O B-date I-date
Score: 
Word 5 score: [7.3588431e-02 9.2558014e-01 8.3141966e-04 1.6169346e-12 8.0742565e-12]
Word 6 score: [3.5326774e-08 2.1156739e-02 2.3125803e-07 1.2263674e-06 9.7884184e-01]
------
1647
what time would you like to make the reservation for ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
1648
i would like to go for lunch around 1 ##pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O B-mealtype B-starttime I-starttime I-starttime
Real slot label: O O O O O O B-mealtype B-starttime I-starttime I-starttime
Score: 
Word 6 score: [3.4615172e-05 9.2474977e-03 5.0925458e-04 6.4129943e-01 3.4890926e-01]
Word 7 score: [9.9800462e-01 1.9399505e-03 2.4858789e-05 2.4858789e-05 5.7545881e-06]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
------
1649
how many guests will you have ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
1650
there will be 4 of us going
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O B-numberofpeople O O O
Real slot label: O O O B-numberofpeople O O O
Score: 
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
------
1651
i found the following top rated restaurants that have availability : astor court , ci ##nco mexican can ##tina - su ##wan ##ee , os ##ter ##ia matt ##one . which would you like to book ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O B-rating I-rating O O O O O B-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O
Real slot label: O O O O B-rating I-rating O O O O O B-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O
Score: 
Word 4 score: [9.4294650e-05 7.0884977e-05 5.0047657e-07 4.9991715e-01 4.9991715e-01]
Word 5 score: [6.2844604e-01 3.9349170e-03 7.7253083e-07 5.7983364e-08 3.6761820e-01]
Word 11 score: [5.8002546e-02 9.4199747e-01 5.6029492e-13 5.6029492e-13 5.6029492e-13]
Word 12 score: [9.9997497e-01 2.7804058e-06 1.9842654e-12 2.1717116e-05 4.4803130e-07]
Word 14 score: [3.3724664e-06 3.3724664e-06 1.1088284e-07 9.9996543e-01 2.7776032e-05]
Word 15 score: [7.61259653e-05 7.61259653e-05 1.10605804e-07 9.99815762e-01
 3.18757957e-05]
Word 16 score: [3.0138360e-06 6.4083640e-03 9.4292564e-03 9.6937615e-01 1.4783151e-02]
Word 17 score: [4.5386866e-02 9.2806017e-01 2.6544157e-02 8.7378403e-06 2.3022785e-11]
Word 18 score: [3.6223959e-02 9.4238383e-01 2.1385616e-02 6.6250327e-06 9.5470628e-12]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [9.9999940e-01 5.3867404e-07 3.0669209e-10 3.0669209e-10 3.0669209e-10]
Word 25 score: [9.999919e-01 8.131872e-06 7.473461e-18 7.473461e-18 7.473461e-18]
Word 26 score: [9.9202216e-01 7.9767415e-03 3.5999307e-07 3.5999307e-07 3.5999307e-07]
Word 27 score: [0.2 0.2 0.2 0.2 0.2]
Word 28 score: [0.2 0.2 0.2 0.2 0.2]
------
1652
what is the type of cuisine for those restaurants ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
1653
astor court is american , ci ##nco mexican can ##tina is mexican , os ##ter ##ia matt ##one is italian .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1654
can you please make reservations for ci ##nco mexican can ##tina
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 6 score: [1.0457161e-05 1.0457161e-05 2.1961521e-08 9.9996006e-01 1.9000958e-05]
Word 7 score: [2.8337826e-04 2.8337826e-04 2.7359599e-07 9.9936122e-01 7.1767005e-05]
Word 8 score: [4.0919267e-06 2.6581099e-03 1.3904276e-02 9.7893482e-01 4.4986377e-03]
Word 9 score: [6.6767912e-03 9.8415226e-01 9.1659883e-03 4.8893953e-06 1.2426504e-11]
Word 10 score: [5.9394562e-03 9.8725224e-01 6.8035829e-03 4.7339131e-06 4.1492534e-12]
------
1655
what name would you like to reserve under ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
1656
can you please put reservation under the name mickey mouse
Predicted label: ['request']
Real label: ['inform']
Predicted slot label: O O O O O O O O B-personfullname I-personfullname
Real slot label: O O O O O O O O B-personfullname I-personfullname
Score: 
Word 8 score: [8.8428227e-05 2.1592087e-01 2.5644939e-02 7.5831687e-01 2.8889926e-05]
Word 9 score: [0.00124263 0.05165575 0.03079979 0.8951095  0.02119236]
------
1657
i have successfully completed your reservation , mr mickey mouse . table for 4 at ci ##nco mexican can ##tina at 1 ##pm on 3 / 13 . enjoy .
Predicted label: ['inform']
Real label: ['inform', 'closing']
Predicted slot label: O O O O O O O O B-personfullname I-personfullname O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-starttime I-starttime O B-date I-date I-date O B-closing O
Real slot label: O O O O O O O O B-personfullname I-personfullname O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-starttime I-starttime O B-date I-date I-date O B-closing O
Score: 
Word 8 score: [1.5048936e-04 8.1688009e-02 4.6937373e-03 9.1346258e-01 5.1696261e-06]
Word 9 score: [1.0345831e-06 8.5173197e-05 3.0455294e-05 5.0586108e-02 9.4929731e-01]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [1.1987569e-06 1.1987569e-06 8.3238190e-09 9.9998128e-01 1.6349828e-05]
Word 16 score: [3.8240883e-05 3.8240883e-05 5.7699044e-08 9.9983859e-01 8.4835119e-05]
Word 17 score: [1.7403798e-04 1.0464779e-01 6.6045529e-01 3.0340666e-02 2.0438226e-01]
Word 18 score: [7.8522332e-02 9.1538984e-01 6.0661705e-03 2.1559679e-05 4.2752362e-15]
Word 19 score: [6.7824744e-02 9.2554951e-01 6.5974868e-03 2.8207911e-05 1.3826308e-15]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
Word 26 score: [0.2 0.2 0.2 0.2 0.2]
Word 28 score: [1.3093913e-01 8.8434368e-03 8.5264069e-01 6.6078377e-05 7.5107259e-03]
------
1658
hello kind sir or madam , i request of thee a bon ##af ##ide reservation at an eater ##y of fine rep ##ute for 3 individuals forth ##with . the service must carried out with ala ##cr ##ity , and cuisine in ##vent ##ive . the desired time is 8 ##pm , the only respectable hour to din ##e
Predicted label: ['request', 'greeting']
Real label: ['request', 'greeting']
Predicted slot label: B-greeting I-greeting I-greeting I-greeting I-greeting O O O O O O O O O O O O O O O O O O O B-numberofpeople O O O O O O O O O O O O O O O O O O O O O O O O B-starttime I-starttime O O O O O O O O
Real slot label: B-greeting I-greeting I-greeting I-greeting I-greeting O O O O O O O O O O O O O O O O O O O B-numberofpeople O O O O O O O O O O O O O O O O O O O O O O O O B-starttime I-starttime O O O O O O O O
Score: 
Word 0 score: [3.3520535e-01 6.5882397e-01 5.9494274e-03 1.0597790e-05 1.0597790e-05]
Word 1 score: [9.5065528e-01 1.3599534e-02 2.7359907e-02 2.8462784e-05 8.3567230e-03]
Word 2 score: [3.6169591e-03 1.5007656e-04 4.8962520e-05 4.9837952e-04 9.9568558e-01]
Word 3 score: [2.1209478e-02 3.9938673e-01 1.1587748e-02 8.7061943e-07 5.6781518e-01]
Word 4 score: [7.7392398e-03 5.4491997e-01 3.7647933e-01 7.0419461e-02 4.4197633e-04]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 49 score: [0.2 0.2 0.2 0.2 0.2]
Word 50 score: [0.2 0.2 0.2 0.2 0.2]
------
1659
my good man , would thee please be so kind as to set forth a date for this get together ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1660
tomorrow would be fine lad .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date O O O O O
Real slot label: B-date O O O O O
Score: 
Word 0 score: [5.2312331e-04 9.9947542e-01 3.9699222e-10 1.2746820e-07 1.4057595e-06]
------
1661
here are three restaurants that i found . do any of these interest you : 1 ) rn ##7 ##4 - 4 / 5 stars , 2 ) metropolitan grill - 4 / 5 stars , or 3 ) art of the table , 4 . 5 / 5 stars ?
Predicted label: ['multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1662
1
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O
Real slot label: O
Score: 
------
1663
success ! i was able to book you a table for 3 at rn ##7 ##4 on 3 / 8 at 8 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O
Real slot label: O O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O
Score: 
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
------
1664
i am looking for an italian restaurant .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-cuisine O O
Real slot label: O O O O O B-cuisine O O
Score: 
Word 5 score: [9.8324907e-01 3.2326908e-09 3.2031718e-07 5.3488344e-07 1.6750002e-02]
------
1665
where are you located ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
1666
los angeles .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city I-city O
Real slot label: B-city I-city O
Score: 
Word 0 score: [9.8418820e-01 1.2342860e-02 3.6815667e-08 3.0095410e-03 4.5949424e-04]
Word 1 score: [5.0759888e-01 5.7142240e-04 4.9182969e-01 3.7427427e-12 3.7427427e-12]
------
1667
do you have a price range in mind ?
Predicted label: ['request']
Real label: ['inform']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
1668
100 dollars .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-pricing I-pricing O
Real slot label: B-pricing I-pricing O
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [2.4999536e-06 9.9763799e-01 8.5837710e-05 1.1208524e-09 2.2737118e-03]
------
1669
on what date would you like to make the reservation ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
1670
saturday . 2 people .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date O B-numberofpeople O O
Real slot label: B-date O B-numberofpeople O O
Score: 
Word 0 score: [9.5398836e-02 7.0871985e-01 4.8327212e-07 1.9587623e-01 4.5961692e-06]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
------
1671
at what time would you like to din ##e ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
1672
0 . 83 ##33 ##33 ##33 ##3
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
1673
i found a few options for you : casa nos ##tra , il mor ##o , and ago - west hollywood . would you like to book one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 8 score: [9.9270427e-01 6.7154998e-03 5.8018253e-04 1.9797140e-08 1.9797140e-08]
Word 9 score: [4.5255795e-03 4.4068511e-06 9.9542964e-01 3.8218714e-05 2.1315548e-06]
Word 10 score: [5.7880406e-04 4.6770023e-09 9.9920911e-01 7.7012854e-05 1.3503576e-04]
Word 12 score: [1.0000000e+00 7.4531086e-14 6.4650167e-11 1.2781673e-13 2.0642989e-11]
Word 13 score: [7.5520761e-02 4.0356074e-03 9.2038751e-01 1.5918874e-06 5.4455690e-05]
Word 14 score: [2.2446747e-04 3.3143151e-04 9.9943119e-01 9.5311234e-06 3.3192969e-06]
Word 17 score: [3.3916533e-01 7.1484864e-02 5.0967413e-01 7.9570957e-02 1.0471854e-04]
Word 18 score: [5.6297581e-06 5.0961225e-06 9.9995828e-01 3.0704552e-05 3.5526605e-07]
Word 19 score: [1.1200157e-01 3.2119169e-06 1.0093896e-06 8.2537264e-01 6.2621534e-02]
Word 20 score: [1.9561584e-08 2.5009774e-06 5.1026827e-01 1.3181983e-07 4.8972908e-01]
------
1674
casa nos ##tra
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [8.6368233e-01 1.1215526e-02 2.7795765e-04 6.2412053e-02 6.2412053e-02]
Word 1 score: [1.0153432e-03 3.7707916e-05 9.9887902e-01 6.7851281e-05 1.8457693e-07]
Word 2 score: [1.2935048e-04 4.1340421e-08 9.9974424e-01 1.0301217e-04 2.3262010e-05]
------
1675
success ! i have booked a table for 2 at casa nos ##tra on 3 / 12 at 8 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O
Real slot label: O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O
Score: 
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [9.8685569e-01 1.1513187e-02 1.6310650e-03 1.6020123e-10 1.6020123e-10]
Word 11 score: [5.1408797e-04 4.2082734e-06 9.9944705e-01 3.4409437e-05 2.7968670e-07]
Word 12 score: [5.785609e-05 6.833959e-09 9.998659e-01 5.731401e-05 1.889035e-05]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
------
1676
need a la ##rh ##e room for a group meeting with meal
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O B-occasion I-occasion O O
Real slot label: O O O O O O O O B-occasion I-occasion O O
Score: 
Word 8 score: [1.9426639e-05 7.0390218e-01 3.2746012e-03 2.9278439e-01 1.9426639e-05]
Word 9 score: [1.2322505e-06 1.5036747e-01 8.4613693e-01 3.4577274e-03 3.6719521e-05]
------
1677
hi . what city are you located in ?
Predicted label: ['request']
Real label: ['request', 'greeting']
Predicted slot label: B-greeting O O O O O O O O
Real slot label: B-greeting O O O O O O O O
Score: 
Word 0 score: [9.3235110e-05 1.4262660e-01 4.3971617e-02 1.4262660e-01 6.7068207e-01]
------
1678
wilmington , nc
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city O B-state
Real slot label: B-city O B-state
Score: 
Word 0 score: [9.4604693e-05 3.1864671e-05 1.9826989e-01 7.2340161e-01 7.8201994e-02]
Word 2 score: [1.0000000e+00 1.8021602e-10 1.8021602e-10 1.8021602e-10 1.8021602e-10]
------
1679
what is a la ##rh ##e meeting room ? i seem to be misunderstanding what you mean ?
Predicted label: ['confirm_question']
Real label: ['confirm_question']
Predicted slot label: O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O
Score: 
------
1680
large , a big private room
Predicted label: ['confirm_answer']
Real label: ['inform']
Predicted slot label: O O O O O O
Real slot label: O O O O O O
Score: 
------
1681
on what date would you like to book ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
1682
3 \ / 12 \ / 2016
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
1683
what time would you like your reservation for . also , how many guests will you have ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O
Score: 
------
1684
8 ##pm 14 guests
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-starttime I-starttime B-numberofpeople O
Real slot label: B-starttime I-starttime B-numberofpeople O
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
------
1685
would you like a specific cuisine ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
1686
country
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-cuisine
Real slot label: B-cuisine
Score: 
Word 0 score: [7.6345110e-05 1.2973495e-01 7.6336591e-03 2.6947945e-01 5.9307563e-01]
------
1687
what name would you like to book the reservation under ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
1688
billy bob
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname I-personfullname
Real slot label: B-personfullname I-personfullname
Score: 
Word 0 score: [1.3990410e-02 3.2090337e-03 5.4235529e-02 6.5915242e-07 9.2856437e-01]
Word 1 score: [7.7530608e-08 9.9999988e-01 3.5410082e-08 2.0933564e-09 1.4471279e-08]
------
1689
i found a few options for you : new southern kitchen , 22 north , and the mas ##h house brewing company . would you like to book one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 8 score: [5.6378267e-05 1.5335677e-03 6.0685186e-09 3.1367781e-10 9.9840999e-01]
Word 9 score: [2.3343737e-11 2.1117569e-07 2.3539843e-07 9.9999952e-01 1.2890444e-09]
Word 10 score: [2.2948800e-12 9.9999249e-01 7.5510848e-06 2.6493438e-11 1.4000061e-09]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [8.2865018e-01 1.7068554e-01 1.2162839e-06 5.6509674e-05 6.0659018e-04]
Word 16 score: [2.7104443e-01 2.0944038e-02 7.0769614e-01 9.7068893e-05 2.1830859e-04]
Word 17 score: [9.9273783e-01 6.9975904e-03 2.5634596e-04 1.0240414e-08 8.1888202e-06]
Word 18 score: [9.9957889e-01 4.0133248e-04 1.0491890e-08 4.2187850e-07 1.9343081e-05]
Word 19 score: [0.00264894 0.82547516 0.00575644 0.12436214 0.04175729]
Word 20 score: [7.3003596e-01 1.4659916e-07 2.6994979e-01 1.2959287e-05 1.1459069e-06]
Word 21 score: [1.8063160e-09 4.0561249e-06 9.9806851e-01 1.5007127e-03 4.2672202e-04]
------
1690
the mas ##h house brewing company
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [9.1952294e-01 7.4444540e-02 4.2248257e-06 3.7512571e-06 6.0245176e-03]
Word 1 score: [9.9537081e-01 4.5805159e-03 4.8133439e-05 8.5273238e-10 4.4188894e-07]
Word 2 score: [9.9178547e-01 8.1810392e-03 4.4981494e-09 1.4942642e-06 3.1953838e-05]
Word 3 score: [0.00232907 0.8540186  0.00316011 0.09242949 0.04806267]
Word 4 score: [7.3865080e-01 5.6803504e-09 2.6133990e-01 3.1872098e-06 6.1245137e-06]
Word 5 score: [4.0405770e-10 9.4307234e-07 9.9861979e-01 1.2488266e-03 1.3046361e-04]
------
1691
unfortunately , that party size is larger than they allow to be booked online . would you like to try another restaurant ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1692
go with 2 , they all backed out
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O B-numberofpeople O O O O O
Real slot label: O O B-numberofpeople O O O O O
Score: 
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
------
1693
ok , then i have reserved a table for 2 on 3 / 12 at 8 ##pm at mas ##h house brewing company . thank you for using our service !
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O O B-numberofpeople O B-date I-date I-date O B-starttime I-starttime O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-closing I-closing I-closing I-closing I-closing I-closing I-closing
Real slot label: O O O O O O O O O B-numberofpeople O B-date I-date I-date O B-starttime I-starttime O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-closing I-closing I-closing I-closing I-closing I-closing I-closing
Score: 
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [1.7378381e-02 2.9833809e-01 1.5094666e-06 2.2657781e-03 6.8201625e-01]
Word 19 score: [9.9982965e-01 8.7905071e-05 7.8672048e-05 2.7148081e-08 3.7088309e-06]
Word 20 score: [0.00194073 0.59531444 0.00413156 0.37549806 0.02311514]
Word 21 score: [9.4534141e-01 4.3042075e-08 5.4641530e-02 1.6576700e-05 4.4122771e-07]
Word 22 score: [7.3800479e-08 2.5505144e-05 9.9195039e-01 6.8873288e-03 1.1366244e-03]
Word 24 score: [1.4949199e-02 9.6463928e-06 9.8449349e-01 4.4955268e-08 5.4756890e-04]
Word 25 score: [0.10003244 0.0015989  0.04115719 0.00216566 0.8550458 ]
Word 26 score: [1.8330705e-07 4.7366790e-05 7.2222040e-04 9.9921918e-01 1.1022013e-05]
Word 27 score: [1.2380180e-02 7.4353296e-04 1.2380180e-02 9.7449613e-01 9.9977010e-15]
Word 28 score: [2.1095868e-08 3.9323019e-03 9.3271740e-02 1.0139780e-01 8.0139816e-01]
Word 29 score: [1.39565505e-02 6.81909995e-08 5.14645362e-04 1.40922691e-03
 9.84119475e-01]
Word 30 score: [0.2 0.2 0.2 0.2 0.2]
------
1694
i would like a restaurant in seattle on march 10th at 7 pm for 3 people .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O B-city O B-date I-date O O O O B-numberofpeople O O
Real slot label: O O O O O O B-city O B-date I-date O O O O B-numberofpeople O O
Score: 
Word 6 score: [8.6377516e-02 5.1503308e-04 2.4358133e-02 8.8838094e-01 3.6839573e-04]
Word 8 score: [1.08606655e-05 8.41185153e-01 9.00848061e-02 3.71820368e-02
 3.15370895e-02]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
------
1695
hi . what type of cuisine would you like ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
1696
burger ##s
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-cuisine I-cuisine
Real slot label: B-cuisine I-cuisine
Score: 
Word 0 score: [0.00270341 0.24932416 0.24932416 0.24932416 0.24932416]
Word 1 score: [1.0000000e+00 1.0081592e-21 1.0081592e-21 1.0081592e-21 1.0081592e-21]
------
1697
sure ! here are some options i found for you : 1 ) hard rock cafe , 2 ) jimmy ' s on first , and 3 ) local burger . would you like to try one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O B-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O B-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 19 score: [0.0032414  0.01998641 0.0024332  0.7991245  0.17521453]
Word 20 score: [0.42142436 0.00724135 0.35665205 0.00316957 0.2115126 ]
Word 21 score: [9.9900937e-01 1.7030077e-06 4.1591889e-08 2.8959689e-06 9.8591438e-04]
Word 22 score: [2.8150441e-04 3.8866558e-05 1.1130605e-03 9.8118788e-01 1.7378746e-02]
Word 23 score: [7.7025592e-02 1.5255091e-02 1.1459838e-03 4.8909156e-04 9.0608418e-01]
Word 28 score: [4.0523964e-06 1.6147892e-04 2.2111794e-04 9.9961334e-01 3.8780406e-11]
Word 29 score: [0.02007042 0.06687402 0.01109614 0.0051241  0.8968354 ]
------
1698
hard rock cafe
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O
Real slot label: O O O
Score: 
------
1699
success ! i was able to book you a table for 3 at hard rock cafe on 3 / 10 at 7 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O B-numberofpeople O O O O O B-date I-date I-date O B-starttime I-starttime O
Real slot label: O O O O O O O O O O O B-numberofpeople O O O O O B-date I-date I-date O B-starttime I-starttime O
Score: 
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
------
1700
book me a table for 1 in seattle for tomorrow at 7 : 00 pm at kan ##ame i ##zak ##aya
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [2.3318436e-02 1.4305573e-04 3.3586040e-02 9.4266319e-01 2.8926175e-04]
Word 9 score: [6.9101888e-01 6.9166467e-02 6.5350008e-07 2.3679279e-06 2.3981163e-01]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [3.1633046e-03 9.9651355e-01 3.2319070e-04 7.5626844e-10 7.5626844e-10]
Word 19 score: [2.9397586e-03 9.9679118e-01 2.6906532e-04 5.8822919e-10 5.8822919e-10]
Word 20 score: [3.1530289e-03 9.9659938e-01 2.4758122e-04 1.0911893e-09 1.0911893e-09]
------
1701
success ! i was able to book you a table for 1 at kan ##ame i ##zak ##aya tomorrow at 7 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname B-date O B-starttime I-starttime O
Real slot label: O O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname B-date O B-starttime I-starttime O
Score: 
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [1.8253693e-03 9.9787951e-01 2.9509989e-04 1.1535476e-10 1.1535476e-10]
Word 16 score: [1.6500199e-03 9.9807465e-01 2.7533135e-04 6.0657805e-11 6.0657805e-11]
Word 17 score: [1.8465923e-03 9.9790335e-01 2.5009169e-04 8.7835565e-11 8.7835565e-11]
Word 18 score: [5.1164233e-07 1.9228839e-06 1.1389149e-13 1.9232935e-11 9.9999762e-01]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
------
1702
looking for a restaurant specializing in craft beer in wilmington , nc
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O B-restaurantname I-restaurantname O B-city O B-state
Real slot label: O O O O O O B-restaurantname I-restaurantname O B-city O B-state
Score: 
Word 6 score: [8.7656474e-07 1.2981863e-04 1.0967709e-03 9.9852186e-01 2.5061693e-04]
Word 7 score: [2.2429520e-05 5.6579877e-02 1.6806523e-17 9.4274348e-01 6.5424509e-04]
Word 9 score: [5.9623995e-05 4.0372433e-07 2.3609132e-02 8.3302997e-02 8.9302784e-01]
Word 11 score: [1.0000000e+00 3.1151962e-10 3.1151962e-10 3.1151962e-10 3.1151962e-10]
------
1703
when would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
1704
tomorrow at 8 ##pm for 4 people
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date O B-starttime I-starttime O B-numberofpeople O
Real slot label: B-date O B-starttime I-starttime O B-numberofpeople O
Score: 
Word 0 score: [1.0513866e-03 9.9894637e-01 6.2883376e-10 1.4179612e-07 2.1602025e-06]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
------
1705
unfortunately i can not find any restaurants specializing in craft beer in the wilmington area . would you like to try either a different specialty or different location ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O B-restauranttype I-restauranttype O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O B-restauranttype I-restauranttype O O O O O O O O O O O O O O O O O O
Score: 
Word 9 score: [1.4235171e-06 1.1040793e-04 4.3972622e-04 9.9935597e-01 9.2449460e-05]
Word 10 score: [3.8283627e-08 2.3090674e-03 8.9085884e-14 9.9769080e-01 1.2217951e-07]
------
1706
wine
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restauranttype
Real slot label: B-restauranttype
Score: 
Word 0 score: [2.3031503e-02 6.4438298e-02 1.4592446e-03 4.5209205e-07 9.1107041e-01]
------
1707
flying fish cafe & wine bar has an excellent wine selection . would you like me to book it ?
Predicted label: ['inform', 'confirm_question']
Real label: ['inform', 'confirm_question']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O
Score: 
Word 0 score: [0.04005617 0.04005617 0.6300419  0.00220473 0.28764108]
Word 1 score: [8.3258197e-07 5.6993032e-01 6.8464124e-07 3.9267356e-08 4.3006814e-01]
Word 2 score: [2.6093891e-01 1.2004413e-02 1.2158266e-03 2.8437263e-11 7.2584093e-01]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [4.1971278e-01 5.8011079e-01 5.3785796e-05 1.0894466e-04 1.3706256e-05]
Word 5 score: [1.4052358e-02 8.7903362e-07 6.5608965e-06 3.7750273e-03 9.8216516e-01]
------
1708
yes
Predicted label: ['confirm_answer']
Real label: ['confirm_answer']
Predicted slot label: O
Real slot label: O
Score: 
------
1709
i have successfully completed your reservation at flying fish cafe & wine bar for tomorrow at 8 ##pm . enjoy !
Predicted label: ['inform', 'closing']
Real label: ['inform', 'closing']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date O B-starttime I-starttime O B-closing O
Real slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date O B-starttime I-starttime O B-closing O
Score: 
Word 7 score: [6.0496491e-04 6.0496491e-04 2.0112333e-05 6.0400210e-04 9.9816602e-01]
Word 8 score: [2.9086169e-07 3.9165822e-01 5.9781655e-07 8.8745278e-10 6.0834092e-01]
Word 9 score: [6.3592046e-02 6.3975719e-03 2.1886746e-03 1.5567796e-10 9.2782176e-01]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [7.2339016e-01 2.7634850e-01 5.9883500e-06 2.0799100e-04 4.7411049e-05]
Word 12 score: [2.5805548e-01 4.2988926e-05 3.6518199e-05 9.3683712e-02 6.4818126e-01]
Word 14 score: [8.5917956e-01 1.1475791e-01 5.0841385e-07 2.8833685e-05 2.6033109e-02]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [3.4788433e-02 3.1961374e-02 8.9101505e-01 7.2649178e-05 4.2162467e-02]
------
1710
can you find me the worst italian place in san diego ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-rating B-cuisine O O B-city I-city O
Real slot label: O O O O O B-rating B-cuisine O O B-city I-city O
Score: 
Word 5 score: [4.0324495e-09 2.0521089e-08 5.5305794e-08 4.4581309e-12 1.0000000e+00]
Word 6 score: [6.7358129e-03 1.4481349e-09 1.1401082e-06 1.8902632e-05 9.9324411e-01]
Word 9 score: [1.5046564e-06 7.1664721e-01 2.8335014e-01 1.0354310e-06 7.1752275e-08]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
------
1711
what date would you like me to look for a reservation ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O
Score: 
------
1712
this coming saturday . 4 people , sometime around 7 ##pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date I-date I-date O B-numberofpeople O O O B-starttime I-starttime I-starttime
Real slot label: B-date I-date I-date O B-numberofpeople O O O B-starttime I-starttime I-starttime
Score: 
Word 0 score: [0.20154381 0.30173185 0.05993565 0.0016901  0.43509865]
Word 1 score: [2.1381695e-02 1.6813402e-03 3.1246810e-04 4.8831227e-01 4.8831227e-01]
Word 2 score: [2.81942915e-03 1.68196202e-04 5.18691121e-03 8.89461458e-01
 1.02364026e-01]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [9.9427468e-01 5.6201383e-03 5.0665123e-05 5.0665123e-05 3.9514161e-06]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
------
1713
what name would you like to book the reservation under ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
1714
tu ##co salamanca
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname I-personfullname I-personfullname
Real slot label: B-personfullname I-personfullname I-personfullname
Score: 
Word 0 score: [3.1898990e-03 9.7774518e-01 1.1019340e-05 1.5116376e-07 1.9053772e-02]
Word 1 score: [3.0853070e-04 9.6599324e-06 4.4602460e-01 5.5363697e-01 2.0282923e-05]
Word 2 score: [9.9738497e-01 1.3075646e-03 1.3075646e-03 2.3790295e-10 2.3790295e-10]
------
1715
i found the following disgusting italian restaurants with bad reviews for your selection : caf ##fe pri ##mo , chi ##ant ##i restaurant , as ##ti ri ##stor ##ante .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O B-cuisine O O B-rating I-rating O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O O B-cuisine O O B-rating I-rating O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 5 score: [5.5715151e-05 8.6897939e-10 2.6834580e-06 3.4241784e-06 9.9993813e-01]
Word 8 score: [1.3203609e-07 1.6868527e-06 1.1691570e-07 1.5706441e-06 9.9999654e-01]
Word 9 score: [8.0774343e-10 5.0000000e-01 5.0000000e-01 5.2327226e-24 5.2327226e-24]
Word 14 score: [7.5763797e-05 1.5876804e-09 1.2896181e-02 1.2896181e-02 9.7413188e-01]
Word 15 score: [1.5222898e-03 1.1458872e-03 4.3147735e-05 4.3147735e-05 9.9724555e-01]
Word 16 score: [9.9207288e-01 4.0555275e-03 1.3959309e-04 3.0659942e-03 6.6610740e-04]
Word 17 score: [9.9140722e-01 4.5528440e-03 1.2175204e-04 3.1699454e-03 7.4822525e-04]
Word 19 score: [1.7344004e-04 3.6052973e-03 1.1550409e-01 8.7711179e-01 3.6052973e-03]
Word 20 score: [8.6488277e-01 4.5884227e-07 2.6611262e-04 1.3485026e-01 4.5884227e-07]
Word 21 score: [1.3366632e-01 9.6506774e-06 1.0123668e-01 7.6507771e-01 9.6506774e-06]
Word 22 score: [7.4306499e-15 6.6995728e-01 2.6985286e-03 3.2734418e-01 6.4694556e-19]
Word 24 score: [4.9999893e-01 4.9999893e-01 2.1268813e-06 2.6061092e-13 2.6061092e-13]
Word 25 score: [4.9999839e-01 4.9999839e-01 3.2452754e-06 1.1862939e-20 1.1862939e-20]
Word 26 score: [9.9508047e-01 4.9194754e-03 8.2463852e-10 8.2463852e-10 8.2463852e-10]
Word 27 score: [9.9621093e-01 3.7890845e-03 9.3146668e-10 9.3146668e-10 9.3146668e-10]
Word 28 score: [9.9645621e-01 3.5437185e-03 1.8507831e-09 1.8507831e-09 1.8507831e-09]
------
1716
i ' ll go with chi ##ant ##i restaurant
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 5 score: [6.4574828e-04 1.1797041e-02 2.0781100e-01 7.6794916e-01 1.1797041e-02]
Word 6 score: [9.4052023e-01 7.0678624e-07 4.1310056e-04 5.9065398e-02 7.0678624e-07]
Word 7 score: [1.6350807e-01 6.5709377e-05 4.3855876e-01 3.9780179e-01 6.5709377e-05]
Word 8 score: [7.7965537e-15 5.8292419e-01 3.8720586e-03 4.1320375e-01 5.2471427e-19]
------
1717
your reservation at chi ##ant ##i restaurant on 03 / 12 / 2016 for four at 7 ##pm was confirmed with the name tu ##co salamanca . i hope you have a horrible meal .
Predicted label: ['inform']
Real label: ['inform', 'closing']
Predicted slot label: O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date I-date I-date O B-numberofpeople O B-starttime I-starttime O O O O O B-personfullname I-personfullname I-personfullname O B-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing
Real slot label: O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date I-date I-date O B-numberofpeople O B-starttime I-starttime O O O O O B-personfullname I-personfullname I-personfullname O B-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing
Score: 
Word 3 score: [1.2214801e-04 1.0442878e-03 1.5403299e-01 8.4375626e-01 1.0442878e-03]
Word 4 score: [7.7893144e-01 7.0663049e-07 1.2381917e-03 2.1982886e-01 7.0663049e-07]
Word 5 score: [5.4060727e-02 3.6452606e-05 5.3773016e-01 4.0813622e-01 3.6452606e-05]
Word 6 score: [6.3642986e-14 6.7723250e-01 3.2703846e-03 3.1949711e-01 3.8473150e-18]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [1.3416858e-06 2.0429409e-06 5.7700009e-07 5.6924793e-10 9.9999607e-01]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [4.3128603e-06 9.9914336e-01 2.4127439e-05 8.2813285e-04 5.3354854e-09]
Word 24 score: [3.5400968e-05 3.5032505e-07 5.6825596e-01 4.3167186e-01 3.6488855e-05]
Word 25 score: [9.3701392e-01 3.1492997e-02 3.1492997e-02 5.7733218e-10 5.7733218e-10]
Word 27 score: [0.52390283 0.06641875 0.00075475 0.407865   0.00105863]
Word 28 score: [3.3853124e-03 2.5362988e-07 9.9568307e-01 7.3885021e-04 1.9252163e-04]
Word 29 score: [1.1419344e-01 8.5073784e-03 3.2929730e-04 4.4174052e-05 8.7692571e-01]
Word 30 score: [1.5972113e-05 7.7042437e-01 1.8207479e-01 1.5972113e-05 4.7468878e-02]
Word 31 score: [1.9386265e-02 2.6755330e-01 4.7120625e-01 2.4155527e-01 2.9889951e-04]
Word 32 score: [0.987189   0.00204641 0.00157209 0.00274846 0.00644409]
Word 33 score: [8.2112689e-07 2.2691564e-05 7.4965974e-06 7.7401340e-01 2.2595556e-01]
Word 34 score: [0.2 0.2 0.2 0.2 0.2]
------
1718
i want to eat in seattle for a party of 4 bb ##q please tomorrow at 1 ##pm
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-city O O B-occasion O B-numberofpeople B-food I-food O B-date O B-starttime I-starttime
Real slot label: O O O O O B-city O O B-occasion O B-numberofpeople B-food I-food O B-date O B-starttime I-starttime
Score: 
Word 5 score: [5.9643272e-02 8.0375554e-05 1.9285388e-01 7.4560314e-01 1.8193525e-03]
Word 8 score: [9.9974281e-01 3.7215133e-05 2.1306274e-04 6.9981395e-12 6.8814816e-06]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [2.0435979e-07 3.0467193e-10 8.7357038e-01 1.2517537e-01 1.2540752e-03]
Word 12 score: [1.2455157e-15 1.4275554e-22 9.9905676e-01 9.4319490e-04 4.0953144e-12]
Word 14 score: [7.2177470e-02 3.0415533e-03 7.3723754e-08 2.2484755e-06 9.2477864e-01]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
------
1719
hello , do you have a price range in mind ?
Predicted label: ['request', 'greeting']
Real label: ['request', 'greeting']
Predicted slot label: B-greeting O O O O O O O O O O
Real slot label: B-greeting O O O O O O O O O O
Score: 
Word 0 score: [2.4263407e-03 9.9618679e-01 1.3850145e-03 9.4452332e-07 9.4452332e-07]
------
1720
medium please
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-pricing O
Real slot label: B-pricing O
Score: 
Word 0 score: [9.1279590e-01 7.9522043e-02 7.0507149e-03 3.8488270e-06 6.2754296e-04]
------
1721
i found the following restaurants that match : jack ' s bb ##q , rooster ' s bar & grill .
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform']
Predicted slot label: O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 8 score: [4.7373990e-07 9.9919301e-01 7.0480490e-11 9.8334345e-09 8.0649502e-04]
Word 9 score: [7.4297589e-01 1.8295392e-03 2.3244970e-02 3.7811827e-04 2.3157141e-01]
Word 10 score: [9.9881470e-01 1.4491629e-06 1.6496022e-08 6.7659983e-07 1.1831238e-03]
Word 11 score: [1.6148456e-11 7.8143868e-18 9.8012233e-01 1.9877015e-02 7.3980465e-07]
Word 12 score: [2.5692821e-11 1.2286340e-17 9.7682571e-01 2.3173282e-02 1.0201986e-06]
Word 14 score: [9.9132556e-01 2.6606838e-03 5.5015710e-04 5.5015710e-04 4.9134446e-03]
Word 15 score: [6.4498210e-01 1.1404419e-03 9.6936509e-02 3.6617744e-04 2.5657475e-01]
Word 16 score: [9.98949468e-01 8.69563223e-07 1.23106965e-08 4.61442085e-07
 1.04923337e-03]
Word 17 score: [7.9590939e-03 1.5215741e-07 1.9561458e-06 4.7699464e-03 9.8726881e-01]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [3.6736762e-17 7.2086094e-18 4.6461899e-04 6.6894046e-15 9.9953544e-01]
------
1722
jack ##s bb ##q
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [0.00620976 0.22854175 0.47853333 0.05817341 0.22854175]
Word 1 score: [6.2413870e-05 3.3852132e-08 1.1179065e-03 9.9881965e-01 3.3852132e-08]
Word 2 score: [1.2340644e-13 1.7322165e-20 9.9009705e-01 9.9030007e-03 4.1252772e-08]
Word 3 score: [1.89469425e-13 2.98463050e-20 9.87712085e-01 1.22877620e-02
 1.05490145e-07]
------
1723
success ! i was able to book you a table for 4 at jack ' s bb ##q tomorrow at 1 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname B-date O B-starttime I-starttime O
Real slot label: O O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname B-date O B-starttime I-starttime O
Score: 
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [3.6116745e-07 9.9948430e-01 5.6561394e-11 2.2555277e-08 5.1528512e-04]
Word 14 score: [0.628971   0.02020236 0.13952142 0.00081037 0.21049494]
Word 15 score: [9.9971503e-01 3.9124075e-06 2.0667708e-08 3.6316865e-07 2.8067769e-04]
Word 16 score: [4.5382071e-13 2.9943302e-20 9.8852462e-01 1.1475170e-02 1.9503200e-07]
Word 17 score: [4.2614897e-13 3.1946933e-20 9.8558468e-01 1.4414858e-02 4.3632105e-07]
Word 18 score: [1.3445799e-07 1.9443785e-06 1.2741429e-14 3.5158851e-12 9.9999797e-01]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
------
1724
please book a table for 1 in seattle for tomorrow at 8 : 30 pm at the six ##gill under the name paul hollywood
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O B-personfullname I-personfullname
Real slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname O O O B-personfullname I-personfullname
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [5.4716729e-02 6.8172027e-04 6.3809520e-01 3.0644184e-01 6.4529173e-05]
Word 9 score: [7.1876413e-01 1.0187945e-01 3.9574871e-08 7.5842280e-07 1.7935565e-01]
Word 16 score: [1.3388726e-01 1.6378721e-02 8.4954596e-01 3.4971988e-05 1.5303395e-04]
Word 17 score: [4.2172549e-05 2.5992463e-03 9.9725336e-01 1.0519460e-04 6.2660252e-11]
Word 18 score: [1.7382195e-07 4.4282856e-03 9.9556941e-01 2.1654400e-06 4.4511995e-11]
Word 22 score: [7.3170144e-04 3.6519359e-07 5.6305893e-05 9.4843888e-01 5.0772831e-02]
Word 23 score: [8.2418488e-08 2.0123065e-09 9.9887973e-01 1.6632608e-04 9.5380546e-04]
------
1725
i have successfully booked your reservation . enjoy !
Predicted label: ['inform']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O B-closing I-closing
Real slot label: O O O O O O O B-closing I-closing
Score: 
Word 7 score: [4.8149686e-02 3.5705091e-03 9.4793278e-01 5.8848909e-06 3.4107082e-04]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
------
1726
my soon - to - be husband and i are going to honolulu for our honeymoon tomorrow ! we are so excited and we want to celebrate our first night there by going out to eat somewhere special . our flight does n ' t arrive until 4 ##pm , so we would n ' t be able to
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O B-city O O B-occasion B-date O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O B-city O O B-occasion B-date O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
Word 12 score: [1.2681662e-04 3.5381024e-03 1.8321132e-02 2.5910085e-01 7.1891308e-01]
Word 15 score: [0.07944982 0.09039582 0.8272611  0.00176922 0.00112398]
Word 16 score: [3.9758194e-02 3.5745064e-03 8.5164537e-08 2.1687806e-06 9.5666510e-01]
------
1727
may i assume your reservation would be for two ?
Predicted label: ['request', 'confirm_answer']
Real label: ['confirm_question']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
1728
ha ##ha , i should hope no one else is planning on coming with us on our honeymoon !
Predicted label: ['confirm_answer']
Real label: ['confirm_answer']
Predicted slot label: O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O
Score: 
------
1729
here are 3 of the top rated restaurants in honolulu for you to celebrate at : 53 by the sea , bu ##ca di be ##pp ##o , and d ##k steak house . would you like to try one of those or should i present more options ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O B-rating I-rating O O B-city O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O
Real slot label: O O O O O B-rating I-rating O O B-city O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O
Score: 
Word 5 score: [6.2234607e-04 1.2792645e-04 4.9071758e-07 4.9962464e-01 4.9962464e-01]
Word 6 score: [9.2196131e-01 1.3274595e-04 1.7949506e-07 2.3560217e-08 7.7905677e-02]
Word 9 score: [4.1460622e-05 8.1727671e-04 7.4620303e-03 8.7302268e-02 9.0437686e-01]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.22630873 0.03631581 0.08091403 0.6533863  0.00307515]
Word 18 score: [0.00353447 0.0259315  0.00356148 0.00610949 0.960863  ]
Word 19 score: [1.37569194e-04 6.05229707e-03 7.37075900e-10 1.14849634e-01
 8.78960490e-01]
Word 21 score: [8.6640529e-03 5.8399024e-07 6.4116656e-03 4.1174931e-06 9.8491967e-01]
Word 22 score: [9.9964154e-01 2.2942154e-04 1.2990037e-06 1.2296598e-04 4.7630542e-06]
Word 23 score: [8.0922306e-01 3.6763295e-04 1.5179758e-01 3.4559838e-02 4.0519326e-03]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
Word 26 score: [0.2 0.2 0.2 0.2 0.2]
Word 29 score: [1.000000e+00 2.797845e-17 2.797845e-17 2.797845e-17 2.797845e-17]
Word 30 score: [1.0000000e+00 1.8362922e-18 1.8362922e-18 1.8362922e-18 1.8362922e-18]
Word 31 score: [2.9365209e-01 4.1649587e-10 5.6621086e-15 3.4718103e-11 7.0634794e-01]
Word 32 score: [0.00310861 0.82552034 0.00289317 0.13847472 0.03000317]
------
1730
i think we would love to try bu ##ca di be ##pp ##o . sounds like something we ' d both enjoy .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 7 score: [4.7001471e-03 2.5282045e-06 4.7877253e-04 1.4096669e-06 9.9481720e-01]
Word 8 score: [9.9987316e-01 1.1676686e-04 2.2321514e-08 8.4875719e-06 1.5524738e-06]
Word 9 score: [9.7639459e-01 1.5369875e-05 1.7785763e-02 5.3961594e-03 4.0807368e-04]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
------
1731
i have found a table that fits your needs ? what name shall i put on the reservation ?
Predicted label: ['request', 'inform']
Real label: ['request', 'confirm_question']
Predicted slot label: O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O
Score: 
------
1732
yes you have . denny pope is the name .
Predicted label: ['inform']
Real label: ['inform', 'confirm_answer']
Predicted slot label: O O O O B-personfullname I-personfullname O O O O
Real slot label: O O O O B-personfullname I-personfullname O O O O
Score: 
Word 4 score: [0.02437134 0.2695251  0.47591823 0.08641941 0.14376591]
Word 5 score: [8.2824670e-08 3.0354236e-08 7.6514044e-07 9.9995017e-01 4.8999587e-05]
------
1733
i have successfully completed your reservation for bu ##ca di be ##pp ##o on 3 / 9 at 6 : 30 ##pm ! enjoy !
Predicted label: ['inform', 'closing']
Real label: ['inform', 'closing']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime I-starttime I-starttime O B-closing I-closing
Real slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime I-starttime I-starttime O B-closing I-closing
Score: 
Word 7 score: [1.92761078e-01 1.77694146e-05 1.14407465e-02 2.00315008e-05
 7.95760453e-01]
Word 8 score: [9.9996293e-01 3.2982385e-05 8.7866976e-09 3.8738608e-06 2.7685118e-07]
Word 9 score: [0.28986818 0.0012074  0.64600325 0.06120293 0.00171822]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [1.0031312e-02 2.6884126e-02 9.6274334e-01 2.1635172e-04 1.2486109e-04]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
------
1734
hello
Predicted label: ['greeting']
Real label: ['greeting']
Predicted slot label: O
Real slot label: O
Score: 
------
1735
hi , can i help you find a restaurant today ?
Predicted label: ['request', 'greeting']
Real label: ['greeting', 'confirm_question']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
1736
yes . may i get a table for two for next wednesday , 5 ##pm , at ben ##ih ##ana newport beach ?
Predicted label: ['request']
Real label: ['inform', 'confirm_answer']
Predicted slot label: O O O O O O O O B-numberofpeople O B-date I-date O B-starttime I-starttime O O B-restaurantname I-restaurantname I-restaurantname B-address I-address O
Real slot label: O O O O O O O O B-numberofpeople O B-date I-date O B-starttime I-starttime O O B-restaurantname I-restaurantname I-restaurantname B-address I-address O
Score: 
Word 8 score: [2.6902884e-01 5.4031480e-03 4.2903138e-04 7.1579474e-01 9.3442639e-03]
Word 10 score: [2.1284346e-04 1.6811985e-04 8.5124641e-04 9.9873680e-01 3.1005344e-05]
Word 11 score: [2.3327073e-01 5.1965232e-09 3.1802821e-01 2.2435054e-01 2.2435054e-01]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [9.9533170e-01 4.6683322e-03 1.1896045e-09 1.7765834e-17 1.7765834e-17]
Word 18 score: [1.7136630e-01 8.2863265e-01 1.0573546e-06 9.1843156e-15 9.1843156e-15]
Word 19 score: [3.1116831e-01 6.8882346e-01 8.2170209e-06 4.4858825e-10 4.4858825e-10]
Word 20 score: [8.9628913e-04 4.5175118e-05 8.0603922e-06 4.6771322e-04 9.9858272e-01]
Word 21 score: [1.1900165e-02 1.3753741e-05 8.0831320e-08 5.6820470e-03 9.8240387e-01]
------
1737
what state is that located in ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
1738
california
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-state
Real slot label: B-state
Score: 
Word 0 score: [7.1882509e-02 3.5478894e-08 6.8591867e-04 9.2741501e-01 1.6532633e-05]
------
1739
success ! i was able to book you a table for 2 at ben ##ih ##ana next wednesday at 5 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname B-date I-date O B-starttime I-starttime O
Real slot label: O O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname B-date I-date O B-starttime I-starttime O
Score: 
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [9.9949157e-01 5.0841988e-04 7.2465041e-11 1.6790237e-18 1.6790237e-18]
Word 14 score: [2.9204676e-01 7.0795286e-01 3.5818601e-07 2.3582568e-15 2.3582568e-15]
Word 15 score: [6.1195159e-01 3.8804638e-01 1.9671581e-06 1.3565281e-10 1.3565281e-10]
Word 16 score: [2.4883771e-12 1.1330591e-06 2.4847787e-11 9.9999857e-01 2.0456744e-07]
Word 17 score: [7.63731897e-01 2.54057929e-12 1.13471355e-02 1.12460464e-01
 1.12460464e-01]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
------
1740
i need a restaurant with an expensive menu .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
1741
certainly , what city are you located in ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
1742
toronto .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city O
Real slot label: B-city O
Score: 
Word 0 score: [1.5175574e-07 9.3667829e-01 1.2493063e-02 5.0828386e-02 2.2633362e-08]
------
1743
do you have a specific cuisine in mind ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O
Real slot label: O O O O O O O O O
Score: 
------
1744
chinese .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-cuisine O
Real slot label: B-cuisine O
Score: 
Word 0 score: [2.9369578e-01 1.3350736e-04 7.0201302e-01 3.1562084e-03 1.0014899e-03]
------
1745
on what date would you like to make the reservation ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
1746
saturday . 5 people .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date O B-numberofpeople O O
Real slot label: B-date O B-numberofpeople O O
Score: 
Word 0 score: [8.5638873e-02 7.5657427e-01 4.3927474e-07 1.5778251e-01 3.9114175e-06]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
------
1747
and what time sounds good ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O
Real slot label: O O O O O O
Score: 
------
1748
7 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-starttime I-starttime O
Real slot label: B-starttime I-starttime O
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
------
1749
unfortunately , there are no restaurants that fit that criteria . would you like to change one of your search terms ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1750
italian ?
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-cuisine O
Real slot label: B-cuisine O
Score: 
Word 0 score: [9.9999523e-01 1.3304033e-06 1.5442762e-09 1.2622803e-09 3.4261379e-06]
------
1751
i found a few options for you : crest ##a toronto , non ##na ' s , and 850 degrees . would you like to book one of these ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O O B-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 8 score: [4.9999869e-01 4.9999869e-01 9.1394367e-07 9.1394367e-07 9.1394367e-07]
Word 9 score: [4.9999905e-01 4.9999905e-01 6.6665410e-07 6.6665410e-07 6.6665410e-07]
Word 10 score: [3.0711428e-05 9.9969292e-01 2.7466879e-06 2.7367703e-04 1.8990227e-09]
Word 12 score: [7.4778032e-01 2.5221959e-01 3.5938417e-08 3.5938417e-08 3.5938417e-08]
Word 13 score: [3.5849303e-02 9.6415073e-01 1.0740361e-11 1.0740361e-11 1.0740361e-11]
Word 14 score: [9.9842536e-01 7.5115520e-07 1.6434308e-07 2.1778576e-06 1.5715562e-03]
Word 15 score: [9.9841535e-01 1.4590460e-06 1.2340031e-07 2.0688353e-06 1.5808964e-03]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [7.5964914e-07 9.9999928e-01 5.5794632e-15 5.5794632e-15 5.5794632e-15]
------
1752
850 degrees
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [5.7630492e-03 9.9423695e-01 2.2175777e-25 2.2175777e-25 2.2175777e-25]
------
1753
unfortunately , 7 ##pm is not available , but 71 ##5 ##pm is . will that be ok ?
Predicted label: ['inform', 'confirm_question']
Real label: ['request', 'inform']
Predicted slot label: O O B-starttime I-starttime O O O O O O O O O O O O O O O
Real slot label: O O B-starttime I-starttime O O O O O O O O O O O O O O O
Score: 
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
------
1754
yes .
Predicted label: ['confirm_answer']
Real label: ['inform']
Predicted slot label: O O
Real slot label: O O
Score: 
------
1755
success ! i was able to book a table for 5 at 850 degrees on 3 / 12 at 7 : 15 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime I-starttime I-starttime O
Real slot label: O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime I-starttime I-starttime O
Score: 
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [1.5267058e-05 9.9998474e-01 1.5475995e-18 1.5475995e-18 1.5475995e-18]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
------
1756
hello . please find me a chinese restaurant in central ##ia , il for a party of 2 for tomorrow at 8 pm .
Predicted label: ['request']
Real label: ['request', 'greeting']
Predicted slot label: B-greeting O O O O O B-cuisine O O B-city I-city O B-state O O B-occasion O B-numberofpeople O B-date O O O O
Real slot label: B-greeting O O O O O B-cuisine O O B-city I-city O B-state O O B-occasion O B-numberofpeople O B-date O O O O
Score: 
Word 0 score: [5.7960969e-01 4.1202089e-01 8.3077569e-03 3.0817144e-05 3.0817144e-05]
Word 6 score: [9.9342841e-01 2.5962867e-05 5.6610373e-03 8.6778903e-04 1.6770307e-05]
Word 9 score: [0.36617002 0.00432265 0.01964663 0.07606929 0.53379136]
Word 10 score: [0.7854089  0.00094758 0.19542246 0.01592444 0.0022965 ]
Word 12 score: [1.0000000e+00 2.4532971e-14 3.7297847e-12 7.3297678e-14 6.7596059e-12]
Word 15 score: [9.9971861e-01 8.9332600e-05 1.8793264e-04 1.5456940e-12 4.0847581e-06]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [5.1139122e-01 4.6490020e-01 3.8294701e-09 7.5942779e-07 2.3707885e-02]
------
1757
unfortunately it does not appear i have any restaurants to book in central ##ia , il . do you have another city preference ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O B-city I-city O B-state O O O O O O O O
Real slot label: O O O O O O O O O O O O B-city I-city O B-state O O O O O O O O
Score: 
Word 12 score: [0.34017843 0.00309514 0.0169086  0.10048887 0.539329  ]
Word 13 score: [0.40432933 0.00383334 0.01965479 0.08902816 0.4831543 ]
Word 15 score: [1.0000000e+00 3.0277031e-13 9.0480318e-11 2.1100092e-12 1.6223625e-10]
------
1758
st . louis , mo
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city I-city I-city O B-state
Real slot label: B-city I-city I-city O B-state
Score: 
Word 0 score: [0.4941238  0.00291657 0.00206892 0.4941238  0.00676699]
Word 1 score: [5.2237995e-02 1.9246067e-07 2.4171883e-05 5.2237995e-02 8.9549971e-01]
Word 2 score: [3.7815174e-05 6.7419997e-10 9.9996209e-01 5.1583335e-08 6.3329374e-08]
Word 4 score: [8.6381145e-02 9.0636253e-01 4.8323427e-03 2.3978190e-04 2.1842187e-03]
------
1759
there are no restaurants available in that area that fit your date / time criteria , would you like to try a different cuisine ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1760
can you try thai please ?
Predicted label: ['inform']
Real label: ['request']
Predicted slot label: O O O B-cuisine O O
Real slot label: O O O B-cuisine O O
Score: 
Word 3 score: [3.9590404e-07 4.1446626e-08 3.9590404e-07 2.2414860e-03 9.9775773e-01]
------
1761
here are three options that i found : add ##ie ' s thai house .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 8 score: [9.9775392e-01 2.1822353e-04 1.0335676e-11 4.8503643e-04 1.5427574e-03]
Word 9 score: [1.4897269e-05 4.9573961e-01 4.9495921e-01 2.6224309e-03 6.6639297e-03]
Word 10 score: [9.9979240e-01 1.2868284e-07 5.6012301e-08 1.1098748e-06 2.0642595e-04]
Word 11 score: [9.9968326e-01 9.9218823e-07 2.4485542e-08 1.1573336e-06 3.1459861e-04]
Word 12 score: [0.05328595 0.01581753 0.05328595 0.03806592 0.83954453]
Word 13 score: [0.00217302 0.8500079  0.0065833  0.09295067 0.04828512]
------
1762
please book me for add ##ie ' s thai house
Predicted label: ['inform']
Real label: ['request']
Predicted slot label: O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 4 score: [9.8707563e-01 1.3478354e-03 4.5151237e-11 3.7528493e-03 7.8236833e-03]
Word 5 score: [1.4776595e-05 7.2751969e-01 2.6695535e-01 1.3792953e-03 4.1309129e-03]
Word 6 score: [9.9964702e-01 1.4396292e-07 4.6900091e-08 1.3874103e-06 3.5139013e-04]
Word 7 score: [9.9960381e-01 5.1852669e-07 2.6795052e-08 1.4243712e-06 3.9432597e-04]
Word 8 score: [0.03193808 0.00938399 0.03193808 0.04060961 0.88613015]
Word 9 score: [0.00211346 0.8320529  0.00384227 0.09502935 0.06696206]
------
1763
unfortunately , that specific time is not available . i can book that restaurant for 8 ##pm on friday or saturday instead , if that is ok .
Predicted label: ['inform']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O B-starttime I-starttime O B-date O B-date O O O O O O O
Real slot label: O O O O O O O O O O O O O O O B-starttime I-starttime O B-date O B-date O O O O O O O
Score: 
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [1.7926207e-01 1.2585351e-03 1.6064175e-04 8.1178868e-01 7.5300680e-03]
Word 20 score: [4.3562181e-02 7.9147937e-03 2.4272539e-04 8.3226752e-01 1.1601281e-01]
------
1764
looking for a place in wilmington , nc that has a wide choice of fines cheese ##s
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-city O B-state O O O O O O B-cuisine I-cuisine I-cuisine
Real slot label: O O O O O B-city O B-state O O O O O O B-cuisine I-cuisine I-cuisine
Score: 
Word 5 score: [3.0902527e-05 2.5243398e-07 2.0006277e-02 1.3933724e-01 8.4062535e-01]
Word 7 score: [1.0000000e+00 1.4265482e-10 1.4265482e-10 1.4265482e-10 1.4265482e-10]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [1.0000000e+00 2.4093288e-16 2.4093288e-16 2.4093288e-16 2.4093288e-16]
Word 16 score: [1.0000000e+00 1.5391683e-11 1.5391683e-11 1.5391683e-11 1.5391683e-11]
------
1765
what date and time would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
1766
saturday at 2 ##pm , 4 of us
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date O B-starttime I-starttime O B-numberofpeople O O
Real slot label: B-date O B-starttime I-starttime O B-numberofpeople O O
Score: 
Word 0 score: [4.0343117e-02 2.4972343e-01 1.3653854e-06 7.0992243e-01 9.6425883e-06]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
------
1767
the melting pot - wilmington has an open table at that time , and they serve fond ##ue cuisine with a number of fine cheese ##s . would you like to book ?
Predicted label: ['inform', 'confirm_question']
Real label: ['inform', 'confirm_question']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O B-cuisine I-cuisine I-cuisine O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O B-cuisine I-cuisine I-cuisine O O O O O O O
Score: 
Word 23 score: [1.2587136e-02 9.5038885e-01 5.3036888e-06 2.6128776e-02 1.0889914e-02]
Word 24 score: [1.0000000e+00 1.0538643e-11 1.0538643e-11 1.0538643e-11 1.0538643e-11]
Word 25 score: [1.0000000e+00 4.1277103e-11 4.1277103e-11 4.1277103e-11 4.1277103e-11]
------
1768
yes please
Predicted label: ['confirm_answer']
Real label: ['confirm_answer']
Predicted slot label: O O
Real slot label: O O
Score: 
------
1769
thank you so much for booking with us ! your reservation has been confirmed as requested . enjoy your meal !
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: B-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing O O O O O O O O O B-closing I-closing I-closing O
Real slot label: B-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing O O O O O O O O O B-closing I-closing I-closing O
Score: 
Word 0 score: [3.1013137e-02 1.3741982e-05 9.6395761e-01 3.5748926e-03 1.4406550e-03]
Word 1 score: [9.3760043e-01 3.8816915e-03 4.0161614e-03 1.4567276e-04 5.4356109e-02]
Word 2 score: [9.0203470e-01 1.9413232e-05 1.0052109e-03 9.1564725e-05 9.6849121e-02]
Word 3 score: [9.5593045e-03 1.5825995e-06 4.7453746e-06 9.8978871e-01 6.4573414e-04]
Word 4 score: [6.8657613e-07 1.4768418e-05 1.3790020e-06 9.9934846e-01 6.3465559e-04]
Word 5 score: [3.6584694e-04 9.7805071e-01 1.0125841e-02 1.3317193e-03 1.0125841e-02]
Word 6 score: [9.9957424e-01 6.9960370e-05 1.6139249e-05 3.3841349e-04 1.3586119e-06]
Word 7 score: [0.2303436  0.00952858 0.00274643 0.2518021  0.5055793 ]
Word 17 score: [1.20839596e-01 2.01413129e-02 7.31083751e-01 1.08217311e-04
 1.27827182e-01]
Word 18 score: [1.2612305e-04 9.9471152e-01 5.1623210e-03 9.5393314e-17 9.5393314e-17]
Word 19 score: [4.5841999e-04 1.9288529e-04 8.2405312e-03 7.2650969e-01 2.6459846e-01]
------
1770
i need to book a table for 3 / 21 at 7 pm for dinner at the aqua ##k ##no ##x in las vegas for two guests .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O B-date I-date I-date O O O O B-mealtype O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-city I-city O O O O
Real slot label: O O O O O O O B-date I-date I-date O O O O B-mealtype O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-city I-city O O O O
Score: 
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [9.9979419e-01 3.7134225e-05 1.5909077e-10 1.6872982e-04 4.6951185e-09]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [2.1571091e-04 3.5787930e-03 2.5388360e-01 7.3753577e-01 4.7860504e-03]
Word 23 score: [1.0000000e+00 2.2384728e-11 2.2384728e-11 2.2384728e-11 2.2384728e-11]
------
1771
success , i was able to book you a table for 2 at the aqua ##k ##no ##x on 3 / 21 at 7 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O B-numberofpeople O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O
Real slot label: O O O O O O O O O O O B-numberofpeople O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O
Score: 
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
------
1772
i would like to book a seafood place in seattle on 03 / 20 at 3 : 30 ##pm for 3 people
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O B-food O O B-city O O O O O B-starttime I-starttime I-starttime I-starttime O B-numberofpeople O
Real slot label: O O O O O O B-food O O B-city O O O O O B-starttime I-starttime I-starttime I-starttime O B-numberofpeople O
Score: 
Word 6 score: [4.1567575e-05 9.0788268e-02 7.3167067e-03 1.0927805e-05 9.0184247e-01]
Word 9 score: [5.8280770e-02 1.7619546e-04 7.7398494e-02 8.2592028e-01 3.8224235e-02]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
------
1773
baha ##ma breeze - seattle - tu ##k ##wil ##a , ballard annex oyster house , and blue ##ac ##re seafood all have open tables at that time . would you like to book one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O O
Score: 
Word 0 score: [9.01755750e-01 2.45052599e-03 8.86738226e-02 1.46260345e-05
 7.10529787e-03]
Word 1 score: [7.7021278e-02 6.0213483e-06 8.9998275e-01 2.2905912e-02 8.3998719e-05]
Word 2 score: [5.2954471e-01 9.1469404e-04 4.6947551e-01 6.3280233e-05 1.7981926e-06]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [4.0016830e-02 9.6756674e-04 8.4013134e-01 1.1881145e-01 7.2794988e-05]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [1.0000000e+00 2.8970907e-08 2.8970907e-08 2.8970907e-08 2.8970907e-08]
Word 12 score: [3.7456214e-06 9.9917221e-01 7.0246955e-04 2.7128923e-05 9.4492585e-05]
Word 13 score: [9.44836736e-01 4.37770151e-02 1.13825565e-02 1.46453827e-09
 3.76201683e-06]
Word 14 score: [0.00199073 0.8615058  0.00440645 0.08952346 0.04257357]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [1.54717738e-04 9.70209420e-01 2.61788946e-02 1.30752105e-05
 3.44394962e-03]
------
1774
tu ##k ##wil ##a
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
------
1775
your reservation has been confirmed . please enjoy your meal , and thank you for using our service !
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O B-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing
Real slot label: O O O O O O B-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing
Score: 
Word 6 score: [9.3633699e-04 1.1609886e-03 9.9740404e-01 4.9857836e-04 7.3464373e-11]
Word 7 score: [7.7645988e-03 4.1657116e-02 9.4902343e-01 1.5546713e-03 9.8029254e-08]
Word 8 score: [3.6031448e-05 9.9904555e-01 9.1840554e-04 4.6860013e-18 4.6860013e-18]
Word 9 score: [1.1062842e-07 3.8359619e-08 8.6434073e-07 6.4765221e-01 3.5234681e-01]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [9.9586725e-01 4.1548713e-04 1.6174919e-03 1.8228588e-04 1.9175285e-03]
Word 12 score: [6.4002290e-02 6.0592394e-04 9.3286026e-01 3.2671934e-04 2.2046983e-03]
Word 13 score: [2.1088342e-01 8.0735894e-04 1.1755572e-02 3.4515018e-04 7.7620858e-01]
Word 14 score: [5.3436122e-09 7.8117068e-07 6.2133324e-08 9.9998784e-01 1.1243608e-05]
Word 15 score: [1.1243011e-02 5.7472958e-04 1.1243011e-02 9.7693926e-01 4.9389515e-14]
Word 16 score: [2.3484927e-06 5.2737992e-02 5.8458120e-01 1.8981360e-01 1.7286482e-01]
Word 17 score: [2.0088097e-02 5.4308584e-05 8.4169433e-03 4.2887840e-02 9.2855287e-01]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
------
1776
book me a table for 2 in seattle for tomorrow at 7 : 00 pm at coastal kitchen
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-city O B-date O B-starttime I-starttime I-starttime I-starttime O B-restaurantname I-restaurantname
Real slot label: O O O O O B-numberofpeople O B-city O B-date O B-starttime I-starttime I-starttime I-starttime O B-restaurantname I-restaurantname
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [1.7029626e-02 1.8040830e-04 3.4675628e-02 9.4764000e-01 4.7434896e-04]
Word 9 score: [6.09854341e-01 1.01422004e-01 2.16438616e-06 5.31085152e-06
 2.88716167e-01]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [2.8796103e-03 9.9447191e-01 2.5896688e-03 6.8157544e-07 5.8110898e-05]
Word 16 score: [4.22318667e-01 3.02959059e-04 1.12727635e-01 4.64650661e-01
 2.91316695e-08]
Word 17 score: [9.8013415e-14 9.9996984e-01 2.9097560e-05 4.9300225e-10 1.0062884e-06]
------
1777
your table for two has been successfully reserved for 7 : 00pm tomorrow night at coastal kitchen . enjoy !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O B-numberofpeople O O O O O O O O B-date O O B-restaurantname I-restaurantname O B-closing O
Real slot label: O O O B-numberofpeople O O O O O O O O B-date O O B-restaurantname I-restaurantname O B-closing O
Score: 
Word 3 score: [9.6282238e-01 5.2014478e-03 3.6605652e-05 3.1573672e-02 3.6586300e-04]
Word 12 score: [2.4092057e-01 6.3040245e-01 6.6437643e-08 1.7126425e-06 1.2867513e-01]
Word 15 score: [1.7824392e-01 9.9768315e-04 8.0949688e-01 1.1261012e-02 4.7564308e-07]
Word 16 score: [4.2801071e-12 9.9998939e-01 3.7500222e-06 4.1842654e-10 6.8169511e-06]
Word 18 score: [1.2964471e-01 4.2530093e-02 8.0624890e-01 1.7092036e-04 2.1405347e-02]
------
1778
book me a table tomorrow in seattle for 2 at 10 ##pm anywhere you choose
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O B-date O B-city O B-numberofpeople O B-starttime I-starttime B-address O O
Real slot label: O O O O B-date O B-city O B-numberofpeople O B-starttime I-starttime B-address O O
Score: 
Word 4 score: [4.1239306e-01 2.9278600e-01 1.1832357e-06 1.5362943e-05 2.9480442e-01]
Word 6 score: [1.6893674e-02 2.1600761e-04 3.8926360e-01 5.9242737e-01 1.1993621e-03]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [1.0850610e-01 8.8582534e-01 5.6306319e-03 1.8956944e-05 1.8956944e-05]
------
1779
i do not make decisions but i can provide recommendations . here are 3 of the top rated restaurants in seattle : can ##lis , the metropolitan grill , the pink door . would you like to try one of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O B-rating I-rating O O B-city O B-restaurantname I-restaurantname O O O O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O B-rating I-rating O O B-city O B-restaurantname I-restaurantname O O O O O B-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 16 score: [7.9692045e-04 1.0079375e-04 2.5974134e-07 4.9955100e-01 4.9955100e-01]
Word 17 score: [9.2314106e-01 2.4443603e-04 4.9314699e-06 7.1212656e-07 7.6608740e-02]
Word 20 score: [1.9048855e-02 6.8141083e-04 8.3108358e-03 9.7145456e-01 5.0436502e-04]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 29 score: [3.4171178e-03 1.6183662e-03 9.9490237e-01 3.3656099e-05 2.8513481e-05]
Word 30 score: [8.4061045e-05 4.1753065e-06 9.9962926e-01 2.8237345e-04 4.1186301e-08]
Word 31 score: [1.2188174e-04 9.9987745e-01 1.2981892e-08 1.9696694e-07 4.5718511e-07]
------
1780
ok how about the pink door
Predicted label: ['request']
Real label: ['inform']
Predicted slot label: O O O O B-restaurantname I-restaurantname
Real slot label: O O O O B-restaurantname I-restaurantname
Score: 
Word 4 score: [4.3691630e-03 9.4206071e-06 9.9473417e-01 8.8429655e-04 2.9037703e-06]
Word 5 score: [1.8921028e-05 9.9998081e-01 1.9336918e-08 9.6258802e-08 1.3945544e-07]
------
1781
great your reservation at the pink door is confirmed !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O B-restaurantname I-restaurantname I-restaurantname O O O
Real slot label: O O O O B-restaurantname I-restaurantname I-restaurantname O O O
Score: 
Word 4 score: [1.8461218e-02 5.9719584e-03 9.7551823e-01 7.0914057e-06 4.1481464e-05]
Word 5 score: [1.1877078e-03 2.0570978e-06 9.9834299e-01 4.6708397e-04 1.6037257e-07]
Word 6 score: [1.3292032e-06 9.9999869e-01 7.3605767e-11 3.5614833e-10 1.8420230e-09]
------
1782
book me a table for 2 in seattle for tomorrow at 7 : 00 pm at ve ##nde ##mm ##ia
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [1.6347475e-02 1.5147243e-04 3.4478668e-02 9.4866991e-01 3.5251124e-04]
Word 9 score: [7.8272325e-01 1.3137552e-01 1.1069263e-06 3.6663932e-06 8.5896447e-02]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
------
1783
hi . i ' ve booked your restaurant for tomorrow . thank you .
Predicted label: ['inform']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O O B-date O O O O
Real slot label: O O O O O O O O O B-date O O O O
Score: 
Word 9 score: [4.1377741e-01 5.8577889e-01 1.0407539e-08 8.7023625e-07 4.4291079e-04]
------
1784
any australian restaurants in wilmington , nc
Predicted label: ['request']
Real label: ['inform']
Predicted slot label: O B-cuisine O O B-city O B-state
Real slot label: O B-cuisine O O B-city O B-state
Score: 
Word 1 score: [2.7893748e-04 8.5039418e-03 9.9116033e-01 3.1365760e-06 5.3636493e-05]
Word 4 score: [3.3377244e-05 1.6755672e-07 1.2580174e-02 4.5500908e-02 9.4188547e-01]
Word 6 score: [1.000000e+00 7.094665e-11 7.094665e-11 7.094665e-11 7.094665e-11]
------
1785
unfortunately there are no restaurants that meet all the criteria you specified in wilmington , nc that i can book .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O B-city O B-state O O O O O
Real slot label: O O O O O O O O O O O O O B-city O B-state O O O O O
Score: 
Word 13 score: [1.5247313e-04 8.1663825e-07 2.5171798e-02 2.5718449e-02 9.4895643e-01]
Word 15 score: [1.000000e+00 6.067364e-13 6.067364e-13 6.067364e-13 6.067364e-13]
------
1786
ok then how about indonesian
Predicted label: ['inform']
Real label: ['request']
Predicted slot label: O O O O B-restauranttype
Real slot label: O O O O B-restauranttype
Score: 
Word 4 score: [8.555917e-01 7.219768e-02 7.219768e-02 1.116427e-05 1.723413e-06]
------
1787
there ' s no indonesian restaurants available for your location that i can book unfortunately .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O B-restauranttype O O O O O O O O O O O
Real slot label: O O O O B-restauranttype O O O O O O O O O O O
Score: 
Word 4 score: [7.2861755e-01 1.3568968e-01 1.3568968e-01 2.0170505e-06 1.0660499e-06]
------
1788
asian
Predicted label: ['inform']
Real label: ['request']
Predicted slot label: B-restauranttype
Real slot label: B-restauranttype
Score: 
Word 0 score: [2.1862203e-05 2.7648829e-07 2.6336279e-06 9.9997306e-01 2.1959315e-06]
------
1789
i found the following asian restaurant at your location : yo sake downtown su ##shi lounge . would you like to book ?
Predicted label: ['inform', 'confirm_question']
Real label: ['inform', 'confirm_question']
Predicted slot label: O O O O B-cuisine O O B-distanceconstraints I-distanceconstraints O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O
Real slot label: O O O O B-cuisine O O B-distanceconstraints I-distanceconstraints O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O
Score: 
Word 4 score: [2.3617524e-04 8.0799242e-04 9.2988356e-04 9.9562883e-01 2.3970569e-03]
Word 7 score: [6.0877526e-01 3.9101949e-01 2.0523877e-04 1.6968843e-09 1.6968843e-09]
Word 8 score: [2.87028790e-01 7.58916258e-07 1.02087324e-04 7.12567627e-01
 3.00754094e-04]
Word 10 score: [8.8246534e-06 9.9861538e-01 1.3748854e-03 1.4579901e-08 8.8935553e-07]
Word 11 score: [0.3736728  0.01729905 0.60388047 0.00360234 0.00154538]
Word 12 score: [5.7621556e-09 9.9996018e-01 1.9662305e-09 2.6442624e-06 3.7217047e-05]
Word 13 score: [3.3085624e-05 7.9713666e-01 6.1603835e-08 2.0215698e-01 6.7315775e-04]
Word 14 score: [4.8538923e-06 9.5842892e-01 1.6546302e-08 4.1270901e-02 2.9530554e-04]
Word 15 score: [4.3383945e-02 1.6851010e-04 4.6147402e-02 9.1016823e-01 1.3194811e-04]
------
1790
yes
Predicted label: ['confirm_answer']
Real label: ['confirm_answer']
Predicted slot label: O
Real slot label: O
Score: 
------
1791
great , what day would you like to din ##e out ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O
Score: 
------
1792
next thursday
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date I-date
Real slot label: B-date I-date
Score: 
Word 0 score: [0.03044009 0.41757476 0.00925015 0.44132033 0.10141475]
Word 1 score: [1.6187865e-03 3.9372784e-03 5.5523653e-04 1.2118318e-04 9.9376750e-01]
------
1793
how many are going ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
1794
4
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
1795
what time would you like to eat ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
1796
7 ##pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-starttime I-starttime
Real slot label: B-starttime I-starttime
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
------
1797
here are some options for you : gen ##ki su ##shi and yo sake . are you interested in either of those ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname O O O O O O O O O
Real slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname O O O O O O O O O
Score: 
Word 7 score: [0.02926878 0.01325454 0.00103113 0.943339   0.01310652]
Word 8 score: [0.01497542 0.0151069  0.30598098 0.6208279  0.04310875]
Word 9 score: [9.0428523e-07 5.7922691e-01 3.6936783e-08 4.1957235e-01 1.1997494e-03]
Word 10 score: [6.1971122e-07 7.3107427e-01 3.2760529e-08 2.6789919e-01 1.0259273e-03]
Word 12 score: [1.1000481e-06 9.9783081e-01 2.1681157e-03 5.4171567e-10 2.6608053e-08]
Word 13 score: [0.40378764 0.00648429 0.5871334  0.001061   0.00153365]
------
1798
gen ##ki su ##shi
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [4.13278713e-06 1.15432225e-01 1.11038287e-06 8.84534419e-01
 2.80445565e-05]
Word 1 score: [0.08788318 0.00159675 0.45443887 0.41806936 0.03801187]
Word 2 score: [1.5540802e-06 5.8625805e-01 1.0953137e-08 4.0950754e-01 4.2328225e-03]
Word 3 score: [1.1521829e-06 6.6667926e-01 1.0524686e-08 3.2925743e-01 4.0621473e-03]
------
1799
success ! i have booked your table for 4 at gen ##ki su ##shi on 3 / 17 at 7 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O
Real slot label: O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O
Score: 
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.06368089 0.00979021 0.00158482 0.9158832  0.00906086]
Word 11 score: [0.04932009 0.00480124 0.47737184 0.4250946  0.04341223]
Word 12 score: [1.9110778e-06 7.7053654e-01 1.3696920e-08 2.2528709e-01 4.1744262e-03]
Word 13 score: [1.1689525e-06 8.6946183e-01 1.1008943e-08 1.2709044e-01 3.4465513e-03]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
------
1800
find me restaurants open at 11 ##pm tonight in new york city downtown
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-starttime I-starttime B-date O O O O O
Real slot label: O O O O O B-starttime I-starttime B-date O O O O O
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [1.17322554e-04 1.51063432e-03 1.77097635e-03 5.19031746e-05
 9.96549129e-01]
------
1801
how many people are going ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O
Real slot label: O O O O O O
Score: 
------
1802
2
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-numberofpeople
Real slot label: B-numberofpeople
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
------
1803
here are the restaurants i found matching your request . please select one : 1 ) ninja new york - rating : 3 . 5 out of 5 . 2 ) bo ##que ##ria - rating : 4 out of 5 . 3 ) the stanton social - rating : 4 out of 5 .
Predicted label: ['multiple_choice']
Real label: ['multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1804
let ' s book ninja new york
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O B-restaurantname I-restaurantname I-restaurantname
Real slot label: O O O O B-restaurantname I-restaurantname I-restaurantname
Score: 
Word 4 score: [1.4587911e-04 7.5639969e-01 2.4210273e-01 1.3668044e-05 1.3379836e-03]
Word 5 score: [3.2588890e-05 7.1991544e-06 1.1187924e-14 2.9743774e-07 9.9995995e-01]
Word 6 score: [9.3743825e-01 4.4934489e-03 2.7755888e-02 1.6076333e-04 3.0151609e-02]
------
1805
i would like to eat lobster tomorrow at 3 pm with a party of 5 in seattle
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-food B-date O B-starttime I-starttime O O O O B-numberofpeople O B-city
Real slot label: O O O O O B-food B-date O B-starttime I-starttime O O O O B-numberofpeople O B-city
Score: 
Word 5 score: [7.2218128e-08 2.6044762e-15 1.4414436e-10 5.4938301e-02 9.4506162e-01]
Word 6 score: [2.1331904e-05 8.0227413e-12 5.1930114e-03 4.2277899e-02 9.5250773e-01]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [8.3400653e-04 9.1849768e-01 8.0660582e-02 2.5292250e-06 5.1915326e-06]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [1.24500565e-01 9.64221035e-05 2.67778039e-01 6.06126845e-01
 1.49817718e-03]
------
1806
here are 3 of the top restaurants in seattle that serve lobster : the capital grille , metropolitan grill , the brooklyn seafood , steak & oyster house . would you like to book one of those or would you prefer more options ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O O O O O O
Score: 
Word 20 score: [3.8950942e-02 1.0824377e-02 9.5014459e-01 1.6724742e-05 6.3273117e-05]
Word 21 score: [3.9720984e-08 7.0756712e-08 7.3621362e-01 2.4669288e-01 1.7093385e-02]
Word 22 score: [2.2530694e-04 9.5477247e-01 4.3803077e-02 3.9518753e-05 1.1596282e-03]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [9.1808997e-03 2.1846527e-02 1.4814547e-11 1.9572639e-10 9.6897262e-01]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
Word 26 score: [9.4209826e-01 3.8998086e-02 1.8886786e-02 7.7103861e-09 1.6794114e-05]
Word 27 score: [0.00319767 0.8306673  0.00555756 0.11096063 0.04961681]
------
1807
steak and oyster house
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [1.32010147e-01 3.08481045e-02 1.01415345e-07 3.54899457e-05
 8.37106228e-01]
Word 1 score: [4.5566231e-02 3.3675823e-01 5.5018690e-04 3.3194140e-06 6.1712199e-01]
Word 2 score: [5.6314468e-01 2.3502611e-04 4.3662024e-01 1.0516411e-08 9.8858372e-08]
Word 3 score: [0.00263893 0.5435659  0.00152667 0.09904207 0.3532264 ]
------
1808
unfortunately that time is all booked but 2 : 30 ##pm is available . should i book it ?
Predicted label: ['inform', 'confirm_question']
Real label: ['inform', 'confirm_question']
Predicted slot label: O O O O O O O B-starttime I-starttime I-starttime I-starttime O O O O O O O O
Real slot label: O O O O O O O B-starttime I-starttime I-starttime I-starttime O O O O O O O O
Score: 
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
------
1809
hello . please find me a mexican restaurant in central ##ia , il for a party of 6 for tomorrow at 5 pm .
Predicted label: ['request', 'greeting']
Real label: ['request']
Predicted slot label: O O O O O O B-cuisine O O B-address I-address I-address I-address O O B-occasion O B-numberofpeople O B-date O O O O
Real slot label: O O O O O O B-cuisine O O B-address I-address I-address I-address O O B-occasion O B-numberofpeople O B-date O O O O
Score: 
Word 6 score: [4.3585186e-04 7.8799212e-01 5.1082224e-02 1.6481194e-03 1.5884176e-01]
Word 9 score: [0.21496078 0.00286808 0.01930025 0.07648919 0.6863817 ]
Word 10 score: [0.747425   0.00081668 0.2284231  0.01932712 0.00400804]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [1.0000000e+00 1.7433715e-14 2.3869861e-11 3.7315030e-14 4.5370504e-12]
Word 15 score: [9.9948859e-01 2.3617641e-04 2.6489529e-04 5.4535634e-12 1.0411184e-05]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [4.2243013e-01 5.7548267e-01 2.3263929e-09 4.3143106e-07 2.0867481e-03]
------
1810
unfortunately , i can not book restaurants in that location at this time . would you like to try a different location ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1811
st . louis , mo
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [0.4929565  0.00559158 0.00209504 0.4929565  0.00640045]
Word 1 score: [5.4785423e-02 3.8788838e-07 2.5731499e-05 5.4785423e-02 8.9040303e-01]
Word 2 score: [9.0596339e-05 1.1841409e-09 9.9990904e-01 1.7139099e-07 1.8944566e-07]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [1.23593315e-01 8.64684165e-01 8.63921642e-03 2.78356252e-04
 2.80501042e-03]
------
1812
would you still like to go with mexican ?
Predicted label: ['inform']
Real label: ['request']
Predicted slot label: O O O O O O O B-cuisine O
Real slot label: O O O O O O O B-cuisine O
Score: 
Word 7 score: [7.7987133e-05 3.6031857e-01 1.1928498e-02 9.1176316e-06 6.2766582e-01]
------
1813
yes
Predicted label: ['confirm_answer']
Real label: ['inform']
Predicted slot label: O
Real slot label: O
Score: 
------
1814
i found the following restaurants that fit your criteria : don emilia ##no ' s restaurant ##e mexican ##o .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 10 score: [7.8470482e-13 2.2239316e-10 9.9999964e-01 3.3065947e-07 1.0133523e-10]
Word 11 score: [7.3977506e-01 2.6022491e-01 8.1682810e-13 8.1682810e-13 8.1682810e-13]
Word 12 score: [8.7306887e-04 9.9912685e-01 2.0267393e-08 2.0267393e-08 2.0267393e-08]
Word 13 score: [9.9972373e-01 7.9134355e-07 2.4232438e-08 1.2109086e-06 2.7425090e-04]
Word 14 score: [9.9970967e-01 1.0129215e-06 2.0085935e-08 1.2127199e-06 2.8809501e-04]
Word 15 score: [3.4589946e-02 9.1423351e-01 3.3429757e-02 1.0448791e-06 1.7745709e-02]
Word 16 score: [3.4323297e-02 9.1534948e-01 3.2579124e-02 1.3224784e-06 1.7746780e-02]
Word 17 score: [9.9743974e-01 2.5602179e-03 2.0283875e-11 2.0283875e-11 2.0283875e-11]
Word 18 score: [9.9793869e-01 2.0612981e-03 1.4877275e-11 1.4877275e-11 1.4877275e-11]
------
1815
please book me for don emilia ##no ' s restaurant ##e mexican ##o .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 4 score: [1.3559622e-12 8.1372098e-10 9.9999964e-01 3.3584357e-07 1.2282871e-09]
Word 5 score: [4.8933429e-01 5.1066571e-01 6.6380007e-13 6.6380007e-13 6.6380007e-13]
Word 6 score: [2.3927676e-04 9.9976069e-01 9.1224228e-09 9.1224228e-09 9.1224228e-09]
Word 7 score: [9.9967873e-01 1.3819343e-06 2.9764958e-08 7.1275502e-07 3.1916215e-04]
Word 8 score: [9.9966013e-01 2.0061336e-06 2.6119263e-08 7.8259666e-07 3.3712186e-04]
Word 9 score: [4.8769683e-02 8.6801070e-01 5.3237703e-02 2.4773417e-06 2.9979499e-02]
Word 10 score: [4.3631181e-02 8.7837052e-01 4.7421489e-02 2.7490087e-06 3.0574081e-02]
Word 11 score: [9.9619424e-01 3.8057158e-03 8.5158533e-11 8.5158533e-11 8.5158533e-11]
Word 12 score: [9.9695313e-01 3.0468015e-03 5.1901830e-11 5.1901830e-11 5.1901830e-11]
------
1816
what name would you like to book the reservation under ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
1817
jason
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname
Real slot label: B-personfullname
Score: 
Word 0 score: [2.2673388e-09 6.1919345e-05 3.5235369e-06 1.7865011e-03 9.9814808e-01]
------
1818
success ! i have booked a table for 6 at don emilia ##no ' s restaurant ##e mexican ##o on 3 / 8 at 5 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O
Real slot label: O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date O B-starttime I-starttime O
Score: 
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [4.3404963e-12 1.3682377e-09 9.9999821e-01 1.8135084e-06 1.3456435e-09]
Word 11 score: [5.8452731e-01 4.1547263e-01 2.8046198e-12 2.8046198e-12 2.8046198e-12]
Word 12 score: [7.1354123e-04 9.9928635e-01 5.2761955e-08 5.2761955e-08 5.2761955e-08]
Word 13 score: [9.9989307e-01 1.3455524e-07 7.8714093e-09 1.7320424e-07 1.0658799e-04]
Word 14 score: [9.9987900e-01 1.8525857e-07 6.6320420e-09 1.7405422e-07 1.2067537e-04]
Word 15 score: [8.6138442e-02 8.2401752e-01 7.5757250e-02 2.4495569e-06 1.4084303e-02]
Word 16 score: [5.1706959e-02 8.9326835e-01 4.4635952e-02 2.4175145e-06 1.0386263e-02]
Word 17 score: [9.9291766e-01 7.0823440e-03 1.4567308e-12 1.4567308e-12 1.4567308e-12]
Word 18 score: [9.9575609e-01 4.2438777e-03 1.6729066e-12 1.6729066e-12 1.6729066e-12]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
------
1819
please book a table for 2 in seattle for tomorrow at 7 : 00 pm at caf ##a ##© la ##go under the name mary berry
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-personfullname I-personfullname
Real slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O B-personfullname I-personfullname
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [9.7422026e-02 6.2812807e-04 6.0785210e-01 2.9394311e-01 1.5462504e-04]
Word 9 score: [7.5777835e-01 9.2969291e-02 1.9078977e-08 5.0159355e-07 1.4925183e-01]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [1.0000000e+00 1.6051926e-15 1.6051926e-15 1.6051926e-15 1.6051926e-15]
Word 20 score: [1.000000e+00 9.246266e-16 9.246266e-16 9.246266e-16 9.246266e-16]
Word 24 score: [2.7153944e-09 1.2192637e-06 9.9545822e-04 9.1354941e-09 9.9900335e-01]
Word 25 score: [1.8175723e-07 2.5628656e-03 9.9703634e-01 1.4200450e-04 2.5858340e-04]
------
1820
success ! your reservation has been confirmed . please enjoy your meal !
Predicted label: ['inform']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O B-closing I-closing I-closing I-closing I-closing
Real slot label: O O O O O O O O B-closing I-closing I-closing I-closing I-closing
Score: 
Word 8 score: [3.4387351e-03 1.3259605e-03 9.9500740e-01 2.2785155e-04 1.5591189e-10]
Word 9 score: [3.0814675e-03 3.2828979e-02 9.6279472e-01 1.2948783e-03 3.2687172e-08]
Word 10 score: [8.0500280e-07 9.9617457e-01 3.8245383e-03 7.8212632e-18 7.8212632e-18]
Word 11 score: [6.2318417e-05 2.2872031e-05 7.9950743e-04 5.9882027e-01 4.0029505e-01]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
------
1821
hello
Predicted label: ['greeting']
Real label: ['greeting']
Predicted slot label: B-greeting
Real slot label: B-greeting
Score: 
Word 0 score: [4.0650237e-03 9.9537271e-01 5.5657350e-04 2.7999233e-06 2.7999233e-06]
------
1822
hello , can i help you make a reservation ?
Predicted label: ['confirm_question']
Real label: ['request', 'greeting']
Predicted slot label: B-greeting O O O O O O O O O
Real slot label: B-greeting O O O O O O O O O
Score: 
Word 0 score: [5.3691532e-02 9.4303370e-01 3.2632013e-03 5.7985221e-06 5.7985221e-06]
------
1823
yes , a reservation for 5 at la fe ##rm ##e in palm beach on tuesday 3 / 14 at 5 ##pm
Predicted label: ['request']
Real label: ['inform']
Predicted slot label: O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-address I-address O B-date I-date I-date I-date O O O
Real slot label: O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-address I-address O B-date I-date I-date I-date O O O
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [9.2211252e-01 9.7299970e-05 5.9075552e-05 7.1102255e-03 7.0620865e-02]
Word 8 score: [8.110734e-03 9.918893e-01 7.790112e-11 7.790112e-11 7.790112e-11]
Word 9 score: [3.4432400e-02 9.6556681e-01 2.6490252e-07 2.6490252e-07 2.6490252e-07]
Word 10 score: [5.7066087e-02 9.4293267e-01 4.0794004e-07 4.0794004e-07 4.0794004e-07]
Word 12 score: [1.0698319e-04 4.9994570e-01 6.6834110e-07 9.4101574e-07 4.9994570e-01]
Word 13 score: [3.5842796e-04 4.7815689e-09 2.1810289e-03 5.4527387e-02 9.4293308e-01]
Word 15 score: [0.0827879  0.35338184 0.23678912 0.01428684 0.31275427]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
------
1824
could you please provide a valid date . 3 / 14 is a monday .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O
Score: 
------
1825
yes , 3 / 15 tuesday
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O B-date I-date I-date I-date
Real slot label: O O B-date I-date I-date I-date
Score: 
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.06991635 0.48505563 0.15023312 0.04008554 0.2547094 ]
------
1826
i ' m sorry , i ' m unable to book that particular restaurant . would you like to try another one ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O B-restauranttype I-restauranttype O O O O O O O O O
Real slot label: O O O O O O O O O O O O B-restauranttype I-restauranttype O O O O O O O O O
Score: 
Word 12 score: [8.0250245e-01 8.8536076e-02 2.0331949e-05 6.4576022e-02 4.4365052e-02]
Word 13 score: [1.7814888e-11 4.2014221e-06 5.3132107e-03 9.9468261e-01 7.5045888e-17]
------
1827
no thank you
Predicted label: ['inform', 'thanks']
Real label: ['thanks']
Predicted slot label: O O O
Real slot label: O O O
Score: 
------
1828
i apologize . please let me know if you ' d like to book a different restaurant in the future .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1829
hi there ! i need a restaurant that ' s good for hosting a baby shower .
Predicted label: ['request', 'greeting']
Real label: ['request', 'greeting']
Predicted slot label: B-greeting O O O O O O O O O B-occasion I-occasion I-occasion I-occasion I-occasion I-occasion O
Real slot label: B-greeting O O O O O O O O O B-occasion I-occasion I-occasion I-occasion I-occasion I-occasion O
Score: 
Word 0 score: [1.1526334e-05 2.4662530e-01 1.1701910e-02 2.4662530e-01 4.9503595e-01]
Word 10 score: [3.5929938e-03 1.9311407e-04 5.6485580e-05 9.7443026e-01 2.1727253e-02]
Word 11 score: [1.7594129e-08 5.1690449e-07 3.6106967e-10 9.9985206e-01 1.4738517e-04]
Word 12 score: [9.44856286e-01 1.02988845e-02 4.10874411e-02 3.19350814e-03
 5.63826412e-04]
Word 13 score: [9.0788603e-01 6.5145735e-04 6.2312130e-02 1.2266265e-02 1.6884189e-02]
Word 14 score: [2.3827372e-01 2.4221402e-04 3.1620431e-01 4.1073063e-01 3.4549061e-02]
Word 15 score: [1.04061613e-10 2.63742295e-09 5.05622302e-06 4.75246954e-04
 9.99519706e-01]
------
1830
hi ! where will this baby shower be located ?
Predicted label: ['request', 'greeting']
Real label: ['request', 'greeting']
Predicted slot label: B-greeting O O O O O O O O O
Real slot label: B-greeting O O O O O O O O O
Score: 
Word 0 score: [1.1156331e-05 2.0509394e-01 9.7662546e-03 2.0509394e-01 5.8003479e-01]
------
1831
los angeles
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city I-city
Real slot label: B-city I-city
Score: 
Word 0 score: [9.7897905e-01 1.5129955e-02 3.9824137e-08 3.4475557e-03 2.4433627e-03]
Word 1 score: [2.9450884e-01 3.3668574e-04 7.0515448e-01 2.7177975e-13 2.7177975e-13]
------
1832
is there a type of cuisine you ' re searching for ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O
Score: 
------
1833
french would be great
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-cuisine O O O
Real slot label: B-cuisine O O O
Score: 
Word 0 score: [0.03540298 0.8639725  0.08446353 0.00490884 0.01125208]
------
1834
when would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
1835
i ' m looking for a table for 5 at sc ##hl ##af ##ly bottle ##works tomorrow afternoon at 2
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname B-date I-date O B-starttime
Real slot label: O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname B-date I-date O B-starttime
Score: 
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [5.9055878e-07 4.4471071e-06 2.3412244e-12 4.4724873e-11 9.9999499e-01]
Word 17 score: [9.9359906e-01 6.2183943e-03 4.8238185e-06 9.7994007e-06 1.6790545e-04]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
------
1836
hi . what city are you located in ?
Predicted label: ['request', 'greeting']
Real label: ['request', 'greeting']
Predicted slot label: B-greeting O O O O O O O O
Real slot label: B-greeting O O O O O O O O
Score: 
Word 0 score: [7.6470482e-05 6.9989949e-02 2.8655404e-02 6.9989949e-02 8.3128828e-01]
------
1837
saint louis mo
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city I-city I-city
Real slot label: B-city I-city I-city
Score: 
Word 0 score: [9.9994075e-01 4.2140707e-07 5.2068691e-07 2.6212138e-07 5.7997317e-05]
Word 1 score: [5.73430452e-06 3.95978167e-10 9.99994278e-01 1.37295695e-08
 3.82250276e-09]
Word 2 score: [9.4014434e-03 9.3165195e-01 4.7085690e-04 2.3979740e-02 3.4496069e-02]
------
1838
what name would you like to book the reservation under ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
1839
jane doe
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname I-personfullname
Real slot label: B-personfullname I-personfullname
Score: 
Word 0 score: [9.1656387e-01 4.6525354e-05 8.1426585e-03 2.0539301e-02 5.4707617e-02]
Word 1 score: [4.0498454e-04 4.8605503e-10 7.5011009e-08 3.2828951e-11 9.9959487e-01]
------
1840
unfortunately sc ##hl ##af ##ty bottle ##works does not allow online reservations . would you like to try another restaurant ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1841
yes , how about square one brewery ?
Predicted label: ['confirm_question']
Real label: ['request']
Predicted slot label: O O O O B-restaurantname I-restaurantname I-restaurantname O
Real slot label: O O O O B-restaurantname I-restaurantname I-restaurantname O
Score: 
Word 4 score: [1.1235510e-05 8.2530147e-05 9.6883285e-01 3.0778021e-02 2.9545545e-04]
Word 5 score: [9.9344300e-03 3.1177109e-04 1.3061519e-03 1.1823799e-03 9.8726523e-01]
Word 6 score: [4.6474190e-04 9.3055171e-01 6.8633787e-02 3.4749182e-04 2.2638112e-06]
------
1842
your reservation at square one brewery was confirmed for 03 / 08 / 2016 at 2 ##pm for 5 guests under the name jane doe . enjoy your meal !
Predicted label: ['inform']
Real label: ['inform', 'closing']
Predicted slot label: O O O B-restaurantname I-restaurantname I-restaurantname O O O B-date I-date I-date I-date I-date O B-starttime I-starttime O B-numberofpeople O O O O B-personfullname I-personfullname O B-closing I-closing I-closing I-closing
Real slot label: O O O B-restaurantname I-restaurantname I-restaurantname O O O B-date I-date I-date I-date I-date O B-starttime I-starttime O B-numberofpeople O O O O B-personfullname I-personfullname O B-closing I-closing I-closing I-closing
Score: 
Word 3 score: [5.5404659e-04 1.7756995e-04 9.9731296e-01 1.9514011e-03 3.9799902e-06]
Word 4 score: [2.6015721e-02 3.9856753e-04 9.1498252e-04 2.0969941e-03 9.7057378e-01]
Word 5 score: [2.7860430e-04 9.8768860e-01 1.1863718e-02 1.6902892e-04 5.6941354e-09]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [2.2920584e-03 2.1461639e-07 6.8713445e-04 9.9696749e-01 5.3073913e-05]
Word 24 score: [1.2837595e-02 1.1156165e-08 3.5561191e-06 5.7241401e-10 9.8715889e-01]
Word 26 score: [5.1489007e-03 1.6719069e-02 9.7693968e-01 3.4032899e-05 1.1583740e-03]
Word 27 score: [1.1250530e-05 9.9451494e-01 5.4737795e-03 1.6075626e-18 1.6075626e-18]
Word 28 score: [1.8144237e-04 4.3237957e-05 1.2444021e-03 7.3267281e-01 2.6585805e-01]
Word 29 score: [0.2 0.2 0.2 0.2 0.2]
------
1843
looking for italian food in seattle for 10 people at 8 ##pm 8 / 13 / 16
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O B-food I-food O B-city O B-numberofpeople O O B-starttime I-starttime B-date I-date I-date I-date I-date
Real slot label: O O B-food I-food O B-city O B-numberofpeople O O B-starttime I-starttime B-date I-date I-date I-date I-date
Score: 
Word 2 score: [9.8745185e-01 5.0876401e-09 8.9182670e-08 1.8784174e-07 1.2547763e-02]
Word 3 score: [6.0002157e-04 1.3559383e-06 9.9102622e-01 8.0561172e-03 3.1623981e-04]
Word 5 score: [4.1385341e-02 1.7917657e-04 8.5396521e-02 8.7167609e-01 1.3628833e-03]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
------
1844
bu ##ca di be ##pp ##o - seattle , tu ##lio , and il for ##nai ##o - seattle are all available . which would you like to book ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O O
Score: 
Word 0 score: [6.3463831e-01 2.1568840e-06 3.5302598e-02 3.6099696e-06 3.3005333e-01]
Word 1 score: [9.9908388e-01 6.7366258e-04 2.1800195e-06 2.1967740e-04 2.0550789e-05]
Word 2 score: [9.4214487e-01 1.0287219e-04 4.2473715e-02 1.2728790e-02 2.5497447e-03]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
Word 4 score: [0.2 0.2 0.2 0.2 0.2]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [7.0741415e-02 2.9467747e-03 4.8905557e-01 4.3719918e-01 5.7010424e-05]
Word 9 score: [2.8060171e-01 1.4464619e-05 4.9656365e-02 2.2913130e-02 6.4681435e-01]
Word 10 score: [5.2205743e-03 2.8573925e-04 9.9250001e-01 6.6283083e-04 1.3309346e-03]
Word 13 score: [1.0000000e+00 5.6035194e-14 4.2904943e-11 2.5384409e-13 3.9759907e-11]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [7.6554537e-02 3.0631658e-03 4.6872720e-01 4.5161563e-01 3.9417064e-05]
------
1845
tu ##lio
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname
Score: 
Word 0 score: [1.2780813e-03 9.1930321e-09 5.0538132e-05 2.5490807e-09 9.9867129e-01]
Word 1 score: [6.5871403e-03 7.3808988e-05 9.9295866e-01 3.9282666e-05 3.4115784e-04]
------
1846
i can not book reservations for that far in advance . would you like to try a sooner date ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O
Score: 
------
1847
3 \ / 10
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date I-date I-date I-date
Real slot label: B-date I-date I-date I-date
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
------
1848
your reservation has been confirmed . please enjoy your meal , and thank you for using our service !
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O
Score: 
------
1849
can you find a family friendly restaurant in seattle anytime this saturday for 3 ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O B-restauranttype I-restauranttype O O B-city O O B-date O B-numberofpeople O
Real slot label: O O O O B-restauranttype I-restauranttype O O B-city O O B-date O B-numberofpeople O
Score: 
Word 4 score: [8.9845596e-12 1.7355349e-05 8.4543932e-04 8.9026628e-08 9.9913722e-01]
Word 5 score: [2.47047807e-04 2.01122493e-01 7.86316454e-01 1.35521323e-05
 1.23004615e-02]
Word 8 score: [9.8820217e-03 1.1920708e-04 2.8212857e-02 9.5929480e-01 2.4911757e-03]
Word 11 score: [3.2885254e-07 4.2970066e-10 1.6085345e-02 3.3958332e-04 9.8357475e-01]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
------
1850
i found the following restaurants matching your request : al bo ##cca ##lino , bar ##olo , godzilla bar .
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform']
Predicted slot label: O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname O B-restaurantname I-restaurantname O
Real slot label: O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname O B-restaurantname I-restaurantname O
Score: 
Word 9 score: [2.4966358e-03 4.6554240e-03 3.4952584e-01 2.1359319e-05 6.4330077e-01]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [1.1786420e-02 1.8445931e-08 1.5989125e-01 8.1676966e-01 1.1552653e-02]
Word 15 score: [7.3012108e-01 1.1827327e-07 6.3965139e-03 2.6319855e-01 2.8370053e-04]
Word 17 score: [2.7283793e-05 3.4219542e-04 8.4812796e-01 1.5150250e-01 2.9483018e-14]
Word 18 score: [6.3966197e-01 1.6753003e-05 1.1230432e-02 1.1815123e-01 2.3093963e-01]
------
1851
godzilla bar
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname
Score: 
Word 0 score: [1.0470944e-03 8.8461870e-01 1.1433222e-01 1.1427210e-06 8.8904937e-07]
Word 1 score: [2.472508e-01 4.649924e-06 9.088440e-03 9.934599e-02 6.443102e-01]
------
1852
i ' m sorry , 3 : 00 is not available , but i could secure a table f ##of 2 ##pm or 4 ##pm . would one of those times work ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O B-starttime I-starttime O B-starttime I-starttime O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O B-starttime I-starttime O B-starttime I-starttime O O O O O O O O
Score: 
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
------
1853
2 ##pm will work
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-starttime I-starttime O O
Real slot label: B-starttime I-starttime O O
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
------
1854
your reservation at godzilla bar at 2 ##pm on 03 / 12 / 2016 for three was confirmed .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O B-restaurantname I-restaurantname O B-starttime I-starttime O B-date I-date I-date I-date I-date O O O O O
Real slot label: O O O B-restaurantname I-restaurantname O B-starttime I-starttime O B-date I-date I-date I-date I-date O O O O O
Score: 
Word 3 score: [7.1486866e-05 4.5925778e-04 9.2194533e-01 7.7523969e-02 1.4977785e-15]
Word 4 score: [2.7107790e-01 5.5724649e-06 6.2292549e-03 5.7274234e-01 1.4994492e-01]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
------
1855
reserve a table tuesday at 8 ##pm for 4 people at a bis ##tro like place
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O B-date O B-starttime I-starttime O B-numberofpeople O O O B-restauranttype I-restauranttype O O
Real slot label: O O O B-date O B-starttime I-starttime O B-numberofpeople O O O B-restauranttype I-restauranttype O O
Score: 
Word 3 score: [0.09469788 0.3446112  0.13793711 0.01519729 0.40755647]
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [8.8245553e-01 1.1750093e-01 1.1733542e-05 3.0459983e-05 1.4165743e-06]
Word 13 score: [8.0429125e-01 8.6891867e-04 2.3298371e-05 9.7246826e-02 9.7569734e-02]
------
1856
what city and state would you like me to look ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
1857
wilmington , nc
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city O B-state
Real slot label: B-city O B-state
Score: 
Word 0 score: [9.0353962e-05 3.6212776e-05 2.7021855e-01 6.6236019e-01 6.7294672e-02]
Word 2 score: [1.000000e+00 7.480882e-10 7.480882e-10 7.480882e-10 7.480882e-10]
------
1858
what name would you like to book the reservation under ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O
Real slot label: O O O O O O O O O O O
Score: 
------
1859
mt ##ur ##k crowd
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-personfullname I-personfullname I-personfullname I-personfullname
Real slot label: B-personfullname I-personfullname I-personfullname I-personfullname
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [1.2709385e-04 4.5511861e-05 3.2445532e-03 9.9658042e-01 2.3799505e-06]
------
1860
i ' ve found bis ##tro ca ##cao , bis ##tro ##t le ##pic and wine bar , and la pi ##quette for you to choose .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O O O O O
Real slot label: O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O B-restaurantname I-restaurantname I-restaurantname O O O O O
Score: 
Word 4 score: [8.2571524e-01 1.7420106e-01 3.8652979e-05 4.2868924e-05 2.2003073e-06]
Word 5 score: [9.9284899e-01 6.5754261e-04 2.4482613e-05 6.4486433e-03 2.0384830e-05]
Word 6 score: [0.0015727  0.0193671  0.8488869  0.00374162 0.12643161]
Word 7 score: [0.00149733 0.02114222 0.8671429  0.00308779 0.1071298 ]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [1.3137650e-07 1.0768301e-05 4.9999452e-01 4.9999452e-01 8.4545412e-11]
Word 13 score: [1.45448823e-07 1.45777385e-05 4.99992609e-01 4.99992609e-01
 9.00271385e-11]
Word 14 score: [0.57300967 0.01780478 0.0111711  0.02004677 0.3779677 ]
Word 15 score: [6.0619241e-01 3.9369923e-01 5.7126266e-07 7.0372604e-05 3.7438214e-05]
Word 16 score: [4.0407456e-03 2.1224167e-08 7.4420645e-06 1.4794104e-03 9.9447232e-01]
Word 19 score: [9.7917664e-01 8.6051252e-05 2.2860370e-06 3.7743095e-03 1.6960671e-02]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
------
1861
bis ##tro ca ##cao
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [3.1127740e-02 9.4467038e-01 2.3686875e-02 5.1450497e-04 4.2309026e-07]
Word 1 score: [9.9418807e-01 3.2520352e-04 9.8897508e-06 5.4641375e-03 1.2764961e-05]
Word 2 score: [0.0021187  0.01895095 0.83962774 0.00245202 0.13685058]
Word 3 score: [0.00194151 0.01859879 0.85643476 0.0023241  0.12070083]
------
1862
the previous agent cited restaurants that can not be booked through this service . i can offer you a booking at one of these establishments instead : angelo ' s pi ##zz ##eria & bis ##tro or cap ##rice bis ##tro . would you like to make a reservation ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O
Score: 
Word 27 score: [0.2 0.2 0.2 0.2 0.2]
Word 28 score: [0.2126497  0.00334109 0.60075665 0.00310919 0.18014331]
Word 29 score: [9.9942446e-01 1.6828837e-06 3.3286476e-08 1.7975711e-06 5.7214196e-04]
Word 30 score: [4.2415800e-17 5.0536345e-15 3.8186397e-02 2.4192248e-16 9.6181357e-01]
Word 31 score: [3.7838011e-17 4.6232460e-15 3.5962600e-02 1.8118217e-16 9.6403742e-01]
Word 32 score: [3.8894625e-17 3.9328527e-15 2.9838840e-02 1.6346726e-16 9.7016114e-01]
Word 33 score: [0.2 0.2 0.2 0.2 0.2]
Word 34 score: [8.0806535e-01 1.8746191e-01 1.8879746e-05 4.4530588e-03 7.8428741e-07]
Word 35 score: [7.8155726e-01 2.1043596e-01 3.1849053e-05 7.9739699e-03 9.7498901e-07]
Word 37 score: [7.4527942e-02 1.1230739e-03 9.2239064e-01 1.3593447e-03 5.9898925e-04]
Word 38 score: [8.6859596e-01 6.6598348e-04 8.1189135e-03 1.2097959e-01 1.6395251e-03]
Word 39 score: [9.6394956e-01 3.5679217e-02 3.1680497e-06 3.6630145e-04 1.7553642e-06]
Word 40 score: [9.5489156e-01 4.4640176e-02 3.6373979e-06 4.6155744e-04 3.0914503e-06]
------
1863
angelo ' s pi ##zz ##eria & bis ##tro
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.5401311  0.0006977  0.3164722  0.00113472 0.14156428]
Word 2 score: [9.9945503e-01 6.7084932e-07 4.0334378e-08 1.5364712e-06 5.4265396e-04]
Word 3 score: [2.8746588e-18 1.4076470e-15 3.2817271e-01 2.0577448e-17 6.7182726e-01]
Word 4 score: [3.7076195e-18 1.8538436e-15 2.9874784e-01 2.1149501e-17 7.0125210e-01]
Word 5 score: [4.7778457e-18 2.0869708e-15 2.9678798e-01 2.2550282e-17 7.0321202e-01]
Word 6 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [8.8509566e-01 1.0881832e-01 1.2802845e-05 6.0726698e-03 6.8458110e-07]
Word 8 score: [9.2186487e-01 7.2183862e-02 9.8231376e-06 5.9409197e-03 5.1701215e-07]
------
1864
your reservation is confirmed ! please enjoy your meal , and thank you for using our service .
Predicted label: ['inform', 'thanks']
Real label: ['inform', 'thanks']
Predicted slot label: O O O O O B-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing
Real slot label: O O O O O B-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing I-closing
Score: 
Word 5 score: [7.6393299e-02 3.4204189e-02 8.8839692e-01 1.0054943e-03 9.1056883e-08]
Word 6 score: [1.1270524e-02 1.6923578e-02 9.7112513e-01 6.7921937e-04 1.6331685e-06]
Word 7 score: [5.2653480e-04 9.9922526e-01 2.4819188e-04 1.2005686e-16 1.2005686e-16]
Word 8 score: [9.1187815e-08 3.6151502e-07 1.0483394e-06 5.4104525e-01 4.5895323e-01]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [9.9569869e-01 1.7679189e-04 8.7082444e-04 1.6457519e-04 3.0890198e-03]
Word 11 score: [2.1496566e-02 1.9655390e-04 9.7564584e-01 2.0025748e-04 2.4606935e-03]
Word 12 score: [6.1577684e-01 1.8833632e-03 3.6801968e-02 3.1994513e-04 3.4521794e-01]
Word 13 score: [2.4741933e-08 7.9554928e-07 2.7190962e-08 9.9995840e-01 4.0710998e-05]
Word 14 score: [1.1087790e-02 4.1491736e-04 1.1087790e-02 9.7740948e-01 4.2330171e-12]
Word 15 score: [2.2579352e-06 8.4935218e-02 7.4805862e-01 1.2533377e-01 4.1670110e-02]
Word 16 score: [2.1173017e-02 4.2789971e-04 3.0981509e-02 8.5545793e-02 8.6187184e-01]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
------
1865
can you recommend a good brazilian steak ##house in san diego ? i need the reservation to be for next monday
Predicted label: ['request']
Real label: ['request', 'inform']
Predicted slot label: O O O O O B-restauranttype I-restauranttype I-restauranttype O B-city I-city O O O O O O O O B-date I-date
Real slot label: O O O O O B-restauranttype I-restauranttype I-restauranttype O B-city I-city O O O O O O O O B-date I-date
Score: 
Word 5 score: [2.5222285e-02 9.4905877e-01 4.9640785e-04 2.3939845e-07 2.5222285e-02]
Word 6 score: [1.2710920e-04 6.9805011e-17 4.3219975e-14 2.3789644e-12 9.9987292e-01]
Word 7 score: [5.0708874e-08 4.2713293e-19 3.0254357e-16 4.6375901e-15 1.0000000e+00]
Word 9 score: [1.1461192e-06 3.6480284e-01 6.3519496e-01 9.0984685e-07 1.2316315e-07]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [2.3511953e-04 2.0727419e-05 5.8231282e-04 9.9915993e-01 1.8935331e-06]
Word 20 score: [1.4311012e-05 1.5951757e-05 3.2057610e-01 3.3969682e-01 3.3969682e-01]
------
1866
what time would you like to go and how many people will be going ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O
Score: 
------
1867
from 5 ##pm to 7 ##pm . there will be two of us but we may need to have another 4 come , it ' s okay if they get their own table . if that does n ' t work , just the reservation for two is fine
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O B-starttime I-starttime O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O B-starttime I-starttime O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
------
1868
fog ##o de chao and rei do ga ##do are both available . which would you prefer ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [1.2847576e-03 3.8641293e-02 9.6000773e-01 6.3743568e-07 6.5590444e-05]
Word 3 score: [1.00000e+00 9.17265e-12 9.17265e-12 9.17265e-12 9.17265e-12]
Word 5 score: [3.9731244e-06 5.0173920e-08 3.2313674e-05 9.3746853e-01 6.2495187e-02]
Word 6 score: [3.1508978e-02 1.3304327e-03 8.7189496e-01 6.4912001e-08 9.5265552e-02]
Word 7 score: [1.7965746e-01 8.0910081e-01 7.2264299e-04 1.0515111e-02 4.0149475e-06]
Word 8 score: [2.3304436e-01 7.5497520e-01 6.6148344e-04 1.1315300e-02 3.6745259e-06]
------
1869
fog ##o de chao sounds pretty sp ##iff ##y , lets go with that
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O O
Score: 
Word 0 score: [0.2 0.2 0.2 0.2 0.2]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [4.5474927e-04 1.5309889e-02 9.8421311e-01 2.6010767e-07 2.2004115e-05]
Word 3 score: [1.0000000e+00 3.1441398e-11 3.1441398e-11 3.1441398e-11 3.1441398e-11]
------
1870
i have successfully completed your reservation at fog ##o de chao for next monday at 6 : 00pm . enjoy !
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date O O O O O B-closing O
Real slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date O O O O O B-closing O
Score: 
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [8.0654887e-04 7.9928458e-02 9.1914356e-01 3.6102844e-07 1.2103964e-04]
Word 10 score: [1.0000000e+00 1.3953519e-12 1.3953519e-12 1.3953519e-12 1.3953519e-12]
Word 12 score: [7.6121360e-05 5.5572094e-05 1.1178893e-03 9.9873942e-01 1.1028894e-05]
Word 13 score: [6.1896333e-04 3.2972865e-04 4.3183646e-01 2.8360742e-01 2.8360742e-01]
Word 19 score: [7.8495555e-02 5.6399368e-03 9.0982705e-01 1.3575030e-05 6.0239378e-03]
------
1871
hello , i am looking for japanese restaurants in denver . can you recommend any ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O B-city O O O O O O
Real slot label: O O O O O O O O O B-city O O O O O O
Score: 
Word 9 score: [4.3665629e-08 4.5030383e-06 1.1579868e-04 9.9980778e-01 7.1906252e-05]
------
1872
sure ! what day would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
1873
friday , march 11th , please .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date I-date I-date I-date O O O
Real slot label: B-date I-date I-date I-date O O O
Score: 
Word 0 score: [9.4519049e-01 1.9552058e-02 3.1387076e-02 9.3195401e-04 2.9383786e-03]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [2.9201814e-04 7.8125268e-01 3.8529009e-02 1.3922016e-01 4.0706079e-02]
Word 3 score: [0.2 0.2 0.2 0.2 0.2]
------
1874
how many will be dining ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O
Real slot label: O O O O O O
Score: 
------
1875
there will be three people .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O
Real slot label: O O O O O O
Score: 
------
1876
what time would you like your reservation ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O
Real slot label: O O O O O O O O
Score: 
------
1877
seven o ' clock , please .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
1878
i found the following restaurants that match your criteria : ban ##zai su ##shi , cherry hills su ##shi co , mi ##yama japanese steak house and su ##shi bar . which one would you like to book ?
Predicted label: ['inform', 'multiple_choice']
Real label: ['inform', 'multiple_choice']
Predicted slot label: O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O
Real slot label: O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O O O O O O O
Score: 
Word 10 score: [2.9203331e-05 2.8568070e-04 6.5346790e-09 9.9968266e-01 2.4904662e-06]
Word 11 score: [1.31926555e-02 1.68037810e-03 4.18856680e-01 5.66249549e-01
 2.07314861e-05]
Word 12 score: [3.0421285e-07 7.1559101e-01 1.6888976e-08 2.8268117e-01 1.7275255e-03]
Word 13 score: [2.3820863e-07 8.1017637e-01 1.5144256e-08 1.8847182e-01 1.3515924e-03]
Word 15 score: [3.5695371e-07 2.1663113e-04 5.3328928e-05 9.9965060e-01 7.9036567e-05]
Word 16 score: [9.6070313e-01 3.9296824e-02 1.3099255e-12 1.3099255e-12 1.3099255e-12]
Word 17 score: [2.6569461e-07 8.0494028e-01 1.3548904e-08 1.9370350e-01 1.3559720e-03]
Word 18 score: [2.09299060e-07 8.51402819e-01 1.24851836e-08 1.47339687e-01
 1.25729188e-03]
Word 19 score: [1.36214993e-07 1.52094235e-05 9.99982953e-01 3.86785359e-07
 1.33141123e-06]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [1.1871042e-06 1.1993769e-01 4.8852083e-04 8.7944031e-01 1.3233801e-04]
Word 24 score: [1.6727047e-01 5.4457538e-10 4.1131382e-15 2.4110679e-11 8.3272952e-01]
Word 25 score: [0.00336809 0.89586955 0.0017111  0.06648652 0.03256483]
Word 26 score: [0.3677574  0.02722669 0.03314959 0.06040655 0.5114597 ]
Word 27 score: [1.66646416e-07 9.45565403e-01 1.44067664e-08 5.34796230e-02
 9.54786723e-04]
Word 28 score: [2.0055591e-06 3.5170060e-01 3.9532587e-08 6.4408290e-01 4.2144540e-03]
Word 29 score: [1.0772769e-02 3.4964449e-07 8.4161375e-06 9.8917028e-03 9.7932684e-01]
------
1879
the mi ##yama japanese steak house and su ##shi bar , please .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O
Real slot label: B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O O O
Score: 
Word 0 score: [8.8693678e-01 9.3984336e-02 1.2342365e-05 1.0071498e-05 1.9056419e-02]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
Word 3 score: [1.5231423e-07 1.8576434e-01 4.0264183e-04 8.1338108e-01 4.5185874e-04]
Word 4 score: [1.2363858e-01 5.8050297e-11 3.6286066e-16 1.6110542e-12 8.7636143e-01]
Word 5 score: [0.00712129 0.84393656 0.00165511 0.06781179 0.07947531]
Word 6 score: [0.55449843 0.02104646 0.02458417 0.02369609 0.3761748 ]
Word 7 score: [9.4553776e-08 9.9327070e-01 7.7364498e-10 5.5242148e-03 1.2050600e-03]
Word 8 score: [2.0799032e-05 2.7572647e-01 1.7777745e-08 6.5657908e-01 6.7673631e-02]
Word 9 score: [9.2413952e-04 2.1578009e-08 1.4833576e-06 1.2319317e-03 9.9784243e-01]
------
1880
i have successfully completed your reservation at mi ##yama japanese steak house and su ##shi bar for 3 / 11 / 16 at 7 ##pm for 3 people . enjoy !
Predicted label: ['inform', 'closing']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O O O O O O O B-date I-date I-date I-date I-date O B-starttime I-starttime O B-numberofpeople O O B-closing O
Real slot label: O O O O O O O O O O O O O O O O O B-date I-date I-date I-date I-date O B-starttime I-starttime O B-numberofpeople O O B-closing O
Score: 
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 19 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
Word 24 score: [0.2 0.2 0.2 0.2 0.2]
Word 26 score: [0.2 0.2 0.2 0.2 0.2]
Word 29 score: [4.9862969e-03 1.8810516e-02 9.7539943e-01 3.4627024e-05 7.6909509e-04]
------
1881
book me a table for 1 at ag ##rod ##ol ##ce in seattle for tomorrow at 7 : 00 pm .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-city O B-date O O O O O O
Real slot label: O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-city O B-date O O O O O O
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [9.6037108e-01 3.2921001e-02 6.7079426e-03 3.0278662e-09 3.0278662e-09]
Word 8 score: [9.9999833e-01 4.4040030e-07 1.1630012e-06 7.7842565e-15 7.7842565e-15]
Word 9 score: [9.9999583e-01 3.8555054e-06 2.5747121e-07 2.5578924e-08 2.5578924e-08]
Word 10 score: [9.9999619e-01 3.5548578e-06 2.6315558e-07 1.9189404e-08 1.9189404e-08]
Word 12 score: [1.1514235e-01 3.5222116e-04 3.0879056e-01 5.7429701e-01 1.4179060e-03]
Word 14 score: [8.07083905e-01 7.00962842e-02 1.60615173e-07 3.80599818e-06
 1.22815795e-01]
------
1882
your reservation for ag ##rod ##ol ##ce on 03 / 08 / 2016 at 7 ##pm for 1 guest was confirmed . enjoy your meal .
Predicted label: ['inform']
Real label: ['inform', 'closing']
Predicted slot label: O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date I-date I-date O B-starttime I-starttime O B-numberofpeople O O O O B-closing I-closing I-closing I-closing
Real slot label: O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-date I-date I-date I-date I-date O B-starttime I-starttime O B-numberofpeople O O O O B-closing I-closing I-closing I-closing
Score: 
Word 3 score: [6.6933268e-01 2.3891161e-01 9.1755651e-02 5.9771046e-09 5.9771046e-09]
Word 4 score: [9.9999070e-01 2.8010118e-06 6.5826071e-06 4.3803211e-14 4.3803211e-14]
Word 5 score: [9.9998021e-01 1.8348081e-05 1.3814168e-06 2.7226326e-08 2.7226326e-08]
Word 6 score: [9.9998319e-01 1.5431329e-05 1.3497975e-06 1.4996555e-08 1.4996555e-08]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 22 score: [1.3509712e-01 5.4674894e-03 8.5571331e-01 2.0011539e-05 3.7021001e-03]
Word 23 score: [3.7901831e-05 9.9718153e-01 2.7806291e-03 3.9196240e-19 3.9196240e-19]
Word 24 score: [4.9297141e-05 3.6425499e-05 5.4311455e-04 8.2769412e-01 1.7167705e-01]
Word 25 score: [0.2 0.2 0.2 0.2 0.2]
------
1883
i need pizza for my son ' s baseball team
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O B-food O O O O O O O
Real slot label: O O B-food O O O O O O O
Score: 
Word 2 score: [7.7780628e-01 1.6638713e-09 3.4794572e-03 1.9307804e-01 2.5636209e-02]
------
1884
where are you located ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
1885
seattle
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-city
Real slot label: B-city
Score: 
Word 0 score: [8.0472302e-01 5.2727024e-05 1.4196783e-01 5.3091664e-02 1.6474249e-04]
------
1886
when would you like to go ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O
Real slot label: O O O O O O O
Score: 
------
1887
saturday afternoon
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-date I-date
Real slot label: B-date I-date
Score: 
Word 0 score: [1.13822326e-01 3.05201620e-01 8.25020470e-06 5.80872357e-01
 9.53615381e-05]
Word 1 score: [9.6424419e-01 3.5378352e-02 2.0374644e-05 2.5361200e-05 3.3178736e-04]
------
1888
how many are going ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O
Real slot label: O O O O O
Score: 
------
1889
about 15 people , mostly kids
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O B-numberofpeople O O O O
Real slot label: O B-numberofpeople O O O O
Score: 
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
------
1890
what time would you like me to search for ?
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O O O O
Real slot label: O O O O O O O O O O
Score: 
------
1891
around 2 ##pm
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-starttime I-starttime I-starttime
Real slot label: B-starttime I-starttime I-starttime
Score: 
Word 0 score: [9.9998379e-01 1.0576582e-05 4.3737199e-07 4.3737199e-07 4.7637304e-06]
Word 1 score: [0.2 0.2 0.2 0.2 0.2]
Word 2 score: [0.2 0.2 0.2 0.2 0.2]
------
1892
do you have a price range in mind ? also , are you looking for a type of restaurant that has video games too ?
Predicted label: ['request']
Real label: ['request', 'confirm_question']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1893
cheap ##ish price range . video games would be good
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: B-pricing I-pricing O O O O O O O O
Real slot label: B-pricing I-pricing O O O O O O O O
Score: 
Word 0 score: [0.03952175 0.24011958 0.24011958 0.24011958 0.24011958]
Word 1 score: [1.000000e+00 9.247129e-20 9.247129e-20 9.247129e-20 9.247129e-20]
------
1894
bell ##town pizza fits all those criteria . would you like to book a table there ?
Predicted label: ['inform', 'confirm_question']
Real label: ['confirm_question']
Predicted slot label: O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O
Score: 
------
1895
perfect
Predicted label: ['confirm_answer']
Real label: ['confirm_answer']
Predicted slot label: O
Real slot label: O
Score: 
------
1896
great , i ' ve secured a table for you at 2 pm . what name shall i put on the reservation ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O O O O O
Score: 
------
1897
i need to book a table for 3 / 21 at 7 pm for dinner at the ac ##qua in san diego for four guests .
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O B-date I-date I-date O O O O B-mealtype O O B-restaurantname I-restaurantname O B-city I-city O O O O
Real slot label: O O O O O O O B-date I-date I-date O O O O B-mealtype O O B-restaurantname I-restaurantname O B-city I-city O O O O
Score: 
Word 7 score: [0.2 0.2 0.2 0.2 0.2]
Word 8 score: [0.2 0.2 0.2 0.2 0.2]
Word 9 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [9.9992299e-01 2.1228479e-05 1.1861280e-10 5.5724406e-05 1.8659569e-09]
Word 17 score: [1.2507598e-05 9.9710196e-01 5.4184584e-06 1.6185611e-04 2.7182226e-03]
Word 18 score: [8.1428162e-08 9.9825519e-01 1.2956503e-08 1.7447267e-03 4.3894408e-10]
Word 20 score: [1.9623310e-07 2.7295715e-01 7.2704214e-01 2.6872939e-07 2.0809770e-07]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
------
1898
i can not find that restaurant in our system . would you like to try a different restaurant ?
Predicted label: ['request', 'inform']
Real label: ['request', 'inform']
Predicted slot label: O O O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O O O
Score: 
------
1899
?
Predicted label: ['confirm_answer']
Real label: ['confirm_question']
Predicted slot label: O
Real slot label: O
Score: 
------
1900
apologies it is in our system , your reservation for 3 / 21 at 7 : 00pm at ac ##qua is confirmed .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O B-date I-date I-date O B-starttime I-starttime I-starttime O B-restaurantname I-restaurantname O O O
Real slot label: O O O O O O O O O O B-date I-date I-date O B-starttime I-starttime I-starttime O B-restaurantname I-restaurantname O O O
Score: 
Word 10 score: [0.2 0.2 0.2 0.2 0.2]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [0.2 0.2 0.2 0.2 0.2]
Word 15 score: [0.2 0.2 0.2 0.2 0.2]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [6.9815625e-04 9.0665215e-01 3.5313267e-05 1.0823635e-03 9.1532029e-02]
Word 19 score: [5.8279452e-06 9.8908406e-01 6.9709574e-07 1.0909442e-02 1.7738540e-09]
------
1901
can you find me a table at card ##amo ##m indian cuisine in los angeles ? its for 2 people tonight at 8 ##pm
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-city I-city O O O B-numberofpeople O B-date O B-starttime I-starttime
Real slot label: O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-city I-city O O O B-numberofpeople O B-date O B-starttime I-starttime
Score: 
Word 7 score: [7.9377045e-05 9.9829251e-01 7.5873812e-13 1.9400840e-11 1.6281187e-03]
Word 8 score: [9.9868387e-01 1.3103368e-03 9.6019015e-09 1.3014741e-07 5.7309694e-06]
Word 9 score: [3.2349205e-01 4.5895009e-04 2.6355435e-10 1.0208154e-09 6.7604899e-01]
Word 10 score: [2.4655174e-02 9.6520585e-01 8.2785217e-04 9.0988781e-03 2.1230568e-04]
Word 11 score: [2.0464543e-07 9.9935848e-01 5.9513820e-08 6.4127048e-04 2.4385624e-10]
Word 13 score: [2.3983246e-05 4.3211654e-05 2.0631708e-02 9.2903474e-06 9.7929186e-01]
Word 14 score: [9.4393533e-01 2.7556433e-03 5.3308979e-02 4.6472767e-11 4.6472767e-11]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
Word 20 score: [0.0179654  0.2260202  0.11879108 0.0190328  0.61819047]
Word 22 score: [0.2 0.2 0.2 0.2 0.2]
Word 23 score: [0.2 0.2 0.2 0.2 0.2]
------
1902
success ! i was able to book you a restaurant at card ##amo ##m indian cuisine for 2 tonight at 8 pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-numberofpeople B-date O O O O
Real slot label: O O O O O O O O O O O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname O B-numberofpeople B-date O O O O
Score: 
Word 11 score: [2.2482083e-04 9.9714005e-01 3.8319876e-13 3.9758700e-12 2.6351798e-03]
Word 12 score: [9.9991202e-01 8.7879453e-05 7.8426471e-10 1.0441876e-08 1.6930170e-07]
Word 13 score: [9.3571687e-01 1.3422979e-04 7.7821485e-11 2.2641868e-10 6.4148955e-02]
Word 14 score: [3.2748128e-03 9.9420714e-01 1.2122297e-03 1.2074140e-03 9.8271412e-05]
Word 15 score: [4.7585004e-08 9.9934608e-01 1.0873980e-08 6.5391150e-04 8.5141139e-12]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.00115437 0.50871694 0.2872894  0.00144829 0.20139103]
------
1903
book me a table for 2 in seattle for tomorrow at 7 : 00 pm at ri ##stor ##ante do ##ria
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-city O O O B-starttime I-starttime I-starttime I-starttime O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Real slot label: O O O O O B-numberofpeople O B-city O O O B-starttime I-starttime I-starttime I-starttime O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [2.7476121e-02 2.0615611e-04 3.5463613e-02 9.3628144e-01 5.7263352e-04]
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 12 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [0.2 0.2 0.2 0.2 0.2]
Word 14 score: [2.1189022e-05 9.5926726e-01 4.0683735e-02 1.3947508e-05 1.3880153e-05]
Word 16 score: [9.9826318e-01 1.7368236e-03 2.3047876e-08 2.3047876e-08 2.3047876e-08]
Word 17 score: [9.8509431e-01 1.4905662e-02 4.4330977e-14 4.4330977e-14 4.4330977e-14]
Word 18 score: [9.9361837e-01 6.3808868e-03 2.5350880e-07 2.5350880e-07 2.5350880e-07]
Word 19 score: [9.9527538e-01 9.9664998e-10 2.1051685e-09 4.6572625e-03 6.7402550e-05]
Word 20 score: [9.9741191e-01 1.3836303e-09 2.3141853e-09 2.5354212e-03 5.2674619e-05]
------
1904
success ! i was able to book you a table for 2 at ri ##stor ##ante do ##ria tomorrow at 7 ##pm .
Predicted label: ['inform']
Real label: ['inform']
Predicted slot label: O O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname B-date O B-starttime I-starttime O
Real slot label: O O O O O O O O O O O B-numberofpeople O B-restaurantname I-restaurantname I-restaurantname I-restaurantname I-restaurantname B-date O B-starttime I-starttime O
Score: 
Word 11 score: [0.2 0.2 0.2 0.2 0.2]
Word 13 score: [9.9830246e-01 1.6975340e-03 9.9253805e-09 9.9253805e-09 9.9253805e-09]
Word 14 score: [9.8205847e-01 1.7941525e-02 4.4762218e-15 4.4762218e-15 4.4762218e-15]
Word 15 score: [9.9050051e-01 9.4995592e-03 1.5871802e-08 1.5871802e-08 1.5871802e-08]
Word 16 score: [9.9764687e-01 6.9804917e-10 3.8233308e-10 2.3477525e-03 5.3809740e-06]
Word 17 score: [9.9832922e-01 1.3082244e-09 4.7862420e-10 1.6660779e-03 4.7717681e-06]
Word 18 score: [7.2587164e-07 9.0628015e-07 3.2365947e-13 2.2060947e-11 9.9999833e-01]
Word 20 score: [0.2 0.2 0.2 0.2 0.2]
Word 21 score: [0.2 0.2 0.2 0.2 0.2]
------
1905
book me a table for 1 in seattle for tomorrow at 7 : 00 pm at can ##tine ##tta
Predicted label: ['request']
Real label: ['request']
Predicted slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname
Real slot label: O O O O O B-numberofpeople O B-city O B-date O O O O O O B-restaurantname I-restaurantname I-restaurantname
Score: 
Word 5 score: [0.2 0.2 0.2 0.2 0.2]
Word 7 score: [3.543494e-02 1.953068e-04 7.268600e-02 8.911270e-01 5.566745e-04]
Word 9 score: [6.1171836e-01 8.1730872e-02 4.7354254e-07 2.7368603e-06 3.0654761e-01]
Word 16 score: [0.2 0.2 0.2 0.2 0.2]
Word 17 score: [0.2 0.2 0.2 0.2 0.2]
Word 18 score: [0.2 0.2 0.2 0.2 0.2]
------
1906
i have secured that table for you ! what name shall i put on the reservation ?
Predicted label: ['request', 'inform']
Real label: ['request']
Predicted slot label: O O O O O O O O O O O O O O O O O
Real slot label: O O O O O O O O O O O O O O O O O
Score: 
------
