This folder contains two datasets used for evaluating the proposed approach in "Recursive Template-based Frame Generation for Task Oriented Dialog"
(1) ATIS: was modified to provide hierarchical tree representations
(2) Simulated dataset

There are three folders in each: train/test/valid

Data
|
|---ATIS_modified-|--train/train.tsv
|        |--test/test.tsv
|        |--valid/valid.tsv
|
|
|
|---Simulated-|--train/train.tsv
              |--test/test.tsv
              |--valid/valid.tsv


Format of the tsv files:
------------------------
Input sentence \t slot labels \t Hierarchical representation \t positional information

Example:
--------
Input Sentence: i want to fly from baltimore to dallas round trip .

Slot labels: O O O O O B-city_name O B-city_name B-round_trip I-round_trip O	
(one slot label for every token position)

Hierarchical representation: ROOT ( atis_flight ( fromloc ( city_name ( $city_name ) ) toloc ( city_name ( $city_name ) ) round_trip ( $round_trip ) ) )	

Positional information: 10 10 10 10 10 10 10 10 5 10 10 10 10 10 10 7 10 10 10 10 8 10 10 10
(Each of the labels in the hierarchical representation point to a token in the input sentence)
Non Terminals are aligned to the end of the sentence

for the above example,
ROOT points to position 10
( points to position 10
atis_flight points to position 10
( points to position 10
fromloc points to position 10
( points to position 10
city_name points to position 10
( points to position 10
$city_name points to position 5 in the input sentence (i.e., baltimore)
) points to position 10
) points to position 10
toloc points to position 10
( points to position 10
city_name points to position 10
( points to position 10
$city_name points to position 7 (i.e., dallas)
) points to position 10
) points to position 10
round_trip points to position 10
( points to position 10
$round_trip points to position 8 (i.e, round)
) points to position 10
) points to position 10
) points to position 10

