# Gen-TyDiQA 

We present the GenTyDiQA dataset. The GenTyDiQA dataset is an extension of the TyDiQA dataset (Clark et. al 2020) including natural, well-formed answers for Arabic, Bengali, English, Japanese and  Russian.

## Description: 

Each sample includes: 
- The language
- The question and passage extracted from the TyDiQA dataset
- The human generated natural sounding complete answer. 
- A unique id. 

## Example 
```
{
        "language": "en",
        "question": "Who lost the Battle of Chancellorsville?\n",
        "answer": "The Union lost the Battle of Chancellorsville.\n",
        "passage": "The Battle of Chancellorsville was a major battle of the American Civil War (1861\u20131865), and the principal engagement of the Chancellorsville Campaign.\t It was fought from April 30 to May 6, 1863, in Spotsylvania County, Virginia, near the village of Chancellorsville.\tTwo related battles were fought nearby on May 3 in the vicinity of Fredericksburg.\tThe campaign pitted Union Army Maj.\tGen. Joseph Hooker's Army of the Potomac against an army less than half its size, General Robert E. Lee's Confederate Army of Northern Virginia.\tChancellorsville is known as Lee's \"perfect battle\" because his risky decision to divide his army in the presence of a much larger enemy force resulted in a significant Confederate victory.\tThe victory, a product of Lee's audacity and Hooker's timid decision making, was tempered by heavy casualties, including Lt.\tGen. Thomas J. \"Stonewall\" Jackson.\tJackson was hit by friendly fire, requiring his left arm to be amputated; he died of pneumonia eight days later, a loss that Lee likened to losing his right arm.\tLee's difficulty in replacing his lost men as well as his inability to prevent the Union Withdrawal effectively have led to his great victory being regarded as a Pyrrhic one.\n",
        "id": "6f62165eb6cdb42c2e29230369433f475aa6cac4"
    }
```

## Release

This dataset is publically released under the Apache 2.0 License or equivalent compatible license.





