# Introduction

This Repo conduct three NLP task: Neural Machine Translation, Abstractive Summarization, and Language Modeling.

# Requirements and Installation

* [PyTorch](http://pytorch.org/) version == 1.8
* Python version >= 3.6

To install fairseq from source and develop locally:
```
git clone https://github.com/dropreg/R-Drop.git
cd R-Drop/fairseq_src/
pip install --editable .
```

# Examples

* [Nerual Translation Task](examples/translation_rdrop/README.md): R-Drop transformer models are available
* [Abstractive Summarization Task](examples/summeration_rdrop/README.md): R-Drop transformer models are available
* [Language Modeling Task](examples/language_model_rdrop/README.md): R-Drop transformer models are available