@inproceedings{li-2021-codewithzichao,
    title = "Codewithzichao@{D}ravidian{L}ang{T}ech-{EACL}2021: Exploring Multilingual Transformers for Offensive Language Identification on Code Mixing Text",
    author = "Li, Zichao",
    editor = "Chakravarthi, Bharathi Raja  and
      Priyadharshini, Ruba  and
      Kumar M, Anand  and
      Krishnamurthy, Parameswari  and
      Sherly, Elizabeth",
    booktitle = "Proceedings of the First Workshop on Speech and Language Technologies for Dravidian Languages",
    month = apr,
    year = "2021",
    address = "Kyiv",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/ingest-emnlp/2021.dravidianlangtech-1.21/",
    pages = "164--168",
    abstract = "This paper describes our solution submitted to shared task on Offensive Language Identification in Dravidian Languages. We participated in all three of offensive language identification. In order to address the task, we explored multilingual models based on XLM-RoBERTa and multilingual BERT trained on mixed data of three code-mixed languages. Besides, we solved the class-imbalance problem existed in training data by class combination, class weights and focal loss. Our model achieved weighted average F1 scores of 0.75 (ranked 4th), 0.94 (ranked 4th) and 0.72 (ranked 3rd) in Tamil-English task, Malayalam-English task and Kannada-English task, respectively."
}