@inproceedings{natarajan-etal-2020-neighbor,
    title = "Neighbor Contextual Information Learners for Joint Intent and Slot Prediction",
    author = "Natarajan, Bharatram  and
      Mathur, Gaurav  and
      Jain, Sameer",
    editor = "S, Praveen Kumar G  and
      Mukherjee, Siddhartha  and
      Samal, Ranjan",
    booktitle = "Proceedings of the Workshop on Joint NLP Modelling for Conversational AI @ ICON 2020",
    month = dec,
    year = "2020",
    address = "Patna, India",
    publisher = "NLP Association of India (NLPAI)",
    url = "https://preview.aclanthology.org/build-pipeline-with-new-library/2020.icon-workshop.1/",
    pages = "1--9",
    abstract = "Intent Identification and Slot Identification aretwo important task for Natural Language Understanding(NLU). Exploration in this areahave gained significance using networks likeRNN, LSTM and GRU. However, modelscontaining the above modules are sequentialin nature, which consumes lot of resourceslike memory to train the model in cloud itself. With the advent of many voice assistantsdelivering offline solutions for manyapplications, there is a need for finding replacementfor such sequential networks. Explorationin self-attention, CNN modules hasgained pace in the recent times. Here we exploreCNN based models like Trellis and modifiedthe architecture to make it bi-directionalwith fusion techniques. In addition, we proposeCNN with Self Attention network calledNeighbor Contextual Information Projector usingMulti Head Attention (NCIPMA) architecture. These architectures beat state of the art inopen source datasets like ATIS, SNIPS."
}