Alexander Shirnin
2026
The Classics at SemEval-2026 Task 3: Combining Transformer Models and LLM-Generated Annotations for Dimensional Aspect-Based Sentiment Analysis
Rafif Alshawi | Amit Raj - | Aleksey Kudelya | Alexander Shirnin
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Rafif Alshawi | Amit Raj - | Aleksey Kudelya | Alexander Shirnin
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
This paper presents an approach to the SemEval-2026 Task 3: Dimensional Aspect-Based Sentiment Analysis. We investigate methods for moving beyond traditional categorical sentiment (e.g., positive or negative) to predict fine-grained, real-valued scores for sentiment "valence" (positivity) and "arousal" (intensity). We participate in two subtasks: predicting these scores for given aspects (Subtask 1) and extracting full sets of sentiment details, including aspects, categories, and opinions alongside their scores (Subtask 3). Our approach for the regression task involves a weighted ensemble of transformer-based encoder models. For the Russian language, we further enhance the input by using a large language model (LLM) to generate synthetic sentiment descriptions. For the extraction task, we fine-tune a decoder LLM to perform structured prediction, allowing the system to identify sentiment elements and estimate their numerical scores simultaneously.
Lacuna Inc. at SemEval-2026 Task 4: Structurally Gated State-Space Models for Disentangling Narrative Similarity
Aleksey Kudelya | Rafif Alshawi | Alexander Shirnin
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Aleksey Kudelya | Rafif Alshawi | Alexander Shirnin
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
In this paper, we present the Invariant-Variant Disentangled State-Space Model (IVD-SSM),our submission to SemEval-2026 Task 4 on Narrative Story Similarity and Narrative Representation Learning. Evaluating narrative similarity is a profound computational challenge that requires models to look past concrete, superficial elements such as specific names, actors, objects, or settings to isolate and compareabstract patterns of causality and plot progression. To model these extended causal chainswithout the quadratic bottlenecks of standard Transformers, we leverage a hybrid State-SpaceModel (Jamba-1.5-Mini). Building upon this backbone, we introduce the Structurally Gated Alignment (SGA) head, a novel, differentiable algorithmic architecture. The SGA head operates on two scales: a heavily strided Macro-path maps the coarse structural skeleton of a story, which then acts as a gating mechanism to filter a full-resolution Micro-path, actively suppressing semantic noise and superficial keyword overlaps. Evaluated on both pairwisecomparative judgments (Track A) and dense representation learning (Track B), our approach demonstrates that explicitly disentangling structural invariants from lexical variants provides a robust, principled framework for deep narrative understanding.
2025
Empaths at SemEval-2025 Task 11: Retrieval-Augmented Approach to Perceived Emotions Prediction
Lev Morozov | Aleksandr Mogilevskii | Alexander Shirnin
Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025)
Lev Morozov | Aleksandr Mogilevskii | Alexander Shirnin
Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025)
The paper introduces EmoRAG, a retrieval-augmented emotion detection system designed for the SemEval-2025 Task 11. It uses an ensemble of models, retrieving similar examples to prompt large language models (LLMs) for emotion predictions. The retriever component fetches the most relevant examples from a database, which are then used as few-shot prompts for the models. EmoRAG achieves strong, scalable performance across languages with no training at all, demonstrating effectiveness in both high and low-resource languages.
Lacuna Inc. at SemEval-2025 Task 4: LoRA-Enhanced Influence-Based Unlearning for LLMs
Aleksey Kudelya | Alexander Shirnin
Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025)
Aleksey Kudelya | Alexander Shirnin
Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025)
This paper describes LIBU (LoRA enhanced influence-based unlearning), an algorithm to solve the task of unlearning - removing specific knowledge from a large language model without retraining from scratch and compromising its overall utility (SemEval-2025 Task 4: Unlearning sensitive content from Large Language Models). The algorithm combines classical influence functions to remove the influence of thedata from the model and second-order optimization to stabilize the overall utility. Our experiments show that this lightweight approach is well applicable for unlearning LLMs in different kinds of task.
2024
AIpom at SemEval-2024 Task 8: Detecting AI-produced Outputs in M4
Alexander Shirnin | Nikita Andreev | Vladislav Mikhailov | Ekaterina Artemova
Proceedings of the 18th International Workshop on Semantic Evaluation (SemEval-2024)
Alexander Shirnin | Nikita Andreev | Vladislav Mikhailov | Ekaterina Artemova
Proceedings of the 18th International Workshop on Semantic Evaluation (SemEval-2024)
This paper describes AIpom, a system designed to detect a boundary between human-written and machine-generated text (SemEval-2024 Task 8, Subtask C: Human-Machine Mixed Text Detection). We propose a two-stage pipeline combining predictions from an instruction-tuned decoder-only model and encoder-only sequence taggers. AIpom is ranked second on the leaderboard while achieving a Mean Absolute Error of 15.94. Ablation studies confirm the benefits of pipelining encoder and decoder models, particularly in terms of improved performance.
Papilusion at DAGPap24: Paper or Illusion? Detecting AI-generated Scientific Papers
Nikita Andreev | Alexander Shirnin | Vladislav Mikhailov | Ekaterina Artemova
Proceedings of the Fourth Workshop on Scholarly Document Processing (SDP 2024)
Nikita Andreev | Alexander Shirnin | Vladislav Mikhailov | Ekaterina Artemova
Proceedings of the Fourth Workshop on Scholarly Document Processing (SDP 2024)
This paper presents Papilusion, an AI-generated scientific text detector developed within the DAGPap24 shared task on detecting automatically generated scientific papers. We propose an ensemble-based approach and conduct ablation studies to analyze the effect of the detector configurations on the performance. Papilusion is ranked 6th on the leaderboard, and we improve our performance after the competition ended, achieving 99.46 (+9.63) of the F1-score on the official test set.