ArAIEval

Arabic AI Tasks Evaluation (ArAIEval)

Welcome to ArAIEval shared task at ArabicNLP 2024!

Propagandistic content spreading online in mainstream and social media is often used to mislead the general audience. Automatic identification of such content is crucial to assist fact-checkers, journalists, and the general audience in challenging the information presented in this content.

ArAIEval offers two shared tasks:

  1. detection of propagandistic textual spans with persuasion techniques identification (unimodal),
  2. distinguishing between propagandistic and non-propagandistic memes (multimodal).

ArAIEval covers both the tweets, news articles and memes. The classification settings includes span identification and binary subtasks.

Tasks

  • Task 1: Unimodal (Text) Propagandistic Technique Detection
  • Task 2: Multimodal Propagandistic Memes Classification

Important Dates

  • 15 Mar 2024: Registration on CodaLab and the start of the development cycle (release of training and development datasets, along with submission for the development phase on CodaLab)
  • 27 April 2023 23:59 AOE: Beginning of the evaluation cycle (test sets release)
  • 1 May 2024 23:59 AOE: End of the evaluation cycle (run submission)
  • 5 May 2024: Release leaderboard
  • 15 May 2024: Deadline for the submission of shared task papers
  • 17 June 2024: Notification of acceptance of shared task papers
  • 1 July 2024: Deadline for submission of camera-ready papers
  • 16 August 2023: ArabicNLP Conference (colocated with ACL-2024)

Recent Updates

  • 1st March, 2024: Website is up!

Contact

Organizers

  • Firoj Alam, Qatar Computing Research Institute, Qatar
  • Maram Hasanain, Qatar Computing Research Institute, Qatar
  • Reem Suwaileh, HBKU, Qatar
  • Md. Arid Hasan, University of New Brunswick, Canada
  • Fatema Ahmed, Qatar Computing Research Institute, Qatar
  • Md. Rafiul Biswas, HBKU, Qatar
  • Wajdi Zaghouani, HBKU, Qatar

Acknowledgments

The contributions of this work were funded by the NPRP grant 14C-0916-210015, which is provided by the Qatar National Research Fund (a member of Qatar Foundation).

QRDI



QNRF