PMIndiaSum: Multilingual and cross-lingual headline summarization for languages in India

  • Ashok Urlana
  • , Pinzhen Chen
  • , Zheng Zhao
  • , Shay Cohen
  • , Manish Shrivastava
  • , Barry Haddow

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper introduces PMIndiaSum, a multilingual and massively parallel summarization corpus focused on languages in India. Our corpus provides a training and testing ground for four language families, 14 languages, and the largest to date with 196 language pairs. We detail our construction workflow including data acquisition, processing, and quality assurance. Furthermore, we publish benchmarks for monolingual, cross-lingual, and multilingual summarization by fine-tuning, prompting, as well as translate-and-summarize. Experimental results confirm the crucial role of our data in aiding summarization between Indian languages. Our dataset is publicly available and can be freely modified and re-distributed.
Original languageEnglish
Title of host publicationFindings of the Association for Computational Linguistics: EMNLP 2023
EditorsHouda Bouamor, Juan Pino, Kalika Bali
Place of PublicationSingapore
PublisherAssociation for Computational Linguistics
Pages11606-11628
Number of pages23
ISBN (Electronic)9798891760615
DOIs
Publication statusPublished - 01 Dec 2023
Externally publishedYes

Cite this