DIP-SumEval: A Data Set of Human Summary Evaluations
Loading...
Date
2020-03-13
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
Description
This repository contains the summaries and evaluations from the paper 'A Dataset for the Analysis of Text Quality Dimensions in Summarization Evaluation' presented at LREC 2020. In total, the data set contains over 400 automatically generated summaries for 49 topics of an data set for multi-document summarization, 1274 judgements according to 11 text and summary quality criteria on a Likert-scale (1 to 5) performed by 26 trained annotators, and 43218 pairwise judgements according to 6 criteria performed by 64 crowd-workers.
If you want to use the data please cite the paper http://www.ke.tu-darmstadt.de/bibtex/publications/show/3200
Citation
Endorsement
Related Resources
Is Supplement To
http://www.ke.tu-darmstadt.de/bibtex/publications/show/3200Is Original Form Of
https://github.com/keelm/DIP-SumEvalProject(s)
Faculty
Collections
License
Except where otherwise noted, this license is described as CC BY 4.0 - Attribution 4.0 International