Home Calls Workshops Tutorial GenChal 2021 Organisation Registration Sponsorship Contact


GenChal@INLG2021

Generation Challenges 2021 Call for Task Proposals



We invite submissions of papers describing ideas for future shared tasks in the general area of language generation (GENERATION CHALLENGES 2021) Proposed tasks can be in the area of core NLG, or in other research areas in which language is generated. Examples include, but are not limited to: data-to-text NLG, text-to-text generation (including MT and summarisation), combining core NLG and MT, combining core NLG and text summarisation, NLG quality estimation, NLG evaluation metrics, and/or generating language from heterogeneous data, including image and video.
=======================================

GENERATION CHALLENGES 2021 (To be held in conjunction with INLG 2021, September 20-24, Aberdeen, UK)

The Generation Challenges are an umbrella event designed to bring together a variety of shared-task efforts that involve the generation of natural language. This year, Generation Challenges will be held during a special session at the 14th International Conference on Natural Language Generation (INLG 2021), in Aberdeen, UK.

The session will follow the format of previous GenChal results sessions, with presentations of results by the organisers of the generation challenges that are currently running, as well as presentations of proposals for new shared tasks in the Task Proposals Track.

• Shared Task on Evaluating Accuracy in Generated Texts
Organised by Ehud Reiter and Craig Thomson
https://github.com/ehudreiter/accuracySharedTask

• The ReproGen Shared Task on Reproducibility of Human Evaluations in NLG
Organised by Anya Belz, Shubham Agarwal, Anastasia Shimorina and Ehud Reiter
https://reprogen.github.io/
=======================================

Call for new Shared Task proposals

Submissions should describe possible future tasks in detail, including information regarding organisers, task description, motivating theoretical interest and/or application context, size and state of completion of data to be used, schedule and evaluation plans. Accepted shared tasks will be run in the 2022 iteration of INLG.
=======================================

Instructions for Paper Submissions:

Submissions in the Task Proposals Track should be no more than 4 (four) pages long excluding citations, and should follow the guidelines and template files from ACL Author Guidelines (https://www.aclweb.org/adminwiki/index.php?title=ACL_Author_Guidelines) and policies for submission, review and citation, and be anonymised for double blind reviewing. Please use ACL 2021 style files for Word or Latex.

Papers should be submitted via softconf (https://www.softconf.com/l/inlg2021/). Please make sure you select "Generation Challenge" in the "Submission Type (*)" drop down menu ("Submission Categories" section of the submission page)."

Task Proposal papers should be submitted no later than June 15th, 2021.

Submissions will be peer-reviewed by the program committee. As reviewing will not be blind, there is no need to anonymise papers.

This is not intended to be a selective process, since the aim is to discuss new potential shared tasks with INLG delegates. However, the organisers reserve the right to reject proposals which do not fall within the scope of the GenChal initiative, or which do not follow guidelines.

Accepted submissions will be included in the INLG 2021 proceedings.
=======================================

Dates:

Paper submission: June 15, 2021
Notification of acceptance: July 26, 2021
Submission of camera-ready papers: August 12, 2021 - 23:59 AOE (UTC-12)
INLG 2021: 20-24th September 2021

All deadlines are 11.59 pm UTC -12h ("anywhere on Earth")
=======================================

Program Committee:

Samira Shaikh (University of North Carolina at Charlotte) (Chair)
Chuan-Yi (Ernie) Chang (Saarland University)
Dimitra Gkatzia (Edinburgh Napier University)
Yvette Graham (Trinity College Dublin)
Yufang Hou (IBM Research Ireland)
Saad Mahmood (Trivago)
Simon Mille (Universitat Pompeu Fabra)