Natural Questions in Icelandic

Vésteinn Snæbjarnarson; Hafsteinn Einarsson

Natural Questions in Icelandic

Vésteinn Snæbjarnarson
, Hafsteinn Einarsson

Iðnaðarverkfræði-, vélaverkfræði- og tölvunarfræðideild

Háskóli Íslands

Rannsóknarafurð: Kafli í bók/skýrslu/ráðstefnuriti › Ráðstefnuframlag › ritrýni

Útdráttur

We present the first extractive question answering (QA) dataset for Icelandic, Natural Questions in Icelandic (NQiI). Developing such datasets is important for the development and evaluation of Icelandic QA systems. It also aids in the development of QA methods that need to work for a wide range of morphologically and grammatically different languages in a multilingual setting. The dataset was created by asking contributors to come up with questions they would like to know the answer to. Later, they were tasked with finding answers to each others questions following a previously published methodology. The questions are Natural in the sense that they are real questions posed out of interest in knowing the answer. The complete dataset contains 18 thousand labeled entries of which 5,568 are directly suitable for training an extractive QA system for Icelandic. The dataset is a valuable resource for Icelandic which we demonstrate by creating and evaluating a system capable of extractive QA in Icelandic.

Upprunalegt tungumál	Enska
Titill gistiútgáfu	2022 Language Resources and Evaluation Conference, LREC 2022
Ritstjórar	Nicoletta Calzolari, Frederic Bechet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Helene Mazo, Jan Odijk, Stelios Piperidis
Útgefandi	European Language Resources Association (ELRA)
Síður	4488-4496
Síðufjöldi	9
ISBN-númer (rafrænt)	9791095546726
Útgáfustaða	Útgefið - 2022
Viðburður	13th International Conference on Language Resources and Evaluation Conference, LREC 2022 - Marseille, Frakkland Tímalengd: 20 jún. 2022 → 25 jún. 2022

Ritröð

Nafn	2022 Language Resources and Evaluation Conference, LREC 2022

Ráðstefna

Ráðstefna	13th International Conference on Language Resources and Evaluation Conference, LREC 2022
Land/Yfirráðasvæði	Frakkland
Borg/bær	Marseille
Tímabil	20/06/22 → 25/06/22

Athugasemd

Publisher Copyright: © European Language Resources Association (ELRA), licensed under CC-BY-NC-4.0.

SÞ SDG

Þessi afurð stuðlar að eftirfarandi markmiðum um sjálfbæra þróun

SDG Heilsa og vellíðan

Viðtal í morgunútvarpi rásar 2 um gervigreind
Einarsson, H.
3/02/23
1 atriði af Fjölmiðlaumfjöllun
Háskóli Íslands
Fjölmiðlar

Vitna í þetta

Snæbjarnarson, V., & Einarsson, H. (2022). Natural Questions in Icelandic. Í N. Calzolari, F. Bechet, P. Blache, K. Choukri, C. Cieri, T. Declerck, S. Goggi, H. Isahara, B. Maegaard, J. Mariani, H. Mazo, J. Odijk, & S. Piperidis (Útg.), 2022 Language Resources and Evaluation Conference, LREC 2022 (bls. 4488-4496). (2022 Language Resources and Evaluation Conference, LREC 2022). European Language Resources Association (ELRA).

Snæbjarnarson, Vésteinn ; Einarsson, Hafsteinn. / Natural Questions in Icelandic. 2022 Language Resources and Evaluation Conference, LREC 2022. ritstjóri / Nicoletta Calzolari ; Frederic Bechet ; Philippe Blache ; Khalid Choukri ; Christopher Cieri ; Thierry Declerck ; Sara Goggi ; Hitoshi Isahara ; Bente Maegaard ; Joseph Mariani ; Helene Mazo ; Jan Odijk ; Stelios Piperidis. European Language Resources Association (ELRA), 2022. bls. 4488-4496 (2022 Language Resources and Evaluation Conference, LREC 2022).

@inproceedings{5f0f6eaab66e48af95fc96aafcc6b815,

title = "Natural Questions in Icelandic",

abstract = "We present the first extractive question answering (QA) dataset for Icelandic, Natural Questions in Icelandic (NQiI). Developing such datasets is important for the development and evaluation of Icelandic QA systems. It also aids in the development of QA methods that need to work for a wide range of morphologically and grammatically different languages in a multilingual setting. The dataset was created by asking contributors to come up with questions they would like to know the answer to. Later, they were tasked with finding answers to each others questions following a previously published methodology. The questions are Natural in the sense that they are real questions posed out of interest in knowing the answer. The complete dataset contains 18 thousand labeled entries of which 5,568 are directly suitable for training an extractive QA system for Icelandic. The dataset is a valuable resource for Icelandic which we demonstrate by creating and evaluating a system capable of extractive QA in Icelandic.",

keywords = "Icelandic, QA, question answering",

author = "V{\'e}steinn Sn{\ae}bjarnarson and Hafsteinn Einarsson",

note = "Funding Information: We would like to thank Akari Asai for granting us access to the annotation software we adapted for this project. We would also like to thank the student annotators: Bergur Tareq Tamimi, Ingibj{\"o}rg I{\dh}a Au{\dh}unard{\'o}ttir, Unnar Ingi S{\ae}mundsson, Hildur Bjarnad{\'o}ttir and Helgi Valur Gunnarsson. They were supported by a grant from the Icelandic student innovation fund. Finally, we thank the anonymous reviewers for their helpful comments and questions. Publisher Copyright: {\textcopyright} European Language Resources Association (ELRA), licensed under CC-BY-NC-4.0.; 13th International Conference on Language Resources and Evaluation Conference, LREC 2022 ; Conference date: 20-06-2022 Through 25-06-2022",

year = "2022",

language = "English",

series = "2022 Language Resources and Evaluation Conference, LREC 2022",

publisher = "European Language Resources Association (ELRA)",

pages = "4488--4496",

editor = "Nicoletta Calzolari and Frederic Bechet and Philippe Blache and Khalid Choukri and Christopher Cieri and Thierry Declerck and Sara Goggi and Hitoshi Isahara and Bente Maegaard and Joseph Mariani and Helene Mazo and Jan Odijk and Stelios Piperidis",

booktitle = "2022 Language Resources and Evaluation Conference, LREC 2022",

}

Snæbjarnarson, V & Einarsson, H 2022, Natural Questions in Icelandic. í N Calzolari, F Bechet, P Blache, K Choukri, C Cieri, T Declerck, S Goggi, H Isahara, B Maegaard, J Mariani, H Mazo, J Odijk & S Piperidis (útg.), 2022 Language Resources and Evaluation Conference, LREC 2022. 2022 Language Resources and Evaluation Conference, LREC 2022, European Language Resources Association (ELRA), bls. 4488-4496, 13th International Conference on Language Resources and Evaluation Conference, LREC 2022, Marseille, Frakkland, 20/06/22.

Natural Questions in Icelandic. / Snæbjarnarson, Vésteinn; Einarsson, Hafsteinn.
2022 Language Resources and Evaluation Conference, LREC 2022. ed. / Nicoletta Calzolari; Frederic Bechet; Philippe Blache; Khalid Choukri; Christopher Cieri; Thierry Declerck; Sara Goggi; Hitoshi Isahara; Bente Maegaard; Joseph Mariani; Helene Mazo; Jan Odijk; Stelios Piperidis. European Language Resources Association (ELRA), 2022. s. 4488-4496 (2022 Language Resources and Evaluation Conference, LREC 2022).

Rannsóknarafurð: Kafli í bók/skýrslu/ráðstefnuriti › Ráðstefnuframlag › ritrýni

TY - GEN

T1 - Natural Questions in Icelandic

AU - Snæbjarnarson, Vésteinn

AU - Einarsson, Hafsteinn

N1 - Funding Information: We would like to thank Akari Asai for granting us access to the annotation software we adapted for this project. We would also like to thank the student annotators: Bergur Tareq Tamimi, Ingibjörg Iða Auðunardóttir, Unnar Ingi Sæmundsson, Hildur Bjarnadóttir and Helgi Valur Gunnarsson. They were supported by a grant from the Icelandic student innovation fund. Finally, we thank the anonymous reviewers for their helpful comments and questions. Publisher Copyright: © European Language Resources Association (ELRA), licensed under CC-BY-NC-4.0.

PY - 2022

Y1 - 2022

N2 - We present the first extractive question answering (QA) dataset for Icelandic, Natural Questions in Icelandic (NQiI). Developing such datasets is important for the development and evaluation of Icelandic QA systems. It also aids in the development of QA methods that need to work for a wide range of morphologically and grammatically different languages in a multilingual setting. The dataset was created by asking contributors to come up with questions they would like to know the answer to. Later, they were tasked with finding answers to each others questions following a previously published methodology. The questions are Natural in the sense that they are real questions posed out of interest in knowing the answer. The complete dataset contains 18 thousand labeled entries of which 5,568 are directly suitable for training an extractive QA system for Icelandic. The dataset is a valuable resource for Icelandic which we demonstrate by creating and evaluating a system capable of extractive QA in Icelandic.

AB - We present the first extractive question answering (QA) dataset for Icelandic, Natural Questions in Icelandic (NQiI). Developing such datasets is important for the development and evaluation of Icelandic QA systems. It also aids in the development of QA methods that need to work for a wide range of morphologically and grammatically different languages in a multilingual setting. The dataset was created by asking contributors to come up with questions they would like to know the answer to. Later, they were tasked with finding answers to each others questions following a previously published methodology. The questions are Natural in the sense that they are real questions posed out of interest in knowing the answer. The complete dataset contains 18 thousand labeled entries of which 5,568 are directly suitable for training an extractive QA system for Icelandic. The dataset is a valuable resource for Icelandic which we demonstrate by creating and evaluating a system capable of extractive QA in Icelandic.

KW - Icelandic

KW - QA

KW - question answering

UR - https://www.scopus.com/pages/publications/85139102522

M3 - Conference contribution

T3 - 2022 Language Resources and Evaluation Conference, LREC 2022

SP - 4488

EP - 4496

BT - 2022 Language Resources and Evaluation Conference, LREC 2022

A2 - Calzolari, Nicoletta

A2 - Bechet, Frederic

A2 - Blache, Philippe

A2 - Choukri, Khalid

A2 - Cieri, Christopher

A2 - Declerck, Thierry

A2 - Goggi, Sara

A2 - Isahara, Hitoshi

A2 - Maegaard, Bente

A2 - Mariani, Joseph

A2 - Mazo, Helene

A2 - Odijk, Jan

A2 - Piperidis, Stelios

PB - European Language Resources Association (ELRA)

T2 - 13th International Conference on Language Resources and Evaluation Conference, LREC 2022

Y2 - 20 June 2022 through 25 June 2022

ER -

Snæbjarnarson V, Einarsson H. Natural Questions in Icelandic. Í Calzolari N, Bechet F, Blache P, Choukri K, Cieri C, Declerck T, Goggi S, Isahara H, Maegaard B, Mariani J, Mazo H, Odijk J, Piperidis S, ritstjórar, 2022 Language Resources and Evaluation Conference, LREC 2022. European Language Resources Association (ELRA). 2022. s. 4488-4496. (2022 Language Resources and Evaluation Conference, LREC 2022).

Natural Questions in Icelandic

Útdráttur

Ritröð

Ráðstefna

Athugasemd

SÞ SDG

Fingerprint

Fjölmiðlar

Viðtal í morgunútvarpi rásar 2 um gervigreind

Vitna í þetta