Exploring the Utility of Dutch Question Answering Datasets for Human Resource Contact Centres

We explore the use case of question answering (QA) by a contact centre for 130,000 Dutch government employees in the domain of questions about human resources (HR). HR questions can be answered using personnel files or general documentation, with the latter being the focus of the current research. We created a Dutch HR QA dataset with over 300 questions in the format of the Squad 2.0 dataset, which distinguishes between answerable and unanswerable questions. We applied various BERT-based models, either directly or after finetuning on the new dataset. The F1-scores reached 0.47 for unanswerable... Mehr ...

Verfasser: van Toledo, Chaïm
Schraagen, Marijn
van Dijk, Friso Willem
Brinkhuis, Matthieu
Spruit, Marco
Dokumenttyp: Artikel
Erscheinungsdatum: 2022
Schlagwörter: question and answering / dataset / Squad 2.0 / question and answering dataset creation / question and answering Dutch / human resource dataset
Sprache: Englisch
Permalink: https://search.fid-benelux.de/Record/base-27069917
Datenquelle: BASE; Originalkatalog
Powered By: BASE
Link(s) : https://dspace.library.uu.nl/handle/1874/423758

We explore the use case of question answering (QA) by a contact centre for 130,000 Dutch government employees in the domain of questions about human resources (HR). HR questions can be answered using personnel files or general documentation, with the latter being the focus of the current research. We created a Dutch HR QA dataset with over 300 questions in the format of the Squad 2.0 dataset, which distinguishes between answerable and unanswerable questions. We applied various BERT-based models, either directly or after finetuning on the new dataset. The F1-scores reached 0.47 for unanswerable questions and 1.0 for answerable questions depending on the topic; however, large variations in scores were observed. We conclude more data are needed to further improve the performance of this task.