Tsaneva, S., Käsznar, K., & Sabou, M. (2022). Human-Centric Ontology Evaluation: Process and Tool Support. In O. Corcho, L. Hollink, & O. Kutz (Eds.), International Conference on Knowledge Engineering and Knowledge Management (pp. 182–197). https://doi.org/10.1007/978-3-031-17105-5_14
E194-04 - Forschungsbereich Data Science E194 - Institut für Information Systems Engineering
-
Published in:
International Conference on Knowledge Engineering and Knowledge Management
-
ISBN:
978-3-031-17105-5
-
Volume:
13514
-
Date (published):
2022
-
Event name:
23rd International Conference on Knowledge Engineering and Knowledge Management
en
Event date:
26-Sep-2022 - 29-Sep-2022
-
Event place:
Bolzano, Italy
-
Number of Pages:
16
-
Keywords:
Human-in-the-loop; Ontology evaluation; Process model
en
Abstract:
As ontologies enable advanced intelligent applications, ensuring their correctness is crucial. While many quality aspects can be automatically verified, some evaluation tasks can only be solved with human intervention. Nevertheless, there is currently no generic methodology or tool support available for human-centric evaluation of ontologies. This leads to high efforts for organizing such evaluation campaigns as ontology engineers are neither guided in terms of the activities to follow nor do they benefit from tool support. To address this gap, we propose HERO - a Human-Centric Ontology Evaluation PROcess, capturing all preparation, execution and follow-up activities involved in such verifications. We further propose a reference architecture of a support platform, based on HERO. We perform a case-study-centric evaluation of HERO and its reference architecture and observe a decrease in the manual effort up to 88% when ontology engineers are supported by the proposed artifacts versus a manual preparation of the evaluation.
en
Research Areas:
Visual Computing and Human-Centered Technology: 20% Information Systems Engineering: 80%