DC Field
Value
Language
dc.contributor.author
Alkhalifa, Rabab
-
dc.contributor.author
Borkakoty, Hsuvas
-
dc.contributor.author
Deveaud, Romain
-
dc.contributor.author
El-Ebshihy, Alaa
-
dc.contributor.author
Espinosa-Anke, Luis
-
dc.contributor.author
Fink, Tobias
-
dc.contributor.author
Galuščáková, Petra
-
dc.contributor.author
Gonzalez-Saez, Gabriela
-
dc.contributor.author
Goeuriot, Lorraine
-
dc.contributor.author
Iommi, David
-
dc.contributor.author
Liakata, Maria
-
dc.contributor.author
Tayyar Madabushi, Harish
-
dc.contributor.author
Medina-Alias, Pablo
-
dc.contributor.author
Mulhem, Philippe
-
dc.contributor.author
Piroi, Florina
-
dc.contributor.author
Popel, Martin
-
dc.contributor.author
Zubiaga, Arkaitz
-
dc.date.accessioned
2025-01-30T14:48:42Z
-
dc.date.available
2025-01-30T14:48:42Z
-
dc.date.issued
2024-08-05
-
dc.identifier.citation
<div class="csl-bib-body"> <div class="csl-entry">Alkhalifa, R., Borkakoty, H., Deveaud, R., El-Ebshihy, A., Espinosa-Anke, L., Fink, T., Galuščáková, P., Gonzalez-Saez, G., Goeuriot, L., Iommi, D., Liakata, M., Tayyar Madabushi, H., Medina-Alias, P., Mulhem, P., Piroi, F., Popel, M., &#38; Zubiaga, A. (2024). Extended overview of the CLEF 2024 LongEval Lab on Longitudinal Evaluation of Model Performance. In <i>Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2024)</i> (pp. 2267–2289). http://hdl.handle.net/20.500.12708/210281</div> </div>
-
dc.identifier.uri
http://hdl.handle.net/20.500.12708/210281
-
dc.description.abstract
We describe the second edition of the LongEval CLEF 2024 shared task. This lab evaluates the temporal persistence of Information Retrieval (IR) systems and Text Classifiers. Task 1 requires IR systems to run on corpora acquired at several timestamps, and evaluates the drop in system quality (NDCG) along these timestamps. Task 2 tackles binary sentiment classification at different points in time, and evaluates the performance drop for different temporal gaps. Overall, 37 teams registered for Task 1 and 25 for Task 2. Ultimately, 14 and 4 teams participated in Task 1 and Task 2, respectively.
en
dc.language.iso
en
-
dc.relation.ispartofseries
CEUR Workshop Proceedings
-
dc.subject
Evaluation
en
dc.subject
Temporal Persistence
en
dc.subject
Temporal Generalisability
en
dc.subject
Information Retrieval
en
dc.subject
Text Classification
en
dc.title
Extended overview of the CLEF 2024 LongEval Lab on Longitudinal Evaluation of Model Performance
en
dc.type
Inproceedings
en
dc.type
Konferenzbeitrag
de
dc.contributor.affiliation
Imam Abdulrahman Bin Faisal University, Saudi Arabia
-
dc.contributor.affiliation
Cardiff University, United Kingdom of Great Britain and Northern Ireland (the)
-
dc.contributor.affiliation
Qwant (Paris, FR)
-
dc.contributor.affiliation
Cardiff University, United Kingdom of Great Britain and Northern Ireland (the)
-
dc.contributor.affiliation
University of Stavanger, Norway
-
dc.contributor.affiliation
Université Grenoble Alpes, France
-
dc.contributor.affiliation
Université Grenoble Alpes, France
-
dc.contributor.affiliation
Research Studios Austria, Austria
-
dc.contributor.affiliation
Queen Mary University of London, United Kingdom of Great Britain and Northern Ireland (the)
-
dc.contributor.affiliation
University of Bath, United Kingdom of Great Britain and Northern Ireland (the)
-
dc.contributor.affiliation
University of Bath, United Kingdom of Great Britain and Northern Ireland (the)
-
dc.contributor.affiliation
Université Grenoble Alpes, France
-
dc.contributor.affiliation
Charles University, Czechia
-
dc.contributor.affiliation
Queen Mary University of London, United Kingdom of Great Britain and Northern Ireland (the)
-
dc.relation.issn
1613-0073
-
dc.description.startpage
2267
-
dc.description.endpage
2289
-
dc.type.category
Full-Paper Contribution
-
tuw.booktitle
Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2024)
-
tuw.container.volume
3740
-
tuw.peerreviewed
true
-
tuw.researchTopic.id
I4
-
tuw.researchTopic.id
C5
-
tuw.researchTopic.name
Information Systems Engineering
-
tuw.researchTopic.name
Computer Science Foundations
-
tuw.researchTopic.value
20
-
tuw.researchTopic.value
80
-
tuw.publication.orgunit
E194-04 - Forschungsbereich Data Science
-
tuw.publication.orgunit
E058-06 - Fachbereich Zentrum für Forschungsdatenmanagement
-
dc.description.numberOfPages
23
-
tuw.author.orcid
0000-0002-2875-5400
-
tuw.author.orcid
0000-0003-3262-0127
-
tuw.author.orcid
0000-0003-2676-7405
-
tuw.author.orcid
0000-0001-6644-2360
-
tuw.author.orcid
0000-0001-6830-9176
-
tuw.author.orcid
0000-0001-6328-7131
-
tuw.author.orcid
0000-0003-0878-5263
-
tuw.author.orcid
0000-0001-7491-1980
-
tuw.author.orcid
0000-0002-4270-5709
-
tuw.author.orcid
0000-0001-5765-0416
-
tuw.author.orcid
0000-0001-5260-3653
-
tuw.author.orcid
0009-0001-4202-8664
-
tuw.author.orcid
0000-0002-3245-6462
-
tuw.author.orcid
0000-0001-7584-6439
-
tuw.author.orcid
0000-0002-3628-8419
-
tuw.author.orcid
0000-0003-4583-3623
-
tuw.event.name
Conference and Labs of the Evaluation Forum (CLEF 2024) : Information Access Evaluation meets Multilinguality, Multimodality, and Visualization
-
tuw.event.startdate
09-09-2024
-
tuw.event.enddate
12-09-2024
-
tuw.event.online
On Site
-
tuw.event.type
Event for scientific audience
-
tuw.event.place
Grenoble
-
tuw.event.country
FR
-
tuw.event.institution
University of Grenoble Alpes
-
tuw.event.presenter
El-Ebshihy, Alaa
-
tuw.event.track
Multi Track
-
wb.sciencebranch
Informatik
-
wb.sciencebranch
Wirtschaftswissenschaften
-
wb.sciencebranch.oefos
1020
-
wb.sciencebranch.oefos
5020
-
wb.sciencebranch.value
90
-
wb.sciencebranch.value
10
-
item.grantfulltext
none
-
item.openairecristype
http://purl.org/coar/resource_type/c_5794
-
item.openairetype
conference paper
-
item.languageiso639-1
en
-
item.cerifentitytype
Publications
-
item.fulltext
no Fulltext
-
crisitem.author.dept
Imam Abdulrahman Bin Faisal University
-
crisitem.author.dept
Cardiff University
-
crisitem.author.dept
Qwant (Paris, FR)
-
crisitem.author.dept
E194-01 - Forschungsbereich Software Engineering
-
crisitem.author.dept
Cardiff University
-
crisitem.author.dept
E194-04 - Forschungsbereich Data Science
-
crisitem.author.dept
Université Grenoble Alpes
-
crisitem.author.dept
Université Grenoble Alpes
-
crisitem.author.dept
Université Grenoble Alpes
-
crisitem.author.dept
Research Studios Austria
-
crisitem.author.dept
Queen Mary University of London
-
crisitem.author.dept
University of Bath
-
crisitem.author.dept
University of Bath
-
crisitem.author.dept
Université Grenoble Alpes
-
crisitem.author.dept
E058-06 - Fachbereich Zentrum für Forschungsdatenmanagement
-
crisitem.author.dept
Charles University
-
crisitem.author.dept
Queen Mary University of London
-
crisitem.author.orcid
0000-0002-2875-5400
-
crisitem.author.orcid
0000-0003-3262-0127
-
crisitem.author.orcid
0000-0003-2676-7405
-
crisitem.author.orcid
0000-0001-6328-7131
-
crisitem.author.orcid
0000-0001-7491-1980
-
crisitem.author.orcid
0000-0002-4270-5709
-
crisitem.author.orcid
0000-0001-5765-0416
-
crisitem.author.orcid
0000-0001-5260-3653
-
crisitem.author.orcid
0009-0001-4202-8664
-
crisitem.author.orcid
0000-0002-3245-6462
-
crisitem.author.orcid
0000-0001-7584-6439
-
crisitem.author.orcid
0000-0002-3628-8419
-
crisitem.author.orcid
0000-0003-4583-3623
-
crisitem.author.parentorg
E194 - Institut für Information Systems Engineering
-
crisitem.author.parentorg
E194 - Institut für Information Systems Engineering
-
crisitem.author.parentorg
E058 - Forschungs-, Technologie- und Innovationssupport
-
Appears in Collections:
Conference Paper
Show simple item record

Page view(s)

132
checked on Jan 30, 2025

Google ScholarTM

Check