CLEF 2019 – LABS AND WORKSHOP INFORMATION


Summary

LifeCLEF

LifeCLEF lab aims at boosting research on the identification and prediction of living organisms in order to solve the taxonomic gap and improve our knowledge of biodiversity.
  • Task 1 - PlantCLEF aims at evaluating image-based plant identification on 10K species.
  • Task 2 - BirdCLEF aims at evaluating bird species detection in audio soundscapes.
  • Task 3 - GeoLifeCLEF aims at evaluating location-based prediction of species based on environmental and occurrence data.
  • Lab Coordination: Alexis Joly (INRIA, LIRMM), Henning Müller (HES-SO), Hervé Goëau (CIRAD, AMAP), Stefan Kahl (Chemnitz University of Technology), Pierre Bonnet (CIRAD, AMAP), Hervé Glotin (University of Toulon, LSIS CNRS), Simone Palazzo (University of Catania), Willem-Pier Vellinga (Xeno-Canto)
  • Lab website: http://lifeclef.org/

ProtestNews

ProtestNews's aim is to test and improve state-of-the-art generalizable machine learning and natural language processing methods for text classification and information extraction on English news from multiple countries such as India and China for creating comparative databases of contentious politics events (riots, social movements), i.e. the repertoire of contention that can enable large scale comparative social and political science studies.
  • Task 1 - News article classification as protest vs. non-protest.
  • Task 2 - Event sentence detection.
  • Task 3 - Event extraction.
  • Lab Coordination : Ali Hürriyetoglu, Deniz Yüret, Erdem Yörük, Çağrı Yoltar, Burak Gürel, Fırat Duruşan, Osman Mutlu (Koc Univ)
  • Lab website: https://emw.ku.edu.tr/clef-protestnews-2019/

CLEF eHealth

This lab aims to support the development of techniques to aid laypeople, clinicians and policy-makers in easily retrieving and making sense of medical content to support their decision making.
  • Task 1 - Multilingual Information Extraction.
  • Task 2 - Technology Assisted Reviews in Empirical Medicine.
  • Task 3 - Consumer Health Search.
  • Lab Coordination: Leif Azzopardi (Univ. of Strathclyde), Lorraine Goeuriot (Univ. J.Fourier), Evangelos Kanoulas (Univ. of Amsterdam), Liadh Kelly (Maynooth University), Mariana Neves (German Fed. Inst. for Risk Assessment), Joao Palotti (Vienna Univ.), Rene Spijker (Cochrane), Hanna Suominen (Australian National Univ.), Guido Zuccon (Univ. Queensland)
  • Lab website: http://clef-ehealth.org/

CENTRE@CLEF 2019

The goal of CENTRE@CLEF 2019 is to run a joint CLEF/NTCIR/TREC task on challenging participants:
  1. to reproduce best results of best/most interesting systems in previous editions of CLEF/NTCIR/TREC by using standard open source IR systems;
  2. to contribute back to the community the additional components and resources developed to reproduce the results in order to improve existing open source systems;
  3. to explore the generalizability of experimental results.
  • Task 1 - Replicability
  • Task 2 - Reproducibility
  • Task 3 - Generalizability
  • Lab Coordination: Nicola Ferro (University of Padua), Norbert Fuhr (University of Duisburg-Essen), Maria Maistro (University of Padua) Tetsuya Sakai (Waseda University), Ian Soboroff (NIST)
  • Lab website: http://www.centre-eval.org/clef2019/
  • Twitter: @_centre_

eRISK: early Risk prediction on the Internet

eRisk explores the evaluation methodology, effectiveness metrics and practical applications (particularly those related to health and safety) of early risk detection on the Internet.
  • Task 1 - Early detection of signs of anorexia.
  • Task 2 - Early detection of signs of self-harm.
  • Task 3 - Measuring the severity of the signs of depression.
  • Lab Coordination: David E. Losada (Univ. Santiago de Compostela), Fabio Crestani (Università della Svizzera italiana), Javier Parapar (Univ. A Coruña)
  • Lab website: http://erisk.irlab.org
  • Twitter: @earlyrisk

PAN Lab on Digital Text Forensics and Stylometry

PAN is a series of scientific events and shared tasks on digital text forensics and stylometry.
  • Task 1 - Bots and Gender Profiling
  • Task 2 - Celebrity Profiling
  • Task 3 - Cross-domain Authorship Attribution
  • Task 4 - Style Change Detection
  • Lab Coordination: Martin Potthast (Leipzig University), Paolo Rosso (Universitat Politècnica de València), Efstathios Stamatatos (University of the Aegean), Benno Stein (Bauhaus Universität Weimar)
  • Lab website: http://pan.webis.de

CheckThat!: Automatic Identification and Verification of Claims

CheckThat! aims to foster the development of technology capable of spotting check-worthy claims in English political debates in addition to providing evidence-supported verification of Arabic claims.
  • Task 1 - Check-Worthiness
  • Task 2 - Evidence and factuality
  • Lab Coordination: Tamer Elsayed (Qatar University), Preslav Nakov (Qatar Computing Research Institute, HBKU), Alberto Barrón-Cedeño (Qatar Computing Research Institute, HBKU), Maram Hasanain (Qatar University), Reem Suwaileh (Qatar University), Pepa Atanasova (Sofia University), Giovanni Da San Martino (Qatar Computing Research Institute, HBKU)
  • Lab website: http://alt.qcri.org/clef2019-checkthat/

PIR-CLEF 2019: Evaluation of Personalized Information Retrieval 2019

The core objective of PIR-CLEF 2019 is to develop laboratory-based evaluation methods to enable comparative evaluation of personalization in web search and medical search.

ImageCLEF: Multimedia Retrieval in CLEF

ollowing the ImageCLEF 2003-2018 editions, the ImageCLEF 2019 lab provides an evaluation forum for visual media analysis, indexing, classification/learning, and retrieval in medical, nature, security and lifelogging applications.
  • Task 1 - ImageCLEFlifelog
  • Task 2 - ImageCLEFsecurity
  • Task 3 - ImageCLEFmedical
  • Task 3 - ImageCLEFcoralReef
  • Lab Coordination: Bogdan Ionescu (University Politehnica of Bucharest), Henning Müller (University of Applied Sciences Western Switzerland, HES-SO), Renaud Péteri (University of La Rochelle)
  • Lab website: https://www.imageclef.org/2019
  • Twitter: @imageclef