Results of the CLEF 2001 Cross-Language System Evaluation Campaign

Working Notes for the CLEF 2001 Workshop
3 September, Darmstadt, Germany

edited by Carol Peters

Foreword [pdf]
Carol Peters, IEI-CNR, Pisa, Italy


Mainly Cross-Language

Report on CLEF-2001 Experiments [pdf]
Jacques Savoy, Université de Neuchâtel, Switzerland

Multilingual Information Retrieval using English and Chinese Queries [pdf]
Aitao Chen, University of California at Berkeley, USA

TNO at CLEF-2001: Comparing Translation Resources [pdf]
Wessel Kraaij, TNO-TPD, The Netherlands

ITC-irst at CLEF 2001: Monolingual and Bilingual Tracks [pdf]
Nicola Bertoldi and Marcello Federico, ITC-irst, Italy

Experiments with the Eurospider Retrieval System for CLEF 2001 [pdf]
Martin Braschler, Bärbel Ripplinger, Peter Schäuble, Eurospider Information Technolog AG, Switzerland

NTU at CLEF 2001: Chinese-English Cross-Lingual Information Retrieval [pdf]
Hsin-Hsi Chen and Weg-Cheng Lin, National Taiwan University, Taiwan

UTACLIR @ CLEF 2001: New features for handling compound words and untranslatable proper names [pdf]
Turid Hedlund, Heikki Keskustalo, Ari Pirkola, Eija Airio and Kalervo Järvelin, University of Tampere, Finland

IR-n, a Passage Retrieval System from University of Alicante, at Clef 2001 [pdf]
Fernando Llopis and Jose Luis Vicedo, University of Alicante, Spain

Using Statistical Translation Models for Bilingual IR [pdf]
Jian-Yun Nie and Michel Simard, Université de Montréal, Canada

CMU PRF using a Comparable Corpus [pdf]
Monica Rogati and Yiming Yang, Carnegie Mellon University

Mercure at CLEF-2 [pdf]
N. Nassr and M. Boughanem, IRIT/SIG, France

Vector-based Semantic Analysis using Random Indexing and Morphological Analysis for Cross-Lingual Information Retrieval [pdf]
Jussi Karlgren and Magnus Sahlgren, SICS, Sweden

Query Expansion Techniques for the CLEF Bilingual Track [pdf]
Fatiha Sadat, Akira Maeda, Masatoshi Yoshikawa and Shunsuke Uemura, Nara Institute of Science and Technology, (NAIST), National Institute of Informatics (NII), CREST, Japan Science and Technology Corporation(JST), Japan

Exeter at CLEF 2001: Experiments with Machine Translation for Bilingual Retrieval [pdf]
Gareth J.F. Jones and Adenike M. Lam-Adesina, University of Exeter, UK

Intelligent Information Access Systems (SINAI) at CLEF 2001: Calculating Translation Probabilities with SemCor. [pdf]
Fernando Martinez Santiago, L. Alfonso Ureña López, Manuel Carlos Diaz Galiano, Manuel García Vega and Maite Martín Valdivia, University of Jaén, Spain

JHU/APL Experiments at CLEF: Translation Resources and Score Normalization [pdf]
Paul McNamee and James Mayfield, Johns Hopkins University, USA

CLEF 2001 Bilingual Task: Simple Dictionary-Based Query Translation [pdf]
Marine Carpuat and Pascale Fung, University of Science and Technology, Hong Kong

Dictionary-based Thai CLIR: Experimental Survey of Thai CLIR [pdf]
Jaruskulchai Chuleerat, Kasetsart University, Thailand

English-Dutch CLIR Using Query Translation Techniques [pdf]
Mirna Adriani, University of Glasgow, UK

Thomson Legal and Regulatory at CLEF 2001: monolingual and bilingual experiments [pdf]
Hugo Molina-Salgado, Isabelle Moulinier, Mark Knutson, Elizabeth Lund and Kirat Sekhon, TLR, USA

Working with Russian Queries for the GIRT, Bilingual and Multilingual CLEF Tasks [pdf]
Frederic C. Gey, Hailing Jiang and Natalia Perelman, University of California at Berkeley, USA

CLEF 2001 Experiments using KCSL Retrieval system [pdf]
Ilia Kaufman and Meena Ghanekar, KCSL, Canada


Monolingual Experiments

The University of Amsterdam at CLEF 2001 [pdf]
Christof Monz and Maarten de Rijke, University of Amsterdam, The Netherlands

Hummingbird’s Fulcrum SearchServer at CLEF2001 [pdf]
Stephen Tomlinson, Hummingbird, Canada

Minimalistic Test Runs of the Eidetica Indexer [pdf]
Teresita Frizzarin and Annius Groenink, Eidetica, The Netherlands

Across the Bridge: CLEF 2001 – Non-English Monolingual Retrieval. The French task. [pdf]
Eugenia Matoyo and Tony Valsamidis, University of Greenwich, London, UK

Some Terms are more Interchangeable than Others [pdf]
Jakob Klok, Samuel Driessen and Marvin Brunner, Océ Technologies, The Netherlands

Mpro-IR in Clef 2001 [pdf]
Bärbel Ripplinger, IAI, Germany

Stemming in Spanish: A First Approach to its Impact on Information Retrieval [pdf]
Carlos G. Figuerola, Raquel Gómez, Angel F. Zazo Rodríguez, José Luis Alonso Berrocal, Universidad de Salamanca, Spain

First experiments with CLEF [pdf]
Peter van der Weerd, Wilfred Blom, Medialab BV, Schellinkhout, The Netherlands


Interactive Track

The CLEF 2001 Interactive Track [pdf]
Douglas W. Oard, University of Maryland, USA and Julio Gonzalo, Universidad Nacional de Educación a Distancia, Spain

iCLEF at Sheffield [pdf]
Zoë Bathie and Mark Sanderson, University of Sheffield, UK

iCLEF 2001 at Maryland: Comparing Word-for-Word Gloss and MT [pdf]
Jianqiang Wang and Douglas W. Oard, University of Maryland, USA

Noun Phrase Translations for Cross-Language Document Selection [pdf]
Fernando López-Ostenero, Julio Gonzalo, Anselmo Peñas and Felisa Verdejo, Universidad Nacional de Educación a Distancia, Spain


Evaluation and Evaluation Initiatives

CLIR System Evaluation at NTCIR Workshops [pdf]
Noriko Kando, National Institute of Informatics, Tokyo, Japan

Report from TREC-9 [pdf]
Donna Harman and Ellen Voorhees, National Institute of Standards and Technology, USA

Philosophy of IR Evaluation [pdf]
Ellen Voorhees, National Institute of Standards and Technology, USA


Appendix - Run Statistics [pdf]