SE 2008



CALL for PAPERS

ACL 2008 Workshop on

Semantic Evaluations: Recent Achievements and Future Directions 19/20th June, 2008 Columbus, OH, USA

NEW Paper Submission deadline: March 16th, 2007 NEW

This workshop is endorsed by SIGLEX and SIGSEM ACL Special Interest Group on the Lexicon ACL Special Interest Group on Computational Semantics

http://www.lsi.upc.edu/~lluism/sew2008.html



Workshop Description

The main purpose of this workshop is to analyze and discuss the results of systems participating in the SemEval-2007 evaluation. We also expect discussion on further developments of related evaluation exercises and systems. SemEval-2007 held nineteen different tasks, which conducted evaluations of systems that perform automatic semantic analysis of text, covering a wide range of aspects of semantics and multilinguality.

Background

There are now many computer systems that do automatic semantic analysis of text. The purpose of SemEval-2007 was to evaluate the strengths and weaknesses of such systems with respect to different words, relations, types of texts, different varieties of language, and different languages. This workshop is a follow-up to the SemEval-2007 and Senseval series of workshops on semantic evaluation, and we also want it to be a preparation for the next SemEval evaluation exercise.

Senseval-1 took place in the summer of 1998 for English, French, and Italian, culminating in a workshop held at Herstmonceux Castle, Sussex, England on September 2-4. Senseval-2 took place in the summer of 2001, and was followed by a workshop held in July 2001 in Toulouse, in conjunction with ACL-2001. It included tasks for 12 languages. A follow-up workshop on the recent successes and future directions of word sense disambiguation was held at ACL 2002. Senseval-3 took place in the spring of 2004, and was followed by a workshop held in July 2004 in Barcelona, in conjunction with ACL-2004. More than 55 teams participated with over 160 systems in its 16 tasks. SemEval-2007 organized 18 tasks, with over 100 teams and 125 systems participating. The results of the tasks and systems were presented in a workshop hold in conjunction with ACL-2007.

SemEval-2007 was motivated by a desire to broaden the spectrum of accepted works to all aspects of computational semantic analysis of language. It especially encouraged the proposal of tasks for different languages, cross-lingual tasks, and tasks that are relevant to particular NLP applications such as machine translation, information retrieval and information extraction.

In recent years, the deployment of multiple semantic lexicons and accordingly tagged corpora (WordNet-SemCor, VerbNet-PropBank, FrameNet Prague Dependency Treebank and OntoNotes, to name a few) have radically changed the way semantic analysis is performed, especially at the disambiguation stage. Some of the tasks at SemEval-2007 tried to take this one step further by proposing multiple layers of semantic annotation of the same corpus (e.g., senses, roles, name-entity classes), allowing for novel research to be performed.

SemEval-2007 had a tight schedule, and the results and systems were usually not known until the workshop was held. This fact, and the growing number of tasks and systems made it difficult to fully analyze the tasks and systems. This proposal allows for a better analysis of the developments in this area.

Topics

This workshop invites the submission of original research papers describing systems and systematic evaluation exercises on tasks related to the SemEval-2007 evaluation or semantic processing in general. Both system and evaluation exercise papers are expected to provide insight on the semantic process where they focus, which include the following:

* shallow and deep semantic analysis * word sense disambiguation * semantic role labeling * semantic relation identification * named-entity classification * analysis and disambiguation of prepositions * metonymy resolution * lexical substitution and paraphrasing * textual entailment * semantics in applications: IR, IE, MT, etc.

Submissions

Authors are invited to submit full papers on original, unpublished work in the topic area of this workshop. Full papers should be up to 8 pages in length, plus one page for references.

As reviewing will be blind, the paper should not include the authors' names and affiliations. Furthermore, self-references that reveal the author's identity, e.g., "We previously showed (Smith, 1991) ...", should be avoided. Instead, use citations such as "Smith previously showed (Smith, 1991) ...".

All submissions must be electronic in PDF. Please see the conference website for detailed typesetting specifications. Authors are strongly encouraged to use the LaTeX or Microsoft Word style files available at http://ling.osu.edu/acl08/stylefiles.html.

Submission will be electronic, using the START paper submission website. The submission deadline is March 9th, 2007. The START submission page is https://www.softconf.com/acl08/ACL08-WS08/.

Important Dates (NEW!!)

March 16, 2008 - Paper Submission due April 14, 2008 - Notification of acceptance April 21, 2008 - Camera ready papers due

Organising Committee

Eneko Agirre (University of the Basque Country, UPV/EHU, Basque Country) Lluí­s Màrquez (Technical University of Catalonia, UPC, Spain) Richard Wicentowski (Swarthmore College, USA)

Address any queries regarding the workshop to:

sew2008org at googlegroups com

Programme Committee

* Eneko Agirre, University of the Basque Country, Basque Country * Timothy Baldwin, Melbourne University, Australia * Nicoletta Calzolari, Istituto di Linguistica Computazionale, Italy * Xavier Carreras, MIT, USA * Walter Daelemans, University of Antwerp, Belgium * Mona Diab, Columbia University, USA * Katrin Erk, University of Texas, USA * Roxana Girju, University of Illinois at Urbana-Champaign, USA * Veronique Hoste, University College Ghent, Ghent * Eduard Hovy, Information Science Institute, USA * Nancy Ide, Vassar College, USA * Adam Kilgarriff, Lexical Computing Ltd, UK    * Kenneth Litkowski, CL Research, USA * Bernardo Magnini, FBC, Italy * Katja Markert, Leeds University, UK    * Llu�?­s M�? rquez, Technical University of Catalonia, Spain * David Mart�?­nez, University of Melbourne, Australia * Diana McCarthy, University of Sussex, UK    * Rada Mihalcea University of North Texas, USA * Roberto Navigli, University of Rome "La Sapienza", Italy * Hwee Tou Ng, National University of Singapore, Singapore * Ted Pedersen, University of Minnesota in Duluth, USA * Philip Resnik, University of Maryland, USA * German Rigau, University of the Basque Country, Basque Country * Mark Stevenson, University of Sheffield, UK    * Suzanne Stevenson, University of Toronto, Canada * Carlo Strapparava, FBC, Italy * Mihai Surdeanu, Barcelona Media Innovation Center, Spain * Stan Szpakowicz, Univerity of Ottawa, Canada * Richard Wicentowski, Swarthmore College, USA * Yorick Wilks, University of Sheffield, UK    * Dekai Wu, The Hong Kong University of Science & Technology, China * Scott Yih, Microsoft, USA * Deniz Yuret, Koc University, Turkey This CfP was obtained from WikiCFP