<html><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><span style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;" class="">[Apologies if you receive multiple copies of this announcement]</span><br style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;" class=""><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;"><br class=""></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;">## Last Call for participants ##</div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;"><br class=""></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;"><br class=""></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;">### Task: CONcreTEXT @ EVALITA 2020 ###</div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;"><br class=""></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;">NEW: **Timetable updates**</div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;"><a href="https://lablita.github.io/CONcreTEXT/" class="">https://lablita.github.io/CONcreTEXT/</a></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;"><br class=""></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;">Please remind that EVALITA registration will close on **September 4th**!<br class=""></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;"><br class=""></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;">---</div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;"><br class=""></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;">The task CONcreTEXT (CONcreteness in conTEXT) focuses on automatic concreteness (and conversely, abstractness) recognition. Given a sentence along with a target word, we ask participants to propose a system able to assess the concreteness of the target word according to a [1-7] concreteness scale, where 1 stands for fully abstract (e.g., 'idempotence') and 7 for maximally concrete (e.g., 'car').</div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;"><br class=""></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;">The concreteness score being assigned to the word must be evaluated in context: the word should not be considered in isolation, but as part of the given sentence. For example, systems are expected to assign different scores to the verb 'COVER' in the next two sentences:</div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;"><br class=""></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;">- COVER the pot and bring the water to a vigorous boil;</div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;">- Your fees and tuition help to COVER the costs of providing these services.</div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;"><br class=""></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;"><br class=""></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;">Target words may be either verbs or nouns. The dataset used for this task is taken from the English-Italian parallel section of The Human Instruction Dataset, derived from WikiHow instructions (<a href="https://www.kaggle.com/paolop/human-instructions-multilingual-wikihow" class="">https://www.kaggle.com/paolop/human-instructions-multilingual-wikihow</a>). The released dataset will be composed by overall 1,000 sentences (500 Italian sentences plus 500 English sentences), all annotated with human judgment by native speakers. </div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;"><br class=""></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;">Participants may decide to participate in either task, or both.</div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;"><br class=""></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;">We invite participants to exploit all possible strategies to solve the task, including (but not limited to) knowledge bases, external training data, word embeddings, multimodal systems, etc..</div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;"><br class=""></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;">Registration is now open, at URL:</div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;"> <a href="http://www.evalita.it/2020/taskregistration" class="">http://www.evalita.it/2020/taskregistration</a> </div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;"><br class=""></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;"><br class=""></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;"><br class=""></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;">#### Definition of concreteness ####</div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;"><br class=""></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;">Operationally, the very first issue is that it is not straightforward to define concreteness/abstractness. Provided that more fine grained distinctions on abstract and concrete word meanings can be drawn, the term 'concrete' has two main interpretations:</div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;"><br class=""></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;">- what is closer to perception (as opposed to what cannot be experienced directly through the senses);</div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;">- what is more specific (as opposed to high-level, abstract).</div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;"><br class=""></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;">We are mostly interested in the first aspect, that is perceptually salient concreteness/abstractness.</div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;"><br class=""></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;"><br class=""></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;"><br class=""></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;">#### Motivation and state of the art ####</div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;"><br class=""></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;">Ordinary experience suggests that semantic representation and lexical access and processing of concepts can be affected by concepts' concrete/abstract status: concrete meanings, closer to perceptual experience, are acknowledged to be more quickly and easily delivered in human communication than abstract meanings. Such kind of information grasps a complex combination of experiential (e.g., sensory, motor) and strictly linguistic features, such as verbal associations arising through co-occurrence patterns and syntactic information. These features make conceptual concreteness/abstractness a challenging though only marginally explored field, with the notable exception of some works at the intersection between Computational Linguistics and Cognitive Science.</div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;"><br class=""></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;">The CONcreTEXT task is aimed at investigating how the concreteness information affects sense selection: different from past research, we are interested in assessing the concreteness of terms in context rather than in isolation. The concreteness score is assumed to be a property of word meanings rather than a property of word forms; thus, scoring the concreteness of a term in context implicitly requires to individuate its underlying sense, by handling lexical phenomena such as polysemy and homonymy.</div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;"><br class=""></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;">The CONcreTEXT task may be relevant also for the psycho-linguistics community, where ratings about concreteness, imageability and other features are largely used as control variables in many experiments. The resulting annotated dataset itself (for both the Italian and English languages) will be a resource to be exploited for future researches focused on concreteness in a more contextual, and thus ecological, setting.</div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;"><br class=""></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;"><br class=""></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;"><br class=""></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;">#### Important Dates #### </div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;"><br class=""></div><p style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;" class="">- **4th September 2020**: EVALITA registration deadline</p><p style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;" class="">- **5th September - 2nd October 2020**: evaluation windows and collection of participants results<br class=""></p><p style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;" class="">- **2nd October 2020**: assessment returned to participants<br class=""></p><p style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;" class="">- **16th October 2020**: deadline for submission of system description papers<br class=""></p><p style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;" class="">- **6th November 2020**: technical reports due to organisers (camera-ready)<br class=""></p><p style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;" class="">- **27th November 2020**: Videos presentations to the Evalita chair<br class=""></p><p style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;" class="">- **16th – 17th December 2020**: EVALITA 2020</p><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;"><br class=""></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;"> </div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;"><br class=""></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;">#### Organisers ####</div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;"><br class=""></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;">- Lorenzo Gregori, Università di Firenze, <a href="mailto:lorenzo.gregori@unifi.it" class="">lorenzo.gregori@unifi.it</a></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;">- Maria Montefinese, Università di Padova, <a href="mailto:maria.montefinese@gmail.com" class="">maria.montefinese@gmail.com</a></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;">- Daniele Radicioni, Università di Torino, <a href="mailto:daniele.radicioni@unito.it" class="">daniele.radicioni@unito.it</a></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;">- Andrea Amelio Ravelli, Università di Firenze, <a href="mailto:andreaamelio.ravelli@unifi.it" class="">andreaamelio.ravelli@unifi.it</a></div><div class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: CourierNewPSMT;">- Rossella Varvara, Università di Firenze, <a href="mailto:rossella.varvara@unifi.it" class="">rossella.varvara@unifi.it</a></div><div class=""><br class="webkit-block-placeholder"></div><div class=""><br class="webkit-block-placeholder"></div><div class=""></div><div class="">
<br class="">: : : : : : : : : : : : : : : : : : :<br class=""><br class="">Daniele Radicioni, PhD<br class="">Department of Computer Science<br class="">University of Turin<br class="">Corso Svizzera, 185<br class="">10149 - Torino<br class="">phone: +39 011 6706802<br class="">fax: +39 011 751603<br class=""><a href="http://www.di.unito.it/~radicion" class="">http://www.di.unito.it/~radicion</a><br class=""><br class=""><br class=""><br class="">
</div>
<br class=""></body></html>