[CogSci] Fwd: Call for papers: 📐Evaluation Beyond Metrics Workshop [EBeM at IJCAI 2022]

danaja rutar rutar.danaja at gmail.com
Thu Apr 7 07:20:05 PDT 2022

---------- Forwarded message ---------
Od: danaja rutar <rutar.danaja at gmail.com>
Date: V pet., 25. mar. 2022 ob 17:58
Subject: Call for papers: 📐Evaluation Beyond Metrics Workshop [EBeM at IJCAI
To: <announcements at lists.cognitivesciencesociety.org>

Please distribute, apologies for cross posting.


[CFP] EBeM at IJCAI 2022: [image: 📐]Evaluation Beyond Metrics Workshop

The goal of this workshop is to challenge the widespread yet limited
approach of evaluating the performance of intelligent systems with
aggregated metrics over a benchmark or distribution of tasks. We invite
submissions on all areas of AI evaluation for all kinds of systems (RL
agents, machine vision, language models, planning, etc.). We especially
welcome alternative approaches that draw on ideas and recent progress in
cognitive and developmental psychology, psychometrics, software testing,
and other areas. Technical and position papers will be considered.

The submission deadline is the *13th of May*. The workshop will be part of
the International *Joint Conference on Artificial Intelligence *
*(IJCAI-2022)* in Vienna (Austria), with workshops being held between
of July* [concrete date TBA]. All information about topics, format and
submission instructions available on the website:



   José Hernández-Orallo - Universitat Politècnica de València (

   Lucy Cheke - Cambridge University (

   Josh Tenenbaum - Massachusetts Institute of Technology (

   Tomer D. Ullman - University of Harvard (https://www.tomerullman.org/)

   Fernando Martínez-Plumed - European Commission (
   - Danaja Rutar - University of Cambridge (

   John Burden - University of Cambridge (www.johnburden.co.uk)

   Ryan Burnell - University of Cambridge (https://ryanburnell.com)

   Wout Schellaert - Universitat Politècnica de València (

Main contact: ebemworkshop at gmail.com


The EbEM Organizing Team
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.cognitivesciencesociety.org/pipermail/announcements-cognitivesciencesociety.org/attachments/20220407/942ff785/attachment-0001.html>

More information about the Announcements mailing list