[CogSci] Call for papers: 📐Evaluation Beyond Metrics Workshop [EBeM at IJCAI 2022]

[danaja rutar]

Please distribute, apologies for cross posting.


================================================================


[CFP] EBeM at IJCAI 2022: [image: 📐]Evaluation Beyond Metrics Workshop


The goal of this workshop is to challenge the widespread yet limited
approach of evaluating the performance of intelligent systems with
aggregated metrics over a benchmark or distribution of tasks. We invite
submissions on all areas of AI evaluation for all kinds of systems (RL
agents, machine vision, language models, planning, etc.). We especially
welcome alternative approaches that draw on ideas and recent progress in
cognitive and developmental psychology, psychometrics, software testing,
and other areas. Technical and position papers will be considered.


The submission deadline is the *13th of May*. The workshop will be part of
the International *Joint Conference on Artificial Intelligence *
*(IJCAI-2022)* in Vienna (Austria), with workshops being held between
*23rd-25th
of July* [concrete date TBA]. All information about topics, format and
submission instructions available on the website:
https://sites.google.com/view/ebem2022.



Organisers

   -

   José Hernández-Orallo - Universitat Politècnica de València (
   http://josephorallo.webs.upv.es/)
   -

   Lucy Cheke - Cambridge University (
   http://lcfi.ac.uk/about/team/lucy-cheke)
   -

   Josh Tenenbaum - Massachusetts Institute of Technology (
   http://web.mit.edu/cocosci/josh.html)
   -

   Tomer D. Ullman - University of Harvard (https://www.tomerullman.org/)
   -

   Fernando Martínez-Plumed - European Commission (
   https://nandomp.github.io/)
   - Danaja Rutar - University of Cambridge (
   http://lcfi.ac.uk/people/danaja-rutar/)
   -

   John Burden - University of Cambridge (www.johnburden.co.uk)
   -

   Ryan Burnell - University of Cambridge (https://ryanburnell.com)
   -

   Wout Schellaert - Universitat Politècnica de València (
   https://schellaert.org)


Main contact: ebemworkshop at gmail.com

Regards,

The EbEM Organizing Team
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.cognitivesciencesociety.org/pipermail/announcements-cognitivesciencesociety.org/attachments/20220325/9333f9bb/attachment-0001.html>