[CogSci] Call for Papers@ EBeM at IJCAI2022: 📐IJCAI International Workshop on Evaluation Beyond Metrics

danaja rutar rutar.danaja at gmail.com
Tue May 3 09:56:32 PDT 2022


2nd CALL FOR PAPERS - EBeM at IJCAI2022

The goal of this workshop is to challenge the widespread yet limited
approach of evaluating the performance of intelligent systems with
aggregated metrics over a benchmark or distribution of tasks. We consider
papers on all areas of AI evaluation for all kinds of systems (RL agents,
machine vision, language models, planning, etc.). We especially welcome
alternative approaches that draw on ideas and recent progress in cognitive
and developmental psychology, psychometrics, software testing, and other
areas.



We will consider technical and position papers. The submission deadline is
May 13th. The workshop will be part of the International Joint Conference
on Artificial Intelligence (IJCAI-2022) in Vienna (Austria), with the
workshop being held on July 24th. All information about topics, format and
submission instructions available on the website:
https://sites.google.com/view/ebem2022
<https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Furldefense.com%2Fv3%2F__https%3A%2F%2Fsites.google.com%2Fview%2Febem2022__%3B!!HJOPV4FYYWzcc1jazlU!78aE1APTjB1QOXKBgOPFfz-QS7ECjUQNhpq9cM7c2QZFi38khnSLycoDGHqCNcvX36eD46ydhrNeOgncrqKNow%24&data=05%7C01%7Cdr571%40universityofcambridgecloud.onmicrosoft.com%7C31d43d20c9424ffd240b08da2d056137%7C49a50445bdfa4b79ade3547b4f3986e9%7C0%7C0%7C637871799820520200%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=pC4ca8tBMWVGj6SNo3wdN%2F9Do312wpGUbzfaKd%2BG4dg%3D&reserved=0>
.

We have already confirmed two extraordinary invited speakers, Adina
Williams (Facebook AI Research) and Amanda Seed (University of St Andrews).
The workshop will also contain two panels, one on "Cognitive Evaluation
with the Animal AI Environment", and the other one on "Big Language Models
and their Generality", as well as a special session on OECD’s Artificial
Intelligence and the Future of Skills (AIFS). More speakers and activities
to be announced.

Main contact: ebemworkshop at gmail.com

>From the EbEM Organizing Team: José Hernández-Orallo (Universitat
Politècnica de València), Lucy Cheke (Cambridge University), Josh Tenenbaum
(MIT), Tomer D. Ullman (Harvard), Fernando Martínez-Plumed (European
Commission), Danaja Rutar (Cambridge), John Burden (Cambridge), Ryan
Burnell (Cambridge), Wout Schellaert (Universitat Politècnica de València)

<https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail>
Virus-free.
www.avast.com
<https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail>
<#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.cognitivesciencesociety.org/pipermail/announcements-cognitivesciencesociety.org/attachments/20220503/d0bb27b1/attachment-0001.html>


More information about the Announcements mailing list