<div dir="ltr"><p dir="ltr" style="color:rgb(32,31,30);font-size:15px;line-height:1.38;margin-top:12pt;margin-bottom:12pt"><span style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant-ligatures:inherit;font-variant-caps:inherit;font-variant-numeric:normal;font-variant-east-asian:normal;font-weight:inherit;font-stretch:inherit;font-size:11pt;line-height:inherit;font-family:Roboto,sans-serif;vertical-align:baseline;color:inherit;white-space:pre-wrap;background-color:transparent">2nd CALL FOR PAPERS - EBeM@IJCAI2022</span></p><p dir="ltr" style="color:rgb(32,31,30);font-size:15px;line-height:1.38;text-align:justify;margin-top:0pt;margin-bottom:0pt"><span style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant-ligatures:inherit;font-variant-caps:inherit;font-variant-numeric:normal;font-variant-east-asian:normal;font-weight:inherit;font-stretch:inherit;font-size:11pt;line-height:inherit;font-family:Roboto,sans-serif;vertical-align:baseline;color:inherit;white-space:pre-wrap;background-color:transparent">The goal of this workshop is to challenge the widespread yet limited approach of evaluating the performance of intelligent systems with aggregated metrics over a benchmark or distribution of tasks. We consider papers on all areas of AI evaluation for all kinds of systems (RL agents, machine vision, language models, planning, etc.). We especially welcome alternative approaches that draw on ideas and recent progress in cognitive and developmental psychology, psychometrics, software testing, and other areas.</span></p><p dir="ltr" aria-hidden="true" style="color:rgb(32,31,30);font-size:15px;line-height:1.38;text-align:justify;margin-top:0pt;margin-bottom:0pt"> </p><p dir="ltr" style="color:rgb(32,31,30);font-size:15px;line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant-ligatures:inherit;font-variant-caps:inherit;font-variant-numeric:normal;font-variant-east-asian:normal;font-weight:inherit;font-stretch:inherit;font-size:11pt;line-height:inherit;font-family:Roboto,sans-serif;vertical-align:baseline;color:inherit;white-space:pre-wrap;background-color:transparent">We will consider technical and position papers. The submission deadline is May 13th. The workshop will be part of the International Joint Conference on Artificial Intelligence (IJCAI-2022) in Vienna (Austria), with the workshop being held on July 24th. All information about topics, format and submission instructions available on the website: </span><a href="https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Furldefense.com%2Fv3%2F__https%3A%2F%2Fsites.google.com%2Fview%2Febem2022__%3B!!HJOPV4FYYWzcc1jazlU!78aE1APTjB1QOXKBgOPFfz-QS7ECjUQNhpq9cM7c2QZFi38khnSLycoDGHqCNcvX36eD46ydhrNeOgncrqKNow%24&data=05%7C01%7Cdr571%40universityofcambridgecloud.onmicrosoft.com%7C31d43d20c9424ffd240b08da2d056137%7C49a50445bdfa4b79ade3547b4f3986e9%7C0%7C0%7C637871799820520200%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=pC4ca8tBMWVGj6SNo3wdN%2F9Do312wpGUbzfaKd%2BG4dg%3D&reserved=0" target="_blank" rel="noopener noreferrer" title="Original URL: https://urldefense.com/v3/__https://sites.google.com/view/ebem2022__;!!HJOPV4FYYWzcc1jazlU!78aE1APTjB1QOXKBgOPFfz-QS7ECjUQNhpq9cM7c2QZFi38khnSLycoDGHqCNcvX36eD46ydhrNeOgncrqKNow$. Click or tap if you trust this link." style="margin:0px;padding:0px;border:0px;font:inherit;vertical-align:baseline;text-decoration-line:none"><span style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant-ligatures:inherit;font-variant-caps:inherit;font-variant-numeric:normal;font-variant-east-asian:normal;font-weight:inherit;font-stretch:inherit;font-size:11pt;line-height:inherit;font-family:Roboto,sans-serif;vertical-align:baseline;text-decoration-line:underline;white-space:pre-wrap;color:rgb(34,34,34);background-color:transparent">https://sites.google.com/view/ebem2022</span></a><span style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant-ligatures:inherit;font-variant-caps:inherit;font-variant-numeric:normal;font-variant-east-asian:normal;font-weight:inherit;font-stretch:inherit;font-size:11pt;line-height:inherit;font-family:Roboto,sans-serif;vertical-align:baseline;color:inherit;white-space:pre-wrap;background-color:transparent">. </span></p><br aria-hidden="true" style="color:rgb(32,31,30);font-size:15px"><p dir="ltr" style="color:rgb(32,31,30);font-size:15px;line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant-ligatures:inherit;font-variant-caps:inherit;font-variant-numeric:normal;font-variant-east-asian:normal;font-weight:inherit;font-stretch:inherit;font-size:11pt;line-height:inherit;font-family:Roboto,sans-serif;vertical-align:baseline;color:inherit;white-space:pre-wrap;background-color:transparent">We have already confirmed two extraordinary invited speakers, Adina Williams (Facebook AI Research) and Amanda Seed (University of St Andrews). The workshop will also contain two panels, one on "Cognitive Evaluation with the Animal AI Environment", and the other one on "Big Language Models and their Generality", as well as a special session on OECD’s Artificial Intelligence and the Future of Skills (AIFS). More speakers and activities to be announced.</span></p><br aria-hidden="true" style="color:rgb(32,31,30);font-size:15px"><p dir="ltr" style="color:rgb(32,31,30);font-size:15px;line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant-ligatures:inherit;font-variant-caps:inherit;font-variant-numeric:normal;font-variant-east-asian:normal;font-weight:inherit;font-stretch:inherit;font-size:11pt;line-height:inherit;font-family:Roboto,sans-serif;vertical-align:baseline;color:inherit;white-space:pre-wrap;background-color:transparent">Main contact: </span><a href="mailto:ebemworkshop@gmail.com" target="_blank" rel="noopener noreferrer" style="margin:0px;padding:0px;border:0px;font:inherit;vertical-align:baseline;text-decoration-line:none"><span style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant-ligatures:inherit;font-variant-caps:inherit;font-variant-numeric:normal;font-variant-east-asian:normal;font-weight:inherit;font-stretch:inherit;font-size:11pt;line-height:inherit;font-family:Roboto,sans-serif;vertical-align:baseline;text-decoration-line:underline;white-space:pre-wrap;color:rgb(34,34,34);background-color:transparent">ebemworkshop@gmail.com</span></a></p><br aria-hidden="true" style="color:rgb(32,31,30);font-size:15px"><p dir="ltr" style="color:rgb(32,31,30);font-size:15px;line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant-ligatures:inherit;font-variant-caps:inherit;font-variant-numeric:normal;font-variant-east-asian:normal;font-weight:inherit;font-stretch:inherit;font-size:11pt;line-height:inherit;font-family:Roboto,sans-serif;vertical-align:baseline;color:inherit;white-space:pre-wrap;background-color:transparent">From the EbEM Organizing Team: José Hernández-Orallo (Universitat Politècnica de València), Lucy Cheke (Cambridge University), Josh Tenenbaum (MIT), Tomer D. Ullman (</span><span style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant-ligatures:inherit;font-variant-caps:inherit;font-variant-numeric:normal;font-variant-east-asian:normal;font-weight:inherit;font-stretch:inherit;font-size:11pt;line-height:inherit;font-family:Roboto,sans-serif;vertical-align:baseline;color:inherit;white-space:pre-wrap;background-color:rgb(251,251,251)">Harvard), </span><span style="margin:0px;padding:0px;border:0px;font-style:inherit;font-variant-ligatures:inherit;font-variant-caps:inherit;font-variant-numeric:normal;font-variant-east-asian:normal;font-weight:inherit;font-stretch:inherit;font-size:11pt;line-height:inherit;font-family:Roboto,sans-serif;vertical-align:baseline;color:inherit;white-space:pre-wrap;background-color:transparent">Fernando Martínez-Plumed (European Commission), Danaja Rutar (Cambridge), John Burden (Cambridge), Ryan Burnell (Cambridge), Wout Schellaert (Universitat Politècnica de València)</span></p></div><div id="DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2"><br>
<table style="border-top:1px solid #d3d4de">
        <tr>
        <td style="width:55px;padding-top:13px"><a href="https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail" target="_blank"><img src="https://ipmcdn.avast.com/images/icons/icon-envelope-tick-round-orange-animated-no-repeat-v1.gif" alt="" width="46" height="29" style="width: 46px; height: 29px;"></a></td>
                <td style="width:470px;padding-top:12px;color:#41424e;font-size:13px;font-family:Arial,Helvetica,sans-serif;line-height:18px">Virus-free. <a href="https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail" target="_blank" style="color:#4453ea">www.avast.com</a>
                </td>
        </tr>
</table><a href="#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2" width="1" height="1"></a></div>