Schedule and Information
- Date and time: 1 March, 2022; 9am-4pm US Eastern Time (ET).
- Location: AAAI-22 Virtual Chair Venue (online event). When you click "Enter the Virtual Venue'', you need to input the email id used for AAAI-22 registration and receive a password.
- Virtual room number: Blue 1. You will have to navigate your avatar to the room; there is an option to teleport your avatar to a specific room by searching for events in the calendar icon. Short video explaining how to navigate is available here.
- Zoom meeting integration: We have requested a Zoom meeting link inside the virtual room Blue 1. Once you are in Blue 1, press 'x' on your keyboard to see the Zoom meeting link and click it to join. Full details are available here.
IMPORTANT: Please ensure you are not standing on microphones in Blue 1 while attending the Zoom meeting, as this will cause echo (your microphone will be heard in both applications). - Schedule: Full details are available here.
- Title+Abstract for invited talks: Full details are available here.
- Paper presentations: See more information below in Papers.
- Contact: For any questions, please email rl4edorg AT gmail.com
- Updates:
- 2022-03-23: We have added recordings for talks, see below.
- 2022-02-28: We have added information about Zoom meeting integration inside the room.
- 2022-02-21: We have updated the schedule and information for attending the workshop.
- 2022-02-21: We have added details about the invited talks and presentations.
Overview
This workshop aims to bring together researchers and practitioners interested in the broad areas of reinforcement learning (RL) and education (ED). The workshop will focus on two thrusts:
- Exploring how we can leverage recent advances in RL methods to improve state-of-the-art technology for ED.
- Identifying unique challenges in ED that are beyond the current methodology, but can help nurture technical innovations and next breakthroughs in RL.
Invited Talks
The workshop will have invited talks from six speakers. You can find more details on the information page for talks and the schedule.-
Simon Woodhead. Eedi (London, UK).
[Recorded Video] - Manuel Lopes. Instituto Superior Tecnico (Lisbon, Portugal).
-
Tanja Käser. EPFL (Lausanne, Switzerland).
[Recorded Video] -
Thomas W. Price. North Carolina State University (Raleigh, NC, USA).
[Recorded Video] -
Mark Ho. Princeton University (Princeton, NJ, USA).
[Recorded Video] -
Ethan Prihar. Worcester Polytechnic Institute (Worcester, MA, USA).
[Recorded Video]
Papers
The list of accepted papers is available below. These papers will be presented as short talks by authors during the workshop. You can find more details on the schedule.-
"Optimizing a Scaffold to Guide Motor Skill Learning"; Dennis Heitkamp, Kathrin Krieger, Jason Friedman, Alexandra Moringen.
[Recorded Video] -
"Extending Adaptive Spacing Heuristics to Multi-Skill Items"; Benoît Choffin, Fabrice Popineau, Yolaine Bourda.
[Recorded Video] -
"Using Adaptive Experiments to Rapidly Help Students"; Angela Zavaleta Bernuy, Qi Yin Zheng, Hammad Shaikh, Jacob Nogas, Anna Rafferty, Andrew Petersen, Joseph Jay Williams.
[Recorded Video] -
"TrueLearn: A Family of Bayesian Algorithms to Match Lifelong Learners to Open Educational Resources"; Sahan Bulathwela, María Pérez Ortiz, Emine Yilmaz, John Shawe-Taylor.
[Recorded Video] -
"X5Learn: A Personalised Learning Companion at the Intersection of AI and HCI"; María Pérez Ortiz, Claire Dormann, Yvonne Rogers, Sahan Bulathwela, Stefan Kreitmayer, Emine Yilmaz, Richard Noss, John Shawe-Taylor.
[Recorded Video] -
"Multi-Armed Bandit Algorithms for Adaptive Learning: A Survey"; John Mui, Fuhua Lin, Ali Dewan.
[Recorded Video] -
"Towards Approximately Optimal Assessments — A Tractable Methodology"; Androniki Sapountzi, Sandjai Bhulai, Jaap Storm, Martijn Meeter.
[Recorded Video] -
"Differential Segmentation of Categorical Log Data from Open-Ended Learning Environments"; James Bywater, Mark Floryan, Jennifer Chiu.
[Recorded Video] -
"Learning Expert Models for Educationally Relevant Tasks using Reinforcement Learning"; Christopher Maclellan, Adit Gupta.
[Recorded Video] -
"Adaptively Scaffolding Cognitive Engagement with Batch Constrained Deep Q-Networks"; Fahmid Morshed Fahid, Jonathan Rowe, Randall Spain, Benjamin Goldberg, Robert Pokorny, James Lester.
[Recorded Video] -
"Student Strategy Prediction using a Neuro-Symbolic Approach"; Anup Shakya, Vasile Rus, Deepak Venugopal.
[Recorded Video] -
"Pick the Moment: Identifying Critical Pedagogical Decisions Using Long-Short Term Rewards"; Song Ju, Guojing Zhou, Tiffany Barnes, Min Chi.
[Recorded Video] -
"Evaluating Critical Reinforcement Learning Framework In the Field"; Song Ju, Guojing Zhou, Mark Abdelshiheed, Tiffany Barnes, Min Chi.
[Recorded Video]
Topics of Interest
Topics of interests in the workshop include (but are not limited to) the following:
Leveraging recent advances in RL methods for ED problem setings
- Survey papers summarizing recent advances in RL with applicability to ED.
- Developing toolkits, datasets, and challenges for applying RL methods to ED.
- Using RL for online evaluation and A/B testing of different intervention strategies in ED.
- Novel applications of RL for ED problem settings.
- Using pedagogical theories to narrow the policy space of RL methods.
- Using RL methodology as a computational model of students in open-ended learning domains.
- Developing novel offline RL methods that can efficiently leverage historical student data.
- Combining statistical power of RL with symbolic reasoning to ensure the robustness for ED.
Call for Papers
We solicit submissions of two types:- Research track papers reporting the results of ongoing or new research, which have not been published before. In particular, we encourage papers covering late-breaking results and work-in-progress research. Submissions should follow the AAAI'22 format and are encouraged to be up to four pages, excluding references and appendices. Papers submitted for review do not need to be anonymized. There will be no official proceedings, but the accepted papers will be made available on the workshop website. Accepted papers will be either presented as a talk or poster.
- Encore track papers that have been recently published, or accepted for publication in a conference or journal. For this track, authors only need to submit the Title and Abstract of their paper to the submission site, and no PDF needs to be uploaded. At the end of the Abstract, authors should clearly state the venue where the paper was previously published and provide a URL link to access the PDF of the paper online. Accepted papers will be either presented as a talk or poster. This is a unique opportunity for the researchers to further broaden the dissemination and impact of their important work.
Please submit papers at https://easychair.org/conferences/?conf=rl4edaaai22.
Organizers
- Neil T. Heffernan. Worcester Polytechnic Institute (Worcester, MA, USA).
- Andrew S. Lan. University of Massachusetts Amherst (Amherst, MA, USA).
- Anna N. Rafferty. Carleton College (Northfield, MN, USA).
- Adish Singla. Max Planck Institute for Software Systems (Saarbrucken, Germany).