Lesson 10 of 10 · 8 min
Social robots, ethics and students’ data
A robot that talks and reacts creates a relationship. Useful for some kinds of learning, it raises questions of attachment, deception and personal data.
Social robots talk, look at the student and react. In 2018, the review by Belpaeme and colleagues showed positive effects on targeted learning, such as vocabulary, sometimes close to those of a human tutor on narrow tasks. It also noted their technical limitations. In 2020, a review by van Straten and colleagues showed that children easily form a relationship with a robot. They feel close to it and trust it.
This relationship raises ethical questions. In 2016, Amanda Sharkey examined the idea of robot teachers. She identified risks to privacy, the child’s attachment to the machine, a form of deception when the child believes the robot cares about them, and the loss of human contact. She judged the robot as a tool serving the teacher to be defensible, but not the robot that replaces the teacher.
The law already governs some uses. In the European Union, the AI Act has prohibited, since February 2025, the use of AI to recognise people’s emotions in educational institutions. An AI that assesses learning or guides a student’s path is a high-risk system. Since Regulation (EU) 2026/1744, these obligations apply from 2 December 2027. A Swiss school can be concerned when it serves students in the Union.
In Switzerland, a public school applies the cantonal data protection law. The federal law, in force in its revised version since 1 September 2023, applies to private schools and to the companies that supply the robot or the online service. In both cases, a student’s voice, image and activity traces are personal data.
- Does it work offline? If not, what data does it send, and where is it processed?
- Does it record the students’ voices, images or location? How long does the supplier keep them?
- Does each student need an account, and with what information?
- Has your school or your canton authorised it?
- Do the parents know what is recorded?
References
- Belpaeme, Kennedy, Ramachandran et al. (2018). Social robots for education: A review. Science Robotics 3(21), eaat5954. doi.org/10.1126/scirobotics.aat5954
- van Straten, Peter, Kühne (2020). Child–Robot Relationship Formation: A Narrative Review of Empirical Research. International Journal of Social Robotics 12(2), p. 325–344. doi.org/10.1007/s12369-019-00569-0
- Sharkey (2016). Should we welcome robot teachers?. Ethics and Information Technology 18(4), p. 283–297. doi.org/10.1007/s10676-016-9387-z
- European Parliament and Council of the European Union (2024). Regulation (EU) 2024/1689 laying down harmonised rules on artificial intelligence. Official Journal of the European Union, 12 July 2024. data.europa.eu/eli/reg/2024/1689/oj
- European Parliament and Council of the European Union (2026). Regulation (EU) 2026/1744 amending Regulation (EU) 2024/1689 (Digital Omnibus on AI). Official Journal of the European Union, 24 July 2026. data.europa.eu/eli/reg/2026/1744/oj
- Swiss Confederation (2020). Federal Act on Data Protection (FADP), SR 235.1. In force since 1 September 2023. www.fedlex.admin.ch/eli/cc/2022/491/fr