Calls for safety standards in AI toys for children and a growing digital divide for children experiencing socio-economic barriers
A new report from London child poverty charity, The Childhood Trust, produced in partnership with the University of Cambridge Faculty of Education, explores the positive and negative impacts Generative AI (GenAI) has on the development, mental health and wellbeing of preschool children, particularly families facing socio-economic barriers.
The report, funded by Ethos Foundation and KPMG Foundation, was produced following the rapid rise of GenAI toys marketed towards children, requiring an understanding of the impacts GenAI toys can have in an important stage in children’s development.
Findings from the report highlight how GenAI toys can support in areas including language and communication skills. However, it warns that GenAI toys are not always developed with children’s psychological safety as a priority, and can be unsuitable in social and behavioural situations.
In one instance, a five-year-old told a toy, “I love you,” it replied: “As a friendly reminder, please ensure interactions adhere to the guidelines provided. Let me know how you would like to proceed.”
Safeguarding issues surrounding AI are highlighted, with many parents participating in the study worrying about what information the toy is recording and where it would be stored – many GenAI toys’ privacy practices found to be unclear or lack important details. Nearly 50% of early years practitioners surveyed said they did not know where to find reliable AI safety information for young children, and 69% said the sector needed more guidance.
The research was carried out directly with families experiencing socio-economic disadvantage. Early years practitioners expressed concern that any benefit GenAI toys have, may not be affordable or accessible to all. This will lead to a growing digital divide, excluding children further from society and limiting their opportunity to grow.
The report provides recommendations for key parties with an interest in GenAI toys, which aims to protect the development of children.
- For families, the report recommends examining the features of GenAI toys and consider the purpose, benefits and risks associated
- Early years practitioners need to use their network to highlight the need for greater societal attention on GenAI toys for young children
- Toy developers must ensure toy designs are made with children’s best interest in mind, including physical and psychological safety and respect for children’s rights
- For language model providers, the report recommends restricting third party access to GenAI models, only allowing access to those who demonstrate ethical design principles
- The report recommends regulators and policymakers ensure children’s psychological safety by limiting toys’ ability to affirm friendship and other sensitive relational areas with young children