Monday, 16 June 2025
30.1 C
Singapore
34.3 C
Thailand
26.2 C
Indonesia
29.2 C
Philippines

OpenAI takes steps to protect children online

OpenAI establishes a Child Safety team to address concerns over children's use of AI tools and regulations on usage in education.

OpenAI has established a new team dedicated to ensuring the safety of children using its artificial intelligence (AI) tools. The move comes in response to concerns raised by activists and parents regarding the potential misuse or abuse of AI technology by minors.

In a recent job listing, OpenAI disclosed the formation of a Child Safety team tasked with collaborating with internal groups and external partners to develop processes and protocols for managing incidents related to underage users. The team is currently seeking to recruit a child safety enforcement specialist to oversee the implementation of OpenAI’s policies concerning AI-generated content, particularly content deemed sensitive or relevant to children.

With the prevalence of regulations like the U.S. Children’s Online Privacy Protection Rule, which governs children’s online activities and data privacy, it is not surprising that OpenAI is investing resources in child safety measures. While OpenAI’s current terms of use require parental consent for users aged 13 to 18 and prohibit access for children under 13, the establishment of the Child Safety team reflects a proactive approach to addressing potential risks associated with underage AI usage.

The formation of this team follows OpenAI’s recent partnership with Common Sense Media to develop guidelines for child-friendly AI usage and its acquisition of its first education customer. These initiatives underscore OpenAI’s commitment to responsible AI development and its recognition of the need to mitigate risks associated with minors’ use of AI technology.

Concerns raised over children’s use of AI tools

The increasing reliance of children and teenagers on AI tools for academic assistance and personal support has raised concerns among educators and policymakers. A poll conducted by the Center for Democracy and Technology revealed that a significant portion of young users have turned to AI platforms like ChatGPT to address issues such as anxiety, social conflicts, and family problems.

However, the growing popularity of AI among minors has also prompted scrutiny and apprehension. Last summer, several educational institutions imposed bans on ChatGPT due to concerns regarding plagiarism and dissemination of misinformation. While some bans have been lifted, lingering doubts remain about the potential negative impact of AI on young users.

According to surveys conducted by organisations such as the U.K. Safer Internet Centre, a considerable proportion of children have reported encountering instances of misuse of AI tools by their peers, including the creation of false information or images intended to harm others.

In response to these challenges, OpenAI has published documentation providing guidance to educators on the appropriate use of AI tools in classrooms. Acknowledging the potential for AI-generated content to be unsuitable for certain audiences, OpenAI advises caution when exposing children to its technology, even among those who meet the minimum age requirements.

OpenAI takes steps to protect children online - 2

Calls for regulation and guidelines on AI use in education

International organisations such as UNESCO have called for stricter regulation of AI usage in education to safeguard children’s well-being and privacy. UNESCO has advocated for the implementation of age restrictions and data protection measures to mitigate the potential risks associated with AI technology in educational settings.

Audrey Azoulay, UNESCO’s director-general, emphasised the need for public engagement and regulatory frameworks to ensure the responsible integration of AI into education. While recognising the potential benefits of generative AI for human development, Azoulay cautioned against overlooking the potential harms and prejudices that could arise without adequate safeguards and regulations in place.

Hot this week

Nothing to launch new over-ear headphones and flagship smartphone on 2 July

Nothing will unveil its first over-ear headphones and flagship smartphone, Phone (3), in a global launch event on 2 July.

Thales launches file activity monitoring to improve control over unstructured data

Thales adds real-time File Activity Monitoring to its CipherTrust platform, improving visibility and compliance for unstructured data.

Informatica deepens partnership with Databricks to support new Iceberg and OLTP services

Informatica joins Databricks as launch partner for new Iceberg and OLTP solutions, introducing AI tools to speed up GenAI development.

AI helps uncover gender-specific drug combinations to improve heart valve disease treatment

Researchers use AI to find gender-specific drug combinations for AVS, aiming to improve personalised treatment for heart valve disease.

Apple gives Image Playground a second chance with ChatGPT integration

Apple is upgrading Image Playground with ChatGPT to offer more creative image styles and better results. It will launch with iOS 26 this autumn.

Building future-ready B2B teams through AI innovation

How B2B teams across APAC can build the skills and mindset needed to stay competitive in a fast-changing AI-driven business world.

Informatica deepens partnership with Databricks to support new Iceberg and OLTP services

Informatica joins Databricks as launch partner for new Iceberg and OLTP solutions, introducing AI tools to speed up GenAI development.

Hong Kong opens skies to larger drones in bid to grow low-altitude economy

Hong Kong will allow the testing of larger drones to boost its low-altitude economy and improve logistics, following mainland China's lead.

Hong Kong to build new AI supercomputing centre in bid to lead global tech race

Hong Kong plans a new AI supercomputing centre to boost its tech hub status and support growing start-ups across the Greater Bay Area.

Related Articles

Popular Categories