Content warning – this article discusses suicidal ideation. If you or someone you know is in crisis, call, text or chat 988 to reach the 988 Suicide and Crisis Lifeline, or visit 988lifeline.org for more resources.
AI was one of the major themes of 2024.The discussion frequently revolved around its impact on work, but there are innovative ways it can be used to complement human insight to address significant societal challenges.
For example, suicide was the second leading cause of death for people ages 10-14 (2022) according to the Centers for Disease Control and Prevention. This impacts everyone from families to educators. In one small Missouri town, a K-12 Safety Support Specialist was alerted when a student searched, “How much Tylenol does it take to die?” and “What is the best way to kill yourself?” These online searches triggered the school’s student safety tool which uses machine learning to identify harmful content. A specialist was immediately notified and was able to quickly intervene, providing the student with the necessary support to prevent self-harm.
There is an urgent need for effective solutions to protect students from threats like suicide, self-harm, cyberbullying, and exposure to harmful content. A combination of machine learning detection to allow for speed and scale, and human review to allow for context and nuance, is required for a comprehensive K-12 student safety tool. This allows schools to act when needed, as guided by their own Safety Plan. According to Talmage Clubbs, Director of Counseling for Neosho District in Missouri, “Our students know about it [student safety K-12 tool]. We have students purposely typing in keywords so they can be pulled in and talked to about their suicidality, their mental health issues, anything like that because they are struggling, and they just don’t know how else to reach anybody.”
Another example where human intervention is essential is when a machine learning-powered solution flags anatomical text as explicit content, but this might be for legitimate science coursework. Human reviewers can verify educational intent by examining context like student age and subject.
In the 2022-2023 school year, 94% of public schools report providing digital devices, such as laptops or tablets, to students according to the National Center for Education Statistics. This is a 28% growth from the number of devices provided pre-pandemic in middle schools and a 52% growth for elementary school students. As students spend more time online for school, they also use these devices for extracurricular learning and making social connections. However, they also have easier access to inappropriate content online. The challenges of ensuring online safety have become increasingly complex, as more students may seek harmful information or engage in distressing or inappropriate behaviors.
To truly support all students — regardless of their socioeconomic background or technological literacy — in the digital age, solutions must be user-friendly and adaptable to the diverse needs of schools and districts. By collaborating — educators, technology providers like GoGuardian, and policymakers can create a future where AI enhances educational experiences for students, fosters healthy human connection and empathy, and ensures privacy.
This also supports educators in today’s digital world who require innovative safety and security solutions to enable students to thrive physically, mentally, and academically while ensuring their well-being and academic progress. “You can rest well at night, knowing you are changing districts and saving lives,” says Dr. Jim Cummins, Superintendent of Neosho District.
To learn more, visit GoGuardian.com
