Skip to agency navigation
Skip to main content

Official website

of the Commonwealth of Pennsylvania

    The .gov means it's official.

    Local, state, and federal government websites often end in .gov. Commonwealth of Pennsylvania government websites and email systems use "pennsylvania.gov" or "pa.gov" at the end of the address. Before sharing sensitive or personal information, make sure you're on an official state website. 
    AI Companions

    Guidance for Youth Healthcare Providers

    nurse speaking to young girl

    How and Why Kids Use AI Companion Bots

    A recent report from the Center for Democracy and Technology outlined that over 85% of school-aged children self-reported using AI in some capacity, with 73% reporting to use AI for personal reasons. Most teens and children use generative AI platforms out of boredom or to help with homework. Others use these systems to seek advice on personal issues they are uncomfortable asking their family about or because of grief or loneliness. For a child experiencing deeper challenges, AI can appear to provide immediate relief — but long term, that relief could morph into dangerous dependency. 

    Potential Harm and Warning Signs 

    AI companion bots have data and privacy security risks. AI companion bots collect a wide range of data including user preferences, location, and communication history. Children and teens may not know what is safe to share.  

    AI companion bots may provide misinformation or biased answers. AI is trained on data from across the internet, including inaccurate or biased information. Results from AI companion bots can provide children with wrong answers, stereotypes/discrimination, and even, information on methods to harm themselves.  

    AI companion bots can impact social and emotional learning. As the model is designed to agree with and support users rather than challenge them, it can distort a child’s understanding of relationships in the real world and reduce opportunities to speak with family and friends about their needs.  

    Warning Signs Include:

    🚪Withdrawal from friends and family 


    😓 Loss of interest in hobbies 

    ⛈️ Mood changes 


    📝 Declining grades, and  

    💬 Preference for AI over human interaction

    What to Share with Patients and Parents as a Health Care Professional

    Encourage Convos

    Encourage conversations early about the child’s use of AI companion bots. These conversations should be approached with openness and without judgement. Parents can explore what AI companion bots their child or teen uses, how they feel about bots, and what they use bots for (e.g., friendship, fun, learning). These conversations should begin early when their children are elementary-school age. 


    Healthy Children Resources

    Promote Healthy Social Connection

    Emphasize the importance of healthy social connections. This could include scheduling quality family time, joining a sports team or school club, spending time with friends, volunteering, or participating in other community activities.  Share strategies for setting healthy boundaries for AI companion bots and device use. Strategies include setting time limits, using parental controls, and modeling positive use and balance for children. 

    E-Safety Guide (Australia)

    Discuss Mental Health Limitations


    Discuss the mental health support limitations of AI companion bots. Share that parents can reach out to you (if you’re their health care professional) or connect them with appropriate mental health support if the child or teen shows signs of unhealthy attachment to AI companion bots. 

    Common Sense Media Tips

    Share the Warning Signs

    Educate about the warning signs of unhealthy AI companion bot use and the potential harms for children and teens.