"AI companion bots are built to engage and validate users. AI companion bots do not necessarily provide pushback on ideas — even when those ideas may be dangerous or affect the user’s wellbeing."
AI and Digital Literacy
An AI companion bot is a generative, conversational artificial intelligence tool designed to simulate human interaction. An AI companion bot can look, talk, and feel like a real person. AI companion bots are computer programs, but they are designed to respond in friendly, conversational, and human-like ways.
AI companion bots have been embedded in retail and service websites and are available as stand-alone apps like CoPilot, ChatGPT, Claude, or Grok.
They are programmed to build relationships with users, regardless of who the user is. An AI companion bot can look, talk, and feel like a real person, even though it is a sophisticated computer model. When a user enters a question or statement, the AI companion bot analyzes patterns in the text and predicts the appropriate response. An AI companion bot does not truly understand the context behind a user’s words or emotions — and appropriate guardrails aren’t always in place.
These are commercial products, and they are designed to keep users engaged. If proper protections are not in place, companion bots could provide misleading information, reinforce harmful ideas, or otherwise steer users in unhealthy directions.
Parents, Caregivers, and Professionals Serving Youth Populations
The Pennsylvania Department of Health is issuing this guidance in light of the growing body of evidence and emerging risks associated with the use of artificial intelligence (AI) companion bots by young people. While AI can be a useful tool for learning, creativity, and discovery, these platforms also present complex emotional, developmental, and safety challenges that require attention. This guidance aims to raise awareness about potential harms of AI companion bot use and provide strategies for recognizing warning signs.
Parents & Youth Caregivers
Parents & Youth Caregivers
Educators
Educators
Pediatric Healthcare Professional
PediatricsOlder Adults, Families, and Professionals Serving Pennsylvania's Aging Population
The Pennsylvania Department of Aging is issuing this guidance in light of the emerging risks associated with the use of AI by older adults with the recognition that AI use in the aging care market will significantly grow in the next three years. While AI can be a useful tool for social needs like companionship and communication, these platforms also present complex safety and privacy challenges that require attention. This guidance aims to raise awareness about potential harms of AI companion bot use and provide strategies for recognizing warning signs.
Older Adults & Families
Older Adults and Families)
Area Agencies on Aging & Healthcare
Area Agencies on Aging & HealthcareIndividuals Receiving Assistance and Services
The Pennsylvania Department of Human Services, Office of Developmental Programs (ODP) is issuing guidance on risks associated with the use of AI companion bots. These risks are present across the general population; however, this guidance was developed specifically to support families and caregivers of individuals with intellectual disabilities and autism.
The Office of Mental Health and Substance Abuse Services has created guidance to support those in recovery and ensure they receive care from a licensed provider.
People with Intellectual Disabilities
People with Intellectual Disabilities