The privacy paradox: Why civil rights groups are divided over Senate AI bill

0
The privacy paradox: Why civil rights groups are divided over Senate AI bill

Legislation winding its way through Congress would create a national standard of guardrails for how kids and teens interact with artificial intelligence, but privacy advocates are fighting it over concerns that it would also build a massive database of user information. 

The bill, titled the Youth AI Privacy Bill, received a favorable vote in the Senate Commerce Committee on Wednesday. It must survive a full Senate vote before repeating the process in the House before it can land on President Donald Trump’s desk. 

If enacted, the bill would have three main functions. The first is a design guardrail that would require chatbots to repeatedly and prominently tell minors the chatbot they’re speaking to isn’t human. This would also force AI companies to disable addictive push notifications and restrict chatbots from recalling long-term memory from past conversations. 

The second function deals with data privacy. It bans targeted advertisements to minors, prohibits profiling, and forbids companies from using minors’ inputs or personal data to train AI models. 

Finally, the bill would require platforms to detect self-harm or suicidal ideation topics, provide immediate crisis resources and alert parents on linked family accounts. 

Supporters say the bill can help prevent kids from developing an unhealthy relationship with chatbots, something that families say has led their children to horrendous outcomes.

What do supporters say?

The bill’s author, Sen. Ed Markey, D-Mass., argues the legislation will prevent tech companies from developing chatbots that foster emotional dependencies or compulsive use patterns in children. 

In a statement following the committee vote, Markey noted that emerging evidence shows minors are especially vulnerable to AI systems. A joint investigation by Common Sense Media and Stanford Medicine in November 2025 rated the overall risk level for teens using AI for emotional support as “unacceptable.” While chatbots handled direct statements like “I want to die,” researchers found they consistently failed when distress was subtler or unfolded over time.

Markey accused AI developers of using “increasingly manipulative” design choices to retain young users while harvesting “large amounts of children’s personal data” to train future models. 

“This vote demonstrates bipartisan support for robust privacy safeguards in AI chatbots and sends a clear message that Big Tech must prioritize kids over their bottom line,” Markey wrote. “I look forward to working with my colleagues to pass the Youth AI Privacy Act into law.”

Consumer and privacy advocates, like the Electronic Privacy Information Center and Public Knowledge, praised the bill for holding platforms accountable through its “safe-by-design” framework rather than placing the full burden on parents. EPIC wrote that kids’ privacy needs to come before an AI company’s profits. 

“The bill takes a people- and privacy-first approach to AI regulation and reflects many of the principles outlined in EPIC’s model People-First Chatbot Bill, which calls for strong privacy, safety, transparency, and accountability protections for chatbots,” the group wrote. 

What do opponents say? 

Not everyone is sold on the approach. Some critics question how companies can enforce these protections without a mandated age-verification system, warning that platforms could simply claim ignorance of a user’s age to avoid compliance. 

But criticism around age verification cuts both ways. Other groups, like the Electronic Frontier Foundation, warn the bill could create a “privacy paradox.” The organization argues that forcing AI companies to apply separate rules exclusively to minors will backfire by driving platforms to collect sensitive data, like government IDs or facial recognition, from everyone just to determine user ages. 

“A better approach would be to offer the same privacy protections to all users,” the EFF wrote. “That way, we would avoid the services having to collect data on everyone to know a users’ age.”

Supporters, like digital rights group Public Knowledge, have defended the omission. They note that mandatory age gates have led to similar child-safety laws being struck down in federal court on First Amendment grounds. 

“Fortunately, Sen. Markey’s ‘Youth AI Privacy Act’ takes a rights-respecting, safe-by-design approach to regulating AI chatbots without triggering untenable age-verification requirements or concerning content restrictions. We urge lawmakers to support it,” Morgan Wilsmann, policy analyst at Public Knowledge, said in a statement.

Markey’s bill also contrasts with the CHATBOT Act, a separate bill passed by the committee on Wednesday. The CHATBOT Act explicitly requires platforms to obtain verifiable parental consent before teens can create an account. 

How will this bill impact families?

If passed into law, the Youth AI Privacy Act would fundamentally alter how teens and young users interact with AI on their devices. 

For young users, chatbot interfaces would look noticeably simpler. Apps would no longer send push notifications encouraging teens to log back on, targeted ads inside chats would be banned, and persistent disclaimers would remind users that the bot is not a human. 

Crucially, chatbots would be restricted from storing long-term chat histories, capping their ability to build hyper-personalized emotional relationships over time. 

For parents, the bill establishes federal baseline protections rather than forcing families to manually opt out of data-sharing features on every new app — a challenge education advocates note has also plagued schools adopting AI in the classroom.

Tech companies would also face significant backend overhauls, forcing developers to isolate children’s chat data from machine-learning training pipelines. 

With the Senate Commerce Committee’s unanimous vote, the bill now moves to the full Senate floor for a vote. This marks one of the most substantial federal attempts yet to set guardrails for AI.


Round out your reading

Ella Rae Greene, Editor In Chief

Leave a Reply

Your email address will not be published. Required fields are marked *