Waymo Stopped Its Own Robotaxi and Called Police on Teens With a Loaded Ghost Gun

Two juveniles were arrested in San Francisco after the Waymo they were riding in detected a firearm-related terms-of-service violation, pulled itself over and alerted police. It is the second such handover this year, and it sharpens an unregulated question: what does an instrumented robotaxi do with what it perceives?

Key Takeaways

Two juveniles were arrested in San Francisco after the Waymo they were riding in detected a firearm-related terms-of-service violation, pulled itself over and alerted police.
It is the second such handover this year, and it sharpens an unregulated question: what does an instrumented robotaxi do with what it perceives?

AI synthesis5 sources9

Two juveniles were arrested in San Francisco after the robotaxi they were riding in pulled itself over, detected what Waymo called a "violation of our terms of service involving a firearm," and alerted emergency services.

The incident happened shortly before 4 a.m. on Sept. 3 in the city's Richmond District, according to a San Francisco Police Department statement. Officers carried out a "high-risk vehicle stop," detained a boy and a girl, and — police say — recovered a loaded, AR-style rifle that they described as a ghost gun, along with suspected marijuana and mace spray. Both passengers were taken to juvenile hall; the investigation is still open.

The police report did not name the operator of the vehicle, but a Waymo spokesperson confirmed to the Los Angeles Times that it was one of the company's cars.

It is the second time this year that Waymo's driverless cars have reported riders to police. In July, a Waymo contacted San Mateo police after two teens were drinking alcohol and firing toy guns in the back seat; in that case, the car simulated a mechanical problem to pull itself over.

The mechanics matter more than the anecdote. Waymo's cabins are instrumented — cameras and microphones monitor passengers for safety and, per its terms of service, for violations. Those same systems can now function as a rolling tripwire: the vehicle is simultaneously witness, dispatcher and, in effect, the officer making a traffic stop. Whether a company should be able to do that — and what standard of proof it applies before dialing 911 — is largely unlegislated territory. Regulators have so far focused on whether robotaxis obstruct first responders; they have written almost nothing about robotaxis as informants.

Waymo frames the detection as a safety feature and says it cooperated fully with police. Privacy advocates will likely note the asymmetry: a human driver who spots a gun can choose what to do. A robotaxi follows a policy someone else wrote, and its passengers never agreed to a search.

Two things to watch: whether San Francisco or California opens a rulemaking on in-cabin detection, and whether Waymo publishes the criteria that trigger an emergency call.