On November 14, 2025, a catastrophic malfunction occurred during an autonomous delivery vehicle test by Amazon in suburban Seattle, resulting in the deaths of three pedestrians. The experimental Rivian electric van, equipped with Amazon’s proprietary "River" AI system, was testing last-mile delivery software when its emergency braking system failed, activating the accelerator instead. The vehicle surged from 25 mph to over 60 mph and struck a mother, Maria Gonzalez, 32, and her two children, Javier, 6, and Sofia, 4, who had wandered near the test perimeter.
The National Highway Traffic Safety Administration (NHTSA) attributes the accident to a critical software glitch—a "neural network hallucination"—where the AI misclassified the obstacle and inverted throttle and brake commands. Despite being tested extensively on millions of simulated miles, this error led to devastating consequences during what was supposed to be a controlled setting.
Amazon promptly suspended all River system tests and issued a recall for 1,200 vans. CEO Andy Jassy expressed devastation and pledged full support for the victims' families and efforts to prevent future incidents. The tragedy has reignited debate over autonomous vehicle safety, regulatory oversight, and the pace of technology deployment.
Lawmakers and safety experts demand stricter fail-safes and thorough scrutiny. The FBI is investigating possible criminal negligence, while civil suits seek $500 million damages. This incident raises critical questions about the balance between innovation and public safety in the autonomous vehicle landscape.
