The California DMV, one of the prominent regulatory institutions in autonomous vehicle industry has released a year-end disengagement report ‘Disengagement Reports 2019’.
Currently more than 60+ companies which include major OEMs, AV startups and AI providers have secured permit to test the fleet of self-driving vehicle in the state of California.
The companies with DMV self-driving license have to submit annual test statistics and disengagement report pursuant to California code of regulations. The authority monitors and analyzes the report to tackle the risks and to reform the vehicle laws.
California DMV defines disengagements as, deactivation of the autonomous mode when a failure of the autonomous technology is detected or when the safe operation of the vehicle requires that the autonomous vehicle test driver disengage the autonomous mode and take immediate manual control of the vehicle
Is the disengagement report engaging?
The self-driving pioneers including Waymo, Cruise, Aurora and Zoox have been critical of the disengagement reports.
This year Chinese self-driving pioneer, Baidu has a lower disengagement rate than the Google spinoff Waymo and other peers. They also agree that using disengagement rates for comparison across companies is “not that meaningful.” It says the data is better used for examining a company’s performance over time.
According to Kyle Vogt, Cruise Co-founder “Disengagement report is really great for giving the public a sense of what’s happening on the roads. Unfortunately, it has also been used by the media and others to compare technology from different AV companies or as a proxy for commercial readiness.” He states the idea that disengagements give a meaningful signal about whether an AV is ready for commercial deployment is a myth.
Waymo also doesn’t agree on using California's disengagement data to compare performance, or judge readiness or competency.
The disengagement report can’t be considered as a safety benchmark as it does not really tell about the autonomous driving systems.
These numbers aren’t too useful in assessing the safety of the vehicles, and they might actually be reducing the proper culture of safety, and that’s not a good combination.
California DMV itself advises against treating its annual report as a scoreboard. The DMV spokesman Marty Greenstein, clearly said that the reports are not intended to compare one company with another or reach broad conclusions on technological capabilities.