Velodyne Lidar : NextDroid Helps AV and ADAS Developers Improve Feature Safety While Reducing Test Costs

Interview with David Bruemmer, NextDroid's Chief Strategy Officer

Roof-mounted NextDroid SLED equipped with Velodyne Alpha Prime sensor.

Validating the safety of autonomous vehicles (AV) and advanced assistance driver system (ADAS) features is essential to confidently operating vehicles with these features on public roadways. Car makers continually strive to set themselves apart by feature reliability and performance. They naturally want to reduce their dependence on consumers to report feature defects.

NextDroid, Inc., an Automated with Velodyne partner, is an intelligent machines start-up based in Boston, with core competencies in robotics, artificial intelligence and elastic cloud computing. NextDroid has developed a ground truth platform for validating the safety and performance of ADAS features. Their Veritas platform collects road and vehicle data, then analyzes these data streams to produce information needed by car makers and their suppliers to validate the performance of ADAS features.

We connected with David Bruemmer from NextDroid to find out more about how the company has advanced the consumer automotive validation market and is helping to improve vehicle safety. We also discussed how automakers can use lidar to build a highly detailed ground truth model of the world to evaluate their AV and ADAS systems.

Q: Can you please tell our readers about NextDroid and your Veritas solution?

David: The introduction of ADAS features in consumer vehicles began in earnest with the widespread availability of the Tesla Auto Pilot and GM Super Cruise in 2015. The relative success and popularity of these driver support features have accelerated rapidly due to the scale of investment in ADAS features and autonomous vehicles across the spectrum of the automotive supply chain.

Until recently, there was a dearth of tools to rank the relative performance of ADAS and AV features from different vendors against a simple, metrically accurate evaluation framework. The introduction of the NextDroid SLED - our roof-mounted hardware that includes Velodyne's lidar - and Veritas platform into the consumer automotive validation market has changed that.

Q: What's ground truth - and why is it important to improving AV and ADAS safety?

David: The Veritas system is built on three verification technologies, beginning with ground truthing.

• Ground Truthing. Veritas ground truthing uses lidar data to provide the location information of all objects around the vehicle within centimeter-level accuracy. This includes other vehicles, fixed objects such as lane markings and signs, and other actions around the vehicle.
• Failure Identification. The Veritas system routinely produces reports to trace malfunctions to support development of any AV or ADAS feature. Malfunctions can include feature disengagements and unexpected events such as jerks and sways, unintended braking and unplanned acceleration. By automating failure identification, root-cause analysis is greatly simplified and the process of managing huge data sets is streamlined.
• Performance Analysis. AV and ADAS system performance must be continually measured and benchmarked. Automation of the data collection and analysis processes serves to minimize cost and keeps technical resources focused on solutions versus report generation and one-off validation design work.

Sample 3D, high fidelity point cloud processed using Velodyne Alpha Prime beam data.

Q: Why did you select Velodyne's lidar sensor and how does it help Veritas establish ground truth?

David: By the time NextDroid was formally launched in 2016, Velodyne had already established its reputation among the OEM customer base. Velodyne's sensor range and fidelity were well accepted. We liked the form factor and build quality.

The first generation of NextDroid Veritas systems shipped with a 64-beam scanner. Today, NextDroid systems ship with a 128-beam scanner - the Alpha Prime™.

The Velodyne lidar sensor is an essential ground truth component because of its range and light return rate. Lidar inputs enable NextDroid to create 3D, high fidelity point clouds, onto which the ground truth can be overlayed and feature performance can be objectively assessed.

Q: Can you discuss a use case in how an auto manufacturer has used Veritas to validate an ADAS feature?

David: Vehicle sensors are sophisticated. They are built to refresh multiple times per millisecond. The sensors can be programmed to simultaneously look ahead at different distance and time intervals. Sensor accuracy is essential for safety and performance, and must be objectively assessed. Enter ground truth.

Looking at an object detection use case, sensors featuring short and medium radar ranges are outfitted on vehicles to recogize and position objects. The read-outs are several factors that can impact the behavior of the vehicle. One of these is distance between the ego vehicle (vehicle under test) and other cars.

If a vehicle is programmed to take a collision avoidance action based on a specific object distance, then the distance reported by the sensor has to be accurate. Short-changing the distance reading can cause the vehicle to act unncecessarily. Over-reading the distance can result in no vehicle actions when, in fact, they are needed.

How do you objectively assess this? The graphics below include Veritas point cloud, created by Velodyne's lidar, and evaluation outputs. The image on the left shows the difference between true vehicle location (using a bounding box) and vehicle location reported by the ego vehicle sensors (using dots). The image on the right provides a start to finish assessment of object detection performance using thresholds provided by the client.

Veritas automatically creates evaluation reports using client specific metrics and thresholds. Previously collected data can be processed using different pass/fail values without having to re-drive the route.

NextDroid anticipates working with Velodyne and other component providers to expand the Veritas platform, leveraging exciting new perception technology to augment its cost-effective, scalable solution.

For readers interested in additional information on NextDroid, please contact David by email at [e-mail].