New approach to simulation set to revolutionise autonomous vehicle training and testing

UK-based driving simulation company, rFpro, has developed a means to slash the hardware costs associated with large-scale simulation.

The ground-breaking development has the potential to remove the industry's dependence on manual annotation of test data that is created frame-by-frame, which is both time-consuming and error-prone.

“Currently, many players in the autonomous vehicle field employ an army of people to manually annotate each frame of a video, LiDAR point or radar return to identify objects in the scene (such as other vehicles, pedestrians, road markings and traffic signals) to create training data,” said Matt Daley, rFpro Managing Director. “This new approach from rFpro provides a digital, cost-effective way of creating the same data completely error-free and 10,000 times quicker compared to manual annotation, which takes around 30 minutes per frame with a 10% error rate. This step-change will enable deep learning to fulfil its potential because it significantly reduces the cost and time of generating useful training data.”

rFpro calls the new approach Data Farming and compares it to Render Farming, which has revolutionised the economics of popular animation. It enables customers to build complete datasets that cover the full vehicle system where every sensor is simulated at the same time. The data is synchronised across all sensors, even with the most complex hardware designs. This is essential where customers are employing sensor fusion to bring together data, for example from multiple 8K HDR stereo cameras, LiDAR and radar sensors at the same time.

Data Farming is already being utilised by existing customers, including global Tier1 supplier, DENSO ADAS Engineering Services. “Through rFpro's Data Farming we can create an extensive number of driving scenarios, allowing the generation of very large variations in scenes, all through the investment in a single platform,” said Francisco Eslava-Medina, Project Manager at DENSO ADAS. “This allows us to quickly and cost-effectively generate the vast quantity of quality training data that is essential for certain product development phases of computer vision technologies, especially for neural networks for our autonomous vehicle technologies.”

The new approach permits customers to start with even a single PC to perform a complex simulation involving multiple sensors. “Simulations don't have to be run in real-time, offering flexibility to the user around the computing power required,” added Daley. “For engineers, this puts it within a typical departmental budget, rather than requiring senior approval. High-quality training and test data is now far more accessible.” Data Farming is fully scalable, allowing customers to expand across multiple hardware resources when they are ready to accelerate their data production.

Another customer that has successfully employed Data Farming includes Ambarella, a leading autonomous vehicle technology provider. “The software presents a radical shift in creating training data and is already accelerating the development of our autonomous vehicle systems,” said Alberto Broggi, General Manager of Ambarella's division in Italy. “Deep learning and AI are critical to the successful adoption of autonomous vehicles. It may not be reasonably possible to get to the standard required only through the use of manually annotated data sets. Data Farming will transform the way the industry develops autonomous vehicles”.