Introducing Validation Toolset and Data Explorer: Tools for V&V and Drive Data Exploration

September 9, 2021

Today, Applied Intuition is excited to announce two new products to support more comprehensive testing and development of advanced driver-assistance systems (ADAS) and autonomous driving systems. The verification and validation (V&V) platform Validation Toolset* and the drive data exploration tool Data Explorer* allow autonomous vehicle (AV) and ADAS engineering teams to prepare for long-tail events and deploy safe automated driving systems to the public.

As AV programs and testing mature, the use of real-world data becomes increasingly important in addition to synthetic simulation. AV and ADAS engineering teams require new approaches to cover the nearly infinite number of possible events that their AV might encounter in the real world.

Validation Toolset and Data Explorer address this need by enabling teams to manage and verify requirements and make better use of real-world data. Our customers have been using these products for their development, and we are proud to share them with the broader AV ecosystem today.

Validation Toolset: Verification & Validation

In an effort to verify the requirements that their safety-critical software needs to meet, systems engineering and validation teams often need to focus on fixing rare failing scenarios and their countless possible variations. Validation Toolset is an end-to-end V&V management platform that allows these teams to centralize their requirements and test management, efficiently track their progress, and build their safety case for public deployment.

Key features include: 

  • Use auto-sampling to intelligently identify relevant scenarios such as failure cases from large parameter spaces at low computational cost (Figure 1).
  • Automatically generate stack performance reports to analyze failure points, track KPIs, and communicate progress to external stakeholders.
  • Leverage programmatic scenario generation to create millions of executable scenarios from a high-level definition of requirements.
  • Ingest requirements and metadata from third-party tools, link requirements and test cases to scenarios, and organize them by testing environment (e.g., software-in-the-loop, hardware-in-the-loop, vehicle-in-the-Ioop, and test track) for end-to-end traceability.
Figure 1: Auto-sampling enables systems engineering teams to intelligently identify failure cases from large parameter spaces.

Data Explorer: Drive Data Exploration

Using real-world data for algorithm development is often time-consuming and costly. To find specific events, AV and ADAS engineering teams usually need to download and comb through thousands of hours of drive data. Data Explorer is a drive data exploration tool that allows engineers to manage their drive data in one place and easily identify stack performance issues.

Key features include: 

  • Use scenario search to automatically identify disengagements, anomalies, and other critical issues across hours of existing drive logs (Figure 2).
  • Attach higher-level metadata to events. Data Explorer automatically annotates drive data with events, objects, anomalous patterns, and custom metrics.
  • Make drive logs accessible across your organization. Data Explorer is a cloud-based tool that lets teams visualize, query, and use drive data through a web browser without the need for downloading.
Figure 2: Scenario search allows AV and ADAS engineering teams to automatically identify interesting events across hours of existing drive logs.

With Validation Toolset and Data Explorer, systems engineering and AV/ADAS engineering teams can manage their V&V workflows and utilize their drive data to deploy safe automated driving systems to the public. Contact our engineering team for a product demo of Validation Toolset or Data Explorer.

*Note: Validation Toolset was previously known as Basis and Data Explorer was previously known as Strada.