『ISO/PAS 8800. Lesson 8: Model Verification and Validation in ISO/PAS 8800』のカバーアート

ISO/PAS 8800. Lesson 8: Model Verification and Validation in ISO/PAS 8800

ISO/PAS 8800. Lesson 8: Model Verification and Validation in ISO/PAS 8800

無料で聴く

ポッドキャストの詳細を見る

今ならプレミアムプランが3カ月 月額99円

2026年5月12日まで。4か月目以降は月額1,500円で自動更新します。

概要

1. Introduction\nIn the context of ISO/PAS 8800 (Road vehicles — Safety and artificial intelligence), Verification and Validation (V&V) are the cornerstones of ensuring that AI-based systems are safe for public roads. While traditional software follows deterministic paths, AI models are probabilistic and data-dependent, requiring a shift in how we confirm their correctness and safety.

2. Defining Model Verification\nVerification asks: \"Did we build the system right?" It involves checking the AI model against the technical requirements and design specifications defined in the early stages of development. Under ISO/PAS 8800, verification includes:

Formal Methods: Using mathematical proofs to verify that certain safety properties are always maintained by the model.

Robustness Testing: Measuring how the model handles small, intentional perturbations in input data, often referred to as adversarial robustness.

Unit and Integration Testing: Testing individual components of the AI pipeline (e.g., pre-processing scripts or specific neural network layers) to ensure they function as intended.

Code and Model Audits: Reviewing the architecture and hyperparameters to ensure they align with the safety goals.

3. Defining Model Validation

Validation asks: "Did we build the right system?" This process ensures the model meets the actual needs of the user and remains safe within its intended Operational Design Domain (ODD). Key aspects include:

ODD-Based Testing: Validating performance across diverse conditions such as varying weather, lighting, and geographic locations.

Edge Case Analysis: Identifying and testing "long-tail" scenarios that are rare but safety-critical.

Safety of the Intended Functionality (SOTIF): Aligning with ISO 21448 to ensure that functional insufficiencies do not lead to unreasonable risk.

Performance Metrics: Evaluating the model using safety-relevant KPIs such as False Negative Rates in pedestrian detection.

4. The Integrated V-Model for AI\nISO/PAS 8800 adapts the classic V-Model to account for the iterative nature of machine learning. This includes a feedback loop where validation failures in the field trigger a re-verification of the training data and model architecture. Verification ensures the model is statistically sound, while validation ensures that statistical soundness translates to real-world safety.

まだレビューはありません