Pilottester Guide

This section details what went wrong. Classifying by severity helps the developers prioritize.

While invaluable, pilot tests are not without hurdles. Common issues include: pilottester

: Clearly defined metrics—such as time to completion, error rates, or technical stability—must be established beforehand. This section details what went wrong

| Domain | System Under Test | Key Finding | |----------------|---------------------------|-------------| | Drone delivery | Obstacle avoidance + GPS spoofing | Pilot-tester detected hidden autopilot oscillation that pure HITL missed. | | ICU ventilator | Alarm management UI | Under high cognitive load, pilots missed 2 alarms; test injection changed priority logic. | | Space docking | Manual override latency | Combined thruster lag + incorrect range indication → new recovery procedure added. | Common issues include: : Clearly defined metrics—such as

Testing user interfaces, browser compatibility, and instruction clarity.