AI Safety Aviation

Roadmap Overview

FOCUS: Flight Operational Companion for Unexpected Situations

FOCUS is an advanced, AI-driven assistant designed to help commercial pilots manage sudden and surprising events within the cockpit. In high-stress situations, pilots may experience natural “freeze” reactions, delayed responses, or unintended inputs, which can compromise safety and increase risk. FOCUS has been designed to address this challenge by monitoring for signs of such startling events in aircraft readings and pilot biometrics. After detection, FOCUS will provide real-time guidance to help pilots quickly regain situational control. Through intuitive, timely interventions, FOCUS enhances flight safety by enabling pilots to confidently navigate complex and unexpected scenarios. This technology roadmap outlines the developmental path for FOCUS, highlighting its role in advancing safety, reducing operational risks, and supporting pilots with reliable, real-time assistance.

Design Structure Matrix (DSM) Allocation

Our technology roadmap focuses on an Adaptive Cockpit (3ADC) at the subsystem level (level 3). Components of the adaptive cockpit are AI for interpreting and modeling data to determine aircraft and pilot status (4AI), Biometric Sensors for measuring pilot status indicators (4BIO), aircraft sensors for detecting aircraft status (4ACS), adaptive displays that can highlight critical information for a pilot (4ADD), a lighting system that assists pilots in maintaining respiratory rates and creating a calming atmosphere (4LIS), and the pilot responsible for flying the aircraft (4PIL). Other subsystems in the cockpit include navigation and communication systems (3NAC), and flight controls (3FLC). We have also listed other level 2 products that support our level 1 market of safe commercial aviation (1SCA).

Roadmap OPD

In the figure below, we provide an Object-Process-Diagram (OPD) of the 3ADC roadmap. This diagram captures the main object of the roadmap (FOCUS), its main process (Teaming), the various tools required, the sub-processes required for FOCUS, and the change in the status of the pilot as a result of Teaming. Additionally, we have included a breakdown of the Temaing process into its three sub-processes (Detecting, Supporting, and Augmenting).

Figures of Merit

Important FOMs for 3AISC

Figure of Merit	Description	Trends	Units
Incident Rate	Rate of incidents and accidents normalized by flight time aircraft	decreasing	$\frac{\text{incidents}}{\text{passenger mile}}$
System Maintainability	How much time is spend maintaining aircraft systems, measured by comparing maintenance time per flight time	decreasing	$\frac{\text{maintenance hours}}{\text{passenger mile}}$
Response Time	Time required to identify and mitigate safety issues	flat	$\text{minutes}$
System Uptime	Amount of time aircraft is available to be dispatched on a mission as a percentage of wall time	increasing	$\text{\%}$
Cognitive Load on Crew	As measured by industry standard NASA TLX score	flat	$\text{unitless}$

Detail of Accidents per Passenger Hour

Alignment with Company Strategic Drivers

Positioning of Company vs. Competition

The chart below summarizes some key metrics for the major players in aircraft manufacturing. There is a clear difference in market share, with Boeing and Airbus demonstrating a duopoly over commercial aviation. Embraer and Bombardier have focused their efforts on commercial aviation's regional and business segments.

Aircraft are incredibly complex systems that impart a tremendous demand on pilots. We will look at some characteristics and traits of various aircraft and use them as a proxy for complexity. The chart below highlights the various levels of complexity in commercial aviation across segments and manufacturers.

The chart below shows that Airbus is the only major manufacturer actively investing in RDO / SPO. There is an opportunity for companies to differentiate their architectures and provide a solution that will assist the industry in meeting pilot demands in the future by providing single-pilot aircraft.

Key Publications and Patents

Publications

• 1.) Masi, G.; Amprimo, G.; Ferraris, C.; Priano, L. Stress and Workload Assessment in Aviation—A Narrative Review. Sensors 2023, 23, 3556. https://doi.org/10.3390/s23073556

a. Summary i. This paper reviews various workload and stress assessment tools used within the military and civilian aviation sector. Stress and workload are key indicators of pilot performance, but measuring these conditions is not straightforward. Some of the highlighted indicators used for determining stress and workload are neurophysical (heart rate (HR) and heart rate variability (HRV)), respiratory rate, electrodermal activity (EDA), body temperature, eye movements and dilation, etc. Subjective measures such as the NASA-TLX can also be used to determine workload. b. Methodology i. This paper reviewed 48 studies from 2012-2022 that investigated workload and stress in pilots. c. Findings i. One of the major conclusions was that there is no positive indicator for stress and workload in pilots. All the indicators mentioned above are only potential indicators for stress, so a comprehensive approach must be taken to model the status of the pilot. Most of the studies reviewed in this analysis used a combination of assessments to deduce stress and workload. The most common neurophysical used in the studies was HR and HRV. The authors comment on the feasibility of taking these measurements during flight, recommending that the devices should be light and not encumber the pilot's ability to function by using single-lead wearables or smart devices. ii. The authors suggest that more research should be done on eye tracking, near-infrared spectroscopy, grip strength during flight, and other parameters. Lastly, the author recommends further research into adaptive cockpits. d. Relevancy i. This review is an excellent source of background science regarding safety in aviation as it relates to pilot performance. The review's conclusion suggests that a combination of assessments is required, that there is still work to do to establish a reliable model for pilot stress and workload, and that adaptive cockpits would be the potential practical application of these findings.

2.) Li, Qinbiao & Chen, Chun-Hsien & Ng, Kam K.H. & Yuan, Xin & Yiu, Cho Yin. (2024). Single-pilot operations in commercial flight: Effects on neural activity and visual behaviour under abnormalities and emergencies. Chinese Journal of Aeronautics. 37. 10.1016/j.cja.2024.04.007. a. Summary i. This publication is a thesis that focuses on enhancing flight safety through neurophysical analysis and mental state predictions in single-pilot operations (SPO). As the airline industry seems primed to shift from dual-pilot operations (DPO) to SPO, a new method for sustaining safe flights must be adopted. This thesis aims to develop a system to monitor pilots and accurately identify off-nominal statuses in real time. b. Methodology i. The researcher performed various experiments on trained pilots in simulators. They collected neurophysiological data such as EEG and eye movements. In some experiments, the scenario was transitioned from DPO to SPO to investigate how the neurophysiological data changes. The data was then cleaned and analyzed c. Findings i. The primary finding reported here is that using, analyzing, and modeling this data type is a valid way to identify risky flight behaviors. The researcher claims an accuracy of up to 92.86%. ii. A few other conclusions worth mentioning are that visual behaviors were pronounced during SPO, meaning the pilots were fixated on single points, especially during emergencies. Additionally, human error was more likely during SPO, and pilots reported feeling more stressed. d. Relevancy i. This thesis directly supports the need for the technology we are roadmapping. The author provides the context surrounding the shift to SPO, and the risks associated with this transition. Additionally, the research suggests it is feasible to implement the strategy our technology demonstrates.

• Patents

1.) Eye Gaze Tracking – US Patent No. US11899837B2 – CPC G06F a. The Eye Gaze patent shows a new way to detect and track eye gaze. The primary components of the patent are a visible wavelength camera, an infrared camera, and processors. It works by using the IR cameras to develop a 3D point cloud of a person’s face. It also creates a 2D image of the face with the visible wavelength camera. The processors take this data and create symmetry planes, which can be used to determine where the person is looking. b. This technology is relevant because the publication review suggested that eye-tracking is a great indicator of pilot status. However, wearing devices that obstruct vision or could bounce around during flight is not ideal. This technology addresses both of those concerns.

2.) Smart Ring System for Monitoring Sleep Patterns And Using Machine Learning Techniques To Predict High-Risk Driving Behavior – US Patent No. US12077193B1– CPC B60W a. The patent above is for a smart ring that monitors sleep patterns in users and predicts high-risk behaviors through machine learning. The device is a ring, similar to an Oura ring, that tracks HR/HRV, body temperature, motion, etc. This data can be used in conjunction with vehicle data to predict high-risk behavior. b. While this patent is centered around sleep and performance of an automobile driver, the general concept can be applied in other domains. It shows that small, non-obstructive devices can be used to collect data, transmit data, and inform models that could improve people's performance in control of transportation systems.

3.) Systems And Methods for Monitoring Pilot Health – US Patent No. US20190090800A1– CPC A61B a. This patent outlines a system for monitoring the health of a pilot and status of the aircraft. It also contains a way to analyze the pilot status and interface with them. Lastly, this patent also includes an actuator to take control of the aircraft if necessary. b. This patent is incredibly relevant as it is nearly identical to our technology with a few exceptions. The main difference is our technology aims to provide biofeedback to get the pilot back into normal operating conditions. In contrast, this patent utilizes a robot-pilot to manually control the aircraft in an emergency. The process up until that point is nearly identical.