Machine Learning for Safety-Critical Applications: Opportunities, Challenges, and a Research Agenda (2025)

Chapter: 3 System Engineering with Machine Learning Components for Safety-Critical Applications

Previous Chapter: 2 State of the Art, Promises, and Risks of Machine Learning
Suggested Citation: "3 System Engineering with Machine Learning Components for Safety-Critical Applications." National Academies of Sciences, Engineering, and Medicine. 2025. Machine Learning for Safety-Critical Applications: Opportunities, Challenges, and a Research Agenda. Washington, DC: The National Academies Press. doi: 10.17226/27970.
Page 46
Suggested Citation: "3 System Engineering with Machine Learning Components for Safety-Critical Applications." National Academies of Sciences, Engineering, and Medicine. 2025. Machine Learning for Safety-Critical Applications: Opportunities, Challenges, and a Research Agenda. Washington, DC: The National Academies Press. doi: 10.17226/27970.
Page 47
Suggested Citation: "3 System Engineering with Machine Learning Components for Safety-Critical Applications." National Academies of Sciences, Engineering, and Medicine. 2025. Machine Learning for Safety-Critical Applications: Opportunities, Challenges, and a Research Agenda. Washington, DC: The National Academies Press. doi: 10.17226/27970.
Page 48
Suggested Citation: "3 System Engineering with Machine Learning Components for Safety-Critical Applications." National Academies of Sciences, Engineering, and Medicine. 2025. Machine Learning for Safety-Critical Applications: Opportunities, Challenges, and a Research Agenda. Washington, DC: The National Academies Press. doi: 10.17226/27970.
Page 49
Suggested Citation: "3 System Engineering with Machine Learning Components for Safety-Critical Applications." National Academies of Sciences, Engineering, and Medicine. 2025. Machine Learning for Safety-Critical Applications: Opportunities, Challenges, and a Research Agenda. Washington, DC: The National Academies Press. doi: 10.17226/27970.
Page 50
Suggested Citation: "3 System Engineering with Machine Learning Components for Safety-Critical Applications." National Academies of Sciences, Engineering, and Medicine. 2025. Machine Learning for Safety-Critical Applications: Opportunities, Challenges, and a Research Agenda. Washington, DC: The National Academies Press. doi: 10.17226/27970.
Page 51
Suggested Citation: "3 System Engineering with Machine Learning Components for Safety-Critical Applications." National Academies of Sciences, Engineering, and Medicine. 2025. Machine Learning for Safety-Critical Applications: Opportunities, Challenges, and a Research Agenda. Washington, DC: The National Academies Press. doi: 10.17226/27970.
Page 52
Suggested Citation: "3 System Engineering with Machine Learning Components for Safety-Critical Applications." National Academies of Sciences, Engineering, and Medicine. 2025. Machine Learning for Safety-Critical Applications: Opportunities, Challenges, and a Research Agenda. Washington, DC: The National Academies Press. doi: 10.17226/27970.
Page 53
Suggested Citation: "3 System Engineering with Machine Learning Components for Safety-Critical Applications." National Academies of Sciences, Engineering, and Medicine. 2025. Machine Learning for Safety-Critical Applications: Opportunities, Challenges, and a Research Agenda. Washington, DC: The National Academies Press. doi: 10.17226/27970.
Page 54
Suggested Citation: "3 System Engineering with Machine Learning Components for Safety-Critical Applications." National Academies of Sciences, Engineering, and Medicine. 2025. Machine Learning for Safety-Critical Applications: Opportunities, Challenges, and a Research Agenda. Washington, DC: The National Academies Press. doi: 10.17226/27970.
Page 55
Suggested Citation: "3 System Engineering with Machine Learning Components for Safety-Critical Applications." National Academies of Sciences, Engineering, and Medicine. 2025. Machine Learning for Safety-Critical Applications: Opportunities, Challenges, and a Research Agenda. Washington, DC: The National Academies Press. doi: 10.17226/27970.
Page 56
Suggested Citation: "3 System Engineering with Machine Learning Components for Safety-Critical Applications." National Academies of Sciences, Engineering, and Medicine. 2025. Machine Learning for Safety-Critical Applications: Opportunities, Challenges, and a Research Agenda. Washington, DC: The National Academies Press. doi: 10.17226/27970.
Page 57
Suggested Citation: "3 System Engineering with Machine Learning Components for Safety-Critical Applications." National Academies of Sciences, Engineering, and Medicine. 2025. Machine Learning for Safety-Critical Applications: Opportunities, Challenges, and a Research Agenda. Washington, DC: The National Academies Press. doi: 10.17226/27970.
Page 58
Suggested Citation: "3 System Engineering with Machine Learning Components for Safety-Critical Applications." National Academies of Sciences, Engineering, and Medicine. 2025. Machine Learning for Safety-Critical Applications: Opportunities, Challenges, and a Research Agenda. Washington, DC: The National Academies Press. doi: 10.17226/27970.
Page 59
Suggested Citation: "3 System Engineering with Machine Learning Components for Safety-Critical Applications." National Academies of Sciences, Engineering, and Medicine. 2025. Machine Learning for Safety-Critical Applications: Opportunities, Challenges, and a Research Agenda. Washington, DC: The National Academies Press. doi: 10.17226/27970.
Page 60
Next Chapter: 4 A Research Agenda to Bridge Machine Learning and Safety Engineering
Subscribe to Email from the National Academies
Keep up with all of the activities, publications, and events by subscribing to free updates by email.