AI components, whether traditional machine learning or generative AI, are embedded in many present-day systems. However, despite advances in automation, infrastructure, and tooling for developing AI components, many do not leave the prototype stage or reach production because they fail to meet overall system quality expectations. In our latest podcast from the Carnegie Mellon University Software Engineering Institute, Rachel Brower-Sinning and Robert Edman, both machine learning scientists in the SEI's Tactical Edge and AI-Enabled Systems Initiative, sit down with Grace Lewis, the initiative's lead and an SEI principal researcher, to discuss a quality model for machine learning components to support their proper testing and evaluation. The research team that developed the model also included Alex Derr, Sebastián Echeverría, and Ipek Ozkaya from the SEI, and, from Carnegie Mellon University, Kate Maffey. Colin Beaudoin, a PhD intern at the SEI in the summer of 2025 who is now an assistant professor at Fairfield University, also worked on the model.

The recent explosion in large language model (LLM) technology has highlighted the challenges of using public generative artificial intelligence tools in classified environments, especially for software analysis. Currently, software analysis falls on the shoulders of static analysis tools and manual code review, which tend to provide limited technical depth and are often time-consuming in practice. In our latest podcast from the Carnegie Mellon University Software Engineering Institute (SEI), Ryan Karl, an SEI embedded engineer, and John Robert, deputy director of the SEI's Software Solutions Division, discuss their work on using LLMs in unclassified environments to rapidly develop tools that accelerate software analysis in classified environments with improved accuracy for certain software analysis tasks.

Software-defined warfare is today's reality for national security, shifting the emphasis in military operations from hardware to software. In the latest podcast from the Carnegie Mellon University Software Engineering Institute, SEI director Paul Nielsen recently sat down with Matthew Butkovic, technical director of Risk and Resilience in the SEI's CERT Division, to discuss the evolution of software-defined warfare and the ways in which software engineering practices can meaningfully address the challenges of implementing software on the battlefield.