Learn more about the host Laurence Gill at: www.laurencegill.com

For twenty five years, software pricing has worked like flat-rate insurance: pay a fixed premium for the capacity you own, not for the value it delivers. AI agents just broke that model, and the fallout is bigger than a line item on your next renewal.

In this episode, Laurence Gill breaks down why AI agents are killing per-seat software pricing, and why what’s replacing it is really a risk-transfer mechanism in disguise. Drawing on principal-agent economics, a real vendor case where efficiency gains cost a company most of its recurring revenue, and two decades of federal IT audit experience, Laurence lays out exactly what leaders need to understand before signing their next AI vendor contract, including the four questions that determine who actually holds the risk when the system fails.

If you’re evaluating, renewing, or negotiating any AI agent contract this quarter, this episode gives you a framework for asking better questions than “how many seats do we need.

Learn more about the host Laurence Gill at www.laurencegill.com.

In Episode 12, Laurence Gill takes that number apart. A Stanford research team called BetterBench built a 46-point audit covering benchmark design, reproducibility, and documentation, then scored 24 widely-cited tests against it. MMLU came in at 5.5. GPQA, a far less publicized test, scored double that. The reasons are specific: ambiguous question phrasing that swings scores when a comma moves, a reproducibility gap across most published benchmarks, and a quiet contamination problem where models may have already seen the answer key buried somewhere in their training data.

Laurence walks through how these tests actually work, why Goodhart’s Law explains the industry’s race to game them, and how newer benchmarks like GPQA and ARC-AGI are trying to close the gap. It closes with five questions to run through before any benchmark score is allowed to inform a real decision and one open question about what happens when AI starts writing the tests that grade other AI.

Over 90 percent of U.S. employers now use AI to screen job applicants. And over 60 percent of the Fortune 100 runs that screening through the same vendor model. A 2026 study from Stanford, Chapman, and Northeastern Universities — the largest independent research ever conducted on deployed hiring algorithms, reveals what that concentration is actually doing to real people at scale.

Researchers analyzed 3.4 million applicants submitting 4 million applications across 156 employers and 11 market sectors. What they found is not a conventional bias problem. It's an architectural one. More than a quarter of all applications submitted by Black applicants landed in positions where the algorithm was actively producing adverse impact. 29,000 additional Asian applications would have moved forward in a fair system. And to statistically guarantee one interview, candidates in an algorithmic monoculture now need to submit 25 applications, two and a half times the number required in a human-driven system.

This episode breaks down how algorithmic monoculture works, why prior vendor studies missed the discrimination, what the disaggregated data reveals, and what a governance framework capable of addressing it actually looks like. Essential listening for every leader whose organization relies on AI in hiring or whose team members are navigating this market right now.

Every AI tool your team uses today runs on infrastructure most leaders have never been taught to think about. It’s called an API — and once you understand what it is, your entire mental model of what your team can actually do with AI right now is going to shift.

In this episode, Laurence breaks down the mechanism that connects your organization to world-class AI — no technical background required. You’ll learn what an API actually is, why the “menu contract” framing is the one that matters for decision-makers, and how a small team with the right knowledge can now access the same AI models powering enterprise products without a data science department or a six-figure infrastructure budget.

This episode covers:

— What an API is and why stability in that contract is everything

— The real reason your team can access world-class AI today — and what that means for what’s possible right now

— How to think about the major AI API providers — OpenAI, Anthropic, IBM Watson, Google Cloud, and SiliconFlow — and the decision logic for matching the right tool to your specific constraints

— What Hyrum’s Law is, why it applies directly to AI, and the governance question every leadership team needs to answer before building workflows on top of an AI API

If you have approved an AI tool for your team without understanding what’s running underneath it — this is the episode.

AI Literacy for Leaders is a podcast for executives, directors, and managers navigating real AI decisions without a technical background. New episodes weekly.

Did you know that Two-thirds of business leaders say they won't hire someone who lacks AI skills.

Only 39% of professionals know which AI skills they're supposed to develop.

That gap — between what organizations are demanding and what the workforce understands — is the most important career opportunity most leaders are ignoring.

Here's what's actually happening:

AI is not replacing experienced leaders. It is replacing leaders who haven't figured out how to deploy their experience deliberately.

The skills that got you to a leadership position — reading a room, making judgment calls in ambiguous situations, building trust under pressure — are not soft skills.

They are capabilities that the design of AI systems cannot replicate.

But they don't protect you passively. You have to claim them.

Episode 9 of AI Literacy for Leaders is about professional experience as a structural advantage, not as a reassuring idea, but as an architectural reality.

There is a technical role spreading through enterprise hiring right now that most executives have never heard of. It is not a data scientist. It is not a prompt engineer. It is a generative AI engineer — and understanding what one of these people actually builds is one of the most important things a non-technical leader can do right now.

In this episode, Laurence Gill breaks down what a gen AI engineer actually does: the validation layers, the orchestration loops, the drift monitoring, and the accountability structure that determines who is legally and ethically responsible when an autonomous AI system causes harm. Plus — four questions every leader should ask before any production AI system goes live.

Learn more about Laurence at: www.laurencegill.com

Every AI strategy meeting has a translation problem. Leaders are approving systems, signing contracts, and setting policy based on terms they’ve never had defined for them. The vendor speaks. The room nods. The decision gets made and somewhere in the middle, something critical got lost.

This episode fixes that. Not with a glossary. By walking through exactly how an AI interaction works, from the moment you send a prompt to the moment something goes wrong and naming the five terms that reveal what your organization is actually authorizing.

Tokens: the billing unit nobody explained. Context Window: the hard memory limit that silently drops what doesn’t fit. Temperature: the confidence dial that has nothing to do with accuracy. AI Slop: what comes out the other end when the first three are misaligned. And Prompt Injection: the attack that works because someone outside your organization understands these systems better than your leadership team does.

The episode closes with a five-question Boardroom Readiness Diagnostic, one question per term, designed to be asked before your next AI procurement or deployment review.

If you haven’t listened to Episode 3, that episode covers AI hallucinations in depth — start there if that term is still unfamiliar.

In this episode, Laurence Gill breaks down the two core failure patterns behind most enterprise AI deployments that don’t deliver: ROT data — the redundant, obsolete, and trivial information making up 30 to 50% of most organizational data environments — and the Demo-to-Reality Gap, the structural disconnect between flawless pilot performance and real-world failure. He closes with three diagnostic questions every leader can bring to their next meeting, before the next contract is signed.

No technical background required. Just the framework you need to make a better decision.

About the Host

Laurence Gill is a federal IT leader with over 20 years managing technology programs across the U.S. government. He is a doctoral candidate in cybersecurity and a published author on federal IT and cybersecurity topics. He also holds BS from UNC Chapel Hill and an MS from Carnegie Mellon University.

AI Literacy for Leaders is an extension of the workforce development work he has done for years — training youth and adults in financial literacy, cybersecurity, and emerging technology through community programs in Washington, D.C. The mission is the same: make complex, high-stakes knowledge accessible to the people who need it most.