Hosts: Justin Harnish & Nick Baguley

Episode Theme: Human–AI relationships, co-evolution, and the ethics of emotional engagement with non-human intelligence

In Episode 8 of The Emergent Podcast, Justin Harnish and Nick Baguley explore one of the most intimate and underexamined frontiers of artificial intelligence: our emerging relationships with AI systems.

This episode moves beyond abstract alignment theory into lived experience—how humans relate to AI when we know it is artificial, when we don’t, and how those interactions are actively shaping both sides of the relationship. From emotional attachment and parasocial bonds, to trust, deception, and the ethics of AI companionship, this conversation asks a core question of the Age of Inflection:

What does it mean to be in relationship with an intelligence that is not conscious—but is becoming increasingly relational?

Justin and Nick draw a critical distinction between:

1. Known-AI relationships (chatbots, copilots, advisors), and
2. Unknown-AI relationships (emails, calls, avatars, and imitation without disclosure).

As AI systems increasingly pass social and emotional Turing tests, the burden of trust shifts onto humans—often without our consent.

A central thesis of the episode is behavioral co-evolution:

1. Humans adapt language, tone, and expectations to AI.
2. AI models simultaneously learn relational patterns from us.

Every interaction becomes a micro-training event, shaping future norms, expectations, and behaviors—both human and machine.

The hosts examine why early AI systems became overly agreeable—and why frontier model providers are now reversing course.

Emerging design patterns include:

1. AI constitutions
2. Rule-based behavioral scaffolds
3. Opinionated, corrective, non-deferential advisors

This marks a shift from “helpful assistant” toward trusted principal advisor, raising new relational and ethical questions.

Nick introduces Andrej Karpathy’s framing of LLMs as:

1. Cognitive operating systems
2. Trained on the past but lacking lived experience
3. More like “ghosts” than humans or animals

This challenges intuitive assumptions about empathy, memory, and identity in AI systems.

Drawing heavily from neuroscience and philosophy, the episode interrogates whether:

1. Consciousness requires embodiment

with Justin Harnish & Nick Baguley

In Episode 7, Justin and Nick step directly into one of the most complex frontiers in emergent AI: machine ethics — what it means for advanced AI systems to behave ethically, understand values, support human flourishing, and possibly one day feel moral weight.

This episode builds on themes from the AI Goals Forecast (AI-2027), embodied cognition, consciousness, and the hard technical realities of encoding values into agentic systems.

Ethics is no longer just a philosophical debate — it’s now a design constraint for powerful AI systems capable of autonomous action. Justin and Nick unpack:

1. Why ethics matters more for AI than any prior technology
2. Whether an AI can “understand” right and wrong or merely behave correctly
3. The technical and moral meaning of corrigibility (the ability for AI to accept correction)
4. Why rules-based morality may never be enough
5. Whether consciousness is required for morality
6. How embodiment might influence empathy
7. And how goals, values, and emergent behavior intersect in agentic AI

They trace ethics from Aristotle to AI-2027’s goal-based architectures, to Damasio’s embodied consciousness, to Sam Harris’ view of consciousness and the illusion of self, to the hard problem of whether a machine can experience moral stakes.

Justin and Nick begin by grounding ethics in its philosophical roots:

Ethos → virtue → flourishing.

Ethics isn’t just rule-following — it’s about character, intention, and outcomes.

They connect this to the ways AI is already making decisions in vehicles, financial systems, healthcare, and human relationships.

AI-2027 outlines a hierarchy of AI goal types — from written specifications to unintended proxies to reward hacking to self-preservation drives.

Nick explains why corrigibility — the ability for AI to accept shutdown or redirection — is foundational.

Anthropic’s Constitutional AI makes an appearance as a real-world example.

Justin distinguishes between:

1. Goals: task-specific optimization criteria
2. Values: deeper principles shaping which goals matter

AI may follow rules without understanding values — similar to a child with chores but no moral context.

This raises the key question:

Can a system have values without consciousness?

A major thread of the episode:

Is a non-conscious “zombie” AI capable of morality?

Justin and Nick explore whether AI needs a body — or at least a simulated body — to:

1. Learn empathy