Hey! I'd love to hear your thoughts, send me a voice note.

Artificial intelligence can explain quantum physics, write software, analyze thousands of documents, and reason through complex problems.

Then you start a new conversation...

and it may not remember what happened yesterday.

So what does it actually mean for an AI to remember?

In Episode 10 of Zero to Singularity, we explore one of the most important problems standing between today’s AI assistants and truly persistent intelligent agents: long-term memory.

We break down the difference between a model’s learned parameters and its context window, why a huge context window is not the same as permanent memory, and how modern AI systems use retrieval, embeddings, vector databases, summaries, and external memory stores to preserve information across time.

Then we go deeper.

How should an AI decide what is worth remembering? How does it know when a memory is outdated? What happens when two memories contradict each other? Can an AI learn from experience without retraining its entire neural network? And how can it keep learning without suffering catastrophic forgetting gaining new knowledge while damaging what it already knows?

We explore:

context windows, working memory, episodic memory, semantic memory, retrieval-augmented generation, vector databases, agent memory, continual learning, catastrophic forgetting, memory compression, personalization, privacy, memory poisoning, and the possibility of AI systems that accumulate experience over months or even years.

Hey! I'd love to hear your thoughts, send me a voice note.

Modern AI was built on an extraordinary resource: human knowledge.

Books. Websites. Research papers. Code. Images. Video. Conversations. Billions upon billions of examples created by people.

But what happens when frontier models have already consumed most of the useful, accessible human-generated data?

In Episode 9 of Zero to Singularity, we investigate one of the biggest questions facing the next generation of artificial intelligence: Can AI keep improving if high-quality human training data becomes a bottleneck?

This episode explores:

• how pretraining data powers modern AI
• scaling laws and diminishing returns
• the difference between more data and better data
• synthetic training data
• self-play and automated curriculum generation
• reinforcement learning and verifiable tasks
• model-generated reasoning examples
• simulation and virtual environments
• multimodal data from video, audio, robotics, and sensors
• proprietary and expert-generated datasets
• inference-time scaling and test-time compute
• retrieval, tools, agents, and external memory
• model collapse and synthetic-data contamination
• why AI-generated internet content could become a training problem
• whether machines can eventually generate their own useful learning experiences

We also examine some of the biggest claims surrounding the future of AI training:

Is the internet running out of useful data? Can synthetic data replace human-created knowledge? Does training on AI-generated content inevitably cause model collapse? Can self-play generate effectively unlimited training material? And could future AI systems eventually design their own increasingly difficult curriculum?

The deeper question is no longer simply:

How much human knowledge can AI absorb?

It may become:

Can intelligence eventually create the experiences it needs to make itself smarter?

Hey! I'd love to hear your thoughts, send me a voice note.

What happens when artificial intelligence stops living only on screens and starts acting in the physical world?

In Episode 8 of Zero to Singularity, we explore Physical AI the convergence of advanced AI, robotics, and embodied intelligence.

We break down how modern robots are learning to see, understand instructions, manipulate objects, move through unfamiliar environments, and connect language with physical action. We also examine why teaching a machine to operate safely and reliably in the real world may be far harder than teaching an AI to generate text, code, images, or plans.

This episode explores:

• embodied AI and robotics foundation models
• vision-language-action systems
• humanoid robots versus specialized machines
• reinforcement learning and imitation learning
• teleoperation, simulation, and synthetic data
• dexterity, locomotion, spatial reasoning, and force control
• the robotics data problem
• why impressive demos do not automatically equal reliable deployment
• safety, recovery, and human supervision
• the economics of physical automation
• factories, warehouses, and the much harder challenge of the home
• what Physical AI could realistically look like by 2030

The central question:

Was language actually the easy part?

Because in software, intelligence only has to produce the right answer.

In robotics, intelligence has to survive reality.

Zero to Singularity explores artificial intelligence from the fundamentals to the frontier making complex technology understandable without oversimplifying the science.