『Embodied AI 101』のカバーアート

Embodied AI 101

Embodied AI 101

著者： Shaoqing Tan
無料で聴く

Stay in the loop on research in AI and physical intelligence.© 2026 Shaoqing Tan 科学
エピソード
  • HexaShell: Can Debugging Code Generalize RGB Robot Manipulation?

    HexaShell: Can Debugging Code Generalize RGB Robot Manipulation?
    2026/10/19
    Can a robot improve at manipulation by debugging code instead of updating neural-network weights? This episode explains how HexaShell turns robot experience into reusable tools, and what its RoboDojo score actually establishes. We cover three questions: how calibrated RGB observations become metric positions; why the reported 39.7% success rate uses category-balanced scoring; and how holding out layouts differs from holding out tasks. The experiments use a simulated dual-arm ARX X5 with head and wrist cameras, camera calibration, and proprioception. Along the way, we connect the design to Code as Policies and URAI, examine an inspectable geometric helper, and separate tool development from execution with frozen tools. The central limitation is a mismatch in task-level learning conditions: HexaShell develops tools on tasks in a category that RoboDojo's published training split reserves for transfer. For researchers building language-driven manipulation systems, the episode offers a concrete way to think about code as learned policy state. If software is part of what a robot learns, where should the training boundary be drawn — and what would convincing generalization look like?
    続きを読む 一部表示
    12 分
  • Niantic Spatial Gaussian Splats: Better Sim-to-Real Robot Training?

    Niantic Spatial Gaussian Splats: Better Sim-to-Real Robot Training?
    2026/10/19
    Niantic Spatial's Places Library is the starting point for this episode of Embodied AI 101, which examines how Gaussian splatting, aligned collision meshes, and existing simulation tools fit together, why visual realism and physical correctness must be assessed separately, and what those differences mean for teams building robot navigation systems for real warehouses and other deployment sites. We unpack the evidence behind reconstruction quality and sim-to-real transfer, examine the reported office-navigation comparisons, and turn the technical details into a practitioner's checklist covering downloadable assets, licensing, reproducibility, simulator integration, mesh defects, lighting variation, and the engineering work required to turn a captured place into a useful policy-training environment. Rather than treating an attractive demo as proof of general-purpose autonomy, we ask how to compare this workflow fairly with synthetic environments, where site-specific specialization might be valuable, and which measurements would justify adding it to a production training stack—so what would a convincing held-out warehouse evaluation actually need to demonstrate?
    続きを読む 一部表示
    12 分
  • Gemini 4 Argon for Robotics: What the Benchmarks Actually Show

    Gemini 4 Argon for Robotics: What the Benchmarks Actually Show
    2026/10/19
    This episode of Embodied AI 101 examines Google's Gemini 4 Argon robotics announcement, separating the demonstrated workflows from the broader promise by tracing how a calibrated camera view becomes a numerical motion command, why an ERQA score is not a manipulation success rate, and where a hosted reasoning model might fit alongside an existing robot controller and its safety mechanisms. We examine the reported sim-to-real improvement in a downstream VLA, the difference between a visually convincing digital twin and a model that predicts contact, the evidence practitioners can inspect or rerun, and independent Robocurve measurements that put latency and partial-credit scoring at the center of the deployment discussion rather than treating stronger reasoning as sufficient evidence of useful physical performance. For roboticists considering a pilot, which experiments, safety boundaries, held-out tasks, and reproducibility artifacts would justify trusting this approach beyond a curated demonstration—and could Argon's biggest near-term contribution be helping engineers build the simulations and training data behind the robot rather than controlling it directly?
    続きを読む 一部表示
    12 分
adbl_web_anon_alc_button_suppression_t1
まだレビューはありません