『Run the Model Yourself: A Clinician’s Guide to Local AI』のカバーアート

Run the Model Yourself: A Clinician’s Guide to Local AI

Run the Model Yourself: A Clinician’s Guide to Local AI

無料で聴く

ポッドキャストの詳細を見る
This one is a roundtable no guest, just the three of us. Dr. Junaid Kalia sits down with co-hosts Ed Marx and DR GPT™ Harvey Castro for a hands on, slightly geeky conversation about something most clinicians have never been told they can do: run capable AI models yourself, on your own hardware, without ever sending a patient’s data to someone else’s cloud.It starts with a provocation Junaid running a local model on a $2,000 Mac at ~100 tokens/second and asking why he’d keep paying Azure for the privilege. From there the three of them walk through the whole terrain: why Harvey now updates his emergency medicine book with an AI agent every month, what “edge vs. near-edge vs. far-edge” actually means, whether an Apple laptop can really keep pace with a data center, and the uncomfortable catch that the best cheap open models right now come out of China, which opens a security and standards question the U.S. hasn’t answered. They close on the part that matters most in medicine: what a model can never show the FDA, and why a rural clinic with no road to it might be the best argument for local AI there is.What You Will Discover:[00:00] A $2,000 Mac at ~80–100 tokens/second (why bother going local?)[00:28] Welcome + why write a book when an AI can rewrite it every month[01:37] Who the book is really for: patients (and why the ER is a lot of people’s primary care)[02:34] 13 minutes with your doctor, how AI fills the gap (and visits trending down)[03:08] The home setup: 3 Macs, 128 GB unified memory, one tailnet[03:30] The model onslaught: what you can run for free (routers, Qwen, Kimi K2)[04:09] Edge, near-edge, or cloud, where should the model actually run?[05:00] Can an Apple laptop out-run a data center? (Apple Silicon + MLX + Core ML)[05:30] The catch: the best cheap models are Chinese and who then owns the standard[06:37] Boeing vs. Airbus: the same fight, now national, now for AI[07:11] What a model can never show the FDA (SBOM + prompt injection)[08:15] The rural clinic more advanced than any academic center[09:19] Three things you can do with AI todayReferenced in the show:🖇️ DR GPT™ Harvey Castro’s AI in Emergency Medicine book + the “Pivot or Perish” series — https://www.harveycastromd.com/🖇️ Open-weight model families discussed: Qwen (Alibaba), Kimi K2 (Moonshot AI), DeepSeek🖇️ Apple MLX + Core ML on Apple Silicon; Tailscale for a private multi-Mac “tailnet”🖇️ Inkling (referenced by Junaid) — a fine-tuning/infrastructure approach for bring-your-own-data models🖇️ Signal & Symptoms Ep 38 — “Why Will Digital Twins Change the Way We Treat Patients?”Connect with us:Dr. Junaid Kalia, Neurocritical Care Specialist and Founder of SaveLife.AI™ (host)💼 LinkedIn — https://www.linkedin.com/in/junaidkaliamd 🔗 Website — https://www.junaidkalia.com/ 📹 YouTube — https://www.youtube.com/@junaidkaliamdEdward Marx, CEO, Advisor (co-host)💼 LinkedIn — https://www.linkedin.com/in/edwardmarx/ 🔗 Website — https://www.marxadvisory.com/ 📹 YouTube — https://www.youtube.com/@EdwardMarxDR GPT™ Harvey Castro, ER Physician, #DrGPT™ (co-host)💼 LinkedIn — https://www.linkedin.com/in/harveycastromd/ 🔗 Website — https://www.harveycastromd.com/Visit our website: https://signalandsymptoms.com/Get advisory insights about Healthcare AI — at zero cost: https://junaidkaliamd.substack.com/Medical disclaimer: This conversation is for general informational purposes and is not medical advice. Listening does not create a doctor–patient relationship. The tools and models discussed are general-purpose technology, not cleared medical devices; nothing here is an endorsement of any specific vendor or model for clinical use. Do not enter protected health information into consumer AI tools.
adbl_web_anon_alc_button_suppression_t1
まだレビューはありません