Google's AI can run a video consultation. Malaysia should treat it as research

A medical consultation is not just a transcript. A clinician watches how someone moves, listens to their breathing, notices visible discomfort and decides whether a physical examination is needed. Google Research is testing whether an AI system can process some of those signals during a live video call instead of relying only on typed questions and answers.[1]

Its new AMIE Video study is an important research result, but the most useful Malaysian reading is deliberately cautious. The sessions were simulations with patient actors. Google itself says real-patient validation and stronger safety frameworks are still needed, while Malaysia already has rules that put secure delivery, consent, professional responsibility and escalation ahead of convenience.[1][2][4]

AMIE stands for Articulate Medical Intelligence Explorer. Earlier versions focused on text-based diagnostic conversations. The new video configuration, built with Gemini and Project Astra, adds live audio and vision so the system can observe non-verbal cues and guide patient actors through simple virtual examination movements while continuing the conversation.[1]

Google's randomized study covered 100 scenarios across cardiopulmonary, abdominal, neurological or psychiatric, musculoskeletal, and head, eye, ear, nose and throat presentations. Fifteen trained patient actors completed 300 consultations across AMIE Video, a text-only AMIE baseline and primary-care doctors using video. Ten doctors conducted comparison consultations, while another 20 experienced primary-care physicians independently evaluated the sessions.[1][2]

Google says one model cannot yet talk naturally, reason deeply and continuously inspect video and audio without awkward delays. AMIE Video therefore separates the work. A Talker agent keeps the patient-facing exchange responsive, a Planner agent updates the differential diagnosis and clinical goals, and a Perception agent reviews visual and auditory signals that may matter to the case.[1]

In the study, clinical evaluators rated AMIE Video broadly on par with primary-care doctors for history-taking, diagnostic accuracy, management appropriateness and communication. Google also reports stronger scores for eliciting physical signs and guiding virtual examination manoeuvres, while patient actors preferred video to the text-only interface. These are comparisons inside one controlled study, not proof that the system can safely replace clinicians across routine care.[1][2]

Every participant playing a patient was an actor following a scenario. That makes cases comparable, but actors cannot reproduce the full uncertainty, mixed symptoms, medical histories and unexpected behaviour of real patients. The study also excluded conditions that could not be represented authentically through acting, which narrows how far its headline results can travel.[1][2]

Google reports occasional perception and reasoning errors as well as intermittent technical problems that disrupted conversational flow. It describes AMIE Video as an investigational research system and says studies involving real patients, real conditions and robust safety frameworks are essential next steps. Malaysians should read 'expert-level' as a performance result within the stated experiment, not as regulatory approval, local availability or permission to use an AI call for diagnosis.[1][3]

Malaysia's Ministry of Health says online healthcare should be delivered through specialised, secure platforms by appropriately registered professionals. Its 2025 guidance requires informed consent and allows a clinician to end or refuse an online session when a physical examination is needed, when the patient situation is unsuitable, or when internet and platform problems make the service unsafe. The public explainer also says ordinary WhatsApp, Telegram and Facebook Messenger channels are not acceptable substitutes for an official platform's secure tools.[4]

Local practice already reflects those limits. Universiti Malaya's primary-care teleconsultation service is designed mainly for chronic-condition monitoring and follow-up. It says emergencies, acute symptoms and complex physical examinations still require an in-person visit; first-time users provide written consent and must have periodic face-to-face care. Malaysia's MyVAS service also connects patients through MySejahtera. An AMIE-like system would therefore have to fit into a clinician-led pathway with identity, records, consent, security and escalation—not sit outside it as a public chatbot doctor.[7][6][5]