Global AI, Malaysia Angle / AI news for Malaysia
Google adds Guided Vision to Gemini Live for blind and low-vision Android users
Google's new camera-sharing mode describes surroundings aloud and coaches users to reframe their shot. It is not a mobility aid, and Google has not said which languages beyond those already in Gemini Live are covered.

In brief
- Google launched Guided Vision in Gemini Live on 1 October 2026 for Android 9 and above. Users share their camera and hear descriptions and spoken cues to reframe.[1]
- Google says it is not a medical device or mobility aid, and not for navigation or obstacle detection.[1]
- Malaysia's statistics department counted 68,665 registered people with visual impairment in 2024. Malay support is unconfirmed.[3][2]
What Google announced
Google has begun rolling out Guided Vision, a feature of Gemini Live that gives real-time spoken help to people who are blind or have low vision. Announced on 1 October 2026, it lets a user share their phone camera, hear a description of what it sees, and ask follow-up questions.[1]
Google says the tool was built with the blind and low-vision community. It adds that Guided Vision can also help older adults, people with low literacy and anyone reading fine print in poor light. The post gives no usage figures and no independent test results.[1]

How Guided Vision works
Guided Vision runs inside Gemini Live. When the camera is pointed too high, too close or off to one side, Gemini gives spoken prompts, such as asking the user to pan right, tilt down or step back, so it can see enough to answer. Google describes this as a conversation rather than a one-off photo description.[1]
Google lists everyday uses: reading small nutrition labels, appliance dials and printed menus in dim restaurants, finding a dropped earbud in a crowded cabinet, checking whether colours and patterns match, and surveying an unfamiliar room. It says conversations work across multiple languages.[1]

Built and tested with Aira
Google says it partnered with Aira, which supplied visual interpretation data covering tens of thousands of hours to train Gemini Live for real-world context. More than 1,000 members of Aira's Trusted Tester network helped stress-test the feature across daily routines.[1]
Aira specialists also worked with Google as subject-matter experts to help set and evaluate safety guardrails. Google says feedback came from blind and low-vision communities in India, Brazil, Singapore, Indonesia, Japan and other places. Malaysia is not named. Google does not say how many people took part beyond that network.[1]
The limits Google states
Google is blunt about the limits. It says Guided Vision can make mistakes and is not a medical device, a mobility aid or a replacement for a white cane. It is not intended for navigation, safe-travel guidance or obstacle detection, and users should keep relying on established mobility aids.[1]
That matters for reading labels. Our reading is that a wrong guess about a medicine strength or expiry date carries different consequences from a wrong guess about a shirt colour. Google gives no accuracy rate for any task, so important details are best checked with a family member or a pharmacist.[1]
Where it runs and how to turn it on
Guided Vision is available on Android 9 and above, in the regions and languages where Gemini Live is supported, with updated Gemini and Android software. In the Gemini app, users open profile settings, switch on Use Guided Vision in Live, then share the camera in Gemini Live.[1]
Google also offers a shortcut under Android Settings, Accessibility, Vision assistance, using the floating accessibility button, a two-finger swipe or both volume keys. TalkBack users can open it with a three-finger tap. The post lists no price and does not say whether a paid Gemini plan is needed.[1]
What it means in Malaysia
The Department of Statistics Malaysia reported 805,509 registered persons with disabilities in 2024, or 2.4% of the population. Of those, 68,665 were registered with visual impairment. The Social Welfare Department, which runs OKU registration, says the visual category must be certified by an ophthalmologist.[3][4]
Google's help page lists Malaysia as a supported country for the Gemini app on Android, and lists Malay with a note that it lacks Hey Google voice commands and some action features. It does not say whether Gemini Live, and so Guided Vision, works in Malay. Try it on real, often multilingual, Malaysian packaging before relying on it.[2]
Why Malaysia should care
Malaysia counted 68,665 registered people with visual impairment in 2024. Google has not said whether Guided Vision works in Malay.
What Malaysians can do now
- Update the Gemini app and Android, then test Guided Vision on low-risk items such as a menu or a tin label, in your own languages.
- Do not rely on it for navigation, crossing roads or medicine doses. Google says it is not designed for them.
- Disability groups and carers should note where it fails on Malay, English or Chinese labels and share that with Google.
What we still do not know
What we still do not know
- Whether Gemini Live, and so Guided Vision, supports Malay, and when it reaches Malaysian devices.
- How accurate the tool is on different tasks, since Google published no figures.
- How camera images shared during a session are stored or used, and whether a paid plan is needed.
Sources
- 1.Guided Vision in Gemini Live: built for accessibility Google, 1 October 2026
- 2.Gemini mobile app availability: Android Gemini Apps Help, Google
- 3.Person With Disability Statistics, Malaysia, 2024 Department of Statistics Malaysia, 11 December 2025
- 4.Pendaftaran Orang Kurang Upaya (OKU) Jabatan Kebajikan Masyarakat
- 5.File:Braille signs at Brisbane Square Library P1450037.jpg Wikimedia Commons, 31 August 2016
- 6.File:Person holding smartphone with camera app open while sitting outdoors on a sunny day, focused on taking a picture of the scene.jpg Wikimedia Commons, 1 March 2026
- 7.File:Audio describer in live theater.jpg Wikimedia Commons, 22 April 2013


