be my eyes accessibility software for mobile devices which puts blind and partially sighted people on a live video call with a sighted guide, it will help Microsoft train its AI. Be My Eyes will provide anonymized video data to improve scene understanding in Microsoft’s accessibility-focused AI models.
The datasets provided by Be My Eyes to Microsoft include “unique objects, lighting and frames that realistically reflect the experiences of the blind and partially sighted community.” The goal is to make Microsoft’s artificial intelligence more accessible to people with visual impairments.
The companies state that all personal information is removed from the metadata. The data provided will not be used for any purpose other than advertising or training Microsoft’s AI models.
While this is Be My Eyes’ first such data partnership, it has worked with Microsoft before which includes Be my AI tool for Microsoft’s Disability Answer Desk. As the name suggests, Be My AI is the company’s GPT-4-powered spin on its assistance product. In this case, it helps visually impaired people navigate Office, Windows and Xbox applications.
Be my eyes too Signed a contract with Hilton earlier this month. In this case, hotel staff assist blind and partially sighted tenants with tasks such as adjusting thermostats, making coffee, and raising or lowering blinds. A previous 2023 collaboration between the two companies helped develop the Be My AI model.
