New Software Tools For Navigation, Health, Communication, And More Will Be Available To Users With Disabilities Later This Year
By Rashmi Goel
A new set of innovative software features was previewed by Apple, enabling users with disabilities to connect, navigate, and utilize Apple products in new and innovative ways. Using Apple's latest technologies, these updates provide unique and customizable tools for users and build on Apple's long-standing commitment to creating products that work for everyone.
People who are blind or have low vision can utilize their smartphones and tablets to navigate the last few feet to their destination with Door Detection; people with physical and motor disabilities can control their Apple Watch from their iPhone with Apple Watch Mirroring; and members of the deaf and hard-of-hearing community can follow Live Captions on iPhone, iPad, and Mac. The company is also adding support for more than 20 new languages and locales for its industry-leading screen reader VoiceOver. Users can access these features later this year via software updates across Apple platforms.
Users With Low Vision Or Blindness Can Use Door Detection
A new navigation feature, Door Detection, is now available for users who are blind or have low vision. Detection of doors can help users locate a door at their destination, determine how close they are, and describe attributes of doors - including if they’re open or closed, and if they’re closed, whether they can be opened by pushing, turning a knob, or pulling a handle. As well as reading signs and symbols around the door, Door Detection can also detect the room number at an office, or the accessibility symbol at an entrance. On iPhone and iPad models with the LiDAR Scanner, this new feature will combine LiDAR, camera, and on-device machine learning.
Within Magnifier, Apple's built-in app for blind and low vision users, there will be a new Detection Mode for door detection. Each of these tools can be used alone or in conjunction with People Detection and Image Descriptions in Detection Mode, giving users with vision disabilities a convenient place to navigate and access rich descriptions of their surroundings. Apple Maps will offer haptic and sound feedback to VoiceOver users to identify the starting point for walking directions in addition to navigation tools in Magnifier.
Enhancing Apple Watch's Physical And Motor Accessibility
With Apple Watch Mirroring, you can control your Apple Watch from your paired iPhone, making it easier for people with physical or motor disabilities to use Apple Watch. As an alternative to tapping the Apple Watch display, users can control Apple Watch using iPhone's assistive features, including Voice Control, Switch Control, and Head Tracking. They can also use voice commands, sound commands, and external Made for iPhone switches instead of tapping the Apple Watch display. Utilizing hardware and software integration, such as the AirPlay technology, Apple Watch Mirroring ensures users who rely on these mobility features can take advantage of unique Apple Watch apps such as Blood Oxygen, Heart Rate, Mindfulness, and more.
Apple Watch users can also use simple hand gestures to control the device. Double-pinch gestures on Apple Watch enable you to answer or end a phone call, dismiss a notification, take a picture, play or pause media in Now Playing, and start, pause, or resume a workout. The technology builds on AssistiveTouch on Apple Watch, which allows users with hand differences to operate the watch with gestures like pinching or clenching without having to tap the display.
The Apple iPhone, Ipad, And Mac Now Offer Live Captions For Deaf And Hard-Of-Hearing Users
Apple has introduced Live Captions for the Deaf and Hard of Hearing community on iPhone, iPad, and Mac. Whether a user is on a phone or FaceTime call, using a video conferencing or social media app, streaming media content, or having a conversation with someone nearby, they can follow along with audio content more easily. For ease of reading, users can also adjust the font size. Using FaceTime's Live Captions, auto-transcribed dialogue can be attributed to call participants, making group video calls easier for users with hearing impairments. Using Live Captions for Mac users is a simple way to type a response and have it read aloud to other participants in the call in real-time. The information used to generate Live Captions is private and secure since it's generated on the device.
Languages And More Are Added To Voiceover
Users will also be able to select new voices optimized for assistive features that are multilingual, such as Bengali, Bulgarian, Catalan, Ukrainian, and Vietnamese4. VoiceOver is Apple's industry-leading screen reader for blind and low vision users. Also included in Speak Selection and Speak Screen are the new languages, locales, and voices. As an added benefit, VoiceOver users on Mac can use the new Text Checker tool to discover common formatting problems such as duplicate spaces or misplaced capital letters, making it easier to proofread documents and emails.
The Following Features Are Included:
⦁ Buddy Controller allows users to ask a care provider or friend to help them play a game; it combines any two controllers into one, so multiple controllers can be driven by a single player.
⦁ Apple's Siri Pause Time feature, which allows users with speech disabilities to adjust the wait time before Siri responds to a request, is available to anyone.
⦁ The Voice Control Spelling Mode allows users to dictate custom spellings using letter-by-letter input.
⦁ A person's home's unique alarm, doorbell, or appliances can be recognized using Sound Recognition, which can be customized to recognize sounds specific to their home.
⦁ There will be new themes available for Apple Books, as well as customization options, such as bolding text and adjusting line, character, and word spacing for a more accessible reading experience.
World Accessibility Awareness Day
Apple celebrates Global Accessibility Awareness Day with special sessions, curated collections, and more:
⦁ Apple Store customers can now use SignTime to connect with American Sign Language (ASL) interpreters on-demand through the Apple Store and Apple Support. For customers in the US, the UK, and France, SignTime is currently available in American Sign Language (ASL), British Sign Language (BSL), and French Sign Language (LSF).
⦁ Apple Stores around the globe are offering live sessions throughout the week to help customers learn how to use iPhone accessibility features, and Apple Support social channels provide how-to content.
⦁ Apple Watch and Mac shortcuts will soon offer the Accessibility Assistant shortcut, which recommends accessibility features based on user preferences.
⦁ The trainer Bakari Williams highlights the accessibility features available to Apple Fitness+ users this week, such as Audio Hints, which are short verbal suggestions to support users who are blind or partially sighted, and time to walk episodes that become "time to put on a wheelchair" or "time to run episodes that put on a wheelchair". Fitness+ trainers also incorporate ASL into every workout and meditation, all videos include closed captioning in six languages, and trainers demonstrate modifications for users of varying skill levels.
⦁ The National Park Foundation has created Park Access for All, a new guide in Apple Maps that helps users discover accessible features, programs, and services in parks across the country. Businesses and organizations featured in Gallaudet University's Deaf, Hard of Hearing, and Deafblind guides respect, embrace, and prioritize the Deaf community and sign language.
⦁ Discover accessibility-focused apps and stories from app creators in the App Store; browse through the Transforming Our World collection in Apple Books, featuring stories by and about people with disabilities; and listen to Apple Podcasts to discover creative ways technology is advancing accessibility.
⦁ There will be a new Stylist playlist on Apple Music, a collection of playlists that each highlight a different sound. By choosing one and singing along, you can practice vocal sounds or speak more effectively.
⦁ Apple TV app will feature movies and TV shows that depict authentic representations of people with disabilities. As well as performing accessibility actors such as Marlee Matlin ("CODA"), Lauren Ridloff ("Eternals"), Selma Blair ("Introducing, Selma Blair"), Ali Stroker ("Christmas Ever After"), and others, guests have curated collections for viewers to enjoy.