Mosen Consulting: Seeing AI, my pick for the best iOS app of 2017

Mosen Consulting: Seeing AI, my pick for the best iOS app of 2017

Good awesome morning campbellsworld visitors and readers everywhere.
This morning I have something to share with you that I’d have never known of if I did not follow Mosen Consulting.

Before I go any further let me say that the reason I am copying this post is because Jonathan’s blog doesn’t have a PressThis button, and I want everyone to know about this.

I recommend anyone using Apple products who is sight impaired follow him.

Honestly, I think anyone using Apple products would be smart to follow him.

So, I’ve left all the info intact.

I would do that anyhow though, because, it is the correct thing to do.

If you do subscribe to his blog newsletter, etc. Please let him know you heard of him from campbellsworld.wordpress.com

And now, the best news of the year!

Jonathan Mosen posted: “A long time ago, and it almost seems like it was in a galaxy far, far away because times were so different, I encountered my first Kurzweil Reading Machine. It was about the size of a washing machine, lived in its own dedicated room at the school for the ”

New post on Mosen Consulting

Seeing AI, my pick for the best iOS app of 2017
by Jonathan Mosen

A long time ago, and it almost seems like it was in a galaxy far, far away because times were so different, I encountered my first Kurzweil Reading Machine.
It was about the size of a washing machine, lived in its own dedicated room at the school for the blind with a special electrostatic mat, and it sounded like a jet engine when it booted up.
As a child, I remember having a giggle at one of the demonstration documents that came with this wonderous monstrosity, which said, “I can read X rated books, but I don’t get excited about them”.
That same document, highlighting the capabilities and limitations of this device costing tens of thousands of New Zealand dollars at the time, warned that reading handwritten material was beyond the machine’s capabilities.
Over the years, the reality of Moore’s Law, which Ray Kurzweil has spoken so entertainingly about in numerous presentations, has meant that the accuracy, speed and capabilities of that initial huge device have both improved and shrunk, to the point that something far more powerful is now on my iPhone.
And yesterday, another barrier came down. As someone who has been using assistive technology for around 40 years, it was a special, and deeply moving moment to download an app that, at long last, could recognise handwriting and speak it back to me as a totally blind person.
Not only has this technology experienced a massive power increase and a remarkable size decrease, the price has gone down to 0.
The release of version 2.0 of Microsoft’s Seeing AI app, in only the first year of its availability is a triumph for the company, and particularly for those involve in its creation.
On Mosen Consulting’s podcast, The Blind Side, I interviewed Seeing AI’s creator, Saqib Shaikh.
Saqib is one of us. He’s a blind guy who has grown up using assistive technology and has seen it evolve. First-hand, he experiences the challenges we face in a world full of visual information, be it printed text, handwritten text, colour, lighting or photos. As one of their employees, Microsoft gave him the space and the resources to dream of innovative solutions to complex problems, to consider practical applications of emerging technologies that will meet the challenges we encounter.
There are a couple of take-aways from this. First, if you’re a young person thinking about career options, it can be rewarding to shape the future in some way. Whether it be through coding, product management, or some other field in this industry, if you can take a step back and think to yourself, “I was able to make a difference”, that’s a special and worthwhile thing. Saqib is just one of several blind people doing just that, and I salute them all.
Second, remarkable things occur when a company offers some space for talented coders to brainstorm and dream. Well done to Microsoft for providing that space.
The feature set of the Seeing AI app is impressive. But what also makes this app so good is that its user interface is elegant, optimised to suit its end users.
As a trainer, I’ve seen many totally blind people struggling with any app that uses the camera. Perhaps part of this is psychological. The idea that blind people can make practical use of something as visual as a camera doesn’t compute for some. Seeing AI’s clear documentation and narrated video tutorials give the user confidence. Without being patronising, they clearly explain the relationship between the size of objects and the distance a camera needs to be from an object.
The “getting warmer” method employed to detect barcodes means that many who gave up on other barcode-detection solutions in iOS are up and running. The picker item to navigate between channels is simplicity itself.
In the episode of The Blind Side Podcast in which I interviewed Saqib, I also demonstrated the feature set of the Seeing AI app as it was then. But I’ve product managed, written about, and used enough assistive technology to know that what really counts is whether people find a place for a piece of assistive technology when all the hubbub has died down. For me, there is no question, Seeing AI very quickly became one of the most important apps on my iPhone. It has pride of place on the first page of apps, where I keep the apps I use daily.
Here are just a few of the ways I have used the app.
The short text feature, which is the default channel when one launches the app, has made life so much simpler. When the printed mail arrives, what could be simpler than hovering the camera above the envelope to know whether the mail is something that needs to be open, or junk mail that can be sent straight to the big round file.
Often, opening the mail and hovering the camera above the printed page is sufficient to glean the information necessary. But if not, the Document channel gives me voice guidance to ensure I have the entire document in the camera’s view, then the app takes a picture. To add icing on the cake, Seeing AI then attempts to intelligently format the resulting text, meaning that key parts of the page are often navigable by heading.
Short text is useful for much more than words on a page. I use it to read information on a range of displays. A couple of weeks ago, the Sony Bravier smart television I demonstrated on The Blind Side Podcast back in April required a software update. Like many such devices, when it’s being updated, a blind person receives no accessible indication that the update is even taking place, let alone how far through the update the device is. Having waited a while and grown concerned about the time the update was taking, I got the bright idea of getting Seeing AI on the job. The Short Text channel read the screen clearly, letting me know that the update was still proceeding. It even left me in no doubt when the TV was rebooting.
When shopping arrives, we regularly use a combination of the short text channel and the barcode channel to identify boxes and cans that might be ambiguous. Thanks, Seeing AI, for ensuring we don’t open a can of dog food, thinking it’s the tinned peaches.
Seeing AI has changed social media for me, with its ability to describe photographs, and read text contained in them. I follow many political journalists around the world. When they’re in a hurry, they might take a screen shot of some text a press secretary has sent them, or of a piece of paper that has been handed to them. Seeing AI brings all that to life for me as a totally blind person. It’s also empowering not to feel excluded when someone sends a tweet which contains a photo, with no text giving me any indication as to what the photo is about. Yes, it’s good practice to caption images and we must continue to encourage that, but the world’s not perfect, so solutions like Seeing AI are helpful.
Now, the app has a handy-dandy light detector, very useful for a totally blind guy with no light perception to be sure the kids haven’t left any lights on. It’s also useful to check lighting conditions before taking a photo.
The currency identifier will be helpful when I can use it here in New Zealand. Presently, NZ currency isn’t supported, so hopefully Microsoft will follow through on its promise to add other currencies soon.
And there is a colour detector, something I’m still experimenting with at this early stage to assess its accuracy.
This is a veritable Swiss army knife for overcoming the information barriers blindness can pose.
What can I say except Microsoft has hit it out of the park with this intuitive, capable, game-changing, totally free app.
With Apple now offering hardware at a range of price points, and the technologies powering Seeing AI improving constantly, I believe this app will be remembered as an app that redefined access to information. Well done to all involved.
Being able to feel so uplifted and positive about an app is a terrific way to conclude the blog posts for this year.
I can’t wait to see what 2018 brings in technology.
Jonathan Mosen | December 15, 2017 at 11:31 am | URL: https://wp.me/p3tzP6-6R0
Comment
See all comments

Unsubscribe to no longer receive posts from Mosen Consulting.
Change your email settings at Manage Subscriptions.
Trouble clicking? Copy and paste this URL into your browser:
http://mosen.org/seeing-ai-my-pick-for-the-best-ios-app-of-2017/

About Patty L. Fletcher

About Patty October 2021 Patty and her guide dog Blue. Patty has her hair tied back in a low ponytail and rests her right hand on Blue's head. She wears a white shirt with a pink and purple butterfly on the front and light blue shorts. Blue is a handsome black lab. He wears a brown leather harness with a handle attached to the back and is smiling at the camera as he sits in front of Patty. In the background is a brick building with white, windowed doors and a flowerpot overflowing with pink and yellow blooms. Updated – October 2021 Patty Fletcher is a single mother with a beautiful daughter, of whom she is enormously proud. She has a great son-in-law and six beautiful grandchildren. From April 2011 through September 2020, she owned and handled a black Labrador from The Seeing Eye® named King Campbell Lee Fletcher A.K.A. Bubba. Sadly, after a long battle with illness on September 24, 2020, King Campbell went to the Rainbow Bridge where all is peace and love. In July 2021, she returned to The Seeing Eye® and was paired with a Black Labrador Golden Retriever cross named Blue. PATTY’S BLINDNESS… Patty was born one and a half months premature. Her blindness was caused by her being given too much oxygen in the incubator. She was partially sighted until 1991, at which time she lost her sight due to an infection after cataract surgery and high eye pressure. She used a cane for 31 years before making the change to a guide dog. WHERE SHE LIVES AND WORKS… Currently, Patty lives and works in Kingsport, Tenn. She’s the creator and owner of Tell-It-To-The-World Marketing (Author, Blogger, Business Assist), The Writer’s Grapevine Online Magazine and the creator and host of the Talk to Tell-It-To-The-World Marketing Podcast. WRITING GOAL… Patty writes with the goal of bridging the great chasm which separates the disabled from the non-disabled. HOBBIES… Patty’s hobbies include reading, music, and attending book clubs via Zoom. FAVORITE TUNES… Some of her favorite types of tunes are classic rock, rhythm and blues, and classic country. FAVORITE READS… Patty enjoys fantasy, science fiction, and books about the supernatural. She loves books by Stephen King, Dean Koontz, Norah Roberts, and many more. Some favorite books include Norah Roberts’ Hide Away, Stephen King’s Dark Tower series, J.K. Rowling’s Harry Potter series, Robert Jordan’s Wheel of Time series, and J.R.R. Tolkien’s Lord of the Rings series. SPIRITUAL FAITH… Patty describes herself as a spiritual Walker. She says she knows both Mother Goddess and Father God and embraces all they have to offer. CONTACT… Email: patty.volunteer1@gmail.com Visit: https://pattysworlds.com/ And: https://www.smashwords.com/profile/view/PattyFletcher As well as: https://www.amazon.com/Patty-L.-Fletcher/e/B00Q9I7RWG
This entry was posted in Uncategorized. Bookmark the permalink.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s