August 20th, 2009

Calm Down, Augmented Reality For Your Mobile Phone Won’t Be As Useful As Promised

This week, Layar, a mobile augmented reality browser for Android phones launched globally to an incredible amount of excitement in the tech community. So, what exactly is Layar? Well, I’ll let Mashable describe it because they can do a much more efficient job than I can:

“Layar is a Reality Browser, which means it displays real time digital meta data on top of the physical world around you, as seen through the camera of your mobile phone. Point the camera anywhere, and you’ll see layers of information on top of real world objects; these layers can be real estate info, bars and shops, tourist information, tweets from users etc. Imagine sitting in an internet cafe and seeing what the folks around you are tweeting through you camera? Well, that’s exactly how it works”.

Only, here’s the problem. That may be how it’s being pitched/positioned, but that’s not “exactly” how it will work when consumers get their hands on it.

Let me be honest: like most interactive marketers, when I first read about this tech I felt like Steve Martin (in “The Jerk”) when the new phone books showed up. My mind was swimming with possibilities – I mean, think about all the ways we could use AR to provide real value to consumers. Think of the amazing experiences we could create! Then, I talked to our Senior Software Engineer who unceremoniously brought me back down to earth with a “thud”. The problem, as it turns out, is not with the software that’s being developed (as I firmly believe that companys like Layar deserve a serious “hat-tip” for pushing the industry forward) but with the hardware (i.e. the phones) that consumers will be running these technologies on.  The fact is the hardware just isn’t accurate enough to deliver on the types of precise experiences that are being showcased/promised in videos around the net. Here are the two primary reasons:

  1. THE GPS – No matter what handset you’re using, we aren’t dealing with military grade GPS. The fact is, even in the best conditions (please note the word “best”), civilian GPS is accurate up to 50 feet. With that in mind we spent the other day playing with Layar on a Google G1 (note: the phone’s hardware is not Google’s but HTC’s) to see what we were dealing with, and we noticed something. Typically we experienced a GPS accuracy level of somewhere between 100 to 250 feet. Now, remember, that could go 250 feet to the left, right, forward, or backwards… So really, the device was telling us that the piece of data that was overlaid on the phone’s screen was somewhere within a 31,400 square foot (if accuracy was 100 feet) to 196,250 square foot (if accuracy was 250 feet) area. That means you won’t be able to swing your phone around an Internet café and match a tweet with a face. In fact, you can’t even safely assume that the person whose tweets you’re reading is even in the café with you (not to mention you may feel a touch silly in an internet café holding up your phone and spinning around anyways, but that’s a conversation for another day).
  2. THE IPHONE 3GS’ COMPASS – As of right now you can’t get AR apps on the iPhone but that’s going to change next month.  So we should probably discuss this now as the the new phone’s compass will be a major component of most GPS related executions.  Let’s check out the screenshot below.  Do you see that “V” coming out from the user’s location? That “V” indicates that they are facing somewhere within those parameters. So, if the device doesn’t know exactly where you’re facing, how can you tell if the real estate data you’re looking at is actually for the house you’re viewing through your phone’s camera? Not to mention that as you get farther away, the margin of error increases. So that subway station you think you’re walking towards… it could actually end up being three blocks over and two blocks up. And that’s just what you want when wandering around New York right? A nice game of “hot or cold”.

At the end of the day, if the hardware can’t accurately tell: where you are, where the data that’s being overlaid is anchored, or where you’re facing… how reliable and useful an experience can you possibly have?

Now, you may be thinking that those two inaccuracies noted above aren’t that bad. Certainly, when you’re driving a car you never really noticed any issues with your GPS, right? Here’s the thing, an exit ramp being a couple hundred feet off is not a big deal. Between the street signs, the fact that there’s only one ramp in the area, and your speed, you just don’t notice the inaccuracies. But, if you’re going to overlay data on a precise location (e.g. real estate information about a house, or information about a city’s historical landmarks) via a phone’s video screen, those inaccuracies make a huge difference in the consumer experience. And here’s the corker, if at the end of the day the data isn’t accurate/reliable why will consumers use it (outside of that initial “this is cool/different” moment that one has the first time they try it)?  So, I guess the real question is why would a consumer continue to use it?

Now, don’t get me wrong; my hope is that there are developers out there that are seeing this technology and having an “A-ha!” moment. I’d love it if some fantastic and useful apps get built even with the hardware’s limitations. I’m starting to doubt that it will happen given what I’ve been discussing, but a guy can always hope right? All I’m trying to do today is manage your expectations, because the experiences that are being promised are not what you’re going to experience when you get the application in your hands.

So, enough blabbering out of me, what do you think?

Tags: , , , , , , , , , ,

  • mj

    I don’t think it’s as gloomy as you describe.

    The accuracy thing is an issue and the V you describe is just to accommodate the wobble – you’ll see the wobble if you use Layar – things just wobble as the compass attempts to calibrate and display the correct data.

    This is not a big issue for housing rental, for example, unless you’re trying to find ‘a’ house among a similar group of houses all the same colour, with gardens the same, with no numbers or signage. And the occupants of the other houses are from Texas.

  • Raimo

    We add accuracy in the topbar. People know that things can be 20 meter off. iPhone 3GS compass is another thing… We are getting pretty good results.. so I expect a good experience..

    Currently our app gets a lot of 5 star reviews of users. Most used words are amazing and awesome..They seem to be happy..

  • Jack

    Thank you both for taking the time to read the post and comment on it.

    @mj I think that when you couple the compass issue with the gps issue though, it becomes a much larger issue of being able to trust the data’s accuracy. At the end of the day, if you can’t trust the data, the “cool” factor will wear off and users will just keep on using google maps.

    @Raimo It is amazing/awesome. But I’m going to “guess” that most users to date have been early adopters and they have been in their offices checking out the tech. They haven’t actually used it “out in the real world”… that is, they haven’t sat in a cafe and tried to match a tweet with a face, or used the application to go house-hunting. They read a mashable/techcrunch/readwriteweb post, they downloaded the app, and they stood in their office spinning around and seeing data displayed on a horizon (directionally). In this setting, the problems with the hardware’s limitations don’t become apparent. I mean the tech is new. It’s cool. It’s fun. It’s inspiring. That’s why we wrote this post. We knew that users would get extremely excited about it (like I did) but not think about how the hardware’s limitations will effect consumer experiences out in the real world. At the end of the day, only time will tell, but it will be interesting to keep an eye on:

    1 – if the average consumer adopts it (ie not just the early adopters)
    2 – if the people who have downloaded it use it (continually) like the tool that it’s intended to be. Or, are they just checking it out initially and being amazed by the new experience.

    Finally, and please know that I’m not trying to be argumentative/combative, but when you say “people know things can be 20 meters off”, do you mean the average consumer? I “suspect” that if I ask my sister about that fact, it would be news to her… Once again, that’s really why we wrote the post, to manage expectations. I’m definitely a fan of the work you and your team are doing.

    Again, I appreciate both of you taking the time to have this conversation with me.

  • Julian

    Gloomy may be the best way to contend with a bit of Technology rollercoastering around the hype curve. I’ve been alongside one or the other kind of “* Reality” for the better part of two decades, after an engineering degree at UW’s Human Interface Technology Lab. The problem is maybe less the bit of technical kit, which passionate, over-confident engineers will sort out. It’s people and their practices — which is a way of wondering what the sensible, legible “apps”. I’ve seen nothing much beyond “holding-phone-up-and-looking-at-the-world” which has no real precedent in terms of what people do in the world and what they would do *anyway* without a silly, power-hungry, inaccurate, delicate device in their paws.

    I mean, I’m not saying that it’ll be a complete fail, but so long as Engineers are leading this, and as long as the technology leads the experiences over and above normal, human sensibilities, this’ll be a geek toy. For the techno-fetishists. Sort of like “fixies”, command prompts and hot-rod mods. Most people? They’ll stick to top-down and birds eye views. Which way is the nearest Tube station? Really? That’s the best enticement over and above, like..asking another human being?

    The “killer” app for VR when I was at the HITLab — and it was an epic fail — was an AR app by today’s definition. Now you see it in the shtbrd Skymall catalogs — glasses that you wear to watch movies while mowing the lawn. I mean… Really, the vision hasn’t gotten much beyond that, seems to me.

  • Claire Boonstra (Layar)

    So… we thought we were making quite some speed and taking the AR experience out of the ‘labs’ environment into the real world. And still we’re not moving fast enough :-)

    AR and Layar are still at the dawn – of what we expect to become a whole new way of browsing, of using ‘contextual aware services’, of playing games etc. Sure, the hardware, software and sensors (like GPS) are not perfect yet. But it will come.

    And it will come faster than you might think – faster than the internet has developed, also faster than the general adoption of mobiles.

    Next to what Raimo already said about the positive user reviews (and amount of downloads), there is also the content: there are hundreds of content owners who have already applied for an API key to build a layer for their geolocation content. And we have much, much more cool stuff to be announced in the coming weeks and months.

    So just be a little bit patient… look back at this moment (and your blog post) in a year from now – and you will probably smile :-)

  • Jack (www.twitter.com/jack_benoff)

    @Claire Thanks for your note. To be clear, I’m bullish on AR and the advances teams such as yours are making. As a company, we (zugara) have been creating our own technologies in the flash/web-based AR space (I’ll include links to those executions at the end of this comment).

    I think that we’re on the same page, the future looks bright for AR and it will come much more rapidly than the internet/mobile spaces developed. That’s the key though, “the future”. Everyone is acting like the iphone update next month will turn our lives in to a Sci-Fi movie, or the Jetsons… I just wanted to raise awareness that “today”, the consumer experience will not match the promises some videos were making. And, the media “hype cycle” has been covering these videos without addressing potential issues or working to manage consumer expectations. Essentially, I’m saying “calm down… not yet”.

    Please know that I’m incredibly excited about AR’s future, but I feel like it helps the space overall if the community stakeholders are able to have open and honest dialogue about the industry.

    ZUGARA’S AR EXAMPLES:

    An AR Flash Game: http://weareorganizedchaos.com/index.php/2009/08/12/zugaras-first-webcam-based-augmented-reality-flash-game-utilizes-its-proprietary-motion-capture-technology/

    An AR Shopping App: http://weareorganizedchaos.com/index.php/2009/06/23/zugara-launches-online-shopping-app-utilizing-augmented-reality-and-motion-capture/

  • olivier

    an AR iphone application has been launched this week in France. it’s called “metro” and helps you locate the nearest subway station but also POI such as closest mcdonalds, starbucks etc..
    it works pretty well but I must admit it is not that accurate … not to mention the fact that I looked really stupid walking down the Champs Elysées while holding my iphone in the air. Everybody thought I was doing some sort of video recording of them .. Well… the fact is that since Monday I didn’t use the application again..
    but i liked the idea and I would have liked to use for other purpose such as museum explanations, landscape information, real estate, jobs etc… Unfortunately we don’t have Layar in Paris yet..

  • Which augmented reality startups are most ready for market? We rank them. | UpOff.com

    [...] blog, the future of AR is mobile (though current hardware limitations can make AR on mobile seriously flawed) and depends heavily on wearable displays. MIT’s Sixth Sense would be a pretty cool and [...]

  • Which augmented reality startups will dominate? We rank them. | UpOff.com

    [...] blog, the future of AR is mobile (though current hardware limitations can make AR on mobile seriously flawed) and depends heavily on wearable displays. MIT’s Sixth Sense would be a pretty cool and [...]

  • Peter Ellenby

    You should check out GeoVector’s World Surfer.
    The information is displayed as a list, not in camera, and corresponds to the direction the phone is pointing. Like a mouse for the real world.

  • Rod Ransburg

    I want some help;-D

  • Anthony Cappetto

    When any new technological development is being fine tuned, there will be issues to clarify and hurdles to clear before it can be smoothly executed and a positive asset for vendors and users alike. I see uses for placing images for 3D street painting art projects at given locations by AR users such as myself for commercial, entertainment uses as well as the casual fan of our art form selecting images that they like to share with others as well. When the complexity can be subdued for the average vendors and users will be when AR will be able to take off and my company for one wishes to be there…

  • sound of the jordan

    wow
    so nice
    so cool

  • free shoes

    it is so cool

  • Ronni True

    MMS dating will see a surge in the next few months. With almost everyone and their dog having access to a mobile device, it’s inevitable that people will look for ways of reaching out to the dating world through their devices. In fact, it’s already happening to some extent. People carry their ipod touch almost anywhere they go. Making text message dating so simple anyone can do it.

  • Salvatore Lemaire

    No-one can say for certain when text message dating will explode want it did in recent years on desktop machines. Though, we can almost say for sure that it will be here very soon. However, to make it easy for users to be able to connect and find what they’re looking for discovered assess how this type of person joining currently. Not so much time ago it wasn’t possible to connect to everybody in your social circle with some clicks. This is definitely successfully possible. We’re now seeing people doing the identical but from their mobile devices.

  • Air Jordan Fusion

    when text message dating will explode want it did in recent years on desktop machines. Though, we can almost say for sure that it will be here very soon. However, to make it easy for users to be able to connect and find what they’re looking for discovered assess how this type of person joining currently. Not so much time ago it wasn’t possible to connect to everybody in your social circle with some clicks. This is definitely successfully possible. We’re now seeing people doing the identical but from their mobile devices.

  • Unsapsesy

    Hi,

    I registered on this dating site Dating Free

    I made several interesting meeting. However I will like to know if you made that meeting and you meet later with the person?

  • Patrick Dockus

    Nike Air Max Uptempo 97,http://www.maxnike.org/Nike-Air-Max-Uptempo-97/

  • Joette Pinsonneault

    Hello People! Just wanted to tell you that I found tickets to the A Perfect Circle concert on Jul 12th. In this site you can find tickets for other dates too. It’s awesome their performance on stage, this is my fourth time and I’m still so excited about listening them live! On this page you can see the section where you’re buying the ticket, so it’s very recommended!

  • Venita Betts

    Just doing googling about mobile, and i get this great article

  • James Savage

    I need to convey my appreciation for your kindness for those that really want help about this particular study. Your real willpower to passing the solution all-around was certainly significant and have consistently permitted persons like me to understand their aims. The warm and helpful report symbolizes this much somebody like me and in some cases further to my office colleagues. Thanks; from everyone of us.

Zugara on Facebook