It starts with pixels

Augmented Reality Panoramas… in your browser!

with 38 comments

If you have the latest iPhone OS (4.2+) and an iPhone 4 or iPod touch 4th gen, check out the new gyro-enabled panorama viewing we just launched!

Quick update: We always get a little annoyed when technical terms are misused, so we’re the first to admit that this new feature isn’t really Augmented Reality [also pointed out by Gizmodo, DownloadSquad], but we thought AR evoked the type of controls we’ve enabled, so we titled this post accordingly. But to be accurate, it’s true 3DOF gyroscope navigation of a simulated camera view — and it’s pretty cool! And if you want to see some actual AR work we’ve done, check this out.

Some details:

  • Live now for every panorama uploaded so far.
  • Requires iOS 4.2+
  • Allows you to physically spin around as if you were actually at the scene of the panorama.
  • Doesn’t currently auto-align with compass North, but you can use touch controls to orient with north.

Let us know what you think and how we can improve it!

Written by jeff

December 21st, 2010 at 9:48 am

Posted in 360panorama,announcements,iphone

Tagged with ,

  • http://blog.vinko.com Vinko

    This is very cool. Would love to know how to create these panoramas myself on my site.

    • occipital

      It's really easy – you can create them with the 360 Panorama app which captures the scene as-you-spin (assuming good light), and then you just press the Upload button in-app to upload and get back a link to your panorama. The app is on the app store and requires an iPhone 4/3GS/iPod touch 4g.

      • http://www.id-pop.net Gilles

        Uuuhhhh when I press the upload button, the only offered possibility is to upload it on Twitter….am I missing something ?
        Don't tell me I must be on Twitter to use this app as I would like !

  • Lupius

    I get "Error downloading the source image. Make sure the source image still exits and try again." both on my iPhone and laptop. Is the panorama still available?

    • bob

      me too. oh well.

      • occipital

        Thanks for pointing that out. Not sure what was wrong, but we've fixed it!

  • Michael

    Will you be able to link for upload to Facebook and/or Flickr, maybe?

    • occipital

      At present, you can only use either of the Twitter-connected services (yFrog, Twitpic) built into the app. But stay tuned for more in future updates.

  • Alan Bergfeld

    Great fun! Would love a site with pano viewer to host the uploads so we could see the 360 from desktop the way your sample is done. Posting to twitter and scrolling around is no fun and would like others without iPhones to enjoy the pano effect from PCs

    • occipital

      Actually you can share it with friends on desktops already! If you use the Upload feature in-app, you can share the link with anyone. You /do/ need a Twitter login to perform the upload, but you don't even need to post the link to Twitter at all, and once you upload, you're free to send the link around (just like we did with the demo).

      • Alan Bergfeld

        Yeah, figgured it out right after my post. Thanks for the quick response though! And, hey, my son has saved hundreds of dollars price matching with red laser, so thanks for that one too! (Even it is with ebay now.)

  • http://www.fxexchangerate.com/ fxgeorges

    The latest iPod touch *does* have a gyroscope.
    I have this app. It's cool but mostly as a toy / demo. The exported panoramas are really low resolution and the stitching can be improved quite a bit.The website linked in this article with the Central Park panorama unfortunately uses Flash on the desktop. On the iPhone, it's choppy to the point of being unusable. Inside the app itself you can move around the panorama very smoothly.

    • occipital

      Hi, that's right, of course the new iPod touch does have a gyro as mentioned in the post. Actually, the website only uses Flash as required — it automatically adapts to use 3D capabilities in Safari on mobile and desktop. We'll use built-in facilities as other browsers begin to enable this, but Safari is solo at this point. Other browsers don't have any built-in ability to display images in 3D, so we adapt to use Flash in those cases because Flash does provide the necessary 3D transforms.

      The resolution of a panorama is up to 4096×1011 pixels depending on the field of view captured. We think it's absolutely excellent for sharing. We're constantly working on even more sophisticated computer vision algorithms to increase fidelity and allow for more varied motion paths.

      Low framerates are not the norm on mobile. In fact, we render at about 60fps. There can sometimes be initial jumps right when you first load a panorama as the browser's still doing a bunch of prep work, but it clears up after 1-2 seconds. If you're seeing consistent slowness, please get in touch with us so we can decipher what's going on and, if appropriate, address it. Note that the gyroscope data arriving in Mobile safari isn't as fast as one might hope — Apple only sends the data to Safari at a rate of 20fps (touch motion will proceed at 60fps despite the gyroscope's slower update rate.)

      We're very, very serious about performance, so whenever we have reports to the contrary, we want to address them immediately.

  • http://bankgothicoverload.com josh mishell

    I would like crossposting to flickr, facebook, etc. And I also would like the image to be instantly saved to the app so I don't have to upload it immediately. Sometimes I want to capture a bunch of panoramas, and don't want to waste my phone's battery (especially in spotty cell area like when I'm skiing or hiking). Still a really cool app.

    • occipital

      Josh, sorry we didn't reply earlier, but thanks for the great suggestions. By the way, in 3.1 you can save panoramas and re-open them in-app. This lets you do what you were hoping to save battery and not have to upload right away. It still requires a few steps, though, so we'll try to make it more streamlined in the future.

  • Mia

    Can a 360 panoramic scene be saved as such in the absence of an internet connection?

    • occipital

      Yes, you can still use the Save and Email options without internet. In the case of Email, your panoramas will go in the outbox just like a typical email, and will send when you're re-connected later. In the case of Save, you can re-open your panoramas into the app later and, if you want, Upload them.

  • Mia

    Thanks for the quick response! One more question tho, when I save the panoramic shot into the photos. It saves as a photo. How is it reopened in the app as a 360 degree panoramic scene? Can’t seem to figure this out. Please help. Thanks!

    • occipital

      On the main capture screen, press the action button in the lower-left corner. Then select your panorama, and it will re-open it automatically. Although it's saved as a flat photo, 360 Panorama knows how to "wrap" the image around you just like when you originally captured it. Best of all, when you upload it, you don't lose any quality.

      Important tip: If you try to open a panorama but it just returns you to the capture screen, this means location services are disabled. To fix this, go to Settings -> General -> Location Services, and enable Location Services for 360 Panorama.

      • Steve

        WOW. That solved one problem in an email I just sent you guys. If you guys can put out a FAQ/manual to ease our thoughts, we wouldn't need to be asking the same questions. Cheers.

      • sometoast

        It seemed like that button should reload a panorama from the camera roll, but I kept going back to the capture screen. I never would have linked that issue to the location services switch. Thanks for the tip!

  • Mia

    Fantastic! It works now. Great App! Great tech support! Thanks.

  • Tony

    I added this app to my iTouch and successfully captured a couple of panoramas to the camera roll. But I'm having no luck at all figuring out how to view them again. When I view from the "Photos" app – they just open as largish images which I can look around … but I can't make them do the 3-D thing by moving/twisting the iTouch – like I could inside the app before I saved the file. Clues please!

    • occipital

      Tony – when you first launch the app, you'll see a small button in the lower-left corner. Tap this button, and then select your panorama from the list. That'll "wrap" the large image around you so it looks just like it did when you captured it. That should do it.

      However, if by chance this just returns you to the main screen without opening, then the problem is that you need to enable Location Services for 360. Just go to Settings -> General -> Location Services, and turn ON location services for 360 Panorama. Then try loading again.

  • http://www.thespecific.com Bryan

    Hello Occipital,

    BTW I love the name of your company. I really am interested in your 360 app. And I would like to use it for business purposes. You see I would like to create 360 interactive views of my office and post them. How could I do this? I know you can email a link but can the link be embedded in a site with a picture?

    Thank you,

    Bryan Wright, D.C.
    The Specific

    • occipital

      Bryan – the best way to pull this off at the moment is using an HTML iframe. You can find some simple code examples around the web for how to create an iframe. Inside the iframe, you can specify the URL to the panorama, and it will display quite well right inside your site.

      • http://www.thespecific.com Bryan

        Thank you, Keep up the great work. I look forward to using this app.

        Bryan,
        The Specific

  • david

    for html code ? thanks 1 exemple

  • Zekegri

    Safari -lates will not open and Firefox has no 360 type view just a flat scroll

  • Mike

    Hi, can you tell me how to have the pano appear throuh the browser? I create the panp, but, I see others have a url that displays their Pano's. Thanks in advance, and a very nice app, I really like it! Mike

  • The Civil

    Can you please make cropping available and improve the camera quality.

    cropping is a must as it always comes out wonky no matter how straight you hold it

    picture quality is a must because currently its crap

  • http://www.storesoffer.com Silk Scarf

    http://www.storesoffer.com/scarf-c-16.html We offer Real Silk Scarf,Scented Sachet Aroma,Camping Bag,Travel Suitcase,Sahcet Bag Aroma,Fragrance Diffuser Aroma,Scented SahcetAroma,etc.

  • Dan

    Hi,
    I have downloaded the most recent software. It works nicely if you move steadily around. I've read in the comments how to reopen a panorama, but I cannot find that button in the lower left. How do I reopen a panorama? Also you need someway to exit the capture mode back to the main screen without having to capture something. When viewing, it would be nice for all the menu bars to hide, so the panorama is full screen. It's a little cramped by the menus and buttons.

  • http://www.storesoffer.com silk scarf

    http://www.storesoffer.com/chinasilkscarf-c-16_18… We offer China Silk Scarf,Scented Sachet Aroma,Camping Bag,Travel Suitcase,Sahcet Bag Aroma,Fragrance Diffuser Aroma,Scented SahcetAroma,etc.

  • http://www.xrez.com Greg Downing

    I have a feature request. I am a photographer and use the app "sunseaker" all the time. I just wish I could see the sun time and path info in a panorama like I can in in the live only sunseaker view after I've left the location. Since you are storing compass and GPS data this could integrated. This would be a terrific tool for scouting and planning filming, photoshoots and events.

  • http://www.gsmpedia.nl/nokia-n9 nokia N9

    Augmented reality is a really cool feature. got it on my phone as well, works great

  • http://www.gizmobiesnz.com iPhone Skins nz

    I would also like to create some panoramas for our store.. :)

  • http://www.gsmpedia.nl/blackberry-bold-9900 Blackberry bold 9900

    really cool feature thanks for pointing it out