Panorama Mode: Embedded Vision Processing Blends Pixels Together Via Microcode
May 10, 2012A recent "tweet" from the Google Android Twitter feed reminded me of a news topic I've long intended to mention:
Galaxy Nexus lets you take stunning wide angle photos with a wave of your hand using Panorama mode in Android 4.0
The "wave of your hand" part is admittedly what caught my attention; I thought when I first read it that Google had somehow integrated gesture interface control into the "Ice Cream Sandwich" Camera app, thereby adding to the existing facial-recognition embedded vision support that I've already mentioned several times. As you can see from the video below, that's actually not the case; what the Android team is referring to is using the hand to rotate the cameraphone across the desired panorama region:
Nevertheless, if you think about it, panorama mode still represents an impressive embedded vision processing achievement. What's in effect happening is that the image sensor is capturing a series of still images (or if you prefer, video frames) of various portions of the total desired end image, which the embedded vision processor then stitches together. In the process, it identifies common areas in each image for overlap purposes, as well as accounting for inter-image variances in orientation, distance, height and other framing variables, not to mention exposure.
Modern smartphones and tablets contain an abundance of additional sensors and transceivers whose logged data assists in these functions; GPS, silicon compass, altimeter (barometer), accelerometer, gyroscope, etc. Nonetheless, the end result is often quite impressive, particularly considering its near-real-time nature. Does anyone else out there remember when the panorama function was implemented only as a tediously slow algorithm with dubious-at-best outcome in dedicated software running on computers...prior to it even being included in Adobe Photoshop and other general-purpose image editing apps?
- ??
- ADAS
- aerospace
- Analog Devices DSP
- analytics
- Android
- Apple
- Apple iPad
- Apple iPhone 4S
- Apple iPhone iPod touch
- Aptina
- Augmented Reality
- Automotive
- Automotive vision
- Autonomous drone
- Autonomous Vehicle
- Autostereoscopic displays
- Azumio
- Barcode
- Baseball
- Biometrics
- Blackfin Embedded Vision Starter Kit Hands-on Workshop
- blur
- Boston Image Processing and Computer Vision Group
- Camera design
- cameraphone
- Carnegie Mellon
- CCD
- CES
- CEVA
- CMOS
- CogniMem
- Comic
- Computational Photography
- computer vision
- Contamination detection
- De-warping
- Design News
- DESIGN West
- Disney
- Driver assistance
- driver information
- embedded vision
- embedded vision alliance
- Embedded Vision Summit
- Embedded vision training
- Embedded Vision Tutorial
- emotion
- emotion detection
- eva
- Evaluation modules
- Eye tracking
- eyeSight
- Face detection
- face recognition
- Facial detection
- Facial recognition
- FiRe
- flying
- Focus
- Foxconn
- games
- gesture
- gesture interface
- Gesture interfaces
- gesture recognition
- GestureTek
- HDR
- health
- High-speed camera
- High-speed capture
- High-speed video camera
- IBM
- IEEE
- IEEE Embedded Vision Workshop
- Image analysis
- Image compression
- Image recognition
- Image sensor
- image sensors
- Image Sensors 2013
- IMS Research
- Industrial vision
- Intel Gesture Interface Facial Recognition
- investment
- iOS
- iPad
- Jitendra Malik
- Kinect
- Kinect Optical Scanner Robotics
- Kodak
- Light intensity detection
- Linley Group
- Lytro
- Mac OS X
- medical
- Medical imaging
- microsoft
- Microsoft Kinect
- military
- mobile
- Motion
- Motion Capture
- Move
- National Instruments
- Neural networks
- New members
- Newsletter
- Nokia
- Nvidia
- NVIDIA Android
- nViso
- object tracking
- object video
- open source
- OpenCV SimpleCV Python C C++
- OpenNI
- optical character recognition
- Optical flow
- Organic Motion
- panel
- Panorama mode
- Parking analytics
- patent
- pc
- PlayStation
- PlayStation Move
- PointGrab
- presentation
- Processors
- pulse
- pulse rate measurement
- Qualcomm
- Raspberry Pi
- Remote control
- Robotics
- robots
- rolling shutter
- Samsung smartphone
- Satellites
- SDK
- search
- security
- slow motion
- Smart TV
- Smartphone
- Soccer
- Sony
- Sports
- Still image analytics
- Surface visualization
- surgery
- Surveillance
- Synopsys
- Tegra 3
- tennis
- Tensilica
- Texas Instruments
- Thermal imaging
- TI
- traffic control
- traffic lights
- user interface
- VanGogh Imaging
- videantis
- video analytics
- Video editing
- Video surveillance
- Videoconferencing
- VideoSurf
- Virtual shopping
- Vision
- Vision Research Phantom
- Volvo
- Webcast
- Website
- x86
- Xbox 360
- xkcd








