The Raspberry Pi And Embedded Vision: Almost Out Of The Oven
February 22, 2013
Late last November, I mentioned that a 5 Mpixel add-in camera module was under active development for the popular (at least to most folks), inexpensive Raspberry Pi hobbyist board. At the time, I passed along its then-only-estimated $25 price tag, and wasn't able to share an availability timeframe with you. I still don't have a firm production date, but a more recent blog update from the Raspberry Pi Foundation suggests that we're getting close; the above photograph (and its below counterpart of the module back-side) shows the claimed final hardware:

Due in no small part to continued software driver development and optimization work, the Foundation isn't yet ready to release the module into the wild. The blog post author comments, "I don’t have a release date for you yet, but we’re probably at least a month away (and possibly more) from being able to sell these at the moment." Still, the reported progress makes for encouraging news. And as BDTI senior software engineer Eric Gregori noted in last November's writeup, the Raspberry Pi hardware is capable of implementing not only elementary image capture but also embedded vision processing capabilities...at least the $35 first-generation hardware is.
Some of you may have already heard about the Raspberry Pi "A" model, which at $25, is $10 lesser than its earlier-released "B" sibling. How did the Foundation accomplish this cost-slimming move? Here are the fundamental differences between the two versions:
|
|
Model A |
Model B |
|
Price |
$25 |
$35 |
|
Memory (SDRAM, shared with GPU) |
256 MB |
512 MB |
|
USB 2.0 ports |
1 |
2 |
|
Onboard networking |
N/A |
10/100 Mbps Ethernet |
|
Power consumption |
300 mA (1.5W) |
700 mA (3.5W) |
While it might be convenient to use Ethernet to interface the Raspberry Pi to a networked webcam, other camera connectivity options also exist on the model "A"; the sole remaining USB 2.0 port, for example, or the interface leveraged by the above-mentioned camera module. The only variation between the two versions that notably concerns me from an embedded vision capability standpoint is the reduction in system memory; I've asked Gregori to comment on the matter. Until then, content yourself with a model "A" first-purchaser's video of initial experiences:
And here's some additional reading material on the camera module:
I am very excited about the possibilities for a camera on the Raspberry Pi. I am looking forward to all the embedded vision projects the community will build around it.
At 5M pixels (assuming RGB565) each frame take almost 4% of your total memory with the model A. Unless the camera can be configured to output lower resolution video streams, the model A is going to be dropping a lot of frames due to a small video buffer queue. Even 512MB is going to be tight at the full 5M resolution.
I would highly recommend the 512MB of memory if you plan on using OpenCV with Linux. If you are planning on implementing your own algorithms directly on the V4L2 framebuffer, 256MB will work with simpler algorithms.
I have implemented simple embedded vision algorithms on systems running linux as small as 400Mhz ARM9's with only 64MB of memory. So it can be done.
http://www.youtube.com/watch?v=hPMiP5wPWkc
- ??
- ADAS
- aerospace
- Analog Devices DSP
- analytics
- Android
- Apple
- Apple iPad
- Apple iPhone 4S
- Apple iPhone iPod touch
- Aptina
- Augmented Reality
- Automotive
- Automotive vision
- Autonomous drone
- Autonomous Vehicle
- Autostereoscopic displays
- Azumio
- Barcode
- Baseball
- Biometrics
- Blackfin Embedded Vision Starter Kit Hands-on Workshop
- blur
- Boston Image Processing and Computer Vision Group
- Camera design
- cameraphone
- Carnegie Mellon
- CCD
- CES
- CEVA
- CMOS
- CogniMem
- Comic
- Computational Photography
- computer vision
- Contamination detection
- De-warping
- Design News
- DESIGN West
- Disney
- Driver assistance
- driver information
- embedded vision
- embedded vision alliance
- Embedded Vision Summit
- Embedded vision training
- Embedded Vision Tutorial
- emotion
- emotion detection
- eva
- Evaluation modules
- Eye tracking
- eyeSight
- Face detection
- face recognition
- Facial detection
- Facial recognition
- FiRe
- flying
- Focus
- Foxconn
- games
- gesture
- gesture interface
- Gesture interfaces
- gesture recognition
- GestureTek
- HDR
- health
- High-speed camera
- High-speed capture
- High-speed video camera
- IBM
- IEEE
- IEEE Embedded Vision Workshop
- Image analysis
- Image compression
- Image recognition
- Image sensor
- image sensors
- Image Sensors 2013
- IMS Research
- Industrial vision
- Intel Gesture Interface Facial Recognition
- investment
- iOS
- iPad
- Jitendra Malik
- Kinect
- Kinect Optical Scanner Robotics
- Kodak
- Light intensity detection
- Linley Group
- Lytro
- Mac OS X
- medical
- Medical imaging
- microsoft
- Microsoft Kinect
- military
- mobile
- Motion
- Motion Capture
- Move
- National Instruments
- Neural networks
- New members
- Newsletter
- Nokia
- Nvidia
- NVIDIA Android
- nViso
- object tracking
- object video
- open source
- OpenCV SimpleCV Python C C++
- OpenNI
- optical character recognition
- Optical flow
- Organic Motion
- panel
- Panorama mode
- Parking analytics
- patent
- pc
- PlayStation
- PlayStation Move
- PointGrab
- presentation
- Processors
- pulse
- pulse rate measurement
- Qualcomm
- Raspberry Pi
- Remote control
- Robotics
- robots
- rolling shutter
- Samsung smartphone
- Satellites
- SDK
- search
- security
- slow motion
- Smart TV
- Smartphone
- Soccer
- Sony
- Sports
- Still image analytics
- Surface visualization
- surgery
- Surveillance
- Synopsys
- Tegra 3
- tennis
- Tensilica
- Texas Instruments
- Thermal imaging
- TI
- traffic control
- traffic lights
- user interface
- VanGogh Imaging
- videantis
- video analytics
- Video editing
- Video surveillance
- Videoconferencing
- VideoSurf
- Virtual shopping
- Vision
- Vision Research Phantom
- Volvo
- Webcast
- Website
- x86
- Xbox 360
- xkcd











Thank you for your good jobs!!