fbpx

Vision Algorithms

Vision Algorithms for Embedded Vision

Most computer vision algorithms were developed on general-purpose computer systems with software written in a high-level language

Most computer vision algorithms were developed on general-purpose computer systems with software written in a high-level language. Some of the pixel-processing operations (ex: spatial filtering) have changed very little in the decades since they were first implemented on mainframes. With today’s broader embedded vision implementations, existing high-level algorithms may not fit within the system constraints, requiring new innovation to achieve the desired results.

Some of this innovation may involve replacing a general-purpose algorithm with a hardware-optimized equivalent. With such a broad range of processors for embedded vision, algorithm analysis will likely focus on ways to maximize pixel-level processing within system constraints.

This section refers to both general-purpose operations (ex: edge detection) and hardware-optimized versions (ex: parallel adaptive filtering in an FPGA). Many sources exist for general-purpose algorithms. The Embedded Vision Alliance is one of the best industry resources for learning about algorithms that map to specific hardware, since Alliance Members will share this information directly with the vision community.

General-purpose computer vision algorithms

Introduction To OpenCV Figure 1

One of the most-popular sources of computer vision algorithms is the OpenCV Library. OpenCV is open-source and currently written in C, with a C++ version under development. For more information, see the Alliance’s interview with OpenCV Foundation President and CEO Gary Bradski, along with other OpenCV-related materials on the Alliance website.

Hardware-optimized computer vision algorithms

Several programmable device vendors have created optimized versions of off-the-shelf computer vision libraries. NVIDIA works closely with the OpenCV community, for example, and has created algorithms that are accelerated by GPGPUs. MathWorks provides MATLAB functions/objects and Simulink blocks for many computer vision algorithms within its Vision System Toolbox, while also allowing vendors to create their own libraries of functions that are optimized for a specific programmable architecture. National Instruments offers its LabView Vision module library. And Xilinx is another example of a vendor with an optimized computer vision library that it provides to customers as Plug and Play IP cores for creating hardware-accelerated vision algorithms in an FPGA.

Other vision libraries

  • Halcon
  • Matrox Imaging Library (MIL)
  • Cognex VisionPro
  • VXL
  • CImg
  • Filters

Visidon Presents Enhanced Object Detection at Embedded World 2024

Visidon has been invited to present on empowering AI to enhance object detection in extreme low-light environments at this year’s Embedded World Conference in Nuremberg, Germany, taking place from April 9th to 11th. The presentation by Mr. Sami Pietilä, Head of Embedded Video at Visidon, will be held on April 9th at 11 AM. Additionally,

Read More »

The Power to Transform Retail with On-device Generative AI

This blog post was originally published at Qualcomm’s website. It is reprinted here with the permission of Qualcomm. NRF 2024 — Retail’s Big Show — is just a few days away as I write these words, and Qualcomm Technologies, Inc., alongside our customers, are excited to demonstrate how we are bringing to life digital retail

Read More »

Vision Transformers vs CNNs at the Edge

This blog post was originally published at Embedl’s website. It is reprinted here with the permission of Embedl. “The Transformer has taken over AI”, says Andrej Karpathy, (Former) Director of AI at Tesla, in a recent episode on the popular Lex Fridman podcast. The seminal paper “Attention is All You Need” by Vaswani and 7

Read More »

ProHawk AI Unveils AI Computer Vision Solutions at NVIDIA GTC

Sponsoring the largest technology and AI events, to be held March 18-21 in San Jose, California Unveiling ProHawk’s edge to cloud solutions embedded across the suite of NVIDIA platforms Also demonstrating integrated solutions with BCD, Dedicated Computing, Network Optix, and Onyx Healthcare LAKE MARY, FLORIDA, March 12, 2024 – ProHawk Technology Group (ProHawk AI), a

Read More »

Visidon AI-powered Low-light Video Enhancement Selected for Hailo-15 AI Vision Processor

The CNN-based technology developed by Visidon allows for significant improvement to video analytics accuracy in low-light environments, marking a new era for intelligent cameras deployed in public spaces, smart cities, factories, buildings, retail locations, and more. March 12th 2024 – The leading AI chipmaker Hailo has selected Visidon CNN-powered low-light video enhancement for their Hailo-15

Read More »

AI, Telehealth and Communications: Digital Healthcare

Software reading scans and online management of mental health are examples of digital healthcare that keep up with the modernization of the world, where efficiency and patient satisfaction are two key benefits. The weight of increasing demand for services could be lifted as more options become available for patients to seek treatment, and communication across

Read More »

Balancing Safety with Efficiency: How LiDAR Transforms Airport Passenger Flow

This blog post was originally published at Outsight’s website. It is reprinted here with the permission of Outsight. Airports, as critical transportation hubs, play a dual role in ensuring passenger safety and maintaining a smooth flow of travelers. Balancing these two aspects is a challenging endeavor, especially in the face of evolving security threats and

Read More »

Navigating the Ethical Labyrinth: Unraveling the Complexities of AI Ethics

This blog post was originally published at Digica’s website. It is reprinted here with the permission of Digica. Our world is experiencing rapid evolution, particularly in the realm of technology. AI stands out as one of the fastest-growing technologies, capturing the imagination not only of developers and scientists, but also of ordinary people. While science-fiction

Read More »

Prompt Engineering in Vision

This blog post was originally published at Embedl’s website. It is reprinted here with the permission of Embedl. Recently, we have all witnessed the stunning success of prompt engineering in natural language processing (NLP) applications like ChatGPT: one supplies a text prompt to a large language model (LLM) like GPT-4 and the result is a

Read More »

The Role of 3D LiDAR Technology in ITS

This blog post was originally published at Outsight’s website. It is reprinted here with the permission of Outsight. Intelligent Transportation Systems (ITS) are crucial for enhancing road safety and efficiency. LiDAR brings these systems to a whole new level. With the integration of advanced technologies like 3D LiDAR, ITS are undergoing a transformation, offering unprecedented

Read More »

How is AI Transforming the Semiconductor Industry?

This blog post was originally published at Digica’s website. It is reprinted here with the permission of Digica. The semiconductor industry stands as a driving force behind technological advancements, powering the devices that have become integral to modern life. As the demand for faster, smaller and more energy-efficient chips continues to grow, the industry faces

Read More »

5 Generative AI Use Cases Impacting Our Lives

This blog post was originally published at Qualcomm’s website. It is reprinted here with the permission of Qualcomm. Generative AI has unlocked the power of AI, and the potential is unlimited Since the introduction of ChatGPT in November 2022, the world has become enamored with the potential for artificial intelligence (AI). ChatGPT ushered in the

Read More »

Detecting Real-time Waste Contamination Using Edge Computing and Video Analytics

This blog post was originally published at NVIDIA’s website. It is reprinted here with the permission of NVIDIA. The past few decades have witnessed a surge in rates of waste generation, closely linked to economic development and urbanization. This escalation in waste production poses substantial challenges for governments worldwide in terms of efficient processing and

Read More »

What Do Vision Transformers See?

This blog post was originally published at Embedl’s website. It is reprinted here with the permission of Embedl. CNNs have long been the workhorses of vision ever since they achieved the dramatic breakthroughs of super-human performance with AlexNet in 2012. But recently, the vision transformer (ViT) is changing the picture. CNNs have a an inductive

Read More »

Here you’ll find a wealth of practical technical insights and expert advice to help you bring AI and visual intelligence into your products without flying blind.

Contact

Address

1646 N. California Blvd.,
Suite 360
Walnut Creek, CA 94596 USA

Phone
Phone: +1 (925) 954-1411
Scroll to Top