fbpx

Processors

Processors for Embedded Vision

THIS TECHNOLOGY CATEGORY INCLUDES ANY DEVICE THAT EXECUTES VISION ALGORITHMS OR VISION SYSTEM CONTROL SOFTWARE

This technology category includes any device that executes vision algorithms or vision system control software. The following diagram shows a typical computer vision pipeline; processors are often optimized for the compute-intensive portions of the software workload.

ev pipeline

The following examples represent distinctly different types of processor architectures for embedded vision, and each has advantages and trade-offs that depend on the workload. For this reason, many devices combine multiple processor types into a heterogeneous computing environment, often integrated into a single semiconductor component. In addition, a processor can be accelerated by dedicated hardware that improves performance on computer vision algorithms.

General-purpose CPUs

While computer vision algorithms can run on most general-purpose CPUs, desktop processors may not meet the design constraints of some systems. However, x86 processors and system boards can leverage the PC infrastructure for low-cost hardware and broadly-supported software development tools. Several Alliance Member companies also offer devices that integrate a RISC CPU core. A general-purpose CPU is best suited for heuristics, complex decision-making, network access, user interface, storage management, and overall control. A general purpose CPU may be paired with a vision-specialized device for better performance on pixel-level processing.

Graphics Processing Units

High-performance GPUs deliver massive amounts of parallel computing potential, and graphics processors can be used to accelerate the portions of the computer vision pipeline that perform parallel processing on pixel data. While General Purpose GPUs (GPGPUs) have primarily been used for high-performance computing (HPC), even mobile graphics processors and integrated graphics cores are gaining GPGPU capability—meeting the power constraints for a wider range of vision applications. In designs that require 3D processing in addition to embedded vision, a GPU will already be part of the system and can be used to assist a general-purpose CPU with many computer vision algorithms. Many examples exist of x86-based embedded systems with discrete GPGPUs.

Digital Signal Processors

DSPs are very efficient for processing streaming data, since the bus and memory architecture are optimized to process high-speed data as it traverses the system. This architecture makes DSPs an excellent solution for processing image pixel data as it streams from a sensor source. Many DSPs for vision have been enhanced with coprocessors that are optimized for processing video inputs and accelerating computer vision algorithms. The specialized nature of DSPs makes these devices inefficient for processing general-purpose software workloads, so DSPs are usually paired with a RISC processor to create a heterogeneous computing environment that offers the best of both worlds.

Field Programmable Gate Arrays (FPGAs)

Instead of incurring the high cost and long lead-times for a custom ASIC to accelerate computer vision systems, designers can implement an FPGA to offer a reprogrammable solution for hardware acceleration. With millions of programmable gates, hundreds of I/O pins, and compute performance in the trillions of multiply-accumulates/sec (tera-MACs), high-end FPGAs offer the potential for highest performance in a vision system. Unlike a CPU, which has to time-slice or multi-thread tasks as they compete for compute resources, an FPGA has the advantage of being able to simultaneously accelerate multiple portions of a computer vision pipeline. Since the parallel nature of FPGAs offers so much advantage for accelerating computer vision, many of the algorithms are available as optimized libraries from semiconductor vendors. These computer vision libraries also include preconfigured interface blocks for connecting to other vision devices, such as IP cameras.

Vision-Specific Processors and Cores

Application-specific standard products (ASSPs) are specialized, highly integrated chips tailored for specific applications or application sets. ASSPs may incorporate a CPU, or use a separate CPU chip. By virtue of their specialization, ASSPs for vision processing typically deliver superior cost- and energy-efficiency compared with other types of processing solutions. Among other techniques, ASSPs deliver this efficiency through the use of specialized coprocessors and accelerators. And, because ASSPs are by definition focused on a specific application, they are usually provided with extensive associated software. This same specialization, however, means that an ASSP designed for vision is typically not suitable for other applications. ASSPs’ unique architectures can also make programming them more difficult than with other kinds of processors; some ASSPs are not user-programmable.

NVIDIA Blackwell Platform Arrives to Power a New Era of Computing

NVIDIA Blackwell powers a new era of computing, enabling organizations everywhere to build and run real-time generative AI on trillion-parameter large language models. New Blackwell GPU, NVLink and Resilience Technologies Enable Trillion-Parameter-Scale AI Models New Tensor Cores and TensorRT- LLM Compiler Reduce LLM Inference Operating Cost and Energy by up to 25x New Accelerators Enable

Read More »

Qualcomm Brings the Best of On-device AI to More Smartphones with Snapdragon 8s Gen 3

Highlights: Snapdragon 8s Gen 3 Mobile Platform leverages specially selected premium capabilities for next-level on-device generative AI features, photography and gaming experiences. Snapdragon 8s Gen 3 will be adopted by major OEMs including Honor, iQOO, realme, Redmi and Xiaomi, with commercial devices expected to be announced in the coming months. Qualcomm Technologies, Inc. today announced

Read More »

AI Accelerators and HPC: Latest Innovations in the Advanced IC Substrates Market

This market research report was originally published at the Yole Group’s website. It is reprinted here with the permission of the Yole Group. The demands and complex requirements of the semiconductor industry were a key driver, transformation enabler, and innovation-inducer of the advanced packaging industry, including the market of advanced IC substrates. While the advanced

Read More »

The Power to Transform Retail with On-device Generative AI

This blog post was originally published at Qualcomm’s website. It is reprinted here with the permission of Qualcomm. NRF 2024 — Retail’s Big Show — is just a few days away as I write these words, and Qualcomm Technologies, Inc., alongside our customers, are excited to demonstrate how we are bringing to life digital retail

Read More »

A One-stop Solution for Digital Skin Analyzers

This blog post was originally published at e-con Systems’ website. It is reprinted here with the permission of e-con Systems. In this blog, we are exploring types of skin analyzers prevalent in the industry and giving insights on the kind of cameras that should be used to get the best results. In the skincare industry,

Read More »

University of Western Australia Latest to Join the BrainChip University AI Accelerator Program

Laguna Hills, Calif. – March 12, – BrainChip Holdings Ltd (ASX: BRN, OTCQX: BRCHF, ADR: BCHPY), the world’s first commercial producer of ultra-low power, fully digital, event-based, neuromorphic AI IP, today announced that The University of Western Australia has joined the BrainChip University AI Accelerator Program, ensuring that UWA students have the tools and resources

Read More »

ProHawk AI Unveils AI Computer Vision Solutions at NVIDIA GTC

Sponsoring the largest technology and AI events, to be held March 18-21 in San Jose, California Unveiling ProHawk’s edge to cloud solutions embedded across the suite of NVIDIA platforms Also demonstrating integrated solutions with BCD, Dedicated Computing, Network Optix, and Onyx Healthcare LAKE MARY, FLORIDA, March 12, 2024 – ProHawk Technology Group (ProHawk AI), a

Read More »

Visidon AI-powered Low-light Video Enhancement Selected for Hailo-15 AI Vision Processor

The CNN-based technology developed by Visidon allows for significant improvement to video analytics accuracy in low-light environments, marking a new era for intelligent cameras deployed in public spaces, smart cities, factories, buildings, retail locations, and more. March 12th 2024 – The leading AI chipmaker Hailo has selected Visidon CNN-powered low-light video enhancement for their Hailo-15

Read More »

BrainChip Boosts Space Heritage with Launch of Akida into Low Earth Orbit

Laguna Hills, Calif. – March 4, 2024 – BrainChip Holdings Ltd (ASX: BRN, OTCQX: BRCHF, ADR: BCHPY), the world’s first commercial producer of ultra-low power, fully digital, event- based, neuromorphic AI, today saw its Akida™ AI technology launched into low earth orbit aboard the Optimus-1 spacecraft built by the Space Machines Company. The successful launch

Read More »

AMD Extends Market-leading FPGA Portfolio with AMD Spartan UltraScale+ Family Built for Cost-sensitive Edge Applications

New FPGAs offer high I/O counts, power efficiency, and state-of-the-art security features for embedded vision, healthcare, industrial networking, robotics, and video applications SANTA CLARA, Calif., — March 5, 2024 — AMD (NASDAQ: AMD) today announced the AMD Spartan™ UltraScale+™ FPGA family, the newest addition to the extensive portfolio of AMD Cost-Optimized FPGAs and adaptive SoCs. Delivering cost

Read More »

How is AI Transforming the Semiconductor Industry?

This blog post was originally published at Digica’s website. It is reprinted here with the permission of Digica. The semiconductor industry stands as a driving force behind technological advancements, powering the devices that have become integral to modern life. As the demand for faster, smaller and more energy-efficient chips continues to grow, the industry faces

Read More »

5 Generative AI Use Cases Impacting Our Lives

This blog post was originally published at Qualcomm’s website. It is reprinted here with the permission of Qualcomm. Generative AI has unlocked the power of AI, and the potential is unlimited Since the introduction of ChatGPT in November 2022, the world has become enamored with the potential for artificial intelligence (AI). ChatGPT ushered in the

Read More »

Intel Launches Altera, Its New Standalone FPGA Company

Altera prioritizes customers with end-to-end FPGAs, accessible AI, software and supply resilience. What’s New: Today, Intel announced the official launch of Altera, its new standalone FPGA company. During the FPGA Vision Webcast, Chief Executive Officer Sandra Rivera and Chief Operating Officer Shannon Poulin unveiled their strategy to secure leadership across a $55 billion-plus market opportunity;

Read More »

Detecting Real-time Waste Contamination Using Edge Computing and Video Analytics

This blog post was originally published at NVIDIA’s website. It is reprinted here with the permission of NVIDIA. The past few decades have witnessed a surge in rates of waste generation, closely linked to economic development and urbanization. This escalation in waste production poses substantial challenges for governments worldwide in terms of efficient processing and

Read More »

Cadence Expands Tensilica Vision Family with Radar Accelerator and New DSPs Optimized for Automotive Applications

Highlights: Single DSPs for embedded vision, radar, lidar and AI processing boost performance while providing significant area, power and cost savings New radar accelerator provides a highly programmable hardware solution for offloading 4D imaging radar workloads, increasing performance Designed for sensor fusion processing in multi-sensor automotive, drone, robotics and autonomous vehicle system designs SAN JOSE,

Read More »

Cornell Tech Joins BrainChip University AI Accelerator Program

Laguna Hills, Calif. – February 27, 2024 – BrainChip Holdings Ltd (ASX: BRN, OTCQX: BRCHF, ADR: BCHPY), the world’s first commercial producer of ultra-low power, fully digital, event-based, neuromorphic AI IP, today announced that Cornell Tech has joined the BrainChip University AI Accelerator Program. Cornell Tech is an applied sciences and engineering campus in New

Read More »

Intel Core Ultra Extends AI PCs to the Enterprise with New Intel vPro Platform

New vPro platform delivers unmatched productivity, security, manageability and stability for businesses of all sizes. What’s New: Today at MWC 2024, Intel extends the benefits of the AI PC to commercial customers with the new Intel vPro® platform. The enhanced features of Intel® Core™ Ultra processors with available built-in Intel® Arc™ GPUs, and Intel® Core™

Read More »

Intel Announces New Edge Platform for Scaling AI Applications

The edge-native software platform simplifies development, deployment and management of edge AI applications. What’s New: At MWC 2024, Intel announced its new Edge Platform, a modular, open software platform enabling enterprises to develop, deploy, run, secure, and manage edge and AI applications at scale with cloud-like simplicity. Together, these capabilities will accelerate time-to-scale deployment for

Read More »

Here you’ll find a wealth of practical technical insights and expert advice to help you bring AI and visual intelligence into your products without flying blind.

Contact

Address

1646 N. California Blvd.,
Suite 360
Walnut Creek, CA 94596 USA

Phone
Phone: +1 (925) 954-1411
Scroll to Top