In-pixel processing embeds computation capabilities inside the pixel array and achieves higher energy efficiency by generating low-level features instead of the raw data stream from CMOS image sensors. Different in-pixel processing techniques and approaches have been demonstrated on conventional frame-based CMOS imagers; however, current designs can require excessive amounts of circuit area, require unusual circuit elements that are difficult to fabricate, or lack the necessary configurability.
UW-Madison researchers have created a new in-pixel processing approach to provide an in-pixel processing system that employs weighting elements flexibly interconnected to different pixels by a switch network allowing both a sharing of weighting values among pixels, to reduce total circuit area, and the ability to locate the weighting circuitry away from the light-sensitive pixel regions for improved pixel density.