This project targets research of novel event-based sensor architectures for incorporating image analysis structures and hence, visual perception capabilities to InfraRed (IR) imaging defense systems. The rationale for the endeavor is that the incorporation of image análisis capabilities at the edge has been barely explored for IR sensors to date, despite the significant increase in the demand for intelligent IR imaging systems in many application scenarios, including defense as relevant area addressed in this proposal.
Such increased demand has prompted significant development at the sensing edge, including uncooled photonic sensors based on Vapor Phase Deposition (VPD) of materials to implement different types of IR-sensitive diodes, like HgCdTe or PbSe, with enhanced sensing
capabilities. The heterogeneous combination of these enhanced sensors with CMOS Focal Plane Arrays (FPA) consisting of the new generation of mature vertical integration technologies defines the conceptual framework for the proposal of new generations of high-speed and low-cost IR vision systems with pixels capable of performing intelligent tasks with small area footprint and competitive pitch.
In parallel, over the past decade, the industrial interest in event-based Dynamic Vision Sensors (DVS) with in-pixel intelligence has experienced unprecedented growth. Esteemed multinational vision sensor developers, including industry giants such as Samsung, Sony, Omnivision, and Prophesee, have swiftly integrated DVS sensors into their comprehensive sensor catalogs. However, implementing DVS sensors in the IR domain is still incipient. Commercial IR image sensors do not perform focal plane processing at the pixel level.
For the given reasons, the actual context is propitious to the development of novel IR vision sensors with event-based operation and in-pixel processing capabilities. The proposal lies on the previous expertise and trajectory of the proposing group regarding CMOS vision sensor chips with event-based operation for the visible part of the light spectrum, whose achievements include significant academic production, patents, and the transfer to industry.
Advertising and communication:
Project PID2023-147244OB-I00 funded by MICIU/AEI/10.13039/501100011033 and FEDER, UE
