top of page

Research Blog

Buscar

Actualizado: 16 dic 2022

In recent years, it had been an evolution in the sensors used by vision systems. Different technologies from RGB camera, IR-camera, LIDAR, RADAR, or sensor combinations can work in different spectrum bands. A new alternative to the vision system is the single-pixel camera (SPC), an architecture based on the compressive sensing theory for 2D reconstruction images. SPC's feature is used as the single detector that measures the linear combinations of pixels through patterns projection of structured light over the object that would like to photograph instead of using an array of pixels as in RGB sensors or cameras. These architectures offer the advantage that they can be adapted to different spectrum bands as near-infrared (NIR), and could operate in scenarios with low visibility or under rain, mist, or fog conditions. Currently, there is little information that discusses the problem of spatial resolution in SPC in scattering conditions for which we defined a methodology to evaluate the spatial resolution SPC's in terms of point spread function (PSF), and we analyzed how it affected the spatial resolution with the distance and under foggy conditions, for an SPC with active illumination at the wavelength at 1550 nm.


Fig.1. Spatial resolution using Hilbert Scanning at 20 cm , with separation between x=10 mm and y=10 mm ∆x=11.6 mm and ∆y=12 mm without Fog (a-b), and ∆x=16 mm and ∆y=18 mm with Fog (c-d).

 

SCATTERING EFFECT


When light interacts with a water particle in the air, various physical phenomena occur as reflection, refraction, absorption, and scattering. The scattering is related to the particle size (sp), defined as: sp=πD/λ , where D is the particle diameter, and λ the incident

Fig.2 .I ncident beam scattering characteristics for

different particles size: a) Rayleigh regime λ >> D,

b) Mie regime λ∼D and c) Ray optical regime λ << D


photon wavelength. This scattering process is respectively related to the size of the particle. For small

scattering particles (see Fig. 2a), the distribution of scattered light is symmetric in the forward and backward directions. If the particle size increases, the scattered energy increases in the direction of the incident beam diminishing the amount of scattered light in the opposite direction (see Fig. 2b, 2c).


The scattering cross-section Qd is proportional to the radiation-particle interaction probability, and it is defined through the so-called effective area of the collision. For which the total scattering of the impinging light is proportional to the effect cross-section (Mie theory) multiplied by the amount of the particles present in the medium. The scattering cross-section is here related tospof the inter-acting particle through the probability of extinction of the photon, also known as the extinction efficiency, Qext, the scattering probability Qsca, and the absorption probability Qabs.



 

FOG EFFECT IN THE SPATIAL RESOLUTION



In scattering scenarios, present changes in the level of contrast in the scenes that affect the quality of the reconstructed 2D image, and deducting spatial resolution image. In the case of scenarios with fog the level contrast is defined by Beer–Lambert law , where the contrast decreases by an exponential factor with distance defined by Eq.(1), with β as scattering coefficients Eq.(2), and depend on Qsc is the scattering coefficient (calculate using matlab ), the radius of particles r andDdensityis the density of particles suspended in the medium.




Therefore, as the measurement distance increases, the SPC's ability for discriminate objects is reduced due to this scattering effect.




Fig.3 .NIR-SPI test image circle of 50 diameter: At focal length distance d1=18 cm, and d2=30 cm , a-e) basic scanning, b-f) Hilbert scanning, c-g) Zig-Zag scanning, d-h) Spiral scanning.




Fig.4.NIR-SPI test image circle under foggy conditions of 50 diameter: At focal length distance d1=18 cm, and d2=30 cm, a-e) basic scanning, b-f) Hilbert scanning, c-g) Zig-Zag scanning, d-h) Spiral scanning.



 

Actualizado: 11 oct 2022


A vision system to operate in fog conditions is an advantage in Unmanned Aerial Vehicle (UAV) navigation applications. It provides fast deployment at remote or challenging locations, being essential for many civil and military applications such as post-disaster relief assistance. Our SPI NIR system developed, if adopted in UAVs, offers a solution to perform better visualization of the scene in outdoor conductions if compared to conventional vision systems that are normally using RGB sensors operating in the visible spectrum. As explained, conventional systems operating in the VIS range present much higher image degradation in fog conditions than those operating in the NIR part of the spectra. In the literature, there are examples of the use of IR vision systems for UAVs for applications such as rescue missions that enable fast exploration in scenes with low-illumination, or operations performed in complex weather conditions that limit the drone visibility. Therefore, we believe that the NIR-SPI system presented has a great potential to be used in similar applications. Furthermore, SPI could be an alternative to the use of LIDAR technology.

Reconstruction 2D NIR-SPI a scenario of foggy and midday using HSI, FSI, and CS methods applying DCP algorithm.



3D reconstruction has become a challenging task for navigation systems in recent years. Therefore, different technologies such as RGB cameras, LIDARs, or RADAR can capture information from the environment and perform the 3D reconstruction. However, in an environment of high dispersion and low illumination, it is necessary to have a robust solution that operates in the infrared spectrum. One solution is to integrate Single-Pixel Near Infra-Red Imaging (NIR-SPI) technology, allowing mage reconstruction of a few samples and operating high dispersion conditions. Using an SPI-NIR vision system with active illumination for 3D image reconstruction in rainy environments is a solution. The reconstruction of 3D objects is performed from their construction of a low-resolution SPI-NIR 2D image, using a robust unified reflectance model that combines the Lambertian, Oren-Nayar, and Blinn-Phong models to improve the 3D image of objects with surface roughness or with low reflectance. For 3D reconstruction, single-view Shape-From-Shading (SFS) based on fast Eikonal solvers was used. Which makes it possible to improve the shape of the 3D object, reduce computation time for future applications and generate real-time 3D images in harsh environments.



bottom of page