pj
Pierre-Jean Lapray Bourgogne Alsace UHA ENSISA school IRIMAS Laboratory
Associate Professor, HDR
Université de Haute-Alsace, ENSISA / IRIMAS
Research
Imaging science and systems (High Dynamic Range & Spectral Filter Array Imaging) Publications
ENSISA, 12 rue des Frères Lumière - 68093 Mulhouse Cedex, France (map) Google Scholar
pierre-jean.lapray (at) uha.fr (paintings)

Research Highlights
 
1. High Dynamic Range Imaging

Standard cameras capture only a fraction of the information that is visible to the human eye. This is specifically true for natural scenes including areas of low and high illumination due to transitions between sunlit and shaded areas. When capturing such a scene, many cameras are unable to store the full Dynamic Range (DR) resulting in low quality images where details are concealed in shadows or washed out by sunlight. High Dynamic Range (HDR) imaging techniques appear as a solution to overcome this issue. Recent research programs on machine vision have clearly demonstrated the benefits of real-time HDR vision. Finally, medical applications require high precision images and HDR lighting techniques to improve the rendering quality of imaging systems.

More information AND Demonstrations here

Sensor board 1 (XGI connectors)
Sensor board 1
Sensor board 2
Sensor board 2
HDR camera prototype 1
HDR camera prototype 1
HDR camera prototype 2
HDR camera prototype 2
Low exposure
Low exposure time
Middle exposure
Middle exposure time
High exposure
High exposure time
HDR result
HDR result (tone mapped with Duan et al.)
False color representation of radiance values
False color representation of relative radiance values
   
   
2. Spectral Filter Array Imaging

Multispectral acquisition improves machine vision since it permits capturing more information on object surface properties than color imaging. The concept of spectral filter arrays has been developed recently and allows multispectral single shot acquisition with a compact camera design. Due to filter manufacturing difficulties, there was, up to recently, no system available for a large span of spectrum, i.e., visible and Near Infra-Red acquisition. This work presents the achievement of a prototype of camera that captures seven visible and one near infra-red bands on the same sensor chip. This opens a new range of applications in security, robotics, automotive and medical fields.

Multispectral Filter Array
Multispectral Filter Array principle
Camera design
Spectral characteristic of the filters
Camera design
Camera design (Zynq FPGA)
   

Teaching Highlights
 
Cours d'Outils Mathématiques

Ce cours est à destination d'étudiants de 1ère année de la filière Automatique et Systèmes Embarqués (ASE) de l'École Nationale Supérieure d’Ingénieurs Sud-Alsace (ENSISA). Il est inspiré du cours donné par Pr. Pierre Ambs jusqu'en 2021 dans la même école. Nous présentons les outils de base du traitement du signal : la transformée de Laplace, la convolution et la transformée de Fourier, ainsi que les propriétés et méthodes de calcul associées. Les signaux étudiés seront pour la plupart continus, les signaux discrets et l'échantillonnage n'étant pas traités de manière complète dans ce cours. Le PDF du Cours est disponible ici :

Cours Outils Mathématiques

 
Journal Articles
     
2025 SSI Thomas J.-B., Lapray P.-J., Le Moan S. (2025), Trends in Snapshot Spectral Imaging: Systems, Processing, and Quality,  Sensors 2025, 25(3), 675 pdfpdf (1.1MB) bibtexbibtex
link
       
SSI Dumoulin R., Spote A., Lapray P.-J., Thomas J.-B., Farup I. (2025), Color–polarization filter array image demosaicing: linear minimum mean squared error augmented by anisotropic diffusion,  J. Electron. Imaging 34(3), 033044. pdfpdf (4.8MB) bibtexbibtex
link
       
2024 PO2024 Grillini F., Aksas L., Lapray P.-J., Foulonneau A., Thomas J.-B., George L., Bigué L. (2024), Relationship between reflectance and degree of polarization in the VNIR-SWIR: A case study on art paintings with polarimetric reflectance imaging spectroscopy,  Plos One, 19(5): e0303018. pdfpdf (3.4MB) bibtexbibtex
link
       
MSFA R. Serres J. R.,Lapray P-J, Viollet S., Kronland-Martinet T., Moutenet A., Morel O., Bigué L. (2024), Passive Polarized Vision for Autonomous Vehicles: A Review, Sensors 2024, 24(11), 3312 pdfpdf (48.8MB) bibtexbibtex
link
       
2022 OE2022 Sattar S., Lapray P.-J., Aksas L., Foulonneau A., Bigué L. (2022), Snapshot spectropolarimetric imaging using a pair of filter array cameras,  Optical Engineering, 61(4), 043104. pdfpdf (2.9MB) bibtexbibtex
Supplementary Materials
link
       
MSFA Lapray P.-J., Thomas J.-B., Farup I. (2022), Bio-Inspired Multimodal Imaging in Reduced Visibility,  Frontiers in Computer Science, 3. pdfpdf (3.1MB) bibtexbibtex
Supplementary Materials
link
       
2021 MSFA Courtier G., Lapray P.-J., Thomas J.-B., Farup I. (2021), Correlations in Joint Spectral and Polarization Imaging,  Sensors 2021, 21, 6. pdfpdf (10.9MB) bibtexbibtex
Supplementary Materials
link
       
2020 MSFA Lapray P.-J. (2020), Exploiting redundancy in color-polarization filter array images for dynamic range enhancement,  Optics Letters, Vol. 45, No. 19. pdfpdf (1.4MB) bibtexbibtex
Supplementary Materials
link
       
MSFA Giménez Y., Lapray P.-J., Foulonneau A., Bigué L. (2020), Calibration algorithms for polarization filter array camera: survey and evaluation,  J. Electron. Imaging 29(4), 041011. pdfpdf (1.7MB) bibtexbibtex
link
       
2018 PFA2018 Mihoubi S, Lapray P-J, and Bigué L (2018), Survey of Demosaicking Methods for Polarization Filter Array Images,  Sensors 2018, 18, 11. pdfpdf (5.5MB) bibtexbibtex
link
       
PFA Lapray P-J, Gendre L, Foulonneau A, and Bigué L (2018), An FPGA-based pipeline for micropolarizer array imaging,  J Circ Theor Appl. 2018;1–16. pdfpdf (1.4MB) bibtexbibtex
link
videos
       
2017 MSFA Lapray P-J, Thomas J-B, and Gouton P (2017), High Dynamic Range Spectral Imaging Pipeline For Multispectral Filter Array Cameras,  Sensors 2017, 17, 6. pdfpdf (16.4MB)
Supplementary Materials
bibtexbibtex
link
       
Energy balance Lapray P-J, Thomas J-B, Gouton P, and Ruichek Y (2017), Energy balance in Spectral Filter Array camera design,  Journal of the European Optical Society-Rapid Publications, (2017) 13: 1. doi:10.1186/s41476-016-0031-7. pdfpdf (3.4MB)
Matlab Code
bibtexbibtex
link
       
2016 MSFA Thomas J-B, Lapray P-J, Cédric C, and Gouton P (2016), Spectral Characterization of a Prototype SFA Camera for Joint Visible and NIR Acquisition,  Sensors 2016, 16, 993. pdfpdf (7.1MB)
Supplementary Materials
bibtexbibtex
link
       
2014 MSFA Lapray P-J, Wang X, Thomas J-B, and Gouton P (2014), Multispectral Filter Arrays: Recent Advances and Practical Implementation,  Sensors, Vol. 14(11), pp. 21626. 10.3390/s141121626. pdfpdf (11.5MB)
bibtexbibtex
link
       
HDR-ARtiSt Lapray P-J, Heyrman B, and Ginhac D (2014), HDR-ARtiSt: an adaptive real-time smart camera for high dynamic range imaging Journal of Real-Time Image Processing, pp. 1-16. Springer Berlin Heidelberg. pdfpdf (2.1MB)
bibtexbibtex
link
       
HDR colour

Lapray P-J, Heyrman B, and Ginhac D (2014), Hardware-based smart camera for recovering high dynamic range video from multiple exposures, Optical Engineering, Vol. 53(10), pp. 102110.

pdfpdf (4.8MB)
bibtexbibtex
link
     
Peer Reviewed Conference Papers
2024 QCAV 2019 Dumoulin R, Lapray P-J, Foulonneau A, and Bigué L (2024), Impact of interchannel misalignment on the performance of demosaicing algorithms dedicated to polarization images,  Proceedings Volume 12996, Unconventional Optical Imaging IV; 129960V, Strasbourg, France. pdfpdf (7.2MB)
bibtexbibtex
link
       
2023 QCAV 2023 Lapray P-J and Bigué L (2023), Performance comparison of division of time and division of focal plan polarimeters ,  Sixteenth International Conference on Quality Control by Artificial Vision, 2023, Albi, France. pdfpdf (15MB)
bibtexbibtex
link
       
CIC 2023 Thomas J-B, Lapray P-J, Derhak M. and Farup I. (2023), Standard representation space for spectral imaging,  in Color and Imaging Conference, 2023, pp 187 - 192. pdfpdf (0.5MB)
bibtexbibtex
link
       
SPIE 2023 Bigué L, Fouloneau A and Lapray P-J (2023), Production of high-resolution reference polarization images from real world scenes,  Proceedings Volume 12690, Polarization Science and Remote Sensing XI; SPIE Optical Engineering + Applications, 2023, San Diego, California, United States. pdfpdf (23MB)
Supplementary Materials
bibtexbibtex
link
       
IEEE 2023 Courtier G, Adam R, Lapray P.-J., Changey S., and Lauffenburger J.-P. (2023), Ground Vehicle Navigation Based on the Skylight Polarization,  IEEE/ION Position, Location and Navigation Symposium (PLANS) pdfpdf (30MB)
bibtexbibtex
link
       
2022 Photonics Europe 2022 Aksas L, Lapray P-J, Foulonneau A, and Bigué L (2022), Joint qualitative and quantitative evaluation of fast image dehazing based on dark channel prior,  Proc. SPIE 12136, Unconventional Optical Imaging III, 1213614 (20 May 2022), Strasbourg, France. pdfpdf (22MB)
posterposter(0.5MB) bibtexbibtex
link
       
MSFA Dumoulin R, Lapray P.-J., Thomas J.-B., (2022), Impact of training data on LMMSE demosaicing for Colour-Polarization Filter Array,  16th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS), 2022, Dijon, France. pdfpdf (14MB)
Matlab Code (CPFA)
Matlab Code (PFA)
bibtexbibtex
link
       
CFM Collaine A, Schrab B, Chassignet A et al., (2022), Influence de l’orientation des fibres sur la qualité du détourage d’éprouvettes UD-GFRP,  25e Congrès Français de Mécanique, 2022, Nantes, France. pdfpdf (1.3MB) bibtexbibtex
link
       
MSFA Courtier G, Adam R, Lapray P.-J., Pecheur E, Changey S., and Lauffenburger J.-P. (2022), Image-based navigation system using skylight polarization for unmanned ground vehicle,  Proc. SPIE 12124, Unmanned Systems Technology XXIV, 121240H, SPIE Defense + Commercial Sensing, 2022, Orlando, Florida, United States. pdfpdf (14MB)
posterposter(4.2MB) bibtexbibtex
link
       
gretsi2013 Courtier G, Adam R, Lapray P.-J., Pecheur E, Changey S., and Lauffenburger J.-P. (2022), Architecture matérielle et traitement d’images pour un système de navigation basé sur la polarisation de la lumière solaire, GRETSI'22 XXVIIIème Colloque Francophone de Traitement du Signal et des Images.
pdfpdf (30MB)
link
     
2021 PFA2018 Spote A, Lapray P-J, Thomas J-B, and Farup I (2021), Joint demosaicing of colour and polarisation from filter arrays,  Color and Imaging Conference 2021(29):288-293. pdfpdf (0.7MB)
posterposter(1.6MB)
Matlab Code (CPFA)
Matlab Code (PFA)
bibtexbibtex
link
       
MSFA Vigne, B and Lapray P.-J. (2021), Les Systèmes Embarqués Reconfigurables enseignés à des automaticiens,  CETSIS 2021 : Colloque de l'Enseignement des Technologies et des Sciences de l'Information et des Systèmes, 8-10 juin 2021, Valenciennes, France. pdfpdf (1.6MB) bibtexbibtex
link
       
2020 QCAV 2019 Sattar S, Lapray P-J, Foulonneau A, and Bigué L (2020), Review of spectral and polarization imaging systems,  Proc. SPIE 11351, Unconventional Optical Imaging II, 113511Q, Strasbourg, France. pdfpdf (0.4MB)
bibtexbibtex
link
       
2019 QCAV 2019 Giménez Y, Lapray P-J, Foulonneau A, and Bigué L (2019), Calibration for polarization filter array cameras: recent advances,  Fifteenth International Conference on Quality Control by Artificial Vision, 2019, Mulhouse, France. pdfpdf (0.5MB)
bibtexbibtex
link
       
2018 Photonics Europe 2018 Lapray P-J, Gendre L, Foulonneau A, and Bigué L (2018), A database of polarimetric and multispectral images in the visible and NIR regions,  In SPIE Photonics Europe. Strasbourg, France, April, 2018. pdfpdf (33.1MB)
posterposter (31.8MB) Supplementary Materials
bibtexbibtex
link
       
2017 CERN Emery J, Barjau A, Dehning B, Alvarez J H, Lapray P-J, and Macchini M (2017), Design and Validation Methodology of the Control System for a Particle Beam Size Measurement Instrument at the CERN Laboratory,  2017 American Control Conference (ACC), 2017. pdfpdf (1.9MB) bibtexbibtex
link
       
scia2017 Thomas J-B, Lapray P-J, and Gouton P. (2017), HDR Imaging Pipeline for Spectral Filter Array Cameras, In: Sharma P., Bianchi F. (eds) Image Analysis. SCIA 2017. Lecture Notes in Computer Science, vol 10270. Springer, Cham.
pdfpdf (3.0MB)
bibtexbibtex
link
     
icdsc2013 Lapray P-J, Thomas J-B, and Gouton P (2017), A Database of Spectral Filter Array Images that Combine Visible and NIR, Computational Color Imaging: 6th International Workshop, CCIW 2017, Milan, Italy, March 29-31, 2017, Proceedings.
pdfpdf (4.5MB)
Supplementary materials
bibtexbibtex
link
     
2016 Ghost removal Bouderbane M, Lapray P-J, Dubois J, Heyrman B, and Ginhac D (2016), Real-time ghost free HDR video stream generation using weight adaptation based method In Proceedings of the 10th International Conference on Distributed Smart Camera (ICDSC '16). ACM, New York, NY, USA, 116-120.
pdfpdf (2.8MB)
bibtexbibtex
link
     
Ghost removal Bouderbane M, Dubois J, Heyrman B, Lapray P-J, and Ginhac D (2016), Ghost removing for HDR real-time video stream generation Real-Time Image and Video Processing 2016, In Proc. SPIE. Vol. 9897, pp. 98970F-98970F-6.
pdfpdf (1.4MB)
bibtexbibtex
link
     
2015 Ghost removal overview Bouderbane M, Lapray P-J, Dubois J, Heyrman B, and Ginhac D (2015), Overview of ghost correction for HDR video stream generation, In Proc. of ACM In 4th Workshop on the Architecture of Smart Cameras. pdfpdf (0.6MB)
bibtexbibtex
link
     
Article 2015 Lapray P-J, Heyrman B, and Ginhac D (2015), High dynamic range adaptive real-time smart camera: an overview of the HDR-ARTiST project, Twelfth International Conference on Quality Control by Artificial Vision 2015, In Proc. SPIE. Vol. 9534, pp. 953417-953417-11. pdfpdf (2.3MB)
bibtexbibtex
link
2014 multispectral_camera Lapray P-J, Thomas J-B, and Gouton P, A Multispectral Acquisition System using MSFAs", Color and Imaging Conference. Colour Imaging Conference, Vol. 2014(2014), pp. 97-102.
pdfpdf (1.4MB)
bibtexbibtex
link
     
spie2014 Lapray P-J, Heyrman B, and Ginhac D (2014), HDR-ARtiSt: A 1280x1024-pixel Adaptive Real-time Smart camera for High Dynamic Range video, In SPIE Photonics Europe. Brussels, Belgium, April, 2014.
pdfpdf (1.8MB)
bibtexbibtex
link
     
2013 icdsc2013 Lapray P-J, Heyrman B, and Ginhac D (2013), A 1.3 megapixel FPGA-based smart camera for High Dynamic Range real-time video, In Distributed Smart Cameras (ICDSC), 2013 ACM/IEEE International Conference on.
pdfpdf (0.9MB)
bibtexbibtex
link
     
wasc2013 Lapray P-J, Heyrman B, and Ginhac D (2013), A smart camera for High Dynamic Range imaging, Second Workshop on Architecture of Smart Camera (WASC), Seville, Spain, 2013.
pdfpdf (2.4MB)
bibtexbibtex
link
     
gretsi2013 Lapray P-J, Heyrman B, and Ginhac D (2013), HDR-ARtiSt : une caméra intelligente dédiée à la vidéo à grande dynamique en temps réel, 24ème colloque Gretsi, Brest : France, 2013.
pdfpdf (1.9MB)
bibtexbibtex
link
     
2012 iscas2012 Lapray P-J, Heyrman B, Rosse M, and Ginhac D (2012), HDR-ARtiSt: High Dynamic Range Advanced Real-Time Imaging System, In Circuits and Systems (ISCAS), Proceedings of 2012 IEEE International Symposium on. Seoul, Corée, République De, May, 2012, pp. 1428-1431.
pdfpdf (1.2MB)
bibtexbibtex
link
     
scabot2012 Lapray P-J, Heyrman B, Rosse M, and Ginhac D (2012), High Dynamic Range Real-time Vision System for Robotic Applications, In IEEE Intelligent Robots and Systems (IROS). Villamoura, Portugal, October, 2012, pp. 1-5.
pdfpdf (4.9MB)
bibtexbibtex
link
     
scabot2012 Lapray P-J, Heyrman B, Rosse M, and Ginhac D (2012), Smart camera design for realtime High Dynamic Range imaging, First Workshop on Architecture of Smart Camera (WASC), Clermont ferrand: France, 2012.
pdfpdf (5.6MB)
bibtexbibtex
link
     
2011 icdsc2011 Lapray P-J, Heyrman B, Rosse M, and Ginhac D (2011), Smart camera design for realtime high dynamic range imaging, In Distributed Smart Cameras (ICDSC), 2011 Fifth ACM/IEEE International Conference on. Belgique, August, 2011, pp. 1-7.
pdfpdf (2.4MB)
bibtexbibtex
link
     
       
Short course
       
2017 Short course Thomas J-B, Monno Y, and Lapray P-J (2017). Spectral Filter Arrays Technology, Color and Imaging Conference, 25th Color and Imaging Conference, Society for Imaging Science and Technology, Sep 2017, Lillehammer, Norway. pdfpdf (12.2MB) bibtexbibtex
link
       
Ph.D. Thesis
       
2013 PhD Dissertation Lapray P-J (2013). New generation of high dynamic range vision systems, Thesis at: Université de Bourgogne, October, 2013. pdfpdf (76.9MB)
       
HDR Thesis
       
2024 PhD Dissertation Lapray P-J (2024). Imagerie par matrice de filtres : Pré-traitements et Mise en œuvre, Habilitation at: Université de Haute-Alsace, 8th February, 2024. pdfpdf
pdfslides
       
Invited Talks
       
2015 cern Lapray P-J (2015). New generation of real-time high dynamic range vision systems, Talk given at:
CERN, October 13, 2015, Geneva, Switzerland.
pdfpdf(4.5MB)
HTML version textIconLink

Valid XHTML 1.0 Transitional