Xavier MaldagueMaldagX@gel.ulaval.ca

http://mivim.gel.ulaval.ca

Report on projectInter-American Materials Research – Infrared Thermography for NDT

Chaire de recherche du CanadaTitulaire : Xavier Maldague

Xavier MaldagueCali, March 16, 2012

2

Outline

1. Université Laval2. Electrical and Computing Engineering Dept.3. Computing and Digital Systems Laboratory4. MIVIM Research Chair5. Infrared vision6. Some Recent MIVIM Activities7. Joint Inter-American project8. Conclusions

3

1. Université Laval

44

Our location in Canada

Université Laval

Located in Québec City, recognized by UNESCO as a World Heritage (1663, 1852), French speaking

over 45 000 students over 400 academic programs – undergraduate and graduate 235 research centres, chairs and institutes (our: Infrared Vision) 17 faculties (our: Science & Engineering) over 3,400 professors, part-time lecturers, teaching and research staff over 5,000,000 documents in its library collections Safe campus that covers 1.75 km2, 56% of which is wooded areas,

grasslands, botanical gardens and sports fields over 40 buildings and 10 km of underground tunnels linking all

buildings 2,277 individual rooms in on-campus residences one of the largest sport complexes in Canada

5

Université Laval

Our Pavilion

6

2. Electrical and Computer Engineering Dept.

600 students (150 graduate students) 23 Faculties 25 Employees 5 research laboratories:

7

8 Mar., 9:26, + 8.67°Chttp://meteo-laval.gel.ulaval.ca/

3. Computing, Vision & Digital Systems Laboratory

7 faculties, 60 graduate students, 1 technican , 5 research staff, 1 assistant

8

Neural NetworkFuzzy LogicModeling 2D/3D

Simulation SurgeryTrackingModeling 3DNDECompressionPe

rcep

tion

Action

Learning

Stereo VisionSensor 3DSensor IRVidéo

9

Computer Vision and Systems Laboratory - CVSL

The CVSL hosts the activities of 7 faculties and over 60 graduate students and research professionals, working on the central theme of computer vision and its industrial and biomedical applications:

http://vision.gel.ulaval.ca

• Evolutionary Computations,• 3-D Sensing and Modeling,• Virtual Reality and Simulation,• Video Sequence Processing,• Biological Vision,• Cognitive Vision, • Infrared Vision.

http://www.ulaval.ca

10

11

4. Infrared thermography research at the CVSL

Xavier Maldague has been professor at the Electrical and Computing Engineering Department of Laval University since 1989. Prof. Maldague started the research work in infrared thermography, NonDestructive Evaluation (NDE) techniques and vision and digital systems for industrial inspection in the CVSL.

• 3 books,• More than 300 papers,• Extensive work on infrared signal

processing and image analysis algorithms• Chair holder of MIVIM since 2004,

renewed: 2011.

Hakim Bendada joined the Computer Vision and Systems Laboratory at Laval University in Canada in 2005. His current scientific interests are centered on infrared vision and sensors, NDE, optical design in thermometry, opto-thermal inspection in industrial processes, photothermal diagnostics, and non-invasive thermophysics.

• More than 70 papers,• Extensive work on laser-beam

thermography, image processing and inverse problems in heat transfer.

12

Multipolar Infrared Vision Research Chair - MIVIM

The central long-term objective of this Canada Research Chair is to solve the key problems limiting the use of infrared vision in multi-polar civilian applications such as in NDE, numerical simulation, biotech and health sector, environment, security and other fields as well.

• 2 professors,• 1 Researcher,• 12 Ph. D. students,• 9 M. Sc. Students.

Canada Research Chairs

http://mivim.gel.ulaval.ca

13

Team MIVIM 2012

Professors (2): • Xavier Maldague (Chair holder) • Hakim Bendada

Researcher (1) :• Clemente Ibarra-Castanedo

Ph. D. (12) :• Hai Zhang, Moulay Akhloufi, Frank

Billy Djupkep Dizeu, Yuxia Duan, Amira Ebeid, Marc Grenier, Matthieu Klein, Louis St-Laurent, Reza Shoja Ghiass, Hai Zhang, Henrique Fernandes, Simon Fisette

M. Sc. (9) :• M.-A. Béland, N. Boutellis, Z. Fang, K.

Peycheva, L.-D. Théroux, É. Turenne, V. Paquin, Ph. Tran-Gia, O. Lévesque

Main research areas:• NDT, security, biomedical, etc.

http://mivim.gel.ulaval.ca

14

5. Infrared vision

15

5. Infrared vision

Infrared vision is a subdivision of computer vision (i.e. the use of computers to emulate human vision), which employs (low-, mid- and high-level) computerized processes to "make sense" of images generated in the infrared part of the electromagnetic (EM) spectrum.

Thermal emissions

Non-thermal reflections

Reflectography/ transmittography

Thermography

1000 mm

1

7

NIR

SWIR

FIR

MWIR5 Low

atmospheric transmittance

window

LWIR

14

32

0.7

atmospheric transmission

80%

0.01 mm

0.4 UV

100

VIS

THz Terahertz imaging

Non-thermal IR vision

16

NIR/SWIR reflections or transmissions Reflectography

Transmittography

17

Thermal IR vision

Thermal emissions

IR vision: summary of characteristics

NIR (0.7-1.1 mm) or SWIR(1.1-2.5 mm

Reflections/transmissions Single images

MWIR (3-5 mm) or LWIR (7-14 mm)

Thermal emissions 3D thermogram sequences

(time)

18

Non-thermal visionNon-thermal vision Thermal visionThermal vision

6. Some Recent MIVIM: Activities

19

IR vision application example: artworks inspection

20

Infrared reflectography/transmittography

21

Visible photograph

SWIR (1650 nm)NIR (780 nm)

Infrared reflectrograms

22

Non-thermal infrared visionand applications

23

Fat estimation in near infrared

The key grading criteria for the quality grades are carcass maturity, muscling, meat quality, external fat covering, and marbling.

Canadian beef grading

Fat estimation in near infrared (cont.)

24

NIR transmittogram mechanism through the meat: top and bottom

faces of meat sample

Visible NIR (940 nm)

Fat estimation in near infrared (cont.)

25

Model of two matched regions to evaluation the volume of the marbling

700 – 1100 nm

2626

3D illustration the two sides of the meat sample.(From top to bottom: VIS image top face; NIR image top face;

NIR image bottom face and VIS image bottom face.)

Sample 1 2 3 4 5 6 7 8

Propos

ed

method

(%)

MIN 13.44 11.59 15.7 17.92 19.5 14.19 1906 21.42MAX

30.36 26.91 30.79 23.6 24.97 21.69 26.07 23.76Chemical method

(%) 23.46 16.92 19.46 19.30 20.00 17.67 20.12 20.27Sample 9 10 11 12 13 14 15 16

Propos

ed

method

(%)

MIN 10.9 12.98 17.08 16.99 14.4 13.3 12 11.2MAX

28.44 31.86 40.26 40.73 31.46 20.18 17.9 17.1Chemical method

(%) 13.13 17.60 27.05 25.70 19.25 24.43 19.88 13.51Sample 17 18 19 20 21 22

Proposed method (%) MIN 8.3 12.9 15.4 24.4 8.79 6.7MAX 18.47 22.81 29.16 35.55 22.72 19.43

Chemical method (%) 9.55 15.65 18.77 30.60 13.51 12.80

Fat estimation in near infrared (cont.)

Vein extraction for Biometry, etc.

27

700 – 1100 nm

Light skin Dark intermediate skin

extraction

NIR reflectography/transmittography of GFRP

28

900 – 1700 nm

29

Thermal vision: Passive thermographyand applications

30

Acquisition Acquisition

Background subtraction Background subtraction

Blob tracking Blob tracking

Object tracking Object tracking

Merging

Infrared Visible

Master/Slave channel merging: dotted line

Security applications (1)

People tracking : visible + IR

31

People class: "Stop walking" and "Resume walking" actions

Vehicle class: "parking" and "starting" actions are shown

Security applications (2)

Parking lot

32

Biological applications (1)

Investigation of blood circulation in snow goose legs

33

Biological applications (2)

Farm Animal Production: Monitoring Applications

• Stress in chickens• Cow calving• Cow counting

1day, 16 day

3D air temperature measurement: local comfort assessment

34

A/ Visible cameraB/ IR cameraC/ Pan-tilt Unit

target

1

1,1,1,

n

iiirefrefn HvHvHv

Homography Hv between visible image n and reference visible image

1,,

HvirrefnHvHvirrefnHir

Homography Hir between IR image n and reference IR image

(RANSAC algorithm)

calib

ratio

n

3D air temperature measurement (cont.)

35

HxLxD=3m x 3m x3m

outsidevisible

temperature

36

Thermal vision: Active thermographyand applications

37

Active thermography for NDT (NonDestructive Testing)

Active thermography is based on the detection and recording by an infrared camera of thermal radiations emitted by object surface.

Presence of an internal defect reveals itself on surface by the temperature perturbation above this defect.

To detect defects, it is sometimes necessary to destabilize the object thermal state through heating or cooling (→ active thermography ).

Talk of Dr. Ibarra-Castanedo

7. Joint Inter-American projectCanada / Colombia

38

39

Joint Inter-American project: Canada / Colombia

Topic: Infrared Thermography for NonDestructive Testing (NDT)

Funded in Canada by: Natural Sciences and Engineering Research Council of Canada (NSERC) and in Colombia by Colciencias

Period 1 – 2004 to 2009 Period 2 – 2009 to 2012, including an «End-of-Project Seminar»

40

Joint Inter-American project: Involved students Graduate Student: Ph. D. completed

1. Mirela SUSA on Numerical modeling of pulse thermography experiments for defect characterization purposes (2009)

Graduate Student: Ph. D. in progress• Hai ZHANG on Infrared Thermography for Polymer NDT

(2012)• Henrique FERNANDES on Infrared Thermography for

Polymer Properties Assessment (2012)• Yuxia DUAN on Probability of detection for Infrared NDT

(2009)• Marc GRENIER on Inductive Infrared Thermography (2007)

41

Joint Inter-American project: Involved students

Graduate Student: M. Sc. completed1. Wael Ben LARBI on Comparaison of Modulated and Pulsed

Thermography (2007)2. Jean-Marc PIAU on Developpement of procedures for Sonic

Thermography (2007)3. Stéphane GUIBERT on Numerical Interface for

Thermography (2006)4. Chen LIU on Thermography of Complex Geometry

Specimens (2006)

42

Joint Inter-American project: Involved students

Graduate Student: M. Sc. in progress1. Phuong TranGia on Eddy Current Thermography for Cracks

Detection (2011)2. Kira Peycheva on Experimental Vibro-thermography (2010)

43

Joint Inter-American project: Papers (Cali+Quebec)

1. H. Benitez, H. Loaiza; E. F. Caicedo Bravo, C. Ibarra-Castanedo, A. Bendada; X. Maldague, “Defect characterization in infrared non destructive testing with learning machines,” NDT&E Int’l, 42: 630–643, 2009.

2. H. D. Benitez, C. Ibarra-Castanedo, A. Bendada, X. Maldague, H. Loaiza, E. Caicedo, “Definition of a new thermal contrast and pulse correction for defect quantification in pulsed thermography, Infrared Physics and Technology, 51[3]: 160-167, January 2008.

3. M. Susa, H. Benitez, C. Ibarra-Castanedo, H. Loaiza, A. Bendada, X. Maldague, “Phase contrast using Differentiated Absolute Contrast Method”, J. QIRT, 3[2]: 219-230, 2006.

4. H. Benitez , A. Bendada, C. Ibarra-Castanedo, X. Maldague, H. Loaiza, "Analytical forward and inversion modeling of infrared phase images using thermal quadrupole theory in pulsed phase thermography”, 9th AITA, Mexico, October 2007.

5. Ibarra-Castanedo C., González D., Benitez Restrepo H. D., Bendada H. and Maldague X. “Estado del arte en el procesado de señales infrarojas para la evaluación no destructiva de materiales,” XI Simposio de Tratamiento de Señales, Imágenes y Visión Artificial, Bogota, Colombia, Paper No. STS532, Septembre 13-15, 2006.

6. Benitez H., Ibarra-Castanedo C., Loaiza H., Caicedo E., Bendada A., and Maldague X. “Defect quantification with thermographic signal reconstruction and artificial neural networks,” QIRT 8 – Quantitative Infrared Thermography, Padova, Italy, June 28-30, 2006.

7. Susa M., Benitez H., Ibarra-Castanedo C., Loaiza H. and Maldague X. “Phase contrast using differentiated absolute contrast method,” QIRT 8 – Quantitative Infrared Thermography, Padova, Italy, June 28-30, 2006.

44

Joint Inter-American project: Papers (Period 2 only)1. Y. Duan, P. Servais, M. Genest, C. Ibarra-Castanedo, and X. P. V. Maldague, “ThermoPoD: A Reliability Study on Active Infrared Thermography for the

Inspection of Composite Materials,” submitted 14 Dec 2011 to Journal of Mechanical and Science Technology.2. C. Ibarra-Castanedo, A. Bendada, N. Avdelidis, X. P. V. Maldague, Nondestructive Assessment of Glass Fibre Composites by Mid-Wave and Near

Infrared Vision, Special Issue of Materials Transactions for APCNDT 2009, accepted Nov. 28th, 2011.3. C. Ibarra-Castanedo, N. P. Avdelidis, E. G. Grinzato, P. G. Bison, S. Marinetti, C. Cochior Plescanu, A. Bendada and X. P. Maldague, “Delamination

detection and impact damage assessment of GLARE by active thermography,” Int. J. Materials and Product Technology, 41[1/2/3/4]: 5-16, 2011.4. Fr. J. Madruga, C. Ibarra-Castanedo, O. M. Conde, J. M. López-Higuera, X. Maldague, Infrared thermography processing based on higher-order

statistics, NDT & E International, 43[8]: 661-666, November 2010.5. M. Susa, X. Maldague, I. Boras, "Improved method for absolute thermal contrast evaluation using Source Distribution Image (SDI), Infrared Physics &

Technology, 53: 197-203, March 2010.6. C. Ibarra-Castanedo, A. Bendada, X. P. V. Maldague, N. Avdelidis, "Nondestructive assessment of glass fibre composites by near and mid-wave

infrared vision," accepted to Materials Transactions of Japan Soc. for NonDestructive Inspection (JSNDI), 2.2012.7. C. Ibarra-Castanedo, J.-M. Piau, S. Guilbert, N. P. Avdelidis, M. Genest, A. Bendada and X. P. V. Maldague, “Comparative study of active thermography

techniques for the nondestructive evaluation of honeycomb structures,” Research in Nondestructive Evaluation, 20: 1-31, 2009.8. J.-M. Piau, A. Bendada and X. Maldague, “Ultrasound Vibrothermography Applications for Nondestructive Discontinuity Detection, ” Materials

Evaluation, 66[10]: 1047-1052, 2008.9. P. Servais, N. Gerlach, J. Habermehl, C. Ibarra-Castanedo and X. Maldague, “Characterization of manufacturing and maintenance aerospace

composite defects using infrared thermography, ” Materials Evaluation, 66[9]: 955-962, 2008. ASNT Outstanding Paper Award 2009.10. C. Ibarra-Castanedo, M. Genest, M.Grenier, J.-M. Piau, A. Bendada, X. Maldague, "Active infrared thermography with applications,"IEEE Canadian

Review / La Revue canadienne de l'IEEE”, 57:8-12, Spring / Printemps 2008.11. J.-M. Piau, A. Bendada, X. Maldague, J.-G. Legoux, Nondestructive inspection of open micro-cracks in thermallysprayed-coatings using ultrasound

excited vibrothermography, Nondestructive Testing and Evaluation, 23[2]: 109-120, 2008.12. M. Genest, D. S. Forsyth, X. Maldague, “Comparison of Solid Highlighter Materials for Thermography,” CINDE Journal, 28[4]: 7-12, JulyAugust 2007.13. C. Ibarra-Castanedo, M. Genest, P. Servais, X. P. V. Maldague and A. Bendada, “Qualitative and quantitative assessment of aerospace structures by

pulsed thermography,” Nondestructive Testing and Evaluation, special issue on infrared thermography, 22[2]: 199 - 215, 2007.14. + more than 30 conference papers

45

7. Conclusions

46

Conclusions

The Inter-American Materials Research Project Cali/Québec on Infrared Thermography for NDT has been quite successful in terms of: involved students and prepared papers (journals, conferences)

Many exchanges took place between Pontificia Universidad Javeriana and Université Laval

Plan is to continue our cooperation, for example by involving graduate students and working on common projects

47

THANK YOU FOR YOUR ATTENTION