Development of Image Processing & Thermal Camera for Railway Vehicle Bearing Inspection: A Review

Hanifar Kahira, F Ferryanto, Satrio Wicaksono


Inspection of the train’s bearings is an important aspect of maintaining the performance and operational safety of the rail transportation system. Bearings act as components that support wheel rotation and transmit loads between the wheels and the axles. The poor condition of bearings can cause operational disruptions, decreased efficiency, and even failures that can endanger the safety of train passengers and personnel. In recent years, the use of thermal camera sensor technology in the inspection of railway bearings has grown rapidly. The thermal camera sensor enables accurate temperature detection and visualization of heat patterns on the bearing surface. Abnormal heating patterns can indicate a problem such as excess friction, wear, or overheating that needs action. In this review paper, the importance of checking bearings on trains, image processing, and object detection technologies in detecting damage, the use of thermal camera sensors in inspections, and the benefits that can be obtained by implementing this technology will be discussed in detail. This study is intended to provide a better understanding of bearing inspection on trains and its contribution to improving the safety and efficiency of the rail transportation system.


Image Processing, Object Detection, Tapered Roller Bearing, Thermal Camera

Full Text:



KNKT, “Laporan Investigasi Kecelakaan Perkeretaapian Anjlokan KLB V2/10212 Di Emplasemen St. Pauhlima Sumatera Barat,” 2018.

R. Kumar et al., “Identification of localized defects and fault size estimation of taper roller bearing (NBC_30205) with signal processing using the Shannon entropy method in MATLAB for automobile industries applications,” Heliyon, vol. 8, no. 12, 2022, doi: 10.1016/j.heliyon.2022.e12053.

C. Yi, Y. Li, X. Huo, and K. L. Tsui, “A promising new tool for fault diagnosis of railway wheelset bearings: SSO-based Kurtogram,” ISA Trans., vol. 128, pp. 498–512, 2021, doi: 10.1016/j.isatra.2021.09.009.

A. Amini, M. Entezami, and M. Papaelias, “Onboard detection of railway axle bearing defects using envelope analysis of high frequency acoustic emission signals,” Case Stud. Nondestruct. Test. Eval., vol. 6, pp. 8–16, 2016, doi: 10.1016/j.csndt.2016.06.002.

S. Liu, Q. Wang, and Y. Luo, “A review of applications of visual inspection technology based on image processing in the railway industry,” Transp. Saf. Environ., vol. 1, no. 3, pp. 185–204, 2019, doi: 10.1093/tse/tdz007.

Y. Huang, C. Huang, J. Ding, and Z. Liu, “Fault diagnosis on railway vehicle bearing based on fast extended singular value decomposition packet,” Meas. J. Int. Meas. Confed., vol. 152, p. 107277, 2020, doi: 10.1016/j.measurement.2019.107277.

E. Balay-Dustrude et al., “Validating within-limb calibrated algorithm using a smartphone attached infrared thermal camera for detection of arthritis in children,” J. Therm. Biol., vol. 111, no. August 2022, p. 103437, 2023, doi: 10.1016/j.jtherbio.2022.103437.

C. Jiang et al., “Object detection from UAV thermal infrared images and videos using YOLO models,” Int. J. Appl. Earth Obs. Geoinf., vol. 112, no. October 2021, p. 102912, 2022, doi: 10.1016/j.jag.2022.102912.

T. Kim, J. Suh, J. Lee, B. Lee, and Y. Yu, “Fatigue life prediction of double-row tapered roller bearings considering thermal effect,” Adv. Mech. Eng., vol. 15, no. 2, pp. 1–17, 2023, doi: 10.1177/16878132231154099.

S. Ai, W. Wang, Y. Wang, and Z. Zhao, “Temperature rise of double-row tapered roller bearings analyzed with the thermal network method,” Tribol. Int., vol. 87, pp. 11–22, 2015, doi: 10.1016/j.triboint.2015.02.011.

S. Darmo et al., “Failure analysis of double-row tapered roller bearing outer ring used in Coal Wagon Wheelset,” Eng. Fail. Anal., vol. 135, no. September 2021, p. 106153, 2022, doi: 10.1016/j.engfailanal.2022.106153.

G. Jing, X. Qin, H. Wang, and C. Deng, “Developments, challenges, and perspectives of railway inspection robots,” Autom. Constr., vol. 138, no. January, p. 104242, 2022, doi: 10.1016/j.autcon.2022.104242.

M. Sol-Sánchez, J. M. Castillo-Mingorance, F. Moreno-Navarro, and M. C. Rubio-Gámez, “Smart rail pads for the continuous monitoring of sensored railway tracks: Sensors analysis,” Autom. Constr., vol. 132, no. September, pp. 1–14, 2021, doi: 10.1016/j.autcon.2021.103950.

D. Sun, Z. Xu, and Y. J. Yuan, “Detection of abnormal noises from tapered roller bearings by a sound sensing system,” 2017 24th Int. Conf. Mechatronics Mach. Vis. Pract. M2VIP 2017, vol. 2017-Decem, pp. 1–4, 2017, doi: 10.1109/M2VIP.2017.8211504.

R. Manish, A. Venkatesh, and S. D. Ashok, “ScienceDirect Machine Vision Based Image Processing Techniques for Surface Finish and Defect Inspection in a Grinding Process,” Mater. Today Proc., vol. 5, no. 5, pp. 12792–12802, 2018, doi: 10.1016/j.matpr.2018.02.263.

A. Colvalkar, S. S. Pawar, and B. K. Patle, “Materials Today : Proceedings In-pipe inspection robotic system for defect detection and identification using image processing,” Mater. Today Proc., vol. 72, pp. 1735–1742, 2023, doi: 10.1016/j.matpr.2022.09.476.

C. Mandriota, E. Stella, M. Nitti, N. Ancona, and A. Distante, “Rail corrugation detection by gabor filtering,” IEEE Int. Conf. Image Process., vol. 2, no. 1, pp. 626–628, 2001, doi: 10.1109/icip.2001.958571.

E. Deutschl, C. Gasser, A. Niel, and J. Werschonig, “Defect detection on rail surfaces by a vision based system,” IEEE Intell. Veh. Symp. Proc., pp. 507–511, 2004, doi: 10.1109/ivs.2004.1336435.

M. Singh, S. Singh, J. Jaiswal, and J. Hempshall, “Autonomous rail track inspection using vision based system,” Proc. 2006 IEEE Int. Conf. Comput. Intell. Homel. Secur. Pers. Safety, CIHSPS 2006, vol. 2006, no. October, pp. 56–59, 2006, doi: 10.1109/CIHSPS.2006.313313.

P. Jiang, D. Ergu, F. Liu, Y. Cai, and B. Ma, “A Review of Yolo Algorithm Developments,” Procedia Comput. Sci., vol. 199, pp. 1066–1073, 2021, doi: 10.1016/j.procs.2022.01.135.

Y. Wu, Y. Qin, Y. Qian, and F. Guo, “Automation in Construction Automatic detection of arbitrarily oriented fastener defect in high-speed railway,” Autom. Constr., vol. 131, no. January, p. 103913, 2021, doi: 10.1016/j.autcon.2021.103913.

X. Wei, Z. Yang, Y. Liu, D. Wei, L. Jia, and Y. Li, “Railway track fastener defect detection based on image processing and deep learning techniques: A comparative study,” Eng. Appl. Artif. Intell., vol. 80, no. January, pp. 66–81, 2019, doi: 10.1016/j.engappai.2019.01.008.

T. Bai, J. Yang, G. Xu, and D. Yao, “An optimized railway fastener detection method based on modified Faster R-CNN,” Meas. J. Int. Meas. Confed., vol. 182, no. March, p. 109742, 2021, doi: 10.1016/j.measurement.2021.109742.

X. Liyun, L. Boyu, M. Hong, and L. Xingzhong, “Improved faster R-CNN algorithm for defect detection in powertrain assembly line,” Procedia CIRP, vol. 93, no. March, pp. 479–484, 2020, doi: 10.1016/j.procir.2020.04.031.

Q. Yin, W. Yang, M. Ran, and S. Wang, “FD-SSD: An improved SSD object detection algorithm based on feature fusion and dilated convolution,” Signal Process. Image Commun., vol. 98, no. March, p. 116402, 2021, doi: 10.1016/j.image.2021.116402.

Y. LI, H. DONG, H. LI, X. ZHANG, B. ZHANG, and Z. XIAO, “Multi-block SSD based on small object detection for UAV railway scene surveillance,” Chinese J. Aeronaut., vol. 33, no. 6, pp. 1747–1755, 2020, doi: 10.1016/j.cja.2020.02.024.

A. Konieczka, E. Michalowicz, and K. Piniarski, “Infrared thermal camera-based system for tram drivers warning about hazardous situations,” Signal Process. - Algorithms, Archit. Arrange. Appl. Conf. Proceedings, SPA, vol. 2018-Septe, pp. 250–254, 2018, doi: 10.23919/SPA.2018.8563417.

N. Vorajee, A. Kumar, and A. Kumar, “ScienceDirect Analyzing capacity of a consumer-grade infrared camera in South Africa for cost- effective aerial inspection of building envelopes,” Front. Archit. Res., vol. 9, no. 3, pp. 697–710, 2020, doi: 10.1016/j.foar.2020.05.004.

X. Chen, S. Sheiati, and A. S. M. Shihavuddin, “AQUADA PLUS: Automated damage inspection of cyclic-loaded large-scale composite structures using thermal imagery and computer vision,” Compos. Struct., vol. 318, no. April, p. 117085, 2023, doi: 10.1016/j.compstruct.2023.117085.

J. D. Choi and M. Y. Kim, “A sensor fusion system with thermal infrared camera and LiDAR for autonomous vehicles and deep learning based object detection,” ICT Express, no. xxxx, 2022, doi: 10.1016/j.icte.2021.12.016.


  • There are currently no refbacks.