Deep Learning-Based Thermal Imaging Analysis to Diagnose Abnormalities in Sports Buildings: Smart Cyber-Physical Monitoring Sensors at the Edge
)Abstract
A joint green-edge computing idea is now realized in practice with the help of intelligent infrastructure for modern sport venues, based on Internet of Things (IoT) platforms and Cyber-Physical Systems (CPS). To monitor their sports actions, athletes need smart environments. Using edge-enabled low-cost and low-power sensors, such as infrared monitoring systems that analyze thermal information, this environment should alert to possible physical damages. Early recognition of sports injuries and joint injuries can usually prevent athletes from pain and missing exercise. One of the most efficient methods for identifying pain and movement problems is to monitor the energy emitted by lower limb injuries. By analyzing thermal images of the lower body parts, this research attempts to automatically identify sports injuries. The thermal image is first isolated from the region of interest. Convolutional structures are applied to identify lesions using a newly developed and optimized method. The performance of the classifier is performed with the possibility of deep learning by pruning the features, to reduce the computational complexity and improve the accuracy, and a model has been developed based on the classification of sports injuries in binary mode (i.e., whether the lesions are present or not) and multiclass mode (i.e., the severity of sports injuries) resulted in optimal results. Thermal images show the different states of joints, including lesions caused by various sports in the lower limbs. This model could provide the ability of solving uncertainty of answers, repeatability, and convergence towards minimum error. As compared to conventional feature extraction and classification approaches, the outputs are more acceptable. By taking advantage of the K-fold cross-validation method, the average error of the proposed method to detect the severity of damage is less than 2.22%.
References
P. A. Gribble, C. M. Bleakley, B. M. Caulfield, C. L. Docherty, F. Fourchet, D. T. P. Fong, J. Hertel, C. E. Hiller, T. W. Kaminski, P. O. McKeon, et al., Evidence review for the 2016 International Ankle Consortium consensus statement on the prevalence, impact and long-term consequences of lateral ankle sprains, Br. J. Sports Med., vol. 50, no. 24, pp. 1496–1505, 2016.
B. Pandey, D. Joshi, A. S. Arora, N. Upadhyay, and H. S. Chhabra, A deep learning approach for automated detection and segmentation of pressure ulcers using infrared-based thermal imaging, IEEE Sens. J., vol. 22, no. 15, pp. 14762–14768, 2022.
T. J. Gabbett and D. G. Jenkins, Relationship between training load and injury in professional rugby league players, J. Sci. Med. Sport, vol. 14, no. 3, pp. 204–209, 2011.
T. J. Gabbett, The training-injury prevention paradox: Should athletes be training smarter and harder? Br. J. Sports Med., vol. 50, no. 5, pp. 273–280, 2016.
P. Kumar, A. Gaurav, R. K. Rajnish, S. Sharma, V. Kumar, S. Aggarwal, and S. Patel, Applications of thermal imaging with infrared thermography in orthopaedics, J. Clin. Orthop. Trauma, vol. 24, p. 101722, 2022.
F. Roggio, L. Petrigna, V. Filetti, E. Vitale, V. Rapisarda, and G. Musumeci, Infrared thermography for the evaluation of adolescent and juvenile idiopathic scoliosis: A systematic review, J. Therm. Biol., vol. 113, p. 103524, 2023.
E. Z. Barcelos, W. M. Caminhas, E. Ribeiro, E. M. Pimenta, and R. M. Palhares, A combined method for segmentation and registration for an advanced and progressive evaluation of thermal images, Sensors, vol. 14, no. 11, pp. 21950–21967, 2014.
A. P. D. de Lacerda, P. R. de Andrade, D. H. Kamonseki, N. A. Parizotto, A. S. A. da Silva, L. B. de Medeiros, and J. J. de Almeida Ferreira, Accuracy of infrared thermography in detecting tendinopathy: A systematic review with meta-analysis, Phys. Ther. Sport, vol. 58, pp. 117–125, 2022.
J. H. L. Branco, R. L. L. Branco, T. C. Siqueira, L. C. de Souza, K. M. S. Dalago, and A. Andrade, Clinical applicability of infrared thermography in rheumatic diseases: A systematic review, J. Therm. Biol., vol. 104, p. 103172, 2022.
J. L. Ramirez-GarciaLuna, R. Bartlett, J. E. Arriaga-Caballero, R. D. J. Fraser, and G. Saiko, Infrared thermography in wound care, surgery, and sports medicine: A review, Front. Physiol., vol. 13, p. 838528, 2022.
A. Lubkowska and A. Knyszyńska, Thermographic assessment of skin temperature changes following partial body cryostimulation (PBC) in football players, Appl. Sci., vol. 13, no. 7, p. 4123, 2023.
G. P. Kenny and O. Jay, Sex differences in postexercise esophageal and muscle tissue temperature response, Am. J. Physiol. Regul. Integr. Comp. Physiol., vol. 292, no. 4, pp. R1632–R1640, 2007.
H. Jung, J. Seo, K. Seo, D. Kim, and S. Park, Detection of muscle activation during resistance training using infrared thermal imaging, Sensors, vol. 21, no. 13, p. 4505, 2021.
A. Aryal and B. Becerik-Gerber, A comparative study of predicting individual thermal sensation and satisfaction using wrist-worn temperature sensor, thermal camera and ambient temperature sensor, Build. Environ., vol. 160, p. 106223, 2019.
S. G. Vieira, M. Sillero-Quintana, A. G. da Silva, K. O. Marins, and J. C. B. Marins, Thermographic response resulting from strength training: A preliminary study, Apunts Sports Med., vol. 55, no. 208, pp. 120–127, 2020.
A. Knyszyńska, A. Radecka, and A. Lubkowska, Thermal imaging of exercise-associated skin temperature changes in swimmers subjected to 2-min intensive exercise on a VASA swim bench ergometer, Int. J. Environ. Res. Public Health, vol. 18, no. 12, p. 6493, 2021.
S. Piñonosa, M. Sillero-Quintana, L. Milanović, J. Coterón, and J. Sampedro, Thermal evolution of lower limbs during a rehabilitation process after anterior cruciate ligament surgerya, Kinesiology, vol. 45, no. 1, pp. 121–129, 2013.
C. Hildebrandt, C. Raschner, and K. Ammer, An overview of recent application of medical infrared thermography in sports medicine in Austria, Sensors, vol. 10, no. 5, pp. 4700–4715, 2010.
D. Perpetuini, C. Filippini, D. Cardone, and A. Merla, An overview of thermal infrared imaging-based screenings during pandemic emergencies, Int. J. Environ. Res. Public Health, vol. 18, no. 6, p. 3286, 2021.
O. Trejo-Chavez, J. P. Amezquita-Sanchez, J. R. Huerta-Rosales, L. A. Morales-Hernandez, I. A. Cruz-Albarran, and M. Valtierra-Rodriguez, Automatic knee injury identification through thermal image processing and convolutional neural networks, Electronics, vol. 11, no. 23, p. 3987, 2022.
V. Lohchab, P. Rathod, P. K. Mahapatra, V. Bachhal, and A. Hooda, Non-invasive assessment of knee osteoarthritis patients using thermal imaging, IET Sci. Meas. Technol., vol. 16, no. 4, pp. 242–249, 2022.
F. J. González, Theoretical and clinical aspects of the use of thermography in non-invasive medical diagnosis, Biomed. Spectrosc. Imaging, vol. 5, no. 4, pp. 347–358, 2016.
C. Jin, Y. Yang, Z. L. Xue, K. M. Liu, and J. Liu, Automated analysis method for screening knee osteoarthritis using medical infrared thermography, J. Med. Biol. Eng., vol. 33, no. 5, pp. 471–477, 2013.
M. A. Calin, G. Mologhianu, R. Savastru, M. R. Calin, and C. M. Brailescu, A review of the effectiveness of thermal infrared imaging in the diagnosis and monitoring of knee diseases, Infrared Phys. Technol., vol. 69, pp. 19–25, 2015.
R. Lasanen, E. Piippo-Savolainen, T. Remes-Pakarinen, L. Kröger, A. Heikkilä, P. Julkunen, J. Karhu, and J. Töyräs, Thermal imaging in screening of joint inflammation and rheumatoid arthritis in children, Physiol. Meas., vol. 36, no. 2, pp. 273–282, 2015.
A. E. Denoble, N. Hall, C. F. Pieper, and V. B. Kraus, Patellar skin surface temperature by thermography reflects knee osteoarthritis severity, Clin. Med. Insights Arthritis Musculoskelet. Disord., vol. 3, pp. 69–75, 2010.
O. Akbarzadeh, S. Hamzehei, H. Attar, A. Amer, N. Fasihihour, M. R. Khosravi, and A. A. Solyman, Heating-cooling monitoring and power consumption forecasting using LSTM for energy-efficient smart management of buildings: A computational intelligence solution for smart homes, Tsinghua Science and Technology, vol. 29, no. 1, pp. 143–157, 2024.
K. Zhu and T. Zhang, Deep reinforcement learning based mobile robot navigation: A review, Tsinghua Science and Technology, vol. 26, no. 5, pp. 674–691, 2021.
A. Tiulpin and S. Saarakkala, Automatic grading of individual knee osteoarthritis features in plain radiographs using deep convolutional neural networks, Diagnostics, vol. 10, no. 11, p. 932, 2020.
P. dos Santos Bunn, M. E. K. Miranda, A. I. Rodrigues, R. de Souza Sodré, E. B. Neves, and E. Bezerra da Silva, Infrared thermography and musculoskeletal injuries: A systematic review with meta-analysis, Infrared Phys. Technol., vol. 109, p. 103435, 2020.
D. Fokam and C. Lehmann, Clinical assessment of arthritic knee pain by infrared thermography, J. Basic Clin. Physiol. Pharmacol., vol. 30, no. 3, p. 20170218, 2019.
A. Arfaoui, M. A. Bouzid, H. Pron, R. Taiar, and G. Polidori, Application of infrared thermography as a diagnostic tool of knee osteoarthritis, J. Therm. Sci. Technol., vol. 7, no. 1, pp. 227–235, 2012.
U. Snekhalatha, T. Rajalakshmi, M. Gopikrishnan, and N. Gupta, Computer-based automated analysis of X-ray and thermal imaging of knee region in evaluation of rheumatoid arthritis, Proc. Inst. Mech. Eng. Part H: J. Eng. Med., vol. 231, no. 12, pp. 1178–1187, 2017.
A. Anaya-Isaza and M. Zequera-Diaz, Detection of diabetes mellitus with deep learning and data augmentation techniques on foot thermography, IEEE Access, vol. 10, pp. 59564–59591, 2022.
K. Rezaee, A. Rezaee, N. Shaikhi, and J. Haddadnia, Multi-mass breast cancer classification based on hybrid descriptors and memetic meta-heuristic learning, SN Appl. Sci., vol. 2, no. 7, p. 1297, 2020.
X. Yang and J. A. Esquivel, Time-aware LSTM neural Networks for dynamic personalized recommendation on business intelligence, Tsinghua Science and Technology, vol. 29, no. 1, pp. 185–196, 2024.
S. Bardhan, S. Nath, T. Debnath, D. Bhattacharjee, and M. K. Bhowmik, Designing of an inflammatory knee joint thermogram dataset for arthritis classification using deep convolution neural network, Quant. InfraRed Thermogr. J., vol. 19, no. 3, pp. 145–171, 2022.
京公网安备11010802044758号