Fault Detection for Split Pins of Power Transmission Fittings in UAV Inspections via Automatic Image Cropping-based Super-Resolution Reconstruction and Enhanced YOLOv8
Download PDF
$currentUrl="http://$_SERVER[HTTP_HOST]$_SERVER[REQUEST_URI]"

Keywords

Split pins
Fault detection
Power transmission fittings
YOLO
Deep learning

DOI

10.26689/jera.v9i3.10614

Submitted : 2025-04-29
Accepted : 2025-05-14
Published : 2025-05-29

Abstract

In modern industrial applications, ensuring the reliability of mechanical fittings is critical for maintaining operational safety and efficiency, particularly in power grid systems where split pins serve a pivotal role despite being susceptible to environmental degradation and failure. Existing UAV-based inspection systems are hampered by a low representation of split pin elements and complex backgrounds, leading to challenges in accurate fault detection and timely maintenance. To address this pressing issue, our study proposes an innovative fault detection method for split pins. The approach employs a three-step process: first, cropping operations are used to accurately isolate the fittings containing split pins; second, super-resolution reconstruction is applied to enhance image clarity and detail; and finally, an improved YOLOv8 network, augmented with inner-shape IoU and local window attention mechanisms, is utilized to refine local feature extraction and annotation accuracy. Experimental evaluations on a split pin defect dataset demonstrate robust performance, achieving an accuracy rate of 72.1% and a mean average precision (mAP) of 67.7%, thereby validating the method’s effectiveness under challenging conditions. The proposed approach contributes to the field by specifically targeting the challenges associated with split pin detection in UAV-based inspections, offering a practically applicable and reliably precise method.

References

Zhang Y, Yuen K, 2022, Bolt Damage Identification based on Orientation-Aware Center Point Estimation Network. Structural Health Monitoring, 21(2): 438–450. https://doi.org/10.1177/14759217211004243

Yang L, Fan J, Liu Y, et al., 2020, A Review on State-of-the-Art Power Line Inspection Techniques. IEEE Transactions on Instrumentation and Measurement, 69(12): 9350–9365. https://doi.org/10.1109/TIM.2020.3031194

Toth J, Gilpin-Jackson A, 2010, Smart View for a Smart Grid — Unmanned Aerial Vehicles for transmission Lines. 2010 1st International Conference on Applied Robotics for the Power Industry, Montreal, QC, Canada, 1–6. https://doi.org/10.1109/CARPI.2010.5624465

Chen J, Liu Z, Wang H, et al., 2017, Automatic Defect Detection of Fasteners on the Catenary Support Device Using Deep Convolutional Neural Network. IEEE Transactions on Instrumentation and Measurement, 67(2): 257–269.

Liang H, Zuo C, Wei W, 2020, Detection and Evaluation Method of Transmission Line Defects Based on Deep Learning. IEEE Access, 8: 38448–38458.

Jiao R, Li K, Zhang X, et al., 2024, Bolt Defect Detection Method Based on Multiple Attention and Feature Alignment. Electric Power Information and Communication Technology, 22: 21–29.

Zhao Z, Qi H, Qi Y, et al., 2020, Detection Method Based on Automatic Visual Shape Clustering for Pin-Missing Defect in Transmission Lines. IEEE Transactions on Instrumentation and Measurement, 69(9): 6080–6091.

Sun J, Liu G, Liu H, 2023, Fine-Grained Detection of Pin Defects Based on Improved R-FCN and Class Activation Mapping. Guangdong Electric Power, 36: 50–57.

Zhong J, Liu Z, Han Z, et al., 2019, A CNN-Based Defect Inspection Method for Catenary Split Pins in High-Speed Railway. IEEE Transactions on Instrumentation and Measurement, 68(8): 2849–2860.

Wang H, Shao Y, Zou S, et al., 2021, Detection of Cotter Pins Missing of Connection Fittings on Transmission Lines of Power System. Proceedings of the 2021 40th Chinese Control Conference (CCC), 6873–6879.

Xiao L, Wu B, Hu Y, 2021, Missing Small Fastener Detection Using Deep Learning. IEEE Transactions on Instrumentation and Measurement, 70: 1–9.

Tao X, Zhang D, Wang Z, et al., 2020, Detection of Power Line Insulator Defects Using Aerial Images Analyzed With Convolutional Neural Networks. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 50(4): 1486–1498.

Liu L, Huang K, Bai Y, et al., 2024, Real-time Detection Model of Electrical Work Safety Belt based on Lightweight Improved YOLOv5. Journal of Real-Time Image Processing, 21(4): 151.

Weiss K, Khoshgoftaar TM, Wang D, 2016, A Survey of Transfer Learning. Journal of Big Data, 3(1): 9.

Li K, Yang S, Dong R, et al., 2020, Survey of Single Image Super-Resolution Reconstruction. IET Image Processing, 14(11): 2273–2290.

Goodfellow I, Pouget-Abadie J, Mirza M, et al., 2020, Generative Adversarial Networks. Commun. ACM, 63(11): 139–144.

Wang X, Yu K, Wu S, et al., 2018, ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks. Proceedings of the European Conference on Computer Vision (ECCV) Workshops.

Ledig C, Theis, L, Huszar-Ferenc C, et al., 2017, Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.

Wang X, Xie L, Dong C, et al., 2021, Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Data. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) Workshops, 1905–1914.

Córdova-Esparza TJ, Romero-González DM, Alenjandro J, 2023, A Comprehensive Review of YOLO Architectures in Computer Vision: From YOLOv1 to YOLOv8 and YOLO-NAS. Machine Learning and Knowledge Extraction, 5(4): 1680–1716.

Zheng Z, Wang P, Liu W, et al., 2020, Distance-IoU Loss: Faster and Better Learning for Bounding Box Regression. Proceedings of the AAAI Conference on Artificial Intelligence, 34: 12993–13000.

Zhang H, Zhang S, 2023, Shape-IoU: More Accurate Metric Considering Bounding Box Shape and Scale. arXiv preprint. https://doi.org/10.48550/arXiv.2312.17663

Zhang H, Xu C, Zhang S, 2023, Inner-IoU: More Effective Intersection over Union Loss with Auxiliary Bounding Box. arXiv preprint. https://doi.org/10.48550/arXiv.2311.02877

Vaswani A, Shazeer N, Parmar N, et al., 2017, Attention is All You Need. Advances in Neural Information Processing Systems, 30.

Dosovitskiy A, Beyer L, Kolesnikov A, et al., 2020, An Image is Worth 16x16 words: Transformers for Image Recognition at Scale. arXiv preprint. https://doi.org/10.48550/arXiv.2010.11929

Liu X, Peng H, Zheng N, et al., 2023, EfficientViT: Memory Efficient Vision Transformer with Cascaded Group Attention. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 14420–14430.