Journal of Guangxi Normal University(Natural Science Edition) ›› 2020, Vol. 38 ›› Issue (6): 21-31.doi: 10.16088/j.issn.1001-6600.2020.06.003

Previous Articles     Next Articles

A Method for Detecting Metal Surface Defects Based on Photometric Stereo and Series Expansion Methods

ZHU Yongjian*, LUO Jian, QIN Yunbai, QIN Guofeng, TANG Chuliu   

  1. College of Electronic Engineering, Guangxi Normal University, Guilin Guangxi 541004, China
  • Received:2020-02-29 Published:2020-11-30

PDF (PC)

85

Abstract: In the detection of metal surface defects with rough textures, the online machine vision inspection system encounters the problems of error detection, missing detection. In addition, photometric solids have problems such as distortion and warpage of reconstructed curved surfaces when reconstructing the three-dimensional topography of metal surfaces. To address these problems, a metal surface defect detection method based on photometric solid and series expansion is proposed. Firstly, this method uses the photometric stereo principle to reconstruct the metal surface in three dimensions. Secondly, uses the series expansion method to fit the reconstructed surface. Then, the fitted surface is converted into point cloud data. Finally, the point cloud data is processed to complete defect detection.Experimental results show that this method solves the problem of distortion and warpage of reconstructed surfaces, and at the same time, improves the ability to detect defects on metal surfaces. Compared with the method without surface fitting, the defect detection rate of this method has increased by more than 4 percentage points.

Key words: photometric stereo, series expansion, point cloud data, metal surface defects, detection

CLC Number: 

  • TP391
[1] WOODHAM R J. Photometric method for determining surface orientation from multiple images[J]. Optical Engineering, 1980,19(1): 191139. DOI:10.1117/12.7972479.
[2] 冯青春, 陈建, 李翠玲, 等. 基于光度立体视觉的蔬菜秧苗叶片形态测量方法[J]. 农业机械学报, 2018, 49(5): 43-50. DOI:10.6041/j.issn.1000-1298.2018.05.005.
[3] 蔡轶珩, 张琳琳, 盛楠, 等. 基于光度立体法的中医舌体三维表面重建[J]. 电子与信息学报, 2015, 37(11): 2564-2570. DOI:10.11999/JEIT150124.
[4] 杨晓波, 黄秀宝. 基于光度立体视觉的起皱织物表面形态重建研究[J].东华大学学报(自然科学版), 2002, 28(2): 48-55. DOI:10.3969/j.issn.1671-0444.2002.02.011.
[5] 黄秀玲, 陆宏建, 任超, 等. 基于四光源光度立体法的药品泡罩包装中铝箔缺陷检测方法[J]. 包装学报, 2018, 10(3): 47-51.
[6] 程耀瑜, 常国立, 田晓杰. 基于光度立体技术的地板疵点检测方法[J]. 科学技术与工程, 2017, 17(30): 263-267. DOI:10.3969/j.issn.1671-1815.2017.30.040.
[7] 刘根, 蔡念, 肖盼, 等. 基于光度立体和图像显著性的皮革缺陷检测[J]. 计算机工程与应用, 2019, 55(8): 215-219. DOI:10.3778/j.issn.1002-8331.1712-0413.
[8] 岳珂娟, 郑明才, 肖建华, 等. 结合背景先验和对象先验的显著性检测[J]. 应用科学学报, 2016, 34(4): 451-460. DOI:10.3969/j.issn.0255-8297.2016.04.010.
[9] 王磊, 徐科. 基于光度立体的带钢表面缺陷三维检测方法[C]// 第十届中国钢铁年会暨第六届宝钢学术年会论文集.北京: 冶金工业出版社, 2015: 599-603.
[10] SOUKUP D, HUBER-MÖRK R. Convolutional neural networks for steel surface defect detection from photometric stereo images[C]// Advances in Visual Computing: Lecture Notes in Computer Science Volume 8887.Berlin: Springer, 2014: 668-677. DOI:10.1007/978-3-319-14249-4_64.
[11] 关月, 江鹏, 董雪. 基于视觉的小模数样板花键参数检测的研究[J]. 组合机床与自动化加工技术, 2017(6): 106-109, 113. DOI:10.13462/j.cnki.mmtamt.2017.06.027.
[12] 朱勇建, 彭柯, 漆广文, 等. 基于机器视觉的太阳能网版缺陷检测[J]. 广西师范大学学报(自然科学版), 2019, 37(2): 105-112. DOI:10.16088/j.issn.1001-6600.2019.02.012.
[13] 李健, 马泳潮, 马文. 基于光度立体法的织物三维数字化研究[J]. 陕西科技大学学报(自然科学版), 2014,32(5): 152-155, 160. DOI:10.3969/j.issn.1000-5811.2014.05.032.
[14] 李健, 张博文, 何斌. 基于偏微分法的光度立体三维重建[J]. 陕西科技大学学报, 2018, 36(6): 170-175, 182. DOI:10.19481/j.cnki.issn2096-398x.2018.06.028.
[15] FRANKOT R T, CHELLAPPA R. A method for enforcing integrability in shape from shading algorithms[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1988, 10(4): 439-451. DOI:10.1109/34.3909.
[16] HARKER M, O’LEARY P. Regularized reconstruction of a surface from its measured gradient field[J]. Journal of Mathematical Imaging and Vision, 2015, 51(1): 46-70. DOI:10.1007/s10851-014-0505-4.
[17] 朱勇建, 朱立新, 钟建平, 等. 条纹反射法测量三维面形中的积分算法[J]. 光子学报, 2018, 47(11): 1112001. DOI:10.3788/gzxb20184711.1112001.
[18] QUÉAU Y, DUROU J D, AUJOL J F. Normal integration: a survey[J]. Journal of Mathematical Imaging and Vision, 2018, 60(4): 576-593. DOI: 10.1007/s10851-017-0773-x.
[19] BÄHR M, BREUβ M, QUÉAU Y, et al. Fast and accurate surface normal integration on non-rectangular domains[J]. Computational Visual Media, 2017, 3(2): 107-129. DOI:10.1007/s41095-016-0075-z.
[20] DUROU J D, AUJOL J F, COURTEILLE F. Integrating the normal field of a surface in the presence of discontinuities[C]// Energy Minimization Methods in Computer Vision and Pattern Recognition: Lecture Notes in Computer Science Volume 5681. Berlin: Springer, 2009: 261-273. DOI:10.1007/978-3-642-03641-5_20.
[21] 郭良贤, 卫俊杰, 唐培. Zernike圆域多项式镜面拟合仿真与精度研究[J]. 光学与光电技术, 2018, 16(6): 56-62. DOI:10.19519/j.cnki.1672-3392.2018.06.010.
[22] 韩路, 田爱玲, 聂凤明, 等. Zernike多项式的条纹反射三维面形重建算法研究[J]. 西安工业大学学报, 2019, 39(2): 137-144. DOI:10.16185/j.jxatu.edu.cn.2019.02.003.
[23] ZHANG Z. A flexible new technique for camera calibration[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000, 22(11): 1330-1334. DOI:10.1109/34.888718.
[24] 夏海英, 刘伟涛, 朱勇建. 一种改进的快速SUSAN棋盘格角点检测算法[J]. 广西师范大学学报(自然科学版), 2018, 36(1): 44-52. DOI:10.16088/j.issn.1001-6600.2018.01.006.
[25] 成宽洪, 周慧鑫, 秦翰林, 等. 基于曲率滤波和梯度变换的图像增强[J]. 光子学报, 2017, 46(7): 0710001. DOI:10.3788/gzxb20174607.0710001.
[26] 邵闯, 王生怀, 徐风华, 等. 基于图像处理的混凝土表面裂缝检测研究[J]. 湖北汽车工业学院学报, 2019, 33(2): 47-50, 59. DOI:10.3969/j.issn.1008-5483.2019.02.010.
[1] TANG Rongchai, WU Xiru. Real-time Detection of Passion Fruit Based on Improved YOLO-V3 Network [J]. Journal of Guangxi Normal University(Natural Science Edition), 2020, 38(6): 32-39.
[2] BAI Jie, GAO Haili, WANG Yongzhong, YANG Laibang, XIANG Xiaohang, LOU Xiongwei. Detection of Students’ Classroom Performance Based on Faster R-CNN and Transfer Learning with Multi-Channel Feature Fusion [J]. Journal of Guangxi Normal University(Natural Science Edition), 2020, 38(5): 1-11.
[3] MA Ling, LUO Xiaoshu, JIANG Pinqun. An Ink-jetted Code Character Recognition MethodBased on Probabilistic Neural Network [J]. Journal of Guangxi Normal University(Natural Science Edition), 2020, 38(4): 32-41.
[4] ZHANG Yongsheng, ZHU Wenjun, SHI Ruoqi, DU Zhenhua, ZHANG Rui, WANG Zhi. A Confidence-guided Hybrid Android Malware DetectionSystem with Multiple Heterogeneous Algorithms [J]. Journal of Guangxi Normal University(Natural Science Edition), 2020, 38(2): 19-28.
[5] LIU Yingxuan, WU Xiru, XUE Ganggang. Multi-target Real-time Detection for Road Traffic SignsBased on Deep Learning [J]. Journal of Guangxi Normal University(Natural Science Edition), 2020, 38(2): 96-106.
[6] XIAO Yiqun, SONG Shuxiang, XIA Haiying. Fast Pedestrian Detection Method Based on Multi-Features    and Implementation [J]. Journal of Guangxi Normal University(Natural Science Edition), 2019, 37(4): 61-67.
[7] ZHU Yongjian, PENG Ke, QI Guangwen, XIA Haiying, SONG Shuxiang. Defect Detection of Solar Panel Based on Machine Vision [J]. Journal of Guangxi Normal University(Natural Science Edition), 2019, 37(2): 105-112.
[8] LIU Jinlong,GUO Yan, YU Zhihua, LIU Yue,YU Xiaoming,CHENGXueqi. A New Method to Detect Busty Events with Different Media Data Based on Word Clustering [J]. Journal of Guangxi Normal University(Natural Science Edition), 2019, 37(1): 23-31.
[9] YUE Tianchi, ZHANG Shaowu, YANG Liang, LIN Hongfei, YU Kai. Stance Detection Method Based on Two-Stage Attention Mechanism [J]. Journal of Guangxi Normal University(Natural Science Edition), 2019, 37(1): 42-49.
[10] LIN Yue, LIU Tingzhang, HUANG Lirong, XI Xiaoye, PAN Jian. Anomalous State Detection of Power Transformer Basedon Bidirectional KL Distance Clustering Algorithm [J]. Journal of Guangxi Normal University(Natural Science Edition), 2018, 36(4): 20-26.
[11] XIA Haiying,LIU Weitao,ZHU Yongjian. An Improved Fast SUSAN Chessboard Corner Detection Algorithm [J]. Journal of Guangxi Normal University(Natural Science Edition), 2018, 36(1): 44-52.
[12] LI Ziyan,LIU Weiming. New Method of Moving Vehicle Detection Based on Partial HOG Feature [J]. Journal of Guangxi Normal University(Natural Science Edition), 2017, 35(3): 1-13.
[13] LIU Yi,YE Xuemei,XIAO Miyun,L Lijun,HOU Chengyou,LU Zujun. The Preliminary Screening of Hypaphorine High-accumulationStrain by Using the Quick Fluorescent Method [J]. Journal of Guangxi Normal University(Natural Science Edition), 2017, 35(3): 141-148.
[14] YANG Liting, HE Li, HE Haining, WU Qiong. The Application of Flow Cytometry in Testing Bacteria of Raw Milk [J]. Journal of Guangxi Normal University(Natural Science Edition), 2017, 35(2): 112-116.
[15] TANG Zhenjun. Image Hashing Algorithm Based on PCA Feature Distance [J]. Journal of Guangxi Normal University(Natural Science Edition), 2016, 34(4): 9-18.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
[1] XU Jianmin, WEI Jia, SHOU Yanfang. Comprehensive Evaluation of Urban Road Traffic Operation StatusBased on Game Theory-Cloud Model[J]. Journal of Guangxi Normal University(Natural Science Edition), 2020, 38(4): 1 -10 .
[2] ZHANG Canlong, LI Yanru, LI Zhixin, WANG Zhiwen. Block Target Tracking Based on Kernel Correlation Filter and Feature Fusion[J]. Journal of Guangxi Normal University(Natural Science Edition), 2020, 38(5): 12 -23 .
[3] XU Lunhui, CAO Yuchao, LIN Peiqun. Location and Dispatching of Multiple Emergency Materials Center Based on Fusion Immune Optimization and Genetic Algorithm[J]. Journal of Guangxi Normal University(Natural Science Edition), 2020, 38(6): 1 -13 .
[4] HU Jinming, WEI Duqu. Research on Generalized Sychronization of Fractional-order PMSM[J]. Journal of Guangxi Normal University(Natural Science Edition), 2020, 38(6): 14 -20 .
[5] TANG Rongchai, WU Xiru. Real-time Detection of Passion Fruit Based on Improved YOLO-V3 Network[J]. Journal of Guangxi Normal University(Natural Science Edition), 2020, 38(6): 32 -39 .
[6] ZHANG Ruchang, QIU Jie, WANG Mingtang, CHEN Qingfeng. Classification of Protein 3D Structure Based on Adaptive Local Features[J]. Journal of Guangxi Normal University(Natural Science Edition), 2020, 38(6): 40 -50 .
[7] CHEN Dong, HU Kui. Cover Gorenstein AC-flat Dimensions[J]. Journal of Guangxi Normal University(Natural Science Edition), 2020, 38(6): 51 -55 .
[8] ZUO Jiabin, YUN Yongzhen. Anti-periodic Boundary Value Problem for a Class of Fractional Differential Equations[J]. Journal of Guangxi Normal University(Natural Science Edition), 2020, 38(6): 56 -64 .
[9] WANG Yue, YE Hongyan, LEI Jun, SUO Hongmin. Infinitely Many Classical Solutions for Kirchhoff Type Problem with Linear Term[J]. Journal of Guangxi Normal University(Natural Science Edition), 2020, 38(6): 65 -73 .
[10] HUANG Chunxian, ZHOU Xiaoliang. Bifurcation Analysis of an SIRS Epidemic Model with Graded Cure and Incomplete Recovery Rates[J]. Journal of Guangxi Normal University(Natural Science Edition), 2020, 38(6): 74 -81 .
Copyright © Journal of Guangxi Normal University(Natural Science Edition), All Rights Reserved.
Tel: 0773-5857325　E-mail: gxsdzkb@mailbox.gxnu.edu.cn
Powered by Beijing Magtech Co. Ltd