Artificial Intelligence Image Segmentation for Extracting Construction Formwork Elements

Ayesha Munira Chowdhury; Sung-Woo Moon

doi:10.13161/kibim.2022.12.1.001

All Issue

2022 Vol.12, Issue 1 Next Page

Artificial Intelligence Image Segmentation for Extracting Construction Formwork Elements 거푸집 부재 인식을 위한 인공지능 이미지 분할

30 March 2022. pp. 1-9

PDF XML

Abstract

Concrete formwork is a crucial component for any construction project. Artificial intelligence offers great potential to automate formwork design by offering various design options and under different criteria depending on the requirements. This study applied image segmentation in 2D formwork drawings to extract sheathing, strut and pipe support formwork elements. The proposed artificial intelligence model can recognize, classify, and extract formwork elements from 2D CAD drawing image and training and test results confirmed the model performed very well at formwork element recognition with average precision and recall better than 80%. Recognition systems for each formwork element can be implemented later to generate 3D BIM models.

Keywords

Construction Formwork

Safety Management

Artificial Intelligence Model

Mask R-CNN

Image Segmentation

키워드

거푸집

안전관리

인공지능모델

마스크 R-CNN

이미지 분할

References

Ahn, J., Kwak, S. (2018). “Learning pixel-level semantic affinity with image-level supervision for weakly supervised semantic segmentation”, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, 18-22 June, pp. 4981-4990. 10.1109/CVPR.2018.00523

Badrinarayanan, V., Kendall, A., Cipolla, R. (2017). “Segnet: A deep convolutional encoder-decoder architecture for image segmentation”, IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(12), pp. 2481-2495. 10.1109/TPAMI.2016.264461528060704

Bhavsar, K., Jani K., Vanzara, R. (2020). “Indian currency recognition from live video using deep learning”. In Chaubey N., Parikh S., Amin K. (eds) Computing Science, Communication and Security. COMS2 2020, Communications in Computer and Information Science, 1235, Springer, Singapore, pp. 70-81. 10.1007/978-981-15-6648-6_6

Dai, J., Li, Y., He, K., Sun, J. (2016). “R-FCN: Object detection via region-based fully convolutional networks”, Advances in Neural Information Processing Systems 29 (NIPS 2016), pp. 379-387.

Girshick, R., Donahue, J., Darrell, T., Malik, J. (2014). “Rich feature hierarchies for accurate object detection and semantic segmentation”, Proceedings of 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA, 23-28 June, pp. 580-587. 10.1109/CVPR.2014.81

Habibi, H., Heravi, E. J. (2017). “Guide to convolutional neural networks: A practical application to traffic sign detection and classification, Springer International Publishing AG, Switzerland, pp. 63.

He, K., Gkioxari, G., Dollar, P., Girshick, R. (2018). “Mask R-CNN”, IEEE transactions on pattern analysis and machine intelligence, 42 (2), pp. 386-397. 10.1109/TPAMI.2018.284417529994331

He, K., Gkioxari, G., Dollar, P., Girshick, R. (2017). “Mask R-CNN”, In Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy, 22-29 October, pp. 2980-2988. 10.1109/ICCV.2017.322

He, K., Zhang, X., Ren, S., Sun, J. (2016). “Deep residual learning for image recognition”, Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, 27-30 June, pp. 770-778. 10.1109/CVPR.2016.90

Horna, S., Méneveaux, D., Damiand, G., Bertrand, Y. (2009). “Consistency constraints and 3D building reconstruction”, Computer-Aided Design, 41 (1), pp. 13-27 2009. 10.1016/j.cad.2008.11.006

Ker, J., Wang, L., Rao, J., Lim, T. (2017). “Deep learning applications in medical image analysis”, IEEE Access, 6, pp. 9375-9379. 10.1109/ACCESS.2017.2788044

Kim, B., Cho. S. (2020). “Automated multiple concrete damage detection using instance segmentation deep learning model”, Appl. Sci., 10 (22), pp. 8008. 10.3390/app10228008

Lee, B., Choi, H., Min, B., Lee, D.-E. (2020). “Applicability of formwork automation design software for aluminium formwork”, Applied Sciences, 10 (24), pp. 9029. 10.3390/app10249029

Lin, T.-Y., Dollár, P., Girshick, R., He, K., Hariharan, B., Belongie, S. (2017). “Feature pyramid networks for object detection”, Proceedings of the IEEE conference on computer vision and pattern recognition, 21-26 July, Honolulu, HI, USA, pp. 2117-2125. 10.1109/CVPR.2017.106

Li, Y., Xu, W., Chen, H., Jiang, J., Li, X. (2021). “A novel framework based on Mask R-CNN and histogram thresholding for scalable segmentation of new and old rural buildings”, Remote Sens, 13 (6), pp. 1070. 10.3390/rs13061070

Long, J., Shelhamer, E., Darrell, T. (2015). “Fully convolutional networks for semantic segmentation.” In: S. Lakušić, Ed. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA, 8-10 June, New Jersey, USA: Institute of Electrical and Electronics Engineers, pp. 3431-3440. 10.1109/CVPR.2015.7298965

Moon, S., Cowdhury, A. M. (2021). “Utilization of prior information in neural network training for improving 28-day concrete strength prediction”, Journal of Construction Engineering and Management, 147 (5), pp. 04021028. 10.1061/(ASCE)CO.1943-7862.0002047

Rawat, W., Wang, Z. (2017). “Deep convolutional neural networks for image classification: A comprehensive review”, Neural Computation, 29 (9), pp. 62352-2449. 10.1162/neco_a_0099028599112

Ren, S., He, K., Girshick, R., Sun, J. (2017). “Faster R-CNN: Towards real-time object detection with region proposal networks”, IEEE Transactions on Pattern Analysis and Machine Intelligence, 39, pp.1137-1149. 10.1109/TPAMI.2016.257703127295650

Sahu, S., Sarma, S., Bora, D. J. (2018). “Image segmentation and its different techniques: An in-depth analysis”, Proceedings of the 3rd IEEE International Conference on Research in Intelligent and Computing in Engineering, RICE 2018, 22-24 August, Ciudadela Don Bosco, San Salvador, El Salvador, pp. 1-7. 10.1109/RICE.2018.8509038

Seo, J., Park, H., Choo S. (2020). “Inference of drawing elements and space usage on architectural drawings using semantic segmentation”, Applied Science, 10 (20), pp. 7347. 10.3390/app10207347

Sigalov, K., König, M. (2017). “Recognition of process patterns for BIM-based construction schedules”, Advanced Engineering Informatics, 33, pp. 456-472. 10.1016/j.aei.2016.12.003

Wang, N., Zhao, X., Zou, Z., Zhao, P., Qi, F. (2020). “Autonomous damage segmentation and measurement of glazed tiles in historic buildings via deep learning”, Computer-Aided Civil and Infrastructure Engineering, 35 (3), pp. 277-291. 10.1111/mice.12488

Xiao, Y., Chen, S., Ikeda, Y., Hotta, K. (2020). “Automatic recognition and segmentation of architectural elements from 2D drawings by convolutional neural network”, Proceedings of The Association for Computer-Aided Architectural Design Research in Asia (CAADRIA), pp. 843-852. 10.52842/conf.caadria.2020.1.843

Ying. H., Lee, S. (2019). “A Mask R-CNN based approach to automatically construct as-is IFC BIM objects from digital images,” ISARC. Proceedings of the International Symposium on Automation and Robotics in Construction, 36. IAARC Publications, Banff, Canada, pp. 764-771. 10.22260/ISARC2019/0103

Zhang, Z., Pan, W., Zheng, Z. J. (2019). “Transfer learning enabled process recognition for module installation of high-rise modular buildings”, Proceedings of the 2019 Modular and Offsite Construction (MOC) Summit, 21-24 May, Banff, Alberta, Canada, pp. 268-275. 10.29173/mocs103

Zhao, Y., Deng, X., Lai, H. (2020). “A deep learning-based method to detect components from scanned structural drawings for reconstructing 3D models”, Applied Science, 10 (6), pp. 2066. 10.3390/app10062066

V. Badrinarayanan, A. Kendall, R. Cipolla, “Segnet: A deep convolutional encoder-decoder architecture for image segmentation”, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 39, no. 12, pp. 2481-2495, 2017. 10.1109/TPAMI.2016.264461528060704

K. Bhavsar, K. Jani, R. Vanzara, “Indian currency recognition from live video using deep learning”. In Chaubey N., Parikh S., Amin K. (eds) Computing Science, Communication and Security. COMS2 2020, Communications in Computer and Information Science, 1235, Springer, Singapore, pp. 70-81, 2020. 10.1007/978-981-15-6648-6_6

Information

Publisher :Journal of KIBIM
Publisher(Ko) :한국BIM학회
Journal Title :Journal of KIBIM
Journal Title(Ko) :한국BIM학회논문집
Volume : 12
No :1
Pages :1-9
Received Date : 2022-02-10
Revised Date : 2022-03-29
Accepted Date : 2022-03-30
DOI :https://doi.org/10.13161/kibim.2022.12.1.001

Journal of KIBIM ISSN:2288-1697(Print) 2288-1697(Online) 한국BIM학회논문집

All Issue