Short-Term Crack in Sewer Forecasting Method Based on CNN-LSTM Hybrid Neural Network Model

Seung-Ju Jang; Seung-Yup Jang

doi:10.12814/jkgss.2022.21.2.011

All Issue

2022 Vol.21, Issue 2 Preview Page Next Page

Research Article

Short-Term Crack in Sewer Forecasting Method Based on CNN-LSTM Hybrid Neural Network Model CNN-LSTM 합성모델에 의한 하수관거 균열 예측모델

30 June 2022. pp. 11-19

PDF XML

Abstract

In this paper, we propose a GoogleNet transfer learning and CNN-LSTM combination method to improve the time-series prediction performance for crack detection using crack data captured inside the sewer pipes. LSTM can solve the long-term dependency problem of CNN, so spatial and temporal characteristics can be considered at the same time. The predictive performance of the proposed method is excellent in all test variables as a result of comparing the RMSE(Root Mean Square Error) for time series sections using the crack data inside the sewer pipe. In addition, as a result of examining the prediction performance at the time of data generation, the proposed method was verified that it is effective in predicting crack detection by comparing with the existing CNN-only model. If the proposed method and experimental results obtained through this study are utilized, it can be applied in various fields such as the environment and humanities where time series data occurs frequently as well as crack data of concrete structures.

Keywords

CNN

LSTM

Hybrid model

Sewer pipe

본 연구에서는 하수관거 내부에서 촬영된 균열 데이터를 활용하여 균열검출에 대한 시계열 예측 성능을 개선하기 위해 GoogleNet의 전이학습과 CNN- LSTM(Long Short-Term Memory) 결합 방법을 제안하였다. LSTM은 합성곱방법(CNN)의 장기의존성 문제를 해결할 수 있으며 공간 및 시간적 특징을 동시에 모델링 할 수 있다. 제안 방법의 성능을 검증하기 위해 하수관거 내부 균열 데이터를 활용하여 학습데이터, 초기학습률 및 최대 Epochs를 변화하면서 RMSE를 비교한 결과 모든 시험 구간에서 제안 방법의 예측 성능이 우수함을 알 수 있다. 또한 데이터가 발생하는 시점에 대한 예측 성능을 살펴본 결과 역시 제안방법이 우수하게 나타나 균열검출의 예측에서 제안 방법이 효율적인 것을 검증하였다. 기존 합성곱방법(CNN) 단독 모델과 비교함으로써 본 연구를 통해 확보된 제안 방법과 실험 결과를 활용할 경우 콘크리트 구조물의 균열데이터뿐만 아니라 시계열 데이터가 많이 발생하는 환경, 인문과학 등 다양한 영역에서 응용이 가능하다.

References

Aizenberg, I., Aizenberg, N. N. and Vandewalle, J. P. L. (2000), Multi-Valued and Universal Binary Neurons: Theory, Learning and Applications, Springer Science & Business Media. pp.81-137. 10.1007/978-1-4757-3115-6_3

Bengio, Y. (1991), Artificial Neural Networks and their Application to Speech/Sequence Recognition, McGill University Ph.D. thesis.

Bengio, Y. (2012), Practical recommendations for gradient-based training of deep architectures, Neural Networks, Tricks of the Trade, pp.437-478. 10.1007/978-3-642-35289-8_26

Dang, L. M., Kyeong, S. J., Li, Y., Wang, H., Nguyen, T. N. and Moon, H. J. (2021), Deep learning-based sewer defect classification for highly imbalanced dataset, Computers & Industrial Engineering, Vol.161, 107630. 10.1016/j.cie.2021.107630

De Carvalho, A. C. L. F., Fairhurst, M. C. and Bisset, D. (1994), An integrated Boolean neural network for pattern classification, Pattern Recognition Letters, Vol.15, No.8, pp.807-813. 10.1016/0167-8655(94)90009-4

Dechter, R. (1986), Learning while searching inconstraint- satisfaction problems, University of California, Computer Science Department, Cognitive Systems Laboratory. pp.178-183.

Deng, L., Hassanein, K. and Elmasry, M. (1994), Analysis of correlation structure for a neural predictive model with applications to speech recognition, Neural Networks, Vol.7, No.2, pp.331-339. 10.1016/0893-6080(94)90027-2

Fukushima, K. (1980), Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position, Biol, Cybern, Vol.36, No.4, pp.193-202. 7370364

Hinton, G. E. (2007), Learning multiple layers of representation, Trends in Cognitive Sciences, Vol.11, No.10, pp.428-434. 17921042

Hinton, G. E., Dayan, P., Frey, B. J. and Neal, R. (1995), The wake-sleep algorithm for unsupervised neural networks, Vol.268, No.5214, pp.1158-1161. 10.1126/science.77618317761831

Hinton, G. E., Osindero, S. and Teh, Y. W. (2006), A Fast Learning Algorithm for Deep Belief Nets, Neural Computation, Vol.18, No.7, pp.1527-1554. 10.1162/neco.2006.18.7.152716764513

Hochreiter, S. (1991), Untersuchungen zu dynamischen neuronalen Netzen Archived 2015-03-06atthe Wayback Machine, Diploma thesis, Institut f. Informatik, Technische Univ.

Hwang, C. H., Kim, H. S. and Jung, H. K. (2018), Detection and Correction Method of Erroneous Data Using Quantile Pattern and LSTM, JICCE, Vol.16, No.4, pp.242-247.

Ivakhnenko, A. G. (1971), Polynomial theory of complex systems, IEEE Transactions on Systems, Man and Cybernetics, Vol.4, pp.364-378. 10.1109/TSMC.1971.4308320

Ivakhnenko, A. G., Lapa, V. G. and McDonough, R. N. (1967), Cybernetics and forecasting techniques, American Elsevier, New York.

Jiang, J., Li, C., Sun, L., Guo, D., Zhang, Y. and Wang, W. (2021), A deep learning algorithm for multi-source data fusion to predict water quality of urban sewer networks, Journal of Cleaner Production, Vol.318, No.10. pp. 2411-2502. 10.1016/j.jclepro.2021.128533

McKim, R. A., and Sinha, S. K. (1999), Condition assessment of underground sewer pipes using a modified digital image processing paradigm, Tunnelling and Underground Space Technology, Vol.14, pp.29-37. 10.1016/S0886-7798(00)00021-3

Moselhi, O. and Shehab-Eldeen, T. (1999), Automated detection of surface defects in water and sewer pipes, Automation in Construction, Vol.8, No.5, pp.581-588. 10.1016/S0926-5805(99)00007-2

Nguyen, V. Q., Ma, L. V. and Kim, J. (2018), LSTM-based anomaly detection on big data for smart factory monitoring, Journal of Digital Contents Society, Vol.19, No.4, pp.789-79.

Samuel, A. L. (1959), Some Studies in Machine Learning Using the Game of Checkers Offsite Link, IBM Journal of Research and Development, Vol.3, No.3, pp. 206-226. 10.1147/rd.33.0210

Son, B. J. and Lee, K. H. (2017), Crack Recognition of Sewer with Low Resolution using Convolutional Neural Network(CNN) Method, Journal of Korean Society for Advanced Composite Structures, Vol.8, No.4, pp.58-65. 10.11004/kosacs.2017.8.4.058

Wang, M. Z., Kumar, S. S. and Cheng, J. C. P. (2021), Automated sewer pipe defect tracking in CCTV videos based on defect detection and metric learning, Automation in Construction 121.103438 10.1016/j.autcon.2020.103438

Xu, K., Lxmoore, A. R. and Davies, T. (1998), Sewer pipe deformation assessment by image analysis of video surveys, Pattern Recognition, Vol.31, No.2, pp.169-180. 10.1016/S0031-3203(97)00037-X

Yang, M. D., and Su, T. C. (2008), Automated diagnosis of sewer pipe defects based on machine learning approaches, Expert Systems with Applications, Vol.35, No.3, pp.1327-1337. 10.1016/j.eswa.2007.08.013

Yang, M. D., Su, T. C., Pan, N. F., and Yang, Y. F. (2011), Systematic image quality assessment for sewer inspection, Expert Systems with Applications, Vol.38, No.3, pp.1766-1776. 10.1016/j.eswa.2010.07.103

Information

Publisher :Korean Geosythetics Society
Publisher(Ko) :한국지반신소재학회
Journal Title :Journal of the Korean Geosynthetics Society
Journal Title(Ko) :한국지반신소재학회 논문집
Volume : 21
No :2
Pages :11-19
Received Date : 2022-03-25
Revised Date : 2022-06-03
Accepted Date : 2022-06-07
DOI :https://doi.org/10.12814/jkgss.2022.21.2.011

Journal of the Korean Geosynthetics Society ISSN:2508-2876(Print) 2287-9528(Online) 한국지반신소재학회 논문집

All Issue