This paper introduces an Intelligent Model for Real-Time Pipeline Monitoring and Maintenance Prediction to enhance infrastructure integrity and operational efficiency in Nigeria's oil and gas sector. Given the country's economic dependence on oil and gas revenue, efficient pipeline transportation is crucial. However, pipelines face challenges such as corrosion, mechanical failures, vandalism, and theft, leading to economic losses and environmental risks. Current monitoring systems are mainly reactive, lacking timely anomaly detection and predictive maintenance capabilities. To tackle these challenges, the study utilized sophisticated machine learning methods by combining the Random Forest classifier for real-time anomaly detection with the Prophet model for predictive maintenance forecasting. Datasets from Kaggle were used. The Random Forest classifier demonstrated robust performance with an accuracy of 93.48%, precision of 93.75%, recall of 96.77%, and an F1-score of 95.24%. The Prophet model provided accurate hourly forecasts of operational parameters, aiding proactive maintenance scheduling. Despite some errors encountered (RMSE: 21.48 and MAE: 18.17), the Mean Absolute Percentage Error (MAPE) of 14.87% indicates relatively minor discrepancies compared to actual values. In conclusion, the Intelligent Model shows significant advancements in pipeline monitoring and maintenance prediction by leveraging machine learning for early anomaly detection and timely maintenance interventions. This proactive approach aims to reduce downtime, prevent environmental damage, and optimize operational efficiency in Nigeria's oil and gas infrastructure. Future research could focus on enhancing system scalability across diverse terrains, employing advanced deep learning techniques such as Transformer Networks and Autoencoders for improved prediction accuracy, and exploring cybersecurity measures like blockchain integration to ensure data integrity and protect critical infrastructure from cyber threats.
Published in | Automation, Control and Intelligent Systems (Volume 12, Issue 2) |
DOI | 10.11648/j.acis.20241202.11 |
Page(s) | 22-34 |
Creative Commons |
This is an Open Access article, distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution and reproduction in any medium or format, provided the original work is properly cited. |
Copyright |
Copyright © The Author(s), 2024. Published by Science Publishing Group |
Pipeline Infrastructure, Machine Learning, Monitoring, Prediction, Random Forest Classifier, Prophet Model
Techniques Used | Outcome |
---|---|
Proteus 8 [16] | Enhanced spillage detection system for intrusions and vandalism. |
Distributed optical fiber sensors, random forest model [17] | Achieved an accuracy of 91.30 % in oil and gas pipeline leak detection with temperature and vibration data. |
GSM-based monitoring framework [18] | Advocated for nationwide automated pipeline monitoring to curb vandalism and oil theft. |
PIR sensors, vibration sensors, sound sensors [19] | Recommended a multi-sensor system for pipeline monitoring to detect and alert authorities to vandalism. |
AI-driven system, neural networks [20] | Explored AI-driven intrusion detection for gas pipelines, showing potential for burst detection. |
Remote flow valve activation, hardware design [21] | Designed an intrusion monitoring system with effective leakage detection and hardware emphasis. |
Proteus software, differential flow equations [22] | Developed an analytical model for detecting single and multiple leaks in oil pipelines. |
Wireless Sensor Networks (WSNs) [11] | Reviewed challenges and solutions for WSN-based oil pipeline monitoring in Nigeria. |
Modern intrusion detection technologies [7] | Discussed security threats on pipelines and recommended tailored detection technologies. |
Internet of Things (IoT) [9] | Proposed IoT solutions for proactive pipeline monitoring to mitigate vandalism's economic impact. |
Automated crack detection, vandalism detection, SMS alerts [2] | Proposed an intelligent system for real-time oil spill detection and remote monitoring. |
Dataset Filename | Pipeline_anomaly_dataset.CSV |
---|---|
Dataset Size | 107Kb |
Source | Kaggle.com |
Dataset Instances | 1152 |
No of Fields | 5 |
Dataset Filename | Pipeline_maint_dataset.CSV |
---|---|
Dataset Size | 1.25Mb |
Dataset Instances | 4977 |
Source | Kaggle.com |
No of Fields | 24 |
Step | Description |
---|---|
Model Initialization | Initialize the Random Forest classifier with specified parameters. |
Feature Preparation | Handle missing values using Simple Imputer for numeric features and encode categorical features using Label Encoder within a Pipeline. |
Data Splitting | Split the dataset into training and testing sets using train_test_split, with a test size of 20% and a random state of 42. |
Model Training | Train the Random Forest classifier (clf) on the training data (X_train, y_train). |
Prediction | Predict the target variable (y_pred) and obtain predicted probabilities (y_proba) on the test set (X_test). |
Evaluation Metrics Calculation | Calculate and print evaluation metrics: Accuracy, Precision, Recall, F1-Score, and ROC-AUC using functions from sklearn.metrics. |
Step | Description |
---|---|
Data Loading | Load the dataset from 'forecast_maint_data.csv'. |
Data Preprocessing | Convert the 'date' column to datetime format (pd.to_datetime). Rename columns to 'ds' for timestamp and 'y' for measurements. |
Train-Test Split | Split the data into training and testing sets (80% train, 20% test). |
Model Initialization | Initialize the Prophet model (model = Prophet()). |
Model Training | Train the Prophet model on the training data (model.fit(train)). |
Prediction | Generate future date ranges for prediction (future = model.make_future_dataframe(periods=len(test))). Make predictions using the trained model (forecast = model.predict(future)). |
Evaluation Metrics Calculation | Calculate Mean Absolute Error (MAE), Mean Squared Error (MSE), Root Mean Squared Error (RMSE), and R-squared (mae, mse, rmse, r2). |
Visualization - Forecast Plot | Plot the forecasted values (model.plot(forecast)). |
Visualization - Components Plot | Plot the components of the forecast (model.plot_components(forecast)). |
Visualization - True vs Predicted Plot | Plot true vs predicted values (plt.plot(test ['ds'], y_true, label='True'), plt.plot(test ['ds'], y_pred, label='Predicted')). |
Component | Recommendation |
---|---|
CPU | Intel Core i7 |
GPU | NVIDIA RTX 3080 |
RAM | 16GB DDR4 |
Storage | 1TB SSD |
Operating System | Windows 10 Pro |
GPU Driver | NVIDIA CUDA Toolkit 11.0 |
Deep Learning Framework | TensorFlow, Keras |
Python Distribution | Python 3.9.7 |
IDE | Jupyter Notebook, PyCharm, Anaconda 3 |
Web Interface Development | JavaScript, HTML |
Local Hosting Platform | Flask |
Specification | Details |
---|---|
Sensor Type | Distributed Fiber Optic Sensors (DFOS) |
Example: DTS, DAS, DSS | |
Measurement Range | Temperature: -200°C to +850°C |
Pressure: Up to 700 bar (10,000 psi) | |
Strain: ± 10,000 µε (micro-strains) | |
Spatial Resolution | DTS: 0.1 to 1 meter |
DAS: 1 to 10 meters | |
DSS: 0.1 to 1 meter | |
Measurement Accuracy | Temperature: ± 0.1°C to ± 1°C |
Pressure: ± 0.1% of Full Scale | |
Strain: ± 1% of measurement | |
Response Time | Real-time data acquisition with latency typically less than 1 second |
Sensor Length | Up to 50 kilometers per sensing unit, extendable beyond 100 kilometers |
Operating Environment | Temperature Range: -40°C to +85°C for the sensing unit |
Humidity: 0% to 95% non-condensing | |
Environmental Protection: IP67 or higher for field-deployable units |
Configuration Aspect | Details |
---|---|
System Components | Interrogator Unit: Processes and analyzes light pulses |
Fiber Optic Cable: Single-mode or multi-mode, ruggedized for harsh environments | |
Connectors and Splices: Ensure minimal signal loss | |
Power Supply: 12V DC or 24V DC, with AC options | |
Installation | Deployment: Fiber optic cables deployed alongside or within pipelines |
Protection: Armored or in protective conduits to prevent damage | |
Calibration: Initial and periodic recalibration for accuracy | |
Data Acquisition and Processing | Software: Advanced solutions for data interpretation, visualization, alarms |
Integration: Compatible with SCADA and other monitoring systems | |
Machine Learning: Analyzes patterns to predict leaks or structural issues | |
Maintenance and Reliability | Durability: High durability with minimal maintenance |
Diagnostics: Continuous system diagnostics | |
Redundancy: Redundant systems for critical applications |
ds | yhat | yhat_lower | yhat_upper |
---|---|---|---|
1/1/2024 0:00 | 101.477612 | 95.025488 | 108.17543 |
1/1/2024 1:00 | 101.293297 | 95.228491 | 107.600144 |
1/1/2024 2:00 | 101.108981 | 94.439863 | 106.662997 |
1/1/2024 3:00 | 100.924665 | 94.312921 | 107.452197 |
1/1/2024 4:00 | 100.740349 | 94.462473 | 106.603424 |
1/1/2024 5:00 | 100.556033 | 93.556064 | 106.768901 |
1/1/2024 6:00 | 100.371718 | 93.775845 | 106.39061 |
1/1/2024 7:00 | 100.187402 | 93.587873 | 106.646444 |
1/1/2024 8:00 | 100.003086 | 93.836199 | 106.221952 |
1/1/2024 9:00 | 99.81877 | 93.806844 | 106.230431 |
1/1/2024 10:00 | 99.634455 | 93.308373 | 105.852675 |
1/1/2024 11:00 | 99.450139 | 93.158037 | 105.734058 |
1/1/2024 12:00 | 99.265823 | 92.735753 | 106.344609 |
1/1/2024 13:00 | 99.081507 | 92.59336 | 105.499479 |
1/1/2024 14:00 | 98.897191 | 92.219593 | 105.351828 |
1/1/2024 15:00 | 98.712876 | 92.338281 | 105.149699 |
1/1/2024 16:00 | 98.52856 | 92.170087 | 104.945244 |
1/1/2024 17:00 | 98.344244 | 91.78075 | 104.979772 |
1/1/2024 18:00 | 98.159928 | 91.465187 | 104.733737 |
1/1/2024 19:00 | 97.975613 | 91.22553 | 104.455174 |
1/1/2024 20:00 | 97.791297 | 91.578203 | 103.7677 |
1/1/2024 21:00 | 97.606981 | 91.139953 | 104.23382 |
1/1/2024 22:00 | 97.422665 | 90.960262 | 103.640478 |
1/1/2024 23:00 | 97.238349 | 91.006873 | 103.397636 |
1/2/2024 0:00 | 97.054034 | 90.790693 | 103.321047 |
1/2/2024 1:00 | 96.869718 | 90.206936 | 102.498589 |
1/2/2024 2:00 | 96.685402 | 90.177687 | 102.880591 |
1/2/2024 3:00 | 96.501086 | 90.137298 | 102.559735 |
1/2/2024 4:00 | 96.31677 | 89.788627 | 102.909365 |
1/2/2024 5:00 | 96.132455 | 89.724287 | 102.595168 |
1/2/2024 6:00 | 95.948139 | 89.128862 | 102.368184 |
1/2/2024 7:00 | 95.763823 | 89.762832 | 102.208097 |
1/2/2024 8:00 | 95.579507 | 89.574003 | 102.02685 |
1/2/2024 9:00 | 95.395192 | 89.189907 | 101.30719 |
RMSE | 21.48 |
MAE | 18.17 |
MAPE | 14.87% |
BMI | Body Mass Index |
PM | Pipeline Monitoring |
OGI | Oil and Gas Industry |
PV | Pipeline Vandalism |
EI | Economic Impact |
ES | Environmental Sustainability |
RL | Revenue Loss |
IOB | Illegal Oil Bunkering |
SC | Security Challenges |
AT | Advanced Technologies |
FOS | Fiber-Optic Sensing |
WSN | Wireless Sensor Networks |
IOT | Internet of Things |
ES | Expert Systems |
RST | Remote Sensing Technology |
RTM | Real-Time Monitoring |
PC | Predictive Capabilities |
PRM | Proactive Risk Management |
[1] | Fagbami, D., Echem, C., Okoli, A., Mondanos, M., Bain, A., Carbonneau, P., and Amarquaye M. A Practical Application of Pipeline Surveillance and Intrusion Monitoring System in the Niger Delta: The Umugini Case Study. In Proceedings at the SPE Nigeria Annual International Conference and Exhibition, Lagos, Nigeria, July 2017. |
[2] | Igbajar, A, and Barikpoa, A. N. Designing an Intelligent Microcontroller based Pipeline Monitoring System with Alarm, Sensor, International Journal of Emerging Technologies in Engineering Research (IJETER), 2015, 3 (2): 22-27. |
[3] | Agbaeze, K. N. Petroleum Pipeline Leakages in PPMC’ Report for Chief Officers Mandatory Course 026, Lagos, 2002. |
[4] | Yiu, C. S., Grant, K., & Edgar, D. Factors affecting the adoption of Internet Banking in Hong Kong—implications for the banking sector. International journal of information management, 2007, 27 (5), 336-351. |
[5] | Ikokwu, T. Oil Spill Management in Nigeria: Challenges of Pipeline Vandalism in the Niger Delta Region of Nigeria, 2007, 16. |
[6] | Ojiaku et al. Pipeline Vandalisation Detection Alert with SMS, Int. Journal of Engineering Research and Applications, 2014, 4 (9). pp. 21. |
[7] | Achilike C. M. N. Securing Nigeria’s Crude Oil and Gas Pipelines –Change in Current Approach and Focus on the Future, Scientific Research Journal (SCIRJ), 2017, 5 (1): 1-9. |
[8] | Oseni, W. Y., Akangbe, O. A., & Abhulimen, K. Mathematical modelling and simulation of leak detection system in crude oil pipeline. Heliyon, 2023, 9 (4), e15412. |
[9] | Ayeni, T. P., and Ayogu, B. A. Intelligent Pipeline Monitoring System Based on Internet of Things, Scientific Research Journal (SCIRJ), 2020, 8 (8): 44-49. |
[10] | Idachaba, F., Wokoma, E., Okuns, G., Brown, C., and Ian W. Fiber Optic Based Pipeline Oil and Gas Leak and Intruder Detection System with Security Intervention Plan. In Proceeding at the SPE Nigeria Annual International Conference and Exhibition, Lagos, Nigeria, August 2013. |
[11] | Ezeja, O. M. and Ahaneku, M. A. Review on the Use of Wireless Sensor Network Systems for Oil Pipeline Surveillance, 2020 LGT-ECE-UNN International Conference: Technological Innovation for Holistic Sustainable Development (TECHISD2020), 2020, 137-145. |
[12] | Muggleton, M. J. and Brennan, Linford, P. W. Axisymmetric wave propagation in fluid-filled pipes: wavenumber measurements in in vacuo and buried pipes, Journal of Sound and Vibration, 2004, 270(1), 171-190. |
[13] | Adebayo S. HDD Technology takes pipeline across 1.7km Escravos River, ‘Fortune Business, 2010. |
[14] | Ajakaiye, B.A Combating Oil spill in Nigeria: Primary role and responsibility of the National Oil Spill Detection and Response Agency (NOSDRA) Consultative workshop August 4 -6, 2008, Calabar, Nigeria, 2008. |
[15] | Okorodudu, O. F., Okorodudu, P. O., & Irikefe, E. K. A Model of Petroleum Pipeline Spillage Detection System for use in the Niger Delta Region of Nigeria. International Journal of Research - Granthaalayah, 2016, 4 (12), 1-16. |
[16] | Wang F., Zhen Liu, Z., Zhou X., Li S., Yuan X., Zhang Y., Shao L., & Zhang X, (INVITED) Oil and Gas Pipeline Leakage Recognition Based on Distributed Vibration and Temperature Information Fusion, Results in Optics, 2021, 5 (1): 1-9. |
[17] | Olaiya, O. O., Oduntan, O. E., and Ehiagwina, F. O. A Short Overview of Pipeline Monitoring Technologies for Vandalism Prevention with a Proposed Framework for a GSM Based System, Journal of Engineering & Research Tech, 2020, 13 (5): 175-188. |
[18] | Salihu, O. A., Agbo, I. O., Saidu M., and Onwuka, E. N. Multi-Sensor Approach for Monitoring Pipelines, International Journal of Engineering and Manufacturing, 2017, 6, 59-72. |
[19] | Umbre, S., and Gaikwad S. Practicality of Gas Pipeline Inspection System, International Journal of Research Publication and Reviews, 2024, 5 (3): 125-131. |
[20] | Okpo, N. C., Itaketo, U. T., and Udofia, K. Analytical Model of Leak Detection and Location for Application in Oil Pipeline Intrusion Detection System, Journal of Multidisciplinary Engineering Science and Technology (JMEST), 2023, 10 (1): 16029-16038. |
[21] | Okpo, N. C., Udofia, K. M. and Friday, S. A. Design of Oil Pipeline Intrusion Monitoring System with GSM Module-Based Remote Flow Valve Activation Mechanism, Journal of Multidisciplinary Engineering Science and Technology (JMEST), 2023, 10 (1): 15999-16007. |
[22] | McAllister, W. Pipeline Rules of Thumb Handbook: Quick and Accurate Solutions to your everyday Pipeline Problems, 6th Edition, 2005. |
APA Style
Nwokonkwo, O. C., Samuel, N. U., Eze, U. F., John-Otumu, A. M. (2024). Machine Learning Framework for Real-Time Pipeline Anomaly Detection and Maintenance Needs Forecast Using Random Forest and Prophet Model. Automation, Control and Intelligent Systems, 12(2), 22-34. https://doi.org/10.11648/j.acis.20241202.11
ACS Style
Nwokonkwo, O. C.; Samuel, N. U.; Eze, U. F.; John-Otumu, A. M. Machine Learning Framework for Real-Time Pipeline Anomaly Detection and Maintenance Needs Forecast Using Random Forest and Prophet Model. Autom. Control Intell. Syst. 2024, 12(2), 22-34. doi: 10.11648/j.acis.20241202.11
AMA Style
Nwokonkwo OC, Samuel NU, Eze UF, John-Otumu AM. Machine Learning Framework for Real-Time Pipeline Anomaly Detection and Maintenance Needs Forecast Using Random Forest and Prophet Model. Autom Control Intell Syst. 2024;12(2):22-34. doi: 10.11648/j.acis.20241202.11
@article{10.11648/j.acis.20241202.11, author = {Obi Chukwuemeka Nwokonkwo and Nwankwo Uchechukwu Samuel and Udoka Felista Eze and Adetokunbo MacGregor John-Otumu}, title = {Machine Learning Framework for Real-Time Pipeline Anomaly Detection and Maintenance Needs Forecast Using Random Forest and Prophet Model }, journal = {Automation, Control and Intelligent Systems}, volume = {12}, number = {2}, pages = {22-34}, doi = {10.11648/j.acis.20241202.11}, url = {https://doi.org/10.11648/j.acis.20241202.11}, eprint = {https://article.sciencepublishinggroup.com/pdf/10.11648.j.acis.20241202.11}, abstract = {This paper introduces an Intelligent Model for Real-Time Pipeline Monitoring and Maintenance Prediction to enhance infrastructure integrity and operational efficiency in Nigeria's oil and gas sector. Given the country's economic dependence on oil and gas revenue, efficient pipeline transportation is crucial. However, pipelines face challenges such as corrosion, mechanical failures, vandalism, and theft, leading to economic losses and environmental risks. Current monitoring systems are mainly reactive, lacking timely anomaly detection and predictive maintenance capabilities. To tackle these challenges, the study utilized sophisticated machine learning methods by combining the Random Forest classifier for real-time anomaly detection with the Prophet model for predictive maintenance forecasting. Datasets from Kaggle were used. The Random Forest classifier demonstrated robust performance with an accuracy of 93.48%, precision of 93.75%, recall of 96.77%, and an F1-score of 95.24%. The Prophet model provided accurate hourly forecasts of operational parameters, aiding proactive maintenance scheduling. Despite some errors encountered (RMSE: 21.48 and MAE: 18.17), the Mean Absolute Percentage Error (MAPE) of 14.87% indicates relatively minor discrepancies compared to actual values. In conclusion, the Intelligent Model shows significant advancements in pipeline monitoring and maintenance prediction by leveraging machine learning for early anomaly detection and timely maintenance interventions. This proactive approach aims to reduce downtime, prevent environmental damage, and optimize operational efficiency in Nigeria's oil and gas infrastructure. Future research could focus on enhancing system scalability across diverse terrains, employing advanced deep learning techniques such as Transformer Networks and Autoencoders for improved prediction accuracy, and exploring cybersecurity measures like blockchain integration to ensure data integrity and protect critical infrastructure from cyber threats. }, year = {2024} }
TY - JOUR T1 - Machine Learning Framework for Real-Time Pipeline Anomaly Detection and Maintenance Needs Forecast Using Random Forest and Prophet Model AU - Obi Chukwuemeka Nwokonkwo AU - Nwankwo Uchechukwu Samuel AU - Udoka Felista Eze AU - Adetokunbo MacGregor John-Otumu Y1 - 2024/07/31 PY - 2024 N1 - https://doi.org/10.11648/j.acis.20241202.11 DO - 10.11648/j.acis.20241202.11 T2 - Automation, Control and Intelligent Systems JF - Automation, Control and Intelligent Systems JO - Automation, Control and Intelligent Systems SP - 22 EP - 34 PB - Science Publishing Group SN - 2328-5591 UR - https://doi.org/10.11648/j.acis.20241202.11 AB - This paper introduces an Intelligent Model for Real-Time Pipeline Monitoring and Maintenance Prediction to enhance infrastructure integrity and operational efficiency in Nigeria's oil and gas sector. Given the country's economic dependence on oil and gas revenue, efficient pipeline transportation is crucial. However, pipelines face challenges such as corrosion, mechanical failures, vandalism, and theft, leading to economic losses and environmental risks. Current monitoring systems are mainly reactive, lacking timely anomaly detection and predictive maintenance capabilities. To tackle these challenges, the study utilized sophisticated machine learning methods by combining the Random Forest classifier for real-time anomaly detection with the Prophet model for predictive maintenance forecasting. Datasets from Kaggle were used. The Random Forest classifier demonstrated robust performance with an accuracy of 93.48%, precision of 93.75%, recall of 96.77%, and an F1-score of 95.24%. The Prophet model provided accurate hourly forecasts of operational parameters, aiding proactive maintenance scheduling. Despite some errors encountered (RMSE: 21.48 and MAE: 18.17), the Mean Absolute Percentage Error (MAPE) of 14.87% indicates relatively minor discrepancies compared to actual values. In conclusion, the Intelligent Model shows significant advancements in pipeline monitoring and maintenance prediction by leveraging machine learning for early anomaly detection and timely maintenance interventions. This proactive approach aims to reduce downtime, prevent environmental damage, and optimize operational efficiency in Nigeria's oil and gas infrastructure. Future research could focus on enhancing system scalability across diverse terrains, employing advanced deep learning techniques such as Transformer Networks and Autoencoders for improved prediction accuracy, and exploring cybersecurity measures like blockchain integration to ensure data integrity and protect critical infrastructure from cyber threats. VL - 12 IS - 2 ER -