Real-Time Incremental Segmentation Of 3D Point Clouds From Disaster Sites

Abstract

In Monitoring Disaster Sites, Mobile Robots Represent A Fast, Reliable, And Practical Option To Remotely Inspect Active Areas In Disaster Management For Applications Such As Risk Management, Search And Rescue, And Structural Assessment Purposes. Mobile Robots Can Efficiently Collect Laser Scan Data And Reconstruct The State Of Ongoing Disaster Relief In The Form Of 3D Point Clouds. Current Point Cloud Processing Methods Are Mostly Designed To Work As A Post-Processing Step And Are Inefficient When Applied In Real-Time. Additionally, Object Segmentation On Point Cloud Data From The Disaster Sites Is Challenging Due To Data Impurities And Occlusions. To Overcome These Issues, This Paper Proposes An Instance Point Cloud Segmentation Method That Incrementally Builds A 3D Map For Robotic Scans Of Infrastructure. In The First Step, The Proposed Neural Network, Named Dynamic Graph PointNet (DGPointNet), Is Trained To Classify Objects In The Disaster Environment While Building Up A Semantic 3D Map Of The Environment. Additionally, The Proposed Method Predicts Object Instance Labels By Using A Sequence Of Predicted Semantic Point Cloud Data. The Proposed Method Shows Strong Performance Over The State Of Art Segmentation Models In Terms Of Semantic Segmentation, Instance Segmentation, And Processing Time Using Point Cloud Data Collected From A Custom-Built Laser-Scanning Robot At An Outdoor Simulated Disaster Site.