Abstract: Natural Disaster Management (NDM, e.g., for wildfires, floods) can be greatly improved by automating precise semantic 3D mapping and disaster evolution prediction to achieve NDM goals in near-real-time. To this end, many heterogeneous extreme data sources must be analyzed and fused: smart drone sensors (e.g., RGB, RGBD and thermal cameras, Lidars, motion sensors), emergency vehicle sensors (similar sensors but equipped with more computing power) and in-situ sensors (smoke sensors, moisture sensors, water flow meters), meteorological sensors, remote sensing data, topographical data, and geosocial media data (text, image and videos). The lecture focus is on a) how to efficiently manage such a heterogeneous and mobile sensor network, including intelligent sensor placement and b) how to analyze the resulting data having extreme nature, due to their varying resolution and quality, very large volume and update rate, different spatiotemporal resolutions and acquisition frequencies, real-time needs and multilingualism. Extreme data analytics can help developing an integrated, ground-breaking NDM platform, focusing on real-time semantic extraction from multiple heterogeneous data modalities and sources, on-the-fly construction of a meaningful semantically annotated 3D disaster area map, prediction of disaster evolution and improved communication between service providers and end-users, through automated process triggering and response recommendations. Semantic analysis computations will be distributed across the edge-to-cloud continuum, in a federated manner, to minimize latency. Extreme data analytics will be performed in a trustworthy and transparent way, by greatly advancing state-of-the-art AI and XAI approaches. The constantly updated 3D map and the disaster evolution predictions will form the basis for an advanced, interactive, Extended Reality (XR) interface, where the current situation will be visualized and different response strategies will be dynamically evaluated through simulation by NDM personnel. An innovative, scalable and efficient implementation platform will provide precise NDM support, based on extreme data analytics.

Lecturer Short CV: Prof. Ioannis Pitas (IEEE fellow, IEEE Distinguished Lecturer, EURASIP fellow) received the Diploma and Ph.D.Degree in Electrical Engineering, both from the Aristotle University of Thessaloniki, Greece. Since 1994, he has been a Professor at the Department of Informatics of the same University. He served as a Visiting Professor at several Universities. His current interests are in the areas of image/video processing, machine learning, computer vision, intelligent digital media, human centered interfaces, affective computing, 3D imaging and biomedical imaging. He is also chair of the Autonomous Systems initiative.

Sensing-and-big-data-analysis-for-NDM-v2.1-short

Video: Sensors and Big Data Analytics for NDM