Objectives of the service
Over 20 million kilometres of infrastructure networks worldwide need to be monitored not only repeatedly but efficiently. The increasing frequency of extreme weather events leads to more violent threats to our society and its infrastructure. Understanding and mitigating the risks is an indispensable mission all around the world. LiveEO aims to provide the necessary high-frequency, in-depth monitoring of industrial infrastructure networks which is envisioned as an “Information-as-a-Service” platform, consisting of a web and a mobile app. These are composed of vegetation analyses to detect dangers posed by trees to overhead electricity lines and railways as well as the identification of ground movement and third-party influences close to pipelines. A large part of our innovation lies in the application of state-of-the-art artificial intelligence and machine learning algorithms to identify, classify and track objects in satellite and airborne imagery. We make complementary use of optical and radar satellite data to deliver the information for our risk models, aiming to identify and prioritize areas alongside infrastructure networks which need immediate attention. LiveEO will provide a full-stack solution to satisfy the needs from supervisors to the on-site personnel to facilitate rapid, effective business, budget and workforce planning as well as the prioritization of tasks.
Users and their needs
Our service is specifically targeted to infrastructure network operators, such as railway, energy and pipeline companies, with a focus on European and North American markets. The primary target users are responsible for the servicing and maintenance of the networks such as vegetation managers or network integrity managers. As our product will be a full-stack solution, it will also cater to the supervisors (via web app) and the on-site personnel (via mobile app). Secondary target users include the forestry, insurance and finance sector.
During stage 1 of this project numerous user interviews with customers involved in this project in order to identify their needs were conducted.
Service/ system concept
LiveEO provides an innovative infrastructure monitoring for railways, electricity grids and pipelines that identifies vegetation, ground deformation and third-party interactions in order to progress to predictive maintenance and thereby reduces operational expenses by at least 25%.
In an end-to-end process state-of-the-art artificial intelligence and machine learning algorithms are applied to the satellite imagery in order to identify, classify and track objects and to estimate the risks to infrastructure networks. This information is made available in the web and mobile app, where it is possible to manage tasks and priorities.
Space Added Value
Copernicus data, including CLM/CDS and Sentinel-1 and -2 imagery is used. Sentinel-1 and -2 have a great spatial coverage. The spectral bands of Sentinel-2 are ideal for tree classification and wildfire detection. Sentinel-1 has high quality consistency, i.e. no cloud coverage and obtainability at night time.
Additionally, commercial data, e.g. optical high-resolution satellite imagery from Planet Labs and Airbus is used, which provide relevant layers of information to our machine learning network, allowing to increase the spatial and temporal resolution and add more spectral information.
Galileo and GPS services are used for the location-based data distribution on mobile devices in order to deliver LiveEO’s analysis to on-site inspection teams. It is also used for on-site personnel to add ground-proof data, helping us to improve our machine learning algorithms.
High-resolution satellite and airborne data from Airbus enables us to get high resolution data from points of interest on-demand.
High-resolution SAR data from ICEYE increases our flexibility and the accuracy of our pipeline as well as third-party interaction.
LiveEO participated in several industry events to address potential customers directly. By the end of the first stage of the project significant contacts with 14 companies in several countries were established. This was accompanied by analysing the potential markets in Germany, the EU and the US. Due to the COVID-19 pandemic LiveEO attend several online conferences and hold webinars to still be able to outreach to potential customers.
The base products for our ground deformation and third-party interaction services were developed and the pre-existing vegetation base product was connected to the web and the mobile applications. The ground deformation base product was tested on several historic cases in which subsidence had led to considerable impediments and destruction.
The development of the third-party interaction base product included the improvement of an already existing, powerful deep learning model. Ensuing tests of bi-temporal change detection on optical and SAR data were successful in detecting relevant changes between the image acquisition dates. The improvement of all base products was completed successfully.
Additionally, the development of the web and mobile applications made large progress.