A benchmark dataset and workflow for landslide susceptibility zonation
Earth-Science Reviews
By: Massimiliano Alvioli, Marco Loche, Liesbet Jacobs, Carlos H. Grohmann, Minu Treesa Abraham, Kunal Gupta, Neelima Satyam, Gianvito Scaringi, Txomin Bornaetxea, Mauro Rossi, Ivan Marchesini, Luigi Lombardo, Mateo Moreno, Stefan Steger, Corrado Camera, Greta Bajni, Guruh Samodra, Erwin Eko Wahyudi, Nanang Susyanto, Marko Sincic, Sanja Bernat Gazibara, Flavius Sirbu, Jewgenij Torizin, Nick Schüßler, Benjamin B. Mirus, Jacob Bryson Woodard, Hector Aguilera, and Jhonatan Steven Rivera-Rivera
Links
- More information: Publisher Index Page (via DOI)
- Download citation as: RIS | Dublin Core
Abstract
Landslide susceptibility shows the spatial likelihood of landslide occurrence in a specific geographical area and is a relevant tool for mitigating the impact of landslides worldwide. As such, it is the subject of countless scientific studies. Many methods exist for generating a susceptibility map, mostly falling under the definition of statistical or machine learning. These models try to solve a classification problem: given a collection of spatial variables, and their combination associated with landslide presence or absence, a model should be trained, tested to reproduce the target outcome, and eventually applied to unseen data.
Contrary to many fields of science that use machine learning for specific tasks, no reference data exist to assess the performance of a given method for landslide susceptibility. Here, we propose a benchmark dataset consisting of 7360 slope units encompassing an area of about 4,100 km2 in Central Italy. Using the dataset, we tried to answer two open questions in landslide research: (1) what effect does the human variability have in creating susceptibility models; (2) how can we develop a reproducible workflow for allowing meaningful model comparisons within the landslide susceptibility research community.
With these questions in mind, we released a preliminary version of the dataset, along with a “call for collaboration,” aimed at collecting different calculations using the proposed data, and leaving the freedom of implementation to the respondents. Contributions were different in many respects, including classification methods, use of predictors, implementation of training/validation, and performance assessment. That feedback suggested refining the initial dataset, and constraining the implementation workflow. This resulted in a final benchmark dataset and landslide susceptibility maps obtained with many classification methods.
Values of area under the receiver operating characteristic curve obtained with the final benchmark dataset were rather similar, as an effect of constraints on training, cross–validation, and use of data. Brier score results show larger variability, instead, ascribed to different model predictive abilities. Correlation plots show similarities between results of different methods applied by the same group, ascribed to a residual implementation dependence.
We stress that the experiment did not intend to select the “best” method but only to establish a first benchmark dataset and workflow, that may be useful as a standard reference for calculations by other scholars. The experiment, to our knowledge, is the first of its kind for landslide susceptibility modeling. The data and workflow presented here comparatively assess the performance of independent methods for landslide susceptibility and we suggest the benchmark approach as a best practice for quantitative research in geosciences.
Study Area
| Publication type | Article |
|---|---|
| Publication Subtype | Journal Article |
| Title | A benchmark dataset and workflow for landslide susceptibility zonation |
| Series title | Earth-Science Reviews |
| DOI | 10.1016/j.earscirev.2024.104927 |
| Volume | 258 |
| Year Published | 2024 |
| Language | English |
| Publisher | Elsevier |
| Contributing office(s) | Geologic Hazards Science Center - Landslides / Earthquake Geology |
| Description | 104927, 26 p. |
| Country | Italy |
| Google Analytic Metrics | Metrics page |