The study of cultural heritage (CH) objects benefits greatly from non-invasive techniques like hyperspectral imaging (HSI), which enables material identification and spatial mapping. Due to the heterogeneous composition of CH artifacts, combining complementary techniques is essential for comprehensive analysis. However, handling such high-dimensional datasets remains a challenge. We present a computational protocol that combines spatial and spectral dimensionality reduction to enable early-stage fusion and efficient analysis of fused data, through multivariate methods, with a focus on Uniform Manifold Approximation and Projection (UMAP). We introduce an open-source plugin for Napari viewer, which allows for UMAP-based exploration of fused multimodal datasets. Our approach is demonstrated in case studies involving reflectance and photoluminescence data fusion, showcasing its effectiveness in detecting degradation phenomena and revealing material complexity in both plastic artifacts and historical paintings.

Integrating innovative Spatial and Spectral Data Fusion strategies in Hyperspectral Imaging for Cultural Heritage

Di Benedetto, Alessia;Martinelli, Elisabetta;Samela, Sabrina;Guzmán García Lascurain, Paulina;Manzoni, Cristian;Comelli, Daniela
2025-01-01

Abstract

The study of cultural heritage (CH) objects benefits greatly from non-invasive techniques like hyperspectral imaging (HSI), which enables material identification and spatial mapping. Due to the heterogeneous composition of CH artifacts, combining complementary techniques is essential for comprehensive analysis. However, handling such high-dimensional datasets remains a challenge. We present a computational protocol that combines spatial and spectral dimensionality reduction to enable early-stage fusion and efficient analysis of fused data, through multivariate methods, with a focus on Uniform Manifold Approximation and Projection (UMAP). We introduce an open-source plugin for Napari viewer, which allows for UMAP-based exploration of fused multimodal datasets. Our approach is demonstrated in case studies involving reflectance and photoluminescence data fusion, showcasing its effectiveness in detecting degradation phenomena and revealing material complexity in both plastic artifacts and historical paintings.
2025
2025 European Optical Society Annual Meeting, EOSAM 2025
File in questo prodotto:
File Dimensione Formato  
epjconf_eosam2025_03024.pdf

Accesso riservato

Descrizione: EOSAM2025_AdB
Dimensione 1.33 MB
Formato Adobe PDF
1.33 MB Adobe PDF   Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11311/1297274
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact