SHARCS - Shared Concept Space for Explainable Multimodal Learning
Accepted to NeurIPS2024 Workshop - UniReps, 2023
In this paper, we introduce SHARCS (SHARed Concept Space) – a novel concept-based approach for explainable multimodal learning. SHARCS learns and maps interpretable concepts from different heterogeneous modalities into a single unified concept-manifold, which leads to an intuitive projection of semantically similar cross-modal concepts.
Recommended citation: Gabriele Dominici, Pietro Barbiero, Lucie Charlotte Magister, Pietro Liò, & Nikola Simidjievski. (2023). SHARCS: Shared Concept Space for Explainable Multimodal Learning. https://arxiv.org/abs/2307.00316?context=cs.AI