top of page

Multimodal Representations of Cultural Heritage

​​Key Objectives:
​
  1. Metadata & Ontologies: We are creating systems to organize and connect different types of data, enabling seamless transformation across formats.

  2. Multimodal & Multisensory Representation: Research is being conducted on how to best represent CH using multiple senses (e.g., sight, sound, touch) for a more immersive experience.

  3. Co-design & Participation: We use participatory methods, involving the community in designing multisensory representations to ensure inclusivity and relevance.

  4. Aesthetic & Experiential Validation: We gather feedback and requirements through co-design methods to validate how well the representations evoke emotional and aesthetic responses.​

​

Additional Goals Include:
 
  • Developing a co-design environment to validate virtual CH experiences.

  • Creating virtual spaces that foster collaborative engagement with cultural heritage.

  • Using affective computing to improve emotional and sensory interaction with CH.

  • Offering fully immersive virtual reality (VR) experiences for deeper CH engagement.

  • Ensuring wide access to these digital cultural assets through a user-friendly, multi-experience web platform.

​

Our Virtual Exhibition 

​

We are working on the design of a virtual exhibition to incorporate the multimodal representations of cultural assets. Users are able to experience 2D and 3D representations of statues and paintings and get engaged in multisensory interactions with the space and the artefacts. Therefore, users have the opportunity to interact through their vision, hearing, and haptic senses.

L1010677.jpg

We want to extend cultural experiences to all senses, and in particular beyond visual and auditory senses. Our goal is to develop advanced ways of representing cultural heritage that make it more accessible and inclusive. By combining different sensory experiences (visual, audio, haptics) and layers of information, we aim to create richer, more engaging interactions with both tangible and intangible heritage.

 

This means that cultural objects such as works of art, crafts, heritage sites or historical archives can be experienced virtually, both by sight (images, videos or texts), hearing (sound, music or audio description) and touch (through haptic technologies). 

Here’s how we’re working toward this goal:

bottom of page