Home $ Project $ Integration of Real and Virtual Worlds in the Mixed Reality Environment
Integration of Real and Virtual Worlds in the Mixed Reality Environment
The project focuses on linking a Metaverse-type virtual world with the real world through a virtual teleport that enables stereoscopic spherical capture of a remote space or object/person, its processing, transmission, and integration into a virtual environment for interactive multimedia communication.

One of the main research topics in the field of ICT is the creation of a virtual world for virtual communication (e.g., the Metaverse). The virtualization of communication enables, among other things, easier technical implementation as well as the creation of virtual worlds with imagined properties. The aim of the proposed project is to connect the virtual world with the real world, which is captured online and displayed in the virtual world (virtual teleport, VT). We distinguish two types of VT:

  • Capturing an object/person and transferring a hologram into the virtual world,
  • Capturing a remote real world and making it present to real persons.

The responsible project investigator is the author of patent applications on behalf of STU. Their subject is a unique concept of a camera system that ensures spherical capture of space in stereo quality. The task of the project is to integrate at least part of the space/object captured in this way into a virtual world. Camera synchronization, projection, and image stitching to create the resulting stereo view represent a significant scientific and research challenge.

Scientific objectives

The main scientific objective is to connect a Metaverse-type virtual world with the real world through a virtual teleport of a remote space or object/person. The basic scientific objectives are concentrated in the following areas:

  • Design of methods and algorithms for interactive multimedia services and applications with an emphasis on multimedia content delivery, including its adaptation, focusing on content such as: still images, 2D video, 3D video, 360° and omnidirectional video, 3D telepresence, VR/AR
  • Design and implementation of a camera system for unlimited omnidirectional stereoscopic transmission of visual information from a remote space and their synchronization
  • Design and implementation of methods and algorithms for image stitching within the proposed camera system
  • Design of methods and algorithms for interactive multimedia services and applications with an emphasis on multimedia content delivery, including its adaptation, focusing on interaction and feedback
  • Identification, design, and verification of new possibilities for adapting multimedia content delivery in 5G networks
  • Integration of the thus-created teleport of space or object/person into a virtual world

Experimental models of cameras for stereoscopic vision

Short: InterViR
Start: January 2023
End: December 2025
ID: VEGA 1/0605/23
Web:

Supported Research: