CONVERGE: A Vision-Radio Research Infrastructure Towards 6G and Beyond

• Type: Article in International Conference Proceedings Book
• Date: 2024

Authors

Teixeira, FB (Author) Other; Manuel Ricardo (Author) FEUP; Coelho, A (Author) Other; Oliveira, HP (Author) FCUP; Viana, P (Author) Other; Nuno Paulino (Author) FEUP; Fontes, H (Author) Other; Marques, PVS (Author) FCUP; Campos, R (Author) FEUP; L. M. Pessoa (Author) FEUP

Conference proceedings International

Title: 2024 JOINT EUROPEAN CONFERENCE ON NETWORKS AND COMMUNICATIONS & 6G SUMMIT, EUCNC/6G SUMMIT 2024

Pages: 1015-1020

Joint European Conference on Networks and Communications & 6G Summit (EuCNC/6G Summit)

Antwerp, BELGIUM, JUN 03-06, 2024

Indexing

ISI Web of Knowledge - 1 Citation

Scopus - 1 Citation

Other information

Authenticus ID: P-012-N81

DOI: 10.1109/eucnc/6gsummit60053.2024.10597071

Abstract (EN): Telecommunications and computer vision have evolved separately so far. Yet, with the shift to sub-terahertz (sub-THz) and terahertz (THz) radio communications, there is an opportunity to explore computer vision technologies together with radio communications, considering the dependency of both technologies on Line of Sight. The combination of radio sensing and computer vision can address challenges such as obstructions and poor lighting. Also, machine learning algorithms, capable of processing multimodal data, play a crucial role in deriving insights from raw and low-level sensing data, offering a new level of abstraction that can enhance various applications and use cases such as beamforming and terminal handovers. This paper introduces CONVERGE, a pioneering vision-radio paradigm that bridges this gap by leveraging Integrated Sensing and Communication (ISAC) to facilitate a dual View-to-Communicate, Communicate-to-View approach. CONVERGE offers tools that merge wireless communications and computer vision, establishing a novel Research Infrastructure (RI) that will be open to the scientific community and capable of providing open datasets. This new infrastructure will support future research in 6G and beyond concerning multiple verticals, such as telecommunications, automotive, manufacturing, media, and health.

Language: English

Type (Professor's evaluation): Scientific

No. of pages: 6