Privacy-aware Hydra (PA-Hydra) for 3D Scene Graph ConstructionShow others and affiliations
2024 (English)In: 2024 IEEE 10th World Forum on Internet of Things, WF-IoT 2024, Institute of Electrical and Electronics Engineers (IEEE), 2024, p. 822-827Conference paper, Published paper (Refereed)
Abstract [en]
A 3D Scene Graph (3DSG) is a hierarchical 3D representation of a physical environment. Hydra is a promising real-time spatial perception framework for 3DSG developed by MIT Spark Lab. It uses sensor and camera data from an agent to construct a graph of the environment with five layers and continuously updates it. Albeit its utility and efficiency in generating and updating real-time 3DSG using visual-inertial sensors, Hydra and many other 3DSG frameworks ignore violating to identify private sensitive objects by segmenting, identifying, and reconstructing everything in data. Therefore, in this paper, we enhance Hydra to preserve sensitive data and increase the privacy-awareness of the framework. Accordingly, we propose a Privacy-aware Hydra (Pa-Hydra) framework, which integrates a state-of-the-art Object Detection (OD) algorithm that utilizes a proposed Filter Algorithm to cover sensitive objects with black boxes and prevent them from being constructed by Hydra. We implemented the framework with two popular OD algorithms with two different pre-trained models: You Only Look Once version 9 (YOLOv9) and Real-time Detection Transformer (RTDETR). We evaluated the algorithms using the COCO2017 validation dataset and observed the efficiency of the proposed framework on the uHuman2 (uH2) dataset.
Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2024. p. 822-827
Series
IEEE World Forum on Internet of Things, ISSN 2769-4003, E-ISSN 2768-1734
Keywords [en]
3D Scene Graphs, 3DSG, Computer Vision, GDPR, Hydra, Object Detection, Privacy-preservation
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:mau:diva-74090DOI: 10.1109/WF-IoT62078.2024.10811446Scopus ID: 2-s2.0-85216547163ISBN: 9798350373011 (electronic)ISBN: 9798350373028 (print)OAI: oai:DiVA.org:mau-74090DiVA, id: diva2:1938837
Conference
10th IEEE World Forum on Internet of Things, WF-IoT 2024, 10 Nov-13 Nov 2024, Ottawa, Canada
2025-02-192025-02-192025-10-06Bibliographically approved