Falls frequently present substantial safety hazards to those who are alone, particularly the elderly. Deploying a rapid and proficient method for detecting falls is a highly effective approach to tackle this concealed peril. The majority of existing fall detection methods rely on either visual data or wearable devices, both of which have drawbacks. This research presents a multimodal approach that integrates video and audio modalities to address the issue of fall detection systems and enhances the accuracy of fall detection in challenging environmental conditions. This multimodal approach, which leverages the benefits of attention mechanism in both video and audio streams, utilizes features from both modalities through feature-level fusion to detect falls in unfavorable conditions where visual systems alone are unable to do so. We assessed the performance of our multimodal fall detection model using Le2i and UP-Fall datasets. Additionally, we compared our findings with other fall detection methods. The outstanding results of our multimodal model indicate its superior performance compared to single fall detection models.

The advances in Internet of things lead to an increased number of devices generating and streaming data. These devices can be useful data sources for activity recognition by using machine learning. However, the set of available sensors may vary over time, e.g. due to mobility of the sensors and technical failures. Since the machine learning model uses the data streams from the sensors as input, it must be able to handle a varying number of input variables, i.e. that the feature space might change over time. Moreover, the labelled data necessary for the training is often costly to acquire. In active learning, the model is given a budget for requesting labels from an oracle, and aims to maximize accuracy by careful selection of what data instances to label. It is generally assumed that the role of the oracle only is to respond to queries and that it will always do so. In many real-world scenarios however, the oracle is a human user and the assumptions are simplifications that might not give a proper depiction of the setting. In this work we investigate different interactive machine learning strategies, out of which active learning is one, which explore the effects of an oracle that can be more proactive and factors that might influence a user to provide or withhold labels. We implement five interactive machine learning strategies as well as hybrid versions of them and evaluate them on two datasets. The results show that a more proactive user can improve the performance, especially when the user is influenced by the accuracy of earlier predictions. The experiments also highlight challenges related to evaluating performance when the set of classes is changing over time.

Connected smart homes (CSH) have benefited immensely from emerging Internet of Things (IoT) technology. CSH is intended to support everyday life in the private seclusion of the home, and typically covers the integration of smart devices such as smart meters, heating, ventilation, and air conditioning (HVAC), intelligent lightening, and voice-activated assistants among others. Nevertheless, the risks associated with CSH assets are often of high concern. For instance, energy consumption monitoring through smart meters can reveal sensitive information that may pose a privacy risk to home occupants if not properly managed. Existing risk assessment approaches for CSH tend to focus on qualitative risk assessment methodologies, such as operationally critical threat, asset, and vulnerability evaluation (OCTAVE). However, security risk assessment, particularly for IoT environments, demands both qualitative and quantitative risk assessment. This paper proposes assets-based risk assessment model that integrates both qualitative and quantitative risk assessment to determine the risk related to assets in CSH when a specific service is used. We apply fuzzy Analytic Hierarchy Process (fuzzy AHP) to address the subjective assessment of the IoT risk analysts and stakeholders. The applicability of the proposed model is illustrated through a use case that constitutes a scenario connected to service delivery in CSH. The proposed model provides a guideline to researchers and practitioners on how to quantify the risks targeting assets in CSH.

The objective of this study is to provide a better understanding of the potential of using Artificial Intelligence (AI) to improve Public Transport (PT), by reviewing research literature. The selection process resulted in 87 scientific publications constituting a sample of how AI has been applied to improve PT. The review shows that the primary aims of using AI are to improve the service quality or to better understand traveller behaviour. Train and bus are the dominant modes of transport investigated. Furthermore, AI is mainly used for three tasks; the most frequent one is prediction, followed by an estimation of the current state, and resource allocation, including planning and scheduling. Only two studies concern automation; all the others provide different kinds of decision support for travellers, PT operators, PT planners, or municipalities. Most of the reviewed AI solutions require significant amounts of data related to the travellers and the PT system. Machine learning is the most frequently used AI technology, with some studies applying reasoning or heuristic search techniques. We conclude that there still remains a great potential of using AI to improve PT waiting to be explored, but that there are also some challenges that need to be considered. They are often related to data, e.g., that large datasets of high quality are needed, that substantial resources and time are needed to pre-process the data, or that the data compromise personal privacy. Further research is needed about how to handle these issues efficiently.

Proper modeling of human behavior is crucial when developing agent-based models to investigate the effects of policies, such as the potential consequences of interventions during a pandemic. It is, however, unclear, how sophisticated behavior models need to be for being considered suitable to support policy making. The goal of this paper is to identify recommendations on how human behavior should be modeled in Agent-Based Social Simulation (ABSS) as well as to investigate to what extent these recommendations are actually followed by models explicitly developed for policy making. By analyzing the literature, we identify seven relevant aspects of human behavior for consideration in ABSS. Based on these aspects, we review how human behavior is modeled in ABSS of COVID-19 interventions, in order to investigate the capabilities and limitations of these models to provide policy advice. We focus on models that were published within six months of the start of the pandemic as this is when policy makers needed the support provided by ABSS the most. It was found that most models did not include the majority of the identified relevant aspects, in particular norm compliance, agent deliberation, and interventions’ affective effects on individuals. We argue that ABSS models need a higher level of descriptiveness than what is present in most of the studied early COVID-19 models to support policymaker decisions. 

This article provides an overview of recent research on edge-cloud architectures in hybrid energy management systems (HEMSs). It delves into the typical structure of an IoT system, consisting of three key layers: the perception layer, the network layer, and the application layer. The edge-cloud architecture adds two more layers: the middleware layer and the business layer. This article also addresses challenges in the proposed architecture, including standardization, scalability, security, privacy, regulatory compliance, and infrastructure maintenance. Privacy concerns can hinder the adoption of HEMS. Therefore, we also provide an overview of these concerns and recent research on edge-cloud solutions for HEMS that addresses them. This article concludes by discussing the future trends of edge-cloud architectures for HEMS. These trends include increased use of artificial intelligence on an edge level to improve the performance and reliability of HEMS and the use of blockchain to improve the security and privacy of edge-cloud computing systems.

The use of Artificial Intelligence (AI) in Internet of Things (IoT) systems has gained significant attention due to its potential to improve efficiency, functionality and decision-making. To further advance research and practical implementation, it is crucial to better understand the specific roles of AI in IoT systems and identify the key application domains. In this article we aim to identify the different roles of AI in IoT systems and the application domains where AI is used most significantly. We have conducted a systematic mapping study using multiple databases, i.e., Scopus, ACM Digital Library, IEEE Xplore and Wiley Online. Eighty-one relevant survey articles were selected after applying the selection criteria and then analyzed to extract the key information. As a result, six general tasks of AI in IoT systems were identified: pattern recognition, decision support, decision-making and acting, prediction, data management and human interaction. Moreover, 15 subtasks were identified, as well as 13 application domains, where healthcare was the most frequent. We conclude that there are several important tasks that AI can perform in IoT systems, improving efficiency, security and functionality across many important application domains.

This paper presents a novel Hierarchical Transfer and Multi-task Learning (HTMTL) approach designed to substantially improve the performance of scene classification networks by leveraging the collective influence of diverse scene types. HTMTL is distinguished by its ability to capture the interaction between various scene types, recognizing how context information from one scene category can enhance the classification performance of another. Our method, when applied to the Places365 dataset, demonstrates a significant improvement in the network’s ability to accurately identify scene types. By exploiting these inter-scene interactions, HTMTL significantly enhances scene classification performance, making it a potent tool for advancing scene understanding and classification. Additionally, this study explores the contribution of individual tasks and task groupings on the performance of other tasks. To further validate the generality of HTMTL, we applied it to the Cityscapes dataset, where the results also show promise. This indicates the broad applicability and effectiveness of our approach across different datasets and scene types.

This paper explores the topic of model credibility of Agent-based Models and how they should be evaluated prior to application in policy-making. Specifically, this involves analyzing bordering literature from different fields to: (1) establish a definition of model credibility -- a measure of confidence in the model's inferential capability -- and to (2) assess how model credibility can be strengthened through Verification, Validation, and Accreditation (VV&A) prior to application, as well as through post-application evaluation. Several studies have highlighted severe shortcomings in how V&V of Agent-based Models is performed and documented, and few public administrations have an established process for model accreditation. To address the first issue, we examine the literature on model V&V and, based on this review, introduce and outline the usage of a V&V plan. To address the second issue, we take inspiration from a practical use case of model accreditation applied by a government institution to propose a framework for the accreditation of ABMs for policy-making. The paper concludes with a discussion of the risks associated with improper assessments of model credibility. 

The research delves into intelligent hybrid heat management Systems, exploring the challenges faced and solutions for enhancing efficiency. Hybrid heating systems are complex cyber-technical systems that combine city heating networks with renewable energy sources, such as heat pumps and solar panels. Traditional heating systems often lack adaptability to internal and external conditions, leading to suboptimal performance and user expectations. This paper proposes a new approach by integrating smart technologies, the Internet of Things, Artificial Intelligence, Machine Learning, optimization techniques, and trade-offs into the management of hybrid heat systems. The emphasis is also placed on the fact that the introduction of smart technologies makes it possible to make hybrid heating systems human-oriented and meet individual needs. Energy efficiency improvement is achievable by combining solutions, such as actual forecasting, with intelligent management that adapts to changing climates and user behaviors. The challenges addressed include inadequate responsiveness to load changes, inaccurate heat consumption forecasting, and inefficient data management. The paper emphasizes the need for intelligent systems that comply with the current standards, providing cost optimization, socializing and ensuring resilience, customer orientation, reliability, safety, and trustworthiness. This exploration of intelligent hybrid heat management systems seeks to overcome existing challenges and pave the way for a sustainable, digitally optimized future in district heating systems.