How augmented reality and virtual reality are taking their places in contemporary media culture alongside film and television.

This book positions augmented reality (AR) and virtual reality (VR) firmly in contemporary media culture. The authors view AR and VR not as the latest hyped technologies but as media—the latest in a series of what they term “reality media,” taking their place alongside film and television. Reality media inserts a layer of media between us and our perception of the world; AR and VR do not replace reality but refashion a reality for us. Each reality medium mediates and remediates; each offers a new representation that we implicitly compare to our experience of the world in itself but also through other media.

The authors show that as forms of reality media emerge, they not only chart a future path for media culture, but also redefine media past. With AR and VR in mind, then, we can recognize their precursors in eighteenth-century panoramas and the Broadway lights of the 1930s. A digital version of Reality Media, available through the book's website, invites readers to visit a series of virtual rooms featuring interactivity, 3-D models, videos, images, and texts that explore the themes of the book.

Electric vehicles (EVs) are environmentally friendly and are considered to be a promising approach toward a green transportation infrastructure with lower greenhouse gas emissions. However, the limited driving range of EVs demands a strategic allocation of charging facilities, hence providing recharging opportunities that help reduce EV owners' anxiety about their vehicles' range. In this paper, we study a set covering method where self-avoiding walks are utilized to find the most significant locations for charging stations. In the corresponding optimization problem, we derive a lower bound of the number of charging stations in a transportation network to obtain full coverage of the most probable routes. The proposed method is applied to a transportation network of the southern part of Sweden.

When simulation models shall be used to support decision-making, the trustworthiness of the results need to be ensured. Usually, models are validated against real-world data. Yet, in the ongoing pandemic, there is a lack of respective data that can be used to validate the model’s behaviour. To overcome this issue, this chapter discusses the validation of simulation models for the Covid-19 pandemic by comparing their results among each other. To this end, we present a formal comparison between the existing behaviour-based epidemiological model that was developed at the University of Oxford and the ASSOCC model.

A/B experimentation is a known technique for datadriven product development and has demonstrated its value in web-facing businesses. With the digitalisation of the automotive industry, the focus in the industry is shifting towards software. For automotive embedded software to continuously improve, A/B experimentation is considered an important technique. However, the adoption of such a technique is not without challenge. In this paper, we present an architecture to enable A/B testing in automotive embedded software. The design addresses challenges that are unique to the automotive industry in a systematic fashion. Going from hypothesis to practice, our architecture was also applied in practice for running online experiments on a considerable scale. Furthermore, a case study approach was used to compare our proposal with state-of-practice in the automotive industry. We found our architecture design to be relevant and applicable in the efforts of adopting continuous A/B experiments in automotive embedded software.

The lack of labeled data is a major problem in both research and industrial settings since obtaining labels is often an expensive and time-consuming activity. In the past years, several machine learning algorithms were developed to assist and perform automated labeling in partially labeled datasets. While many of these algorithms are available in open-source packages, there is a lack of research that investigates how these algorithms compare to each other for different types of datasets and with different percentages of available labels. To address this problem, this paper empirically evaluates and compares seven algorithms for automated labeling in terms of their accuracy. We investigate how these algorithms perform in twelve different and well-known datasets with three different types of data, images, texts, and numerical values. We evaluate these algorithms under two different experimental conditions, with 10% and 50% labels of available labels in the dataset. Each algorithm, in each dataset for each experimental condition, is evaluated independently ten times with different random seeds. The results are analyzed and the algorithms are compared utilizing a Bayesian Bradley-Terry model. The results indicate that the active learning algorithms using the query strategies uncertainty sampling, QBC and random sampling are always the best algorithms. However, this comes with the expense of increased manual labeling effort. These results help machine learning practitioners in choosing optimal machine learning algorithms to label their data.

Quests are a core element in many games, especially role-playing and adventure games, where quests drive the gameplay and story, engage the player in the game’s narrative, and in most cases, act as a bridge between different game elements. The automatic generation of quests and objectives is an interesting challenge since this can extend the lifetime of games such as in Skyrim, or can help create unique experiences such as in AI Dungeon. This work presents Questgram [Qg], a mixed-initiative prototype tool for creating quests using grammars combined in a mixed-initiative level design tool. We evaluated our tool quantitatively by assessing the generated quests and qualitatively through a small user study. Human designers evaluated the system by creating quests manually, automatically, and through mixed-initiative. Our results show the Questgram’s potential, which creates diverse, valid, and interesting quests using quest patterns. Likewise, it helps engage designers in the quest design process, fosters their creativity by inspiring them, and enhance the level generation facet of the Evolutionary Dungeon Designer with steps towards intertwining both level and quest design.

MAP-Elites has been successfully applied to the generation of game content and robot behaviors. However, its behavior and performance when interacted with in co-creative systems is underexplored. This paper analyzes the implications of synthetic interaction for the stability and adaptability of MAP-Elites in such scenarios. We use pre-recorded human-made level design sessions with the Interactive Constrained MAP-Elites (IC MAP-Elites). To analyze the effect of each edition step in the search space over time using different feature dimensions, we introduce Temporal Expressive Range Analysis (TERA). With TERAs, MAP-Elites is assessed in terms of its adaptability and stability to generate diverse and high-performing individuals. Our results show that interactivity, in the form of design edits and MAP-Elites adapting towards them, directs the search process to previously unexplored areas of the fitness landscape and points towards how this could improve and enrich the co-creative process with quality-diverse individuals.

The general idea of tracking and tracing apps is that they track the contacts of users so that in case a user tests positive for COVID-19, all the other users that she has been in contact with get a warning signal that they have potentially been in contact with the COVID-19 virus. This is, to quarantine potential carriers of the virus even before they show symptoms. We set up a scenario in which we test the effects the introduction of such an app has on the dynamics of infection with varying amounts of app users. Running the experiments resulted in a slightly lower peak of infections for higher app usages and the total amount of infected individuals over the course of the whole run decreased not more than 10% in any case. The app seems mainly effective in decreasing contacts and infections in public spaces (except hospitals) while increasing the contacts and infections at home.

Digitalizing tabletop games for general game playing(GGP) AI research is a continuously growing field. TabletopGames Framework (TAG) is a framework developed to simplifythe process of implementing tabletop board games to digital form.Sushi Go! is a game that combines simultaneous action selectionand complete information. This creates a unique combination ofmechanics, which presents a new challenge for GGP agents. Byimplementing Sushi Go! into TAG, we can test different agent’sperformance using these mechanics and compare them to theirexisting performances in the other games of TAG. Results ofthis testing are presented, which display that the framework iscapable of implementing Sushi Go! and that the agents performwith mixed results. Further developing heuristics for the agentsshould prove to increase their performance when faced with thesetypes of games.

With the development and the increasing interests in ML/DL fields, companies are eager to apply Machine Learning/Deep Learning approaches to increase service quality and customer experience. Federated Learning was implemented as an effective model training method for distributing and accelerating time-consuming model training while protecting user data privacy. However, common Federated Learning approaches, on the other hand, use a synchronous protocol to conduct model aggregation, which is inflexible and unable to adapt to rapidly changing environments and heterogeneous hardware settings in real-world scenarios. In this paper, we present an approach to real-time end-to-end Federated Learning combined with a novel asynchronous model aggregation protocol. Our method is validated in an industrial use case in the automotive domain, focusing on steering wheel angle prediction for autonomous driving. Our findings show that asynchronous Federated Learning can significantly improve the prediction performance of local edge models while maintaining the same level of accuracy as centralized machine learning. Furthermore, by using a sliding training window, the approach can minimize communication overhead, accelerate model training speed and consume real-time streaming data, proving high efficiency when deploying ML/DL components to heterogeneous real-world embedded systems.

Emerging digital technologies are becoming increasingly prevalent in contemporary society. As future- oriented, promissory, and sometimes yet to be realised, such technologies pose particular methodological challenges for digital social research since they partake in creating the future they aim at transforming. This paper proposes a methodological framework to study the construction of emerging digital technologies as meaningful phenomena. Corporate actors within this growing field adopt similar marketing strategies that involve sharing multimodal promotional materials on digital platforms where technical specifications blend with evocative stories. These stories employ a future- oriented vocabulary in which words such as change, re-imagination, reinvention, and transformation play an essential role. Building on recent ethnographic research, this paper demonstrates how emerging digital technologies are promoted by creating a symbolic and imaginary context in which such technologies make perfect sense. These studies focus on wearable devices, digital food technologies, and systems for work automation. The empirical examples demonstrate how the promotional materials involve discursive practices that produce a particular kind of situated and transformative knowledge that allows emerging digital technologies to appear meaningful. These empirical examples serve as a basis for the formulation of ’digital technography’ as a methodological framework that allows for an interrogation of how emerging digital technologies are imagined across different sites of knowledge production.

Named data networking (NDN) is an emerging information-centric networking paradigm, in which the Internet of Things (IoT) achieves excellent scalability. Recent literature proposes the concept of NDN-IoT, which maximizes the expansion of IoT applications by deploying NDN in the IoT. In the NDN, the security is built into the network by embedding a public signature in each data package to verify the authenticity and integrity of the content. However, signature schemes in the NDN-IoT environment are facing several challenges, such as signing security challenge for resource-constrained IoT end devices (EDs) and verification efficiency challenge for NDN routers. This article mainly studies the data package authentication scheme in the package-level security mechanism. Based on mobile edge computing (MEC), an efficient certificateless group signature scheme featured with anonymity, unforgeability, traceability, and key escrow resilience is proposed. The regional and edge architecture is utilized to solve the device management problem of IoT, reducing the risks of content pollution attacks from the data source. By offloading signature pressure to MEC servers, the contradiction between heavy overhead and shortage of ED resources is avoided. Moreover, the verification efficiency in NDN router is much improved via batch verification in the proposed scheme. Both security analysis and experimental simulations show that the proposed MEC-based certificateless group signature scheme is provably secure and practical.

Smart homes promise to improve the quality of life of residents. However, they collect vasts amounts of personal and sensitive data, making privacy protection critically important. We propose a framework, called PRASH, for modeling and analyzing the privacy risks of smart homes. It is composed of three modules: a system model, a threat model, and a set of privacy metrics, which together are used for calculating the privacy risk exposure of a smart home system. By representing a smart home through a formal specification, PRASH allows for early identification of threats, better planning for risk management scenarios, and mitigation of potential impacts caused by attacks before they compromise the lives of residents. To demonstrate the capabilities of PRASH, an executable version of the smart home system configuration was generated using the proposed formal specification, which was then analyzed to find potential attack paths while also mitigating the impacts of those attacks. Thereby, we add important contributions to the body of knowledge on the mitigations of threat agents violating the privacy of users in their homes. Overall, the use of PRASH will help residents to preserve their right to privacy in the face of the emerging challenges affecting smart homes.

In order to pursue high-accuracy localization for intelligent vehicles (IVs) in semi-open scenarios, this study proposes a new map creation method based on multi-sensor fusion technique. In this new method, the road scenario fingerprint (RSF) was employed to fuse the visual features, three-dimensional (3D) data and trajectories in the multi-view and multi-sensor information fusion process. The visual features were collected in the front and downward views of the IVs; the 3D data were collected by the laser scanner and the downward camera and a homography method was proposed to reconstruct the monocular 3D data; the trajectories were computed from the 3D data in the downward view. Moreover, a new plane-corresponding calibration strategy was developed to ensure the fusion quality of sensory measurements of the camera and laser. In order to evaluate the proposed method, experimental tests were carried out in a 5 km semi-open ring route. A series of nodes were found to construct the RSF map. The experimental results demonstrate that the mean error of the nodes between the created and actual maps was 2.7 cm, the standard deviation of the nodes was 2.1 cm and the max error was 11.8 cm. The localization error of the IV was 10.8 cm. Hence, the proposed RSF map can be applied to semi-open scenarios in practice to provide a reliable basic for IV localization.

With the increasing diffusion of Internet of Things (IoT) technologies, the transportation of goods sector is in a position to adopt novel intelligent services that cut across the otherwise highly fragmented and heterogeneous market, which today consists of a myriad of actors. Legacy systems that rely upon direct integration between all actors involved in the transportation ecosystem face considerable challenges for information sharing. Meanwhile, IoT based services, which are designed as devices that follow goods and communicate directly to cloud-based backend systems, may provide services that previously were not available. For the purposes of this paper, we present a theoretical framework for classification of such intelligent goods systems based on a literature study. The framework, labelled as the Intelligent Goods Service (IGS) framework, aims at increasing the understanding of the actors, agents, and services involved in an intelligent goods system, and to facilitate system comparisons and the development of new innovative solutions. As an illustration of how the IGS framework can be used and contribute to research in this area, we provide an example from a direct industry-academia collaboration.

The increasing popularity of e-commerce requires efficient solutions for the provision of last mile logistics. There are different approaches for delivering parcels, e.g., home delivery, service points, or parcel lockers, which have different advantages and disadvantages for customers and logistics providers in terms of flexibility, accessibility, and operating costs. We have studied a novel transportation solution where electric vehicles dynamically set up smart cargo boxes, from which customers can fetch their delivery at any time of the day. This provides customers with a more flexible access to their packages and allows the service provider to deliver the parcels more efficiently. In this article, we present the results of a feasibility study conducted in Västra Hamnen, Malmö (Sweden). The developed simulation model shows that smart boxes not only are a viable approach for efficient last mile deliveries, but also result in considerably smaller travel distances compared to conventional package delivery.

With the increasing applications of magnetic robots in medical instruments, the research on different structures and locomotion approaches of magnetic robots has become a hotspot in recent years. A ferrofluid rolling robot (FRR) with magnetic actuation is proposed and enabled to realize a novel locomotion approach in this article. The drive performance of ferrofluid is elaborated, which is characterized by the magnetic torque of a rectangle-shaped object filled with ferrofluid under magnetic field. First, the proposed structure and locomotion mechanism of the FRR are detailed. Moreover, based on the established mathematical models of the FRR, the simulations with straight and turning locomotion are carried out, respectively. Finally, the FRR prototype is manufactured by 3-D printing, and experimental results demonstrate that the feasibility of straight and turning locomotion is verified. The locomotion performance of the FRR is in good agreement with the theoretical models where the root mean square (rms) value of displacement for experiments and simulations is 1.2 mm. In this work, the proposed FRR can automatically switch from straight to turning locomotion with a fast response in an external magnetic field, and does not has magnetism when without a magnetic field. 

The Internet of Things (IoT) is revolutionizing our environments with novel types of services and applications by exploiting the large number of diverse connected things. One of the main challenges in the IoT is to engineer systems to support human users to achieve their goals in dynamic and uncertain environments. For instance, the mobility of both users and devices makes it infeasible to always foresee the available things in the users’ current environments. Moreover, users’ activities and/or goals might change suddenly. To support users in such environments, we developed an initial approach that exploits the notion of Emergent Configurations (ECs) and mixed initiative techniques to engineer self-configuring IoT systems. An EC is a goal-driven IoT system composed of a dynamic set of temporarily connecting and cooperating things. ECs are more flexible and usable than IoT systems whose constituents and interfaces are fully specified at design time

A mobile stroke unit (MSU) is an ambulance, where stroke patients can be diagnosed and treated. Recently, placement of MSUs has been studied focusing on either maximum population coverage or equal service for all patients, termed efficiency and equity, respectively. In this study, we propose an unconstrained optimization model for the placement of MSUs, designed to introduce a tradeoff between efficiency and equity. The tradeoff is based on the concepts of weighted average time to treatment and the time difference between the expected time to treatment for different geographical areas. We conduct a case-study for Sweden’s Southern Health care Region (SHR), generating three scenarios (MSU1, MSU2, and MSU3) including 1, 2, and 3 MSUs, respectively. We show that our proposed optimization model can tune the tradeoff between the efficiency and equity perspectives for the MSU(s) allocation. This enables a high level of equal service for most inhabitants, as well as reducing the time to treatment for most inhabitants of a geographic region. In particular, placing three MSUs in the SHR with the proposed tradeoff, the share of inhabitants who are expected to receive treatment within an hour potentially improved by about a factor of 14 in our model.

We have investigated machine learning based cheating behaviour detection in physical activity-based smart-phone games. Sensor data were acquired from the accelerometer/gyroscope of an iPhone 7 during activities such as jumping, squatting, stomping, and their cheating counterparts. Selected attributes providing the most information gain were used together with a sequential model yielding promising results in detecting fake activities. Even better results were achieved by employing a random forest classifier. The results suggest that machine learning is a strong candidate for detecting cheating behaviours in physical activity-based smartphone games.

Context: With the advent of Machine Learning (ML) and especially Deep Learning (DL) technology, companies are increasingly using Artificial Intelligence (AI) in systems, along with electronics and software. Nevertheless, the end-to-end process of developing, deploying and evolving ML and DL models in companies brings some challenges related to the design and scaling of these models. For example, access to and availability of data is often challenging, and activities such as collecting, cleaning, preprocessing, and storing data, as well as training, deploying and monitoring the model(s) are complex. Regardless of the level of expertise and/or access to data scientists, companies in all embedded systems domain struggle to build high-performing models due to a lack of established and systematic design methods and processes.

Objective: The overall objective is to establish systematic and structured design methods and processes for the end-to-end process of developing, deploying and successfully evolving ML/DL models.

Method: To achieve the objective, we conducted our research in close collaboration with companies in the embedded systems domain using different empirical research methods such as case study, action research and literature review.

Results and Conclusions: This research provides six main results: First, it identifies the activities that companies undertake in parallel to develop, deploy and evolve ML/DL models, and the challenges associated with them. Second, it presents a conceptual framework for the continuous delivery of ML/DL models to accelerate AI-driven business in companies. Third, it presents a framework based on current literature to accelerate the end-to-end deployment process and advance knowledge on how to integrate, deploy and operationalize ML/DL models. Fourth, it develops a generic framework with five architectural alternatives for deploying ML/DL models at the edge. These architectural alternatives range from a centralized architecture that prioritizes (re)training in the cloud to a decentralized architecture that prioritizes (re)training at the edge. Fifth, it identifies key factors to help companies decide which architecture to choose for deploying ML/DL models. Finally, it explores how MLOps, as a practice that brings together data scientist teams and operations, ensures the continuous delivery and evolution of models. 

The papers in this special section focus on hybrid human-artificial intelligene (AI) for multimedia computing. Multimedia computing has experienced a tremendous growth in the last decades, with applications ranging from multimedia information retrieval and analysis to multimedia compression and communication. However, the increasing volume and complexity of multimedia data driven by the large-scale spread of various new devices and sensors is posing a serious challenge to traditional multimedia computing algorithms. Artificial intelligence (AI), in particular deep learning techniques, has improved the performance of multimedia computing algorithms for many tasks, including computer vision and natural language processing. But unlike humans, AI is poor at solving tasks across multiple domains or in dealing with an uncontrolled dynamic environment. Hybrid Human-Artificial Intelligence (HH-AI) is an emerging field that aims at combining the benefits of human intelligence, such as semantic association, inference, and generalization with the computing power of AI.

When planning interventions to limit the spread of Covid-19, the current state of knowledge about the disease and specific characteristics of the population need to be considered. Simulations can facilitate policy making as they take prevailing circumstances into account. Moreover, they allow for the investigation of the potential effects of different interventions using an artificial population. Agent-based Social Simulation (ABSS) is argued to be particularly useful as it can capture the behavior of and interactions between individuals. We performed a systematic literature reviewand identified 126 articles that describe ABSS of Covid-19 transmission processes. Our reviewshowed that ABSS is widely used for investigating the spread of Covid-19. Existing models are very heterogeneous with respect to their purpose, the number of simulated individuals, and the modeled geographical region, as well as how they model transmission dynamics, disease states, human behavior, and interventions. To this end, a discrepancy can be identified between the needs of policy makers and what is implemented by the simulation models. This also includes how thoroughly the models consider and represent the real world, e.g. in terms of factors that affect the transmission probability or how humans make decisions. Shortcomingswere also identified in the transparency of the presented models, e.g. in terms of documentation or availability, as well as in their validation, which might limit their suitability for supporting decision-making processes. We discuss how these issues can be mitigated to further establish ABSS as a powerful tool for crisis management.

Higher education institutions (HEIs) are significantly progressing, especially to external affordances caused by Covid-19. Digital assets are an opportunity during the pandemic to secure social distance and enhance the students’ learning experience at the same time. Also, student administration might benefit from new digitally-enhanced opportunities. There is no uniform procedure for the use of digital media in teaching and student services. Thus, HEIs need to ascertain students’ attitudes toward the technologies used. To compare attitudes before and during the pandemic, we surveyed students about their perceptions. The first round of surveys was completed in a blended learning setting in fall 2019 before the global pandemic of Covid-19. The second round was conducted in an online learning setting in February 2021 after nearly one year of higher education under Covid-19. Our results show that students’ perceptions toward digitalization at HEIs differ in many aspects due to the Covid-19 pandemic. Students during the pandemic are more critical of the effects on their learning success. The study indicates that the adoption has taken place more quickly in the area of services. Still, teaching concepts and the learning culture lag behind.

In this paper, we investigate the problem of trajectory tracking control for marine surface vehicles (MSVs), which are subject to dynamic uncertainties, external disturbances and unmeasurable velocities. To recover the unmeasurable velocities, a novel adaptive neural network-based (NN-based) state observer is constructed. To guarantee the transient and steady-state tracking performance of the system, a novel nonlinear transformation method is proposed by employing a tracking error transformation together with a newly constructed performance function, which is characterized by a user-defined settling time and tracking control accuracy. With the aid of the state observer and the nonlinear transformation method in combination with the adaptive NN technique and vector-backstepping design tool, an adaptive neural output-feedback trajectory tracking control scheme with predefined performance is developed. With regard to the developed control scheme, uncertainties can be reconstructed only by utilizing the position and heading of the MSVs. Independent designs of the state observer and the controller can be achieved, and the position tracking error can be guaranteed to fall into a predefined residual set in the user-defined time frame and remain in the above set. A rigorous stability analysis validates that all signals in the closed-loop trajectory tracking control system for MSVs are uniformly ultimately bounded. Simulation results verify the effectiveness of the developed adaptive neural output-feedback trajectory tracking control scheme.

The 18th IEEE International Conference on Software Architecture (ICSA 2021) solicited different types of submissions structured into the following tracks: The main Technical Track (included in the ICSA main proceedings), the Software Architecture in Practice (SAIP) track, the New and Emerging Ideas (NEMI) track, the Early Career Researchers Forum (ECRF), the Journal First track, and the Workshop track (included in the companion volume of ICSA 2021 proceedings). Each of these tracks, except for the Technical Track, is presented in the following sections. © 2021 IEEE.

Understanding the character of natural organic matter (NOM) and assessing its impact on water quality is paramount for managers of catchments and water utilities. For drinking-water producers, NOM affects disinfectant demand and the formation of by-products which can have adverse health effects. NOM content in raw waters also has an impact on water treatment processes by increasing required coagulant dosages, reducing the effectiveness of adsorption processes and fouling membrane systems. This study investigated the effects of calcium chloride (CaCl2) as a co-coagulant in Al3+ and Fe3+ assisted coagulation, flocculation and sedimentation processes for NOM-removal from raw water collected from Lake Bolmen, in southern Sweden. Jar tests were conducted at Ringsjo Water Works (WW), a surface water treatment plant (WTP), to investigate the potential reduction in primary coagulants aluminum sulphate (Al-2(SO4)(3)) and ferric chloride (FeCl3). This work shows that CaCl2 can, in certain situations, reduce the need for primary coagulants, which would reduce the environmental impact and costs associated with primary coagulant consumption.

Building on existing research and experiences regarding the use of supportive and assistive technology -- called welfare technology -- in elderly care, we have developed a framework to represent a holistic view of the complex tangle of factors contributing to the sustainable integration of these technologies into the elder care context. The framework is described here for the purpose of initiating a conversation regarding the framework with interested researchers. At the same time discussions are also being conducted with managers, caregivers, and other stakeholders involved in welfare technology deployment in eldercare in Sweden. Our ultimate goal with the framework is to provide general guidelines that municipalities and care organizations can use to improve the quality of life for elderly citizens through the successful selection, rollout and use of welfare technology that meets the needs not only of the elderly citizens needing support but also of the care providers and organizations. 

Machine Learning (ML) and Artificial Intelligence (AI) impact many aspects of human life, from recommending a significant other to assist the search for extraterrestrial life. The area develops rapidly and exiting unexplored design spaces are constantly laid bare. The focus in this work is one of these areas; ML systems where decisions concerning ML model training, usage and selection of target domain lay in the hands of domain experts. 

This work is then on ML systems that function as a tool that augments and/or enhance human capabilities. The approach presented is denoted Human In Command ML (HIC-ML) systems. To enquire into this research domain design experiments of varying fidelity were used. Two of these experiments focus on augmenting human capabilities and targets the domains commuting and sorting batteries. One experiment focuses on enhancing human capabilities by identifying similar hand-painted plates. The experiments are used as illustrative examples to explore settings where domain experts potentially can: independently train an ML model and in an iterative fashion, interact with it and interpret and understand its decisions. 

HIC-ML should be seen as a governance principle that focuses on adding value and meaning to users. In this work, concrete application areas are presented and discussed. To open up for designing ML-based products for the area an abstract model for HIC-ML is constructed and design guidelines are proposed. In addition, terminology and abstractions useful when designing for explicability are presented by imposing structure and rigidity derived from scientific explanations. Together, this opens up for a contextual shift in ML and makes new application areas probable, areas that naturally couples the usage of AI technology to human virtues and potentially, as a consequence, can result in a democratisation of the usage and knowledge concerning this powerful technology.

In recent years design with augmented reality applications for cultural heritage purposes have increased and their usefulness for informal learning and tourist experiences is improving (Haugstvedt and Krogstie, 2012; Liestøl 2014). However, there are still significant challenges with using Augmented Reality technology for cultural heritage applications in open urban environments using GPS location. Even if the potential for rich experiences is great, the continued lack of precision of available GPS location and direction in smart phones create particular challenges for the interaction and experience design. This paper presents the experiences from a project that underwent several iterations in 2017 and 2018, using mobile Augmented Reality and 360 panoramic photography in a mobile application that foregrounded historical narratives in urban heritage environments. Specifically, the narratives were about the colonial past in the Danish capital Copenhagen, a past whose traces are still present in the architecture and history of noted places such as the famous Tivoli in the city as well as in archives and museums. This contested and fragmented colonial past live in digital archives that require design and exhibition practices in order to find their way to a larger audience. 

Our project Finding Alberta was one such intervention. The extended reality (XR) web-based application, using a now depreciated platform called Argon (Speiginer et al 2015) but which was created using web programming and therefore is transferable, was part of a larger set of experiences, workshops and installations that brought to life black persons who were once taken to Denmark from the Virgin Islands, then under Danish rule. The point of the urban AR experience was to let the visitor follow in the footsteps of two children - Victor and Alberta - in order to better comprehend their lives and ultimately their fate in Denmark, from the human exhibition to early death of Alberta in 1917. However, the difficulty of properly leading visitors to GPS points and understand fully in what directions they are facing once they reach those points proved a design challenge that we were only partially able to successfully work around. This paper presents some of the design choices we made in order to still create a compelling experience while working around the limits of the affordances of mobile AR.

Digital health and welfare technologies and artificial intelligence are proposed to revolutionise healthcare systems around the world by enabling new models of care. Digital health and welfare technologies enable remote monitoring and treatments, and artificial intelligence is proposed as a means of prediction instead of reaction to individuals' health and as an enabler of proactive care and rehabilitation. The digital transformation not only affects hospital and primary care but also how the community meets older people's needs. Community care is often provided by informal and formal care-givers, most of whom are women. Gender equality is at the heart of many national strategies, but do all genders have equal rights, responsibilities and opportunities when it comes to community care and its digital transformation? The digital transformation of community care is entangled with how care is provided to older people and the working conditions of community-care professionals. Current and, even more so, future community-care systems are and will be partly constituted by networks of technological artefacts. These health and welfare technological artefacts and the discourse surrounding them mediate and constitute social relations and community care. This article looks into how health and welfare technology and artificial intelligence-based devices and systems mediate and constitute gender relations in community care and presents an argument for reflexivity, embodiment, pluralism, participation and ecology as an alternative strategy to treating community care as one-size-fit-all and being blind to gender-related issues.

Complexity and sophistication among multimedia-based tools have made it easy for perpetrators to conduct digital crimes such as counterfeiting, modification, and alteration without being detected. It may not be easy to verify the integrity of video content that, for example, has been manipulated digitally. To address this perennial investigative challenge, this paper proposes the integration of a forensically sound push button forensic modality (PBFM) model for the investigation of the MP4 video file format as a step towards automated video forensic investigation. An open-source multimedia forensic tool was developed based on the proposed PBFM model. A comprehensive evaluation of the efficiency of the tool against file alteration showed that the tool was capable of identifying falsified files, which satisfied the underlying assertion of the PBFM model. Furthermore, the outcome can be used as a complementary process for enhancing the evidence admissibility of MP4 video for forensic investigation.

Intelligent telehealth system (ITS) provides patients and medical institutions with a lot of convenience, medical institutions can achieve medical services for patients in time through monitored health data. However, as the scope of people?s daily activities extends, the traditional single-server architecture is no longer applicable. To deal with this problem, a multi-server architecture has been proposed recently while there remains security and privacy challenges, including handover authentication. In this paper, we investigate a blockchain-assisted handover authentication and key agreement scheme for ITS in a multi-server edge computing environment. Specifically, we first propose a novel handover authentication model of ITS with multi-server edge computing architecture. Second, the proposed handover authentication scheme allows the authenticated server to assist users subsequently authenticate with other server, thereby achieving interactions with the server anytime and anywhere with low overhead. Finally, blockchain technology and strong anonymity mechanism are introduced to protect users? privacy strictly. To our best knowledge, the proposed scheme is the first in the literature to provide efficient authentication, strict anonymity and computational load transfer simultaneously. The security analysis and performance evaluation show that our scheme can not only satisfy the security requirements but also achieve higher efficiency in computation and communication cost.

We consider the online two-dimensional vector packing problem, showing a lower bound of 11/5 on the competitive ratio of any AnyFit strategy for the problem. We provide a strategy with competitive ratio max{2,6/(1+3tan(𝜋/4−𝛾/2))+𝜖}max{2,6/(1+3tan⁡(π/4−γ/2))+ϵ} and logarithmic advice, for any instance where all the input vectors are restricted to have angles in the range [𝜋/4−𝛾/2,𝜋/4+𝛾/2][π/4−γ/2,π/4+γ/2], for 0≤𝛾<𝜋/30≤γ<π/3. In addition, we give a 5/2-competitive strategy also using logarithmic advice for the unrestricted vectors case. These results should be contrasted to the currently best competitive strategy, FirstFit, having competitive ratio 27/10.

Emotion recognition, as a challenging and active research area, has received considerable awareness in recent years. In this study, an attempt was made to extract complex network features from electroencephalogram (EEG) signals for emotion recognition. We proposed a novel method of constructing forward weighted horizontal visibility graphs (FWHVG) and backward weighted horizontal visibility graphs (BWHVG) based on angle measurement. The two types of complex networks were used to extract network features. Then, the two feature matrices were fused into a single feature matrix to classify EEG signals. The average emotion recognition accuracies based on complex network features of proposed method in the valence and arousal dimension were 97.53% and 97.75%. The proposed method achieved classification accuracies of 98.12% and 98.06% for valence and arousal when combined with time-domain features.

Henzinger et al. posed the so-called Online Boolean Matrix-vector Multiplication (OMv) conjecture and showed that it implies tight hardness results for several basic dynamic or partially dynamic problems [STOC'15]. We first show that the OMv conjecture is implied by a simple off-line conjecture that we call the MvP conjecture. We then show that if the definition of the OMv conjecture is generalized to allow individual (i.e., it might be different for different matrices) polynomial-time preprocessing of the input matrix, then we obtain another conjecture (called the OMvP conjecture) that is in fact equivalent to our MvP conjecture. On the other hand, we demonstrate that the OMv conjecture does not hold in restricted cases where the rows of the matrix or the input vectors are clustered, and develop new efficient randomized algorithms for such cases. Finally, we present applications of our algorithms to answering graph queries. (c) 2021 Elsevier Inc. All rights reserved.

This article demonstrates an approach to the simulation of Demand Responsive Transport (DRT) – a flexible transport mode that typically operates as a combination of taxi and bus modes. Travellers request individual trips and DRT is capable of adjusting its routes or schedule to the needs of travellers. It has been seen as a part of the public transport network, which has the potential to reduce operational costs of public transport services, to provide better service quality for population groups with limited mobility and to improve transport fairness. However, a DRT service needs to be thoroughly planned to target the intended user groups, attract a sufficient demand level and maintain reasonable operational costs. As the demand for DRT is dynamic and heterogeneous, it is difficult to simulate it with a macro approach. To address this problem, we develop and evaluate an individual-based simulation comprising models of traveller behaviour for both supply and demand sides. Travellers choose a trip alternative with a mode choice model and DRT vehicle routing utilises a model of travellers’ mode choice behaviour to optimise routes. This allows capturing supply-side operational costs and demand-side service quality for every individual, what allows for designing a personalised service that can prioritise needy groups of travellers improving transport fairness. By simulating different setups of DRT services, the simulator can be used as a decision support tool.

The article discusses modes of reading that emerge from reading situationsthat involve literary digital interfaces and digital audiobooks. Building onanalyses of sensorial characteristics of the act of reading a digital audiobook and aliterary digital app, respectively, the article presents and defines the concept of multisensoryreading. This concept emphasizes the literary work’s material and performative features, as well as the experienced reading situation. The authors explore how the digital literary interface changes reading situations and argue that newreading habits create a need to renegotiate what it means to read in a digital age.In particular, sensory aspects can be understood as integrally involved in what theyterm the digital reading condition.

We report here on an application of reality media(virtual and augmented reality) to digital culturalheritage. The particular challenge we address is:how to combine VR and AR to bridge the gap betweenthe center (the museum housing cultural artifacts)and periphery (the heritage site where theartifacts were found) while at the same time attendingto, even enhancing, the aura of both artifacts andsites? Our proposed solution is to implement thecultural heritage technique known as situated simulation(sitsim) in combination with a social virtual environmentcalled Hubs. Our case study is a sitsim ofthe Acropolis in Athens, which can function on locationand remotely and offers real-time conferencingcapabilities for its participants.

Video games have become the largest portion of the entertainment industry and everyday life of millions of players around the world. Considering games as cultural artifacts, it seems imperative to study both games and players to understand underlying psychological and behavioral implications of interacting with this medium, especially since video games are rich domains for occurrence of rich affective experiences annotated by and measurable via in-game behavior. This thesis is a presentation of a series of studies that attempt to model player perception and behavior as well as their psychosocial attributes in order to make sense of interrelations of these factors and implications the findings have for game designers and researchers. In separate studies including survey and in-game telemetry data of millions of players, we delve into reliable measures of player psychological need satisfaction, motivation and generational cohort and cross reference them with in-game behavioral patterns by presenting systemic frameworks for classification and regression. We introduce a measurement of perceived need satisfaction and discuss generational effects in playtime and motivation, present a robust prediction model for ordinally processed motivations and review classification techniques when it comes to playstyles derived from player choices. Additionally, social aspects of play, such as social influence and contagion as well as disruptive behavior, is discussed along with advanced statistical models to detect and explain them.   

Sociotechnical and sociomaterial perspectives are tools for research on Information System. As Digital Transformation is a research area related to IS, this paper takes these two perspectives into account for a literature review. The explicit use of both perspectives is rather limited. Still, sociotechnical is the broader perspective. A call for more sociomateriality in research on Digital Transformation is the aim of this reflection paper.

Digital transformation (DT) describes technology-based improvements in business processes, business models, and customer experience. It promises efficiency gains for industrial enterprises. Nonprofit organizations also expect advantages from DT. However, barriers hinder realizing all its possible advantages in both sectors. If decision-makers recognize the potential barriers, they can reflect upon these challenges and take well-coordinated countermeasures. Orienting towards a Straussian grounded theory approach, a framework of barriers is developed with data of two diverse sectors: industry and nonprofit. According to the framework pre-conditions such as profit-orientation and size shape the possibilities to tackle different barriers. In general, the DT process in the industry-sector has been slowed down by barriers. Whereas, nonprofit organizations often take the view that they are not in a DT process at all. This might be due to limited individual and organizational perspectives. Especially, NPOs have to work on their recruitment of skilled volunteers to challenge this view.

A Mobile stroke unit (MSU) is a type of ambulance deployed to promote the rapid delivery of stroke care. We present a computational study using a time to treatment estimation model to analyze the potential benefits of using MSUs in Sweden's Southern Health Care Region (SHR). In particular, we developed two scenarios (MSU1 and MSU2) each including three MSUs, which we compared with a baseline scenario containing only regular ambulances. For each MSU scenario, we assessed how much the expected time to treatment is estimated to decrease for the whole region and each subregion of SHR, and how the population is expected to benefit from the deployment of MSUs. For example, the average time to treatment in SHR was decreased with 20,4 and 15,6 minutes, respectively, in the two MSU scenarios. Moreover, our computational results show that the locations of the MSUs significantly influence what benefits can be expected. While MSU1 is expected to improve the situation for a higher share of the population, MSU2 is expected to have a higher impact on the patients who currently have the longest time to treatment.

We propose a method, whose purpose is to combine a set of GPS traces collected by bicyclists with a set of notifications of problematic situations to determine an optimal action plan for solving safety related problems in a traffic network. In particular, we use optimization to determine which problem locations to resolve under a given budget constraint in order to maximize the number of impediment free trips. The method aims to suggest a priority of impediments to resolve, which would be manually infeasible. The proposed method consists of two steps. First, problematic locations are clustered, where each cluster corresponds to a so-called impediment. Each impediment is associated with trips nearby using a distance function. The trip set is partitioned by matching each trip with the largest set of its affecting impediments. Solving all impediments associated with such a part induces a cost and makes the associated part of trips impediment free. The second step aims to find the set of impediments that can be solved with a given budget and that makes the maximum number of trips impediment free. A branch-and-bound optimizer for the second step is presented and evaluated. The clustering parameters affect the set of identified impediments and the extent of each of them. In order to evaluate the sensitivity of the result to the clustering parameters a technique is proposed to consistently estimate the impediment resolution cost. Our study aims to support the interactive urban designer to improve the urban bicycle road infrastructure. By providing a method to prioritize between impediments to resolve, it also aims to contribute to a safer and more attractive traffic situation for bicyclists.

Context: Nowadays, the hype around artificial intelligence is at its absolute peak. Large amounts of data are collected every second of the day and a variety of tools exists to enable easy analysis of data. In practice, however, making meaningful use of it is way more challenging. For instance, affected stakeholders often struggle to specify their information needs and to interpret the results of such analyses. Objective: In this study we investigate how to enable continuous monitoring of information needs, and the generation of knowledge and insights for various stakeholders involved in the lifecycle of software-intensive products. The overarching goal is to support their decision making by providing relevant insights related to their area of responsibility. Methods: We implement multiple monitoringand decision-making frameworks for six individual, real-world cases selected from three different platforms and covering four types of stakeholders. We compare the individual procedures to derive a generic process for instantiating such frameworks as well as a model to scale it up for multiple stakeholders. Results: For one, we discovered that information needs of stakeholders are often related to a limited subset of data sources and should be specified in stages. For another, stakeholders often benefit from sharing and reusing existing components among themselves in later phases. Specifically, we identify three types of reuse: (1) Data and knowledge, (2) tools and methods, and (3) concepts. As a result, key aspects of our model are iterative feedback and specification cycles as well as the reuse of appropriate components to speed up the instantiation process and maximize the efficiency of the model. Conclusion: Our results indicate that knowledge and insights can be generated much faster and stakeholders feel the benefits of the analysis very early on by iteratively specifying information needs and by systematically sharing and reusing knowledge, tools and concepts.

With digitalization and with technologies such as software, data, and artificial intelligence, companies in the embedded systems domain are experiencing a rapid transformation of their conventional businesses. While the physical products and associated product sales provide the core revenue, these are increasingly being complemented with service offerings, new data-driven services, and digital products that allow for continuous value creation and delivery to customers. However, although there is significant research on digitalization and digital transformation, few studies highlight the specific needs of embedded systems companies and what it takes to transform from a traditional towards a digital company within business domains characterized by high complexity, hardware dependencies, and safety-critical system functionality. In this paper, we capture the difference between what constitutes a traditional and a digital company and we detail the typical evolution path embedded systems companies take when transitioning towards becoming digital companies.

Modern Information and Communication Technology (ICT)-based applications utilize currenttechnological advancements for purposes of streaming data, as a way of adapting to the ever-changingtechnological landscape. Such efforts require providing accurate, meaningful, and trustworthy output fromthe streaming sensors particularly during dynamic virtual sensing. However, to ensure that the sensingecosystem is devoid of any sensor threats or active attacks, it is paramount to implement secure real-timestrategies. Fundamentally, real-time detection of adversarial attacks/instances during the User FeedbackProcess (UFP) is the key to forecasting potential attacks in active learning. Also, according to existingliterature, there lacks a comprehensive study that has a focus on adversarial detection from an activemachine learning perspective at the time of writing this paper. Therefore, the authors posit the importance ofdetecting adversarial attacks in active learning strategy. Attack in the context of this paper through a UFPThreat driven model has been presented as any action that exerts an alteration to the learning system ordata. To achieve this, the study employed ambient data collected from a smart environment human activityrecognition from (Continuous Ambient Sensors Dataset, CASA) with fully labeled connections, where weintentionally subject the Dataset to wrong labels as a targeted/manipulative attack (by a malevolent labeler)in the UFP, with an assumption that the user-labels were connected to unique identities. While the dataset’sfocus is to classify tasks and predict activities, our study gives a focus on active adversarial strategies froman information security point of view. Furthermore, the strategies for modeling threats have been presentedusing the Meta Attack Language (MAL) compiler for purposes adversarial detection. The findings fromthe experiments conducted have shown that real-time adversarial identification and profiling during the UFPcould significantly increase the accuracy during the learning process with a high degree of certainty and pavesthe way towards an automated adversarial detection and profiling approaches on the Internet of CognitiveThings (ICoT).

The introduction of cloud technology has reduced the feedback time in software development for many companies. However, companies require significant resources to run applications in an Infrastructure as a Service. The study aims at developing an innovation platform which enables faster deployment of web-based applications. The innovation platform is an add-on for a cloud service, its purpose is to allow developers to set up and use multiple cameras in a cloud environment. Furthermore, the study investigates the drivers and value created by the platform for Axis. We developed a proof of concept built on the innovation platform, using the design science methodology and evaluated it in a focus group. The prototype was a mock version of a grocery store’s internal website, used to show the potential of the innovation platform. Moreover, we conducted semi-structured interviews to investigate the drivers for implementing the platform and the value it created. Results showed that the implementation of the prototype may make the deployment of web-based applications easier. A majority of the interviewees and the focus group participants agreed that the development of the innovation platform should continue and be tested to adopt the platform as a complement to AWS. However, the degree to which the platform should be open source needs a more clear management strategy. The prototype is seen as an innovation platform which may be used to quickly experiment with new ideas. The key drivers for implementing a prototype entails reduced cost, faster time to market and reduced complexity of web-based deployments.

Accurate positioning is an essential requirement of autonomous vehicular navigation system (AVNS) for safe driving. Although the vehicle position can be obtained in Global Position System (GPS) friendly environments, in GPS denied environments (such as suburb, tunnel, forest or underground scenarios) the positioning accuracy of AVNS is easily reduced by the trajectory error of the vehicle. In order to solve this problem, the plane, sphere, cylinder and cone are often selected as the ground control targets to eliminate the trajectory error for AVNS. However, these targets usually suffer from the limitations of incidence angle, measuring range, scanning resolution, and point cloud density, etc. To bridge this research gap, an adaptive continuum shape constraint analysis (ACSCA) method is presented in this paper to design a new target with optimized identifiable specific shape to eliminate the trajectory error for AVNS. First of all, according to the proposed ACSCA method, we conduct extensive numerical simulations to explore the optimal ranges of the vertexes and the faces for target shape design, and based on these trials, the optimal target shape is found as icosahedron, which composes of 10 vertexes, 20 faces and combines the properties of plane and volume target. Moreover, the algorithm of automatic detection and coordinate calculation is developed to recognize the icosahedron target and calculate its coordinates information for AVNS. Lastly, a series of experimental investigation were performed to evaluate the effectiveness of our designed icosahedron target in GPS denied environments. The experimental results demonstrate that compared with the plane, sphere, cylinder and cone targets, the developed icosahedron target can produce better performances than the above targets in terms of the clustered minimum registration error, ambiguity and range of field-of-view; also can significantly improve the positioning accuracy of AVNS in GPS denied environments.

A multi-mode hybrid automaton is proposed for setting vehicle platoon modes with velocity, distance, length, lane position and other state information. Based on a vehicle platoon shift movement under different modes, decisions are made based on key conditional actions such as sudden acceleration changes because of vehicle distance changes, emergency braking to avoid collisions and free-lane changing choices adapted to various traffic conditions, so as to ensure effortless movement and safety in multi-mode shift. With a 3-degree (longitudinal, lateral, and yaw directions) of freedom coupled model, a hybrid vehicle platoon controller is proposed using non-singular terminal sliding mode control to ensure fast and steady tracking on the hybrid automaton outputs during the multi-mode shift process. Convergence of the hybrid controller in finite time is also analyzed with the Lyapunov exponential stability. The analysis result proves that the proposed controller not only ensures the stability of the individual vehicle and the vehicle platoon, but also ensures stability of the multi-mode shift movement system. The proposed cooperative driving strategy for vehicle platoon is evaluated using simulations, where varying traffic conditions and the influence of cutting off are considered in conjunction with demonstration simulations of a vehicle platoon’s cruising, following, lane changing, overtaking and moving in/out of garage functions.