In this paper, we highlight how including technology, movement or play can boost a design process but with unbalanced amounts can also hamper the process. We provide a set of examples where we miscalculated the amount of technology, movement, or play that was needed in a design activity in such a way that it became counterproductive and for each example mention possible adaptations. Finally, we highlight three existing approaches that can balance the overabundance of technology, movement, and play in design processes: activity-centered design, somaesthetic design, and perspective-changing movement-based design.  

MnemoRoom4U is an AR (Augmented Reality) tool that uses a memory-palace strategy for foreign-language training. A memory palace helps information recall with the aid of object association in visualizations of familiar spatial surroundings. In MnemoRoom4U, paper or digital flashcards are re-placed with virtual notes containing L1 words and their L2 translations that are placed on top of real physical objects inside a familiar environment, such as one’s room, home, office space, etc. The AR-supported notes aid associative memory by establishing a relationship between the physical objects in the user’s mind and the virtual lexis to be retained in L2. Learners first set up a path through their familiar environment, attaching virtual sticky notes—each containing a target word to be memorized together with its corresponding source-language translation—to real-life objects (e.g. furniture in their homes or offices). They then take the same path again, reviewing all the words, and finally carry out a retention test. MnemoRoom4U is a technological artifact designed for specific didactic purposes in the Unity game engine with the ARCore augmented-reality plug-in for Android. This work takes a Design-Science approach with phenomenological, exploratory underpinnings tracking back to the efficiency of spatial mnemonics previously reported quantitatively and combines it with AR technology to effect L2 vocabulary recall.

We propose the Interactive Constrained MAP-Elites, a quality-diversity solution for game content generation, implemented as a new feature of the Evolutionary Dungeon Designer (EDD): a mixed-initiative co-creativity tool for designing dungeons. The feature uses the MAP-Elites algorithm, an illumination algorithm that segregates the population among several cells depending on their scores with respect to different behavioral dimensions. Users can flexibly and dynamically alternate between these dimensions anytime, thus guiding the evolutionary process in an intuitive way, and then incorporate suggestions produced by the algorithm in their room designs. At the same time, any modifications performed by the human user will feed back into MAP-Elites, closing a circular workflow of constant mutual inspiration. This paper presents the algorithm followed by an in-depth evaluation of the expressive range of all possible dimension combinations in several scenarios, and discusses their influence in the fitness landscape and in the overall performance of the procedural content generation in EDD.

Narratives are a predominant part of games, and their design poses challenges when identifying, encoding, interpreting, evaluating, and generating them. One way to address this would be to approach narrative design in a more abstract layer, such as narrative structures. This paper presents Story Designer, a mixed-initiative co-creative narrative structure tool built on top of the Evolutionary Dungeon Designer (EDD) that uses tropes, narrative conventions found across many media types, to design these structures. Story Designer uses tropes as building blocks for narrative designers to compose complete narrative structures by interconnecting them in graph structures called narrative graphs. Our mixed-initiative approach lets designers manually create their narrative graphs and feeds an underlying evolutionary algorithm with those, creating quality-diverse suggestions using MAP-Elites. Suggestions are visually represented for designers to compare and evaluate and can then be incorporated into the design for further manual editions. At the same time, we use the levels designed within EDD as constraints for the narrative structure, intertwining both level design and narrative. We evaluate the impact of these constraints and the system’s adaptability and expressiveness, resulting in a potential tool to create narrative structures combining level design aspects with narrative.  

We propose modeling designer style in mixed-initiative game content creation tools as archetypical design traces. These design traces are formulated as transitions between design styles; these design styles are in turn found through clustering all intermediate designs along the way to making a complete design. This method is implemented in the Evolutionary Dungeon Designer, a research platform for mixed-initiative systems to create adventure and dungeon crawler games. We present results both in the form of design styles for rooms, which can be analyzed to better understand the kind of rooms designed by users, and in the form of archetypical sequences between these rooms, i.e., Designer Personas.

In Mixed-Initiative Co-Creative tools, the human is mostly in control of what will and can be created, delegating the AI to a more suggestive role instead of a colleague in the co-creative process. Allowing more control and agency for the AI might be an interesting path in co-creative scenarios where AI could direct and take more initiative within the co-creative task. However, the relationship between AI and human designers in creative processes is delicate, as adjusting the initiative or agency of the AI can negatively affect the user experience. In this paper, different degrees of agency for the AI are explored within the Evolutionary Dungeon Designer (EDD) to further understand MI-CC tools. A user study was performed using EDD with three varying degrees of AI agency. The study highlighted elements of frustration that the human designer experiences when using the tool and the behavior in the AI that led to possible strains on the relationship. The paper concludes with the identified issues and possible solutions and suggested further research.

Augmented reality (AR) games are a rich environment for researching and testing computational systems that provide subtle user guidance and training. In particular computer systems that aim to augment a user’s situation awareness benefit from the range of sensors and computing power available in AR headsets. The main focus of this work-in-progress paper is the introduction of the concept of the individualized Situation Awareness-based Attention Guidance (SAAG) system used to increase humans’ situating awareness and the augmented reality version of the board game Carcassonne for validation and evaluation of SAAG. Furthermore, we present our initial work in developing the SAAG pipeline, the generation of game state encodings, the development and training of a game AI, and the design of situation modeling and eye-tracking processes.  

Games are complex, multi-faceted systems that share common elements and underlying narratives, such as the conflict between a hero and a big bad enemy or pursuing a goal that requires overcoming challenges. However, identifying and describing these elements together is non-trivial as they might differ in certain properties and how players might encounter the narratives. Likewise, generating narratives also pose difficulties when encoding, interpreting, and evaluating them. To address this, we present TropeTwist, a trope-based system that can describe narrative structures in games in a more abstract and generic level, allowing the definition of games’ narrative structures and their generation using interconnected tropes, called narrative graphs. To demonstrate the system, we represent the narrative structure of three different games. We use MAP-Elites to generate and evaluate novel quality-diverse narrative graphs encoded as graph grammars, using these three hand-made narrative structures as targets. Both hand-made and generated narrative graphs are evaluated based on their coherence and interestingness, which are improved through evolution.  

Games are complex, multi-faceted systems that share common elements and underlying narratives, such as the conflict between a hero and a big bad enemy or pursuing a goal that requires overcoming challenges. However, identifying and describing these elements together is non-trivial as they might differ in certain properties and how players might encounter the narratives. Likewise, generating narratives also pose difficulties when encoding, interpreting, and evaluating them. To address this, we present TropeTwist, a trope-based system that can describe narrative structures in games in a more abstract and generic level, allowing the definition of games' narrative structures and their generation using interconnected tropes, called narrative graphs. To demonstrate the system, we represent the narrative structure of three different games. We use MAP-Elites to generate and evaluate novel quality-diverse narrative graphs encoded as graph grammars, using these three hand-made narrative structures as targets. Both hand-made and generated narrative graphs are evaluated based on their coherence and interestingness, which are improved through evolution.

Digitalizing tabletop games for general game playing(GGP) AI research is a continuously growing field. TabletopGames Framework (TAG) is a framework developed to simplifythe process of implementing tabletop board games to digital form.Sushi Go! is a game that combines simultaneous action selectionand complete information. This creates a unique combination ofmechanics, which presents a new challenge for GGP agents. Byimplementing Sushi Go! into TAG, we can test different agent’sperformance using these mechanics and compare them to theirexisting performances in the other games of TAG. Results ofthis testing are presented, which display that the framework iscapable of implementing Sushi Go! and that the agents performwith mixed results. Further developing heuristics for the agentsshould prove to increase their performance when faced with thesetypes of games.

MAP-Elites has been successfully applied to the generation of game content and robot behaviors. However, its behavior and performance when interacted with in co-creative systems is underexplored. This paper analyzes the implications of synthetic interaction for the stability and adaptability of MAP-Elites in such scenarios. We use pre-recorded human-made level design sessions with the Interactive Constrained MAP-Elites (IC MAP-Elites). To analyze the effect of each edition step in the search space over time using different feature dimensions, we introduce Temporal Expressive Range Analysis (TERA). With TERAs, MAP-Elites is assessed in terms of its adaptability and stability to generate diverse and high-performing individuals. Our results show that interactivity, in the form of design edits and MAP-Elites adapting towards them, directs the search process to previously unexplored areas of the fitness landscape and points towards how this could improve and enrich the co-creative process with quality-diverse individuals.

Quests are a core element in many games, especially role-playing and adventure games, where quests drive the gameplay and story, engage the player in the game’s narrative, and in most cases, act as a bridge between different game elements. The automatic generation of quests and objectives is an interesting challenge since this can extend the lifetime of games such as in Skyrim, or can help create unique experiences such as in AI Dungeon. This work presents Questgram [Qg], a mixed-initiative prototype tool for creating quests using grammars combined in a mixed-initiative level design tool. We evaluated our tool quantitatively by assessing the generated quests and qualitatively through a small user study. Human designers evaluated the system by creating quests manually, automatically, and through mixed-initiative. Our results show the Questgram’s potential, which creates diverse, valid, and interesting quests using quest patterns. Likewise, it helps engage designers in the quest design process, fosters their creativity by inspiring them, and enhance the level generation facet of the Evolutionary Dungeon Designer with steps towards intertwining both level and quest design.

As tabletop games are ported to digital versions to increase their accessibility, the expected User Experience (UX) might be degraded in the transition. This paper aims to understand how and why playing tabletop games differentiates depending on the platform. Seven tabletop games have been chosen from different genres with an official digital adaptation. Our approach has been to do a comparative analysis of both versions followed by a user study to analyze and measure the UX differences, measuring five key factors, Usability, Engagement, Social Connectivity, Aesthetics, and Enjoyment. Our results indicate that games that rely on imperfect information offer a much higher social connectivity and engagement when played around a table. Meanwhile, games relying on tile-placement offers higher usability and engagement when played digitally due to the assistance provided by the game. However, the physical versions got, in general, a higher rating than the digital versions in all key factors except slightly in the usability. Physical versions are the preferred options, but the digital versions' benefits, such as accessibility and in-game assistance, makes them relevant for further analysis.  

This paper presents the Designer Preference Model, a data-driven solution that pursues to learn from user generated data in a Quality-Diversity Mixed-Initiative Co-Creativity (QD MI-CC) tool, with the aims of modelling the user’s design style to better assess the tool’s procedurally generated content with respect to that user’s preferences. Through this approach, we aim for increasing the user’s agency over the generated content in a way that neither stalls the user-tool reciprocal stimuli loop nor fatigues the user with periodical suggestion handpicking. We describe the details of this novel solution, as well as its implementation in the MI-CC tool the Evolutionary Dungeon Designer. We present and discuss our findings out of the initial tests carried out, spotting the open challenges for this combined line of research that integrates MI-CC with Procedural Content Generation through Machine Learning.

With the growth of procedural content generation in game development, there is a need for a viable generative method to give context and make sense of the content within game space. We propose procedural narrative as context through objectives, as a useful means to structure content in games. In this paper, we present and describe an artifact developed as a sub-system to the Evolutionary Dungeon Designer (EDD) that procedurally generates objectives for the dungeons created with the tool. The quality of the content within rooms is used to generate objectives, and together with the distributions and design of the dungeon, main and side objectives are formed to maximize the usage of game space and create a proper context.  

The InvisibleAI (InvAI’20) workshop aims to systematically discuss a growing class of interactive systems that invisibly remove some decision-making tasks away from humans to machines, based on recent advances in artificial intelligence (AI), data science, and sensor or actuation technology. While the interest in the affordances as well as the risks of hidden pervasive AI are high on the agenda in public debate, discussion on the topic is needed within the human-computer interaction (HCI) community. In particular, we want to gather insights, ideas, and models for approaching the use of barely noticeable AI decision-making in systems design from a human-centered perspective, so as to make the most out of the automated systems and algorithms that support human activity both as designers and users. Concurrently, these systems should safeguard that humans remain in charge when it counts (high stakes decisions, privacy, monitoring lack of explainability and fairness, etc.). What to automate and what not to automate is often a system designer’s choice [8]. By taking the established concept of explicit interaction between a system and its user as a point of departure, and inviting authors to provide examples from their own research, we aim to stimulate dynamic discussion while keeping the workshop concrete and system design-focused. The workshop especially directs itself to participants from the interaction design, AI, and HCI communities. The targeted scientific outcome of the workshop is an up-to-date ontology of invisible AI-HCI systems and hybrid human-AI collaboration mechanisms, and approaches. Additionally, we expect that the workgroups and the roundtables will provide starting points shaping continued discussions, new collaborations, and innovative scientific contributions that springboard from the workgroups’ findings. The focus of the proposed workshop involves the bridging of two spaces of computational research that impact user experiences and societal domains (HCI and AI). Thus, the proposed workshop topic aligns well with the theme of this year’s NordiCHI conference which is Shaping Experiences, Shaping Society.

Multiplayer online battle arena (MOBA) games are a recent huge success both in the video game industry and the international eSports scene. These games encourage team coordination and cooperation, short and long-term planning, within a real-time combined action and strategy gameplay. Artificial intelligence (AI) and computational intelligence (CI) in games research competitions offer a wide variety of challenges regarding the study and application of AI techniques to different game genres. These events are widely accepted by the AI/CI community as a sort of AI benchmarking that strongly influences many other research areas in the field. This paper presents and describes in detail the Dota 2 (Defense of the Ancients 2) Bot competition and the Dota 2 AI framework that supports it. This challenge aims to join both the MOBAs and AI/CI game competitions, inviting participants to submit AI controllers for the successful MOBA Dota 2 to play in 1v1 matches, which aims for fostering research on AI techniques for real-time games. The Dota 2 AI framework makes use of the actual Dota 2 game mudding capabilities to enable to connect external AI controllers to actual Dota 2 game matches using the original F2P game.

We propose the use of quality-diversity algorithms for mixed-initiative game content generation. This idea is implemented as a new feature of the Evolutionary Dungeon Designer, a system for mixed-initiative design of the type of levels you typically find in computer role playing games. The feature uses the MAP-Elites algorithm, an illumination algorithm which divides the population into a number of cells depending on their values along several behavioral dimensions. Users can flexibly and dynamically choose relevant dimensions of variation, and incorporate suggestions produced by the algorithm in their map designs. At the same time, any modifications performed by the human feed back into MAP-Elites, and are used to generate further suggestions.

Mobile Virtual Reality (MVR) makes Virtual Reality games more accessible to a broader audience. Interaction design guidelines and best practices for MVR experiences are available for developers. In this paper, we specifically explore interactions in MVR games, a particular subset of MVR experiences that is becoming popular. A set of MVR games is analyzed with a special focus on head gaze, categorizing and isolating their mechanics implemented with this common MVR technique. This analysis is the basis of a test application in the MVR interactions are implemented and later compared to a traditional game pad controller in three different challenges. A comparative user study has been carried out from the perspective of both gamers and non-gamers facing these challenges. Results show the preferences and performances of the players using all the interactions, highlighting an interesting generalized preference for MVR interactions over the traditional controller in some of the analyzed cases.

The Evolutionary Dungeon Designer (EDD) [1] is as a mixed-initiative tool for creating dungeons for adventure games. Results from a user study with game developers positively evaluated EDD as a suitable framework for collaboration between human designers and PCG suggestions, highlighting these as time-saving and inspiring for creating dungeons [2]. Previous work on EDD identified the need of assessing aesthetic criteria as a key area for improvement in its PCG Engine. By upgrading the individual encoding system and the fitness evaluation in EDD's evolutionary algorithm, we present three techniques to preserve and account the designer's aesthetic criteria during the dungeon generation process: the capability of locking sections for preserving custom aesthetic structures, as well as the measurement of symmetry and similarity in the provided suggestions.

Mixed-initiative systems highlight the collaboration between humans and computers in fostering the generation of more interesting content in game design. In light of the ever-increasing cost of game development, providing mixed-initiative tools can not only significantly reduce the cost but also encourage more creativity amongst game designers. The Evolutionary Dungeon Designer (EDD) [3] is a mixed-initiative tool with a focus on using evolutionary computation to procedurally generate content that adhere to game design patterns. As part of an ongoing project, feedback from a user study on EDD's capabilities as a mixed-initiative design tool pointed out the need for improvement on the tool's functionalities [4]. In this paper we present a review of the principles of the mixed-initiative model, as well as the existing approaches that implement it. The outcome of this analysis allows us to address the appointed needs for improvement by shaping a new version of EDD that we describe here. Finally, we also present the results from a user study carried out with professional game developers, in order to assess EDD's new functionalities. Results show an overall positive evaluation of the tool's intuitiveness and capabilities for empowering game developers' creative skills during the design process of dungeons for adventure games. They also allow us to identify upcoming challenges pattern-based mixed-initiative tools could benefit from.

During the last decade, the way people learn has seen a big shift from the traditional classroom that purely uses printed material to the contemporary classroom that utilizes digital technologies for the teaching material (Al-Emran and Shaalan, 2015). In this paper we present Vault!, an Android mobile app that combines the benefits of mobile learning and relational learning, while at the same time reaps the reward of the community-based learning model existing in parkour. We also provide a theoretical support for parkour as a general-purpose challenge-based educational model, as well as an analysis of popular mobile learning apps, both of them resulting in the design and development of the presented application.

Abstract: Procedural Content Generation (PCG) can be a useful tool for aiding creativity in the process of designing game levels. Mixed-initiative level generation tools where a designer and an algorithm collaborate to iteratively generate game levels have been used for this purpose. However, it can be difficult for designers to work with tools that do not respond to the common language of games: game design patterns. We present the Evolutionary Dungeon Designer, the first step towards a mixed-initiative dungeon design tool which evolves dungeon rooms using game design patterns, as well as several metrics regarding the placement of treasures and enemies, in the fitness function of a genetic algorithm. Our results show that we are able to control the frequency, shape and type of design patterns, as well as properly place enemies and treasures in the generated rooms, using design pattern-related input parameters.

Abstract: In this paper we explore the hybrid application of evolutionary computation and artificial neural networks in the development of intelligent systems able to solve the problem of approximating the optimal strategy in a tile-matching puzzle game. Three intelligent systems are proposed: an evolutionary heuristic technique, artificial neural networks, and a hybrid approach that combines both. Results show that the hybrid approach, which combines the advantages of the two previous solutions, performs better at both, the number of completed lines and the average piece placement time. These results aim to serve as the basis for a later comparative study against state- of-the-art techniques in the topic.

Mixed-initiative Procedural Content Generation uses algorithms to assist human designers in the collaborative creation of game content. Different mixed-initiative approaches use different methods to engage with the design material while supporting the designer’s intentions. However, the designer runs the risk of misunderstanding the system’s abilities and how to control them. In order to limit miscommunication during the design process, heuristics could be applied. In this paper we present a mixed-initiative tool for evolving dungeons with the aid of game design patterns as heuristics. The tool, the Evolutionary Dungeon Designer, uses a genetic algorithm that searches for levels containing game design patterns on two hierarchical levels of abstraction to express more complex gameplay in the game level. We evaluate the tool through a series of lab experiments and a user study conducted with professional game developers. Our results demonstrate that we are able to control the generation of the different patterns with the aid of design pattern-related input parameters, as well as identifying a number of features a design pattern-based mixed-initiative tool could benefit from.

Ethiopia has one of the highest maternal and child mortality rates in the world, partly due to the low accessibility of educational content regarding nutrition and healthcare in the rural regions. This paper presents the first step for tackling this problem by means of a serious game, Easycare, designed for teaching illiterate users, with almost no previous experience with digital games, good practices for healthcare and nutrition. Promising results from a field study conducted in Ethiopia are also presented, showing the potential of the tool for education in developing countries.