Internet of Things (IoT) systems are often complex and have to deal with many challenges at the same time, both from a human and technical perspective. In this vision paper, we (i) describe IoT-Together , the Mixed-initiative Paradigm that we devise for IoT user-system collaboration and (ii) critically analyze related architectural challenges.