Different storage and handling conditions in cold supply chains often cause variations in the remaining shelf life of perishable foods. In particular, the actual shelf life may differ from the expiration date printed on the primary package. Based on temperature sensors placed on or close to the food products, a remaining shelf-life prediction (RSLP) service can be developed, which estimates the remaining shelf life of individual products, in real-time. This type of service may lead to decreased food waste and is used for discovering supply chain inefficiencies and ensuring food quality. Depending on the system architecture, different service qualities can be obtained in terms of usability, accuracy, security, etc. This article presents a novel approach for how to identify and select the most suitable system architectures for RSLP services. The approach is illustrated by ranking different architectures for a RSLP service directed towards the supply chain managers. As a proof of concept, some of the most highly ranked architectures have been implemented and tested in food cold supply chains.