Automotive A/B testing: Challenges and Lessons Learned from PracticeShow others and affiliations
2020 (English)In: 2020 46th Euromicro Conference on Software Engineering and Advanced Applications (SEAA), IEEE, 2020, p. 101-109Conference paper, Published paper (Refereed)
Abstract [en]
Over the past 15 years, A/B testing has been a critical tool for accurate prioritization of development efforts in online and web-facing companies. As automotive companies progress on their digitalization process, A/B testing and other experimentation techniques start to be adopted. However, specific characteristics of the automotive software industry create additional challenges to the successful adoption of A/B testing. Recently, research has been conducted to investigate the challenges and opportunities for experimentation techniques in the automotive and more generally in the embedded systems domain. However, despite the collaboration with industry, previous research was based on either hypothesized or toy scenarios in companies seeking, but not yet running experimentation. Utilizing a case study method, we investigate the challenges of adopting A/B testing in two large-scale automotive companies that are currently running or preparing for their first A/B testing. The contribution of this paper is two-fold. First, we present our main findings in terms of the challenges of real A/B testing iterations in automotive vehicles. Second, we present the current, potential solutions and lessons learned from applying A/B testing in the automotive domain.
Place, publisher, year, edition, pages
IEEE, 2020. p. 101-109
Keywords [en]
automobile industry, embedded systems, Internet, production engineering computing, online companies, automotive A/B testing, large-scale automotive companies, automotive software industry, experimentation techniques, Web-facing companies, automotive domain, automotive vehicles, Testing, Companies, Automotive engineering, Software, Measurement, Industries, Interviews, A/B testing, Automotive Software, Case study, Challenges
National Category
Software Engineering
Identifiers
URN: urn:nbn:se:mau:diva-40291DOI: 10.1109/SEAA51224.2020.00026ISI: 000702094100015ISBN: 978-1-7281-9532-2 (electronic)ISBN: 978-1-7281-9533-9 (print)OAI: oai:DiVA.org:mau-40291DiVA, id: diva2:1524599
Conference
2020 46th Euromicro Conference on Software Engineering and Advanced Applications (SEAA), 26-28 Aug. 2020, Portoroz, Slovenia, Slovenia
2021-02-012021-02-012022-08-11Bibliographically approved