Malmö University Publications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Unsupervised Clustering of Core Dumps to Support Debugging in IoT Device Fleets: Semantic Preprocessing and Density-Based Clustering of Firmware Failure Artifacts
Malmö University, Faculty of Technology and Society (TS).
Malmö University, Faculty of Technology and Society (TS).
2026 (English)Independent thesis Advanced level (degree of Master (Two Years)), 20 credits / 30 HE creditsStudent thesis
Abstract [en]

As IoT device fleets grow in scale, manual inspection of core dumps becomes increasingly impractical, outpacing the engineers who perform it. While core dumps, memory snapshots captured at the time of device failure, are a standard debugging mechanism in embedded systems, no established approach exists for analyzing them at scale from large, unlabeled, real world IoT deployments. This thesis investigates how core dumps from a fleet of deployed hearing aids at Demant A/S can be grouped and analyzed to support failure analysis and defect debugging. 

A preprocessing pipeline was developed to transform core dumps into a representation suitable for unsupervised machine learning. Key contributions include source-grounded semantic feature annotation, type-aware encoding, and a noise handling strategy that combines firmware sentinel matching with a data-driven cliff detection. UMAP was then applied for dimensionality reduction, followed by HDBSCAN to identify dense failure groups in the resulting embedding. 

Applied to 41,685 core dumps from a single firmware release, the pipeline produced 73 clusters with a Density Based Clustering Validation (DBCV) score of 0.641. When evaluated against domain-defined crash tags assigned at two levels of granularity, 99.4% of clustered samples shared the same crash type as the majority of their cluster, and 87.5% shared the same detailed crash tag. Preprocessing reduced noise from 30.3% to 7.1% and improved tag-level agreement from 57.1% to 87.5% compared to clustering on non-preprocessed data.

Expert evaluation suggested that the pipeline output was interpretable and useful for debugging within the studied setting. Applied to a single firmware release, this work shows that semantically guided preprocessing enables the formation of meaningful clusters, and that unsupervised machine learning can distill tens of thousands of failure artifacts into structured, analyzable groups without the need for labels. Extending this validation across multiple firmware releases remains an important direction for future research.

Place, publisher, year, edition, pages
2026. , p. 74
Keywords [en]
Core dump analysis, Crash clustering, Unsupervised learning, Hearing devices, UMAP, HDBSCAN, Preprocessing, Fault diagnosis
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:mau:diva-86470OAI: oai:DiVA.org:mau-86470DiVA, id: diva2:2077412
External cooperation
Demant A/S
Educational program
TS IoT- Internet of Things
Supervisors
Examiners
Available from: 2026-06-25 Created: 2026-06-23 Last updated: 2026-06-25Bibliographically approved

Open Access in DiVA

fulltext(1776 kB)78 downloads
File information
File name FULLTEXT02.pdfFile size 1776 kBChecksum SHA-512
284294e35b34489d54a0ac71db5a36e8ac83899ff92904a195100c6f29133c5df5ee41e32d7d360a240538f4a38db022bd347d573cf66c4ec677f11f5a2a60f3
Type fulltextMimetype application/pdf

Search in DiVA

By author/editor
Olsson, IsacHøeg Møller, Rasmus
By organisation
Faculty of Technology and Society (TS)
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar
Total: 78 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 249 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf