Property-Driven Synthetic Data Engineering for Data-Scarce Software Systems: Reflections from the Breast Cancer Domain

· Source: cs.SE updates on arXiv.org · Field: Technology & Digital — Software Development & Engineering, Artificial Intelligence & Machine Learning, Data Science & Analytics · Depth: Expert, extended

Summary

Saverio D'Amico and Claudio Menghi introduce "property-driven synthetic data engineering" as a critical approach for developing software systems in data-scarce, privacy-sensitive domains like breast cancer treatment. Their work, stemming from a collaboration with oncologists on intraoperative radiotherapy (IORT) data, reveals that synthetic data generation (SDG) shifts the core challenge from data unavailability to defining and validating the specific properties synthetic data must preserve. Using a cleaned dataset of 709 patients and 58 variables, they experimented with SDG techniques including TabDDPM, CTGAN, Gaussian Copula, CopulaGAN, and TVAE, noting TVAE's strong performance in statistical fidelity. However, the authors emphasize that statistical similarity does not equate to clinical plausibility, underscoring the need for multi-stakeholder property definition and validation. They identify key challenges in requirements elicitation under uncertainty, validation without ground truth, and the continuous evolution of synthetic data pipelines.

Key takeaway

For software engineers and AI scientists building data-driven systems in data-scarce, sensitive domains, you must shift from merely generating synthetic data to a property-driven engineering approach. Explicitly define and formalize validity properties—like clinical plausibility, statistical fidelity, and privacy protection—with all stakeholders. Your validation pipelines should continuously check these properties, acknowledging that no single generator is universally optimal and that data cleaning decisions are critical system specifications.

Key insights

Synthetic data engineering requires defining, validating, and evolving stakeholder-specific properties, not just generating data.

Principles

Method

The proposed method involves stakeholders defining properties, developers operationalizing them as checks, tools comparing generators against checks, and pipelines evolving with changes.

In practice

Topics

Best for: AI Scientist, Software Engineer, Research Scientist

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by cs.SE updates on arXiv.org.