They Requested It. I Built It. Nobody Ever Used It.
Summary
Data science models frequently fail to achieve adoption despite being requested and developed, a common issue for data professionals. This problem stems from three core challenges: models often act as "black boxes" lacking explainability, development cycles extend too long, and solutions are not easily integrated into existing workflows. In healthcare, for instance, clinicians prioritize trusted processes over complex, unexplainable predictive models, even if highly accurate. Prolonged development can lead stakeholders to find alternative solutions, underscoring the need for rapid iteration and frequent communication. Furthermore, models must seamlessly fit into users' daily operations, such as integrating predictions directly into electronic health record software like Epic, rather than introducing workflow friction.
Key takeaway
For Data Scientists and ML Engineers aiming for model adoption, prioritize user trust and workflow integration over raw predictive accuracy. You should develop concise model briefs explaining complex features in business terms and push for rapid v1 deployments. Continuously communicate progress and ensure predictions seamlessly fit into existing tools, like Epic in healthcare, to avoid abandonment and maximize impact.
Key insights
Data models fail adoption due to explainability, slow delivery, and poor integration into user workflows.
Principles
- Explainability often outweighs raw accuracy for user trust.
- "Don't let the perfect get in the way of the good."
- Seamless integration is critical for model adoption.
Method
Create an "easily digestible model brief" (slides) defining population, target, features, and performance, using business-centric language. Communicate progress frequently.
In practice
- Develop a model brief defining terms in business context.
- Prioritize rapid iteration (v1) over perfect initial solutions.
- Integrate predictions directly into existing user systems (e.g., Epic).
Topics
- Model Adoption
- Explainable AI
- Data Science Workflow
- Healthcare AI
- User Experience
- Iterative Development
Best for: AI Product Manager, Product Manager, Data Scientist, Machine Learning Engineer, Director of AI/ML
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Towards Data Science.