Customer Support Tickets That Code
Summary
Software developers are integrating large language models (LLMs) to automate the conversion of customer support tickets, detailing software issues or feature requests, directly into new code. This approach streamlines a previously lengthy process involving support teams, engineers, and manual coding. For instance, AI cybersecurity startup Semgrep routes customer bug complaints or feature requests to Anthropic's Claude model. Claude then generates fixes or new features within a sandboxed version of Semgrep's application. A human engineer subsequently tests these changes before they are merged into the main Semgrep app, which assists developers in scanning code for vulnerabilities. Currently, Semgrep applies this method to a handful of tickets monthly, with founder Isaac Evans anticipating rapid expansion.
Key takeaway
For AI Engineers or Directors of AI/ML evaluating ways to accelerate development cycles and improve customer response, consider implementing LLM-driven code generation from support tickets. You should establish a robust sandboxing and human review process to ensure code quality and security before deployment. This approach can significantly reduce the manual effort in addressing customer-reported issues and feature requests, scaling your team's responsiveness.
Key insights
LLMs are being used to automate the transformation of customer support tickets into functional code.
Principles
- Combine LLM strengths: coding and customer interaction.
- Isolate AI-generated code in a sandbox.
- Human oversight is critical for code quality.
Method
Customer complaints or feature requests are routed to an LLM, which generates code in a sandboxed environment. A human engineer then tests and merges the validated changes.
In practice
- Route support tickets to models like Claude.
- Implement sandboxed environments for AI code.
- Integrate human testing into the merge process.
Topics
- Customer Support Automation
- Code Generation
- Large Language Models
- AI in Software Development
- Anthropic Claude
- Semgrep
Best for: CTO, VP of Engineering/Data, AI Architect, AI Engineer, Software Engineer, Director of AI/ML
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by The Information.