François Pachet on music generation with AI
Summary
Dr. François Pachet, a prominent AI researcher and musician known for systems like Continuator and Flow Machines, discusses the current state and future of AI music generation. Having led labs at Spotify and Sony, and now founding Imagine All The People and Ynosound, Pachet critiques platforms like Suno and Udio. He notes that while these tools produce impressive results, they often lack the "search" phase inherent in human creativity, which involves design, trial-and-error, and planning, instead relying solely on "sampling." Pachet advocates for combining search with production in next-generation systems to achieve more surprising and satisfying musical outcomes. He also emphasizes that evaluating AI-generated music should focus on professional musicians' willingness to credit or producers' willingness to distribute, rather than popularity. Pachet concludes by stressing the importance of researcher autonomy and tackling ill-defined problems in AI.
Key takeaway
For AI and Research Scientists developing generative music systems, recognize that current end-to-end sampling approaches, like those in Suno or Udio, miss the crucial "search" phase of human creativity. Your focus should shift towards integrating design, trial-and-error, and backtracking into your models to produce more nuanced and surprising compositions. Prioritize tackling ill-defined problems and evaluating success through professional artistic endorsement, rather than solely relying on quantitative metrics or popularity.
Key insights
AI music generation needs to integrate a "search" phase, akin to human creative planning, to move beyond mere sampling and achieve truly surprising results.
Principles
- Human creativity involves design and execution.
- Artistic domains lack definitive loss functions.
- Researcher autonomy fosters true innovation.
Method
Combine current end-to-end sampling systems with a "search" phase that incorporates design, trial-and-error, and backtracking, enabling AI to create more surprising and satisfying musical compositions.
In practice
- Focus AI on ill-defined problems.
- Evaluate music by professional credit/distribution.
- Model interplay between melody and harmony.
Topics
- AI Music Generation
- Generative AI
- Search Algorithms
- Music Composition
- Ill-defined Problems
- Researcher Autonomy
Best for: AI Scientist, Research Scientist, Creative Technologist
Related on AIssential
See Counsel's argued verdicts on the open AI decisions leaders are weighing →
Editorial summary, takeaway, and curation by AIssential. Original article published by ΑΙhub.