Making Machines Make Music

2026-04-29 · Source: Where What If Becomes What's Next · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Software Development & Engineering, Computer Music · Depth: Intermediate, extended

Summary

Carnegie Mellon University Professor Emeritus Roger Dannenberg, a pioneer in computer music and co-creator of Audacity, reflects on his career bridging music and computer science. His work includes building a custom computer in 1984 for real-time musical accompaniment, developing Nyquist, a programming language for music, and creating Smart Music, a leading educational software. Audacity, one of the world's most widely used free audio editing tools with millions of monthly downloads, originated from a "query by humming" research project around 2000, not a product vision. Dannenberg's lab also conducted early gesture research, including pinch-to-zoom, which foreshadowed modern touchscreen interactions. He envisions a future where AI acts as a true musical collaborator, acknowledging current challenges in areas like beat detection and understanding musical anticipation and surprise.

Key takeaway

For software engineers or creative technologists developing audio applications, you should recognize that foundational tools like Audacity emerged from unexpected research needs, not always direct product roadmaps. Focus on solving core technical visualization or interaction problems, as these can organically lead to widely adopted solutions. Also, consider integrating temporal semantics into your designs for applications requiring precise timing, such as musical or real-time interactive systems.

Key insights

Roger Dannenberg's career merged computer science and music, pioneering real-time accompaniment, music programming languages, and widely used audio tools.

Principles

• Open source fosters academic dissemination.
• Computers can be musical collaborators, not just tools.
• Music requires temporal semantics in programming.

Method

Dannenberg's approach involved building custom hardware for real-time performance, developing specialized programming languages like Nyquist for musical expression, and applying AI techniques for interactive music education systems like Smart Music.

In practice

• Use Audacity for free audio editing.
• Explore Nyquist for sound synthesis and composition.
• Consider Smart Music for interactive music practice.

Topics

• Computer Music
• Audacity
• Nyquist Programming Language
• Computer Accompaniment
• Smart Music

Best for: AI Scientist, Software Engineer, Creative Technologist

Related on AIssential

• AI Music Generation Goes Consumer with Google’s MusicFX DJ — Google's MusicFX DJ brings real-time, interactive AI music generation to consumers via the Lyria RealTime diffusion model.
• AI Music Is Here. The Real Fight Is Over Who Gets Erased — AI music's rise demands focus on human artist visibility, credit, and control, not just its presence.
• Music AI Sandbox | AI x Creativity: Wyclef Jean — AI tools serve as creative instruments that augment human artistry through careful curation and iterative exploration.
• Optical Music Recognition for Real-World Manuscripts with Synthetic Data — Synthetic data, combined with minimal in-domain real data, significantly improves Optical Music Recognition for diverse real-world musical manuscripts.
• Spotify says its best developers haven’t written a line of code since December, thanks to AI — Spotify's "Honk" system, powered by generative AI, enables top developers to deploy code without manual writing.
• This AI Music Studio Has Grammy Producers Getting Excited! — Suno Studio combines human creativity with AI to revolutionize music production workflows.

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Where What If Becomes What's Next.