Decoding Insect Song: A Multitask Semisupervised Orthoptera Bioacoustic Classifier

· Source: Machine Learning · Field: Science & Research — Life Sciences & Biology, Mathematics & Computational Sciences, Artificial Intelligence & Machine Learning · Depth: Expert, quick

Summary

PULSE, a novel semi-supervised, multi-task framework, addresses limitations in existing automated tools for Orthoptera bioacoustics, which are typically narrowly trained and non-transferable. This framework integrates weakly-supervised species classification, self-supervised learning on unlabelled field audio, and knowledge distillation from a general-purpose bioacoustic model. As a domain-adapted specialist model, PULSE significantly outperforms a state-of-the-art general model across key metrics, achieving a macro F1 of 0.21 versus 0.07, an AUC of 0.74 versus 0.45, and an AP of 0.32 versus 0.19. Further enhancements through active learning boost its F1 score to 0.34 and AUC to 0.84. Beyond classification, PULSE generates ecologically meaningful embeddings, which are exposed via an interactive visualization tool for ecological discovery.

Key takeaway

For research scientists developing specialized bioacoustic monitoring tools, PULSE demonstrates a robust approach to overcome data scarcity and transferability issues. You should consider integrating semi-supervised, multi-task learning with knowledge distillation to create highly effective, domain-adapted classifiers. This method significantly improves performance metrics like F1 and AUC, even with limited labeled data, and also enables deeper ecological insights.

Key insights

PULSE combines semi-supervised, multi-task learning with knowledge distillation to create a high-performing, domain-adapted bioacoustic classifier for Orthoptera.

Principles

Method

PULSE integrates weakly-supervised species classification, self-supervised learning on unlabelled field audio, and knowledge distillation from a general bioacoustic model to create a domain-adapted classifier.

In practice

Topics

Best for: AI Scientist, Research Scientist

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Machine Learning.