TwelveLabs’ video AI finds new use cases on AWS Marketplace
Summary
TwelveLabs, founded in 2020, specializes in multimodal AI models designed to "watch" and analyze video content, addressing the fact that over 80% of the world's data is video but remains largely ununderstood. The company offers Marengo for semantic video search, converting content into searchable embeddings, and Pegasus, a video language model that analyzes footage for insights like summaries and classifications. Their AI copilot, Rodeo, assists video editors by accelerating footage search and assembly using natural language prompts. Initially serving the telco, media, entertainment, games, and sports (TMEGS) sectors, TwelveLabs has expanded its customer base and discovered new applications through its presence on AWS Marketplace. This includes use cases for auto manufacturers, law firms, and insurance companies, with one Canadian sports company reducing highlight reel production from 16 hours to 9 minutes.
Key takeaway
For AI Product Managers or Directors overseeing extensive video archives, TwelveLabs' multimodal AI solutions on AWS Marketplace offer a direct path to unlock value from previously inaccessible video data. By leveraging Marengo for semantic search and Pegasus for deep analysis, you can automate content understanding and accelerate workflows like highlight reel generation or evidence review. Consider piloting these models via AWS S3 or Bedrock to transform video into a searchable, actionable asset, significantly boosting operational efficiency and discovering new use cases.
Key insights
Video AI transforms unstructured video data into searchable, analyzable, and actionable assets, unlocking new value across industries.
Principles
- Over 80% of world's data is video, yet least understood.
- Semantic video search can mimic human memory recall.
- Combining search and analysis models creates a powerful video librarian.
Method
TwelveLabs' Marengo model converts video into embeddings for semantic search, while Pegasus analyzes content for insights. Rodeo, an AI copilot, uses natural language prompts to accelerate video editing by searching and assembling footage.
In practice
- Automate sports highlight reel creation from 16 hours to 9 minutes.
- Analyze legal discovery or investigative video evidence.
- Enable automated initial vehicle analysis for auto manufacturers.
Topics
- Video AI
- Multimodal AI
- AWS Marketplace
- Video Intelligence
- Semantic Search
- AI Copilot
Best for: Executive, Director of AI/ML, AI Product Manager, Consultant
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by AI – SiliconANGLE.