Tether launches open-source on-device AI framework for developers
Summary
Tether Operations S.A. de C.V., known for its cryptocurrency, has released the QVAC Software Development Kit (SDK), an open-source framework designed for building AI features directly onto various devices and platforms. The QVAC SDK, which stands for QuantumVerse Automatic Computer, aims to enable a decentralized AI internet to handle the anticipated expansion of AI agents and autonomous machines. It supports cross-platform deployment, allowing applications to run unchanged across iOS, Android, Windows, macOS, and Linux. The SDK integrates QVAC Fabric, a fork of llama.cpp, for executing AI model workloads, and includes local engines like whisper.cpp and Parakeet for speech-to-text, and Bergamot for on-device translation. A core feature is its built-in peer-to-peer functions for decentralized model distribution and delegated inference, ensuring resilience without centralized infrastructure.
Key takeaway
For NLP Engineers developing AI applications, the QVAC SDK offers a compelling path to build once and deploy across all major platforms, leveraging decentralized peer-to-peer functions. You should explore its cross-platform compatibility and integrated local AI engines to create resilient, local-first AI experiences that bypass the scalability limitations of centralized infrastructure.
Key insights
Decentralized, device-agnostic AI frameworks are emerging to scale intelligence beyond centralized server models.
Principles
- Centralized AI models will not scale.
- AI applications should run universally.
- Peer-to-peer functions enhance AI resilience.
Method
The QVAC SDK provides a unified framework for building AI applications once and deploying them across diverse operating systems and hardware, leveraging decentralized peer-to-peer functions for model distribution and inference.
In practice
- Develop AI apps for iOS, Android, Windows, macOS, Linux.
- Utilize llama.cpp fork for AI model execution.
- Implement local speech-to-text with whisper.cpp.
Topics
- Tether
- QVAC SDK
- On-device AI
- Decentralized AI
- Peer-to-peer functions
Best for: NLP Engineer, AI Engineer, Software Engineer, Machine Learning Engineer
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by AI – SiliconANGLE.