Model Picker - Perplexity

· Source: perplexity.ai via Google News · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Software Development & Engineering · Depth: Intermediate, medium

Summary

Perplexity's Model Picker is a command-line example demonstrating how to use the Perplexity Agent API to generate grounded recommendations for open models from Hugging Face. It utilizes a single Agent API request that integrates two distinct tools: the "mcp" tool, which connects to the Hugging Face MCP server for live model registry data (e.g., download counts, licenses, last-modified dates), and the "web_search" tool, used for checking benchmarks, quality, and known issues. Users provide a plain-language task, such as "on-device English speech-to-text, small enough to run on a laptop," and the system returns a Markdown brief containing a shortlist of models and a justified recommendation. The Agent API is explicitly instructed to verify all claims using these tools, ensuring recommendations are based on current data rather than the model's training memory. Installation requires the Perplexity Python SDK, with an optional "HF_TOKEN" for increased Hugging Face rate limits. The process involves the model iteratively searching the Hub, then performing web searches before presenting its final output.

Key takeaway

For AI Engineers evaluating open-source models for specific deployment constraints, Perplexity's Model Picker offers a robust, data-driven approach. Instead of relying on a model's potentially outdated training data, you can use this tool to get real-time, verified recommendations grounded in live Hugging Face registry data and web benchmarks. This ensures your model choices are current and optimized for factors like on-device performance or license compatibility, streamlining your selection process and reducing manual cross-referencing.

Key insights

Combining live registry data with web search grounds LLM model recommendations.

Principles

Method

The Agent API uses "mcp" for Hugging Face registry search and "web_search" for external validation. It iteratively refines searches, retrieves details, and then performs web checks before generating a recommendation.

In practice

Topics

Code references

Best for: AI Engineer, Machine Learning Engineer, Software Engineer

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by perplexity.ai via Google News.