The Retrieval Substrate Goes Open-Source: Perplexity's pplx-embed-v2-late and the Commoditization of Research-Agent Search Infrastructure
Revised 2026-10-13: adds a live rate-card check — the hosted endpoint for the v2-late late-interaction models is still NOT live six days after release; the open-weights models remain self-host-only while the hosted meter monetizes the older v1 models. Also documents Perplexity's now-published Agent API tool rate card and its third-party-model router.
The Oct 7 release. Perplexity released pplx-embed-v2-late — a pair of ColBERT-style late-interaction embedding models (0.6B and 9B) that are multimodal (text, natural images, and rendered document pages), MIT-licensed on Hugging Face. The 0.6B runs at the edge (340M active parameters, 128-dim); the 9B (7.4B active params) is the quality tier. Published ViDoRe(v3) nDCG@10: 62.3% (0.6b, image) / 65.2% (9b, image); MarkTechPost highlights a "best 92.4% MADQA score." The company blog frames it as "Multimodal embeddings beyond a single vector" (perplexity.ai/hub/blog/multimodal-embeddings-beyond-a-single-vector, cited in the HF card).
Oct 13 rate-card check (docs.perplexity.ai/getting-started/pricing, fetched live). The hosted Embeddings API rate card lists only the v1 models: pplx-embed-v1-0.6b at $0.004/1M tokens and pplx-embed-v1-4b at $0.03/1M tokens. No v2-late, no contextual endpoints — the late-interaction substrate is open-weights-only for now, exactly as the Oct 7 blog implied ("a hosted Perplexity API endpoint is planned but not live," per MarkTechPost). The pattern: open-weights as distribution for a hosted meter — Perplexity gives away the new architecture for self-hosting while the hosted API monetizes the previous generation1.
The full Agent API tool rate card is now published — the first complete list-price view of the retrieval substrate a research-agent builder can buy by the component:
| Tool / API | Price |
|---|---|
web_search (standard) |
$0.0025/invocation ($2.50/1K) |
web_search (Fast Search) |
$0.001/invocation ($1.00/1K) |
image_search |
$0.0025/successful invocation |
fetch_url |
$0.0005/invocation |
people_search |
$0.005/invocation |
finance_search |
$0.005/invocation |
sandbox |
$0.03/session (20-min window) |
| Search API (raw) | $5.00/1K requests ($1.00/1K fast) |
Decisions API (pplx-decider-v1.1-27b) |
$0.02/1M input tokens, output free |
Notably, the Agent API also routes third-party models — "OpenAI, Anthropic, Google, xAI, Z.AI, Moonshot AI, and NVIDIA with transparent, token-based pricing at each model's published rates" — making Perplexity simultaneously a substrate vendor and an orchestrator/router over competitors' models2.
Why it matters. The retrieval layer underneath every research agent now has public component pricing: a deep-research loop's marginal search cost is knowable to fractions of a cent, which hardens the comparison point for anyone building on Gemini grounding ($14/1,000 requests after the free 5,000/month on Gemini 3+ models), Brave ($3–5/1K), or self-hosted pplx-embed. It also sharpens the commoditization thesis: when the search substrate is a metered commodity, differentiation migrates up the stack — to orchestration, verification, and workflow embedding (see Market Map & Positioning: Where Does Hey, Lefty Fit?, Destination vs. Backend: The Research-Tool Market Bifurcates — and Both Layers Converge on MCP).
-
An instance of Open weights are the free sample; the hosted meter is the product. — The open release is the distribution funnel while the billed endpoint remains the product. ↩︎
-
An instance of When models and retrieval commoditize, the orchestrator seat becomes the contested prize. — A substrate vendor explicitly claims the orchestrator seat over rivals' models — the contested layer of the stack. ↩︎