Perplexity Tries to Outsource AI Work to Your Laptop

Perplexity CEO Aravind Srinivas took the stage at Computex 2026 in Taipei on June 2 alongside Intel CEO Lip-Bu Tan to announce what the company calls the first hybrid local-server inference orchestrator. The system, coming to Perplexity Computer in July, automatically decides which parts of an AI task to run on your machine and which parts get routed to more powerful models in the cloud—without asking you to choose.

"Today we're announcing the next step for Personal Computer: the first hybrid local-server inference orchestrator," Perplexity announced. "It decides what work should run on your device and what work should go to cloud agents, automatically routing each part of a task to the right place."

"The right goal for an AI system is to deliver the most token value per watt, for each user," Perplexity wrote in the official announcement. Three competing pressures make that hard: accuracy demands the most capable models, privacy demands some data never leaves your machine, and cost demands you don't spend a frontier model's computing resources on a task a smaller one can handle. The solution Perplexity calls "hybrid agentic inference" addresses all three at once. A compact model runs locally on your device and acts as a traffic cop—figuring out which information is sensitive enough to stay local and which tasks need the full power of a cloud-based frontier model.

"Hybrid agentic inference is for work that includes sensitive data but needs powerful AI. Things like financial records, health information, and personal files," the company explained. "The compact model runs locally on your device to determine when sensitive data should also be kept locally. Meanwhile, work that needs a frontier model's full capability runs on the server."

Inference—the process of running a trained AI model to generate a response—is the computational work that happens every time you send a prompt to a chatbot. Right now, almost all of it happens on remote servers owned by AI companies. That means your financial documents, health queries, and private notes travel to someone else's computer before you get an answer back.

This is why you see "Auto" modes or "low thinking" modes on your chatbot. AI companies will always try to nudge users into the cheapest routing tier possible for them. A bold corporate strategy, truly.

Srinivas has been direct about this. In a Bloomberg Television interview at Computex, he said the quiet part out loud: "You don't want all your compute centralized in servers and everything running through the largest models. Some people are spending half a billion dollars per month. What you actually want is efficient value per watt per user."

Offloading inference work to user hardware reduces those bills—for Perplexity. Local inference is a cost-cutter's dream for those companies, but it has a major selling point for AI users too: it keeps that data on your machine. The tradeoff has always been power: smaller models that run locally are less capable than the large ones living in data centers. Perplexity's orchestrator tries to get both.

Simple tasks—summarizing a document you've already written, formatting text, lightweight classification—run locally. Complex reasoning gets routed to the cloud, ideally without the sensitive parts of your task attached. The company says this happens automatically, mid-task, invisible to the user. Whether the routing is as reliable in practice as it sounds in a Computex demo is a question the July rollout will answer.

One clarification worth making: this is not Perplexity giving away an open-source local model you control. The local component is a compact model Perplexity deploys as part of its app. The cloud component still routes through Perplexity's servers. Users who want a fully offline, self-hosted setup—the kind projects like MiniCPM5-1B offer—won't find that here.

The numbers give that framing context. Perplexity's revenue grew from $100 million to $500 million while headcount increased just 34%, Sri