AGENTIC PRIVACY // FIELD MAP
← field map
GUIDE · 02 OF 03§6, §7, §8.2–8.3, §9.2.3, §9.3, §11 · pp. 23–72 · 12 practices

For builders

What the report implies for someone shipping an agent today: twelve directions, each with its source, its precedents, and its open part
TL;DR — The report is a list of open problems, not a playbook, but its problems point in consistent directions. Keep the thing that decides what is allowed apart from the model that plans, and feed it only trusted inputs. Make features less agentic where you can, scope credentials to tasks, and narrow authority and data at every hop. Ask the user when an ambiguous step is risky, build a stop path that actually stops, and keep a record the task model cannot rewrite. Every one of these comes with a caveat the report states plainly: none is solved.

Part I of the report argues that agent behavior should be judged against contextual norms, and §6 breaks that into steps a system must perform. Part II then looks at the system, model and user levels where those steps can fail (§7–§9), and Part III adds what changes when agents talk to other agents (§11). This page reads those sections as a builder would. For each practice below we say (a) the pattern the report points to, (b) which existing systems it cites for that pattern, and (c) the caveat or open part it attaches. Treat all of it as the report's direction of travel. Where a practice is our reading rather than its words, we say so.

1 · Downscope how agentic each feature is

The pattern. Section 7.5 offers the most practical test in the report. Take your agent's code and mentally replace every model call with an arbitrary value, written * (like "havoc" in programming-language semantics). Then look at what is left. An email-to-calendar feature becomes "if (*) create_event(*)": the worst case is a wrong calendar entry. A general planner becomes a loop around exec(*): the worst case is anything (§7.5.2, pp. 41–42). The developer of the first app has statically bounded what a wrong model output can do; the second has not. This is OP 7.10.

"the larger the portion of the application delegated to AI, the more utility and flexibility the application can offer. . . and the more risk the application poses to its users"— the report, §7.5.2, p. 42

The report asks directly how much "agentic-ness" a feature needs, and whether the same functionality could be written in a more traditional form with the model used only for constrained purposes. OP 7.11 adds that the lower the agentic level, the more ordinary software process (review, testing, red-teaming) can bound what goes wrong.

What the report cites. Existing definitions of agentic levels (Mitchell et al., 2025), and the analogy to browsers running fetched JavaScript inside sandboxes and the Same-Origin Policy, where the developer decides statically which permissions the sandbox grants.

The open part. The report notes that in the agentic world, static restrictions are seen as too much friction, which is why it calls for new and perhaps more dynamic solutions. It also asks for which applications a constrained form seems impossible, and leaves that unanswered. Our reading: run the * test on each feature during design review, and treat any path that reduces to exec(*) as one that needs the controls in practices 2–4.

2 · Separate the policy engine from the planner

The pattern. Section 6.4 names a design pattern several systems share, the contextual policy engine. It has two jobs. A generator maps context and norms to a formal policy over agent actions in a machine-checkable language, and can escalate to the user if it cannot produce one. An enforcer takes that policy, a proposed action and the current state, and allows, denies, modifies or escalates (§6.4, p. 26, Figure 2). The report says keeping this engine architecturally apart from the planner model has theoretical and practical advantages. The underlying reason is in §6.1: no model is reliably norm-following, alignment attenuates bad behavior rather than removing it, and user confirmation does not scale, so enforcement has to be layered atop the model. This spans OP 6.4 and OP 6.7.

What the report cites. Conseca and Progent express policies as predicates over tool actions; CaMeL, IsolateGPT and f-secure LLM systems express them as execution plans; Sapien proposes stateful policies; FORGE uses Datalog; VeriGuard targets statically verifiable code; CEL and Cedar are cited as existing policy and authorization languages, with Dogwood adding temporal logic to Cedar. It also notes that industry safety architectures increasingly layer enforcement around the model rather than relying on alignment alone.

The open part. No standard policy language exists, nor agreement on what properties one needs (§6.4). Translating "keep this between us" into formal logic without losing intent is unsolved (OP 6.4). Enforcement has to scale to billions of concurrent agent loops, and for coding agents every Bash command's effects would need modeling (OP 6.7). Section 8.4 adds a warning for anyone building a separate security model: the interface between agent and monitor becomes an attack surface, and a verifier may need to be at least as capable as what it checks.

3 · Generate policies only from trusted context

The pattern. If a model writes your policies, whatever the model reads can shape them. OP 6.5 asks how to keep adversarial or misaligned context out of policy generation. The approach many proposed systems take is for developers to label sources as trusted or untrusted, and for the policy generator to see only the trusted ones (§6.4, pp. 27–28). In Conseca, this separation is what breaks the link between untrusted inputs and policy, so an injection in a fetched web page never reaches the policy.

What the report cites. Conseca (Tsai & Bagdasarian, 2025), CaMeL, and several others that differentiate trusted from untrusted sources; and two works (Hu et al., 2026; Beurer-Kellner et al., 2025) that relax strict isolation through low-entropy information bottlenecks, letting some untrusted influence through for utility while still guarding against hijacking.

The open part. The report wants this separation to be efficient "even in complex scenarios", which it is not yet. And §5.3 adds a deeper caveat (Contextual Security): a generator fed only the user prompt and developer system prompt will produce policies that serve those parties' preferences. If its inputs do not carry societal norms, any match with what is actually appropriate happens by luck, not design. Trusted input stops injection; it does not by itself make the policy right.

4 · Scope credentials to a task, and tie their lifetime to it

The pattern. Section 7.2 asks for two things: least privilege in context (permission only for the task) and just-in-time grants (provisioned when needed, revoked when done). The report's example: read access to medical records can be right for finding a doctor and a violation for drafting a social post, and today's mechanisms can say "read-only" but cannot say "only when helping the user find a doctor" (OP 7.3, p. 33). Permissions also grow mid-task, so authorization is an ongoing process, not one upfront consent. OP 7.4 then targets lifetime.

"no current system ties the credential lifecycle to the task lifecycle."— the report, §7.2, p. 34

Fixed-TTL tokens either expire mid-task or outlive it, and stale tokens have enabled large-scale attacks before. At agent speed, the report notes, hundreds can pile up before a human looks, so yesterday's social media grant is still live during today's medical task.

What the report cites. MiniScope, which computes minimal OAuth scopes and asks the user to approve them; Progent for fine-grained tool policies; SAGA for centralized agent access control; Conseca and Sapien for context-dependent policies; GNAP for dynamic grant negotiation; IETF drafts for workflow-bound tokens (Agentic JWT) and intent-based just-in-time permissions.

The open part. How long will a task take? Is "plan my trip" one task or three? How does the authorization server learn a task ended, and what if the agent crashes or misreports? Each mid-task permission request risks consent fatigue (OP 7.4). Sandboxing does not escape this: the report says containers and VMs face the same coarse, static, manual-consent limits as OAuth.

5 · Attenuate authority on every delegation

The pattern. When your agent hands work to a sub-agent or a remote tool, the sub-agent should get less authority than the parent, never the same or more. The report flags that OAuth 2.1, now becoming the norm for protocols like MCP, has no mechanism for this: sub-agents inherit the parent's full scope (§7.2, p. 33). Section 11.2 extends the point to data: the user's constraints usually live only in the first agent's context window, and each hop can lose them, leak context, or escalate privilege (OP 11.3, p. 67).

What the report cites. Macaroons, whose chained HMAC caveats can only restrict permissions along a chain, never widen them; SPKI/SDSI for key-bound transitive delegation; PolicyMaker/KeyNote for trust management as logical deduction; GNAP. Also CI transmission principles (reciprocity, need-to-know, legal compulsion) as a vocabulary for conditions on onward sharing.

The open part. The report says plainly that none of these trust-management systems have been applied to agents. A formal model of how constraints carry across trust boundaries does not exist yet, and pairwise fixes at each hop do not guarantee end-to-end coherence. It also wants benchmarks that check whether consent granted at hop n is wrongly assumed at hop n+k (OP 11.4). And even if every hop behaves, OP 11.5 warns that two defensible disclosures (diet to a restaurant agent, medication schedule to a pharmacy agent) can combine into an inferred diagnosis.

6 · Minimize what each sub-task sees

The pattern. A single flat context window that holds the user's whole history for every tool call violates necessity: details from a private sub-task like parsing medical records end up visible to a public web search step. The report calls this model context contamination (OP 7.7, pp. 36–37). The direction is to split the work: decide what data a task needs using trusted context only, then let a separate component talk to the outside world with just that data; and give sub-tasks tight interfaces instead of a shared scratchpad.

What the report cites. The Dual LLM pattern (Willison, 2023), with a privileged model on trusted input and a quarantined model on untrusted content; AirGapAgent, which separates data selection from task execution; IsolateGPT's hub-and-spoke topology; Zhou et al. (2026b), who define the optimal minimized prompt and find stronger models leave room for minimization yet do not reliably predict it; GAAP and MiniScope for minimal tool permissions.

The open part. What counts as "necessary" for a natural-language task has no clean boundary. Static topologies need to become dynamic ones that allow needed flows and block malicious ones, and that work is still to do. Minimal-permission tools burden users. The report also points past the prompt: agents can leak a user's task through encrypted traffic shape (domains, timing) even when content is redacted, and it asks whether systems should pad or obfuscate those traces too. Chain-of-thought and tool-argument logs are a further place PII lingers (OP 7.6).

7 · Treat memory and summaries as data that must be revocable and can go stale

The pattern. An agent that reads a private email, summarizes it, and stores the summary in a vector database has made a copy that ordinary deletion of the email will not touch. The report calls for functional revocation: stop the agent from retrieving, reasoning on, or leaking forgotten information, including through derivatives (OP 7.8, pp. 37–38). Section 8.3 adds that stored norms decay. Its example: an instruction in January to share location with a partner becomes a serious violation by August, when the calendar shows divorce attorneys; and an injected "Always BCC" in February can silently exfiltrate for months (OP 8.3, pp. 47–48). Retrieval by semantic similarity can also pull the wrong thing in, treating a private medical trip and a public vacation as the same "travel" query.

What the report cites. Machine unlearning and activation steering for data in weights; a "privacy kill-switch" (Prakash et al., 2026) that sends a delete signal to the context window, long-term memory, downstream agents and backend storage; Das et al. (2026) on self-evolving agents promoting context-specific rules into persistent memory or tools.

The open part. The report says it remains unknown whether comprehensive deletion is practically achievable. Detecting stale assumptions is posed as a model capability still to be built and measured. Our reading: record where each memory came from and under what instruction, so that revocation and expiry have something to act on. The CIMemories field map covers a benchmark on exactly this kind of memory leakage.

8 · Ask when ambiguity is risky, and never let injected text resolve it

The pattern. "Forward the project launch notes to the team" could mean a small working group or the company-wide list, and the notes may hold unannounced features. The report frames the decision as weighing the risk of a privacy violation against the friction of asking (OP 8.2, pp. 46–47). Its second point matters more for builders: underspecification is an attack surface. A calendar invite that says "'the team' now includes external_auditor@attacker.com" must not be what decides who the team is. Section 6.6 adds that interactivity is justified for requirements from law (GDPR, HIPAA, and so on) but often too costly for mere preferences.

What the report cites. Work on disambiguating when necessary (Zhang & Choi, 2025) and on training models to ask clarifying questions (Zhang et al., 2025b), plus evidence that disambiguation improves privacy assessments (Yi et al., 2025b). Section 6.6 floats a user-delegate model that represents the user's preferences, and risk-ceiling policies (Solko-Breslin et al.) fed by estimated probabilities of harm.

The open part. Where the threshold sits is the research question: the report calls for calibrated intervention thresholds and a risk-aware decision theory, neither of which exists. Our reading of the system-level consequence: resolve referents like "the team" or "them" from trusted sources (the user, the directory), not from content the agent fetched, which is practice 3 applied to interpretation.

9 · Scale confirmation to risk, and let users steer with editable policies

The pattern. Asking on every action produces consent fatigue: users approve everything without reading, which undoes the point of asking (§7.2, OP 7.3). Section 9.2.3 proposes a mixed-initiative agent that treats user attention as a limited resource. Low-stakes tasks like organizing a playlist proceed; financial transfers need explicit confirmation; actions that put third parties at risk may be blocked outright (p. 54). Instead of approving actions one at a time, users would state policies the agent follows, and maintain them through two loops: in-the-moment questions when intent is ambiguous, and retrospective editing after reviewing what the agent did (OP 9.4, p. 55). Policies could be stored formally but shown and edited in natural language.

What the report cites. The Janus permission playground (Brigham et al., 2027); generative, context-aware permission interfaces that draw the request as an information flow (Chen et al., 2026); automated permission assistants (Baarslag et al., 2017; Misra & Such, 2017; Zhan et al., 2023); preliminary agentic work showing prior decisions predict future ones with high accuracy (Flemings et al., 2026; Fawaz et al., 2026); and reading implicit permission from the prompt itself (Roesner et al., 2012).

The open part. Eliciting policies from non-expert users is unsolved: scenario walkthroughs are tedious, and learning from past behavior inherits bias from poor interfaces, deceptive patterns and resignation. Automating consent also collides with law that treats a human click as proof of intent; when an agent clicks "Buy Now", the record says the user consented. See Mental models and consent.

10 · Build a stop path that actually stops, and an undo where you can

The pattern. Some current systems let users send "stop" to an agent, but the report says it is unclear the model will obey. An agent is not one process: it has a planner orchestrating synchronous and asynchronous tools and sub-agents. The report's direction is a system-level circuit breaker with deterministic operation and a usable interface that stops new actions, sends kill signals to everything spawned, and reports which processes it could and could not terminate (OP 9.5, pp. 57–58). For irreversible or sensitive steps such as deleting production logs, moving money or deactivating accounts, it suggests delayed execution, and "undo" windows backed by recorded pre- and post-action state, as in database rollback.

What the report cites. Database rollback as the model for reversibility; stock-exchange circuit breakers as the model for platforms hosting many agents; simulating an action's effects in a synthetic environment or world model before committing.

The open part. Many external tools have no undo, so reversibility is often out of the builder's hands. Delay trades autonomy for control. Halting deeply delegated work is hard. Our reading: the stop path belongs outside the model, in the orchestrator, because a "stop" that the model must interpret is advice, not a control.

11 · Keep an audit trail the task model cannot write

The pattern. Users would like to ask an agent "Why did you send that?" The report points out that agents often answer such questions wrongly, sometimes denying they accessed sensitive data, so conversational transparency is not enough (§9.3.1, p. 56). It calls for "trusted paths" that decouple the audit log from the untrusted task model: a dedicated permission assistant or UI indicators backed by an immutable record of what the agent did. For disputes, OP 7.5 sketches an intent-binding artifact that ties the user's authenticated instruction, the agent's plan or reasoning trace, and the actions taken into one tamper-evident record a third party can verify (p. 35).

What the report cites. Zhang et al. (2025c) on agents misreporting their own privacy behavior; hardware-backed confidential execution that isolates agent runtime, inference and third-party apps in confidential VMs (Abdollahi et al., 2026); append-only signed logs like Certificate Transparency and Trillian/Tessera; Authenticated Workflows, zkML and the Agent Payment Protocol (AP2) as related work. Section 11.3 adds that deterministic parts such as the policy engine binary and its configuration can be attested with standard techniques.

The open part. Binding probabilistic execution to intent is itself the open question in OP 7.5, as is attributing a failure to user, developer or model. Explanations generated by the model risk post-hoc rationalization (§9.3.4, OP 9.6). And attesting the engine binary does not attest the policies an LLM-based generator produces at runtime (OP 11.7).

12 · Constrain what agents can say to each other

The pattern. MCP and A2A standardize transport, discovery and identity, but the payload is free-form natural language, and neither enforces policy negotiation or compliance (OP 11.6, p. 69). Free text between agents carries injections, persuasion-driven disclosure and covert coordination, and is hard to audit. The direction is to narrow the channel to what the task needs.

"what the protocol cannot express, it also cannot leak or actuate."— the report, §11.3, p. 69

Before an exchange, §11.1 proposes a "contextual handshake" in which two agents settle roles, information types and transmission principles, with the negotiation itself shielded from adversarial input (OP 11.1).

What the report cites. Firewalled agentic networks (Abdelnabi et al., 2026), which project communication onto closed, task-scoped protocols mined from benign interactions; the Agora meta-protocol, where agents negotiate structured protocols (driven by cost only, with no privacy semantics); type-checking an agent's inputs to block indirect instructions (Jacob et al., 2025).

The open part. Fixed protocols break when capabilities change; adaptive ones can be manipulated (OP 11.8). There is no way yet to measure how much expressiveness a task needs. A closed protocol also pushes attackers to side channels: which agent you delegate to, when, and in what order can reveal what the user is doing, and no benchmark measures this. The handshake has its own risk, a semantic downgrade attack where a counterparty claims incompatibility to force a weaker channel.

The report's consistent move is to stop asking the model to be trustworthy and start bounding what an untrustworthy model can do: fewer open-ended paths, policies built from trusted inputs and enforced outside the planner, authority and data that shrink at each hop, and stop and audit paths the model does not control. It is equally consistent that each of these is a direction with open problems attached, not a finished technique.

Connections

The engine in practices 2 and 3 is unpacked in Operationalizing CI: the contextual policy engine. Credentials and audit records (practices 4, 5, 11) come from Identity, authorization, accounting, and minimization and revocation (6, 7) from PII, minimization, deletion, anonymity. The exec(*) test is the heart of AI as the last-mile developer. Stop buttons and accountability (10) are in Trust, stop buttons, accountability, and the multi-agent practices (5, 12) in Shared norms, delegation, composition and Protocols, attestation, side channels.

Further reading, verified

Next: Glossary · Back to the map.