detections
- ID: SDT019
- Created: 26th August 2026
- Updated: 26th August 2026
- Contributors: Nimer Kees, Yonatan Machluf, The ITM Team,
Provenance and Boundary Correlation
Provenance and boundary correlation tags instructions, retrieved content, tool outputs, memory records, and data items with their source, trust level, owner, and boundary context. The detection alerts when a synthetic subject action traces back to tainted, external, low-trust, or out-of-boundary content rather than an approved task origin.
Implementation
Assign provenance metadata at ingestion, retrieval, context assembly, memory write, tool return, and inter-agent handoff. Metadata should include source system, source record identifier, submitter or originator, trust level, tenant, user, team, data owner, classification, boundary zone, producing agent, producing tool, session identifier, and approved task identifier where applicable.
Apply taint labels to content from attacker-controllable or low-trust sources, including fetched web pages, inbound forms, inbound tickets, email bodies, shared files, uploaded documents, Customer Relationship Management (CRM) fields, webhook payloads, queue payloads, and tool-returned content. Propagate those labels through summaries, retrieved passages, generated task records, memory writes, tool arguments, agent-to-agent messages, and downstream actions.
Alert when a tool call, payload, destination, financial action, record update, retrieval, outbound request, or communication can be traced to tainted content without an approved-task origin. Also alert when a worker synthetic subject acts on instructions whose source cannot be resolved to an authorized operator, approved workflow, or valid originating event.
For unattended runs, bind the run to the originating event, record, entity, and workflow identifier. Alert when a run triggered by external or low-trust input reaches sensitive data, invokes outbound network access, modifies records outside the triggering entity, or emits records belonging to a different account, lead, customer, tenant, or case than the one that initiated the run.
Correlate across user, team, tenant, and trust-zone boundaries. Alert when data tagged to one boundary appears in a synthetic subject operating in another; when an action toward user B traces to user A’s prior interaction; when collaborating agents pass context across boundaries without provenance preservation; or when a clean session acts on a memory record, task artifact, or tool result written in an unrelated prior session.
Investigative Use
This detection supports investigation of indirect prompt injection, retrieval poisoning, memory-resident invocation, cross-boundary data disclosure, inter-agent context propagation, and source provenance obfuscation. It helps investigators determine not only what the synthetic subject did, but which source, user, session, agent, record, or trust boundary influenced the action.
It is especially useful where the visible request appears authorized, but the causal instruction or data item originated from external content, another user, another tenant, an earlier session, a different agent, or a record outside the approved workflow boundary.
Sections
| ID | Name | Description |
|---|---|---|
| DR002 | Internal AI Assistant | Internal AI assistants are employee-facing artificial intelligence systems embedded into workplace environments to retrieve information, answer questions, summarize content, generate work product, or perform actions across internal systems. They may connect to knowledge bases, mailboxes, document stores, chat platforms, ticketing systems, calendars, customer relationship management systems, and source code repositories.
This deployment pattern creates an elevated exposure condition because the synthetic subject operates inside the organization’s trust boundary with standing access to internal data and tools. Service identities, delegated permissions, or broad connectors may allow it to retrieve information across many users, teams, channels, or repositories, giving it broader practical reach than any single human subject should normally possess.
The main risk is the combination of trusted internal access and untrusted or weakly trusted content. A malicious instruction may be planted in an email, shared document, calendar invite, wiki page, support ticket, chat message, or code comment, then influence the assistant when that content is later retrieved during a legitimate employee request. This is commonly described as indirect prompt injection.
Investigative RelevanceInternal AI assistants are high-trust synthetic insider patterns because they operate inside normal employee workflows. They may be treated as productivity tools, but their access, retrieval behavior, and ability to act across systems can make them significant investigative subjects. |
| DR005 | Event-Triggered AI Agent | An event-triggered AI agent is a synthetic subject whose runs are started by a system event rather than a direct conversational request. This may include a frontend action, webhook, queue item, form submission, file drop, inbound email, application event, or record arriving in a data pipeline.
This deployment pattern creates an elevated exposure condition because the person or system that triggers the run may be different from the person who controls the input. The agent may run with a standing application identity and access to customer records, ticket queues, internal documents, communications, or pipeline data, while the event content may originate from an external or low-trust source.
The primary risk is event-driven indirect prompt injection. Form fields, payloads, queued rows, uploaded files, or inbound messages may contain instructions that the agent treats as task context. A malicious instruction can therefore be planted by a malicious individual and executed later when the workflow processes the item.
A related risk is unattended repetition. Event-triggered agents often process backlogs, queues, or recurring inputs without a human reviewing each run. A poisoned input or flawed directive may produce harmful outputs at machine speed while appearing to be normal workflow throughput.
Investigators should review the agent’s directive, trigger conditions, event payloads, queue records, service identity, workflow permissions, input sources, run history, tool calls, output destinations, and downstream actions. Particular attention should be given to externally controlled fields, repeated adverse outcomes across similar records, and logs that fail to show which input content caused the agent’s action.
Investigative RelevanceEvent-triggered AI agents are relevant because they decouple human oversight from agent execution. The run may be authorized by the workflow, while the effective instruction is supplied through data controlled by an external party, customer, vendor, compromised account, or low-trust source.
This section is especially relevant where agents process public forms, inbound webhooks, emails, file uploads, watched folders, customer relationship management records, ticket queues, data pipelines, or application events without human review before action. |
| CF005 | Persistent Memory Access | Persistent memory access is the configuration that allows a synthetic subject to store, retrieve, or act on durable memory across sessions, users, tasks, or workflows. This may include long-term memory, shared memory, user memory, vector memory, profile memory, task state, scratchpads, or context stores.
This configuration creates an elevated exposure condition because stored memory can influence future behavior after the original interaction has ended. If memory writes are not governed, attributed, reviewed, isolated, or time-limited, a synthetic subject may later act on false assumptions, malicious instructions, sensitive records, or outdated context.
The primary risk is memory poisoning. A user, external content source, compromised integration, or prior agent interaction may cause harmful content to be written into memory. That memory may then be retrieved in a later session and influence the synthetic subject’s reasoning, output, tool use, or treatment of another user.
A related risk is cross-user memory influence. If memory is not isolated by user, tenant, role, or workflow, content introduced through one interaction may affect another person’s future interaction. This may cause unauthorized personalization, data exposure, misleading recommendations, or actions based on context the later user never supplied.
Investigators should review memory write paths, stored memory entries, source prompts, provenance tags, identity records, retrieval logs, retention settings, isolation controls, and memory-driven outputs. Particular attention should be given to unexplained memory entries, progressively shortened or innocuous-looking records, cross-user influence, and behavior not justified by the current prompt or retrieved context.
Investigative RelevancePersistent memory access is relevant because memory can become a durable configuration surface that shapes future synthetic subject behavior. Unlike transient prompt context, persistent memory may survive across sessions and continue influencing outputs after the original source is no longer visible.
This section is especially relevant where synthetic subjects use long-term memory, shared memory, user profiles, vector stores, task scratchpads, reusable summaries, or context stores that can be written by users, agents, tools, or retrieved content. |
| CF011 | Orchestrated AI System | An orchestrated AI system is a deployment pattern where multiple synthetic subjects coordinate to complete a goal. This may involve an orchestrator that decomposes work and delegates tasks to worker agents, or peer agents that call each other across services, teams, or organizations.
This deployment pattern creates an elevated exposure condition because agents may share context, instructions, tools, credentials, or outputs over trusted internal channels. The effective synthetic subject is the whole agent graph, not only the individual agent that performs the final action.
The primary risk is distributed authority. One manipulated agent, poisoned input, or unsafe delegation may spread across the system and cause other agents to act on untrusted instructions. Because agents may treat each other’s outputs as trusted, a single injected instruction can propagate through the graph and influence tool-equipped workers.
A related risk is diffuse attribution. Actions may appear in logs as “the system,” an orchestrator identity, a shared service account, or the final worker agent, rather than the agent or input that originated the decision. This can make intent, origin, data movement, and responsibility difficult to reconstruct after an adverse outcome.
Investigators should review the system directive, orchestration logic, delegation graph, agent identities, inter-agent messages, shared context, tool access, credentials, provenance records, and cross-boundary data flows. Particular attention should be given to new agent-to-agent paths, repeated instructions appearing across agents, aggregate access that exceeds the task scope, and actions that cannot be traced to an approved source.
Investigative RelevanceOrchestrated AI systems are relevant because they allow synthetic subjects to behave like a coordinated internal team. Their combined reach may exceed the access, autonomy, and speed of any individual agent. |
| IV002 | Indirect Untrusted-Content Invocation | Indirect untrusted-content invocation occurs when attacker-controlled or low-trust content causes a synthetic subject to act. The effective instruction is embedded in data the synthetic subject retrieves, ingests, summarizes, renders, or processes, rather than being issued directly by the apparent operator.
This may include instructions hidden in email, webpages, documents, customer relationship management fields, support tickets, pull request comments, uploaded files, calendar invites, chat messages, tool outputs, or other content sources. The synthetic subject may treat the embedded instruction as part of the task context and execute it as if it were a legitimate command.
This invocation creates an elevated exposure condition because the person who triggers the synthetic subject may not be the person who supplied the effective instruction. An employee may ask an assistant to summarize a mailbox, review a document, process a lead, or inspect a pull request, while the actual behavioral instruction comes from external or attacker-controlled content previously placed in that source.
The primary risk is indirect prompt injection. A malicious instruction may cause the synthetic subject to retrieve private data, override constraints, call tools, generate outbound links, render images, transmit information, or combine internal data with an external communication path. This is especially significant where the same context contains private data, untrusted content, and outbound connectivity.
Investigators should review the ingested content, retrieval records, tool outputs, prompt and response logs, rendered links and images, external fetches, web proxy records, Data Loss Prevention (DLP) alerts, requester identity, and downstream tool calls. Particular attention should be given to instruction-like text in retrieved content, invisible or obfuscated payloads, auto-rendered markdown images, new or recently registered domains, character-by-character request patterns, and outputs that combine private data with an outbound channel.
Investigative RelevanceIndirect untrusted-content invocation is relevant because the apparent user request may be benign while the effective command is supplied by another party. The investigation must reconstruct not only who invoked the synthetic subject, but which retrieved or ingested content shaped the action. |
| IV003 | Agent-to-Agent and Tool-Output Invocation | Agent-to-agent and tool-output invocation occurs when the output of one synthetic subject, tool, service, or agent becomes the triggering instruction for another synthetic subject. The effective instruction is propagated through an agent graph, tool chain, orchestration layer, or service-to-service workflow rather than being issued directly by a human operator.
This invocation creates an elevated exposure condition because machine-generated output may be treated as trusted task context by the next synthetic subject. A tool result, worker-agent summary, delegated task, inter-agent message, service response, or generated record may carry instruction-bearing content that causes another synthetic subject to act.
The primary risk is propagation without human review. A compromised, manipulated, or misaligned synthetic subject may produce output that recruits other agents, triggers tool-equipped workers, causes repeated actions, or spreads across a multi-agent system. The resulting behavior may resemble worm-like fan-out, synchronized drift, or cascading action across multiple agents.
A related risk is provenance loss. If inter-agent messages and tool outputs are not signed, attributed, or tagged by trust level, investigators may be unable to determine which agent originated the instruction, which agents propagated it, and where the first unsafe action occurred.
Investigators should review inter-agent messages, tool outputs, orchestration logs, delegation records, shared context, tool-call logs, agent identities, message provenance, and downstream actions across the agent graph. Particular attention should be given to instruction-bearing payloads, repeated payloads across agents, one-to-many fan-out, synchronized identical actions, and actions caused by peer output rather than an approved human instruction.
Investigative RelevanceAgent-to-agent and tool-output invocation is relevant because synthetic subject action may be triggered by another machine actor inside the workflow. The apparent local action may be only one step in a broader propagation chain.
This section is especially relevant where orchestrators delegate to worker agents, agents exchange messages, tools return model-visible output, services generate task instructions, agents share context, or multi-agent systems operate without human review at each handoff. |
| IV006 | Memory-Resident Invocation | Memory-resident invocation occurs when a malicious, false, or instruction-bearing record written into persistent memory causes a synthetic subject to act in a later session. The current session may appear clean, while the effective instruction is retrieved from memory that was written earlier.
This invocation creates an elevated exposure condition because the triggering record can persist across time and, depending on memory isolation, across users. A prior user, external content source, compromised workflow, or earlier synthetic subject interaction may cause a memory entry to be stored, then a later unrelated user may trigger behavior shaped by that record.
The primary risk is persistence and replay. A poisoned memory record may re-invoke attacker-chosen behavior long after the original interaction has ended. The synthetic subject may retrieve the memory as relevant context and use it to alter reasoning, substitute identifiers, disclose information, call tools, change recommendations, or mis-handle a later task.
A related risk is innocuous-looking memory drift. Malicious memory may be written in stages, shortened over time, or phrased as a harmless preference, fact, procedure, or reminder. This can make the memory entry difficult to distinguish from legitimate personalization or task history while still preserving its triggering effect.
Investigators should review memory write logs, stored memory records, memory provenance, source sessions, user identities, retrieval logs, cross-session behavior, and downstream actions. Particular attention should be given to instruction-like records, unexplained memory changes, progressively shortened entries, actions in clean sessions that trace to prior memory writes, and memory entries that affect users other than the user who caused the write.
Investigative RelevanceMemory-resident invocation is relevant because persistent memory can become the source of action rather than merely background context. The investigation must determine whether the synthetic subject acted on the current prompt or on a stored record introduced earlier.
This section is especially relevant where synthetic subjects use persistent memory, user profiles, shared memory stores, long-term task memory, vector memory, reusable summaries, or cross-session context that can be written by users, tools, retrieved content, or prior agent activity. |
| OP006 | Source Provenance Obfuscation | Source provenance obfuscation occurs when a synthetic subject’s output hides, omits, or misrepresents the true source of the data, instruction, or context that influenced its behavior. The visible output may cite an innocuous source, trusted record, private channel, or retrieved document while omitting the upstream content that actually caused the response or action.
This opacity condition frustrates investigation because the cited source may not be the causal source. A synthetic subject may produce an answer that appears grounded in approved material, while the operative instruction came from hidden text, an attacker-controlled message, a tool result, a retrieved comment, or another upstream source not shown to the user.
The primary risk is false source confidence. Investigators, users, or reviewers may inspect the visible citation and conclude that the response was properly grounded, while the actual source of influence remains outside the cited evidence chain. This can delay containment, misdirect review, and cause investigators to inspect the wrong document, channel, record, or tool output.
A related risk is missing upstream provenance. Retrieved or summarized content may be copied through multiple layers before reaching the synthetic subject. As content passes through summaries, citations, tool outputs, shared context, or generated records, the original source may become hidden or detached from the final answer.
Investigators should review cited sources, retrieved records, raw source content, upstream messages, hidden comments, tool outputs, prompt and response logs, provenance tags, source ranking, and generated citations. Particular attention should be given to citations that do not contain the asserted content, outputs shaped by uncited material, invisible markdown comments, zero-width Unicode, hidden instructions, and answers whose visible source trail begins after the true originating source.
Investigative RelevanceSource provenance obfuscation is relevant because a synthetic subject’s visible citation or grounding trail may not identify the content that caused its behavior. The investigator must reconstruct the full source chain, including upstream material that was retrieved, summarized, hidden, or omitted from the final output.
This section is distinct from data exfiltration and indirect prompt injection. The data leak belongs to Adverse Outcome, and the injected instruction belongs to Invocation. This Opacity section concerns the concealment or loss of source provenance that frustrates reconstruction.
This section is especially relevant where synthetic subjects generate citations, summarize retrieved content, process hidden comments, use Retrieval-Augmented Generation (RAG), consume tool outputs, or operate in collaboration platforms where content from one channel, record, or document can influence output attributed to another. |
| DR002.001 | Internal Knowledge Assistant | An internal knowledge assistant is an employee-facing artificial intelligence system that answers questions using internal documents, wikis, file stores, tickets, policies, procedures, and other indexed sources. It is commonly implemented using Retrieval-Augmented Generation (RAG), where relevant source material is retrieved before an answer is generated.
This deployment pattern creates an elevated exposure condition because the retrieval index becomes part of the synthetic subject’s instruction surface. Any indexed document, ticket, page, comment, or shared file may later enter the assistant’s context. If that content contains malicious or misleading instructions, the assistant may treat them as relevant during an ordinary employee query.
The primary risk is that a planted or low-trust document can influence answers drawn from higher-trust material. A malicious outsider or low-trust insider may not need direct access to sensitive repositories if they can place content somewhere the assistant indexes.
A related risk is permission and access-boundary failure. The assistant may retrieve, summarize, or infer information from documents the human requestor is not entitled to view. This can occur through a shared service identity, broad retrieval index, cached embeddings, inherited connector permissions, or weak query-time access controls.
Investigators should review the assistant’s directive, retrieval configuration, indexed sources, ingestion process, access controls, source ranking, logs, and retrieved source records. Particular attention should be given to retrieval outside the employee’s entitlement, embedded instructions in indexed material, and answers that are not grounded in approved sources.
Investigative RelevanceInternal knowledge assistants are relevant to the SITM because they convert internal document stores into conversational answers at workforce scale. Their retrieval process may combine content across repositories, trust levels, and access boundaries in ways that employees cannot easily observe. |
| DR005.001 | User Action Trigger | A user action trigger occurs when an action in an application interface starts an agent run. This may include submitting a form, clicking a button, saving a record, uploading a file, updating a field, or completing another workflow step.
This deployment pattern creates an elevated exposure condition because the action that starts the run may not be the same as the content that shapes it. The agent may process free-text fields, attachments, comments, descriptions, or uploaded records as task context, even where that content was supplied by an external or low-trust submitter.
The primary risk is delayed execution of injected content. A malicious instruction may be planted in a frontend field or submitted record, then executed later when an internal employee opens, reviews, routes, or processes the item. The run may execute under the application, workflow, or employee identity, while the effective instruction came from the external submitter.
Investigators should review the trigger action, submitted fields, attachments, record history, user identity, workflow permissions, agent run logs, tool calls, and downstream actions. Particular attention should be given to free-text fields, externally supplied content, and cases where an internal user triggered processing of a record created or modified by someone else.
Investigative RelevanceUser action triggers are relevant because they allow external or low-trust content to influence an agent run through normal application behavior. The employee may appear to have initiated the run, but the instruction path may originate in submitted data.
This sub-section is especially relevant where agents process web forms, customer relationship management records, support tickets, uploaded files, comments, case notes, lead forms, application records, or other frontend-supplied content. |
| DR005.002 | Webhook Event Trigger | A webhook event trigger occurs when an inbound event from another system automatically starts an agent run. This may include a new ticket, inbound email, status callback, chat application event, customer relationship management update, or other webhook-driven workflow.
This deployment pattern creates an elevated exposure condition because the agent may run without a human reviewing the event first. The event payload may contain free text, metadata, links, attachments, or structured fields that the synthetic subject treats as task context.
The primary risk is attacker-shaped event input. Public or weakly authenticated endpoints may allow an external actor to forge, replay, or manipulate event payloads. A single malicious event may then trigger downstream actions, such as ticket routing, message generation, record updates, external calls, or tool execution, before anyone notices.
Investigators should review the event source, webhook authentication, payload content, replay protections, trigger rules, agent run logs, tool calls, downstream actions, and output destinations. Particular attention should be given to forged or repeated events, unusual payload fields, newly observed sources, and actions that exceed the normal event workflow.
Investigative RelevanceWebhook event triggers are relevant because they allow external or third-party system events to initiate agent behavior without direct human oversight. The workflow may appear routine, while the effective instruction is carried in the event payload.
This sub-section is especially relevant where agents process inbound webhooks, status callbacks, chat events, ticket events, email events, customer updates, integration messages, or other automated triggers from public, partner, or weakly trusted systems. |
| DR005.003 | Batch Processing Trigger | A batch processing trigger occurs when an agent or model processes queued rows, files, records, or items in a scheduled data pipeline. This may include Extract, Transform, Load (ETL) jobs, bulk classification runs, document processing queues, ticket enrichment, record summarization, or scheduled workflow automation.
This deployment pattern creates an elevated exposure condition because each item is processed without per-item human review. A single poisoned row, file, record, or queued item may enter the model’s context and influence the run while appearing to be ordinary batch input.
The primary risk is hidden manipulation inside routine throughput. Because the run is bulk and scheduled, a tampered item may be difficult to distinguish from normal processing. If the agent has broad pipeline permissions, one poisoned record may trigger outputs, updates, classifications, external calls, or downstream actions across the job’s full data scope.
Investigators should review the pipeline directive, schedule, input queue, source records, transformation logs, model outputs, tool calls, downstream writes, error handling, and affected data scope. Particular attention should be given to anomalous individual records, repeated harmful outputs across a backlog, externally sourced rows or files, and changes that occurred without per-item approval.
Investigative RelevanceBatch processing triggers are relevant because they allow a synthetic subject to act across many records at machine speed with limited human visibility. A harmful instruction or manipulated input may be hidden inside otherwise normal pipeline activity. |
| CF011.002 | Cross-Boundary Agent Collaboration | Cross-boundary agent collaboration occurs when peer agents owned by different teams, vendors, tenants, or organizations call each other over shared protocols or integrations. Each agent may treat the other’s output as both useful input and trusted instruction.
This deployment pattern creates an elevated exposure condition because trust is extended across boundaries that no single human subject could normally span. An instruction, recommendation, file, record, or tool result produced in one environment may be accepted and acted on inside another.
The primary risk is boundary-crossing instruction propagation. A malicious or injected instruction may move from one agent to another and influence actions outside the original trust zone. Internal confidential information, customer data, intellectual property, or regulated records may also pass to another agent, vendor, tenant, or organization without human awareness, creating legal, contractual, regulatory, or confidentiality exposure.
A related risk is weakened attribution. Logs may show only local agent activity rather than the external agent, source content, or original instruction that caused it. This can make origin, authorization, data movement, and responsibility difficult to reconstruct.
Investigators should review the agents’ directives, inter-agent protocols, trust relationships, authentication model, message provenance, shared context, tool outputs, data tags, and cross-boundary logs. Particular attention should be given to new collaboration paths, externally originated instructions, data appearing outside its authorized trust zone, and actions that cannot be traced to an approved source.
Investigative RelevanceCross-boundary agent collaboration is relevant because it allows synthetic subjects to extend trust and action across teams, vendors, tenants, or organizations. A harmful instruction or sensitive data transfer may propagate through legitimate collaboration paths while appearing to each receiving agent as authorized input. |
| CF011.003 | Inter-Agent Context Propagation | Inter-agent context propagation occurs when an orchestrated AI system is configured to pass one synthetic subject’s output into another synthetic subject’s context. This may occur through inter-agent messages, delegated task records, summaries, shared memory, generated work products, workflow state, tool outputs, or orchestration-layer handoffs.
This configuration creates an elevated exposure condition because model-visible context can move across agents, roles, tools, and trust boundaries. A receiving synthetic subject may rely on inherited context without knowing its original source, trust level, or integrity.
The primary risk is unvalidated context transfer. Content first processed by a low-trust or attacker-influenced synthetic subject may be reformatted, summarized, copied, or embedded into another agent’s task context. As the context moves through the system, its original provenance may become less visible while its ability to influence downstream behavior increases.
A related risk is capability amplification through delegation. A synthetic subject with limited access may pass inherited context to a tool-equipped worker, privileged agent, or downstream workflow with greater operational reach. The downstream synthetic subject may then act on that context as if it came from the orchestrator, an approved task record, or another trusted system component.
Investigators should review the agent graph, context-sharing configuration, delegation paths, inter-agent message formats, shared memory stores, task handoff records, summarization steps, tool-output routing, provenance tags, and trust-boundary controls. Particular attention should be given to context copied between agents, missing source attribution, inherited instructions, repeated unusual text appearing across agents, and downstream actions that trace back to propagated context rather than an approved operator objective.
Investigative RelevanceInter-agent context propagation is relevant because context-sharing is a design decision that defines how synthetic subjects influence each other. In an orchestrated system, the risk is not only what an individual agent can access, but what context it can pass to other agents with different permissions, tools, or responsibilities.
This sub-section is especially relevant where agents summarize each other’s work, pass task instructions, share memory, consume generated records, exchange tool outputs, or delegate actions to tool-equipped workers without enforcing provenance, trust-level separation, and integrity checks. |
| CF012.003 | Shared-Tenant AI Service | Cross-tenant content injection occurs when content authored in one tenant, organization, or external customer environment is processed by an embedded artificial intelligence feature in another. This may occur through shared Software as a Service (SaaS) platforms, customer relationship management records, support tickets, shared documents, partner portals, email threads, comments, or other collaborative surfaces.
This deployment pattern creates an elevated exposure condition because a malicious actor does not need direct access to the victim’s tenant or agent. They only need to place content into a shared surface that the embedded synthetic subject later reads, summarizes, classifies, routes, or acts upon.
The primary risk is cross-boundary instruction execution. A malicious instruction may travel as ordinary business content from one party to another, then execute when the receiving party’s embedded agent processes it. The resulting action may occur under the victim organization’s SaaS tenant, service identity, or employee workflow, even though the effective instruction originated externally.
A related risk is attribution failure. The malicious payload and the executing agent belong to different parties, while the shared SaaS provider may only see normal platform activity. Victim logs may show the agent processing a legitimate record, and vendor logs may show permitted tenant behavior, making origin, authorization, and responsibility difficult to establish.
A further risk is shared-service data exposure. Where the vendor uses a shared artificial intelligence service across multiple customers, confidential data submitted by one customer may be processed, indexed, retained, or reused in a way that affects another customer’s environment. This can expose proprietary information, customer data, regulated records, or privileged material through generated answers, shared context, model memory, retrieval results, telemetry, or vendor-managed integrations.
Investigators should review the shared SaaS surface, source tenant or external origin, record history, embedded content, agent processing logs, tenant audit records, vendor logs, downstream actions, and shared-service data handling. Particular attention should be given to externally authored fields, cross-tenant records, shared documents, support tickets, partner inputs, unexpected tenant-to-tenant data exposure, and actions triggered without direct authentication by the external originator.
Investigative RelevanceCross-tenant content injection is relevant because it allows an external party to influence a synthetic subject through ordinary shared business content. Standard authentication may not prevent the attack because the injected instruction enters through a legitimate collaboration or customer channel.
This sub-section is especially relevant where embedded artificial intelligence features process records, tickets, documents, forms, comments, emails, or other content that crosses tenant, vendor, customer, partner, or organizational boundaries. It is also relevant where vendor-hosted artificial intelligence services process confidential data from multiple customers through shared infrastructure, shared retrieval systems, shared model services, or vendor-managed integrations. |
| IV004.003 | MCP Tool-Output Invocation | MCP tool-output invocation occurs when output returned by a Model Context Protocol (MCP) tool causes a synthetic subject to act. MCP is an integration pattern that allows a synthetic subject to discover and use external tools, data sources, and actions through a structured interface.
This invocation occurs after a tool call, when the tool result is returned to the synthetic subject’s context. The output may contain ordinary data, but it may also contain instruction-bearing content that causes the synthetic subject to call another tool, disclose information, alter its plan, or continue a workflow in an unsafe direction.
The primary risk is tool-returned instruction execution. A compromised, malicious, or attacker-influenced MCP tool may return content that the synthetic subject treats as a command rather than as data. This is especially significant where the tool processes web pages, files, tickets, customer records, repository content, database results, or other low-trust sources.
Investigators should review raw tool outputs, tool-call logs, returned content, subsequent tool calls, prompt and response records, and downstream actions. Particular attention should be given to instructions embedded in tool results, external content returned by tools, repeated tool-call chains, and actions that began only after a specific tool output entered context.
Investigative RelevanceMCP tool-output invocation is relevant because tool results can become an instruction source after the operator has already approved or initiated a tool call. The investigation must determine whether the synthetic subject acted on the requested tool result or on instructions embedded inside that result.
This sub-section is especially relevant where MCP tools retrieve webpages, read files, query databases, summarize tickets, inspect repositories, fetch external resources, or return model-visible text from untrusted or mixed-trust sources. |
| IV004.004 | MCP Resource Content Invocation | MCP resource content invocation occurs when content exposed through an MCP resource causes a synthetic subject to act. MCP resources allow servers to expose contextual data, such as files, documents, records, repository content, logs, or other readable material, to the client and model context.
This invocation creates an elevated exposure condition because resource content may be treated as task-relevant context while also carrying embedded instructions. A resource may appear to be a document, file, record, or data object, but contain prompt-like text that directs the synthetic subject to ignore rules, call tools, disclose information, or change behavior.
The primary risk is resource-borne instruction execution. A malicious or low-trust resource may be read as data, but used by the synthetic subject as an instruction source. This is especially significant where MCP resources expose external files, shared folders, repository content, user-submitted records, logs, or other material that may be modified by untrusted parties.
Investigators should review MCP resource reads, raw resource content, source provenance, access permissions, retrieved records, prompt and response logs, and actions following resource access. Particular attention should be given to instruction-like text in resources, hidden or obfuscated content, externally writable resources, and actions that follow resource reads rather than operator prompts.
Investigative RelevanceMCP resource content invocation is relevant because resources can introduce instructions through a data channel rather than a tool description or direct prompt. The synthetic subject may appear to be reading context, while the effective instruction is embedded inside that context.
This sub-section is especially relevant where MCP servers expose filesystems, repositories, documentation stores, ticket systems, customer records, logs, emails, or other resources that may include untrusted or externally influenced content. |
| AO001.006 | Cross-Boundary Data Disclosure | Cross-boundary data disclosure occurs when a synthetic subject causes protected information to move outside its authorized user, tenant, customer, vendor, organizational, or trust boundary. The data may remain inside a platform or service, but still be exposed to a party, account, agent, tenant, workflow, or organization that is not authorized to receive it.
This adverse outcome creates organizational harm because boundary controls define who may access protected information. A synthetic subject may summarize, retrieve, infer, route, or disclose data across boundaries that would normally be separated by identity, tenant, role, customer, vendor, department, legal entity, or contractual control.
The primary harm is unauthorized cross-boundary exposure. Protected information belonging to one user, customer, tenant, team, or organization may appear in another user’s output, another customer’s record, another tenant’s workflow, a vendor-accessible context, or a shared agent environment.
A related harm is loss of data sovereignty and accountability. The disclosure may occur through shared indexes, cross-tenant SaaS workflows, vendor-hosted AI features, shared memory, collaboration records, support tickets, or agent-to-agent handoffs. Investigators may need to determine which boundary was crossed, what data moved, who received it, and whether the disclosure violated access policy, contractual terms, privacy obligations, or regulatory requirements.
Investigators should review tenant logs, user entitlements, retrieval records, shared indexes, connector access, vendor audit logs, support records, memory stores, agent handoff records, prompt and response logs, and downstream recipients. Particular attention should be given to data from one customer, tenant, user, or organization appearing in another boundary’s output, record, workflow, or agent context.
Investigative RelevanceCross-boundary data disclosure is relevant because synthetic subjects may combine data across users, tenants, systems, and organizations in ways traditional access controls were not designed to observe. The harmful outcome is not only that data was disclosed externally, but that it crossed an authorization boundary.
This sub-section is especially relevant where synthetic subjects operate in shared-tenant platforms, vendor-hosted AI services, customer relationship management systems, support tools, shared memory stores, enterprise retrieval indexes, collaboration platforms, or agent-to-agent workflows. |