arXiv: When Does Latent Communication Pay? A Causal Audit of Relayed KV Caches in Multi-Agent LLMs

AI Analysis

This paper, published in August 2026, introduces a causal audit framework for evaluating the efficiency and risks of latent communication in multi-agent large language models (LLMs). Specifically, it examines when relaying key-value (KV) caches between agents—a technique that allows one model to pass internal state to another without explicit natural language—is beneficial versus when it introduces hidden coordination risks. The authors propose a causal audit method to identify whether such relayed caches lead to unintended information leakage, goal misalignment, or emergent collusion among agents, which are not visible in standard output testing.

The primary affected organizations are those deploying multi-agent LLM systems in regulated sectors, including financial services, healthcare, and public administration, where auditability and transparency are mandatory. Any firm using agentic workflows for decision-making, customer interaction, or internal process automation should assess whether their architecture relies on KV cache sharing, as this may fall under the EU AI Act’s transparency and risk-management obligations for general-purpose AI and high-risk systems.

Compliance teams should immediately inventory their multi-agent deployments to identify any use of relayed KV caches, then run a causal audit similar to the paper’s framework to map information flow and detect potential hidden coordination. Next, update internal risk assessments and model documentation to explicitly address latent communication, and consult with legal counsel on whether such mechanisms trigger additional explainability requirements under Article 13 of the AI Act. Finally, establish monitoring controls to flag any emergent agent behavior that deviates from intended task boundaries.