Results 1221 - 1230 of 24716

I’ll present the privacy architecture we designed for W3C’s Attribution API, the privacy-preserving ad-measurement standard being developed with participation from all major browsers. The API replaces backend tracking with on-device measurement and differentially private aggregation, grounded in individual differential privacy (IDP), which enables strong per-user guarantees and critical data-dependent optimizations. I’ll describe two systems that make this architecture practical: Cookie Monster, which introduced efficient on-device IDP budgeting and formed the basis of the W3C draft; and Big Bird, which extends it with principled defenses against adversarial privacy-budget depletion and is now being incorporated into the standard. I’ll conclude with open research challenges and why increased engagement from the research community is essential for these standards to deliver real-world privacy.

Today, data sharing is the cornerstone of many modern applications. A common concern in such data sharing pipelines is privacy: organizations are responsible for protecting the privacy of their data, whether it represents user data or enterprise trade secrets. In this talk, we will discuss emerging challenges related to learning large machine learning models from private, federated data. Existing approaches (namely, differentially-private federated learning, DP-FL) involve training models on client devices and are difficult to scale to large models. We will explore the feasibility of replacing DP-FL with centralized training over differentially private synthetic data. We will show that finetuning a model on DP synthetic data can perform similarly to DP-FL in downstream model performance, with order(s)-of-magnitude lower communication and computation. We will also demonstrate conditions under which synthetic data is theoretically guaranteed to approach they underlying private data distribution.

Understanding real-world usage is critical for improving Generative AI, but analyzing this data risks exposing sensitive user inputs. While platforms use "privacy-aware" heuristics like PII redaction and clustering to mitigate this, are these protections actually secure? First, we put these claims to the test by introducing CLIOPATRA, the first successful privacy attack against Anthropic's CLIO. We demonstrate how an adversary can insert malicious chats to systematically bypass layered protections and leak sensitive data. Evaluated against synthetic medical chats, CLIOPATRA proves that knowing just basic demographics and a single symptom allows an attacker to extract a target’s full medical history up to 100% of the time—showing that ad-hoc, heuristic mitigations are fundamentally unreliable. If heuristics fail, how can developers safely extract insights? To answer this, we introduce Provably Private Insights (PPI), a novel framework that abandons heuristics in favor of mathematically guaranteed privacy. PPI bridges the gap between raw data and analytics by integrating Trusted Execution Environments (TEEs) for external verifiability, "Data Expert" LLMs operating within secure enclaves, and Differential Privacy (DP) for anonymous aggregation. By walking through PPI’s open-source architecture and its real-world deployment in Google's Android Recorder app, this talk demonstrates the practicality of provably private AI analytics at scale.

We examine how privacy must evolve as AI systems become increasingly agentic and operate across diverse tasks, tools, and information flows. I will highlight two research directions: using reinforcement learning to instill contextual integrity in agents, and using agentic systems to synthesize new privacy-preserving algorithms on the fly. Together, these point toward a scalable view of privacy that is both context-sensitive at deployment time and adaptive at the level of mechanism design.