#DP-SGD

Dummy-Point Differential Privacy: A New Privacy Amplification Mechanism Under Observable Batch Sizes

Addressing the problem of observable batch sizes and truncation increasing privacy loss in DP-SGD, this introduces a privacy amplification mechanism that injects random dummy points, privatizing batch sizes while preserving privacy guarantees in distributed settings, empirically outperforming truncation direct accounting.