[KongchangAI]
Benchmark

MobileInject

The first evaluation benchmark targeting multimodal injection attacks and reasoning-to-action security risks for mobile agents. It provides a high-fidelity interactive mobile environment containing multiple scenario categories, security risk categories, and executable risk instances.

Timeline (last 90 days)

Oct 19

MobileInject is the first evaluation benchmark targeting multimodal injection attacks and 'reasoning-to-action' security risks in mobile agents.

Unverified50%
Oct 19

MobileInject provides a high-fidelity interactive mobile evaluation environment containing 11 scenario categories, 9 security risk categories and 108 executable risk instances.

Unverified50%
Oct 19

MobileInject proposes Cross-Modal Consistency Injection, whose core idea is to have malicious instructions corroborate each other across multiple modalities to lower the agent's vigilance.

Unverified50%
Oct 19

MobileInject's accompanying Reasoning Security Diagnosis Framework is used to perform fine-grained attribution of failure cases, determining whether the problem lies in perception, reasoning or action.

Unverified50%
Oct 19

Systematic experiments show that mobile agents are generally vulnerable to multimodal injection attacks, and that a large number of failures stem from hijacking early in reasoning rather than the final click action.

Unverified50%
Oct 19

Information on the release of MobileInject code is given in the open science section of the paper's appendix.

Unverified50%

All Facts (6)

Source Articles