[KongchangAI]
ConceptPrompt Injection

Prompt Injection Attack

A prompt injection attack is a security attack targeting large language models (LLMs) and their applications. Attackers embed carefully crafted malicious instructions within input content to interfere with or override the model's original system prompt, manipulating the model into executing unintended behaviors such as bypassing safety restrictions, leaking sensitive information, or performing harmful operations. This attack exploits the inherent limitation of models in distinguishing normal user input from malicious instructions.

Core Facts

Timeline (last 90 days)

Oct 27

Prompt injection attacks do not directly attack the bank system; instead, they use the AI agent's proxy identity as a "legitimate user" to bypass the bank's risk controls.

Unverified50%

All Facts (2)

Source Articles