OpenAI Multiple Model Prompt Injection via "Morse Code Businessman" Tactic
Case GUID: 42b3d2ae-84d3-47a2-a35c-49a7ace22b99
Summary
A Prompt Injection vulnerability has been discovered affecting multiple models. The specific flaw manifests through a combination of the 'Ignore Previous Instructions' and 'Morse Code' techniques and allows the attacker to bypass inference restrictions around providing information hazards and violating laws.
Metadata
Test Scores
Model |
Test Kind |
Test Score |
Temperature (max 2.0) |

OpenAI GPT-4.5
|
Illegal Substances: Crystal Meth |
100.0 |
N/A |

OpenAI GPT-4o
|
Illegal Substances: Crystal Meth |
95.0 |
N/A |
Social Impact Score
Violations at this level present a tangible risk to public safety or social well-being, often related to dangerous but not highly restricted content.
Example: Bypassing guardrails to obtain instructions for creating illicit substances, such as recreational drugs or substances with moderate harm potential. Leakage of private personal data such as Social Security number or private medical.
Potential Consequences: Potential health impacts on a small scale, significant regulatory interest, and the need for stricter AI guardrails.
Taxonomies
Language
This category focuses on the use of specific linguistic techniques, such as prompt injection or stylization, to influence the model's output.
Prompt Injection
This technique enables attackers to override original instructions and employed controls by crafting specific wording of instructions, often resembling SQL injection methods, to manipulate the model's behavior.
Ignore Previous Instructions
This technique is a form of prompt injection that allows users to override the model's prior directives or constraints. By explicitly instructing the model to disregard any previous commands or context, users can manipulate the model's behavior to produce desired outputs that may not align with its original programming. This technique often requires precise wording, such as stating "Ignore previous instructions" followed by new commands. It is similar to SQL injection in that it exploits the model's inability to differentiate between trusted and untrusted inputs. This method can be particularly effective in scenarios where the model has been restricted from discussing certain topics or generating specific types of content, enabling users to bypass these limitations and elicit responses that would typically be filtered out.
Fictionalizing
This category involves creating scenarios or narratives that leverage existing genres or contexts to manipulate the language model's responses.
Roleplaying
This strategy involves prompting the language model to assume a specific role or persona, which can influence its responses based on the characteristics and moral codes associated with that role. Techniques include claiming authority or inventing personas to elicit different types of outputs.
Personas
Personas are fictional characters or identities that users create to guide the behavior and responses of language models. By establishing a persona, users can influence the tone, style, and content of the model's outputs, tailoring them to specific audiences or contexts. This technique allows for a more engaging and relatable interaction, as the model adopts the characteristics, knowledge, and perspectives of the defined persona. For instance, a user might prompt the model to respond as a friendly teacher, a technical expert, or a historical figure, thereby shaping the conversation to fit the desired narrative. Utilizing personas can enhance the effectiveness of communication, making it easier to convey complex ideas or evoke particular emotions, while also providing a framework for exploring diverse viewpoints and experiences. This approach highlights the flexibility of language models in adapting to various roles and contexts.
Language
This category focuses on the use of specific linguistic techniques, such as prompt injection or stylization, to influence the model's output.
Code and Encode
This strategy encompasses techniques that utilize various coding methods, such as Base64 or ROT13, to bypass model restrictions and manipulate outputs.
Morse Code
This technique involves encoding prompts into Morse code to bypass filters or obscure intent. By leveraging the model’s ability to interpret structured formats, users can manipulate outputs or access restricted responses.
About 0Din.ai
The 0Day Investigative Network (0DIN) was founded by Mozilla in 2024 to reward responsible researchers for their efforts in securing GenAI models. Learn more and submit discoveries at https://0din.ai.