AIF-C01 Question 132
Select 4A company is using an AI model powered by prompt engineering to automate customer support. However, they notice that with certain crafted inputs, users can manipulate the model to generate harmful or inappropriate outputs. What are the potential risks associated with this scenario?
- A
Exposure of sensitive or confidential information
- B
Model hijacking to execute unintended tasks
- C
Increased latency in response time due to model overload
- D
Jailbreaking to bypass safety constraints
- E
Model poisoning to degrade overall performance
Show answer and explanation
Correct answers: A, B, D, E
Explanation
The scenario highlights multiple risks of prompt engineering, including exposure of sensitive data, hijacking of the model for unintended tasks, jailbreaking to override safety constraints, and poisoning to degrade performance. These are all critical considerations when implementing AI systems to ensure security and integrity.
- A. Correct.
Exposure of sensitive or confidential information can occur if prompt engineering unintentionally elicits responses that reveal private or proprietary data.
- B. Correct.
Model hijacking refers to exploiting the prompt to make the model perform tasks outside its intended scope, which aligns with the described scenario.
- C. Incorrect.
Increased latency in response time is typically related to infrastructure or performance issues, not directly linked to the risks of prompt engineering.
- D. Correct.
Jailbreaking happens when users craft prompts to bypass the AI model's safety mechanisms, leading to harmful or unintended outputs.
- E. Correct.
Model poisoning involves introducing malicious inputs that degrade the model's performance or behavior over time.