AIF-C01 Question 117
Single answerYour team is building a chatbot using a foundation model to assist customers with product inquiries. You are considering customization approaches to optimize performance while managing costs. Which customization approach is most cost-effective if your primary goal is to minimize compute resources and training time, while still tailoring responses to your specific product catalog?
- A
Pre-training a new foundation model from scratch using your product catalog data.
- B
Fine-tuning an existing foundation model with your product-specific data.
- C
Using in-context learning by providing product-specific examples in the input prompts.
- D
Implementing a Retrieval-Augmented Generation (RAG) approach to fetch product-specific information from a knowledge base.
Show answer and explanation
Correct answer: C
Explanation
In-context learning is the most cost-effective approach when attempting to customize foundation models without incurring compute-intensive training costs. By providing product-specific examples in the input prompts, the model can be tailored to specific needs without modifying its underlying parameters. Other approaches, such as pre-training or fine-tuning, involve significant compute and training time, while RAG introduces additional operational overhead.
- A. Incorrect.
Pre-training a new foundation model from scratch is highly expensive in terms of compute resources, data requirements, and time. This approach is unnecessary when existing models can be adapted more cost-effectively.
- B. Incorrect.
Fine-tuning an existing foundation model is cheaper than pre-training, but it still requires significant compute resources and can be costly compared to lighter-weight solutions like in-context learning.
- C. Correct.
In-context learning involves providing examples in the input prompt without modifying the model itself. This approach avoids training costs entirely, making it highly cost-effective for scenarios where minimal customization is needed.
- D. Incorrect.
While RAG is cost-effective for dynamically retrieving information, it requires setting up and managing an external knowledge base, which may introduce additional operational costs and complexities compared to in-context learning.