Databricks Generative AI Engineer Associate exam dumps

Databricks Generative AI Engineer Associate practice question 280 of 306

Databricks Certified Generative AI Engineer Associate. Free level, Databricks. Free question with the correct answer and a full explanation.

Databricks Generative AI Engineer Associate Question 280

Single answer

You are tasked with selecting a Large Language Model (LLM) for a customer support chatbot that must handle thousands of daily queries with high accuracy and fast response times. The evaluation metrics provided include latency (lower is better), accuracy on domain-specific tasks (higher is better), and memory footprint (lower is better). Given the following quantitative evaluations for four LLMs, which one should you choose?

  1. Model A: Latency = 200ms, Accuracy = 85%, Memory Footprint = 8GB
  2. Model B: Latency = 150ms, Accuracy = 75%, Memory Footprint = 5GB
  3. Model C: Latency = 250ms, Accuracy = 90%, Memory Footprint = 10GB
  4. Model D: Latency = 180ms, Accuracy = 88%, Memory Footprint = 6GB
  1. A

    Model A

  2. B

    Model B

  3. C

    Model C

  4. D

    Model D

Show answer and explanation

Correct answer: D

Explanation

Model D is the best choice because it balances the key metrics of latency, accuracy, and memory footprint. While other models excel in some metrics, they fall short in others. Model D provides high accuracy (88%) while maintaining low latency (180ms) and a reasonable memory footprint (6GB), making it ideal for a customer support chatbot that requires fast, accurate, and resource-efficient responses.

  • A. Incorrect.

    Model A has good accuracy (85%) and a moderate memory footprint (8GB), but its latency of 200ms is higher than other options, making it less optimal for fast response times.

  • B. Incorrect.

    Model B has the lowest latency (150ms) and memory footprint (5GB), but its accuracy (75%) is significantly lower than the others, which makes it unsuitable for high-accuracy requirements.

  • C. Incorrect.

    Model C offers the highest accuracy (90%) but has the highest latency (250ms) and memory footprint (10GB), making it unsuitable for the requirement of fast responses and low resource usage.

  • D. Correct.

    Model D strikes a balance with low latency (180ms), high accuracy (88%), and a reasonable memory footprint (6GB), making it the best choice for the given requirements.

Timed practice exam

Take a Databricks Generative AI Engineer Associate practice test under exam conditions

45 questions in 90 minutes, drawn from this bank, with a score report and a per-question review when you finish.

Start timed exam

More Databricks Generative AI Engineer Associate practice questions

  1. 281.Your team is tasked with selecting an appropriate large language model (LLM) for a customer support...
  2. 282.You are deploying a large language model (LLM) to power a customer support chatbot. The chatbot is...
  3. 283.You are deploying a large language model (LLM) in a customer support chatbot application. The...
  4. 284.You are deploying a large language model (LLM) for a customer support chatbot in a production...
  5. 285.You are deploying a large language model (LLM) for a customer support chatbot designed to handle...
Back to the Databricks Generative AI Engineer Associate exam dumps