NCA-GENM Question 138
Single answerYou are tasked with monitoring the functioning of a multimodal generative AI system being developed for creating video content based on textual descriptions. During the experimentation phase, you notice that the system is producing outputs with significant delays. What would be the most effective step to identify and resolve the issue?
- A
Check the GPU utilization and memory usage during the data generation process.
- B
Re-run the experiment using smaller input datasets to see if the delay persists.
- C
Focus exclusively on debugging the data collection script.
- D
Increase the number of training epochs to improve model accuracy.
Show answer and explanation
Correct answer: A
Explanation
Monitoring GPU utilization and memory usage is a critical step in identifying and resolving performance bottlenecks during the experimentation phase of generative AI systems. This approach allows you to determine whether the delays are caused by resource limitations, such as insufficient computational power or memory, and helps in making informed optimizations.
- A. Correct.
Monitoring GPU utilization and memory usage is essential for identifying bottlenecks in resource usage that might be causing delays.
- B. Incorrect.
While re-running experiments with smaller datasets can provide insights, it is not the most direct way to monitor the cause of significant delays.
- C. Incorrect.
Debugging the data collection script alone will not address delays caused by computational bottlenecks during the generation process.
- D. Incorrect.
Increasing the number of training epochs may improve model accuracy, but it is unrelated to resolving delays in model output generation.