NCP-AII Question 134
Select 3You are tasked with running multiple AI workloads with different resource requirements on an NVIDIA A100 GPU in a data center environment. To ensure efficient resource utilization, you decide to configure MIG (Multi-Instance GPU). Which of the following steps are required to successfully configure and allocate MIG instances on the A100 GPU?
- A
Enable MIG mode on the GPU using the NVIDIA System Management Interface (nvidia-smi).
- B
Restart the GPU system after enabling MIG mode to apply the changes.
- C
Use nvidia-smi to create GPU instances of varying sizes based on workload requirements.
- D
Configure the MIG instances directly in the workload application without using nvidia-smi.
- E
Ensure the GPU driver and CUDA version installed on the system support MIG.
Show answer and explanation
Correct answers: A, C, E
Explanation
To configure MIG on an NVIDIA A100 GPU, you must first enable MIG mode using the nvidia-smi tool. Then, GPU instances are created using nvidia-smi commands, allowing you to allocate resources for AI workloads. Additionally, the system must have a compatible GPU driver and CUDA version to support MIG. Restarting the GPU system is not necessary, and MIG configuration cannot be done directly within applications.
- A. Correct.
Correct: Enabling MIG mode on the GPU is the first step in configuring MIG. This can be done using the nvidia-smi tool.
- B. Incorrect.
Incorrect: Restarting the GPU system is not required after enabling MIG mode. The changes take effect without a system restart.
- C. Correct.
Correct: After enabling MIG mode, you need to create GPU instances of specific sizes using nvidia-smi commands.
- D. Incorrect.
Incorrect: MIG instances cannot be configured directly in the workload application. They must be set up at the GPU level using nvidia-smi or other system tools.
- E. Correct.
Correct: MIG functionality requires a compatible GPU driver and CUDA version. Without proper support, MIG cannot be used effectively.