Databricks Data Engineer Associate Question 43
Single answerYou are a data engineer managing a Databricks cluster that is running a batch job. The job has just completed successfully, but the cluster is still running. What happens if you manually terminate the cluster, and what are the impacts of this action?
- A
All active Spark jobs on the cluster will be terminated, and the cluster will no longer incur any costs.
- B
The cluster will be permanently deleted, and you must recreate it manually if needed in the future.
- C
The cluster's state, including metadata and logs, will be saved for later inspection.
- D
Terminating the cluster will prevent any future scheduled jobs from running on it, but it will restart automatically when needed.
Show answer and explanation
Correct answer: A
Explanation
Terminating a cluster in Databricks stops all active Spark jobs, releases resources, and ensures that the cluster no longer incurs costs. This is a standard operation for managing and optimizing cloud costs. However, it does not permanently delete the cluster configuration, and it does not allow automatic restarts unless explicitly set up. Understanding the impact of cluster termination is critical for resource and cost management in Databricks.
- A. Correct.
Correct: When you terminate a Databricks cluster, all active Spark jobs running on the cluster are stopped, and the cluster stops incurring costs. This is the expected behavior of cluster termination.
- B. Incorrect.
Incorrect: Terminating a cluster does not permanently delete it. You can restart terminated clusters, provided they are not ephemeral jobs-only clusters.
- C. Incorrect.
Incorrect: While some metadata and logs may be retained, this is not the primary impact of terminating a cluster. The core impact is the stopping of jobs and cost savings.
- D. Incorrect.
Incorrect: Terminating a cluster stops it completely; it does not automatically restart for future jobs unless explicitly configured to do so (e.g., with auto-scaling or job clusters).