Databricks Data Engineer Associate Question 41
Select 3A data engineering team is using a Databricks cluster to process a large batch job. After the job completes, the cluster is terminated. Which of the following outcomes should the team expect after the cluster is terminated?
- A
All cached data on the cluster will be lost.
- B
The cluster's configuration will be permanently deleted.
- C
The job's execution logs will still be accessible.
- D
All notebooks attached to the cluster will be deleted.
- E
The cluster's associated metadata will be retained temporarily for debugging.
Show answer and explanation
Correct answers: A, C, E
Explanation
When a Databricks cluster is terminated, the compute resources are deallocated, leading to the loss of cached data. However, job execution logs and some metadata are retained temporarily for debugging purposes. The cluster configuration and notebooks are unaffected by termination, as they are stored separately in the Databricks environment.
- A. Correct.
Correct: When a cluster is terminated, all cached or in-memory data on the cluster is lost as the compute resources are deallocated.
- B. Incorrect.
Incorrect: The cluster's configuration is not permanently deleted upon termination; it can be reused to recreate the cluster if needed.
- C. Correct.
Correct: Job execution logs are retained even after the cluster is terminated, allowing users to review them for debugging or auditing purposes.
- D. Incorrect.
Incorrect: Notebooks attached to the cluster are not stored on the cluster itself; they remain available in the Databricks workspace and are unaffected by cluster termination.
- E. Correct.
Correct: Metadata associated with the cluster, such as job history and logs, is retained temporarily for debugging and auditing purposes.