Databricks Data Engineer Associate Question 370
Select 2You are building a data pipeline in Databricks using Delta Live Tables (DLT). As part of the configuration, you need to define a target and use a notebook library. What is the purpose of the target and the notebook library in this context?
- A
The target specifies where the transformed data will be stored.
- B
The target defines the cluster configuration for the pipeline execution.
- C
The notebook library contains the transformation logic and table definitions for the pipeline.
- D
The notebook library is used to configure the permissions for the pipeline.
- E
The target stores the metadata and logs of the pipeline execution.
Show answer and explanation
Correct answers: A, C
Explanation
In Databricks Delta Live Tables, the target specifies the destination where the final transformed data will be saved, such as a database or a directory. The notebook library is essential because it contains the code that defines the pipeline's transformation logic and table definitions. Understanding these components ensures proper configuration and execution of DLT pipelines.
- A. Correct.
Correct: The target defines the storage location (such as a database or a directory) where the transformed or output data from the pipeline will be stored.
- B. Incorrect.
Incorrect: The target does not configure the cluster for the pipeline. Cluster configuration is managed separately in the pipeline settings.
- C. Correct.
Correct: The notebook library contains the code (written in Python or SQL) that defines the transformations and tables needed for the pipeline.
- D. Incorrect.
Incorrect: The notebook library does not handle permissions. Pipeline permissions are managed through workspace access control settings.
- E. Incorrect.
Incorrect: The target does not store metadata or logs. Metadata and logs are stored in the pipeline storage location, which is configured separately.