Databricks Data Engineer Associate Question 363
Select 4You are tasked with creating a new Delta Live Tables (DLT) pipeline in Databricks. Which of the following components must you configure to successfully create the pipeline?
- A
A JSON or Python notebook defining the data transformations
- B
A storage location for the pipeline results and metadata
- C
Cluster policies to enforce instance size and runtime constraints
- D
A target schema where the resulting tables will be stored
- E
A schedule to define the pipeline's execution frequency
- F
A list of users authorized to access the pipeline
Show answer and explanation
Correct answers: A, B, D, E
Explanation
Creating a new DLT pipeline requires a notebook or script for transformation logic, a storage location for metadata and results, a target schema for output tables, and a schedule for execution frequency. These are the key components to configure when setting up a DLT pipeline. Additional elements like cluster policies or user permissions, while useful, are not mandatory for pipeline creation.
- A. Correct.
Correct: You need a JSON or Python notebook to define the DLT pipeline logic and transformations.
- B. Correct.
Correct: A storage location is required to store the pipeline's output and operational metadata.
- C. Incorrect.
Incorrect: Cluster policies are not mandatory for creating a DLT pipeline, though they can be used for governance purposes.
- D. Correct.
Correct: A target schema is necessary to specify where the pipeline should publish the resulting tables.
- E. Correct.
Correct: A schedule is required to determine how often the DLT pipeline runs, especially for batch processing.
- F. Incorrect.
Incorrect: While user permissions are important for security, a list of authorized users is not a mandatory component for creating a pipeline.