DatabricksProfessional levelPage 3 of 4

Databricks Data Engineer Professional exam dumps: questions 201 to 300 of 312

Page 3 of the free Databricks Data Engineer Professional question bank for the Databricks Certified Data Engineer Professional exam. Questions 201 to 300 are listed below, the first 5 in full with answers and explanations. Back to page 1 for the exam overview and FAQ.

Question bank last updated January 2025

Free Databricks Data Engineer Professional practice questions

Questions 201 to 205 of 312

Pick an answer before you open the explanation. Each question also has its own page with a permalink.

Databricks Data Engineer Professional Question 201

Select 3

You are configuring a Databricks workspace for a financial services company that requires fine-grained access control to meet regulatory compliance. The organization wants to ensure that sensitive data is only accessible to authorized users and that all access is auditable. Which of the following configurations and features should you implement to meet these requirements?

  1. A

    Enable Unity Catalog and configure table permissions using attribute-based access control (ABAC).

  2. B

    Use cluster-scoped access control to restrict access to sensitive clusters.

  3. C

    Configure data masking policies in Unity Catalog to obfuscate sensitive data for unauthorized users.

  4. D

    Rely on workspace-level access controls only, as they provide sufficient security for sensitive data.

  5. E

    Enable audit logs in Unity Catalog to track data access and modifications.

Show answer and explanation

Correct answers: A, C, E

Explanation

To meet regulatory compliance for fine-grained access control and auditability, you should implement Unity Catalog, which supports granular data permissions through ABAC and data masking. Additionally, enabling audit logs ensures that all access and modifications to sensitive data are tracked. Workspace-level and cluster-scoped access controls alone are not sufficient to fulfill these requirements.

  • A. Correct.

    Correct: Unity Catalog provides fine-grained access control at the table, column, and row levels. Attribute-based access control (ABAC) is an advanced feature that enables dynamic access control based on user attributes.

  • B. Incorrect.

    Incorrect: Cluster-scoped access control restricts who can access and manage clusters but does not address fine-grained data access requirements for regulatory compliance.

  • C. Correct.

    Correct: Data masking in Unity Catalog allows sensitive data to be obfuscated for users without proper permissions, meeting the requirement for securing sensitive data.

  • D. Incorrect.

    Incorrect: Relying solely on workspace-level access controls is insufficient for regulatory compliance, as these controls do not provide the necessary granularity for data access management.

  • E. Correct.

    Correct: Enabling audit logs in Unity Catalog allows tracking of data access and modifications, ensuring compliance with regulatory requirements for auditable access.

Databricks Data Engineer Professional Question 202

Single answer

A data engineering team is tasked with securing sensitive data stored in a Databricks workspace. They want to limit access to specific tables based on user roles while ensuring auditability of access events. What is the most appropriate approach to achieve this in Databricks?

  1. A

    Implement table ACLs (Access Control Lists) in Unity Catalog and enable audit logging.

  2. B

    Use workspace object permissions to restrict access to Delta tables.

  3. C

    Encrypt the Delta tables using a custom encryption algorithm and distribute decryption keys to users.

  4. D

    Store sensitive data in plain text files in a private S3 bucket and manage access using AWS IAM policies.

Show answer and explanation

Correct answer: A

Explanation

Unity Catalog is the recommended solution for securing sensitive data in Databricks. It provides fine-grained access control through table ACLs, which allow permissions to be granted at the table, schema, or catalog level. Additionally, Unity Catalog supports audit logging, ensuring that access events can be tracked for compliance and governance purposes. Other approaches, such as workspace object permissions or custom encryption, either lack necessary functionality or introduce unnecessary complexity.

  • A. Correct.

    This is correct because Unity Catalog provides fine-grained access control via table ACLs, along with audit logging for tracking access events. This is the recommended approach for securing sensitive data in Databricks.

  • B. Incorrect.

    This is incorrect because workspace object permissions do not provide the fine-grained access control needed for table-level security. Additionally, they are not used for managing access to Delta tables specifically.

  • C. Incorrect.

    This is incorrect as custom encryption algorithms introduce complexity and potential security risks. Distributing decryption keys securely is also challenging and not aligned with Databricks' security best practices.

  • D. Incorrect.

    This is incorrect because storing sensitive data as plain text files lacks the necessary fine-grained access control. While AWS IAM policies can control access at the bucket level, they do not offer the table-level permissions or audit logging required for robust data governance.

Databricks Data Engineer Professional Question 203

Select 2

A data engineering team is tasked with setting up access control for a Databricks environment to ensure that only specific users can access and modify production data. They also need to ensure that audit logs are captured for compliance purposes. Which combination of actions should the team take to achieve these requirements?

  1. A

    Enable cluster-level access control and assign users to appropriate groups based on their roles.

  2. B

    Configure Table Access Control (TAC) and assign permissions using Databricks SQL grants.

  3. C

    Set up an external logging destination to capture Databricks audit logs for long-term storage.

  4. D

    Disable Personal Access Tokens (PATs) for all users to enhance security.

  5. E

    Configure Databricks Repos to enforce version control on production data.

Show answer and explanation

Correct answers: B, C

Explanation

To ensure proper access control, the team should use Table Access Control (TAC) to define permissions for production data. Additionally, configuring an external logging destination for audit logs satisfies the compliance requirement. Other options, while useful for security or workflow management, do not directly fulfill the requirements specified in the scenario.

  • A. Incorrect.

    Cluster-level access control manages who can use specific clusters but does not directly address data access control or audit logging, which are the requirements in this scenario.

  • B. Correct.

    Table Access Control (TAC) allows fine-grained permissions on tables and views, ensuring that only authorized users can access production data, making it essential for meeting the access control requirement.

  • C. Correct.

    Setting up an external logging destination ensures that audit logs are captured and stored securely for compliance purposes, addressing the requirement for audit logging.

  • D. Incorrect.

    Disabling Personal Access Tokens (PATs) can enhance security, but it is not directly related to the requirements of data access control or audit logging in this scenario.

  • E. Incorrect.

    Configuring Databricks Repos enforces version control but does not address data access control or audit logging requirements.

Databricks Data Engineer Professional Question 204

Select 3

A data engineering team is tasked with securing access to sensitive data stored in Delta tables. They need to ensure that only specific groups of users can read or write to the data while maintaining compliance with privacy regulations. Which of the following steps should the team take to implement secure access control in Databricks?

  1. A

    Configure table-level access permissions using Unity Catalog

  2. B

    Use Databricks secrets to store credentials and share them with all users

  3. C

    Set up fine-grained access control for Delta tables via SQL GRANT statements in Unity Catalog

  4. D

    Assign workspace-wide admin permissions to all team members to simplify access management

  5. E

    Enable column-level security to restrict access to sensitive columns in the Delta table

Show answer and explanation

Correct answers: A, C, E

Explanation

To secure access to sensitive data in Delta tables, the team should leverage Unity Catalog for table-level and column-level access controls, as well as use GRANT statements to define fine-grained permissions. These approaches ensure compliance with privacy regulations and follow best practices for data security, such as the principle of least privilege. Databricks secrets can be used for credential management but should not be shared broadly, and assigning admin permissions to all users poses significant security risks.

  • A. Correct.

    Correct. Unity Catalog provides table-level access controls, allowing you to define permissions for specific user groups or roles.

  • B. Incorrect.

    Incorrect. While Databricks secrets are useful for managing sensitive credentials, sharing them with all users compromises security and does not directly provide data access control.

  • C. Correct.

    Correct. Unity Catalog supports fine-grained access control via SQL GRANT statements, enabling precise control over who can access or modify data.

  • D. Incorrect.

    Incorrect. Assigning workspace-wide admin permissions to all team members is not a secure practice and violates the principle of least privilege.

  • E. Correct.

    Correct. Column-level security is a feature that allows you to restrict access to specific columns within a Delta table, ensuring sensitive data is not exposed unnecessarily.

Databricks Data Engineer Professional Question 205

Select 3

A data engineering team needs to create a dynamic view in Databricks to mask sensitive customer data such as Social Security Numbers (SSNs) based on the user's role. Users with the 'admin' role should see the full SSN, while others should see only the last four digits of the SSN with the rest of the digits masked. Which of the following approaches should the team use to implement this requirement?

  1. A

    Use a CASE statement in the view definition to conditionally display the masked or unmasked SSN based on the user's role.

  2. B

    Store the user roles and permissions in a table, and join it with the data table in the dynamic view to determine the appropriate masking logic.

  3. C

    Use Databricks secrets to store SSNs securely and dynamically retrieve them in the view for authorized users.

  4. D

    Grant SELECT permission on the dynamic view to specific users, and use Databricks ACLs to enforce data masking.

  5. E

    Leverage the is_member function within the view definition to check the user's group membership and apply masking logic.

Show answer and explanation

Correct answers: A, B, E

Explanation

Dynamic views in Databricks allow data masking by applying conditional logic within the view definition. Using a combination of the CASE statement, user role data, and the is_member function enables dynamic and scalable masking based on user roles or group memberships. Databricks secrets and ACLs are useful for other security purposes but are not directly applicable for implementing dynamic data masking in this scenario.

  • A. Correct.

    This is correct. A CASE statement can be used within the dynamic view to apply conditional logic to show masked or unmasked data based on user roles.

  • B. Correct.

    This is correct. Joining with a table containing user roles and permissions allows dynamic role-based decisions within the view, enabling appropriate masking.

  • C. Incorrect.

    This is incorrect. Databricks secrets are used for securely storing credentials, not for dynamically masking sensitive data in views.

  • D. Incorrect.

    This is incorrect. While ACLs can manage access at the table or view level, they do not handle row- or column-level masking logic within views.

  • E. Correct.

    This is correct. The is_member function is commonly used to check group membership and can be included in the view definition to dynamically apply masking logic.

Timed practice exam

Take a Databricks Data Engineer Professional practice test under exam conditions

60 questions in 120 minutes, drawn from this bank, with a score report and a per-question review when you finish.

Start timed exam

Databricks Data Engineer Professional practice questions 201 to 300 of 312

Every question has a page with the answer and explanation. Numbers are stable, so you can bookmark or share them. The bank is split into 4 pages of up to 100 questions.

  1. 201.You are configuring a Databricks workspace for a financial services company that requires fine-grained access...
  2. 202.A data engineering team is tasked with securing sensitive data stored in a Databricks workspace. They want to...
  3. 203.A data engineering team is tasked with setting up access control for a Databricks environment to ensure that...
  4. 204.A data engineering team is tasked with securing access to sensitive data stored in Delta tables. They need to...
  5. 205.A data engineering team needs to create a dynamic view in Databricks to mask sensitive customer data such as...
  6. 206.You are working on a Databricks project for a financial institution. The database contains a 'customers'...
  7. 207.A company is storing sensitive customer information, such as Social Security Numbers (SSNs), in a Delta...
  8. 208.A company wants to ensure that sensitive customer information, such as Social Security Numbers (SSNs), is...
  9. 209.A Databricks data engineer is tasked with creating a dynamic view to enforce data masking on a customer...
  10. 210.A company stores sensitive customer information in a Databricks Delta table, and they want to implement data...
  11. 211.You are tasked with implementing row and column-level security for a table containing employee data in...
  12. 212.A data engineering team at your company is tasked with implementing row-level security on a Delta table...
  13. 213.A company wants to control access to a Delta table containing employee records based on both user roles and...
  14. 214.You are tasked with creating a dynamic view in Databricks to restrict access to specific rows and columns in...
  15. 215.A company wants to restrict access to sensitive columns and rows in a Delta table containing employee data....
  16. 216.A company is using Databricks to manage sensitive customer data in a Delta table. The table contains columns...
  17. 217.You are working on a Databricks pipeline that processes streaming data from a Kafka source. The pipeline is...
  18. 218.A data engineering team is running a Databricks job that processes large volumes of data daily. They notice...
  19. 219.You are tasked with monitoring a Databricks job that processes large volumes of data and occasionally fails...
  20. 220.You are tasked with monitoring a production Databricks job that processes terabytes of data daily. The job...
  21. 221.You are tasked with monitoring a production Databricks job that processes a large volume of streaming data....
  22. 222.You have been tasked with monitoring a streaming job in Databricks that processes real-time data from a Kafka...
  23. 223.You are analyzing the performance of a Spark application using the Spark UI. Which of the following elements...
  24. 224.You are analyzing the performance of a Spark application using the Spark UI. Which of the following...
  25. 225.You are analyzing the performance of a slow-running Spark job in the Spark UI. Which elements of the Spark UI...
  26. 226.While debugging a slow-running Spark application, you decide to use the Spark UI for analysis. Which of the...
  27. 227.You are tasked with optimizing a Spark application that is running slowly. Upon inspecting the Spark UI, you...
  28. 228.You are debugging a slow-running Spark application in Databricks, and you decide to analyze the Spark UI....
  29. 229.You are troubleshooting the performance of a Spark job running on a Databricks cluster. The job seems to be...
  30. 230.While working on a Databricks cluster, you want to inspect the performance of a job that has already run. You...
  31. 231.While investigating the performance of a Spark job running on a Databricks cluster, you need to identify the...
  32. 232.You are a data engineer troubleshooting an ETL job running on a Databricks cluster. The job is taking longer...
  33. 233.You are troubleshooting a slow-performing Spark job on a Databricks cluster and want to analyze the event...
  34. 234.A data engineer is troubleshooting a slow-running job on a Databricks cluster. They decide to inspect the...
  35. 235.A data engineering team is running a Spark job on a Databricks cluster that processes a large volume of data...
  36. 236.A data engineering team is running a Spark job on Databricks that processes a large dataset. Users report...
  37. 237.You are analyzing a job in Databricks that is taking significantly longer than expected to complete. Upon...
  38. 238.You are debugging a Spark job that is running slowly on a Databricks cluster. Upon reviewing the Spark UI,...
  39. 239.You are analyzing a Spark application that is taking significantly longer to complete than expected. Upon...
  40. 240.You are troubleshooting a Spark job that is taking significantly longer than expected to complete. Upon...
  41. 241.A data engineering team manages a production streaming job in Databricks that processes real-time clickstream...
  42. 242.You are tasked with designing a production streaming job in Databricks to process high-velocity data from IoT...
  43. 243.You are designing a production streaming job in Databricks that processes real-time IoT sensor data from...
  44. 244.You are designing a production streaming job in Databricks to process real-time data with strict latency SLAs...
  45. 245.You are tasked with designing a streaming system on Databricks for processing real-time telemetry data. The...
  46. 246.You are designing a production streaming job in Databricks to process real-time data from IoT sensors. The...
  47. 247.You are tasked with deploying a structured streaming job in Databricks that reads data from a Kafka source...
  48. 248.You are tasked with deploying a structured streaming job in Databricks that processes real-time IoT sensor...
  49. 249.You are tasked with deploying and monitoring a structured streaming job in Databricks that processes...
  50. 250.You are a data engineer tasked with deploying a structured streaming job in Databricks that processes...
  51. 251.You are managing a Databricks workspace where a streaming job is processing real-time data from a Kafka...
  52. 252.You are tasked with setting up a streaming job in Databricks to process real-time data from a Kafka topic and...
  53. 253.You are tasked with deploying a new version of a data pipeline in a Databricks environment. Before...
  54. 254.You are working on a Databricks project that processes sensitive customer data. The team has implemented a...
  55. 255.You are tasked with deploying a production-grade data pipeline in Databricks that processes incoming data...
  56. 256.You are tasked with deploying a data pipeline in a Databricks environment. To ensure a smooth deployment,...
  57. 257.You are deploying a new ETL pipeline in Databricks. The pipeline consists of multiple jobs, and you want to...
  58. 258.You are working on deploying a data pipeline in your Databricks workspace. As part of the deployment process,...
  59. 259.A data engineering team is working on a Databricks project that involves multiple Python files for...
  60. 260.You are tasked with refactoring a Databricks notebook that currently uses a notebook dependency pattern. The...
  61. 261.You are working on a shared Databricks environment where multiple notebooks require the same custom functions...
  62. 262.You are tasked with refactoring a Databricks notebook that currently uses notebook-to-notebook imports for...
  63. 263.You are working on a Databricks notebook that requires the reuse of utility functions defined in a Python...
  64. 264.You are tasked with refactoring a Databricks notebook that contains multiple utility functions used across...
  65. 265.You are maintaining a Databricks project where a shared Python library was previously packaged and...
  66. 266.You are working on a Databricks project where a Python module was previously packaged and distributed as a...
  67. 267.A data engineering team maintains reusable Python functions as a custom library packaged in a Wheel file....
  68. 268.A data engineering team has been maintaining a Python library as a Wheel file in their Databricks...
  69. 269.You are maintaining a Databricks project where a Python library was previously packaged and distributed as a...
  70. 270.A data engineering team is migrating their Databricks workflows from using Python Wheels to direct imports...
  71. 271.A data engineering team is using Databricks workflows to orchestrate a series of jobs that process and...
  72. 272.During a nightly ETL process in Databricks, a job failed due to an intermittent network issue while...
  73. 273.A data engineering team is running a Databricks job that processes streaming data and writes it to a Delta...
  74. 274.A Databricks job that processes daily sales data has failed due to a transient network issue while writing...
  75. 275.A Databricks job that processes large datasets has failed due to an intermittent connection issue when...
  76. 276.You are managing a Databricks job that processes a large dataset using multiple tasks in a task graph. One of...
  77. 277.You are a data engineer tasked with creating a Databricks Job to process daily sales data from a Delta table...
  78. 278.You are tasked with building a data pipeline in Databricks to process daily sales data. The pipeline should...
  79. 279.You are tasked with creating a Databricks Job to process daily incoming data from an external source. The...
  80. 280.You are tasked with creating a Databricks Job to process daily transactional data from a Delta table and...
  81. 281.A data engineering team is tasked with setting up an automated ETL pipeline in Databricks to ingest data from...
  82. 282.A Databricks Data Engineer is tasked with creating a Job to process daily sales data. The process involves...
  83. 283.You are tasked with creating a multi-task job in Databricks to process customer orders. The workflow should...
  84. 284.You are tasked with creating a multi-task job in Databricks to process and analyze customer data. The...
  85. 285.You are tasked with creating a multi-task job in Databricks to process and transform data. The workflow...
  86. 286.You are tasked with creating a multi-task job in Databricks to process and analyze customer transaction data....
  87. 287.You are tasked with creating a Databricks multi-task job to process raw data, transform it, and load it into...
  88. 288.You have been tasked with creating a multi-task job in Databricks to process a dataset in three sequential...
  89. 289.A data engineering team is tasked with designing a production streaming system in Databricks for real-time...
  90. 290.You are designing a production streaming job on Databricks that processes real-time clickstream data from a...
  91. 291.You are designing a production streaming job in Databricks that processes real-time IoT sensor data. The job...
  92. 292.You are designing a production streaming job in Databricks that processes real-time data from IoT devices....
  93. 293.A team is designing a production streaming job in Databricks to process real-time IoT sensor data. The system...
  94. 294.You are tasked with designing a production streaming job in Databricks that processes real-time data from a...
  95. 295.You are tasked with configuring the Databricks CLI on your local machine to interact with a Databricks...
  96. 296.You have been tasked to automate interactions with a Databricks workspace using the Databricks CLI. After...
  97. 297.A data engineer needs to automate interactions with a Databricks workspace using the Databricks CLI. To...
  98. 298.You are tasked with configuring the Databricks CLI to automate interactions with your Databricks workspace....
  99. 299.You are tasked with automating interactions with your Databricks workspace using the Databricks CLI. Before...
  100. 300.You are a data engineer tasked with deploying a notebook to a Databricks workspace and starting a cluster...