Databricks Data Engineer Professional Question 269
Select 4You are maintaining a Databricks project where a Python library was previously packaged and distributed as a Wheel file. The new requirement is to refactor the project to use direct imports with relative paths to simplify development and deployment. What steps should you take to adapt the existing code for this requirement?
- A
Update the import statements in your Python scripts to use relative paths instead of absolute paths.
- B
Remove the Wheel file from the Databricks cluster libraries to avoid runtime conflicts.
- C
Modify the Databricks cluster configuration to include the directory containing the Python scripts in the PYTHONPATH environment variable.
- D
Recompile the Wheel file with updated relative import paths to maintain compatibility.
- E
Ensure that all Python scripts are located in a structured directory that supports relative imports.
Show answer and explanation
Correct answers: A, B, C, E
Explanation
To adapt Python code from being maintained as Wheels to direct imports, you must refactor the import statements to use relative paths, remove the dependency on the Wheel file, and configure the environment (e.g., PYTHONPATH) to support direct imports. Additionally, organizing your Python scripts in a structured directory is crucial for enabling relative imports. Recompiling the Wheel file is unnecessary as the goal is to transition away from using Wheel files altogether.
- A. Correct.
Correct: Switching to relative imports requires updating the import statements in the Python scripts to use relative paths instead of absolute paths.
- B. Correct.
Correct: Removing the previously used Wheel file ensures there are no conflicts between the old Wheel-based approach and the new direct import approach.
- C. Correct.
Correct: Modifying the PYTHONPATH environment variable allows the Databricks cluster to locate the modules for direct imports.
- D. Incorrect.
Incorrect: Refactoring to use direct imports eliminates the need for Wheel files, so recompiling the Wheel is unnecessary.
- E. Correct.
Correct: A structured directory is essential for Python's relative imports to work properly, as the modules need to reside in directories that form a package hierarchy.