Databricks Machine Learning Associate Question 41
Single answerYou are working on a Databricks workspace and need to install a Python library so that it is available to all notebooks running on a specific cluster. Which of the following steps should you take to achieve this?
- A
Navigate to the 'Libraries' tab of the cluster in the Databricks workspace, click 'Install New', and specify the library source and details.
- B
Run the command
%pip install <library_name>in one of the notebooks attached to the cluster. - C
Manually SSH into the cluster nodes and install the library using
pip. - D
Use the Databricks REST API to install the library directly on the cluster.
Show answer and explanation
Correct answer: A
Explanation
To ensure a Python library is available to all notebooks running on a cluster in Databricks, it must be installed through the 'Libraries' tab of the cluster settings. This installation method ensures the library is added at the cluster level, making it accessible to all users and notebooks attached to the cluster. Using %pip install or manual installation methods will not achieve the same cluster-wide availability.
- A. Correct.
Correct. The 'Libraries' tab in the cluster settings allows you to install libraries that will be available to all notebooks attached to the cluster. This is the appropriate way to install a library for all users and notebooks on a cluster.
- B. Incorrect.
Incorrect. While
%pip install <library_name>can install a library for use in a specific notebook, it does not make the library available across all notebooks on the cluster. - C. Incorrect.
Incorrect. SSH access to Databricks cluster nodes is not allowed. All installations must be done through the Databricks interface or APIs.
- D. Incorrect.
Incorrect. While the Databricks REST API can be used to manage libraries, this method is less common for individual users and requires additional configuration. The 'Libraries' tab in the cluster settings is the more straightforward and commonly used approach.