DatabricksAssociate levelPage 4 of 7

Databricks Machine Learning Associate exam dumps: questions 301 to 400 of 655

Page 4 of the free Databricks Machine Learning Associate question bank for the Databricks Certified Machine Learning Associate exam. Questions 301 to 400 are listed below, the first 5 in full with answers and explanations. Back to page 1 for the exam overview and FAQ.

Question bank last updated January 2025

Start timed practice exam Questions 301 to 400

Free Databricks Machine Learning Associate practice questions

Questions 301 to 305 of 655

Pick an answer before you open the explanation. Each question also has its own page with a permalink.

Databricks Machine Learning Associate Question 301

Select 4

You are tasked with building a machine learning pipeline in Databricks using Spark ML to predict customer churn. The pipeline should include stages for data preparation, feature transformation, and model training. Which of the following components can be included as valid stages in a Spark ML Pipeline?

A
VectorAssembler for combining feature columns into a single feature vector
B
StringIndexer for converting categorical labels into numeric indices
C
LinearRegression for training a regression model
D
Pandas DataFrame for performing data transformations
E
OneHotEncoder for encoding categorical features
F
SQL queries for data preparation within the pipeline stages

Show answer and explanation

Correct answers: A, B, C, E

Explanation

Spark ML Pipelines consist of a sequence of stages, where each stage is either a Transformer (e.g., VectorAssembler, StringIndexer, OneHotEncoder) or an Estimator (e.g., LinearRegression). These stages operate on Spark DataFrames and are designed to work seamlessly within the pipeline framework. Pandas DataFrames and SQL queries, while useful for data manipulation, are not valid pipeline stages.

A. Correct.
VectorAssembler is a valid Spark ML Pipeline stage used for combining multiple feature columns into a single vector, which is required by Spark ML algorithms.
B. Correct.
StringIndexer is a valid Spark ML Pipeline stage used to convert categorical labels into numeric indices, a common preprocessing step in machine learning pipelines.
C. Correct.
LinearRegression is a valid Spark ML Pipeline stage as it is a machine learning algorithm included in Spark ML for regression tasks.
D. Incorrect.
Pandas DataFrame is not a valid Spark ML Pipeline stage because Spark ML pipelines operate on Spark DataFrames, not Pandas DataFrames.
E. Correct.
OneHotEncoder is a valid Spark ML Pipeline stage for encoding categorical features as one-hot vectors, which is often used in feature transformation.
F. Incorrect.
SQL queries are not directly supported as stages within Spark ML Pipelines, although SQL queries can be used outside the pipeline to prepare data.

Databricks Machine Learning Associate Question 302

Select 4

You are tasked with building a machine learning pipeline in Databricks using Spark ML to predict house prices. The dataset contains numeric features (e.g., square footage, number of rooms) and categorical features (e.g., neighborhood). Which of the following steps are necessary to correctly build a pipeline for this task?

A
Use StringIndexer to convert categorical features into numeric indices
B
Use VectorAssembler to combine all features into a single feature vector
C
Normalize numeric features using a StandardScaler before combining them with categorical features
D
Use Tokenizer to convert numeric features into text format for further processing
E
Include a regression model like LinearRegression at the end of the pipeline

Show answer and explanation

Correct answers: A, B, C, E

Explanation

Building a Spark ML pipeline involves several key steps: preprocessing categorical features with StringIndexer, normalizing numeric features with StandardScaler, combining features into a single vector using VectorAssembler, and adding a machine learning model at the end of the pipeline. Tokenizer is unnecessary here because the dataset does not include text data.

A. Correct.
StringIndexer is necessary for converting categorical features into numeric indices that can be used in machine learning models.
B. Correct.
VectorAssembler is required to combine all the features, both numeric and categorical (after encoding), into a single feature vector for the pipeline.
C. Correct.
StandardScaler is used to normalize numeric features, which helps improve model performance and convergence, especially for regression tasks.
D. Incorrect.
Tokenizer is used for processing text data, which is not relevant in this scenario as the dataset does not contain text features.
E. Correct.
Including a regression model like LinearRegression is essential as it is the final step in the pipeline that performs the prediction task.

Databricks Machine Learning Associate Question 303

Select 4

You are developing a Spark ML Pipeline to train a model that predicts house prices. During development, you encounter unexpected behavior where the model performs poorly despite having a well-defined feature set. Which of the following factors should you check to address this issue?

A
Ensure consistent column naming between the DataFrame and the pipeline stages
B
Verify that all stages in the pipeline are fitted on the same training dataset
C
Inspect and handle missing values in the dataset before fitting the pipeline
D
Check for data leakage caused by using test data during pipeline fitting
E
Confirm that the pipeline stages are executed in parallel for faster processing

Show answer and explanation

Correct answers: A, B, C, D

Explanation

When developing a Spark ML Pipeline, several common issues can lead to poor model performance. Ensuring consistent column naming across pipeline stages, fitting all stages on the same training dataset, handling missing values appropriately, and preventing data leakage are critical steps. These ensure that the pipeline operates correctly and produces reliable results. Parallel execution of pipeline stages is not applicable in Spark ML, so it is not relevant to the problem described.

A. Correct.
Spark ML Pipelines rely on consistent column naming conventions for input and output columns across stages. If column names are mismatched, it can lead to runtime errors or incorrect results.
B. Correct.
All pipeline stages must be fitted on the same training dataset. Mismatched datasets between stages can result in misaligned transformations and poor model performance.
C. Correct.
Missing values can disrupt feature engineering and model training. These need to be handled before fitting the pipeline to avoid issues during transformation or training.
D. Correct.
Data leakage occurs when test data is inadvertently used during pipeline fitting, leading to overly optimistic performance metrics and poor generalization to unseen data.
E. Incorrect.
Pipeline stages in Spark ML are executed sequentially, not in parallel. Optimizing execution speed is unrelated to addressing model performance issues.

Databricks Machine Learning Associate Question 304

Select 3

You are developing a Spark ML Pipeline in Databricks to train a machine learning model. During the pipeline's execution, you notice that the output contains unexpected results. Upon investigation, you find that the issue stems from the handling of categorical features. Which of the following practices could help prevent similar issues in Spark ML Pipelines?

A
Ensure that StringIndexer is applied to all categorical columns before using them in machine learning models.
B
Avoid reusing feature column names across different stages of the pipeline.
C
Manually cast all numerical columns to DoubleType before feeding them into the VectorAssembler.
D
Always use VectorAssembler to combine feature columns before passing them to the model.
E
Verify that the pipeline stages are executed in the correct order during the transformation process.

Show answer and explanation

Correct answers: A, B, E

Explanation

Developing a Spark ML Pipeline requires careful attention to the handling of categorical features and the overall pipeline structure. Applying StringIndexer to categorical columns ensures they are numerically encoded, while avoiding feature name reuse prevents overwriting issues. Additionally, verifying the order of pipeline stage execution ensures proper transformations. These practices collectively help prevent common issues and ensure the pipeline produces expected results.

A. Correct.
Correct: StringIndexer is essential for converting categorical columns into numerical indices required by Spark ML models.
B. Correct.
Correct: Reusing feature column names across different stages can cause overwriting issues, leading to unexpected results in the pipeline.
C. Incorrect.
Incorrect: While numerical columns should be of the correct type, Spark ML automatically handles numerical column conversions in many cases. Manual casting is not always necessary.
D. Incorrect.
Incorrect: Although VectorAssembler is often used to combine feature columns, it is not mandatory for all Spark ML Pipelines, depending on the specific requirements.
E. Correct.
Correct: Ensuring that pipeline stages are executed in the correct order is critical to avoid errors and achieve the desired transformations.

Databricks Machine Learning Associate Question 305

Select 3

You are developing a Spark ML pipeline to predict customer churn using Databricks. During the development process, you encounter issues where the pipeline fails at runtime when applied to new data. Which of the following practices could help avoid such issues?

A
Ensure that the transformations in the pipeline handle missing or unseen categories in the input data.
B
Use a consistent schema for all datasets (training, validation, and testing) that will pass through the pipeline.
C
Skip the step of persisting intermediate DataFrames, as Spark ML pipelines automatically optimize memory usage.
D
Test the pipeline on a small batch of unseen data to identify potential edge cases and runtime errors.
E
Avoid using feature scaling in the pipeline, as it can lead to runtime errors when encountering new data.

Show answer and explanation

Correct answers: A, B, D

Explanation

When developing a Spark ML pipeline, runtime errors can often occur due to schema mismatches, unhandled edge cases, or transformations failing to process unseen data. Ensuring the pipeline is robust to unseen categories, using consistent schemas, and testing on unseen data helps identify and mitigate these issues. Avoiding practices like skipping schema checks or neglecting testing can lead to runtime failures.

A. Correct.
Correct. Spark ML pipelines may fail if transformations (e.g., one-hot encoding) can't handle unseen categories or missing values in new data. Implementing robust handling is critical.
B. Correct.
Correct. Consistent schemas ensure that the pipeline can process data without schema mismatches causing runtime errors.
C. Incorrect.
Incorrect. Persisting intermediate DataFrames can help optimize performance and prevent recomputation, but it is not directly related to avoiding runtime failures.
D. Correct.
Correct. Testing the pipeline on a small batch of unseen data can help identify runtime issues, such as schema mismatches or unhandled edge cases.
E. Incorrect.
Incorrect. Feature scaling is an essential part of many machine learning pipelines and does not inherently cause runtime errors. Issues arise only if scaling isn't applied consistently across all data splits.

Timed practice exam

Take a Databricks Machine Learning Associate practice test under exam conditions

48 questions in 90 minutes, drawn from this bank, with a score report and a per-question review when you finish.

Start timed exam

Databricks Machine Learning Associate practice questions 301 to 400 of 655

Every question has a page with the answer and explanation. Numbers are stable, so you can bookmark or share them. The bank is split into 7 pages of up to 100 questions.

More Databricks exam dumps

All Databricks exams

312 questions

Databricks Data Engineer Professional exam dumps

Databricks Certified Data Engineer Professional

531 questions

Databricks Data Engineer Associate exam dumps

Databricks Certified Data Engineer Associate

305 questions

Databricks Generative AI Engineer Associate exam dumps

Databricks Certified Generative AI Engineer Associate

279 questions

Databricks Machine Learning Professional exam dumps

Databricks Certified Machine Learning Professional