NCA-AIIO Question 89
Select 3You are tasked with training an AI model to predict crop yields based on weather data. During the exploratory data analysis phase, you notice that the dataset contains unusually high humidity readings in a specific month across multiple years. Upon further investigation, you find that these readings are due to a sensor calibration issue. What steps should you take to ensure accurate model predictions and valid research results?
- A
Remove all data points from the affected month entirely to avoid any potential bias.
- B
Replace the incorrect humidity readings with interpolation based on neighboring months' data.
- C
Leave the dataset as-is to avoid losing potentially valuable patterns.
- D
Document the presence of the sensor calibration issue and its potential effects on the dataset.
- E
Run sensitivity analyses to assess the impact of the incorrect readings on model performance.
Show answer and explanation
Correct answers: B, D, E
Explanation
To ensure accurate model predictions and valid research results, it is essential to address the sensor calibration issue by correcting the erroneous data (e.g., interpolation), documenting the issue's presence and its potential effects, and conducting sensitivity analyses to quantify its impact. These steps help maintain the integrity of the research while mitigating the risk of introducing bias or losing valuable information.
- A. Incorrect.
Removing all data points from the affected month may result in losing valuable information, such as other weather variables or trends that are unaffected by the sensor calibration issue. This is not the most effective solution.
- B. Correct.
Replacing the incorrect humidity readings with interpolation based on neighboring months' data is a reasonable approach, as it allows for correcting the data while preserving the overall trends and patterns.
- C. Incorrect.
Leaving the dataset as-is may lead to biased results, as the incorrect humidity readings could negatively affect the model's ability to learn accurate relationships.
- D. Correct.
Documenting the sensor calibration issue and its potential effects is crucial for ensuring transparency and reproducibility in research. It helps stakeholders understand the limitations of the dataset.
- E. Correct.
Running sensitivity analyses can help identify the extent to which the incorrect readings affect model performance, aiding in determining whether additional corrective actions are necessary.