AZ-305 Question 102
Select 2A global retailer wants to move incremental data from multiple on-premises transactional systems into Azure for advanced analytics. They need a solution that can orchestrate data extraction from on-premises sources, apply transformations, and load the cleansed data into an Azure Data Lake. Which two Azure services should they use to build this integrated data pipeline?
- A
Use Azure Data Factory with a self-hosted Integration Runtime (SHIR) to orchestrate data movement and transformations.
- B
Use Azure Logic Apps to replicate the on-premises databases directly into Azure via scheduled workflows.
- C
Use Azure Synapse Pipelines to perform data ingestion and transformations as part of an end-to-end analytics solution.
- D
Use Azure Event Hubs to stream the entire on-premises databases in real time without any transformation.
Show answer and explanation
Correct answers: A, C
Explanation
For batch or scheduled data movement from on-premises sources to the cloud, Azure Data Factory or Azure Synapse Pipelines are recommended solutions. Both services can orchestrate data extraction, leverage a self-hosted Integration Runtime for secure connectivity, perform transformations (via mapping data flows or external activities), and then store the processed data in Azure Data Lake Storage or other analytics targets. Refer to Azure Data Factory documentation (https://docs.microsoft.com/azure/data-factory/) and Azure Synapse Analytics documentation (https://docs.microsoft.com/azure/synapse-analytics/) for best practices in designing data integration pipelines.
- A. Correct.
Correct. Azure Data Factory can connect to on-premises data sources securely by installing and configuring a self-hosted Integration Runtime. It allows you to schedule data ingestion, perform data transformations, and load the results into Azure services such as Data Lake Storage.
- B. Incorrect.
Incorrect. Although Azure Logic Apps can automate workflows and integrate with various services, it is not designed primarily for large-scale data ingestion and transformation scenarios. Logic Apps can complement data pipelines but is not the most effective solution for orchestrating complex ETL or ELT processes from on-premises systems.
- C. Correct.
Correct. Azure Synapse Pipelines (part of Azure Synapse Analytics) offer similar orchestration and data transformation capabilities to Azure Data Factory, but within an integrated analytics environment. It can ingest and process data from on-premises sources and then store or further analyze the data in Azure Data Lake or a Synapse SQL pool.
- D. Incorrect.
Incorrect. Azure Event Hubs is best suited for streaming data ingestion such as event logs, IoT device telemetry, or real-time data feeds. For batch-style data movement and transformation from on-premises SQL databases or similar transactional systems, Event Hubs is not the optimal choice.