Exam DP-100 topic 2 question 2 discussion

Is the answer not D?? They are trying to build a development environment (line 1). Nowhere it says its for production environment.

B. Azure Databricks is a fast, easy, and collaborative Apache Spark-based analytics platform that provides a complete environment for data engineering, machine learning, and data science. It supports Python and Scala, and allows you to compose data storage, movement, and processing services into automated data pipelines. Azure Data Factory, on the other hand, is a cloud-based data integration service that allows you to create, schedule, and orchestrate your data pipelines. By using both Databricks and Data Factory together, you can have a unified platform for both data engineering and data science that also supports workload isolation and interactive workloads, as well as enables scaling across a cluster of machines.

Azure Databricks is an obvious choice for the environment. To decide between Data Factory vs Container Instances for orchestration makes the difference here. ADF would be a more suitable choice compared to ACI for orchestration in this scenario due to 1. Native Orchestration Capabilities 2. Visual Workflow Designer 3. Integration with Diverse Data Sources and Services 4. Built-in Monitoring and Management Therefore, for the purpose of orchestrating data pipelines in a data engineering and data science environment, ADF would be the recommended choice due to its dedicated orchestration features, data integration capabilities, visual workflow designer, and integration with diverse data sources and services.

B without doubts

B is the right answer. C and D are out as there is need for data engineering Since there is need for "both data engineering and data science", there is need for Data Factory, hence C and D are out. Due to need for Scala and Python support, Databricks (B) is the correct answer.

B is correct

the correct answer is B

Previewed last year, Microsoft's Azure Container Instances (ACI) is now ready for production usage, according to the company. ... Microsoft promises an uptime service level agreement of 99.9 percent for any container group. Each container is secured and isolated through a VM hypervisor.

azure databricks support clustering while azure data factory supports orchestration (https://docs.microsoft.com/en-us/azure/databricks/clusters/configure). The orchestration here should be in the context of data processing (think SSIS, ETL, informatica etc.) Answer should be B. Azure containers instances provide some basic orchestration capabilities, but then again the context is different. https://docs.microsoft.com/en-us/azure/container-instances/container-instances-orchestrator-relationship

I think the best answer is B. ACI is used to deploy a model. ACI is just like docker - for orchestration you would need something like kubernetes not docker.

Wow, so what's the correct answer really? Why is Azure Container not an option?