Exam DP-201 topic 1 question 21 discussion

Shouldn't answer be C, there is no concept of folders and folder permissions in Azure storage.

Answer should definitely be C, Azure Data Lake Storage Gen2.

The given answer is wrong and it should be C. The answer given states container is same as folder but it is not. A folder can have sub folders and access can be given only to sub folder. Where as in containers there are no sub containers hence the answer is wrong. Folder however can be given access in ADLS Gen2 using ACL so when we have a straight forward answer, why go with assumtion that 'container is same as folder'

Azure Data Lake Store Gen2 is a superset of Azure Blob storage capabilities. In the list below, some of the key differences between ADLS Gen2 and Blob storage are summarized. ADLS Gen2 supports ACL and POSIX permissions allowing for more granular access control compared to Blob storage. ADLS Gen2 introduces a hierarchical namespace. This is a true file system, unlike Blob Storage which has a flat namespace. This capability has a significant impact on performance, especially in big data analytics scenarios. ADLS Gen2 is an HDFS-compatible store. This means that Apache Hadoop services can use data stored in ADLS Gen2. Azure Blob storage is not Hadoop-compatible.

ADLS is the appropriate solution here as it has ACL function.

In Question they mentioned about flat files and columnar optimized files(Binary Files) and Containers are similar to folders, so Azure storage is Correct

The requirements leads to using ADLS gen 2 as it can manage the folder level using ACL

C. Azure Data Lake Storage Gen2

Columnar optimized file for Raw, enriched and curated structure with Folder level access Ans is ADLS ref: https://www.dremio.com/data-lake/adls/ https://medium.com/microsoftazure/building-your-data-lake-on-adls-gen2-3f196fc6b430

The given answer is correct as when you check the below link https://docs.microsoft.com/en-us/azure/architecture/data-guide/technology-choices/data-storage it's clearly mentioned that ADLS can be used with certain restrictions it can be accessed via az synapse using poly base feature. There are certain performance tuning guidelines but in qn it's asked it need to be easily accessed by data scientistists as per the conditions we can go with blob storage

I will choose Azure Datalake on the only fact that the question did ask for columnar optimized files and this is available in Datalake and not Azure storage account

A folder can be created in a blob (e.g. via button "Create folder" in the portal) but such a folder is virtual. Using Azure Storage Explorer (presently v1.17.0), one can verify that an SAS can be created on a blob container, but not on a folder within a blob. Still, multiple containers could be created where each container maps to one group of users in the security requirements. This is not forbidden in the question. If each container has one or more folders, all requirements would still be met, making answer B a "minimum viable answer". However, I agree that answer C is the best and most flexible. Using Azure Storage Explorer, one can easily verify that the option "Manage Access Control Lists" is available on an individual folder.

The given answer is clearly incorrect. All the points that are mentioned in the questions are hints to use ADLS Gen 2.

The answer also mentions that the files are supposed to be explored by Data Scientists in curated folder. ADLS Gen 2 hooked up with Databricks or Azure Synapse Analytics is a ready-made solution for this kind of exploration.

I think correct answer should be ADLS Gen 2.

raw, curated folder, folder level access all characteristics of ADLS

I believe there is actually only a single layer of containers. You can virtually create a "file-system" like layered storage, but in reality everything will be in 1 layer, the container in which it is. So Answer should be DATA LAKE