Exam DP-203 topic 1 question 70 discussion

A. \DataSource\SubjectArea\YYYY\WW\FileData_YYYY_MM_DD.parquet The recommended folder structure that best meets the requirements is option A. It separates data by data source, year and week. It allows for easy filtering of data by year or week, which aligns with the usage pattern where most queries include a filter on the current year or week.

Correct Answer: A

Based on the usage patterns and requirements, I recommend the following folder structure: \DataSource\SubjectArea\YYYY\WW\FileData_YYYY_MM_DD.parquet This structure is designed to support the usage patterns by organizing data by data source and subject area. The year and week folders will help optimize queries that filter by current year or week. This structure also simplifies folder security by grouping data by data source and subject area, making it easier to apply security policies. Finally, this structure minimizes query times by organizing data in a way that is optimized for the most common queries.

I believe it would be B. "Minimises query time" and "Most queries will include a filter on the current year OR week." The "OR WEEK" suggests that we may filter by only week and not the year. In this event it would (to my knowledge) take longer to query through every single year to select the week you want as opposed to selecting all the folders containing the WW target value in their name. If someone with query optimisation knowledge could confirm this below it would be appreciated.

Minimizes query times && Most queries will include a filter on the current year OR week. It is B.

my opinion it should be A, as it can clearly filter on year or on week , both the options will be available.

We need to query by week too, so better YYYY-WWW.

Option B seems right answer as we can directly access the given yyyy-ww .

chat GPT: Based on the given usage patterns and requirements, the recommended folder structure would be option B: \DataSource\SubjectArea\YYYY-WW\FileData_YYYY_MM_DD.parquet This structure allows for easy filtering of data by year and week, which aligns with the identified usage pattern of most queries filtering by the current year or week. It also organizes the data by data source and subject area, which simplifies folder security. By using a flat structure, with the data files directly under the year-week folder, query times can be minimized as the data is organized for efficient partition pruning. Option A is similar but includes an additional level of hierarchy for the year, which is unnecessary given the requirement to filter by year-week. Options C, D, and E do not follow a consistent hierarchy, making it difficult to navigate and locate specific data files.

A is correct answer

A is correct

The answer A is correct

Given answer is correct

Correct

Answer is correct. The reason is that this folder structure allows for the data to be organized by data source and subject area, which can help with securing the data by data source. Additionally, it organizes the data by year and week, which can minimize query times for the queries that include a filter on the current year or week. And also the file name format is consistent with the folder structure, which makes it easy to understand where the data comes from.

My choice is A