Exam AZ-305 topic 2 question 28 discussion

Man sometimes I think I know what I'm talking about with Azure, and then I see a question like this and I question my sanity.

1. Storage Type: Azure Data Lake Storage Gen2 Azure Event Hubs Capture allows captured data to be written either to Azure Blob Storage or Azure Data Lake Storage Gen2. Given the nature of the data and its use in reporting and analysis, Azure Data Lake Storage Gen2 is the more appropriate choice because it is designed for big data analytics. 2. Data format: Avro Event Hubs Capture uses Avro format for the data it captures. Avro is a row-oriented format that is suitable for various data types, it's compact, fast, binary, and enables efficient and fast serialization of data. This makes it a good choice for Event Hubs Capture.

* Event Hubs doesn't support capturing events in a premium storage account. * Event Hubs Capture supports any non-premium Azure storage account with support for block blobs. Answer : 1.Storage Type: Azure Data Lake Storage Gen2 2. Data format: Avro

CORRECT

This question appeared in the exam, August 2024, I gave this same answer provided here. I scored 870

The given answer is correct. Azure Data Lake Storage Gen2 is designed for big data analytics and is highly scalable, making it suitable for storing large volumes of event data. Avro is a compact, fast binary format supported by Event Hubs Capture, optimized for efficiency and performance in data streaming scenarios.

Response from Gemini AI: Storage Type: Event Hubs Capture allows captured data to be written to either Azure Blob Storage or Azure Data Lake Storage Gen2. However, for cold path processing scenarios, which involve analyzing historical data, Azure Data Lake Storage Gen2 is the more suitable choice. It's designed for big data analytics workloads and offers better performance and scalability for working with large datasets captured from event hubs. Inbound Data Format: Event Hubs Capture uses Avro format for the captured data. Avro is a widely used open-source data format specifically designed for data exchange. It's a row-oriented, binary format that provides rich data structures with inline schema definition. This makes it efficient for storage and easy for various analytics tools and reporting systems to understand and process the captured event data.

Based on Gemini AI: Box 2-

For streaming Avro is made for it compared to Parquet as it row oriented format so if you have batch in the question => Parquet, Streaming => Avro

Correct given answers. "Azure Data Lake Storage Gen 2" or "Azure Storage Account" can be used as a Storage Account via the Portal. Just to be sure, I created a Premium Storage Account (blob) and this is - NOT - a valid option to store the Captured files. By default Avro is selected via the Portal. Also Parquet and Delta Lake (preview) are supported via the Portal.

Correct Answer: - Azure Data Lake Storage Gen2 - Apache Parquet I am thinkin rather best-practice driven rather than looking into docs. If I'd set up an analytics service in Azure, I'd prefer Databricks. In Databricks I am always working with Parquet files rather than Avro. Avro is often used in case of streaming. Single messages can be compressed and a schema is still enforced. But the question is only about analytics. While as I am preferring Avro in context of streaming, I am preferring Parquet for data analysis.

avro or apache parquet both are correct answer. however apache parquet is columnar storage format that provides efficient commpression and query performance.

The answer is correct. https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-capture-overview#how-event-hubs-capture-works The capture can be in Parquet format however if you use no code editor which is outside the scope of the question.

Capture data to ADLS Gen2 in Parquet format: https://learn.microsoft.com/en-us/azure/stream-analytics/event-hubs-parquet-capture-tutorial

Azure Data Lake Storage Gen2 is not a premium storage account. It is a storage account type that provides a unified storage solution for both structured and unstructured data. As Premium Storage options are not supported by Event Hubs Capture

To support Event Hubs Capture, the appropriate Azure storage type is Azure Data Lake Storage Gen2. Event Hubs Capture is specifically designed to write captured events directly to Azure Data Lake Storage Gen2, providing a durable and scalable storage solution. Regarding the inbound data format that the reporting system must support, the data format supported by Event Hubs Capture is Apache Avro. Event Hubs Capture writes the captured events in Avro format by default. Therefore, the reporting system should be able to consume and process data in the Apache Avro format. So the correct selections would be: Storage Type: Azure Data Lake Storage Gen2 Data Format: Apache Avro

Answer is not correct I side and agree with the explanation by Sanaie. Azure Data Lake Storage Gen2, as premium storage options are not supported by Event Hubs Capture. Apache Parquet is better suited for data analytics compared to Avro and JSON. Avro and Parquet are the only supported formats I have seen in the documentation. As we have an analytics case here I would suggest Parquet. Avro, however, is the default option and doesn't need any specific configurations.