Exam Certified Data Engineer Associate topic 1 question 59 discussion

D is correct. Temp view : session based Create temp view view_name as query All these are termed as session ended: Opening a new notebook Detaching and reattaching a cluster Installing a python package Restarting a cluster

A temporary view is created in memory and does not persist beyond the session. It does not require physical storage, making it ideal for avoiding storage costs.

D. Temporary view Explanation: Temporary View: A temporary view in database systems like Apache Spark provides a temporary and ephemeral representation of data based on an SQL query's result set. It exists for the duration of a Spark session and is not persisted to storage. Similar to a regular view, a temporary view allows the data engineer to define a logical schema by pulling and combining data from multiple tables using SQL queries, but it does not store any physical data on disk. Temporary views are suitable when there's no need for long-term storage of the combined data and are helpful for immediate analysis or processing within the current session without incurring storage costs.

https://docs.databricks.com/en/sql/language-manual/sql-ref-syntax-ddl-create-view.html Should be a view or temporary view to avoid copying and storing data. Does not need to be used by other data engineers in other sessions. So this view should be temporary. TEMPORARY views are visible only to the session that created them and are dropped when the session ends.

Answer is D. key phrase is "...does not need to be used by other data engineers in other sessions..."

D is right option