Exam DP-700 topic 1 question 28 discussion

Actual exam question from Microsoft's DP-700

Question #: 28
Topic #: 1

You have a Fabric workspace that contains a lakehouse and a notebook named Notebook1. Notebook1 reads data into a DataFrame from a table named Table1 and applies transformation logic. The data from the DataFrame is then written to a new Delta table named Table2 by using a merge operation.
You need to consolidate the underlying Parquet files in Table1.
Which command should you run?

A. VACUUM
B. BROADCAST
C. OPTIMIZE
D. CACHE

Show Suggested Answer

Suggested Answer: C 🗳️

by GHill1982 at Dec. 30, 2024, 5:57 p.m.

Comments

Submit Cancel

smanzana

2 weeks, 3 days ago

Selected Answer: C

C is correct

upvoted 1 times

...

benni_ale

4 months, 1 week ago

Selected Answer: C

Optimise!

upvoted 1 times

...

henryphchan

4 months, 2 weeks ago

Selected Answer: C

In Delta Lake, the OPTIMIZE command is used to consolidate small Parquet files into larger ones. This improves query performance by reducing the overhead of managing many small files. VACUUM command is used to clean up and remove files that are no longer needed (e.g., old versions of data files, deleted files)

upvoted 3 times

...

prabhjot

4 months, 4 weeks ago

Selected Answer: C

Optimize solves the "small file problem" by consolidating multiple small files into larger parquet files

upvoted 2 times

...

Tuki93

5 months ago

Selected Answer: C

Optimize: Consolidates multiple small Parquet files into large file. Big Data processing engines, and all Fabric engines, benefit from having larger files sizes. Having files of size above 128 MB, and optimally close to 1 GB, improves compression and data distribution, across the cluster nodes. It reduces the need to scan numerous small files for efficient read operations. It's a general best practice to run optimization strategies after loading large tables.

upvoted 1 times

...

doctordodge

5 months, 1 week ago

Selected Answer: C

Link: https://learn.microsoft.com/en-us/fabric/data-engineering/lakehouse-table-maintenance

upvoted 1 times

...

GHill1982

6 months, 1 week ago

Selected Answer: C

To consolidate the underlying Parquet files in Table1, you should run the OPTIMIZE command.

upvoted 4 times

...