A Spark job is taking longer than expected. Using the Spark UI, a data engineer notes that the Min, Median, and Max Durations for tasks in a particular stage show the minimum and median time to complete a task as roughly the same, but the max duration for a task to be roughly 100 times as long as the minimum.
Which situation is causing increased duration of the overall job?
KadELbied
2 months, 1 week agoarekm
6 months, 2 weeks agobenni_ale
7 months, 3 weeks agoAndreFR
11 months agoimatheushenrique
1 year, 1 month agovikram12apr
1 year, 4 months agoJay_98_11
1 year, 6 months agokz_data
1 year, 6 months agosturcu
1 year, 9 months agoEertyy
1 year, 10 months ago