ExamTopics Logo
Mail Us[email protected]
Menu
Databricks Discussions
exam questions

Exam Certified Associate Developer for Apache Spark All Questions

View all questions & answers for the Certified Associate Developer for Apache Spark exam
Go to Exam

Exam Certified Associate Developer for Apache Spark topic 1 question 74 discussion

Actual exam question from Databricks's Certified Associate Developer for Apache Spark
Question #: 74
Topic #: 1
[All Certified Associate Developer for Apache Spark Questions]

Which of the following operations can be used to return a DataFrame with no duplicate rows? Please select the most complete answer.

  • A. DataFrame.distinct()
  • B. DataFrame.dropDuplicates() and DataFrame.distinct()
  • C. DataFrame.dropDuplicates()
  • D. DataFrame.drop_duplicates()
  • E. DataFrame.dropDuplicates(), DataFrame.distinct() and DataFrame.drop_duplicates()
Show Suggested Answer Hide Answer
Suggested Answer: E 🗳️
by thanab at Sept. 6, 2023, 4:38 a.m.

Comments

Chosen Answer:
This is a voting comment (?). It is better to Upvote an existing comment if you don't have anything to add.
Switch to a voting comment New
Submit Cancel
Ahlo
8 months, 1 week ago
Answer E drop_duplicates() is an alias for dropDuplicates() it also work in pyspark
upvoted 1 times
...
azure_bimonster
8 months, 3 weeks ago
Selected Answer: E
it asks "most complete" one, so E would be correct as all these three options would work in pyspark
upvoted 1 times
...
thanab
1 year, 1 month ago
B The most complete answer is B. DataFrame.dropDuplicates() and DataFrame.distinct(). Both DataFrame.distinct() and DataFrame.dropDuplicates() methods in PySpark can be used to return a new DataFrame with duplicate rows removed. The DataFrame.drop_duplicates() method is used in pandas, not in PySpark.
upvoted 1 times
juadaves
1 year ago
It should be E, drop_duplicates() works in pyspark too.
upvoted 1 times
...
...
Community vote distribution
A (35%)
C (25%)
B (20%)
Other
Most Voted
A voting comment increases the vote count for the chosen answer by one.

Upvoting a comment with a selected answer will also increase the vote count towards that answer by one. So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.

SaveCancel
exam
Someone Bought Contributor Access for:
SY0-701
London, 1 minute ago