Welcome to ExamTopics
ExamTopics Logo
- Expert Verified, Online, Free.
Mail Us[email protected]
Menu

Unlimited Access

Get Unlimited Contributor Access to the all ExamTopics Exams!
Take advantage of PDF Files for 1000+ Exams along with community discussions and pass IT Certification Exams Easily.
Databricks Discussions

Exam Certified Associate Developer for Apache Spark topic 1 question 70 discussion

Actual exam question from Databricks's Certified Associate Developer for Apache Spark
Question #: 70
Topic #: 1
[All Certified Associate Developer for Apache Spark Questions]

The code block shown below contains an error. The code block is intended to return a new DataFrame where column managerName from DataFrame storesDF is split at the space character into column managerFirstName and column managerLastName. Identify the error.

A sample of DataFrame storesDF is displayed below:



Code block:

storesDF.withColumn("managerFirstName", col("managerName").split(" ").getItem(0))
.withColumn("managerLastName", col("managerName").split(" ").getItem(1))

  • A. The index values of 0 and 1 are not correct – they should be 1 and 2, respectively.
  • B. The index values of 0 and 1 should be provided as second arguments to the split() operation rather than indexing the result.
  • C. The split() operation comes from the imported functions object. It accepts a string column name and split character as arguments. It is not a method of a Column object.
  • D. The split() operation comes from the imported functions object. It accepts a Column object and split character as arguments. It is not a method of a Column object.
  • E. The withColumn operation cannot be called twice in a row.
Show Suggested Answer Hide Answer
Suggested Answer: D 🗳️
by zozoshanky at July 30, 2023, 7:35 p.m.

Comments

Chosen Answer:
This is a voting comment (?) , you can switch to a simple comment.
Switch to a voting comment New
Submit Cancel
Sowwy1
1 month, 1 week ago
D. The split() operation comes from the imported functions object. It accepts a Column object and split character as arguments. It is not a method of a Column object.
upvoted 1 times
...
Ahlo
2 months, 3 weeks ago
Answer C pyspark.sql.functions provides a function split() to split DataFrame string Column into multiple columns. https://sparkbyexamples.com/pyspark/pyspark-split-dataframe-column-into-multiple-columns/
upvoted 1 times
...
newusername
6 months, 1 week ago
Selected Answer: C
I think it is C data = [ ("John Smith",), ("Jane Doe",), ("Mike Johnson",) ] df = spark.createDataFrame(data, ["managerName"]) df.show() df = df.withColumn("managerFirstName", split(col("managerName"), " ").getItem(0)) \ .withColumn("managerLastName", split(col("managerName"), " ").getItem(1)) df.show()
upvoted 1 times
...
zozoshanky
9 months, 3 weeks ago
Can be C as an answer too.
upvoted 1 times
cookiemonster42
9 months, 3 weeks ago
But you have to pass a column as an object, not a string. you have to use col() expression. So D is the right one.
upvoted 4 times
65bd33e
1 week, 5 days ago
Yes, I agree with you, D is correct we have to pass a column as an object
upvoted 1 times
...
...
...

Get IT Certification

Unlock free, top-quality video courses on ExamTopics with a simple registration. Elevate your learning journey with our expertly curated content. Register now to access a diverse range of educational resources designed for your success. Start learning today with ExamTopics!

Start Learning for free
Community vote distribution
A (35%)
C (25%)
B (20%)
Other
Most Voted
A voting comment increases the vote count for the chosen answer by one.

Upvoting a comment with a selected answer will also increase the vote count towards that answer by one. So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.

SaveCancel