C is correct as '%sh pip install ...' runs only on the driver node and the Cluster UI PyPi or other library installs are not scoped to a specific notebook only but to all spark sessions in all notebooks on all cluster nodes.
Is necessary just run %pip install some_library inside a notebook cell
C.
OBS:
For the last update of a library can be executed %pip install some_library -U
A voting comment increases the vote count for the chosen answer by one.
Upvoting a comment with a selected answer will also increase the vote count towards that answer by one.
So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.
m79590530
6 months, 2 weeks agoimatheushenrique
11 months, 1 week ago