O'Reilly logo
  • Paul Hinton thinks this is interesting:

in iPython


Cover of Agile Data Science 2.0


This refers to the session you just launched with the pyspark command. To ensure that ipython is used in lieu of the standard Python interpreter, add the following option to the pyspark command shown above:

--conf spark.pyspark.driver.python=ipython