O'Reilly logo
  • Paul Hinton thinks this is interesting:

in iPython

From

Cover of Agile Data Science 2.0

Note

This refers to the session you just launched with the pyspark command. To ensure that ipython is used in lieu of the standard Python interpreter, add the following option to the pyspark command shown above:

--conf spark.pyspark.driver.python=ipython