O'Reilly logo
  • Shuchi Mishra thinks this is interesting:

topTweetText = topTweets.map(lambda row: row.text)


Cover of Learning Spark
  • 9. Spark SQL
  • from Learning Spark
  • by Matei Zaharia, Patrick Wendell, Andy Konwinski, Holden Karau
  • Publisher: O'Reilly Media, Inc.
  • Released: February 2015


Outdated. The dataframe needs to be converted to rdd first:

topTweetsrdd = topTweets.rdd type(topTweetsrdd) topTextTweet = topTweetsrdd.map(lambda row:row.text) topTextTweet.collect()