O'Reilly logo
  • Shuchi Mishra thinks this is interesting:

topTweetText = topTweets.map(lambda row: row.text)

From

Cover of Learning Spark
  • 9. Spark SQL
  • from Learning Spark
  • by Matei Zaharia, Patrick Wendell, Andy Konwinski, Holden Karau
  • Publisher: O'Reilly Media, Inc.
  • Released: February 2015

Note

Outdated. The dataframe needs to be converted to rdd first:

topTweetsrdd = topTweets.rdd
type(topTweetsrdd)
topTextTweet = topTweetsrdd.map(lambda row:row.text)
topTextTweet.collect()