Chapter 12

Exploring Data Science Jobs with Web Scraping and Text Mining

Deborah Nolan

University of California, Berkeley

Duncan Temple Lang

University of California, Davis

12.1 Introduction and Motivation

In this case study, we will explore on-line job postings for different professions or types of positions. We are interested in finding the set of skills that different types of positions expect and want, and which are valuable, but not required. We also want to find information about what educational level an applicant should have (i.e., BSc, MSc, or PhD) for different types of jobs, how many years of experience are needed, what the salary ranges are, and how these differ geographically. We will work with on-line postings so they are up-to-date ...

Get Data Science in R now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.