O'Reilly logo

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Mining the Social Web - Web Pages

Video Description

How do software programs that automatically extract information from web pages actually work? This video course, based on content from the book "Mining the Social Web" (O'Reilly Media) by Matthew Russell, teaches you how to create machines that can navigate the internet, cut through the noise, and extract the most important textual content from any web page or group of web pages. You'll learn how to use Python to write programs that can crawl, scrape, and parse the web; as well as discover how to extract key terms and sentences from web mined documents, explore document summarization techniques used in natural language processing and artificial intelligence, and gain experience using Python’s Natural Language Toolkit (NLTK) to auto-summarize web articles. Learners should have a basic understanding of Python.

  • Understand how helpful (and malicious) web bots crawl, parse, and index the web
  • Learn how to scrape content, extract links, and parse information from web pages and blog feeds
  • Discover how Python’s Natural Language Toolkit (NLTK) extracts and summarizes content

After completing his PhD in astrophysics, Mikhail Klassen transitioned to data science and refined his expertise in data mining, data analysis, and machine learning. He's now the Chief Data Scientist for Paladin: Paradigm Knowledge Solutions in Montreal, where he combines data mining and artificial intelligence to deliver personalized training for the aerospace industry.