SUMMARY: The purpose of this project is to practice web scraping by extracting specific pieces of information from a website. The web scraping Python code leverages the BeautifulSoup module.
INTRODUCTION: The O’Reilly Strata Data Conference brings expert-led guidance on the tools and technologies that can enhance data strategies and projects. This web scraping script will automatically traverse through the entire web page and collect all links to the PDF and PPTX documents. The script will also download the documents as part of the scraping process. The Python script ran in the Google Colaboratory environment and can be adapted to run in any Python environment without the Colab-specific configuration.
Starting URLs: https://conferences.oreilly.com/strata/strata-ny/public/schedule/proceedings
The source code and HTML output can be found here on GitHub.