SUMMARY: The purpose of this project is to practice web scraping by extracting specific pieces of information from a website. The web scraping Python code leverages the BeautifulSoup module.
INTRODUCTION: The AWS re:Invent is a learning conference featuring keynote announcements, training and certification opportunities, a partner expo, and access to more than 2,500 technical sessions. This web scraping script will automatically traverse through the entire web page and collect all links to the PDF and PPTX documents. The script will also download the documents as part of the scraping process.
Starting URLs: https://aws.amazon.com/events/events-content/?awsf.filter-series=event-series%23reinvent
The source code and HTML output can be found here on GitHub.