An Introduction to Web Scraping using Python

The basics of gathering data from the web: pages and APIs, submitting forms, dealing with JavaScript-driven DOMs, and a side-by-side of BeautifulSoup, lxml and regular expressions. It ends with the ethics: when you should, when you shouldn’t, and how to scrape without getting banned. The first version of this was my first conference talk ever, and my first international one as well.