From the course: Skill Up with Python: Hands-On Data Science and Machine Learning Projects

Unlock this course with a free trial

Join today to access over 25,500 courses taught by industry experts.

Learn about web-scraping tools in Python

Learn about web-scraping tools in Python - Python Tutorial

From the course: Skill Up with Python: Hands-On Data Science and Machine Learning Projects

Start my 1-month free trial Buy for my team

Learn about web-scraping tools in Python

“

- Alright, so let's get started here by talking about just the basic idea of web scraping tools in Python in general. And really the first thing to know about web scraping is that at the end, most of the time it's just making basic requests to different websites and taking the HTML or other data that we get back from those websites and parsing it in order to get some kind of data from it. So, to give you an example of this, just to do a very brief demonstration, there are more specific tools that we'll be using for the actual parsing. Well, let's say that we wanted to collect data about different articles from Hacker News, right? Which is a, you know, a very popular site. Just there's lots of interesting news article links on here. So let's say that you wanted to be able to pull the data for these articles and sort of create your own data set from that. Well, the first thing that you would have to do, and this is going to be true, as I've said, of most of the web scraping you're going…

Contents