Dsij Stock Market Book Free Download there. Getting a job in data science is as much about finding a company whose needs match your skills as it is developing those skills.
Hey Karthikeyan, BeautifulSoup is a library that “parses” HTML or XML content. In other words, it reads your HTML file and helps extract content from it. Scrapy is a full blown web scraping framework. That means, it already has the functionality that BeautifulSoup provides along with that it offers much more.
When you are developing a web scraping system, you would need a way to send requests to the websites (probably using requests or urllib), you would need a way to send multiple requests at once(multiprocessing/asynchronous) so that you can download content faster. You would also need a way to export your downloaded content in various required formats, if you are working on large scale projects, you would require deploying your scraping code across distributed systems.
Comments are closed.