Do It Yourself – Tutorials – Let's Build a Python Web Scraping Project from Scratch | Hands-On Tutorial

by | Apr 18, 2021 | 0 comments

Do It Yourself – Tutorials – Let's Build a Python Web Scraping Project from Scratch | Hands-On Tutorial

by | Apr 18, 2021 | Do It Yourself - Build Your Own Website | 0 comments

Do It Yourself – Website Tutorials



Join our upcoming 20-week data science boot camp: https://www.jovian.ai/data-analyst-bootcamp

💻 Web scraping is the process of extracting and parsing data from websites in an automated fashion using a computer program. It’s a useful technique for creating datasets for research and learning.

🔗 Resources used in the workshop:
– Rough notebook: https://jovian.ai/aakashns-6l3/scraping-github-topics-repositories-rough
– Final notebook: https://jovian.ai/aakashns-6l3/scraping-github-topics-repositories
– Web scraping project guide: https://jovian.ai/aakashns/python-web-scraping-project-guide
– Web scraping tutorial: https://jovian.ai/aakashns/python-web-scraping-and-rest-api

In this workshop, we’ll use Python and its ecosystem of libraries to scrape information from a website and create a dataset of CSV file(s).

Here are the steps we’ll follow to build a web scraping project from scratch:
✅ Pick a website and identify the information to be scraped into a CSV file
💾 Use the requests library to download web pages from the site programmatically
💬 Use Beautiful Soup to parse and extract information from web pages
📝 Create well-formatted CSV file(s) with the extracted information
✍ Document and share your work online in the form of a Jupyter notebook or blog post

Time Breaks:
Introduction 00:00
Problem Statement 7:03
Setting up Jupyter 21:05
Fetching pages with requests 31:23
Parsing pages with beautifulsoup 39:23
Saving data to CSV files 1:07:36
Scraping another page 1:09:04
Defining functions 1:17:29
Putting it together 1:36:34
Documentation 2:03:28
Publishing your notebook 2:32:09
Q&A 2:34:17

🎤 About the speaker
Aakash N S is the co-founder and CEO of Jovian – a community learning platform for data science & ML. Previously, Aakash has worked as a software engineer (APIs & Data Platforms) at Twitter in Ireland & San Francisco and graduated from the Indian Institute of Technology, Bombay. He’s also an avid blogger, open-source contributor, and online educator.


Learn Data Science the right way at https://www.jovian.ai
Interact with a global community of like-minded learners https://jovian.ai/forum/
Get the latest news and updates on Machine Learning at https://twitter.com/jovianml
Connect with us professionally on https://linkedin.com/company/jovianml
Subscribe for new videos on Artificial Intelligence https://youtube.com/jovianml

source

0 Comments

Submit a Comment

What Our Clients Are Saying

Amplifylife.ca

Been working with Leland on a project for a Not-For-Profit organization and it is a pleasure to be able to...

Rob - Amplylife.ca

Dieno Digital Marketing Services
5
2018-05-03T19:49:40+00:00

Rob - Amplylife.ca

Been working with Leland on a project for a Not-For-Profit organization and it is a pleasure to be able to bring a high level of creativity, energy, expertise and professionalism to the project for their digital marketing needs. We are so excited for the chance to work more with Leland and Dieno Digital.

FS Designs

Leland is extremely knowledgeable and super pleasant to deal with. He helped me get my website running for my graphic...

F.S.

Dieno Digital Marketing Services
5
2018-06-19T18:50:18+00:00

F.S.

Leland is extremely knowledgeable and super pleasant to deal with. He helped me get my website running for my graphic design business and improved my SEO so that I appear more frequently and near the top of searches. He a great digital and web strategist and I would highly recommend his services.

Juju Hair Lounge

Great class! Not only was it very informative but it was also really entertaining! I can't wait to apply everything...

Leah

Dieno Digital Marketing Services
5
2018-07-09T03:06:21+00:00

Leah

Great class! Not only was it very informative but it was also really entertaining! I can't wait to apply everything I've learned to our Facebook business page!

Uniglobe Travel – Western Canada

I enjoyed the workshop, we covered a broad range of topics in a short space of time, but I appreciated...

Ciara

Dieno Digital Marketing Services
5
2018-07-10T03:22:20+00:00

Ciara

I enjoyed the workshop, we covered a broad range of topics in a short space of time, but I appreciated that there was some concrete, actionable advice given as well!
5
4
Dieno Digital Marketing Services
[newsletter_form]
<div class="tnp tnp-subscription"> <form method="post" action="https://www.dienodigital.com/?na=s"> <input type="hidden" name="nlang" value=""><div class="tnp-field tnp-field-firstname"><label for="tnp-name">First name or full name</label> <input class="tnp-name" type="text" name="nn" value=""></div> <div class="tnp-field tnp-field-email"><label for="tnp-email">Email</label> <input class="tnp-email" type="email" name="ne" value="" required></div> <div class="tnp-field tnp-field-button"><input class="tnp-submit" type="submit" value="Subscribe" > </div> </form> </div>