Skip to content

lowdias/Scrapper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

4912087 · Nov 29, 2021

History

11 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Install the packages in requirements.txt and install mongodb and ideally Robo 3T for better visualisation,
in scrapper_main.py execute every function one by one, do not execute the whole script in one go!!!!

Scrap_bbc_landing():
Scraps the landing page of http://bbc.com and store the scrapped articles in the news database of
the mongo database hosted on the cloud at cloud.mongodb.com

dbmongo_query_articles("China"):
Non case sensitive search for the word China in the articles scrapped.

The mongo database is hosted on the cloud at cloud.mongodb.com

About

Data Engineering Coding Challenge

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages