Skip to content

Scrapes comments from guardian articles and outputs them to JSON or CSV

Notifications You must be signed in to change notification settings

tfeltwell/Guardian-comment-scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Guardian comments scraper

Scrapes comments from guardian articles and outputs them to JSON or CSV formats.

Requires python and BeautifulSoup (pip install BeautifulSoup)

Usage

python scrape.py <url>

With format specified (defaults to json)

python scrape.py <url> -o csv

With a list of links (one per line)

python scrape.py <file.txt>

About

Scrapes comments from guardian articles and outputs them to JSON or CSV

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages