Code

Add Marin County Scraper#80

Code

Merged

elaguerta merged 50 commits intomastersfbrigade/data-covid19-sfbayarea:masterfrom marin-countysfbrigade/data-covid19-sfbayarea:marin-countyCopy head branch name to clipboardSep 3, 2020

+279-6

Commits

Commits on May 19, 2020

• i think I got series data for the cases

  kwonangela7

  committed
  95f93c2

  Copy full SHA for 95f93c2

Commits on May 26, 2020

• tried a variety of things to download csvs, eventually selected the right element and clicked on the right elt, but nothing downloaded. switching methods anyway, so going to scrap this code

  kwonangela7

  committed
  46d23cf

  Copy full SHA for 46d23cf

• added in Rob's suggested code

  kwonangela7

  committed
  e3e2357

  Copy full SHA for e3e2357

Commits on May 27, 2020

• revised csv parsing logic now that I'm working with a csv_string

  kwonangela7

  committed
  9893f63

  Copy full SHA for 9893f63

Commits on Jun 2, 2020

• finished breakdown parsings

  kwonangela7

  committed
  a5a66d8

  Copy full SHA for a5a66d8

Commits on Jun 10, 2020

• finalized series and test scraping methods with function annotations and raised exceptions

  kwonangela7

  committed
  a27073f

  Copy full SHA for a27073f

• fixed the bug so that only chart notes from the charts I'm looking at are pulled, and put in get_data_model function that Elaine wrote

  kwonangela7

  committed
  30ccf08

  Copy full SHA for 30ccf08

• Merge branch 'master' of https://github.com/sfbrigade/data-covid19-sfbayarea into marin-county

  kwonangela7

  committed
  cffeaea

  Copy full SHA for cffeaea

• moved marin scraper to folder

  kwonangela7

  committed
  cb9947c

  Copy full SHA for cb9947c

Commits on Jun 11, 2020

• deleted extra copy of marin_scraper.py

  kwonangela7

  committed
  b53c84e

  Copy full SHA for b53c84e

Commits on Jun 20, 2020

• pulled new files

  kwonangela7

  committed
  ac14dfb

  Copy full SHA for ac14dfb

• converted tab to 4 spaces

  kwonangela7

  committed
  c108ac1

  Copy full SHA for c108ac1

• raised error for wrong kind of href

  kwonangela7

  committed
  c6a969f

  Copy full SHA for c6a969f

Commits on Jun 24, 2020

• Merge branch 'master' into marin-county

  kwonangela7

  committed
  c3b6f1a

  Copy full SHA for c3b6f1a

Commits on Jun 28, 2020

• Update covid19_sfbayarea/data/marin_scraper.py

  Show description for 0156f85
  

  kwonangela7

  and

  Mr0grog

  authored
  0156f85

  Copy full SHA for 0156f85

• changed module name

  kwonangela7

  committed
  029f367

  Copy full SHA for 029f367

• deleted marin_scraper.py

  kwonangela7

  committed
  cf1ddb3

  Copy full SHA for cf1ddb3

• Merge branch 'master' into marin-county

  kwonangela7

  committed
  07760b2

  Copy full SHA for 07760b2

• renamed file, will rename at the end lol

  kwonangela7

  committed
  a36b2c0

  Copy full SHA for a36b2c0

• renamed county function, added scraper to init file

  kwonangela7

  committed
  0aadb08

  Copy full SHA for 0aadb08

• pls ignore previous renaming commits, this is the actual commit to properly use the scraper script

  kwonangela7

  committed
  37880a6

  Copy full SHA for 37880a6

• removing file with the wrong name

  kwonangela7

  committed
  9b90510

  Copy full SHA for 9b90510

Commits on Jun 29, 2020

• added import to init statement

  kwonangela7

  committed
  8b2f8b9

  Copy full SHA for 8b2f8b9

Commits on Jul 1, 2020

• used soup.select('h4+p') instead of find_next_sibling + threw error

  kwonangela7

  committed
  39ce2bb

  Copy full SHA for 39ce2bb

Commits on Jul 7, 2020

• fixed get_case_series to use csv modeul, not use numpy, and use the proper date object.

  kwonangela7

  committed
  7521dfb

  Copy full SHA for 7521dfb

Commits on Jul 8, 2020

• fixed case and deaths series data + breakdown functions to use csv module instead of manual parsing

  kwonangela7

  committed
  1e3fcbc

  Copy full SHA for 1e3fcbc

Commits on Jul 11, 2020

• testing to get the most recent commits on this branch

  

  Angela Kwon

  authored and

  Angela Kwon

  committed
  5b04be9

  Copy full SHA for 5b04be9

• Merge branch 'marin-county' of https://github.com/sfbrigade/data-covid19-sfbayarea into marin-county

  

  Angela Kwon

  authored and

  Angela Kwon

  committed
  850650e

  Copy full SHA for 850650e

Commits on Jul 15, 2020

• simplified test logic

  kwonangela7

  committed
  2ba5273

  Copy full SHA for 2ba5273

Commits on Jul 16, 2020

• fixed testing data logic, fixed age mappings. The raw counts for age groups don't match up with the numbers on the spreadsheet I just downloaded but not sure why

  kwonangela7

  committed
  d574680

  Copy full SHA for d574680

Commits on Jul 17, 2020

• fixed linter errors

  kwonangela7

  committed
  0b94cc4

  Copy full SHA for 0b94cc4

• Merge branch 'master' into marin-county

  kwonangela7

  authored
  f7f532b

  Copy full SHA for f7f532b

• ready to write up code in context managers tomorrow

  kwonangela7

  committed
  eb079be

  Copy full SHA for eb079be

• Merge branch 'marin-county' of https://github.com/sfbrigade/data-covid19-sfbayarea into marin-county

  kwonangela7

  committed
  0fc2903

  Copy full SHA for 0fc2903

Commits on Jul 18, 2020

• rewrote metadata and extract csv functions using context managers

  kwonangela7

  committed
  862a240

  Copy full SHA for 862a240

Commits on Jul 23, 2020

• fixed half of metadata function, not sure what's wrong with the other part

  kwonangela7

  committed
  153d379

  Copy full SHA for 153d379

Commits on Aug 18, 2020

• fixed metadata function - finallygit add covid19_sfbayarea/data/marin.py just wasn't waiting long enough..

  kwonangela7

  committed
  90e75ee

  Copy full SHA for 90e75ee

• Merge remote-tracking branch 'origin/master' into marin-county

  kwonangela7

  committed
  176cbd7

  Copy full SHA for 176cbd7

Commits on Aug 22, 2020

• added data points to data model needed for marin, updated README, and scraper is ready for second round of review.

  kwonangela7

  committed
  6d12de7

  Copy full SHA for 6d12de7

• fixed linter issue

  kwonangela7

  committed
  04e62e1

  Copy full SHA for 04e62e1

Commits on Aug 29, 2020

• Update covid19_sfbayarea/data/marin.py

  Show description for ef46d85
  

  kwonangela7

  and

  elaguerta

  authored
  ef46d85

  Copy full SHA for ef46d85

• removed instances of inmate as that data is not collected by marin county moving forward

  kwonangela7

  committed
  b4826cc

  Copy full SHA for b4826cc

• updated README - inmate section

  kwonangela7

  committed
  e4f586f

  Copy full SHA for e4f586f

• Merge branch 'marin-county' of https://github.com/sfbrigade/data-covid19-sfbayarea into marin-county

  kwonangela7

  committed
  c1e3be8

  Copy full SHA for c1e3be8

• updated Race and Ethnicity README

  kwonangela7

  committed
  e4b185b

  Copy full SHA for e4b185b

• made sure to use 4-space indentation, fixed test series function to only scrape positive test data

  kwonangela7

  committed
  d35f453

  Copy full SHA for d35f453

• updated meta_from_baypd

  kwonangela7

  committed
  eb7c0c1

  Copy full SHA for eb7c0c1

• updated meta_from_source

  kwonangela7

  committed
  f5d8ae1

  Copy full SHA for f5d8ae1

• updated meta_from_source about testing data nuances

  kwonangela7

  committed
  3a03180

  Copy full SHA for 3a03180

Commits on Sep 3, 2020

• Delete inmates from population_totals

  elaguerta

  committed
  6d55284

  Copy full SHA for 6d55284