Skip to content

Releases: Police-Data-Accessibility-Project/scrapers

CSV Exports and Dataset creation (Experimental Linux support)

06 Jan 19:01
Compare
Choose a tag to compare

Dataset creation within the GUI is now possible!
Once you have finished setting the information for the dataset, upload the csv files created by the GUI to their respected table on our dolthub

I'm not 100% sure the Linux files will work yet, create an issue if you have a problem with it please!

Checksums

File: scrapersetup_windows.zip
SHA256: 4FB6281376DF8C8BA6264A42715013021411B204573D27403148DA14F63C2C68

File: scrapersetup_linux.zip
SHA256: 7AD857BD5930456EEF107325D80CA8BB8B5DEAC1CA70F37A763F8F5839AC0102

What's Changed

Full Changelog: v0.0.5...v0.0.6

Better schema creation

09 Dec 18:45
cdfa329
Compare
Choose a tag to compare
  • Parse homepage_url using urllib's urlparse to make the select statement more lenient by using netloc
  • Fixed bug where results weren't displayed if only one result was returned
  • Added alternative way of searching for agencies (city + state_iso)
  • Replaced prints with logging module to make it a little more readable

What's Changed

Full Changelog: v0.0.4...v0.0.5

Checksum

File: scrapersetup_windows.zip
SHA256: 2eabb457f51020a06e36900587338b416e33355be7e21b9342fc7127be7cbb9f

Fixed GUI Issues

22 Oct 12:58
dce3dbe
Compare
Choose a tag to compare

~ Fixed issue with sections of GUI going off the window on certain monitors.

What's Changed

Full Changelog: 0.0.3...v0.0.4

Schema creation support

22 Aug 18:19
5e06939
Compare
Choose a tag to compare
  • The GUI will now autofill the first portion of the schema, and sections of the data portion
  • Fixed an issue with scaling on high DPI screens
  • Moved the readme to setup_gui

Bugfixes

12 Aug 19:11
63d7a52
Compare
Choose a tag to compare
  • Fix for issue #148
  • Scripts in Base_Scripts were the function version instead of the module version
  • Fixed and added comments
  • Renamed the script from scraper_setup to ScraperSetup

Initial GUI Release

10 Aug 19:06
Compare
Choose a tag to compare
Initial GUI Release Pre-release
Pre-release

First release of the scraper creation gui